Commit Graph

110 Commits

Author SHA1 Message Date
evilhero 75d77546fe FIX: if 32p was disabled due to inability to signon, would still attempt to retrieve cached result when match occured which would then possibly result in excessive attempted logins, IMP: Added Force Type option to comicdetails page which will allow the type of series to be forced to TPB/GN format if Mylar is unable to decipher it under normal circumstances (doing this will affect how files are parsed for the given series), IMP: TPB/GN File Parser will now account for mutiple issues of the same TPB series within the given directory, IMP: When enabling/disabling Force Type, will rename existing folder to accomodate new naming folder convention if required, IMP: Started to move some of the file rename/manipulation modules into a filer.py module for more consistency, IMP: Added a to Folder Format which when triggered will use the designated Series Type, IMP:(#2130) When importing, option now available for the final series destination path to use the imported path location instead of defaulting to the Comic Location base folder - status will be no longer be Archived in such cases. Will also not show previous imported series on subsequent import runs if the import directory has not changed (thnx @CuddleBear92), IMP: Added the codebase for a Rename Preview option into the mix - GUI available, but not linked, FIX: Removed DEM from RSS scans when Public Torrents option is enabled, FIX:(#2137) When adding series, if series indicated date in a different format other than just numeric, would cause error 2018-12-10 12:27:53 -05:00
evilhero 851799f642 FIX: Added global reference so can change WWT URL in one location in __init__, FIX: Changed WWT to new domain, FIX: Removed DEM from being used 2018-12-04 14:34:10 -05:00
evilhero 16ae80c137 FIX:(#2066) When series titles began with the word 'vol', search results would be rejected or incorrectly parsed due to volume testing incorrectly, FIX: Removed the rss feed being logged when retrieving feeds 2018-09-06 12:49:50 -04:00
evilhero f7c1629679 IMP: Tiered wanted list searching - anything older than 2 weeks will only by searched for using RSS and/or manual means (scheduled searches only), IMP: Tiered option viewable in Upcoming tab, FIX: Fixed API searching against WWT option (RSS is still broken however, as that is due to WWT), IMP: Removed cherrypy logging in some instances, IMP: Updated cfscrape library to most recent, FIX: Fixed problem with simliar titles being incorrectly post-processed due to multiple matches when manual post-processing, FIX: Fixed notifications not firing off on a successful manual post-process/folder monitor due to some previous changes, FIX: If grabbag_dir was not set, would not correctly set the location, FIX:(#2051) When using nzbget, if nzbToMylar is enabled along with CDH - warning will be issued within Mylar to indicate as such 2018-08-31 12:03:54 -04:00
evilhero a895f3f8d3 FIX:(#1905) Unicode errors when logging and system language is not a subset of english, IMP: Added post-processing queue (currently just for forceProcess api, but will be used by default for all post-processing actions soon), IMP: Multiple Torznab support added, IMP: Logging values for number of files and size/file added to config, IMP: Pushover notifications can be sent to specific device now, IMP: Added nzbget, newznab, nzb.su and dognzb test options, IMP: Added graphical checkmark/x when performing various tests (providers, downloaders, notifiers) within configuration, IMP: Removed some more unnecessary logging lines from searches 2018-04-06 13:46:39 -04:00
evilhero b0d2ab5430 IMP: Added 0-day pack support for 32p (definitely beta quality), FIX: Reconfigured post-process api to allow for direct post-processing of issues/packs directly to either issueid/comicid as appropriate, FIX: Removed some unnecessary logging, IMP: Added better error/logging handling for 32p authentication (will now return proper error instead of a generic message), FIX: auto-snatch environment variables set to use temporary values instead of reusing incorrect globals 2018-03-22 10:00:34 -04:00
evilhero 3e9d7a87a7 FIX:(#1876) When adding file to uTorrent via snatch, Mylar would successfully add but return an error due to an invalid format 2018-03-02 02:08:49 -05:00
evilhero 0ff38c164e IMP: Added Choose specific Download option to manually select from result list on Upcoming/Details/Weekly tabs, IMP: Added Wanted storyarcs to the overall Wanted section so now will search as per global options (storyarc issues can be displayed optionally on Wanted tab), IMP: Added custom url option for image banners/posters for storyarcs, IMP: updated Cherrypy, FIX: Fixed ComicRN not working when forms authentication used - in conjunction updated autoProcessComics to 2.0 which now uses apikey instead of user/pass, IMP: Alternate Series Covers option for alternating existing series image to the most current issue image, IMP: Added overall series total to series page for reference, IMP: Search workflow completely changed to accomodate more than one indexer - now will simultaneously sumbit initial request to each provider, wait 30s submit additional as required at 30s intervals, FIX: Removed TPSE as an option and relabelled to just Public Torrents, IMP: Added direct backlog search to WWT option (pack support will follow), FIX: Removed line about configparser being required for ComicTagger usage, IMP: Test code in place for newzab testing, FIX: Fixed layout problem with torrents that are in auto-snatch status on weekly tab, IMP: backend code improvements to allow for better alias usage and annual linking directly from WS, IMP: Updated systemd init-scripts with read.me, IMP: When post-processing, will now check for available destination free space before actually moving files, IMP: Will copy during metatagging to cache folder instead of move being an option so cleanup is cleaner if something fails, FIX: Changed readinglist table to storyarcs for clarity, IMP: When post-processing issues, will now only update the one issue status and adjust totals accordingly (instead of doing a complete rescan of the series), FIX: Clear out empty ID's from the Failed DB on startup, IMP: Initial code-run at REST API interface, FIX: Fixed some matching problems with 32p due to case, IMP: removed apikeys from log entries that were accidentally logging, IMP: When searching 32p, if items get packed up - will now delete the cached reference so new items of the same can be located, IMP: ForceSearch option switched to scheduler so simultaneous runs should not occur, FIX: Fixed manual metatagging error that would occur if multiple destination directories existed 2018-02-16 14:57:01 -05:00
evilhero c02c946f35 FIX: (#1779) Download button from weekly pull would return a 500 error, FIX: When editing the Alternate Search Name field on the series detail page, would drag and drop the text box instead of highlighting the text within, FIX: Fix for filechecker/post-processor erroring out on an 'alt_series' message and/or creating .BAD files during post-processing, IMP: Removed some more unneeded logging lines 2017-11-26 02:30:40 -05:00
evilhero 7421ffb12d FIX:(#1776) If newznab provider does not have the rss url on the same url as the api, rss would always return 0 hits. Now will try to use rss url first, and if fails diretly query the api for the last 100 items, IMP: Will now disable nzb provider that returns a 503 in response to a query (timed feature coming), FIX: Some issues arose when 0 providers were enabled after disabling, as well as if torrents were disabled but the torrent provider was enabled, IMP: Removed some unnecessary logging when peforming provider order search sequence 2017-11-22 13:23:52 -05:00
evilhero c45a70b0da IMP: Added config.ini option to not create series folders (create_folder=True/False) when adding/refreshing series, IMP: Adde test connection button for rtorrent, FIX: Fixed weekly pull recreate, FIX: Removed TorrentProject from public torrent searches, FIX: Updated url for demonoid again, FIX: Fixed schedulers not running/returning error when forced from schedulers tab, IMP: Removed some more unnecesary logging lines 2017-11-16 11:22:46 -05:00
evilhero 1585bd321e FIX: incorrect global reference when rss checking against public torrents 2017-10-26 18:47:23 -04:00
evilhero c95b3d847c IMP: Redid configuration completely - added config module and changed structures accordingly. Allow for minimal ini configuration (minimal_ini=True). Updated global/config variables throughout each module as required. Provider order sequence now generated on each save (no longer requires a restart). Bunch of other fixes that were either part of the configuration changeover, or the result of and had to be changed/fixed in order for the this to work 2017-10-25 14:33:56 -04:00
evilhero 3671a81096 FIX:(#1712) Fix for incorrect variable reference when using public torrents with watchdir 2017-09-13 13:18:14 -04:00
evilhero 21eee17344 IMP:New scheduler tab (Manage / Activity) where you can see job current run status', next runtime, and prev runtimes as well as force/pause a job, FIX: Disabling
torrents will now properly hide torrent information, IMP: Specified daemon port for deluge as an on-screen tip for more detail, IMP: Added 100,200,ALL as viewable
watchlist views, FIX: When viewing pullist and annual integration enabled, if annual was present would incorrectly link to invalid annual series instead of the
actual series itself, IMP: Added more detail error messages to metatagging errors and better handling of stranded files during cleanup, IMP: Improved some handling for weekly pull-list one-off's and refactored the
nzb/oneoff post-processing into a seperate function for future callables, Moved all the main url locations for public torrent sites to the init module so that it
can be cascaded down for use in other modules instead as a global, IMP: Added a 'deep_search_32p' variable in the config.ini for specific usage with 32p, where
if there is more than one result will dig deeper into each result to try and figure out if there are series matches, as opposed to the default where it will only use ref32p
table if available or just the first hit in a multiple series search results and ignore the remainder, FIX:Fixed some unknown characters appearing in the pullist due
to unicode-related conversion problems, FIX: fixed some special cases of file parsing errors due to Volume label being named different than expected, FIX: Added a
3s pause between experimental searches to try and not hit their frequency limitation, IMP: Weekly Pullist One-off's will now show status of Snatched/Downloaded as
required, FIX: Fixed some deluge parameter problems when using auto-snatch torrent script/option, IMP: Changed the downlocation in the auto-snatch option to an
env variable instead of being passed to avoid unicode-related problems, FIX: Fixed some magnet-related issues for torrents when using a watchdir + TPSE, FIX: Added
more verbose error message for rtorrent connection issues, FIX: Could not connect to rtorrent client if no username/password were provided, IMP: Set the db updater to run
every 5 minutes on the watchlist, automatically refreshing the oldest updated series each time that is more than 5 hours old (force db update from the activity/job schedulers page will run the db updater
against the entire watchlist in sequence), IMP: Attempt to handle long paths in windows (ie. > 256c) by prepending the unicode windows api character to the import
a directory path (windows only), IMP: When manual metatagging a series, will update the series after all the metatagging has been completed as opposed to after each
issue, IMP: Will now display available inkdrops on Config/Search Providers tab when using 32P (future will utilize/indicate inkdrop threshold when downloading)
2017-09-10 11:50:08 -04:00
evilhero d2b8ffebad FIX:(#1702) Fix for WWT domain change as well as a quick patch for future domain changes 2017-09-05 21:27:54 -04:00
evilhero cef6732a9d FIX:(#1678) When searching 32p, would use os-based dates for comparisons which caused problems when it was not English. Now will convert non-English timestamps into an English format so that comparisons will work properly again. 2017-07-13 14:03:32 -04:00
evilhero e48ff520a1 FIX:(#1667) 32p api searches returned invalid timestamps when OS being used has a different long-date format than expected, FIX: Public torrent searches would error due to size of torrent being in KB instead of expected MB,GB (added TB acceptance as well) 2017-07-09 14:51:54 -04:00
evilhero f9b08c6da6 FIX:(#1667) Demonoid RSS date changes caused RSS to not populate and failure to continue rss searches/populating 2017-06-29 13:50:00 -04:00
evilhero 3d91a5e521 FIX: Fix for TPSE switching to magnets only - will now send magnet link to chosen client, IMP: Telegram & Pushover notifications will now take on-screen data for test connections instead of always from cached, IMP: SABnzbd test connection will take on-screen data for test connection instead of always from cached, FIX: Quick fix for torrent-auto-snatcher trying to snatch single issues when the directory only contains the 1 file, FIX: On 32p, when doing api search and then verifying posting date of issue against store date of issue, would take the posting date as a string thinking it was an integer and causing mismatches for snatches (usually on mutli-volume series) 2017-06-08 20:23:59 -04:00
evilhero 535c557e30 FIX:(#1630) One-off issues will now be post-processed according to grab-bag dir location, IMP: One-off pull-list issues will now have the status marked accordingly on weekly pullist for tracking purposes, FIX: Fix for utorrent not being able to update status properly after initial snatch, FIX: Fix for some incorrect variable references due to different snatch methods when trying to run on-snatch scripts, FIX: Fix for auto-torrent-snatcher trying to snatch a torrent with an '&' in the filename, FIX:(#1637) Fix for telegram not saving on snatch toggle properly, IMP: added additional logging for metatagging when attempting to create temp folder in cache location, IMP: will now clean up any left over metagtagging directories that fail during normal post-processing instead of leaving and continuing, FIX: Will notify on one-off grab's/storyarc's being post-processed, FIX: fix for displaying cbz issue details (the 'i' on the comic details page) in which the series title contained non-alphanumeric characters, IMP: Added ability to change status to Wanted on Upcoming tab (will perform an immediate search on selected issues), IMP: Threaded the one-off search call from the weeklypull 2017-06-02 10:05:06 -04:00
evilhero 2bba83a6d3 FIX:(#1633) Various problems related to qBittorrent - labels not being set properly, some qBittorrent settings would not persist across sessions, snatches would cause an error and/or stop the snatch from being sent in some instances (or trigger failed download handling if it was enabled), FIX: Fixed some os.environ problems when using on-snatch scripts combined with one-off downloads 2017-05-07 13:44:18 -04:00
evilhero 003d3bad7a FIX:(#1627) Fix for torrents using local watchdir as an option erroring out after a snatch, FIX: Added auto_snatch_script location field to allow for seperate auto_snatch script location in addition to other custom on-snatch script, IMP: torrent hashes were not being saved to snatch db for future reference in some cases 2017-05-01 14:42:14 -04:00
evilhero c5e46e552f IMP: Added Qbittorrent download client option, FIX:(#1604)Folder Name with a . at the end appears mess up on windows, FIX:(#1607) invalid reference to arc variable during post-processing, IMP: added an auto-snatch option for rutorrent/deluge seedbox users on nix systems (will automatically download the file to a local client for immediate post-processing), IMP: can now run custom script on snatch, FIX: Fixed a problem with volume labels getting reset on series refreshes to None, FIX: When recreating the pull (either automated/manual), will now wipe out the existing entries from the table prior to getting new information, IMP: Will now store hash of torrent (if applicable) when storing snatch information 2017-04-28 02:12:45 -04:00
evilhero 2246aacc7d FIX:(#1600) Folder volume naming will now default to V1 if not indicated and the tag is used as well as the new SETDEFAULTVOLUME to True in the config.ini, FIX: Fix for post-processing getting locked up on some machines due to story arc post-processing, FIX: Fixed some incorrect css references resulting in some weird displays, FIX: If 32P torrent feed didn't have a torrent size, would error, IMP: Can now add/remove story-arc issues from directly within story-arcs. They will stay removed until arc is deleted. Added arcs are done by providing an issueid and a reading order number to set it to. IMP: Can now change reading order number by directly clicking on reading order column and entering in new sequence number. Screen refresh needs to be done thereafter still however. 2017-04-04 11:19:40 -04:00
evilhero 5399f6dfcc FIX: fix for last PR with whitespaces and bad characters within 2017-03-15 14:40:17 -04:00
evilhero d2fc2b6d02 FIX: just some whitespace errors 2017-03-15 13:28:59 -04:00
barbequesauce 69cc847715 Add random delay to avoid DDOS protection
Add random delay to avoid DDOS protection (per issue 1571)
2017-03-15 13:26:45 -04:00
evilhero e10b2b7b9b FIX:(1564) Fake the RSS Feed generation for nzbhydra so it can poll against the last 100 entries via api, instead of rss query 2017-03-15 13:05:37 -04:00
evilhero 26e6196d4b FIX: Quick patch for torrent comparisons during searches when either search results or series title contained a comma 2017-02-11 18:57:19 -05:00
evilhero a9b7da8690 FIX:(#1548) Fix to allow for continuation of polling RSS Feeds if provider is non-responsive 2017-01-25 13:27:03 -05:00
evilhero 0596c6366b FIX:(#1542) WWT Category update 2017-01-18 13:56:26 -05:00
evilhero 2188061ba1 FIX:(#1520)(#1523) DEM torrent provider changed domain causing downloads to point to incorrect domain link 2017-01-02 20:11:28 -05:00
Undeadhunter 48933364bb Incorperate cfscraper with 32pages auth/torrent download 2016-12-31 00:27:10 -05:00
Undeadhunter 7cb640500b Add Deluge for Torrent downloads 2016-12-19 10:17:19 -05:00
evilhero 9c6bb12dd1 FIX:(#1481) Legacy search of 32p gives incorrect snatches when TPSE is enabled 2016-12-13 10:15:15 -05:00
evilhero cef076ee83 FIX:(#1431) Fixed post-processing cleanup when using SAB + files resided in a sub-folder of the path sent from SAB, IMP: Added hardlink/softlink option for non-windows users (note that metatagging is forcibly disabled when these options are enabled), IMP: Added Enforce Permissions option to force Mylar to either force / ensure permissions are as set within Mylar, or to ignore permissions and just try to perform the given action (this is for adding series, post-processing, importing, arcs, etc), FIX: Fixed a problem where if local watchdir was set and a torrent downloader was selected, both would attempt to be used, but only the watchdir was actually utilized (now it's one or the other, never both), FIX: Mylar will now remove issues that are in Failed status that have incorrect Series Data attached, FIX:(#1438) When file-checking/post-processing if issue date in Mylar was current year and date in filename was the following year (for end-of-year issues), would cause traceback error, FIX: If series year polled from CV is incorrect or not provided, option is available in Edit Settings of series detail page that allows user to specify the correct series year, FIX:(#1427) Fixed a typo when the Scan Library option is used and ComicID's were able to be parsed from the files, FIX: When issues were archived, depending on if series had issues in a Downloaded status or not, would give different results to the Have totals, IMP: Manage tab / Manage Comics now has metatag option available to allow metatagging multiple series in a batch mode, IMP:(#1419) When 'write cvinfo' option is enabled, will now also write cvinfo into story arc directories when added / refreshed, FIX: Fixed a problem when group metatag was being used and causing errors, IMP: Manage Failed page now will link back to the series for easier reference, and the 'link' column was removed due to invalid references, FIX: Removed the 'issue not updated' from the series detail page as was not accurate, IMP: Added a Select Filtered Issues button to the series detail page to allow for selecting of all filtered issues (Show ALL MUST be enabled for it to work properly) 2016-11-02 11:00:56 -04:00
evilhero e971620b43 FIX: When alt_pull 2 method was offline, would fail to drop-down to alt_pull 0/1 method and continue checking for new releases, FIX:(#1402) Fixed adding directly to uTorrent client, FIX: Added some exception traps for when Wanted tab is inaccessible, FIX: Updating public tracker demonoid to use new url for rss feeds, FIX: should now account for unicode issue numbers when filechecking, FIX: Attempt to improve unicode handling when importing, FIX: When importing a series, would not flip into Manual Intevention status when more than one search result came back in some instances 2016-10-05 10:12:58 -04:00
evilhero eea07cfc3f FIX: RSS error when retrieving some feeds 2016-09-07 01:34:51 -04:00
evilhero a036e554d2 Fixed some incorrect lib references 2016-09-07 00:04:42 -04:00
evilhero 9679d7a6ed Merge branch 'lib-in-sys-path' of git://github.com/tresni/mylar into tresni-lib-in-sys-path 2016-09-06 11:45:28 -04:00
evilhero e36cb13e6a FIX:(#1358) nzbname error when retrieving nzb and assigning filename from WWT tracker, FIX:(#1372)(#1369) Fix for creating series folder when adding a series when series title contains either double quotation marks, or an asterisk, FIX:(#1373) Filechecker would ignore filenames that had the extension captialized, FIX:(#1366) When Comic Publisher is not provided on CV, would error during add, FIX: Attempted fix for unicode characters when importing (series title, filenames), FIX: Removed str references that would cause an error on weekly pull in some instances, FIX: When checking for watched series, if series title being checked against had only one word, would cause a traceback error, FIX: When attempting to retrieve results/torrents from TPSE and was behind cloudflare, would error out, IMP: file-size check now works for 32p feeds, FIX: When pullist issue was marked as Wanted and issue was populated on series detail page, occassionaly would not have the same status of Wanted, FIX: Fixed incorrect placement of Comic Location title in GUI, IMP: Added short description for Search Delay option within GUI, FIX:(#1370) multiple selection from Manage Comics tab (Refresh/Delete/Pause) would only select one item 2016-09-06 11:06:07 -04:00
Brian Hartvigsen 69eeb9b49d Put libs/ in sys.path
Update bs4 to latest version to fix issues
Get clean modules using `pip install --upgrade --target=lib`
Move cherrypy, mako, pystun, bs4 into lib directory
2016-08-23 00:01:41 -06:00
evilhero a850e386d4 IMP: Added new Public Torrent providers to TPSE option (will use TPSE for searches, and both WWT and DEM to poll RSS Feeds from), FIX: Removed KAT as a provider, IMP: Added ability for Retry Issue option to scan through all previous snatches instead of just using the last option, FIX: Tried to fix problems with Wanted tab causing an error when opening (usually after a new install), IMP: Will now store the last time that Mylar retrieved a pullist with alt_pull =2 method and will check every 2 hours for new issues and/or issues being delayed, FIX: Fixed a notification error when doing one-off downloads from the pull-list, FIX:(#1348) Fixed an issue with escape characters when performing a mass update change to the comic location (loc_move setting), FIX:(#1350) When post-processing if filename didn't have a year present, and volume of series wasn't given would cause an error 2016-08-20 17:56:30 -04:00
Brian Hartvigsen 5de91332ba Support for transmission 2016-08-11 01:43:11 -04:00
evilhero aa48391aae Added rutorrent options to GUI, restructured the watchdir options (local/remote) 2016-05-11 09:59:32 -04:00
Jason Cline 162094b980 Fix for branch check, Updated config HTML for uTorrent support. 2016-05-06 13:31:46 -04:00
Jason Cline 37cf39ccf4 Added uTorrent support 2016-05-05 11:11:39 -04:00
evilhero fad91809d3 FIX: When series contained an exclamation mark, would not match during post-processing/file-checking, FIX: Removed some unnecessary logging lines regarding rss results 2016-04-30 11:56:01 -04:00
evilhero 8f53f854ff FIX: When manually post-processing files, if files were in more than one subdirectory level deep would use incorrect path resulting in error, FIX:(#1261, #1262) Traceback error when searching and returned value had volume, FIX: If filenames had the Volume label after the issue number, would fail to recognize the series title properly resulting in errors during scanning, FIX: Removing imported series from the Import List via dropdowns, IMP: Improved upon imports matching up to series that have multiple volumes by comparing issue counts & years, IMP: If an import is determined to need manual intervention, will display only the results that have passed the issue counts/years/name matching as opposed to showing all the results, FIX: When moving files during an import will now only move those files that are attached to the specific grouping by series title/volume, FIX: Import Manual Intervention results sortable by Year column now, FIX: Fixed an errant callback to home during configuration saves that caused web browser error when used with reverse proxy, FIX: During story arc searching if a story arc had a '-' in the arc name, would not be able to find it, FIX: When adding a story-arc, if files pre-existed in the directory attached to the arc would error, FIX: When adding a series, if was used for Folder Format and the volume label didn't exist would label directory with 'noversion', FIX: Selecting to metatag annuals via the manual metatag option on the series detail page, FIX: When retrieving from KAT and response returned was a 404 would ignore it, now will retry alternate torcache site 2016-04-25 11:35:12 -04:00