Commit Graph

169 Commits

Author SHA1 Message Date
evilhero 36f544b6d9 FIX: 'str' object error during post-processing runs 2019-10-11 10:15:12 -04:00
evilhero e350eca3ef FIX:(#2359) Unicode logging error on status update during search 2019-10-07 13:20:18 -04:00
evilhero 15aadaaa23 FIX:(#2313) One-shot file name parsing would not properly detect details in some instances 2019-07-25 20:36:44 -04:00
evilhero 3d8661c3e1 FIX:(#2274) Repeat issue numbers in series incorrectly detected as duplicate 2019-05-09 10:36:29 -04:00
evilhero 8a2d00fb9e FIX:(#2238) Forgot formatting 2019-03-14 17:15:12 -04:00
evilhero c64d3d594e FIX:(#2238) Fix for incorrect variable reference IssueID 2019-03-14 15:39:29 -04:00
evilhero 99241f700a IMP: Added One-Shot as a type to weekly pull, allows for weekly one-offs to work as expected with one-shot issues, FIX: Fixed dbUpdater start sequence line to be logged so it's not just saying Update Completed 2019-02-02 16:18:57 -05:00
evilhero 41e5f42471 FIX:(#2179) Post-processing item would fail if match would occur on story-arc check, FIX: Fixed some sub-directory problems when doing various types of scans, IMP: Added booktype to filechecker parsing results, FIX: When downloading via DDL, would not adhere to the booktype as a restraint, IMP: Pack support added for DDL (available as a per series option), IMP: Added BookType & Aliases to the arc's section which will impact how issues/series are searched/post-processed/cheked when they're an issue from an arc, IMP: Initial codebase for the a queue manager section, IMP: Write DDL-Queue data to the sql table so that stalled/broken downloads can be resumed/deleted etc eventually, FIX: If a filename didn't have a valid issue number and it is a Print Edition, will now throw a warning indicating other options to try instead of causing a traceback, IMP: Updated snatch notifications so the notification header will just say 'Issue Snatched' with a brief description, FIX: Removed multiple import db lines from the helpers module, IMP: cleanup_cache variable (true/false) added to config section which will initiate a cleanup of items in the cache directory on startup which will remove items that are no longer needed, IMP: Changed some logging string concatenation lines to try and avoid traceback errors due to logging 2019-02-01 16:25:24 -05:00
evilhero ba011cc659 FIX:(#1519) Allow for scanning/checking of files whose issue numbers indicate seasons (must be numbered as #Winter, #Summer, #Spring, or #Fall) 2019-01-16 14:23:04 -05:00
evilhero d2e03646d2 FIX: Fix for TPB/One-Shot file rechecking expecting an issue number, but one not being present due to the type 2019-01-14 21:52:53 -05:00
evilhero 82bd567c32 FIX: When Rechecking series that are One-Shots, and the filename did not contain an issue number would cause an error and not scan in, FIX: if a Special did not contain an issue number (ie. One-Shot), would fail during parsing 2019-01-14 10:54:54 -05:00
evilhero a09ac48951 FIX:(#2148)(#2150) Auto-Search would get locked up after an RSS scan ran, which basically stopped any subsequent searches from firing off correctly until a restart, FIX:(#2159) Could not locaate files when trying to filecheck normal issues that had no year present, but had a Vxxxx present 2019-01-04 10:12:02 -05:00
evilhero 0c9ed00a13 IMP: Added 'Force to TPB/GN' option for printed editions and 'Force to Print' option for TPB/GN's (this WILL impact how files are scanned in - so make sure you have files named appropriately), IMP: Added One-Shot as a Type, FIX: Fixed incorrect variable reference to seriesvolume during post-processing of TPB series, FIX: Fixed refresh to fire off every 5 minutes, FIX: When post-processing and metatagging a cbz file with rename files not enabled, would indicate the new filename as being a copy of the existing file (ie. (1).cbz) which would carry over to a final filename, IMP: Allow Mylar to populate the alias list on add/refresh of a series if the aliases don't already exist in the Alternate Series field for the series, FIX: Fixed a problem with single quotes in series titles when using experimental search,
IMP: When searching for a one-off series, will accept either issues with an issue number or those with no issue numbers as acceptable search results when searching,  IMP: Updated search code to utilize the existing filename parser within Mylar when parsing the search results for more consistency
2018-12-22 17:48:14 -05:00
evilhero 75d77546fe FIX: if 32p was disabled due to inability to signon, would still attempt to retrieve cached result when match occured which would then possibly result in excessive attempted logins, IMP: Added Force Type option to comicdetails page which will allow the type of series to be forced to TPB/GN format if Mylar is unable to decipher it under normal circumstances (doing this will affect how files are parsed for the given series), IMP: TPB/GN File Parser will now account for mutiple issues of the same TPB series within the given directory, IMP: When enabling/disabling Force Type, will rename existing folder to accomodate new naming folder convention if required, IMP: Started to move some of the file rename/manipulation modules into a filer.py module for more consistency, IMP: Added a to Folder Format which when triggered will use the designated Series Type, IMP:(#2130) When importing, option now available for the final series destination path to use the imported path location instead of defaulting to the Comic Location base folder - status will be no longer be Archived in such cases. Will also not show previous imported series on subsequent import runs if the import directory has not changed (thnx @CuddleBear92), IMP: Added the codebase for a Rename Preview option into the mix - GUI available, but not linked, FIX: Removed DEM from RSS scans when Public Torrents option is enabled, FIX:(#2137) When adding series, if series indicated date in a different format other than just numeric, would cause error 2018-12-10 12:27:53 -05:00
evilhero 4a2015c549 Added config.ini option to reduce Total issues by Ignored status counts for a given series (ignore_total). Note, that you cannot have both ignore_total AND ignore_havetotal enabled - both will be disabledeach until only one is enabled) 2018-11-19 12:20:18 -05:00
barbequesauce 488f2934b7 FIX: Including ignored annuals in file rescan totals 2018-11-19 11:59:51 -05:00
evilhero 51fd4fb2fd FIX:(#2024) Annuals were not being recognized when performing a Recheck Files regardless of format being used 2018-07-21 13:15:14 -04:00
evilhero 1a71893e3e FIX: (#2006)(#1986) Auto-Want series were not being auto-added, and even after manually added would result in count error after sucessful post-processing, FIX: When filechecking, if a 'special' was included as part of the annuals of a given series, it would not be detected, IMP: (#1982) When ComicRN & Completed Download Handling (CDH) are both enabled, will now check to see if ComicRN is active for the given category in the respective client. If it is, CDH will not post-process and issue a warning and let ComicRN handle the post-processing, FIX: Fixed a utf-8 encoding error when 'Run script AFTER snatch' was enabled, FIX: (#2004) Possible fix for 500 error on Wanted tab, when series had an annual/special attached but was located in the incorrect table, FIX: Removed some logging lines when CDH is monitoring downloads 2018-06-30 14:35:52 -04:00
evilhero 2623bbcbaf IMP: Updated CT to a newer version - changed to use rarfile, fixes size invalid errors with some cbr's encountered during conversions, IMP: Search and Post-Processing Queues now added in order to queue up all searches/post-processing in sequence instead of loading lists and iterating through it and encountering various lock-related errors, IMP: In most cases, will now post-process directly against comicid/issueid/storyarcid instead of relying on relationship via nzb/torrent, FIX: realigned some checkboxes on series detail page, FIX: in configuration, indicated that ComicRN cannot be used when Completed Download Handling is enabled for a client now, FIX: Fix for issues named as 'special' that are part of the annuals section, but would not work in various portions (also will allow for naming differences in the future hopefully), FIX: Will now trap error properly when file cannot be located during dupecheck so that post-processing can continue without error, FIX: Fixed newznab test option on configuration screen so that it will return the correct response (previous was an invalid api endpoint), FIX: When retrieving image for storyarcs would error when no image was present and stop the process, FIX: accounted for some incorrect newznab responses that would return a non-api endpoint when retrieving via rss, which resulted in invalid nzbs, FIX: in some cases, weekly pull snatches would not update properly on the weekly page due to some db values not being written 2018-06-14 13:07:39 -04:00
evilhero 0c25634684 IMP: When comic location is changed for a given series, will rename the directory if possible as opposed to creating a new directory, IMP:(#1920) Ability to directly input a 32p series ID for more accurate search results via the series details page/edit tab, IMP: Better error messages regarding: no CV API key being set when searching, and no Comic Location being set when trying to add a series, FIX: When using test SABnzbd button, if SABnzbd was not enabled previously (meaning config saved after the option selected), the test would return a fail status, FIX: When post-processing annuals, would fail to update the correct table resulting in a null table entry that would cause further problems, IMP: Added 1 day grace to the date check when comparing search results to allow for some leniency with regards to timezone differences, FIX: Fixed slight display issue when 32p provider was enabled, but torrents were turned off (pack option was being shown in series page when it shouldn't have been) 2018-04-26 11:27:51 -04:00
evilhero b0d2ab5430 IMP: Added 0-day pack support for 32p (definitely beta quality), FIX: Reconfigured post-process api to allow for direct post-processing of issues/packs directly to either issueid/comicid as appropriate, FIX: Removed some unnecessary logging, IMP: Added better error/logging handling for 32p authentication (will now return proper error instead of a generic message), FIX: auto-snatch environment variables set to use temporary values instead of reusing incorrect globals 2018-03-22 10:00:34 -04:00
evilhero 312e699ef1 FIX:(#1893) In maintenance mode, when performing an import into a fresh install, the pull refresh date would not be populated due to the weekly pull not initializing on startup 2018-03-17 22:25:24 -04:00
evilhero 5553e940a0 FIX: When dupchecking and file-size was being returned as 0, would result in an assumed archived status and not post-process - now will recheck existing series dir if required, and run dupechk thereafter, FIX: Post-process was not updating file-size of post-processed issue 2018-03-07 10:02:48 -05:00
evilhero 0ff38c164e IMP: Added Choose specific Download option to manually select from result list on Upcoming/Details/Weekly tabs, IMP: Added Wanted storyarcs to the overall Wanted section so now will search as per global options (storyarc issues can be displayed optionally on Wanted tab), IMP: Added custom url option for image banners/posters for storyarcs, IMP: updated Cherrypy, FIX: Fixed ComicRN not working when forms authentication used - in conjunction updated autoProcessComics to 2.0 which now uses apikey instead of user/pass, IMP: Alternate Series Covers option for alternating existing series image to the most current issue image, IMP: Added overall series total to series page for reference, IMP: Search workflow completely changed to accomodate more than one indexer - now will simultaneously sumbit initial request to each provider, wait 30s submit additional as required at 30s intervals, FIX: Removed TPSE as an option and relabelled to just Public Torrents, IMP: Added direct backlog search to WWT option (pack support will follow), FIX: Removed line about configparser being required for ComicTagger usage, IMP: Test code in place for newzab testing, FIX: Fixed layout problem with torrents that are in auto-snatch status on weekly tab, IMP: backend code improvements to allow for better alias usage and annual linking directly from WS, IMP: Updated systemd init-scripts with read.me, IMP: When post-processing, will now check for available destination free space before actually moving files, IMP: Will copy during metatagging to cache folder instead of move being an option so cleanup is cleaner if something fails, FIX: Changed readinglist table to storyarcs for clarity, IMP: When post-processing issues, will now only update the one issue status and adjust totals accordingly (instead of doing a complete rescan of the series), FIX: Clear out empty ID's from the Failed DB on startup, IMP: Initial code-run at REST API interface, FIX: Fixed some matching problems with 32p due to case, IMP: removed apikeys from log entries that were accidentally logging, IMP: When searching 32p, if items get packed up - will now delete the cached reference so new items of the same can be located, IMP: ForceSearch option switched to scheduler so simultaneous runs should not occur, FIX: Fixed manual metatagging error that would occur if multiple destination directories existed 2018-02-16 14:57:01 -05:00
evilhero ea34294006 FIX: Fix for startup errors on clean installs referencing scheduler variables 2017-11-25 20:03:43 -05:00
evilhero e4541708b8 FIX: changed how scheduled jobs are ran when forced, which also fixed the db updater not returning to a Waiting status after it was run 2017-11-17 20:00:49 -05:00
evilhero ed55065779 FIX: fix for error during post-processing if multiple_dest_dirs was not present for a given series, FIX: set the versions for the comicrn & autoprocess correctly again 2017-10-28 12:33:59 -04:00
evilhero c95b3d847c IMP: Redid configuration completely - added config module and changed structures accordingly. Allow for minimal ini configuration (minimal_ini=True). Updated global/config variables throughout each module as required. Provider order sequence now generated on each save (no longer requires a restart). Bunch of other fixes that were either part of the configuration changeover, or the result of and had to be changed/fixed in order for the this to work 2017-10-25 14:33:56 -04:00
evilhero 98d705fabc FIX: Fix for db update running against older series and changing the status' incorrectly to Wanted when they should have been Skipped 2017-09-28 20:26:50 -04:00
evilhero 98471d1232 FIX:(#1732) Possible fix for issues not retaining previous status other than Skipped, during a DB update of a series 2017-09-24 13:35:45 -04:00
evilhero 53446dc638 FIX: Should be final fix for None status occuring that have caused several pullist/refresh problems, IMP: Will check on startup for any series that contain issues with a None status, and automatically refresh those in the background so that things can be properly accounted for again. 2017-09-21 15:01:11 -04:00
evilhero 60f147455a FIX: Another try at the None Status problem... 2017-09-20 20:32:53 -04:00
evilhero b3fcfab0a0 FIX: Another possible fix for the None Status issue currently happening that is affecting pullist and series refreshes 2017-09-20 20:19:26 -04:00
evilhero 75f243bc8d FIX:(#1719) Fix for logging error trying to log unicode in file format, FIX: Possible fix for weeklypull / refresh causing some series to change status to None 2017-09-20 19:51:00 -04:00
evilhero c6a7f4dbdf FIX: Annuals were not being refreshed properly which caused various errors when trying to refresh/update/add series that had annuals integrated, FIX: If an annual had a volume label in the filename prior to the word 'annual', file parser would assume it was a non-annual and mark wrong issues 2017-09-19 11:41:48 -04:00
evilhero 0f1a3578f3 FIX:(#1715) When manually renaming from series detail page, would fail due to an invalid reference, FIX: Fixed some icon display issues with annuals and annual integration not dislaying proper ones, FIX: Annuals were not being refreshed that were previously present, due to a commit fix, IMP: Removed some code not needed 2017-09-18 16:07:21 -04:00
evilhero 595ed45511 FIX:(#1658) Retries from history should now be working again (with post-processing), IMP: When refreshing a series, if expected series directory was inaccessible/unavailable would delete old issue data resulting in a blank issue table, FIX: Fixed some encoding problems with the auto-snatch script, FIX: Removed Failed as a possible available option for status change on the Manage Issues tab, IMP: Changed some logger lines from info level to debug. 2017-09-14 14:49:24 -04:00
evilhero 21eee17344 IMP:New scheduler tab (Manage / Activity) where you can see job current run status', next runtime, and prev runtimes as well as force/pause a job, FIX: Disabling
torrents will now properly hide torrent information, IMP: Specified daemon port for deluge as an on-screen tip for more detail, IMP: Added 100,200,ALL as viewable
watchlist views, FIX: When viewing pullist and annual integration enabled, if annual was present would incorrectly link to invalid annual series instead of the
actual series itself, IMP: Added more detail error messages to metatagging errors and better handling of stranded files during cleanup, IMP: Improved some handling for weekly pull-list one-off's and refactored the
nzb/oneoff post-processing into a seperate function for future callables, Moved all the main url locations for public torrent sites to the init module so that it
can be cascaded down for use in other modules instead as a global, IMP: Added a 'deep_search_32p' variable in the config.ini for specific usage with 32p, where
if there is more than one result will dig deeper into each result to try and figure out if there are series matches, as opposed to the default where it will only use ref32p
table if available or just the first hit in a multiple series search results and ignore the remainder, FIX:Fixed some unknown characters appearing in the pullist due
to unicode-related conversion problems, FIX: fixed some special cases of file parsing errors due to Volume label being named different than expected, FIX: Added a
3s pause between experimental searches to try and not hit their frequency limitation, IMP: Weekly Pullist One-off's will now show status of Snatched/Downloaded as
required, FIX: Fixed some deluge parameter problems when using auto-snatch torrent script/option, IMP: Changed the downlocation in the auto-snatch option to an
env variable instead of being passed to avoid unicode-related problems, FIX: Fixed some magnet-related issues for torrents when using a watchdir + TPSE, FIX: Added
more verbose error message for rtorrent connection issues, FIX: Could not connect to rtorrent client if no username/password were provided, IMP: Set the db updater to run
every 5 minutes on the watchlist, automatically refreshing the oldest updated series each time that is more than 5 hours old (force db update from the activity/job schedulers page will run the db updater
against the entire watchlist in sequence), IMP: Attempt to handle long paths in windows (ie. > 256c) by prepending the unicode windows api character to the import
a directory path (windows only), IMP: When manual metatagging a series, will update the series after all the metatagging has been completed as opposed to after each
issue, IMP: Will now display available inkdrops on Config/Search Providers tab when using 32P (future will utilize/indicate inkdrop threshold when downloading)
2017-09-10 11:50:08 -04:00
evilhero 535c557e30 FIX:(#1630) One-off issues will now be post-processed according to grab-bag dir location, IMP: One-off pull-list issues will now have the status marked accordingly on weekly pullist for tracking purposes, FIX: Fix for utorrent not being able to update status properly after initial snatch, FIX: Fix for some incorrect variable references due to different snatch methods when trying to run on-snatch scripts, FIX: Fix for auto-torrent-snatcher trying to snatch a torrent with an '&' in the filename, FIX:(#1637) Fix for telegram not saving on snatch toggle properly, IMP: added additional logging for metatagging when attempting to create temp folder in cache location, IMP: will now clean up any left over metagtagging directories that fail during normal post-processing instead of leaving and continuing, FIX: Will notify on one-off grab's/storyarc's being post-processed, FIX: fix for displaying cbz issue details (the 'i' on the comic details page) in which the series title contained non-alphanumeric characters, IMP: Added ability to change status to Wanted on Upcoming tab (will perform an immediate search on selected issues), IMP: Threaded the one-off search call from the weeklypull 2017-06-02 10:05:06 -04:00
evilhero 4d5b384c82 FIX: Fix for post-processing files that are retained in the folder monitor location (ie. torrent-seeding), which would result in the same file being post-processed several times over 2017-05-09 14:08:26 -04:00
evilhero 3d28371dcb FIX: Annuals with identical numbering across multiple volumes for the same series would be incorrectly dupe-checked during post-processing and/or incorrectly assigned the wrong status for the given issue 2017-05-04 14:41:05 -04:00
evilhero caa5894554 FIX:(#1529) Retrying downloads would fail to start search, FIX: One-off downloads from the weekly pull should now be working again, FIX: Test button for 32P Auth mode option will display proper response 2017-01-20 14:15:15 -05:00
evilhero e602518ea6 IMP: Added Hash field to Snatched table to allow for future torrent features 2017-01-06 13:41:13 -05:00
evilhero 9519153db3 FIX:(#1522) Fix for weekly pull list being empty when using alt_pull 0 method 2017-01-06 13:06:58 -05:00
evilhero d1c5fa63fa FIX: When annual integration enabled, but annual added to watchlist as individual series would fail to update status of filechecked issues properly 2016-12-24 02:24:14 -05:00
evilhero 021459c280 FIX:(#1466) When post-processing if filename did not have issue year or volume, would error, IMP:(#1418) Separate copy/move/hardlink/symlink option for Story arcs, IMP:(#1417) Added story arc format folder to story arc options - can now specify folder format for story arc naming, IMP:(#1374) Added rtorrent_authentication to config.ini allowing user to specify digest/basic authentication, as well as the rpc_url (rtorrent_rpc_url) and ssl (rtorrent_ssl). Rtorrent_host no longer requires protocol in field, IMP: Instead of hitting the intermediary/32P site to get the torrent group, will now retain specific id for torrent group to speed up searches, FIX: (#1472) Fixed some problems with series being searched against 32P which had special characters and would return no results, FIX: Added some specific exception catches when attempting to retrieve search results for nzb providers, FIX: Fixed publisher retaining problem for story arcs (note story arcs will have to be refreshed), FIX: Fixed a problem with the pull-list matching up to the correct series when the issue was an annual for a given series with the alt_pull 2 method (would create an invalid link on the Wanted tab), IMP:(#1470) Added config.ini option to specify folder-formatting for weekly folder numbering, 0=YYYY-WN, 1=YYYY-MM-DD, IMP: (#1471) Added quick check to ensure that newznab host entries do not contain leading/trailing spaces and will strip accordingly, FIX:(#1476) Annuals now have option to add to reading list via the series detail page, IMP: Fixed password fields to allow for special characters within password, IMP: Weekly pull will now correctly show status for previous/future weeks for watchlisted series, IMP: Download option on pullist will work for previous weeks, FIX: Fixed some issues with one-off and story arc post-processing using different file operations, FIX: Fixed error when performing an 'Force Update Active Comics' from the Manage tab (or the scheduled updating of all active comics), IMP: Storyarc issues that are not on watchlist will now retain value for volume to help when searching and file-checking/post-processing, FIX:(#1473) Changed pullist dates on pullist page to unicode to allow for non-English presentation 2016-12-02 12:45:49 -05:00
evilhero a774a3ba0b FIX:(#1455)(#1452)Added search_32p option in config.ini to indicate where Mylar will do the initial compare to see if a series exists on 32p before attempting to retrieve/compare the search results (0 = WS, 1 = 32P). The default setting of 0 will fix the auth mode issues all users were having, FIX: One-off's from the pullist would not snatch in some cases 2016-11-11 11:52:24 -05:00
evilhero 7c7aef0d38 FIX: Fix for filechecking series that had more 200 issues in them and was incorrectly setting the status to Archived for issues, FIX: When copying issues to story-arc directory will now check to see if multiple destination directory is in effect and grab file from the correct location 2016-11-09 11:49:06 -05:00
evilhero cef076ee83 FIX:(#1431) Fixed post-processing cleanup when using SAB + files resided in a sub-folder of the path sent from SAB, IMP: Added hardlink/softlink option for non-windows users (note that metatagging is forcibly disabled when these options are enabled), IMP: Added Enforce Permissions option to force Mylar to either force / ensure permissions are as set within Mylar, or to ignore permissions and just try to perform the given action (this is for adding series, post-processing, importing, arcs, etc), FIX: Fixed a problem where if local watchdir was set and a torrent downloader was selected, both would attempt to be used, but only the watchdir was actually utilized (now it's one or the other, never both), FIX: Mylar will now remove issues that are in Failed status that have incorrect Series Data attached, FIX:(#1438) When file-checking/post-processing if issue date in Mylar was current year and date in filename was the following year (for end-of-year issues), would cause traceback error, FIX: If series year polled from CV is incorrect or not provided, option is available in Edit Settings of series detail page that allows user to specify the correct series year, FIX:(#1427) Fixed a typo when the Scan Library option is used and ComicID's were able to be parsed from the files, FIX: When issues were archived, depending on if series had issues in a Downloaded status or not, would give different results to the Have totals, IMP: Manage tab / Manage Comics now has metatag option available to allow metatagging multiple series in a batch mode, IMP:(#1419) When 'write cvinfo' option is enabled, will now also write cvinfo into story arc directories when added / refreshed, FIX: Fixed a problem when group metatag was being used and causing errors, IMP: Manage Failed page now will link back to the series for easier reference, and the 'link' column was removed due to invalid references, FIX: Removed the 'issue not updated' from the series detail page as was not accurate, IMP: Added a Select Filtered Issues button to the series detail page to allow for selecting of all filtered issues (Show ALL MUST be enabled for it to work properly) 2016-11-02 11:00:56 -04:00
evilhero b437d7450a FIX:(#1411) When arc issue searching using 32p, would cause an error in regards to publisher not being present, FIX:(#1415) Fixed error with story arcs and searching when the year isn't specified, FIX: Copy/Move will during post-processing will now cleanup cache files properly, FIX:(#1413)(#1416) Fix for invalid reference when updating Story Arc settings.FIX: Added issue exception for issue 112/113, FIX: When story arc issue did not have an issue name present, would error, FIX: multiple destination dirs won't be scanned if the dir(s) don't exist 2016-10-14 13:52:55 -04:00