Commit Graph

220 Commits

Author SHA1 Message Date
evilhero d280ce0b0b FIX:(#2275) Experimental search was pointing to incorrect/old domain 2019-05-18 11:27:24 -04:00
evilhero 7cb2175f28 FIX: fix for typo when shutdown/restart 2019-03-08 15:58:33 -05:00
evilhero 6a9edb44e7 FIX: fix for multiple threads being started when saving/starting which would lead to locking and general problems 2019-03-02 14:10:33 -05:00
evilhero 63dc7bf0ba FIX: Post-processing queue was not being initialized if the mylar API was not enabled 2019-02-11 11:21:16 -05:00
evilhero 56706f2ac6 FIX: Fix for refresh not honouring the alternate_latest_series_covers option properly, FIX: When adding a series, if the series had a start year with a ? in it, would error out, IMP: Added more columns to the ddl_info table 2019-02-07 12:46:46 -05:00
evilhero 41e5f42471 FIX:(#2179) Post-processing item would fail if match would occur on story-arc check, FIX: Fixed some sub-directory problems when doing various types of scans, IMP: Added booktype to filechecker parsing results, FIX: When downloading via DDL, would not adhere to the booktype as a restraint, IMP: Pack support added for DDL (available as a per series option), IMP: Added BookType & Aliases to the arc's section which will impact how issues/series are searched/post-processed/cheked when they're an issue from an arc, IMP: Initial codebase for the a queue manager section, IMP: Write DDL-Queue data to the sql table so that stalled/broken downloads can be resumed/deleted etc eventually, FIX: If a filename didn't have a valid issue number and it is a Print Edition, will now throw a warning indicating other options to try instead of causing a traceback, IMP: Updated snatch notifications so the notification header will just say 'Issue Snatched' with a brief description, FIX: Removed multiple import db lines from the helpers module, IMP: cleanup_cache variable (true/false) added to config section which will initiate a cleanup of items in the cache directory on startup which will remove items that are no longer needed, IMP: Changed some logging string concatenation lines to try and avoid traceback errors due to logging 2019-02-01 16:25:24 -05:00
evilhero 43ca4825e5 FIX:(#2179) Post-processing item would fail if match would occur on story-arc check, FIX: Fixed some sub-directory problems when doing various types of scans, IMP: Added booktype to filechecker parsing results, FIX: When downloading via DDL, would not adhere to the booktype as a search-result constraint with regards to matching 2019-01-30 17:08:30 -05:00
evilhero 319d7f7f54 FIX: more general fixes for DDL option, IMP: Added DDL Queue so items hitting the DDL provider option will be queued in sequence for downloading & immediate post-processing thereafter 2019-01-17 13:22:36 -05:00
evilhero d9ce193630 FIX: When performing a force search, or letting the auto-search hit - the searchlock would not release properly in some instances which would result in a locked search queue and no searches being performed, FIX: The pullist would sometimes default down to the wrong value as it was set to the wrong initial value 2018-12-28 21:36:31 -05:00
evilhero 0c9ed00a13 IMP: Added 'Force to TPB/GN' option for printed editions and 'Force to Print' option for TPB/GN's (this WILL impact how files are scanned in - so make sure you have files named appropriately), IMP: Added One-Shot as a Type, FIX: Fixed incorrect variable reference to seriesvolume during post-processing of TPB series, FIX: Fixed refresh to fire off every 5 minutes, FIX: When post-processing and metatagging a cbz file with rename files not enabled, would indicate the new filename as being a copy of the existing file (ie. (1).cbz) which would carry over to a final filename, IMP: Allow Mylar to populate the alias list on add/refresh of a series if the aliases don't already exist in the Alternate Series field for the series, FIX: Fixed a problem with single quotes in series titles when using experimental search,
IMP: When searching for a one-off series, will accept either issues with an issue number or those with no issue numbers as acceptable search results when searching,  IMP: Updated search code to utilize the existing filename parser within Mylar when parsing the search results for more consistency
2018-12-22 17:48:14 -05:00
evilhero 75d77546fe FIX: if 32p was disabled due to inability to signon, would still attempt to retrieve cached result when match occured which would then possibly result in excessive attempted logins, IMP: Added Force Type option to comicdetails page which will allow the type of series to be forced to TPB/GN format if Mylar is unable to decipher it under normal circumstances (doing this will affect how files are parsed for the given series), IMP: TPB/GN File Parser will now account for mutiple issues of the same TPB series within the given directory, IMP: When enabling/disabling Force Type, will rename existing folder to accomodate new naming folder convention if required, IMP: Started to move some of the file rename/manipulation modules into a filer.py module for more consistency, IMP: Added a to Folder Format which when triggered will use the designated Series Type, IMP:(#2130) When importing, option now available for the final series destination path to use the imported path location instead of defaulting to the Comic Location base folder - status will be no longer be Archived in such cases. Will also not show previous imported series on subsequent import runs if the import directory has not changed (thnx @CuddleBear92), IMP: Added the codebase for a Rename Preview option into the mix - GUI available, but not linked, FIX: Removed DEM from RSS scans when Public Torrents option is enabled, FIX:(#2137) When adding series, if series indicated date in a different format other than just numeric, would cause error 2018-12-10 12:27:53 -05:00
evilhero 851799f642 FIX: Added global reference so can change WWT URL in one location in __init__, FIX: Changed WWT to new domain, FIX: Removed DEM from being used 2018-12-04 14:34:10 -05:00
evilhero f63e746280 IMP: Added TPB/GN detection for file parser, IMP: Added TPB as a booktype to series detail page, IMP: Added to format options for Folder Formatting which would denote either TPB or GN, IMP: If detected as a TPB/GN volume, will display the series/issues that are contained within - if they exist on your watchlist, they will be clickable links, IMP: Weeklypull set to display TPB/GN's when option is configured (backend change), IMP: Added proper detection for filenames that have mini-series designations within them ie ( '(of 04)' ), IMP:(#2102) detect decimal issues that also contain unicoded numbering, IMP: Proper handling of filenames that have '38 p' or the like to denote number of pages in issue, FIX: Removed forceful reference to lib.requests when using WWT, IMP: If an issue has a digital release prior to the actual print release, will now look at either date when attempting to reference if a successful match when post-processing/searching, IMP: Issues that also have digital release dates will be indicated on the series detail page as such, IMP: Added job completion notifs for refreshing/adding story-arcs, deleting directories, IMP: Main Home page will display if a given volume is a TPB/GN if determined, IMP: Reworded 'Search for Watchlist matches' to 'Search for Watchlist Matches/Recheck Files' for more clarity, FIX: Fixed story-arc posters causing some text boxes to overflow 2018-11-29 14:59:34 -05:00
evilhero f7c1629679 IMP: Tiered wanted list searching - anything older than 2 weeks will only by searched for using RSS and/or manual means (scheduled searches only), IMP: Tiered option viewable in Upcoming tab, FIX: Fixed API searching against WWT option (RSS is still broken however, as that is due to WWT), IMP: Removed cherrypy logging in some instances, IMP: Updated cfscrape library to most recent, FIX: Fixed problem with simliar titles being incorrectly post-processed due to multiple matches when manual post-processing, FIX: Fixed notifications not firing off on a successful manual post-process/folder monitor due to some previous changes, FIX: If grabbag_dir was not set, would not correctly set the location, FIX:(#2051) When using nzbget, if nzbToMylar is enabled along with CDH - warning will be issued within Mylar to indicate as such 2018-08-31 12:03:54 -04:00
evilhero 2623bbcbaf IMP: Updated CT to a newer version - changed to use rarfile, fixes size invalid errors with some cbr's encountered during conversions, IMP: Search and Post-Processing Queues now added in order to queue up all searches/post-processing in sequence instead of loading lists and iterating through it and encountering various lock-related errors, IMP: In most cases, will now post-process directly against comicid/issueid/storyarcid instead of relying on relationship via nzb/torrent, FIX: realigned some checkboxes on series detail page, FIX: in configuration, indicated that ComicRN cannot be used when Completed Download Handling is enabled for a client now, FIX: Fix for issues named as 'special' that are part of the annuals section, but would not work in various portions (also will allow for naming differences in the future hopefully), FIX: Will now trap error properly when file cannot be located during dupecheck so that post-processing can continue without error, FIX: Fixed newznab test option on configuration screen so that it will return the correct response (previous was an invalid api endpoint), FIX: When retrieving image for storyarcs would error when no image was present and stop the process, FIX: accounted for some incorrect newznab responses that would return a non-api endpoint when retrieving via rss, which resulted in invalid nzbs, FIX: in some cases, weekly pull snatches would not update properly on the weekly page due to some db values not being written 2018-06-14 13:07:39 -04:00
infomofo 1ec6a1e087 Fix a misleading error message 2018-06-08 09:23:58 -04:00
evilhero f30358573d FIX: Fix for mis-spaced line in sabnzbd module from previous commit, FIX:(#1963) Remove stale entries from storyarcs table on startup to avoid errors when viewing Upcoming table due to invalid references 2018-05-24 12:23:32 -04:00
evilhero 58b59d49bf FIX: Fix for autoProcessComics not properly determining the post-processing result type, Updated apc version to 2.04 2018-05-09 11:26:28 -04:00
evilhero db47659e42 FIX: When alternate series covers was enabled, would fail to perform complete update properly - leaving some issues unaccounted for, FIX: Will now log when CV does not respond with valid information on most queries (ie. expat errors), FIX: Will only write covers/cvinfo if either do not already exist, IMP: Alternate series covers will now track the last cover by issueid and only download when a newer issue cover is available 2018-05-08 14:01:24 -04:00
evilhero 8d626ec361 FIX:(#1941)(#1921) Possible fix for inability to correctly parse response from post-processor when using ComicRN 2018-05-02 13:38:51 -04:00
evilhero 0c25634684 IMP: When comic location is changed for a given series, will rename the directory if possible as opposed to creating a new directory, IMP:(#1920) Ability to directly input a 32p series ID for more accurate search results via the series details page/edit tab, IMP: Better error messages regarding: no CV API key being set when searching, and no Comic Location being set when trying to add a series, FIX: When using test SABnzbd button, if SABnzbd was not enabled previously (meaning config saved after the option selected), the test would return a fail status, FIX: When post-processing annuals, would fail to update the correct table resulting in a null table entry that would cause further problems, IMP: Added 1 day grace to the date check when comparing search results to allow for some leniency with regards to timezone differences, FIX: Fixed slight display issue when 32p provider was enabled, but torrents were turned off (pack option was being shown in series page when it shouldn't have been) 2018-04-26 11:27:51 -04:00
evilhero 6a2b12313e FIX: Changed where version checking would run in startup sequence - is now after the web interface loads so that it will not loop forever in some instances trying to check git but an instance of Mylar is already running, FIX: Added more verbose error logging when checking versions fails 2018-04-16 13:59:17 -04:00
evilhero 0fdb551365 FIX:(#1921) When using ComicRN & NZBget, post-processing would fail due to inability to properly parse return string 2018-04-16 13:50:09 -04:00
evilhero 127b109011 FIX:(#1912)(#1905) Logging would fail to initialize properly on non-English systems 2018-04-08 14:21:01 -04:00
evilhero a895f3f8d3 FIX:(#1905) Unicode errors when logging and system language is not a subset of english, IMP: Added post-processing queue (currently just for forceProcess api, but will be used by default for all post-processing actions soon), IMP: Multiple Torznab support added, IMP: Logging values for number of files and size/file added to config, IMP: Pushover notifications can be sent to specific device now, IMP: Added nzbget, newznab, nzb.su and dognzb test options, IMP: Added graphical checkmark/x when performing various tests (providers, downloaders, notifiers) within configuration, IMP: Removed some more unnecessary logging lines from searches 2018-04-06 13:46:39 -04:00
evilhero 47fb2db6ed FIX: Fix for db not being created on new installs when in maintenance mode 2018-03-17 22:43:04 -04:00
evilhero e060f37c8e IMP: Added maintenance mode to command line option. Allows for exporting/importing of either json file/db files, as well as updating Mylar without having to load the GUI which sometimes causes problems, FIX: Removed extra Mark as Skipped option from appearing on comic details page, FIX: Added series cover fallback for alternate issue images if issue images were not populated yet, FIX: Removed some unneeded logging lines during weekly pull check 2018-03-09 14:08:25 -05:00
evilhero 8081a50d4d FIX: fix for stray readinglist references that has been changed to storyarcs on initialization 2018-02-21 14:55:23 -05:00
evilhero a68ec6bb78 FIX: fix for not having requests installed when using ComicRN - autoProcessComics updated to accomodate legacy fall-back mode via api 2018-02-18 16:46:06 -05:00
evilhero 0ff38c164e IMP: Added Choose specific Download option to manually select from result list on Upcoming/Details/Weekly tabs, IMP: Added Wanted storyarcs to the overall Wanted section so now will search as per global options (storyarc issues can be displayed optionally on Wanted tab), IMP: Added custom url option for image banners/posters for storyarcs, IMP: updated Cherrypy, FIX: Fixed ComicRN not working when forms authentication used - in conjunction updated autoProcessComics to 2.0 which now uses apikey instead of user/pass, IMP: Alternate Series Covers option for alternating existing series image to the most current issue image, IMP: Added overall series total to series page for reference, IMP: Search workflow completely changed to accomodate more than one indexer - now will simultaneously sumbit initial request to each provider, wait 30s submit additional as required at 30s intervals, FIX: Removed TPSE as an option and relabelled to just Public Torrents, IMP: Added direct backlog search to WWT option (pack support will follow), FIX: Removed line about configparser being required for ComicTagger usage, IMP: Test code in place for newzab testing, FIX: Fixed layout problem with torrents that are in auto-snatch status on weekly tab, IMP: backend code improvements to allow for better alias usage and annual linking directly from WS, IMP: Updated systemd init-scripts with read.me, IMP: When post-processing, will now check for available destination free space before actually moving files, IMP: Will copy during metatagging to cache folder instead of move being an option so cleanup is cleaner if something fails, FIX: Changed readinglist table to storyarcs for clarity, IMP: When post-processing issues, will now only update the one issue status and adjust totals accordingly (instead of doing a complete rescan of the series), FIX: Clear out empty ID's from the Failed DB on startup, IMP: Initial code-run at REST API interface, FIX: Fixed some matching problems with 32p due to case, IMP: removed apikeys from log entries that were accidentally logging, IMP: When searching 32p, if items get packed up - will now delete the cached reference so new items of the same can be located, IMP: ForceSearch option switched to scheduler so simultaneous runs should not occur, FIX: Fixed manual metatagging error that would occur if multiple destination directories existed 2018-02-16 14:57:01 -05:00
evilhero 48c30f150f FIX:(#1787) Removed wait for process ending entirely when performing shutdown/restart/update 2017-12-04 11:59:06 -05:00
barbequesauce 1d5e3a0def Removing added --nolaunch option from restart 2017-11-29 12:03:43 -05:00
evilhero ea34294006 FIX: Fix for startup errors on clean installs referencing scheduler variables 2017-11-25 20:03:43 -05:00
evilhero 05a3c49c65 FIX:(#1784) On new installations, pull-list tab would give a float error due to some improper trapping of variables 2017-11-25 15:56:29 -05:00
evilhero c45a70b0da IMP: Added config.ini option to not create series folders (create_folder=True/False) when adding/refreshing series, IMP: Adde test connection button for rtorrent, FIX: Fixed weekly pull recreate, FIX: Removed TorrentProject from public torrent searches, FIX: Updated url for demonoid again, FIX: Fixed schedulers not running/returning error when forced from schedulers tab, IMP: Removed some more unnecesary logging lines 2017-11-16 11:22:46 -05:00
evilhero 689268684b IMP: Changed configuration completely. New config processing, global/config variables changed over entire application. All changes in the configuration GUI take effect immediately after saving - no more need to restart Mylar, IMP: Added provider order sequence header to the top of the Providers tab for improved visibilty, IMP: Added completed download handling for both SABnzbd and NZBGet - will monitor active queue for downloads sent by Mylar and then post-process them accordingly (no more ComicRN), FIX: When recreating a pullist for a week that's not the current week, will now refresh series that are still missing data in case of late population, IMP: Removed loose/explict search options, and search results will now match more accurately to the terms entered, as well as being much quicker, IMP: Changed colour-codes on search results screen, green now indicates that the series is a print series, non-green indicates that it is either a HC/TPB/digital series and will also be indicated as such, IMP: Fixed weeklypull not refreshing some series due to legacy numbering on series deemed as Ended by Mylar, or the pull not refreshing propeprly and thereby were not elgible to be considered as a valid series for matching, IMP: Fixed problem with the scheduler of the weekly pull not running at the designated time, which causes problems when attempting to match series to the pullist for issues, IMP: Changed the autosnatch script so that the get.conf is no longer required to be maintained seperately. The get.conf config items are now located in the main config.ini and have to be repopulated initially, FIX: Fixed problem with the import count not resetting to 0 on subsequent runs of the Import A Directory option, IMP: Changed the sab api key from using the nzbkey to the full api key as is required for completed download handling, FIX: Fixed the retry option for newznab entries so that it should work across the board now for newznabs as opposed to only some providers, IMP: some minor code cleanup 2017-11-10 14:25:14 -05:00
evilhero ed55065779 FIX: fix for error during post-processing if multiple_dest_dirs was not present for a given series, FIX: set the versions for the comicrn & autoprocess correctly again 2017-10-28 12:33:59 -04:00
evilhero 9ced86a0e1 FIX: when sab_host was blank, would error on config conversion, IMP: Removed blank spaces from extra newzanbs when writing config - also fixes the blank newznabs entries being generated when blank information is present 2017-10-26 13:24:38 -04:00
evilhero 520e9347f7 FIX: forgot the __init__.py! :/ 2017-10-25 14:39:50 -04:00
evilhero 53446dc638 FIX: Should be final fix for None status occuring that have caused several pullist/refresh problems, IMP: Will check on startup for any series that contain issues with a None status, and automatically refresh those in the background so that things can be properly accounted for again. 2017-09-21 15:01:11 -04:00
evilhero 6294bb7476 FIX: Added unicode option for issue number retention in config.ini as UNICODE_ISSUENUMBERS (enabling will retain unicode issue numbers in filename, not enabling will convert to normal numbering if possible), FIX: Fixed some problems with the weekly pull not properly refreshing series that were on the pullist in order to be correctly marked as Wanted. 2017-09-20 17:21:33 -04:00
evilhero 21eee17344 IMP:New scheduler tab (Manage / Activity) where you can see job current run status', next runtime, and prev runtimes as well as force/pause a job, FIX: Disabling
torrents will now properly hide torrent information, IMP: Specified daemon port for deluge as an on-screen tip for more detail, IMP: Added 100,200,ALL as viewable
watchlist views, FIX: When viewing pullist and annual integration enabled, if annual was present would incorrectly link to invalid annual series instead of the
actual series itself, IMP: Added more detail error messages to metatagging errors and better handling of stranded files during cleanup, IMP: Improved some handling for weekly pull-list one-off's and refactored the
nzb/oneoff post-processing into a seperate function for future callables, Moved all the main url locations for public torrent sites to the init module so that it
can be cascaded down for use in other modules instead as a global, IMP: Added a 'deep_search_32p' variable in the config.ini for specific usage with 32p, where
if there is more than one result will dig deeper into each result to try and figure out if there are series matches, as opposed to the default where it will only use ref32p
table if available or just the first hit in a multiple series search results and ignore the remainder, FIX:Fixed some unknown characters appearing in the pullist due
to unicode-related conversion problems, FIX: fixed some special cases of file parsing errors due to Volume label being named different than expected, FIX: Added a
3s pause between experimental searches to try and not hit their frequency limitation, IMP: Weekly Pullist One-off's will now show status of Snatched/Downloaded as
required, FIX: Fixed some deluge parameter problems when using auto-snatch torrent script/option, IMP: Changed the downlocation in the auto-snatch option to an
env variable instead of being passed to avoid unicode-related problems, FIX: Fixed some magnet-related issues for torrents when using a watchdir + TPSE, FIX: Added
more verbose error message for rtorrent connection issues, FIX: Could not connect to rtorrent client if no username/password were provided, IMP: Set the db updater to run
every 5 minutes on the watchlist, automatically refreshing the oldest updated series each time that is more than 5 hours old (force db update from the activity/job schedulers page will run the db updater
against the entire watchlist in sequence), IMP: Attempt to handle long paths in windows (ie. > 256c) by prepending the unicode windows api character to the import
a directory path (windows only), IMP: When manual metatagging a series, will update the series after all the metatagging has been completed as opposed to after each
issue, IMP: Will now display available inkdrops on Config/Search Providers tab when using 32P (future will utilize/indicate inkdrop threshold when downloading)
2017-09-10 11:50:08 -04:00
evilhero d2b8ffebad FIX:(#1702) Fix for WWT domain change as well as a quick patch for future domain changes 2017-09-05 21:27:54 -04:00
davalanche da8bec9bf1 IMP:(#1680) Added Pushbullet Channel Support 2017-07-19 14:09:09 -04:00
pwf115 997808851d Added Slack notification support 2017-07-13 14:28:10 -04:00
evilhero 535c557e30 FIX:(#1630) One-off issues will now be post-processed according to grab-bag dir location, IMP: One-off pull-list issues will now have the status marked accordingly on weekly pullist for tracking purposes, FIX: Fix for utorrent not being able to update status properly after initial snatch, FIX: Fix for some incorrect variable references due to different snatch methods when trying to run on-snatch scripts, FIX: Fix for auto-torrent-snatcher trying to snatch a torrent with an '&' in the filename, FIX:(#1637) Fix for telegram not saving on snatch toggle properly, IMP: added additional logging for metatagging when attempting to create temp folder in cache location, IMP: will now clean up any left over metagtagging directories that fail during normal post-processing instead of leaving and continuing, FIX: Will notify on one-off grab's/storyarc's being post-processed, FIX: fix for displaying cbz issue details (the 'i' on the comic details page) in which the series title contained non-alphanumeric characters, IMP: Added ability to change status to Wanted on Upcoming tab (will perform an immediate search on selected issues), IMP: Threaded the one-off search call from the weeklypull 2017-06-02 10:05:06 -04:00
evilhero 20051f6c26 FIX: Fix for 32p api searches, would use stale torrent_id's when searching, which would result in no results. Will now refresh the id's for the series torrents every 24hrs or as required 2017-05-18 13:14:58 -04:00
evilhero 4d5b384c82 FIX: Fix for post-processing files that are retained in the folder monitor location (ie. torrent-seeding), which would result in the same file being post-processed several times over 2017-05-09 14:08:26 -04:00
evilhero 2bba83a6d3 FIX:(#1633) Various problems related to qBittorrent - labels not being set properly, some qBittorrent settings would not persist across sessions, snatches would cause an error and/or stop the snatch from being sent in some instances (or trigger failed download handling if it was enabled), FIX: Fixed some os.environ problems when using on-snatch scripts combined with one-off downloads 2017-05-07 13:44:18 -04:00
evilhero 003d3bad7a FIX:(#1627) Fix for torrents using local watchdir as an option erroring out after a snatch, FIX: Added auto_snatch_script location field to allow for seperate auto_snatch script location in addition to other custom on-snatch script, IMP: torrent hashes were not being saved to snatch db for future reference in some cases 2017-05-01 14:42:14 -04:00