9a4a6b4bc5
Whitespace cleanup
2015-05-27 00:43:43 -04:00
8f2b9bed34
FIX: Fix for 32P Legacy mode downloading torrent files.
2015-05-14 12:22:23 -04:00
3528b88162
FIX: ( #1006 ) Fix Legacy mode for 32P not being able to properly pull in feed, FIX: Fix Auth mode for 32P erroring out when reading feed list
2015-05-14 05:33:40 -04:00
f0305ec1ae
IMP: 32P legacy mode (rss feed only) and Auth mode (user/pass) available now. With Auth mode, will monitor all of personal notification feeds, IMP: Changed access methods to 32P for retrieving links, FIX:( #1007 ) Fixed error for one-off downloading via weekly pull list, FIX: ( #1004 ) Fix for post-processing errors (missing files), FIX: ( #1001 ) Extra scripts & pre-scripts will now accept bash scripts, FIX: Annuals were being incorrectly tallied in Have total as well as not having status correctly updated, IMP: Fixed some discrepencies with the provider_order generation line, IMP: Made some additional adjustments to the file-checking to account for some additional variations in naming, FIX: Fixed traceback errors when folder monitor was running and wouldn't be able to complete the post-processing properly, FIX: Cleanup code and some other small fixes....
2015-05-08 22:39:28 -04:00
2b98184718
FIX:( #986 ) Fix for empty newznab provider when searching - will now auto-populate to newznab host if it exists, if not it will ignore entirely, FIX: Fixed a problem with 32P RSS Feed and unicode series titles
2015-04-23 03:39:13 -04:00
b31ee589b3
FIX: Import Error messages re:Requests should be fixed now, IMP: Switched default kat url to use https (if you're using the kat_proxy, you just need to specify the https in the url)
2015-04-19 19:39:02 -04:00
c3de824271
FIX: Another attempt at a fix for the insecure https requests errors
2015-04-17 14:35:05 -04:00
538d9d8e24
FIX: Possible fix for urllib3 exception errors
2015-04-17 13:29:30 -04:00
5c2a24f874
FIX: Added requests to library
2015-04-15 01:42:03 -04:00
0115135e43
IMP: 32P support added (identical to CBT, no backlog searching but full RSS url is required for usage), IMP: Threaded RSS Check (will only run once concurrently), IMP: Added option to enable/disable Snatched/Failed to show on Wanted tab, FIX: Removed UID from dognzb config, IMP: Removed apikey from being stored in db for dognzb, IMP: Will only store ID/HASH for torrents, instead of entire link - will recreate dynamically as required, IMP: Switched to requests for torrent retrieval, IMP: Removed getdefaultlocal requirements on startup (would fail startup on some OSX systems), IMP: Will now display covers that are in 00.png format when viewing issue details, IMP: Fixed incorrect logic for dupecheck status checks, FIX: Removed some unneeded print statements
2015-04-15 00:10:52 -04:00
4426483bae
- Further simplification of feed parsing
2015-04-07 23:58:57 -04:00
88c3a3b158
- Unrolling RSSDB loops
2015-04-07 23:58:57 -04:00
ff0421d1ee
- Inject a function into Feedparser so that we can get the newznab:attr from the RSS feed. Now we can use it to get file sizes from the DOGNZB RSS. The complete list of possible attributes is available at http://newznab.readthedocs.org/en/latest/misc/api/#predefined-attributes , but it's a much smaller subset for comics and size is pretty much the only interesting one.
2015-04-07 23:58:57 -04:00
3ed8673152
- By default the RSS feeds fetches 50 items for experimental, and 25 each for NZB.SU and DOGNZB . Those defaults are probably fine when everything runs correctly and the feeds are requested frequently enough. However, there might be a gap if Mylar is stopped for a few hours, or if a large amount of new releases come out in a very short time, as is likely on Wednesday.
...
So I changed it so that when either Mylar is restarted, or a RSS refresh is forced, Mylar will request the largest amount of items possible from each RSS feeds which would be 250 items from experimental, and 100 items each from NZB.SU and DOGNZB.
2015-04-07 23:58:57 -04:00
a153b6f790
- Use Mylar's own user-agent instead of feedparser's generic user-agent which seems to be rejected by NZB.SU with a 403 : You don't have permission to access /rss
2015-04-07 23:58:57 -04:00
cdc3e8a7a0
IMP: Cleaned up interface for StoryArcs / Story Arc Details, IMP: Cleaned up interface for Reading list Management, IMP: Added better reading list management - new status (added, downloaded, read), IMP: Added sync option for use with another device for reading list transfer (ie. tablet) Android only, IMP: Autopopulate new weekly pull releases to reading list, IMP: 'Watch' option in weekly pull list now fully functional. Will watch CV for series' that do not have any series data yet as they are new starting series. Will auto-add once available, IMP: Auto-watch check is run after every refresh/recreate of the weeklypull list, IMP: Improved the Add a Series option where it will now look for issues that are 'new' or 'wanted' during add sequence, IMP: Main page interface now has coloured have/total bars to denote series completion, IMP: New scheduler / threading locks in place in an attempt to avoid database locks, FIX: Removed some erroneous locking that was going on when importing a directory was being run, IMP: Stat counter now present when post-processing multiple issues in sequence, FIX: for issue number error when post-processing and issue number was a non-alphanumeric, FIX: for metatagging: when original file was .cbz, would try to convert and fail, FIX: for issues that were negative and were preceeded by a # in the filename (filechecker), FIX: for publisher having non-alphanumeric character in name when attempting to determine publisher, FIX: if annuals enabled, would incorrectly show as being 'already in library' when viewing search results if results constained annuals, FIX:( #944 ) for incorrect nzbname being used when post-processing was being performed from an nzb client (experimental mainly), IMP: Turned off logging for ComicVine API counter, FIX: Added retry attempts when connecting to ComicVine in order to avoid errors when adding a series, IMP:( #963 ) Added ability to add snatched to filter when viewing Wanted issues on Wanted tab, FIX: When importing and then selecting a series to import via the select screen, will now flip back to the importresults and add the selected series in the background, IMP:( #952 ) Main page is now sorted in ascending order by Continuing/Ended status (and subbed by whether is Active/Paused).Custom sorting is still available, FIX: Dupecheck will now automatically assume existing 0-byte files are to be overwritten when performing post-processing, FIX: If publication date for series contained a '?' (usually with brand new series) will force to 'Present' to allow for pull-list comparisons to take place, FIX: Mylar will now disallow search results which have 'covers only' or 'variant' in the filename, IMP: Better nzbname generation/retrieval (will check inside nzb for possible names) to be used when post-processing, IMP: DB Update will now perform update to all active comics in descending order by Latest Date (instead of random order), FIX: Enforce the 5hr limit rule when running DB update (will only update series that haven't been updated in >5 hours), FIX: Annuals will now have/retain the proper status upon doing DB Update, FIX: Have totals will now be updated when doing a recheck files (sometimes wouldn't get updated depending on various states of status'), FIX:( #966 ) Added urllib2.URLError exeception trap when attempting to check Git for updates, IMP: Removed the individual sqlite calls for weeklypull, and brought them into line with using the db module (which will minimize concurrent access, which seemed to be causing db locks), IMP: Cleaned up some code and shuffled some functions so they are in more appropriate locations
2015-03-27 13:27:59 -04:00
0b9ce0befe
FIX: ( #932 ) RSS Checker would not include first item in rss feed
2015-01-28 02:39:21 -05:00
cd5a8b2be5
IMP: Added HTTPS support, with certificate/key generation, FIX: If a series had a ', search results would miss some key results when not hitting rss feeds, IMP: Better handling of series' that have non-alphanumeric characters when it comes to requesting search results, FIX: Removed some unnecessary spamming when file-checking/manual post-processing in relation to # signs
2015-01-24 21:26:22 -05:00
d9a303fe4b
IMP: When scanning a folder using the Import a Directory option, upon completion a button to the Import Results Management page will be displayed to allow for easier access / acknowledgement of completion of scan, FIX: Fixed some issues with the search results page displaying too much information, IMP: Improved the ability to see alternate covers within issues when viewing selected issue details via the 'i' icon on the issue details page, IMP: Fixed the problem with issues that had 2015 dates and wouldn't scan in via manual post-processing, IMP: Added duplicate issue detection (beta) - enabled, when post-processing (manually or otherwise), will retain the issue that is bigger in filesize and won't post-process if it's smaller in size, instead of hammering the oldest copy, FIX: bunch of small fixes, and getting groundwork done for other things.
2014-12-18 13:30:57 -05:00
1ad1d7e927
FIX:( #897 ) Improvements for Experimental search and better rss handling/searching for it, IMP: restricting filetypes to cbr/cbz, as well as file-sizees, should now be working for Experimental / CBT / KAT, FIX:( #885 ) referencing issue_firstword errors should now be fixed and working again, IMP: Attempt at better handling of filenames that have issue titles within them (searching only)
2014-12-01 12:23:49 -05:00
1d4ac8a97b
FIX:( #886 ) Fixed issue for all the geeks in us (error was given as invalid api key within sabnzbd on an attempted send)
2014-11-21 11:46:34 -05:00
2173614836
FIX:( #813 ) Received index out of Range when searching for an issue with KAT as a provider
2014-09-05 02:19:26 -04:00
5696ab905c
FIX: When manual processing with folders, would delete the main folder provided to in the GUI. Now will check if files exist within directory, and that it's not identical as the provided folder and remove if both are not True, FIX: Removed some str statements that were hanging up due to unicode.
2014-06-25 11:32:54 -04:00
c510860c46
FIX: ( #746 ) updated autoProcessComics.py / ComicRN.py's which will now send proper completion messeages to clients, FIX: ( #752 ) refresh series will now test if a series is 'out of whack' with it's numerical issue count (ie. 5/4) or it has no issue data due to a bad refresh / api maxing out and will adjust it's processing to accomodate either, IMP: ( #750 ) Added ComicVine API Checker which will check API counts at regular intervals to inform/warn users of usage, as well as adding a screen-time display of API hits / mins used at the bottom of every page (refreshing/reloading pages will update counts), FIX: ( #747 )EOL normalization (dos2unix) on search.py - removed classes & exceptions as not being used, IMP: ( #747 ) Skip processing issues with an invalid store date & issue date (thnx rupaschomaker), FIX: Removed strings when searching/logging torrents as was causing ascii errors especially with KAT, IMP: Added [META-TAGGING] to logging for meta-tagging module, IMP: Added ability in GUI to select CR or Cbl tags (or both) when writing metadata to cbz files, IMP: Improved support/usage with ComicTagger v1.1.15 which allows for personal CV API Key usage - if supplied to Mylar, will use when tagging with ComicTagger, IMP: Added Manual Search option to allow for individual searches of issues without changing initial status.
2014-06-18 15:58:19 -04:00
b6217b729b
IMP: Experimental search would not remove the word 'the' from series starting with it, resulting in non-hits for such series, IMP: Removed unnecessary print statements from solicit, IMP: If torrents was enabled, but no torrent providers enabled would still check/cache rss feeds, IMP: Additonal logging for weekly-pull copy to Weekly Download directory during post-processing
2014-06-15 01:05:42 -04:00
3b148298df
FIX:( #742 ) Overlapping of text on ManageComics screen, FIX: Parsed names showing up on Upcoming list instead of actual series titles, FIX:( #744 ) If Alternate Search used, with a series that has '&' in it, would never get any matches, FIX:( #741 ) Search results would return multiples for the same search results (default search mode), FIX:( #738 ) Wipe Nzblog should now return to History page after wipe, IMP: Removed unnecessary logging that resulted in excessive spam, FIX: ManageComics screen - using checkboxes would result in errorswith a table error
2014-06-11 14:39:50 -04:00
a1ef71c881
FIX:( #717 ) MacOS metadata will now be ignored during filechecks, FIX:( #718 ) searchprov error during searching should be fixed now, IMP: Made manual-run and some other functions threaded to help improve performance, FIX: Manual post-processing should recurse directories properly now (thnx bmfrosty), FIX:( #715 ) if pre-scripts were being used, post-processing would fail, IMP: Removed some unnecessary logging, FIX: When doing a Force Check (or normal 6-hr delayed api check), would error out if a series was a GN/Trade - now will continue but ignore the GN/trade
2014-05-29 14:05:11 -04:00
e00d6c5ddf
FIX:( #708 )( #709 ) Reverted back to apscheduler for the time being, FIX: unicode normalization for filechecker
2014-05-26 14:11:39 -04:00
ea02cd83f2
IMP: Ability to now specify search provider order (regardless of torrents or nzb) within the config.ini, IMP: ( #667 ) Changed the db module to try to accomodate db locking errors and lowering the amount of actual write transactions that were committed along with a new scheduler system, IMP: Changed sabnzbd directory to post-processing, and included subdirs for sabnzbd & nzbget ComicRN scripts, IMP: NZBGet Post-Processing ComicRN.py script (updated for use with nzbget v11.0+)added & updated in post-processing/nzbget directory (thnx ministoat), FIX: If Issue Location was None, and status was Downloaded would cause error in GUI and break series, IMP: ( #689 ) Minimum # of seeders added (will work with KAT), IMP: ( #680 ) Added Boxcar 2 IO Notifications, IMP: Added PushBullet Notifications, IMP: Cleaned up some notification messages so it's not so cluttered, IMP: Added Clickable series link in History tab, IMP: Added Post-Processed as a status to History tab to show manually post-processed items, IMP: Removed log level dropdown from Logs page & added 'ThreadName' as a column, IMP: Added Force Check Availability & View Future Pull-list to Upcoming sub-tabs, IMP: Added '--safe' option to startup options which will redirect directly to Manage Comics screen incase things are broken, FIX: Added proper month conversions for manual post-processing when doing comparitive issue analysis for matches, FIX: ( #613 ) Allow for negative issue numbers in post-processing when renaming and issue padding is enabled, FIX: File Permissions on post-processing would stop post-processing if couldn't change, now will just log the error and continue, IMP: Added Scheduler (from sickbeard) to allow for threadnaming and better scheduling, IMP: Filenames in the format of ' () ' will now get scanned in, IMP: During manual post-processing will now stop looking for matches upon a successful match, IMP: A Refresh/Weeklypull series check will now just scan in issue data, instead of series info,etc, IMP: Removed some legacy GCD code that is no longer in use, IMP: Exception/traceback handling will now be logged, FIX: Unable to grab torrents from KAT due to content-encoding detection failing, IMP: Added universal date-time conversion to allow for non-english based dates to be properly compared when checking search results against publication dates, FIX: Annuals will now get proper notification (prior was leaving out the word 'annual' from notification/logs), IMP: Improved future pull-list detection and increased retension (now ~5 months), IMP: Will now mark new issues as Wanted on a Refresh Series if autowant upcoming is enabled (was reverting to a status of None previously), IMP: Cannot change status to Downloaded if current status is Skipped or Wanted, FIX: ( #704 ) UnSkipped will now work (X in options column on comic details page), IMP: future_check will check upcoming future issues (future pull-list) that have no series data yet (ie. #1's) and auto-add them to watchlist when the data is available and auto-want accordingly, IMP: ( #706 ) Downloading issues to local machine (via comicdetails screen) with special characters in filename now will work, IMP: improved comparison checks during weekly pull list and improved speed abit since only refreshing issue data now instead of entire series, Other Referenced issues: ( #670 )( #690 ) and some others....
2014-05-25 14:32:11 -04:00
e0299e5c35
FIX: Removed unnecessary print statements from importResults, FIX: If Issue number contains a negative, when renaming would rename to '00-1' (with padding enabled), FIX: When searching RSS cache for search results, would use both CBT and KAT regardless if only one was enabled (but either was used previously), FIX: Allow for some issues store dates to have a fluctuation of 1.5 weeks in order to account for some discrepencies in dates with the weekly pullist, FIX: ( #671 ) Issues tagged as Archived (either manually, or by auto-checks) would not tally count the Have totals properly - it would not add the Archived count to the total Have Issue count.
2014-04-20 00:01:23 -04:00
10f797c9b7
FIX: if CBT and KAT both enabled, would only use CBT for searches, FIX: Added extra URL for KAT to include Other category when indexing RSS / searching (increase 0-day hits)
2014-04-14 13:59:27 -04:00
af41c43b4c
FIX: If no providers are selected, will abort search so it doesn't spam, FIX: ( #650 ) Changed nzb.su to use new api url, FIX: ( #649 ) Filechecker parsing failed on recheck/post-process on Windows machines, FIX: Annuals would not get manually post-processed, FIX: Added missing icon for manually adding a series to another series, IMP: Removed dead provider (nzbx) references
2014-03-21 14:48:25 -04:00
606114c743
FIX:( #627 ) Rebooted #1's showing incorrectly on pull-list/matching, FIX:( #630 ) identify cbr/cbz files only in filechecker, FIX:( #632 ) NZBGet Download directory option added, IMP: Manual Annual add now supported via comicid directly (on bottom of comicdetails screen), IMP: Publisher now accounted for when searching, IMP: / added for file format values, IMP: Store/Publication dates now used to help better matching during et all, FIX:( #620 ) dognzb/nzb.su should be working (again), IMP: Very generic API implemented (taken from headphones), lots of other fixes...
2014-02-26 14:48:50 -05:00
bbf9c0f0e6
IMP: Dognzb / nzb.su RSS Feeds and API searches should now be working again (no UID needed for dognzb) (thnx lostkt87 for all of the detailed logs and feedback), FIX: Filechecker wouldn't recognize some alpha-numerics in issue numbers
2014-02-01 14:50:48 -05:00
ce5576dd0d
FIX:( #613 ) filechecker will now account for - in series and in issues more accurately, FIX:( #621 ) host_newznab_fix error, FIX:( #620 ) Changed dognzb RSS url as per request, FIX:( #619 ) Will log details to log file if sucessfully added series using 'addbyid' command, IMP: Removed unnecessary logging lines during filechecking, FIX: ( #616 ) Fixed ID retrieval for KAT (for do-not-download usage), IMP: Increased month-lap to include March publication dates (some issues have dates of Mar-2014, but are being posted as 2013)
2014-01-31 01:36:58 -05:00
aad93a2314
IMP:( #559 ) Differences between pull-list naming and ComicVine - substitutions.csv usage, FIX:( #583 ) When Importing Series, if filenames had a volume label it would error out, FIX:( #597 ) When Importing Series, decimal in issue would cause error, FIX:( #600 ) Annuals file format now inluded as (thanks uspider7), IMP:( #571 ) centos-init.d and ubuntu-init.d added, Various other fixes....
2014-01-16 15:25:02 -05:00
4b26013400
FIX: ( #584 ) If publication date was in February, wouldn't rollback year to previous when doing deeper searches, IMP: Versioning check will remove some erroneous numerics, IMP: RSS Feeds better matching for nzbs, FIX: If annuals not enabled and annuals within given series directory, would error on refresh/recheck files
2013-12-09 14:44:26 -05:00
227547977e
IMP: Experimental RSS search will now remove year requirements if series is the only series with that title, FIX: RSS Feeds for Experimental wasn't searching properly, FIX: Experimental sometimes wasn't able to download nzb (zero-byte returned)
2013-12-03 14:04:38 -05:00
f1e7b9d50e
IMP: Added ForceRSS Check and Test SABnzbd Connection buttons in Config, FIX: If Annuals not enabled, would error on home screen, IMP: updated mylar.init.d (thnx Kalinon), FIX: Manual Post-Processing fix for Manual Run (thnx Kalinon), IMP: Library Monitor working (check folder every X minutes and Post-Process), IMP: Future Upcoming introduction, IMP: Experimental search better handling of year inclusions, FIX: Filechecker will now pick up series with years in the series title accordingly, FIX: Torrent seedbox sending would lockup occassionally when attempting to send torrent file, FIX: malformed image url on some series, IMP: Moved issue updating to a seperate function, IMP: When series was refreshed, would download the last issue (or few issues depending on date), regardless of status, IMP: When series is volume 1 or volume label doesn't exist, either assume V1 or remove volume requirements to improve matching hits, IMP: StoryArcs will now check in StoryArc folder for existing issues and change status in StoryArc accordingly...
2013-11-28 10:48:59 -05:00
eace56d92e
IMP: Added non-default Newznzb category to Newznab UID GUI field. Type in '#8020' or whatever category comics is on newznab installation (not required for normal newznabs), IMP: When issue was found via torrents by RSS, it would continue to look via db/api searches'
2013-10-31 14:54:19 -04:00
17866be3a1
FIX: Provider Priority Error on very first run
2013-10-24 22:14:31 -04:00
527c23526e
FIX: Invalid Torrent files (Bencoded Error), IMP:( #562 ) update mylar.init.d (thnx Kalinon), IMP:(#558,#560) Added quiet variable to config.ini (kat_proxy) for bypassing blocked url, FIX:( #556 ) Torrent File Names now fixed for KAT (format of: series_issue_year), FIX: KAT Torrent searching wasn't going through all iterations of issue numbering for matches
2013-10-18 21:04:16 -04:00
4ce7728b00
FIX: necessary git catchup (bad merge)
2013-10-01 14:37:42 -04:00
0db2968d36
IMP: KAT torrent searches will now work (was a gzip issue), FIX:( #526 ) NzbGet support was broken (fixed - thanks ministoat), IMP: Merged Manual Run GUI option now in idirectory tabbed screen, FIX:( #524 ) ComicID not defined in updater.py
2013-09-04 22:36:41 -04:00
40685b7dc1
FIX:( #515 ) Unicode characters support for Comic Location, IMP: Added Force Continuing Series to forcibly mark a series as Continuing regardless of actual status, IMP: corrected some logging errors on non-english systems (not completed yet), FIX: Added wait timer on writing .torrent file in attempt to fix invalid torrents, FIX: Removed extra loop on searching that was in error.
2013-08-19 02:14:47 -04:00
37c6decd07
FIX: Updated search to better account for versioning, FIX/IMP: Improved KAT torrent support, FIX:( #509 ) github issue link, FIX: Manual Run Post-Processing should be working again, FIX: FileChecking inclusions added, as well as more parsing (Issue Titles currently not supported)
2013-08-11 01:31:41 -04:00
176de5b92a
FIX:( #503 ) inclusion of 1/4 issues, FIX:( #505 ) Versioning now removed from filenames in filechecker, FIX:( #504 ) Enable_RSS would reset to enabled on every update/Also added additional checking, IMP: KAT integration buildup
2013-08-07 02:27:12 -04:00
ce43aa61ca
FIX:( #492 ) Rssdb Empty - UID fields added to Providers, RSS not run if not enabled, FIX:( #496 ) Incorrect Path for Metatagging for Mac OS, FIX:( #495 ) Versioning now fully detected when searching, FIX: If issue had alpha-numerics, now will seperate for more results, FIX: Newznab would loop an extra time (or more) when doing searches / rss, FIX:( #490 )( #482 ) Invalid literal during PostProcessing (FileChecking), IMP: Cleaned up some unneeded code and streamlined some process'
2013-08-04 01:57:21 -04:00
16ddfad398
FIX:( #480 ) A/B Lettering in issue numbering fails, FIX:( #476 ) Unwritten counting .5 issues messes up, FIX:( #484 ) Checking weekly releases throws execption if annuals off and annual encountered in weeklypull, FIX:( #479 )( #481 ) Update would fail on RSS Check / Starup error
2013-07-31 02:34:07 -04:00
7e58ac7433
FIX:( #477 ) ImportError: No module named feedparser on startup
2013-07-30 05:04:07 -04:00
Adrian Moisey