Commit Graph

447 Commits

Author SHA1 Message Date
Cybr Wizrd ff0421d1ee - Inject a function into Feedparser so that we can get the newznab:attr from the RSS feed. Now we can use it to get file sizes from the DOGNZB RSS. The complete list of possible attributes is available at http://newznab.readthedocs.org/en/latest/misc/api/#predefined-attributes , but it's a much smaller subset for comics and size is pretty much the only interesting one. 2015-04-07 23:58:57 -04:00
Cybr Wizrd 3ed8673152 - By default the RSS feeds fetches 50 items for experimental, and 25 each for NZB.SU and DOGNZB . Those defaults are probably fine when everything runs correctly and the feeds are requested frequently enough. However, there might be a gap if Mylar is stopped for a few hours, or if a large amount of new releases come out in a very short time, as is likely on Wednesday.
So I changed it so that when either Mylar is restarted, or a RSS refresh is forced, Mylar will request the largest amount of items possible from each RSS feeds which would be 250 items from experimental, and 100 items each from NZB.SU and DOGNZB.
2015-04-07 23:58:57 -04:00
Cybr Wizrd a153b6f790 - Use Mylar's own user-agent instead of feedparser's generic user-agent which seems to be rejected by NZB.SU with a 403 : You don't have permission to access /rss 2015-04-07 23:58:57 -04:00
Cybr Wizrd 77575cc660 RSS Check query would search for 'newznab' instead of site name. 2015-04-07 23:58:57 -04:00
evilhero 87d37e6011 FIX: more invalid str references whem manual post-processing / importing 2015-03-28 21:03:22 -04:00
evilhero 59ffc702b8 FIX: invalid str reference whem manual post-processing / importing 2015-03-28 18:40:11 -04:00
evilhero a32909ed24 FIX: logging statements cleaned to allow for logging information about unicode filenames, FIX: if '#' in filename, and series did not have any special characters, would not scan in files during file checking 2015-03-28 17:55:10 -04:00
evilhero 2680f66b7a FIX: Bunch of fixes for using the Reading List - Send to option now available for specific issues on reading list, transfer or issues to tablet will now work, location of issues on reading list will now be stored based on series directory, and other small code fixes 2015-03-28 17:53:18 -04:00
evilhero 640fafc3d3 FIX: When Failed download handling was being run, would fail to find nzb/torrent in the db due to extra characters not being parsed. 2015-03-28 17:50:26 -04:00
evilhero 4fad909380 FIX: readinglist module error 2015-03-27 15:07:19 -04:00
evilhero bacb9111ef FIX: Paramiko module error on startup if Paramiko not installed. 2015-03-27 14:42:48 -04:00
evilhero cdc3e8a7a0 IMP: Cleaned up interface for StoryArcs / Story Arc Details, IMP: Cleaned up interface for Reading list Management, IMP: Added better reading list management - new status (added, downloaded, read), IMP: Added sync option for use with another device for reading list transfer (ie. tablet) Android only, IMP: Autopopulate new weekly pull releases to reading list, IMP: 'Watch' option in weekly pull list now fully functional. Will watch CV for series' that do not have any series data yet as they are new starting series. Will auto-add once available, IMP: Auto-watch check is run after every refresh/recreate of the weeklypull list, IMP: Improved the Add a Series option where it will now look for issues that are 'new' or 'wanted' during add sequence, IMP: Main page interface now has coloured have/total bars to denote series completion, IMP: New scheduler / threading locks in place in an attempt to avoid database locks, FIX: Removed some erroneous locking that was going on when importing a directory was being run, IMP: Stat counter now present when post-processing multiple issues in sequence, FIX: for issue number error when post-processing and issue number was a non-alphanumeric, FIX: for metatagging: when original file was .cbz, would try to convert and fail, FIX: for issues that were negative and were preceeded by a # in the filename (filechecker), FIX: for publisher having non-alphanumeric character in name when attempting to determine publisher, FIX: if annuals enabled, would incorrectly show as being 'already in library' when viewing search results if results constained annuals, FIX:(#944) for incorrect nzbname being used when post-processing was being performed from an nzb client (experimental mainly), IMP: Turned off logging for ComicVine API counter, FIX: Added retry attempts when connecting to ComicVine in order to avoid errors when adding a series, IMP:(#963) Added ability to add snatched to filter when viewing Wanted issues on Wanted tab, FIX: When importing and then selecting a series to import via the select screen, will now flip back to the importresults and add the selected series in the background, IMP:(#952) Main page is now sorted in ascending order by Continuing/Ended status (and subbed by whether is Active/Paused).Custom sorting is still available, FIX: Dupecheck will now automatically assume existing 0-byte files are to be overwritten when performing post-processing, FIX: If publication date for series contained a '?' (usually with brand new series) will force to 'Present' to allow for pull-list comparisons to take place, FIX: Mylar will now disallow search results which have 'covers only' or 'variant' in the filename, IMP: Better nzbname generation/retrieval (will check inside nzb for possible names) to be used when post-processing, IMP: DB Update will now perform update to all active comics in descending order by Latest Date (instead of random order), FIX: Enforce the 5hr limit rule when running DB update (will only update series that haven't been updated in >5 hours), FIX: Annuals will now have/retain the proper status upon doing DB Update, FIX: Have totals will now be updated when doing a recheck files (sometimes wouldn't get updated depending on various states of status'), FIX:(#966) Added urllib2.URLError exeception trap when attempting to check Git for updates, IMP: Removed the individual sqlite calls for weeklypull, and brought them into line with using the db module (which will minimize concurrent access, which seemed to be causing db locks), IMP: Cleaned up some code and shuffled some functions so they are in more appropriate locations 2015-03-27 13:27:59 -04:00
John 052e6ecb0b remove auth for /cache, added getArt
Set correct headers, add imageurls to do, added getArt.
2015-03-05 13:57:12 -05:00
evilhero dea9ee73a2 FIX:(#944) When using RSS Feeds, and grabbing off of them - would sometimes take an incorrect value for the nzbname which would result in a failed post-processing message (due to the nzbname being generated off of the d-nzbname-proper) 2015-02-18 14:33:18 -05:00
Cybr Wizrd a27a18619e In retryissue: Missing U in UID for nzb.su (should be NZBSU_UID, not NZBSU_ID) 2015-02-17 02:06:32 -05:00
evilhero a692cfb745 FIX: Hopefully addressed the issue where re-downloads of the pull-list occur after they've already been downloaded, FIX: Having duplicate issues within the series directory will now be handled properly based entirely on duplication settings in the GUI, FIX: Fixed a small bug when adding a series, would not populate the pull-list when the series was on said list, IMP: Removed Downloaded status as an available option to change issues to on the comic details page, FIX: Formatted multiple series diretories on the comic details page a bit better, IMP: Added different css colouring for Downloaded status on the weekly pull list, FIX: Annuals should now be appearing on the Manage Issues tab 2015-02-09 13:44:10 -05:00
evilhero f31f279add FIX: If an issue was downloaded where the series contained an ', it would fail to match up on post-processing due not accounting for the ' properly within the nzb name that is stored by Mylar 2015-02-08 14:55:33 -05:00
evilhero 946c3d48e1 FIX:(#939) Redirect loop error when ALT_PULL is enabled and attempting to load up new weekly pull-list, FIX: When manual post-processing and doing out-of-whack check if the Series Total was equal to the Have Total, would perform an endless loop sequence. 2015-02-02 15:29:21 -05:00
evilhero e7b1cdf843 FIX: When searching for issues prior to local OS' epoch date, would error due to resulting mktime comparison (mainly Windows based). Now will just set a pre-determined value for anything prior to 1970 to use as a posting date when comparing dates. 2015-02-02 13:59:30 -05:00
evilhero c730c59552 FIX: Pushbullet notifcations fixed (will send to all pushbullet devices assigned to provided pushbullet apikey currently) 2015-01-31 17:21:42 -05:00
evilhero c140c75785 FIX: Adjusted generated nzbname to remove titles that had apostrophes which would cause non-matches during post-processing 2015-01-30 20:11:40 -05:00
evilhero df09b562f8 FIX: When updating a setting in the comic details/Edit Settings tab, would take 'None' as a valid Alternate FileName if nothing else was present - which would cause errors when file-renaming. 2015-01-30 20:07:21 -05:00
evilhero ee87963762 FIX: when adding story arcs would always return a message indicating arc was already in list,and would not add the arc 2015-01-29 20:45:44 -05:00
evilhero 590d838401 FIX:(#936) Error on Manual post-processing would give an 'IOError: [Errno 9] Bad file descriptor' message 2015-01-29 13:51:43 -05:00
evilhero 0b9ce0befe FIX: (#932) RSS Checker would not include first item in rss feed 2015-01-28 02:39:21 -05:00
evilhero b27ecf8911 FIX: Error when doing Force Check, or scheduled search 2015-01-25 14:21:52 -05:00
evilhero cd5a8b2be5 IMP: Added HTTPS support, with certificate/key generation, FIX: If a series had a ', search results would miss some key results when not hitting rss feeds, IMP: Better handling of series' that have non-alphanumeric characters when it comes to requesting search results, FIX: Removed some unnecessary spamming when file-checking/manual post-processing in relation to # signs 2015-01-24 21:26:22 -05:00
evilhero e80c39c085 IMP: Alternate File Naming can now be configured on a per-series basis, which will rename series' accordingly when manual renaming or post-processing (both downloaded & manual), FIX: Will now better handle filenames that contain a # to denote an issue numbering (file-checking), FIX: When manually renaming, if issue numbering had a trailing decimal would error out, FIX: When parsing search results, if an nzb had a ' in the title, would be incorrectly accounted for - will now be able to match these series' more reliably 2015-01-24 03:33:54 -05:00
evilhero 61af7a5e3d FIX: Removed the 'v' from the volume tag when applying it to the ComicRack tagging when using meta-tagging 2015-01-20 00:41:29 -05:00
evilhero d4113db5bc FIX: Manual renaming of files would fail if any issues where had non-numeric characters, FIX: Removed some unecessary logging statements and print statements when adding story arcs, IMP: After sucessful search result, will now send notification AFTER updating the status, instead of prior which was causing errors if there were errors sending the notification due to timeouts, FIX: Can no longer add identical Story Arcs to the Story Arc Watchlist screen. 2015-01-19 13:41:18 -05:00
evilhero ae6f2830c3 FIX: When downloading/post-processing a cbz file, and meta-tagging was enabled - would delete the actual cbz file at the end of the sequence and mark it as Archived. Now will tag it correctly and more importantly, not delete said file after sequence has been run. 2015-01-19 00:11:59 -05:00
evilhero 2be2c78a00 FIX: Windows users were unable to view more detailed information on a given issue - the 'i' icon beside each issue that is in Downloaded status AND is a cbz file. 2015-01-19 00:10:46 -05:00
evilhero db093f7a75 FIX: Invalid Try/Except iterations during db execution on startup - only affect new installations of Mylar. 2015-01-19 00:06:43 -05:00
evilhero 3945ba4a0d Many updates & bug fixes - too many too list here (check changelog @ http://forum.mylarcomics.com/viewtopic.php?f=2&t=545) 2015-01-16 14:40:08 -05:00
evilhero c814e0aa35 FIX: Would cause an error when importing Story Arcs that did not contain a publisher entry, FIX: When attempting to auto-populate the Series for a given story arc (using the search option) would leave one series out which would result in a None value for the Series Year which caused errors when doing a search for watchlist matches. 2015-01-04 04:17:49 -05:00
evilhero 568f0de60c FIX:When parsing search results, would cause ValueError when attempting to determine the volume label when the volume was present and words starting with 'v' were present after 2015-01-04 03:53:23 -05:00
evilhero 4109760616 FIX:(#916) Error adding series when Issue Title field was not present 2015-01-04 03:47:45 -05:00
evilhero 77899c2390 FIX:(#912) Updated fix to include issues that have trailing decimal places - whether on purpose or not, which was causing incomplete loading of these series 2015-01-02 01:56:01 -05:00
evilhero 054b7cf3aa FIX:(#912) Unable to add series that have issue numbers containing 'O' and 'X'. Also updated file checking to include the same fix. 2015-01-01 19:58:31 -05:00
evilhero 7e6a0e648a FIX: (#910) Upcoming tab would be unaccessible if there were annuals present that just had an IssueID, with no associative ComicName within the annuals table. 2015-01-01 19:33:47 -05:00
evilhero 212cfa7758 FIX:(#905) Removed Donation button from config screen to lessen confusion, FIX:(#906) External links will now open in new tab (again), as well as changelog link from within Update popup 2014-12-20 12:12:46 -05:00
evilhero d9a303fe4b IMP: When scanning a folder using the Import a Directory option, upon completion a button to the Import Results Management page will be displayed to allow for easier access / acknowledgement of completion of scan, FIX: Fixed some issues with the search results page displaying too much information, IMP: Improved the ability to see alternate covers within issues when viewing selected issue details via the 'i' icon on the issue details page, IMP: Fixed the problem with issues that had 2015 dates and wouldn't scan in via manual post-processing, IMP: Added duplicate issue detection (beta) - enabled, when post-processing (manually or otherwise), will retain the issue that is bigger in filesize and won't post-process if it's smaller in size, instead of hammering the oldest copy, FIX: bunch of small fixes, and getting groundwork done for other things. 2014-12-18 13:30:57 -05:00
evilhero cebb3b4ada FIX: When using the 'Snatched as Have' option, downloading issues wouldn't get tallied into the total correctly, IMP: Moved the code to check for Issue Titles within a filename into it's own function to allow it to be called from different modules 2014-12-18 13:12:46 -05:00
evilhero 423bce0461 FIX:(#904) If a series only had one issue, when adding would keep the status as Skipped regardless if 'Automatically Mark All Issues as Wanted' was enabled, FIX: When a series had an annual on the weekly pull-list that had no data in CV yet (ie. first annual issue), it would always get added/refreshed as Skipped regardless of settings 2014-12-18 13:03:45 -05:00
evilhero d748d80ff1 IMP: Added ability to set Snatched Status as being able to accumulate the HAVE totals for every series - (config.ini - snatched_havetotal = 0/1) 2014-12-08 12:48:13 -05:00
evilhero f3806a1b4c FIX: When Adding a Story Arc via the Search method, if an issue had no title it would error out and only display a few issues when viewing the arc, IMP: When viewing a specific Story Arc, if it was an imported cbl, the issue's would not display the Publication Year properly, IMP: Removed a spammed print message, IMP: Changed the colour of the Donate button so that it's blue. 2014-12-08 12:19:20 -05:00
evilhero f19783ed56 FIX:(#898) When attempting to parse torrent name to generate filename to send to client, would error out if the title of the torrent contained any special characters. 2014-12-04 03:18:36 -05:00
evilhero 4607a1688b FIX: Error when using Experimental search (typo) 2014-12-01 17:15:31 -05:00
evilhero 70f0c75dc8 FIX: When starting up Mylar for the very first time, will indicate -1 series have been ordered, FIX: When using the ALT_PULL method for the pull-list, would grab html colour codes occasionally 2014-12-01 12:25:35 -05:00
evilhero 1ad1d7e927 FIX:(#897) Improvements for Experimental search and better rss handling/searching for it, IMP: restricting filetypes to cbr/cbz, as well as file-sizees, should now be working for Experimental / CBT / KAT, FIX:(#885) referencing issue_firstword errors should now be fixed and working again, IMP: Attempt at better handling of filenames that have issue titles within them (searching only) 2014-12-01 12:23:49 -05:00