Commit Graph

115 Commits

Author SHA1 Message Date
Alessio Gogna 6dab689533
[feature] Indexer Test status filter (#11705) Partial solution for #3292 2021-05-16 09:52:12 +12:00
Alessio Gogna 66bec102db
[Feature] Filter Meta Indexer by tag and by language (#11662). resolves #8884 resolves #7170 resolves #4787 resolves #2185
* bump to 0.18.*

Also partially addresses https://github.com/Jackett/Jackett/issues/661 (if user adds `enabled` and `disabled` tags).

Co-authored-by: garfield69 <garfieldsixtynine@gmail.com>
Co-authored-by: ilike2burnthing <59480337+ilike2burnthing@users.noreply.github.com>
2021-05-08 21:24:18 +01:00
Alessio Gogna 7789a72ffb
[enhancement] Date parser handle dates without a year. resolves #11219 (#11656) 2021-05-03 20:26:43 +01:00
6cUbi57z 42b6aaedc9
erairaws: add new public tracker. resolves #4116 (#11484)
Also change release size for ShowRSS to 512MB.

Co-authored-by: 6cUbi57z <git@g-de.co.uk>
Co-authored-by: ilike2burnthing <59480337+ilike2burnthing@users.noreply.github.com>
2021-04-18 16:56:34 +01:00
NinjaLikesCheez f5688f289d
core: Migrate configurations from bug fixed in #11173. Fixes #11313 (#11347) 2021-03-31 06:47:16 +13:00
XYZJR 6d79cab496
Feature/rutracker music album rerelease. resolves #11161 (#11275) 2021-03-14 23:51:10 +00:00
Diego Heras 456338399b
core: remove rss feed image (legacy code) #324 (#10837) 2021-01-17 13:42:52 +01:00
Diego Heras 13baa27656
core: fix .net core 5.0 warnings. resolves #10433 (#10485) 2020-12-12 21:38:33 +01:00
Diego Heras 69125add3e
core: redo search cache from scratch. resolves #10382 (#10447)
In simple words, when you make a request in Jackett, the results are saved in memory (cache). The next request will return results form the cache improving response time and making fewer requests to the sites.
* We assume all indexers/sites are stateless, the same request return the same response. If you change the search term, categories or something in the query Jackett has to make a live request to the indexer.
* There are some situations when we don't want to use the cache:
** When we are testing the indexers => if query.IsTest results are not cached
** When the user updates the configuration of one indexer => We call CleanIndexerCache to remove cached results before testing the configuration
** When there is some error/exception in the indexer => The results are not cached so we can retry in the next request
* We want to limit the memory usage, so we try to remove elements from cache ASAP:
** Each indexer can have a maximum number of results in memory. If the limit is exceeded we remove old results
** Cached results expire after some time
* Users can configure the cache or even disable it
2020-12-11 23:14:21 +01:00
airhawk777 65ca4d7478
Update to .NET 5 (#10346)
* Update to .NET 5

.NET 5 brings many performance (especially regex) improvements
https://devblogs.microsoft.com/dotnet/announcing-net-5-0/

Can look at bringing the packages upto date and using a single file executable in a future PR if the maintainers are interested

* Dotnet restore before building

* Restore on Windows only

* Out of ideas

* Update framework for windows specific apps

* Don't upgrade Microsoft.Extensions.Configuration

* drop mono from the dotnet linux build instructions

* Fix logic to get app runtime

* readme: add windows .net prereq link

* Update README.md

* azure-pipeline: bump minorversion to 17

Co-authored-by: garfield69 <garfieldsixtynine@gmail.com>
Co-authored-by: Diego Heras <ngosang@hotmail.es>
Co-authored-by: ilike2burnthing <59480337+ilike2burnthing@users.noreply.github.com>
2020-12-08 21:10:34 +13:00
Diego Heras 38f09900ca
core: fix version number to match github release tag. resolves #10249 (#10413) 2020-12-07 00:14:23 +01:00
Diego Heras 2030d9cf13
core: follow torznab specs about categories. resolves #10120 (#10147) 2020-11-08 23:27:54 +01:00
Diego Heras 2ea22af9ef
core: rename comments field to details #10092 (#10135) 2020-11-08 15:11:27 +13:00
Diego Heras c5dd37b836
core: rename banner field to poster #10092 (#10134) 2020-11-08 12:43:33 +13:00
Diego Heras 2cf78fe4fd
core: add missing torznab attributes. resolves #10118 (#10122)
* add coverurl
* rename tvdb and tmdb
2020-11-06 22:03:25 +01:00
Diego Heras 11e4143841
core: add more unit tests (#10107) 2020-11-04 21:56:54 +01:00
Diego Heras 14fdea164c
core: generate magnet link from infohash and vice versa. resolves #8590 (#10087)
* global list of public trackers
* infohash => magnet link (only in public trackers)
* magnet link => infohash
2020-11-02 17:43:13 +01:00
Diego Heras 6413ad8fd4
core: refactor results post processing: filter and fixing results (#10082) 2020-11-02 14:20:13 +01:00
Diego Heras 1d7ea48505
core: add custom cats in indexers with string categories. resolves #9746 (#10060)
* When category ids in the indexer are "strings" we create a unique hash to make it compatible with Torznab
* This PR also fix several issues related to custom cats
2020-11-02 13:42:00 +13:00
Diego Heras 7a2e52659a
core: rewrite category code from scratch. resolves #8049 (#10031)
* Core: Categories are stored in a real tree
* Sorting: First Torznab categories sorted by Id and then custom cats sorted by Name
* Filtering: Results with child category are not removed when searching by parent category. Details in #8049
* Jacket UI: Add parent category when at least one child category exists
* Torznab (caps): Remove non existent children categories. Remove duplicated categories. Details in #10006
2020-11-01 12:07:24 +01:00
Diego Heras e8c0ca31cc
core: fix disabled unit test (#10028) 2020-10-31 22:11:02 +01:00
Diego Heras b63519b64b
core: add category filter tests (#10024) 2020-10-31 01:51:19 +01:00
Diego Heras 15ea7ed9f9
core: rearrange test classes (#10023) 2020-10-31 01:12:35 +01:00
Diego Heras 767700d6bb
core: categories cleanup (#10006)
* core: categories cleanup
* swap categories 2050 Movies/BluRay / 2060 Movies/3D
* swap categories 6050 XXX/Pack / 6070 XXX/Other
* swap categories 7010 Books/Mags / 7020 Books/EBook / 7030 Books/Comics
* category validation is case sensitive
* renamed some categories to follow Newznab specs
2020-10-29 08:00:48 +13:00
Diego Heras 861655395b
core: move categories code into a new class (#10005) 2020-10-27 22:17:03 +01:00
garfield69 aec14b88e9
Core: correct Other as 8000 and Books as 7000 (#9986)
as documented in https://newznab.readthedocs.io/en/latest/misc/api/#predefined-categories
and update any indexers affected
2020-10-28 08:02:32 +13:00
Diego Heras 74d08c937f
core: add more unit tests (#9907) 2020-10-19 22:22:41 +02:00
Diego Heras da0761406f
core: refactor book-search (#9897) 2020-10-19 21:26:43 +02:00
Diego Heras 1e42016546
core: refactor music-search (#9895) 2020-10-18 23:20:08 +02:00
Diego Heras 56a260f0d7
core: disable tv-search by default (#9893)
* Disable tv-search in music trackers
* Add TVRage search in Cardigann
2020-10-18 22:47:36 +02:00
Diego Heras 9cdad3de64
core: separate categories from movie-search (#9862)
* Categories and Torznab movie-search are separated
* Movie-search parameters are validated
* Fixed some bugs in Cardigann indexers
2020-10-18 19:26:22 +02:00
Diego Heras dcf339a6eb
core: remove default categories in c# trackers (#9831) 2020-10-13 22:17:26 +02:00
Diego Heras 886de069a7
core: add tests for torznab categories (#9821) 2020-10-12 23:07:21 +02:00
Diego Heras 2654ba808c
core: relocate test classes (#9817) 2020-10-12 13:35:09 +02:00
Diego Heras a1108bc5a2
core: fix invalid characters in xml/rss. resolves #9118 (#9636) 2020-09-25 02:40:13 +02:00
Cory ac0ba0f9b1 core: refactor http webclient part 13 #8529 (#8941)
Merge string/byte request code
2020-09-21 18:13:30 +02:00
Cory 67c7b4ca70 core: refactor http webclient part 12 #8529 (#8939)
Merge web results classes into single class and update usages
2020-09-21 18:13:27 +02:00
Cory 125298425a core: refactor http webclient part 10 #8529 (#7729)
Move WebResult String and Byte properties to base class
2020-09-21 18:13:19 +02:00
ngosang 2d0b378545 Revert "core: refactor http webclient part 10 #8529 (#7729)"
This reverts commit 3a0ece162f.
2020-09-21 08:03:14 +02:00
ngosang a8d055f0d5 Revert "core: refactor http webclient part 12 #8529 (#8939)"
This reverts commit 22bced9ca3.
2020-09-21 08:02:58 +02:00
ngosang ca61f965e9 Revert "core: refactor http webclient part 13 #8529 (#8941)"
This reverts commit 4d63fa81d5.
2020-09-21 08:02:53 +02:00
Cory 4d63fa81d5 core: refactor http webclient part 13 #8529 (#8941)
Merge string/byte request code
2020-09-19 18:43:06 +02:00
Cory 22bced9ca3 core: refactor http webclient part 12 #8529 (#8939)
Merge web results classes into single class and update usages
2020-09-19 18:40:08 +02:00
Cory 3a0ece162f core: refactor http webclient part 10 #8529 (#7729)
Move WebResult String and Byte properties to base class
2020-09-19 18:39:12 +02:00
Diego Heras aa6d8962de
core: update dependencies (#9527) 2020-09-14 00:56:07 +02:00
Diego Heras 2c4ca6be1f
core: update jackett dependencies (#8977) 2020-06-14 13:25:51 +02:00
morpheus133 cd4e5de8f4
Add support of IMDBid search for ncore indexer (#7847) 2020-04-17 17:45:26 -05:00
Diego Heras 47454e4c1e
test: add unit test to validate all cardigann definitions (#8165)
* test: add unit test to validate all cardigann definitions

Error while parsing Cardigann definition 4thd.yml
YamlDotNet.Core.YamlException: (Line: 13, Col: 9, Idx: 240) - (Line: 13, Col: 9, Idx: 240): Exception during deserialization
 ---> System.Runtime.Serialization.SerializationException: Property 'dec' not found on type 'Jackett.Common.Models.CategorymappingBlock'.
2020-04-13 09:34:45 +02:00
Diego Heras 9cbc78b1c2
core: fix cookie parsing (part 2) (#8150)
* core: fix cookie parsing (part 2)

After fixing cookie storage in #8133 I noticed that I still have a lot of '.json.bak' files in the Jackett configuration folder. After deleting them they were created again in each request. The cause was we were parsing bad the cookies with '=' character in the value. Most Cloudflare cookies include if so we were sending bad cookies and solving the callenge in each request.

This PR should increase performance in several ways: we are not solving the challenge again (it takes time), we are not making extra requests and we are not updating the Jackett configuration in each request (both files '.json' and '.json.bak').

Tested with the client HttpWebClient2NetCore only. Please do some tests with the site 1337x.
2020-04-13 06:22:50 +02:00
Cory 937aa6b370
Add multi value processing to GetQueryString (#7915) 2020-04-09 23:18:10 -05:00