Commit Graph

82 Commits

Author SHA1 Message Date
Diego Heras aca4a16bae
ci/cd: fix whitespaces (#11749) 2021-05-16 20:13:54 +02:00
Diego Heras bf8cae6a48
core: allow to set user-agent header per indexer (#10528) 2020-12-16 01:42:41 +01:00
Diego Heras ebe05267b2
core: FlareSolverr integration. Bypass Cloudflare protection (#9028) 2020-12-13 21:42:10 +01:00
Diego Heras 18aff90b9c
core: add post body in debug traces. resolves #10285 (#10320) 2020-11-28 22:04:41 +01:00
Diego Heras 938315cebd
core: remove legacy cloudflare code (#10110) 2020-11-04 23:01:58 +01:00
Diego Heras d0dff67251
core: handle error in proxy dns. resolves #8826 resolves #4785 (#9661) 2020-09-26 22:52:22 +02:00
Diego Heras 41afd9f61b
core: add an option to disable proxy. resolves #8138 (#9660) 2020-09-26 22:28:29 +02:00
Diego Heras 7279edf354
core: fix ignoresslerrors cli option (#9657) 2020-09-26 19:50:58 +02:00
Garfield69 73eb8ddac0 webclient: debug logging. some json starts with [ #8529 2020-09-22 18:42:38 +12:00
Diego Heras 24bffe9dae
core: refactor http webclient part 17 #8529 (#9589)
Print HTML in debug mode. Fix bugs in old implementation too
2020-09-22 13:06:23 +12:00
ngosang 621a47338d core: refactor http webclient part 16 #8529
Rename RequestWithCookiesAsync method
2020-09-21 19:06:32 +02:00
ngosang 5ad1c9c87c core: refactor http webclient part 15 #8529
Fix Mono 5.x and Automapper bugs
2020-09-21 18:21:48 +02:00
Cory ac0ba0f9b1 core: refactor http webclient part 13 #8529 (#8941)
Merge string/byte request code
2020-09-21 18:13:30 +02:00
Cory 67c7b4ca70 core: refactor http webclient part 12 #8529 (#8939)
Merge web results classes into single class and update usages
2020-09-21 18:13:27 +02:00
Cory 124719acae core: refactor http webclient part 11 #8529 (#7728)
Remove redundant NetCore classes and update client selection logic
2020-09-21 18:13:23 +02:00
Cory 125298425a core: refactor http webclient part 10 #8529 (#7729)
Move WebResult String and Byte properties to base class
2020-09-21 18:13:19 +02:00
Cory ab74421a81 core: refactor http webclient part 9 #8529 (#7727)
Move identical functions up to base WebClient instance. Replay #7691
2020-09-21 18:13:16 +02:00
Cory 41dd2dcad5 core: refactor http webclient part 8 #8529 (#7725)
Replay Remove automapper commit after rebase
2020-09-21 18:13:12 +02:00
Cory b2f00d7fde core: refactor http webclient part 7 #8529 (#7689)
Move web-result encoding logic to internal lazy evaluation
2020-09-21 18:13:09 +02:00
Cory 2d1ad624bb core: refactor http webclient part 6 #8529 (#7690)
Add implicit string result conversion
2020-09-21 18:13:06 +02:00
Cory 30965c0d3b core: refactor http webclient part 5 #8529 (#7661)
Update standard clients to X509Certificate2
2020-09-21 18:12:03 +02:00
Cory 4dd6da4f6e core: refactor http webclient part 4 #8529 (#7653)
Change byte result name to ContentBytes in preparation for merge
2020-09-21 18:12:00 +02:00
Cory abb8526b76 core: refactor http webclient part 3 #8529 (#7659)
Move encoding for results into BaseWebResult to prepare for class merging
2020-09-21 18:11:57 +02:00
Cory d760350dc0 core: refactor http webclient part 1 #8529 (#7652)
Rename WebClientStringResult.Content to WebClientStringResult.ContentString
2020-09-21 18:11:48 +02:00
ngosang 1271ecaa4c Revert "core: refactor http webclient part 1 #8529 (#7652)"
This reverts commit 0bdcfd1e7b.
2020-09-21 08:04:26 +02:00
ngosang e4d384158a Revert "core: refactor http webclient part 3 #8529 (#7659)"
This reverts commit 823ed8522c.
2020-09-21 08:04:15 +02:00
ngosang ede3f77e6a Revert "core: refactor http webclient part 4 #8529 (#7653)"
This reverts commit c605c9a7ae.
2020-09-21 08:04:11 +02:00
ngosang 263b5b5433 Revert "core: refactor http webclient part 5 #8529 (#7661)"
This reverts commit 4a11a770d7.
2020-09-21 08:04:06 +02:00
ngosang db0d14822f Revert "core: refactor http webclient part 6 #8529 (#7690)"
This reverts commit 0f431471cd.
2020-09-21 08:04:02 +02:00
ngosang 5f457fcb29 Revert "core: refactor http webclient part 7 #8529 (#7689)"
This reverts commit 79fa3b9e0d.
2020-09-21 08:03:27 +02:00
ngosang 08c41c6daa Revert "core: refactor http webclient part 8 #8529 (#7725)"
This reverts commit 1184a9285a.
2020-09-21 08:03:23 +02:00
ngosang 94feb875f7 Revert "core: refactor http webclient part 9 #8529 (#7727)"
This reverts commit c8b91bece6.
2020-09-21 08:03:18 +02:00
ngosang 2d0b378545 Revert "core: refactor http webclient part 10 #8529 (#7729)"
This reverts commit 3a0ece162f.
2020-09-21 08:03:14 +02:00
ngosang 90d31a9b8e Revert "core: refactor http webclient part 11 #8529 (#7728)"
This reverts commit e0ef6bc8a8.
2020-09-21 08:03:08 +02:00
ngosang a8d055f0d5 Revert "core: refactor http webclient part 12 #8529 (#8939)"
This reverts commit 22bced9ca3.
2020-09-21 08:02:58 +02:00
ngosang ca61f965e9 Revert "core: refactor http webclient part 13 #8529 (#8941)"
This reverts commit 4d63fa81d5.
2020-09-21 08:02:53 +02:00
Cory 4d63fa81d5 core: refactor http webclient part 13 #8529 (#8941)
Merge string/byte request code
2020-09-19 18:43:06 +02:00
Cory 22bced9ca3 core: refactor http webclient part 12 #8529 (#8939)
Merge web results classes into single class and update usages
2020-09-19 18:40:08 +02:00
Cory e0ef6bc8a8 core: refactor http webclient part 11 #8529 (#7728)
Remove redundant NetCore classes and update client selection logic
2020-09-19 18:39:33 +02:00
Cory 3a0ece162f core: refactor http webclient part 10 #8529 (#7729)
Move WebResult String and Byte properties to base class
2020-09-19 18:39:12 +02:00
Cory c8b91bece6 core: refactor http webclient part 9 #8529 (#7727)
Move identical functions up to base WebClient instance. Replay #7691
2020-09-19 18:38:46 +02:00
Cory 1184a9285a core: refactor http webclient part 8 #8529 (#7725)
Replay Remove automapper commit after rebase
2020-09-19 18:38:21 +02:00
Cory 79fa3b9e0d core: refactor http webclient part 7 #8529 (#7689)
Move web-result encoding logic to internal lazy evaluation
2020-09-19 18:37:56 +02:00
Cory 0f431471cd core: refactor http webclient part 6 #8529 (#7690)
Add implicit string result conversion
2020-09-19 18:37:27 +02:00
Cory 4a11a770d7 core: refactor http webclient part 5 #8529 (#7661)
Update standard clients to X509Certificate2
2020-09-19 18:36:56 +02:00
Cory c605c9a7ae core: refactor http webclient part 4 #8529 (#7653)
Change byte result name to ContentBytes in preparation for merge
2020-09-19 18:36:33 +02:00
Cory 823ed8522c core: refactor http webclient part 3 #8529 (#7659)
Move encoding for results into BaseWebResult to prepare for class merging
2020-09-19 18:35:44 +02:00
Cory 0bdcfd1e7b core: refactor http webclient part 1 #8529 (#7652)
Rename WebClientStringResult.Content to WebClientStringResult.ContentString
2020-09-19 18:33:39 +02:00
Diego Heras c02a782b95
core: fix cloudflare iuam. resolves #8539 (#8617) 2020-05-13 00:04:47 +02:00
Diego Heras 9cbc78b1c2
core: fix cookie parsing (part 2) (#8150)
* core: fix cookie parsing (part 2)

After fixing cookie storage in #8133 I noticed that I still have a lot of '.json.bak' files in the Jackett configuration folder. After deleting them they were created again in each request. The cause was we were parsing bad the cookies with '=' character in the value. Most Cloudflare cookies include if so we were sending bad cookies and solving the callenge in each request.

This PR should increase performance in several ways: we are not solving the challenge again (it takes time), we are not making extra requests and we are not updating the Jackett configuration in each request (both files '.json' and '.json.bak').

Tested with the client HttpWebClient2NetCore only. Please do some tests with the site 1337x.
2020-04-13 06:22:50 +02:00