search

qbittorrent / qBittorrent

qBittorrent BitTorrent client
https://www.qbittorrent.org
Other
28.08k stars 3.96k forks source link

Ability to stagger RSS feed refresh interval for individual rules #18671

Open ghost opened 1 year ago

ghost commented 1 year ago

Suggestion

I am running into an issue with one torrent site, RARBG, where my RSS feed rules are being rate limited.

I would like to do this, but when I do I am rate limited because these are all run one after the next. There is no option to run one, wait 15 min, run the next, etc. A few will run but then others will get stuck and show up with error icons, the logs also show the error.

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=76177

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=397060

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=393197

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=364093

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=382389

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=39358

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=393187

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=76119

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=361753

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=81157

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=278518

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=84082

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=159651

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=74379

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=393189

Use case

I use jackett and, instead of using a single RSS feed for a single category and then hoping my regex rules will find the torrents I want, I would rather use the show ID. But this reveals a limitation of qBittorrent where all of these RSS rules are run one immediately after the next ( for the same category ID ) causing me to be rate limited (520). (I have set every 15 minutes in qbittorrent and cache to 2400 seconds in jackett.)

If we could stagger the RSS fetch when multiple feeds have the same category ( or maybe based on Rules in folder?) this would be avoided and I could run my rules and abide by RARBGs API rules.

As it stands I don't see a way to take advantage of the jackett show ID feature while abiding by RSS fetch API rules

Extra info/examples/attachments

2023-03-07 10:46:32 Info Torznab search in RARBG => Found 32 releases (from cache)
2023-03-07 10:46:32 Info Torznab search in tag:mvgroup => Found 100 releases
2023-03-07 10:46:28 Info CardigannIndexer (mvgroupmain): Relogin required
2023-03-07 10:46:25 Info CardigannIndexer (mvgroupforum): Relogin required
2023-03-07 10:46:24 Info Torznab search in RARBG => Found 100 releases
2023-03-07 10:45:52 Info Torznab search in RARBG for BluRay => Found 100 releases (from cache)
2023-03-07 10:45:52 Info Torznab search in RARBG for .WEB => Found 100 releases (from cache)
2023-03-07 10:45:52 Info Torznab search in RARBG for 2160p x265 => Found 100 releases
2023-03-07 10:38:07 Info Torznab search in RARBG => Found 32 releases
2023-03-07 10:30:58 Error Jackett.Common.IndexerException: Exception (rarbg): Rate limited with StatusCode 520, retry in 3 minutes
2023-03-07 10:30:53 Info Torznab search in tag:mvgroup => Found 100 releases
2023-03-07 10:30:53 Info Torznab search in RARBG => Found 100 releases (from cache)
2023-03-07 10:30:53 Info Torznab search in RARBG for BluRay => Found 100 releases
2023-03-07 10:30:47 Info Torznab search in RARBG for .WEB => Found 100 releases (from cache)
2023-03-07 10:30:47 Info Torznab search in RARBG for 2160p x265 => Found 100 releases (from cache)
2023-03-07 10:15:58 Error Jackett.Common.IndexerException: Exception (rarbg): Rate limited with StatusCode 520, retry in 3 minutes
luzpaz commented 1 year ago

Linking to #8350

jNullj commented 9 months ago

Should we close this?

  1. RARBG seems to have been shutdown https://en.wikipedia.org/wiki/RARBG#:~:text=enforcement.%5B5%5D-,Shutdown,-%5Bedit%5D
  2. The user who opened this request seems to be deleted
  3. There is now a rate limit feature