kickscondor / fraidycat

Follow blogs, wikis, YouTube channels, as well as accounts on Twitter, Instagram, etc. from a single page.
Other
1.76k stars 56 forks source link

Add option to lower the feed scanning interval in order to make fewer requests #243

Open joshuacwnewton opened 2 years ago

joshuacwnewton commented 2 years ago

Before you start.

Desktop (please complete the following information):

Describe the bug

I use NextDNS as my DNS resolver (as an alternative to PiHole, which I love, but it's a bit of a pain to maintain your own server).

Recently, I got an email from NextDNS saying that I reached 250,000 requests out of my allotted 300,000 requests (free plan). I was curious where all those requests were coming from, so I checked the Analytics page, and saw this:

image

That's... a lot of requests!!

image

Proposed solution

For comparison, the settings page of Feedbro, another Firefox RSS reader, has this option:

image

I'm not sure what configuration Fraidycat uses under the hood (it looks like it checks once every ~3m, give or take), but it could be nice to expose this setting to users in some way to provide some control over the number of requests made.

kickscondor commented 2 years ago

Ok great - I agree. Fraidycat can be quite voracious - and this would be easy to expose. Thanks!

aereaux commented 2 years ago

Hello, just wanted to chime in that I'm experiencing the same problem. One of the feeds I subscribe to (https://hackerfactor.com/blog/) bans my IP often because fraidycat requests the RSS feed too often. It would probably also be possible to automatically set an interval per-feed based on how often it updates, but that could get complicated.

Fraidycat also doesn't appear to surface the 429 and 410 errors that I started getting, but that is a separate issue.