akirk / friends

A social network between WordPresses. Privacy focused, by itself a self-hosted RSS++ reader with notifications.
https://wpfriends.at/
GNU General Public License v2.0
78 stars 13 forks source link

Improve Feed Fetching Cron Accuracy #302

Closed akirk closed 1 month ago

akirk commented 3 months ago

The cron job could run every five minutes since we have a feed meta next-poll. We should thus also improve the logic for broken feeds so that they do get rechecked but don't clog the pipe.

Vary the next poll based on the feed success:

  1. Before polling a feed, update the next-poll to 5 minutes later, in case the polling gets stoped due to a php user timeout (30 secs default)
  2. When the feed was polled successfully, update it to the set duration (by default 1hr later).
  3. If the feed has an error, flag it as erroneous and logarithmically increase the next-poll time.