Even without using having a fetch_interval column in the feeds table would allow linear or exponential back-off in the case of fetch failure: use current interval, then increase (by incrementing, multiplying by a constant or squaring) the stored value.
This details an idea suggested in Issue #8
16K of 45K recently fetched feeds provide tags:
If we want to poll feeds more often than once a day, this provides an indication of how often the feed is likely to be updated see https://web.resource.org/rss/1.0/modules/syndication/
If used with https://github.com/mediacloud/backup-rss-fetcher/issues/16 we might not fetch the feed document each time we poll, so we would need to save some indication of the (next) poll interval to use in the feeds table.
Even without using having a
fetch_interval
column in the feeds table would allow linear or exponential back-off in the case of fetch failure: use current interval, then increase (by incrementing, multiplying by a constant or squaring) the stored value.