This PR does several important perf fixes to the feed reader system. In particular we're trying to fix memory / storage consumption. To achieve this, the PR does two things:
We drop the account data used by feed reader entirely, instead using Redis. This avoids having to store things in Hookshot's memory, and doing expensive load/save operations. Deployments of Hookshot using an in-memory storage provider will always initial sync on startup. This is a regression, but in practice it only means you miss items that were published during downtime. Anyone wishing for better reliability should be using Redis.
We now read the feeds from Rust, avoiding the memory cost of shifting potentially huge blocks of XML across the native module boundary.
Fixes #789
This PR does several important perf fixes to the feed reader system. In particular we're trying to fix memory / storage consumption. To achieve this, the PR does two things: