Act: cache more, update fine grained

stakevrun / db

GNU Affero General Public License v3.0

0 stars 0 forks source link

Act: cache more, update fine grained #26

Open xrchz opened 4 months ago

xrchz commented 4 months ago

We may need to support refreshing only part of the cache at a time, for efficiency, based on the outcome of #23. One approach here: limit the number of jobs done periodically, and sort jobs for the next update by how stale the data is. Would need to accept instructions to specifically refresh things from srv.

xrchz commented 1 week ago

Probably do this:

Cache everything in memory
Only update specific things in the cache when we know what changed (because it comes from a request from srv)
Do a full refresh periodically but less than once an hour - maybe a few times a day