danthegoodman1
commented
3 weeks ago Should support various configs, for example file size min and max size and age thresholds so that you can tune what files are cached (e.g. caching larger, older files which are less likely to be merged and become useless).
Also having TTL, can use s3-fifo for LRU cache as well.
Instead of fetching from S3, fetch from a local SSD cache. Can use local NVMes since this is just a cache to improve performance.
Related to #16
Might be good to have consistent routing to compute instance with load spillover instead of random and groupcache to reduce network hops(?) and reduce redundant caching.
Will need caching (and routing) configuration.