buro9 / microcosm

Front end for Microcosm, a Go web server that serves the static files, templates and performs API calls.
GNU Affero General Public License v3.0
11 stars 3 forks source link

Include a configurable size LRU cache for attachments, this should be file system based #124

Open buro9 opened 1 year ago

buro9 commented 1 year ago

We read attachments from AWS S3, but the data transfer is expensive.

We should be a reverse proxy cache to AWS S3 and cache all attachments to the local file system. This needs to be a file system based LRU so that the cache survives restarts. It needs to be configurable too, such that it can be configured to use as much disk as necessary to reduce the AWS S3 transfer costs.