gaul / s3proxy

Access other storage backends via the S3 API
Apache License 2.0
1.79k stars 232 forks source link

Read caching middleware #140

Open gaul opened 8 years ago

gaul commented 8 years ago

S3Proxy could provide a read cache by saving every object during get and issuing conditional gets for validation which most backends support. We would need to provide knobs for cache size in gigabytes and number of objects. Write caching raises complex issues so I intentionally scope this to just reads. Related to kahing/goofys#82.

gaul commented 4 years ago

Minio has a similar caching mode:

https://docs.min.io/docs/minio-disk-cache-guide.html