blob GET/HEAD request on S3 like storage is too expensive

distribution / distribution

The toolkit to pack, ship, store, and deliver container content

https://distribution.github.io/distribution

Apache License 2.0

9.02k stars 2.51k forks source link

blob GET/HEAD request on S3 like storage is too expensive #4500

Open kofj opened 3 weeks ago

kofj commented 3 weeks ago

Description

In current any version, if we make a blob GET/HEAD request, it will calls 5 times backend storage apis. That's no problem for local filesystem, but it is slow and expensive for s3 like storage.

So, shall we make a way to reduce or use-short time cache thus expensive api calls.

milosgajdos commented 3 weeks ago

Always use cache: https://distribution.github.io/distribution/about/configuration/#cache

Also, please avoid using v2.8.x release and use the latest available v3 release.