search

buchgr / bazel-remote

A remote cache for Bazel
https://bazel.build
Apache License 2.0
576 stars 150 forks source link

S3 backed vs Blob backed remote cache performance #748

Open Ryang20718 opened 2 months ago

Ryang20718 commented 2 months ago

We currently have an S3 backed cache. Whilst we haven't profiled the performance vs a blob based remote cache performance, I was wondering whether there is a configuration suggestion that is recommended (assuming a lot of small files and some larger ones here and there) in terms of best performance?

mostynb commented 2 months ago

For best performance I recommend fast local storage (I tend to prefer XFS on linux), rather than using the proxy backends.