search

awslabs / soci-snapshotter

A containerd snapshotter plugin which enables standard OCI images to be lazily loaded without requiring a build-time conversion step.
Apache License 2.0
517 stars 54 forks source link

Span Size Impact #114

Open sbuckfelder opened 1 year ago

sbuckfelder commented 1 year ago

Investigate the impact of using different span sizes on benchmark workloads.

vkuzniet commented 1 year ago

The benchmarking results are presented in the following document: Performance effects of building Ztocs with different values of span size.pdf

The main takeaways are:

vkuzniet commented 1 year ago

When eliminating the network latency when downloading a layer, a different set of results was produced. There’s a strong negative correlation between increasing span size and underlying performance if we eliminate network calls. Therefore, it doesn’t make sense to increase the default span size until the S3 optimization is complete and another evaluation is done to confirm that the default value of span size of 4MiB is not enough. For more details on the analysis, you can read the updated document below: Performance effects of building Ztocs with different values of span size.pdf