pangeo-data / zarr-proxy

A proxy for Zarr stores that allows for chunking overrides.
Apache License 2.0
9 stars 3 forks source link

To compress or not to compress? #5

Open rabernat opened 1 year ago

rabernat commented 1 year ago

Right now we are returning raw, uncompressed chunks to the client. We could instead recompress them.

Whether this improves performance is very difficult to guess without some systematic benchmarking. Basically, it is a tradeoff. Compressing means more CPU work for both client and server, but potentially less data to transfer.

Just flagging this as a potential area for future work.