search

HDFGroup / hsds

Cloud-native, service based access to HDF data
https://www.hdfgroup.org/solutions/hdf-kita/
Apache License 2.0
129 stars 53 forks source link

Enable HTTP Compression #66

Closed jreadey closed 4 years ago

jreadey commented 4 years ago

Many dataset hyperslab and point selections would benefit from using HTTP Compression (c.f. https://en.wikipedia.org/wiki/HTTP_compression). For example, if 1024x1024 dataset is mostly zero's, reading the entire dataset would need to transmit relatively few bytes if the response is compressed compared to 10241024element_size for the uncompressed response.

jreadey commented 4 years ago

This is implemented in https://github.com/HDFGroup/hsds/commit/d39ff5fd7b1fe81c63089af40bc78e963b3ac82b.