search

elastic / rally

Macrobenchmarking framework for Elasticsearch
Apache License 2.0
1.95k stars 313 forks source link

Add support for zstd-compression #1786

Closed danielmitterdorfer closed 1 year ago

danielmitterdorfer commented 1 year ago

With this commit we add support for zstd compressed corpora. Compared to bzip, the zstd format produces compressed files that are roughly 40% smaller and took around a third of the time to decompress in our tests.

Closes #1781

danielmitterdorfer commented 1 year ago

Thanks! Yes, I've tested both cases (with the library and the native binary). Also, the library I've picked seems to be the most mature of them.