Accept zstd compressed input files, in addition to gzip

theosanderson / taxonium

A tool for exploring very large trees in the browser

http://taxonium.org

GNU General Public License v3.0

95 stars 17 forks source link

Accept zstd compressed input files, in addition to gzip #596

Open corneliusroemer opened 3 weeks ago

corneliusroemer commented 3 weeks ago

Loading a large tree (SC2 Usher) takes quite a while (~1min) even on fairly performant hardware (M1 Pro 32GB).

I can imagine that gzip decompression might be a bottleneck - zstd decompresses much faster.

Might be worth offering that option as well!

theosanderson commented 3 weeks ago

As I recall it the bottleneck isn't compression but just turning all that text into JS objects but I should check and zst could be nice to support in any case