WIP: Compare ingest path benchmark and compression

grafana / pyroscope

Continuous Profiling Platform. Debug performance issues down to a single line of code

https://grafana.com/oss/pyroscope/

GNU Affero General Public License v3.0

9.65k stars 576 forks source link

WIP: Compare ingest path benchmark and compression #3330

Open simonswine opened 1 month ago

simonswine commented 1 month ago

Currently we compress twice with gzip2 on the distributors, we should consider switching at least one of those off (if not both). Or consider a better transport compression.

TODO:

Compare bytes on the wire with uncompress profile bytes
Make zstd and/or lz4 work

Releates to https://github.com/grafana/pyroscope/issues/2545