grafana / alloy

OpenTelemetry Collector distribution with programmable pipelines
https://grafana.com/oss/alloy
Apache License 2.0
995 stars 101 forks source link

[prometheus/loki].write: add more compression algorithms #913

Open TheRealNoob opened 1 month ago

TheRealNoob commented 1 month ago

Request

It would be nice to see more (different) compression algorithms supported during write operations to prometheus and loki. gzip compression is by far the most common being support by all webservers such as nginx. Other common algorithms are deflate, brotli, and zstd.

Use case

nginx doesn't support snappy compression, and for large implementations it would make a lot of sense to be able to send compressed data.

csh0101 commented 1 month ago

what problem about snappy? for nginx

TheRealNoob commented 1 month ago

my understanding is that nginx doesn't support snappy out of the box - some people have made modules to add it but it's unrealistic to expect most people will do that

csh0101 commented 1 month ago

my understanding is that nginx doesn't support snappy out of the box - some people have made modules to add it but it's unrealistic to expect most people will do that我的理解是 Nginx 不支持开箱即用的 snappy - 有些人已经制作了模块来添加它,但期望大多数人会这样做是不现实的

I get it.. you mean's maybe snappy data compression format data is not support for uncompressed in nginx.. so alloy need other compress method?

TheRealNoob commented 4 weeks ago

so alloy need other compress method?

Yes correct

csh0101 commented 2 weeks ago

so alloy need other compress method?那么合金需要其他压缩方法吗?

Yes correct

if i have time i will see this .. these days i have some busy .. i m very interested to contributor code into alloy..