search

elastic / stream

Test utility for streaming data via udp/tcp/tls/webhook/GCP Pub-Sub/Kafka.
https://container-library.elastic.co/r/observability/stream
Apache License 2.0
8 stars 13 forks source link

Add support for gzip #36

Open vinit-chauhan opened 2 years ago

vinit-chauhan commented 2 years ago

This issue here is to request support for sending the given log file in gzip format.

andrewkroh commented 2 years ago

Is this a request for any particular output? Like for httpserver supporting Accept-Encoding: gzip and then delivering the response with Content-Type: gzip?

Is there a related issue or Fleet integration that will use this?

vinit-chauhan commented 2 years ago

We faced the issue while running the Zscaler cloud NSS test system tests. Cloud NSS sent the gzipped events and we needed to mock them. Hence, we needed the support in the stream to convert logfile to gzip and then send it.

Here's the link to the Zscaler ZIA package where we needed the gzip functionality. https://github.com/elastic/integrations/blob/main/packages/zscaler_zia/

andrewkroh commented 2 years ago

Thanks. So then for the webhook output we want to offer gzip encoding in some way. Perhaps we could make it encode the content as gzip when a Content-Encoding: gzip header is configured.