katanemo / arch

Arch is an intelligent prompt gateway. Engineered with (fast) LLMs for the secure handling, robust observability, and seamless integration of prompts with APIs - all outside business logic. Built by the core contributors of Envoy proxy, on Envoy.
https://archgw.com
Apache License 2.0
367 stars 19 forks source link

Add support for compression/decompression #172

Open adilhafeez opened 1 week ago

adilhafeez commented 1 week ago

Right now filter doesn't understand compressed data. Fix here is to decompress data before it makes its way to filter and compress it on the way out depending on accept-encoding set by client. This is fairly simple task as envoy supports that out of the box.