katanemo / arch

Arch is an intelligent prompt gateway. Engineered with (fast) LLMs for the secure handling, robust observability, and seamless integration of prompts with APIs - all outside business logic. Built by the core contributors of Envoy proxy, on Envoy.
https://archgw.com
Apache License 2.0
367 stars 19 forks source link

split wasm filter #186

Closed adilhafeez closed 6 days ago

adilhafeez commented 1 week ago

This is part 1 of two part code change. In next PR I will remove unnecessary code from both llm and prompt gateway code.

fixes https://github.com/katanemo/arch/issues/188