Arch is an intelligent prompt gateway. Engineered with (fast) LLMs for the secure handling, robust observability, and seamless integration of prompts with APIs - all outside business logic. Built by the core contributors of Envoy proxy, on Envoy.
Right now when a developer service fails due to some error (4xx or 5xx) envoy keeps on retrying and eventually sends back a 503. Which isn't a great experience. In case of error filter should short-circuit and sends error back.
Right now when a developer service fails due to some error (4xx or 5xx) envoy keeps on retrying and eventually sends back a 503. Which isn't a great experience. In case of error filter should short-circuit and sends error back.