Arch is an intelligent prompt gateway. Engineered with (fast) LLMs for the secure handling, robust observability, and seamless integration of prompts with APIs - all outside business logic. Built by the core contributors of Envoy proxy, on Envoy.
Right now we send tools call and tools call response to client in metadata. Clients treat this as opaque blob and send it back to us so we can reconstruct message history before making call to arch-fc. This must be simplified as right now client would have to maintain state on their end and send it back to us.
On possible solution is to convert tool calls and tool call response into message so client can append them onto their message history.
Right now we send tools call and tools call response to client in metadata. Clients treat this as opaque blob and send it back to us so we can reconstruct message history before making call to arch-fc. This must be simplified as right now client would have to maintain state on their end and send it back to us.
On possible solution is to convert tool calls and tool call response into message so client can append them onto their message history.