katanemo / arch

Arch is an intelligent prompt gateway. Engineered with (fast) LLMs for the secure handling, robust observability, and seamless integration of prompts with APIs - all outside business logic. Built by the core contributors of Envoy proxy, on Envoy.
https://archgw.com
Apache License 2.0
367 stars 19 forks source link

Pass only contextual user messages for parameter gathering... #205

Open salmanap opened 3 days ago

salmanap commented 3 days ago

for hallucination check. Today we send all the "user" messages to check for any possible hallucinations from Arch-Function when validating the parameters that it has detected in the conversation. This isn't correct. We should only send user history up to the point where we detect the latest instance of parameter gathering in the conversation via Arch-Function