Cotran/hallucination - Githubissues

katanemo / arch

Arch is an intelligent prompt gateway. Engineered with (fast) LLMs for the secure handling, robust observability, and seamless integration of prompts with APIs - all outside business logic. Built by the core contributors of Envoy proxy, on Envoy.

https://archgw.com

Apache License 2.0

367 stars 19 forks source link

Cotran/hallucination #208

Closed cotran2 closed 17 hours ago

cotran2 commented 1 day ago

Fixing https://github.com/katanemo/arch/issues/205. Logic

We reverse the messages list
If the last assistant/system message is from Arch,
We loop and concatenate all the user messages until it is not arch -> (gpt model)