search

crossid / accessbot

Streamline resource access grants with AI-Powered chatbot
https://www.crossid.io
Other
2 stars 0 forks source link

feat: implements on topic guardrail #144

Closed ErezSha closed 4 months ago

ErezSha commented 4 months ago

implements an on_topic guardrail for the graph

asaf commented 4 months ago

@ErezSha Is this another LLM call and going to increase latency? we'r already at > 20s

ErezSha commented 4 months ago

That's the only way to do it reliably. It calls gpt-4o, so it's faster. Also, it's happening asynchronously, in parallel, with the other call entry point makes, so it's doesn't increase latency.