search

crossid / accessbot

Streamline resource access grants with AI-Powered chatbot
https://www.crossid.io
Other
2 stars 0 forks source link

feat: implements on topic guardrail #150

Closed ErezSha closed 4 months ago

ErezSha commented 4 months ago

implements an on_topic guardrail for the graph

closes #138

ErezSha commented 4 months ago

@asaf I closed the previous PR (#144 ) because I needed to fix the commits. I'll copy the comments here:

@ErezSha Is this another LLM call and going to increase latency? we'r already at > 20s

That's the only way to do it reliably. It calls gpt-4o, so it's faster. Also, it's happening asynchronously, in parallel, with the other call entry point makes, so it's doesn't increase latency.