(EAI-354): LLM MongoDB discovery baseline - Githubissues

mongodb / chatbot

MongoDB Chatbot Framework. Powered by MongoDB and Atlas Vector Search.

https://mongodb.github.io/chatbot/

Apache License 2.0

106 stars 48 forks source link

(EAI-354): LLM MongoDB discovery baseline #428

Open mongodben opened 4 weeks ago

mongodben commented 4 weeks ago

Jira: https://jira.mongodb.org/browse/EAI-354

Changes

Baseline evaluation of if LLMs mention MongoDB on relevant queries
Add Regex-based evaluator to eval framework

Notes

-