(EAI-201): Step-back prompting for MongoDB AI Chatbot

mongodb / chatbot

MongoDB Chatbot Framework. Powered by MongoDB and Atlas Vector Search.

https://mongodb.github.io/chatbot/

Apache License 2.0

106 stars 48 forks source link

Closed mongodben closed 5 months ago

mongodben commented 5 months ago

Generate search query with step-back prompting
Separate LLM calls to generate search query and extract metadata for better results
Bundle all context for LLM in the user message

[ ] Will need to update the production Azure OpenAI ChatGPT API version to use the 0610 model w/ function calling. will need to get our deployment updated to have more tokens/minute using that version as well.

mongodben commented 5 months ago

Amazing...

hopefully 🙏