mongodb / chatbot

MongoDB Chatbot Framework. Powered by MongoDB and Atlas Vector Search.
https://mongodb.github.io/chatbot/
Apache License 2.0
106 stars 48 forks source link

Does not work with latest models #441

Closed hasaketa closed 6 days ago

hasaketa commented 1 week ago

It does not produce response with text-embedding-3-small and gpt-4o combination

mongodben commented 1 week ago

can you provide more information about the error that you're getting so we can help debug?

as a first step, you can try to lower the minScore in the FindContentFunc. the .9 that we have as a default in the quick start works well for ada-02 but is often too high for text-embedding-3-small.

const findContent = makeDefaultFindContent({
  embedder,
  store: embeddedContentStore,
  findNearestNeighborsOptions: {
    k: 5,
    path: "embedding",
    indexName: VECTOR_SEARCH_INDEX_NAME,
    // Start low to make sure all is working, and work your way up to a higher score if it's suiting. 
    minScore: 0.1,
  },
});
hasaketa commented 6 days ago

Followed your suggestion to lower the minScore to 0.1 and that worked. Thank you!