This is not answered correctly because we are using ConversationalRetrievalChain which
rephrases the question by fitting the chat history as context to get a standalone question.
This standalone question is different from the initial question
and is passed to the model. This causes un intended answers.
You can not ask the model what was my chat history
because the model simply does not know the chat history.
The chat history was used for something else (rephrasing)
Use RetrievalQA instead of ConversationalRetrievalChain
Anteemony
commented
6 months ago
This is not answered correctly because we are using ConversationalRetrievalChain which rephrases the question by fitting the chat history as context to get a standalone question.
This standalone question is different from the initial question and is passed to the model. This causes un intended answers.
You can not ask the model what was my chat history because the model simply does not know the chat history. The chat history was used for something else (rephrasing)
Use RetrievalQA instead of ConversationalRetrievalChain