We need some sort of automatic chat history prune when topic change occurs.
Currently chat history can get large, especially when using multiple retriever tools in a row. More in this case: retrieved documents pollute further questions and the LLM sometimes draw conclusions from old retrieved documents from previous query.
Notes:
probably a tool the LLM can invoke on its own
probably to automatically reset history after invoking retriever
probably to summarize previous history after invoking retriever
We need some sort of automatic chat history prune when topic change occurs. Currently chat history can get large, especially when using multiple retriever tools in a row. More in this case: retrieved documents pollute further questions and the LLM sometimes draw conclusions from old retrieved documents from previous query.
Notes: