Open tao2021 opened 2 months ago
We intend to create an international community, so we encourage using English for communication.
We intend to create an international community, so we encourage using English for communication.
1. Plain Text 2. Using embedding and BM25 similarity.
Does this sorting method have anything to do with the documents passed in? Or do all the documents get parsed and stored in a large pool, and then extracted based on their similarity to the question? For example, if document A and document B are passed in, will the difference between the documents affect the calculation of similarity?
You'd better to check the RAG process which is not impacted by the order of document ingestion. As for the second question, they won't affect the similarity calculation itself, but will affect the rank of the retrieval.
Describe your problem
上传文档后,解析的结果会存成什么格式,在输入问题后,对文档切片结果呈现的优先级是什么?是按照文档进行排序的吗?