Open icemoon-creative opened 2 months ago
Hello, I'm new to this and would like to ask if it supports adding multiple documents and then performing RAG (Retrieval-Augmented Generation)? Thank you so much!
@icemoon-creative multidoc does not work, like @medxiaorudan mentioned , you can hack it to build a giant document. But this approach is not very scalable. I've also seen document chunks that include details from multiple documents.
For multidoc, I would recommend checking out alternative implementations.
There are others that have replicated RAPTOR. For example:
Llamma index has a RAPTOR module/pack. https://github.com/run-llama/llama_index/tree/2f80ca3834906e82c69484f4193530f279058033/llama-index-packs/llama-index-packs-raptor/llama_index/packs/raptor
Langchain has a RAPTOR notebook. This notebooks uses a clustering technique that even be more performant/reliable than the one in this github project. https://github.com/langchain-ai/langchain/blob/master/cookbook/RAPTOR.ipynb
小白求问,这个支持add多个document,然后进行rag吗?非常感谢非常感谢