Open edoserbia opened 1 month ago
How to make overlapping chunking for docx, pdf or txt? The chunking methods seemed to split contents with no overlapping. This way, if the answer appears in the middle of two chunks, it can be very easy to fail to retrieve the complete answer.
Please try RAPTOR which is much better than overlapping chunking.
Describe your problem
How to make overlapping chunking for docx, pdf or txt? The chunking methods seemed to split contents with no overlapping. This way, if the answer appears in the middle of two chunks, it can be very easy to fail to retrieve the complete answer.