Open michaelgloeckner opened 9 months ago
https://medium.com/@ayhamboucher/llm-based-context-splitter-for-large-documents-445d3f02b01b
Above medium article but scope out if we can use cross-encoders to calculate the similarity score instead
https://medium.com/@ayhamboucher/llm-based-context-splitter-for-large-documents-445d3f02b01b