make semantic clustering and time compressor using semantic clustering

Marker-Inc-Korea / RAGchain

Extension of Langchain for RAG. Easy benchmarking, multiple retrievals, reranker, time-aware RAG, and so on...

Apache License 2.0

275 stars 28 forks source link

make semantic clustering and time compressor using semantic clustering #399

Closed vkehfdl1 closed 8 months ago

vkehfdl1 commented 8 months ago

close #390

I made semantic clustering, that embeds each passage and semantically cluster that. Plus, I made ClusterTimeCompressor, which cluster each passages and remain only latest passage in each semantic cluster.

This is one of solution of time-aware RAG.