Update rag analyzer - Githubissues

infiniflow / infinity

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text

https://infiniflow.org

Apache License 2.0

2.68k stars 275 forks source link

Update rag analyzer #2232

Closed yangzq50 closed 1 week ago

yangzq50 commented 1 week ago

What problem does this PR solve?

Add RAGAnalyzer::GetBestTokens function It is now only for test in Debug mode It differs with dfs in some cases
Fix some existing bugs

Issue link:#2159

Type of change

[x] Bug Fix (non-breaking change which fixes an issue)
[x] New Feature (non-breaking change which adds functionality)
[x] Refactoring
[x] Test cases