Fix rag analyzer - Githubissues

infiniflow / infinity

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text

https://infiniflow.org

Apache License 2.0

2.68k stars 275 forks source link

Fix rag analyzer #2231

Closed yingfeng closed 1 week ago

yingfeng commented 1 week ago

What problem does this PR solve?

Fix memory issue of rage tokenizer

Type of change

[x] Bug Fix (non-breaking change which fixes an issue)