The speed of processing trunks

HKUDS / LightRAG

"LightRAG: Simple and Fast Retrieval-Augmented Generation"

https://arxiv.org/abs/2410.05779

MIT License

9.22k stars 1.13k forks source link

The speed of processing trunks #274

Open icvplayer opened 1 week ago

icvplayer commented 1 week ago

Hi, author: I wonder if the speed of building graphs slows down with more chunks? Because according to the data set you provided, processing 300 chunks has been running for 6 hours.

LarFii commented 2 days ago

Based on our testing results, using a local model for indexing can be extremely slow. The process is significantly faster when using an API.