InternLM / HuixiangDou

HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance
https://openxlab.org.cn/apps/detail/tpoisonooo/huixiangdou-web
BSD 3-Clause "New" or "Revised" License
1.45k stars 125 forks source link

the faiss index method change: replace the IndexFlatIP with IndexIVFFlat #250

Open Adeshen opened 5 months ago

Adeshen commented 5 months ago

IndexFlatIP is brute searching method. IndexIVFFlat use aggregation to lower the dimension. So it will be faster, but lower the precision.

tpoisonooo commented 5 months ago

IndexIVFFlat needs clustering and L2 norm as distance method, see https://zhuanlan.zhihu.com/p/40236865

IndexIVFFlat may cause precision drop.

tpoisonooo commented 5 months ago

See also https://github.com/facebookresearch/faiss/wiki/Faiss-indexes