Add Faiss, perhead and better compatibility. - Githubissues

thunlp / InfLLM

The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory"

MIT License

269 stars 21 forks source link

Add Faiss, perhead and better compatibility. #25

Closed guyan364 closed 5 months ago

guyan364 commented 5 months ago

增加 faiss (cpu only) (#15)
增加 perhead 选项，以供研究使用
默认不使用各类加速方法，提高兼容性

Added faiss (CPU only) (#15)
Added the perhead option for research use
Acceleration methods are not used by default to enhance compatibility