search

SeanLee97 / AnglE

Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
https://arxiv.org/abs/2309.12871
MIT License
397 stars 30 forks source link

Unversioned PEFT Dependency Prevents Model from Loading #66

Closed jambonne closed 3 months ago

jambonne commented 3 months ago

A recent update to PEFT deprecates and removes references to prepare_model_for_8bit_training. Since AnglE's dependencies are unversioned and it references the deprecated method here, the model breaks when its constructor is invoked.

ganeshkrishnan1 commented 3 months ago

You can install older version of PEFT to fix this temporarily

pip install peft==0.7.1

SeanLee97 commented 3 months ago

Thank you! I will update the code to support the latest peft.

SeanLee97 commented 3 months ago

@ganeshkrishnan1 fixed this issue in angle_emb==0.3.10