SeanLee97 / AnglE

Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
https://arxiv.org/abs/2309.12871
MIT License
397 stars 30 forks source link

remove torch_dtype for AutoModel #76

Closed SeanLee97 closed 1 month ago

SeanLee97 commented 1 month ago

When loading some BERT-based models with AutoModel, NaN values are produced if torch_dtype is specified to 'auto'. Remove torch_dtype here to fix this bug.