SeanLee97 / AnglE

Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
https://arxiv.org/abs/2309.12871
MIT License
397 stars 30 forks source link

added support for streaming dataset #67

Closed ganeshkrishnan1 closed 3 months ago

ganeshkrishnan1 commented 3 months ago

for larger datasets its recommended to use streaming datasets. This PR enabled support for streaming by adding "--streaming" to command line for train script

SeanLee97 commented 3 months ago

Thanks for the contribution!

SeanLee97 commented 3 months ago

bumpversion to 0.3.10. Thanks again!