SeanLee97 / AnglE

Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
https://arxiv.org/abs/2309.12871
MIT License
398 stars 30 forks source link

How to finetune NLI model #29

Closed mdabedr closed 3 months ago

mdabedr commented 5 months ago

Hi, could you please give me an overview of how to fine-tune an NLI model? Namely:

SeanLee97 commented 5 months ago

Hi, it is recommended to read this doc: https://github.com/SeanLee97/AnglE/tree/main/examples/NLI

I will add more docs later.

mdabedr commented 5 months ago

So I have to train the angle model before I can fine-tune it for the dataset I have in mind?

SeanLee97 commented 5 months ago

If you have prepared the NLI datasets, you can fine-tune the model using angle-trainer