xlang-ai / instructor-embedding

[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
Apache License 2.0
1.85k stars 134 forks source link

When does the training stop? #41

Closed qmin2 closed 1 year ago

qmin2 commented 1 year ago

Hello,

Was there a specific reason for ending the training at 40K steps? What criteria or basis(i.e. metric) did you use to determine the stopping point?

hongjin-su commented 1 year ago

Hi, Thanks a lot for your interest in the INSTRUCTOR model!

To determine the stopping point of the training, you may observe the loss curve. When the loss decreases slowly and the curve becomes flat, you may stop the training process.

Feel free to add any further questions or comments!

qmin2 commented 1 year ago

Thanks a lot !