How many epochs did you use to train openchat 3.5?

imoneoi / openchat

OpenChat: Advancing Open-source Language Models with Imperfect Data

https://openchat.team

Apache License 2.0

5.26k stars 398 forks source link

Open houghtonweihu opened 8 months ago

imoneoi commented 8 months ago

We picked the 3rd epoch out of 5 epochs. You can find the full hyperparameters here.