search

EleutherAI / math-lm

MIT License
1.03k stars 78 forks source link

Optimizer states? #102

Open jenkspt opened 9 months ago

jenkspt commented 9 months ago

Hi I'm interested in getting access to the optimizer states for the final llemma checkpoints. Are these available? - and if not, can they be made public?

Thanks for your amazing work!

jenkspt commented 9 months ago

Also interested in older checkpoints of 7b model -- specifically interested in estimating the performance of the 34b model with more tokens.