Liuhong99 / Sophia

The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
MIT License
931 stars 52 forks source link

Which is the original repo? #36

Closed SagiPolaczek closed 1 year ago

SagiPolaczek commented 1 year ago

This one or: https://github.com/kyegomez/Sophia ?

Liuhong99 commented 1 year ago

https://github.com/Liuhong99/Sophia is the original repo. Thanks!

Liuhong99 commented 1 year ago

https://github.com/kyegomez/Sophia/ has nothing to do with the authors