search

Liuhong99 / Sophia

The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
MIT License
937 stars 54 forks source link

Sophia-H Implementation in third party #38

Closed robotzheng closed 1 year ago

robotzheng commented 1 year ago

https://github.com/kozistr/pytorch_optimizer/issues/194 Can you repair its bug?