Liuhong99 / Sophia

The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
MIT License
937 stars 54 forks source link

Please package Sophia as a PyPi Package #29

Open guilt opened 1 year ago

guilt commented 1 year ago

Hi,

I can help, but essentially this is adding requirements.txt, manifest.in and setup.py and using twine to upload to PyPi. Since it has MIT License, it should be easily usable.

Idea is that someone can start using this library, and I wanted to see how users of a library such as transformers can start easily using this. See the draft PR here

Let me see if I can send a PR for it. I won't upload it to PyPi, i'd request @Liuhong99 and other authors to own the package.