How to convert model weights(e.g., bigscience/bloomz-560m-optimizer-states) to Hugging Face model.bin file? - Githubissues

bigscience-workshop / Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Other

1.3k stars 211 forks source link

How to convert model weights(e.g., bigscience/bloomz-560m-optimizer-states) to Hugging Face model.bin file? #374

Closed qazwsx042 closed 1 year ago

qazwsx042 commented 1 year ago

Hi, how to convert model weights(e.g., bigscience/bloomz-560m-optimizer-states) to Hugging Face model.bin file?

qazwsx042 commented 1 year ago

see here: https://github.com/bigscience-workshop/xmtf/issues/16