search

bigcode-project / Megatron-LM

Ongoing research training transformer models at scale
Other
371 stars 48 forks source link

how to convert huggingface? #63

Closed cdj0311 closed 1 year ago

cdj0311 commented 1 year ago

hi, The megatron format how to convert huggingface for inference?

seopbo commented 1 year ago

Did you find it? @cdj0311

cdj0311 commented 1 year ago

Did you find it? @cdj0311

https://github.com/bigcode-project/transformers/blob/main/src/transformers/models/megatron_gpt_bigcode/convert_megatron_gpt_bigcode_checkpoint.py