How can we transform the hugging format weight into the meta format?

Alpha-VLLM / LLaMA2-Accessory

An Open-source Toolkit for LLM Development

https://llama2-accessory.readthedocs.io/

Other

2.68k stars 170 forks source link

How can we transform the hugging format weight into the meta format? #87

Closed ZhenYangIACAS closed 10 months ago

ZhenYangIACAS commented 10 months ago

Hi, Thanks for your great work! My issue is: I have downloaded the hugging format weight of llama2, which like this: pytorch_model-00001-of-00002.bin how can it be loaded by your code or do you have scripts to convert it to the supported format? Thanks a lot.

ChrisLiu6 commented 10 months ago

Well, theoretically, HF checkpoints and Meta checkpoints are interchangeable. However, while a conversion script from Meta to HF is available in HF's repository, I'm not sure if a public implementation exists for the reverse conversion. Please verify this yourself.