Tencent / TencentPretrain

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
https://github.com/Tencent/TencentPretrain/wiki
Other
1.03k stars 142 forks source link

LLaMA2-70B格式转换 #96

Open Double-bear opened 1 year ago

Double-bear commented 1 year ago

请问如果要进行LLaMA2-70B的huggingface转tencentpretrain格式的模型,应该如何i修改llama的那个转化脚本?