search

CVI-SZU / Linly

Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集
3.03k stars 235 forks source link

33b Huggingface 格式怎么转成TencentPretrain 格式 #89

Closed lyy-zz closed 1 year ago

lyy-zz commented 1 year ago

模型下载章节写着提供脚本，支持格式互转，但实际脚本只有tp转hf，请问hf转tp可以参考哪里？ image

ydli-ai commented 1 year ago

在tencentpretrain的scripts目录中

发件人: lyy-zz @.> 发送时间: Friday, May 26, 2023 5:34:51 PM 收件人: CVI-SZU/Linly @.> 抄送: Subscribed @.***> 主题: [CVI-SZU/Linly] 33b Huggingface 格式怎么转成TencentPretrain 格式 (Issue #89)

模型下载章节写着提供脚本，支持格式互转，但实际脚本只有tp转hf，请问hf转tp可以参考哪里？ [image]https://user-images.githubusercontent.com/31911972/241180733-76e9a81f-7c57-47f5-9249-2703a0f32961.png

― Reply to this email directly, view it on GitHubhttps://github.com/CVI-SZU/Linly/issues/89, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AE3SPVY6VWYUXV2KW376WY3XIB2LXANCNFSM6AAAAAAYP7LAZ4. You are receiving this because you are subscribed to this thread.Message ID: @.***>

lyy-zz commented 1 year ago

明白了，感谢回复