search

baichuan-inc / Baichuan2

A series of large language models developed by Baichuan Intelligent Technology
https://huggingface.co/baichuan-inc
Apache License 2.0
4.03k stars 286 forks source link

baichuan2-13B-chat 微调loss 一直为0 #401

Open sunjinguo opened 2 months ago

sunjinguo commented 2 months ago

尝试不同的测试数据, 训练过程中loss 一直为0

yajunDai commented 2 months ago

同样的问题，请问你解决了么

sunjinguo commented 1 month ago

这个问题没解决，换了LLama-Factory 框架微调了，然后测试的baichuan2 跟qianwen1.5

------------------ 原始邮件 ------------------ 发件人: "baichuan-inc/Baichuan2" @.>; 发送时间: 2024年4月30日(星期二) 上午10:23 @.>; @.**@.>; 主题: Re: [baichuan-inc/Baichuan2] baichuan2-13B-chat 微调loss 一直为0 (Issue #401)

同样的问题，请问你解决了么

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>