linyiLYi / bilibot

A local chatbot fine-tuned by bilibili user comments.
Apache License 2.0
2.93k stars 342 forks source link

微调的时候这个Train loss 怎么理解? #27

Open lzpsqzr opened 1 month ago

lzpsqzr commented 1 month ago

image 微调的时候这个Train loss 怎么理解?然后上面的val loss又是什么意思?

theblackcat102 commented 1 month ago

确保 train loss 持续下降即可,val loss 就是验证资料集的表现,如果后续一直都在上升那就调低 learning rate试试看