search

OpenMOSS / MOSS

An open-source tool-augmented conversational language model from Fudan University
https://txsun1997.github.io/blogs/moss.html
Apache License 2.0
11.89k stars 1.15k forks source link

finetuning loss #344

Open ZiboZ opened 1 year ago

ZiboZ commented 1 year ago

在finetune代码中，<|Human|>部分也加入了loss的计算，想请教下这样相比conditioning language modeling loss有什么特别的好处吗？

metacarbon commented 11 months ago

用户输入不应该计算loss，他们的代码有点问题