Open blackblue9 opened 3 weeks ago
Hello @blackblue9 this is most likely a stop token issue to pass at gen time
But I am using the model deployed by vllm for testing. vllm should automatically use qwen's stop token, i.e., im_start, im_end, and endoftext, as stop tokens. Why can't the output of the model be stopped after I have trained it?
And judging from the loss curve, it seems that there is no need to train for 3 epochs. The loss of the model has converged after 0.5 epoch. How did you set it up?
Can you share the training code you used along with the tokenizer_config.json from the saved model?
I used the qwen2-1.5b-chat model finally trained using your code and found that the output could not stop. For example, when I asked it: "Who are you?", his reply was:
is this normal? How to solve it? ?
I found that setting "\nassistant" as the stop token did not completely solve the problem.