search

imoneoi / openchat

OpenChat: Advancing Open-source Language Models with Imperfect Data
https://openchat.team
Apache License 2.0
5.23k stars 399 forks source link

repeat the output content until the maximum output length is set #209

Closed zestaken closed 1 month ago

zestaken commented 6 months ago

Using Openchat-3.5-0106 locally will repeat the output content until the maximum output length is set. In other words, the output of the model does not stop automatically. And the model is loaded with the following warning: Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. May I ask how to solve this kind of problem?

imoneoi commented 6 months ago

Hi @zestaken, can you provide more information about your local model setup?

Cancerxy commented 5 months ago

I also encountered this problem

1193700079 commented 1 month ago

I also encountered this problem