bug: Token appeared in response. And the model can't stop with the stop token.
I have read the issue about phi-3 before and it was really useful, but there are still other tokens that appear, such as <|begin|>,<|display|>, <|body|>, and <br>.
I can fix the model stop bug by changing eos_token, but the rest tokens do not appear to be normal.
I have read the issue about phi-3 before and it was really useful, but there are still other tokens that appear, such as
<|begin|>,<|display|>,<|body|>, and<br>. I can fix the model stop bug by changingeos_token, but the rest tokens do not appear to be normal.