Closed imfinethanks closed 5 months ago
Your generated content is not a complete sentence. I suspect there might be an issue with your generation config. You may need to check generation_config.json
(in checkpoint dir), especially if max_new_tokens
in the config is mistakenly set to 1.
My generation during testing is normal. (See attached image, I find this response quite interesting, no offense intended).
max_new_tokens=512没发现问题,不过环境从windows+pytorch2.2切换成ubuntu+pytorch2.0后正常了。 Awesome
A. B.you C.need D.1 E.2 F.ah
请问这个结果正常吗?看起来并不是很搞笑