search

QwenLM / qwen.cpp

C++ implementation of Qwen-LM
Other
537 stars 48 forks source link

Why does `TextStreamer` hold on punctuation? #71

Open Wovchena opened 9 months ago

Wovchena commented 9 months ago

https://github.com/QwenLM/qwen.cpp/blob/86547f160abf6eb4979a6f246f5177565e662ae4/qwen.cpp#L115 TextStreamer waits for the next token before printing punctuation. What's the harm to print it as the last char?