search

RWKV / rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
MIT License
1.37k stars 90 forks source link

Flush output every token in generate_completions.py #73

Closed LoganDark closed 1 year ago

LoganDark commented 1 year ago

before:

https://github.com/saharNooby/rwkv.cpp/assets/4723091/90c404cb-b3a7-4f55-901b-118cd6c6faa8

after:

https://github.com/saharNooby/rwkv.cpp/assets/4723091/5dd3cacf-87a6-4551-99f1-8e878534f7dd