search

cryscan / web-rwkv

Implementation of the RWKV language model in pure WebGPU/Rust.
Other
210 stars 15 forks source link

Allow incorrect UTF-8 output #11

Closed carrotflakes closed 7 months ago

carrotflakes commented 7 months ago

I have switched to using String::from_utf8_lossy() instead of String::from_utf8().

This is a temporary measure to prevent the program from crashing.

It is necessary because errors were occurring frequently when using Japanese characters.

cryscan commented 7 months ago

Thanks!