LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.34k stars 310 forks source link

Show this while loading #949

Open lolo17787 opened 4 days ago

lolo17787 commented 4 days ago

Welcome to KoboldCpp - Version 1.68 For command line arguments, please refer to --help


Exception in thread Thread-7: Traceback (most recent call last): File "threading.py", line 932, in _bootstrap_inner File "threading.py", line 870, in run File "subprocess.py", line 1370, in _readerthread File "codecs.py", line 322, in decode UnicodeDecodeError: 'utf-8' codec can't decode byte 0xcc in position 344: invalid continuation byte

LostRuins commented 4 days ago

Does it still load correctly?

lolo17787 commented 4 days ago

Does it still load correctly?

The model can be loaded normally, but I think the model is more stupid than the quality recommended by others.

LostRuins commented 4 days ago

What model are you trying to use?