search

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.34k stars 310 forks source link

IDK chat Bug? kobold give random code... #951

Closed alastor367 closed 4 days ago

alastor367 commented 4 days ago

I deleted the old sessions but on the old session literally displayed in the messages after writing hello some code for min 30 lines

During the generation: image when the generation has finished: image

I have a dual boot system with Windows and Linux on both systems I used kobold I used two separate versions of the kobold to test both of them had the same effect versions: 1.58 and 1.64 everything was going well, only from today it's been like this

image

alastor367 commented 4 days ago

The problems in a way have been fixed after upgrading to the latest version and changing to OpenBlast but he can still sometimes answer me with my own question

alastor367 commented 4 days ago

but it would still be nice if someone would be able to tell me that it could be caused by

LostRuins commented 4 days ago

Hmm, what model were you using? Make sure you're using the correct instruct format, and make sure the story memory doesn't contain unwanted data.

You can try load the KoboldGPT Instruct scenario and repeat the query, it should be better.

image