search

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
5.35k stars 364 forks source link

Fixing Mistral Templates #1131

Closed pandora-s-git closed 2 months ago

pandora-s-git commented 2 months ago

Following https://github.com/LostRuins/lite.koboldai.net/pull/87 , now fixing similarly the templates!

LostRuins commented 2 months ago

For backward compatibility, avoid renaming the existing Mistral.json, instead just add new templates as needed under new files. Otherwise people who have scripts referencing the old names will break.