search

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.34k stars 310 forks source link

Creating your own instruct Tag Preset #899

Open berkut1 opened 3 weeks ago

berkut1 commented 3 weeks ago

Hello.

As I understand, the soft only offers a selection of pre-made presets and a highly inconvenient way to edit them (the text boxes are very small).

Why not add the ability to create and save your own presets?

For example, I very often use modified presets, such as adding "Sure," or creating my own. And at the moment, it’s literally a pain in the butt to modify them each time for different models.

Thanks.

LostRuins commented 3 weeks ago

There's no easy way to edit presets right now, but you can edit the instruct tags which get saved into the current settings. You can use the multiple save slots to keep different tags for each situation. Eventually I do wanna tidy up the instruct configs