search

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
5.26k stars 360 forks source link

Feature request: blank preset - all samplers disabled. #1127

Open morbidCode opened 1 month ago

morbidCode commented 1 month ago

Hi,

I noticed that in some models huggingface page, They have recommended samplers like temperature, min_p, etc and no other values for other samplers. I think it means all other samplers are disabled. Same goes for new samplers like XTC, where you only tinker with DRY and min_p (and possibly temperature?) and ignore the rest. Problem is the default values for a sampler can be different (I.E. top_p=1, top_k =0), and so someone might accidentally leave some samplers on while trying to adjust the samplers into the recommended settings by the model.

My suggestion: let’s add a preset (blank preset?) where all samplers start off disabled, and then users can enable the ones they actually want.

What do you think?

LostRuins commented 1 month ago

Sure, I can do that.

LostRuins commented 1 month ago

Added in latest version