[FEATURE Request] - DRuGS sampler: Deep Random Micro-Glitch Sampling

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

https://github.com/lostruins/koboldcpp

GNU Affero General Public License v3.0

4.82k stars 343 forks source link

[FEATURE Request] - DRuGS sampler: Deep Random Micro-Glitch Sampling #1080

Open SabinStargem opened 3 weeks ago

SabinStargem commented 3 weeks ago

It is a sampler that injects noise into layers of the AI, changing the output. Apparently the AI can overcome this noise, but the results will be mildly distorted from doing so. Not being a smartie, I recommend using the link for actual details. Much like XTC, it holds promise for increasing the creativity of a model.

DRuGS Github

LostRuins commented 3 weeks ago

That modifies the model weights itself, so I think it might not be ideal for KCPP. I am looking into implementing XTC first.