search

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.66k stars 334 forks source link

Seed 0 cannot be specified #711

Closed Azirine closed 5 months ago

Azirine commented 5 months ago

Only seed -1 should be random, seed 0 works as a fixed seed in llama.cpp but not in kobold.

LostRuins commented 5 months ago

Just use a different seed. Seed 0 is treated like a random seed in kobold, and to change it would break backwards compatibility.