search

nomic-ai / gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
https://nomic.ai/gpt4all
MIT License
69.01k stars 7.57k forks source link

[Feature] SEED please !!! #2705

Open kalle07 opened 1 month ago

kalle07 commented 1 month ago

Feature Request

i dont must complain that or ? (in oobdooga text-gen-webUI is implemented it since 2 years)

so i can better understand what is different if I change the question or the differenzes between quantisized models or ... or ...

cosmic-snow commented 1 month ago

It's not quite what you're asking, but if you want reproducible responses, you can set temperature to 0.

kalle07 commented 1 month ago

i see ...

but you know what i mean?

grafik

cosmic-snow commented 1 month ago

I know what you mean, yes. The seed is used by the PRNG for temperature other than 0.

cebtenzzre commented 1 month ago

You actually can't set the temperature to zero, or it will crash, as we don't implement true greedy sampling currently. You can set it to e.g. .0001 though, which makes the output almost reproducible.

cosmic-snow commented 1 month ago

Oh did that change? That's good to know then, that was possible for a long time.

kalle07 commented 1 month ago

yes, but this is only one "same" answer ... you can copy/paste from oobadooga (it was never that simple) ^^