antimatter15 / alpaca.cpp

Locally run an Instruction-Tuned Chat-Style LLM
MIT License
10.25k stars 910 forks source link

controll the Random #196

Open openMolNike opened 1 year ago

openMolNike commented 1 year ago

Please, add the ability to control "randomness". Let the randomness value be shown in the answer so that it can be specified to reproduce exactly the same answer again (if app was crushed during writing long nice responce)

Example:


>write a song
random=667| bla-bla-ola-la

>write a song
random=777| ola-la-la-bla-ola

>write a sing|random=667
random=667| bla-bla-ola-la

ps. I see if I will restart app and make exact the same requests with same order I can get the same result. But It can be too long =(