Open stevenwaterman opened 4 years ago
So from what I have read and in my experience using mrcheeze's implementation, temperature determines how adventurous the model is allowed to get. Where 1 is average and 2 is complete chaos. I know that Open AI said the sweet spot was somewhere between 0.9 and 1.1
I can say this has been useful in the past when you need to break the model out of a loop it has gotten too comfortable with and coax it in a different direction. Choosing a different genre can do this but it is a gradual change where the temperature seemed to be a very drastic and immediate measure.
Amazing, i will add temperature to the generation options menu + give it a tooltip that explains what it means
Temperature add 2.4.0
The Musenet API takes 2 extra parameters that aren't controllable through their frontend - temperature and truncation. The app is set up to change those, but I don't know what they do. Try to figure out what they do and if they're useful re-add them to the generation options