search

Ai00-X / ai00_server

A localized open-source AI server that is better than ChatGPT.
https://ai00-x.github.io/ai00_server/
MIT License
434 stars 54 forks source link

Enabled default value for temperature and top_p #106

Closed cahya-wirawan closed 2 months ago

cahya-wirawan commented 2 months ago

Hi,

The current version requires the temperature and top_p to be included in the api request, otherwise the api request will fail. This PR just enabled the default value of temperature and top_p which actually have been set (to 0.5 and 1.0) but not configured/enabled.

cryscan commented 2 months ago

If default values are set for both temp and top_p, serde will not deserialize a mirostat variant because all fields of the nucleus variant have default values and the deserializer chooses it in priority. I am looking into a fix for this.