search

Ai00-X / ai00_server

The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.
https://ai00-x.github.io/ai00_server/
MIT License
485 stars 58 forks source link

Enabled default value for temperature and top_p #106

Closed cahya-wirawan closed 7 months ago

cahya-wirawan commented 7 months ago

Hi,

The current version requires the temperature and top_p to be included in the api request, otherwise the api request will fail. This PR just enabled the default value of temperature and top_p which actually have been set (to 0.5 and 1.0) but not configured/enabled.

cryscan commented 7 months ago

If default values are set for both temp and top_p, serde will not deserialize a mirostat variant because all fields of the nucleus variant have default values and the deserializer chooses it in priority. I am looking into a fix for this.