Expose a couple extra params - Githubissues

nchapman / pulsar

Mozilla Public License 2.0

1 stars 1 forks source link

Expose a couple extra params #176

Open ospfranco opened 6 days ago

ospfranco commented 6 days ago

According to current progress:

https://linear.app/pulsarapp/issue/PUL-159/multi-model-or-model-settings

Added the following params to the predict API:

temperature (called on predict)
max tokens a.k.a max_len (that was already there, called on predict)
top P (called on predict)
stop tokens (called on context initialization)

The rest as described in the ticket need to be done by Yuri first