Add `top_p`, `presence_penalty`, and `frequency_penalty` options to inference requests - Githubissues

tensorzero / tensorzero

make LLMs improve through experience

https://tensorzero.com

Apache License 2.0

396 stars 17 forks source link

Add `top_p`, `presence_penalty`, and `frequency_penalty` options to inference requests #409

Closed virajmehta closed 1 week ago

GabrielBianconi commented 1 week ago

Follow up #410