LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with a KoboldAI UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.41k stars 318 forks source link

Generation API lacks the dynatemp_exponent parameter #767

Closed OcelotTheOcelot closed 3 months ago

OcelotTheOcelot commented 3 months ago

Looking at the /api/v1/generate request's GenerationInput schema, I only see "dynatemp_range" and "smoothing_factor" fields, but nothing seems to represent the DynaTemp-Exponent parameter from the UI. Is it there but under a different name, or is it really missing? image

LostRuins commented 3 months ago

That's an oversight. I'll add it. Thanks.