search

IncredibleDevHQ / agent-panel

AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.
Other
46 stars 5 forks source link

What are the top level `model` and other params for? #6

Closed failable closed 2 months ago

failable commented 2 months ago 
model: openai:gpt-3.5-turbo # Specify the language model to use
temperature: null # Set default temperature parameter
top_p: null # Set default top-p parameter
save: true # Indicates whether to persist the message
save_session: null # Controls the persistence of the session, if null, asking the user

As the title says...Isn't the model passed by POST request?

hackintoshrao commented 2 months ago

You're right; setting the model in the config isn't necessary; it was a mistake!

Changed the example config https://github.com/IncredibleDevHQ/agent-panel/blob/main/config.example.yaml .

I'm working on a change to include temperature and top_p as part of the API params.

Ignore the save and save session, they'll relevant once the persistence/memory layer is added.