search

enricoros / big-AGI

Generative AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.
https://big-agi.com
MIT License
5.67k stars 1.31k forks source link

[Roadmap] Parameters selection for Beam #519

Open kharbandaraghu opened 7 months ago

kharbandaraghu commented 7 months ago

Why Users can select temperature, top-p for the models while beaming responses. This would allow them to compare responses from the same model but with different parameters and test which parameters work best for their prompts

Description In the chat where users can select "Beam" as an option that lets users combine multiple responses from different models and merge them, there is no feature to select the parameters of the model - so users can only choose different models. not same models with different parameters.

Requirements [ ] add the settings icon next to the model name in dropdown of beam page next to each model just like in the chat window models allowing the users to adjust parameters of the CleanShot 2024-05-01 at 00 55 51 models CleanShot 2024-05-01 at 00 55 25 CleanShot 2024-05-01 at 00 51 58

[ ] connect the selected paramteres to the data when sending API requests enabling functionality

enricoros commented 7 months ago

Good input. Cross referencing: #483