breadboard-ai / breadboard

A library for prototyping generative AI applications.
Apache License 2.0
163 stars 22 forks source link

[agent-kit] Make Specialist and Looper Models switchable #2628

Open dglazkov opened 1 month ago

dglazkov commented 1 month ago

TODO:

dglazkov commented 1 month ago

Currently, the model family that is used by Specialist and Looper is hard-coded to Gemini and the actual model is asked once per run (unless configured via inputs setting).

This is good, but ideally, we should offer a way to specify a model per component instance. For example, I should be able to say "run this Specialist with Gemini Flash, and run that Specialist with Gemini Pro" or even "run this Specialist with Claude 3.5 Sonnet".

Here's a sketch:

Here are some mocks:

Default:

image

Drop-down open:

image