[ui] Support for more output types

breadboard-ai / breadboard

A library for prototyping generative AI applications.

Apache License 2.0

176 stars 23 forks source link

[ui] Support for more output types #163

Open paullewis opened 10 months ago

paullewis commented 10 months ago

We currently have a single output node, which is text. However, it would be good to support images, text, audio, and physical device outputs, too.

dglazkov commented 10 months ago

yes! There's a case where I already wished for more structured output. In pinecone-query I would have loved to add links to posts (since they are stored in the metadata) to the answer. That tells me that we might want to invent structured outputs, similar to how we have structured (multimodal) inputs.

dglazkov commented 10 months ago

Running notes:

JSON rules my life. Displaying nice legible JSON as output feels important