search

livekit / agents

Build real-time multimodal AI applications 🤖🎙️📹
https://docs.livekit.io/agents
Apache License 2.0
1.08k stars 215 forks source link

Adding Support for Structured Outputs for Openai models! #689

Open aryan1107 opened 2 weeks ago

aryan1107 commented 2 weeks ago

Wondering if new support for Structured Outputs can be added for openai models?

theomonnom commented 2 weeks ago

We’re definitely planning to support this feature in the coming months. Just curious, what’s your use case that requires this support?

ChrisFeldmeier commented 1 week ago

+1 (also need that... I'm now feeling like an unpaid Livekit developer xd I've been working with the live kit interface for half a year now.)

zachllee commented 5 hours ago

We’re definitely planning to support this feature in the coming months. Just curious, what’s your use case that requires this support?

This is relevant for guaranteed schemas for function calling as well as COT or moderation use cases. As an example, we have several scenarios we need to flag for every response, so rather than calling a function each time we have flags using structured outputs that we check before the model response.