MadcowD / ell

A language model programming library.
http://docs.ell.so/
MIT License
5.16k stars 299 forks source link

Structured Outputs for Gpt4o-MINI #332

Open HusainMkd opened 1 week ago

HusainMkd commented 1 week ago

Hi! I see here that "Structured outputs using Pydantic models are currently only available for the gpt-4o-2024-08-06 model": https://docs.ell.so/core_concepts/structured_outputs.html image

Will Structured outputs be available for the gpt4o-mini model?

OpenAI say here that it supports it: https://platform.openai.com/docs/guides/structured-outputs/introduction image

reecelikesramen commented 1 week ago

@HusainMkd I think the documentation is just be outdated. Internally its just an API param passed through, so you should be able to use gpt-4o-mini with structured responses. I believe I'm using gpt-4o-mini with structured responses in my project somewhere.

alex-dixon commented 4 days ago

Not sure how we should update the docs — we support structured outputs for all ell-supported models and providers that support them.

We could maintain our own list or link to one that’s maintained or just replace with general verbiage.