anngvu / accent

AI-Assisted Curation/Content ENhancement Tool for Synapse (pre-alpha)
MIT License
0 stars 1 forks source link

Extraction agent should better handle when strict structured outputs can be used #68

Open anngvu opened 3 weeks ago

anngvu commented 3 weeks ago

Extraction agent does not use strict structured output mode by default because most likely the user-provided schema won't be supported since there are many requirements such as:

Using structured output mode can necessitate quite a bit of schema wrangling first to have a supported schema, and so extraction agent doesn't make the assumption that we have a supported schema. But perhaps we should analyze the schema or use a test response to turn on/off strict structured outputs in the case where we can and should use strict structured outputs.