Validation process for function call names and args before calling

anngvu / accent

AI-Assisted Curation/Content ENhancement Tool for Synapse (pre-alpha)

MIT License

0 stars 1 forks source link

Validation process for function call names and args before calling #24

Open anngvu opened 4 months ago

anngvu commented 4 months ago

While function calls seem to be correct so far under limited prompting, in more large-scale usage there will most certainly be some that are mangled (especially if a user opts to use gpt-3.5 instead of gpt-4). The validation should also contain a re-prompt when something looks wrong.

[x] Handle function names that don't match an allowed function
[ ] Handle function arg validation

anngvu commented 6 days ago

Priority changed to low since, at least for OpenAI, function calls can now be made reliable. See https://openai.com/index/introducing-structured-outputs-in-the-api/ However, it is still relevant for Claude and other providers if they don't have something similar.