Is there any way to replicate function calling like in openai assistants api?

eth-sri / lmql

A language for constraint-guided and efficient LLM programming.

https://lmql.ai

Apache License 2.0

3.48k stars 191 forks source link

Is there any way to replicate function calling like in openai assistants api? #317

Closed KurtKobalt closed 4 months ago

KurtKobalt commented 5 months ago

I'd like to us the LLM to query the user until it has all the parameters required to call an external api. I tried reading the documentation but couldn't find any use case like this. Thanks.

lbeurerkellner commented 4 months ago

There is some work happening around bridging to OpenAI function calling. Further, we have shipped preview features around similar functionality with other models (see https://lmql.ai/blog/#lmql-actions-preview for glimps).

All in all, there is no batteries-included solution shipping with LMQL right now. I hope this is helpful.