EinStack / glide

🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps
https://docs.einstack.ai/glide/
Apache License 2.0
127 stars 20 forks source link

✨ Support tool calling in Glide #246

Open roma-glushko opened 4 months ago

roma-glushko commented 4 months ago

Glide should allow to configure tools and make them available during requests to LLMs. Then, if LLM decides to call a specific tool, Glide needs to handle that request and call the tool. Then, the response is going to be send back to the model automatically.

Requirements

References:

roma-glushko commented 4 months ago

cc @mkrueger12 just got this idea 👀 Curious what do you think and what's the priority of this in your eyes