search

jeremychone / rust-genai

Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Groq, Gemini, Cohere, ...)
Apache License 2.0
168 stars 35 forks source link

Function calling / tool use #24

Open Boscop opened 3 hours ago

Boscop commented 3 hours ago

It would be really great if you could prioritize adding support for function calling / tool use :) I started using this crate for a project where I need function calling, and then realized that this crate doesn't support it yet.. For now I'll emulate it by telling the model in the system prompt to output json in a certain format whenever it wants to "call a function", but it's a hacky workaround.

Please let me know, what's your planned timeline for adding function calling? :)

Thanks 🙏 I really appreciate your work on this crate 🙂

Btw, in general it would be very helpful to have an intended Roadmap in the Readme, or have a GitHub project that implies one :)

jeremychone commented 2 hours ago

@Boscop Yes, make sense. Ok, this is next on the list now.