search

microsoft / autogen

A programming framework for agentic AI 🤖
https://microsoft.github.io/autogen/
Creative Commons Attribution 4.0 International
30.82k stars 4.49k forks source link

[Feature Request]: Add note to docs that only some models support function calling #1262

Open davorrunje opened 8 months ago

davorrunje commented 8 months ago

Is your feature request related to a problem? Please describe.

People asked for it on Discord after spending a lot of time trying to make it work with unsupported models.

Describe the solution you'd like

No response

Additional context

No response

gagb commented 8 months ago

Text in this notebook and the doc strings of methods exposed in this notebook seem like a good starting point for where to update the documentation? https://github.com/microsoft/autogen/blob/main/notebook/agentchat_function_call.ipynb

qingyun-wu commented 8 months ago

I think it also helps to have a place to document the models that are supporting function calls. Adding some here:

prithvi2226 commented 3 months ago

Is this issue still open or has been closed?? Thank you very much!

davorrunje commented 3 months ago

Looks like it is still open.

yonitjio commented 2 months ago

Please also add that function calling is also depends on AI platform. Even if the model can suggest function calling, if the AI platform doesn't support it then it won't work.

It seems some has tried Autogen with Ollama directly without realizing this. As of this writing, June 19, 2024, Ollama's Open AI implementation doesn't support function calling. https://github.com/ollama/ollama/blob/main/docs/openai.md

We do have documentation about this, but perhaps it needs to be moved to a more visible place.

https://microsoft.github.io/autogen/docs/topics/non-openai-models/local-litellm-ollama