AllYourBot / hostedgpt

An open version of ChatGPT you can host anywhere or run locally.
MIT License
383 stars 253 forks source link

Enable tool calling for Anthropic LLMs (and OpenRouter) #420

Open krschacht opened 5 months ago

mattlindsey commented 1 day ago

Tool calling should work for Ollama now with openai api driver, so we should test and document that it works. (P.S. I tested against Ollama Llama3.1 model locally, and it didn't seem to want to call the memory tool. LLam3.1 does support tools. I'll keep checking... Also note that setting of the conversation title is not working with Ollama.)

And a PR can be done to enable for Google Gemini.