search

lobehub / lobe-chat

🤯 Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Azure / DeepSeek), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT/ Claude application.
https://chat-preview.lobehub.com
Other
40.51k stars 9.21k forks source link

[Request] Ollama Tool (Funtion) Calling #3436

Open DEAD1SIDE opened 1 month ago

DEAD1SIDE commented 1 month ago

🥰 Feature Description

Ollama released Tool support https://ollama.com/blog/tool-support. It would be nice to use it.

🧐 Proposed Solution

Let the user select what models can function call

📝 Additional Information

No response

lobehubbot commented 1 month ago

👀 @DEAD1SIDE

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible. Please make sure you have given us as much context as possible.\ 非常感谢您提交 issue。我们会尽快调查此事，并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

arvinxx commented 1 month ago

Ollama don't support stream tool using. So it's a little difficult to implement it. I plan to wait for the stream tools use implement of Ollama

p00pcvm commented 3 weeks ago

You're not getting good publicity with that attitude.

arvinxx commented 3 weeks ago

@p00pcvm I' sorry for that, but I work on this only by myself and I have limited time. There are more important features to do like knowledge base/ file upload. I will maintain this project in long-term. So I make decision for what's the better in the long run.

As for the detail why I need to wait for stream tool calling, you can check it here: https://github.com/lobehub/lobe-chat/issues/2311#issuecomment-2290657866

In the mean-while you can still use Open WebUI which match better with Ollama.

p00pcvm commented 2 weeks ago

@arvinxx I'm sorry, I didn't realize you were doing this by yourself. I was under the impression there was a team of engineers working on the project.

arvinxx commented 2 weeks ago

@p00pcvm I do the main product plan / main UX design / frontend and backend develop / marketing. @canisminor1990 will also work for some features. But LobeChat is our side project by now. That's why we open-source it, community help a lot on small bug fix and document update.