Bin-Huang / chatbox

User-friendly Desktop Client App for AI Models/LLMs (GPT, Claude, Gemini, Ollama...)
https://chatboxai.app
GNU General Public License v3.0
19.99k stars 2.03k forks source link

[Feature] Ollama model add support image / Ollama添加图片支持 #1230

Open Jackxwb opened 4 months ago

Jackxwb commented 4 months ago

Problem Description The llava model in Ollama supports image input, but after selecting the llava model in chatbox, images cannot be sent, prompting Current model does not support image input

Proposed Solution According to the model page prompts in Ollama for llava , using the api/generate interface Reference [llm-x]( https://github.com/mrdjohnson/llm-x )The implementation method of this project image

Additional Context Please provide any additional context or information that would help better understanding your feature request, such as screenshots, examples, or use cases. image


问题描述 Ollama 里 llava 模型是支持图片输入的,但 chatbox 里选择 llava 模型后,无法发送图片,提示 当前模型不支持图片输入

解决思路 根据 Ollama 里 llava 的模型页面提示,使用 api/generate 接口 参考 llm-x 这个项目的实现方式 image

附加上下文 请提供任何其他上下文或信息,以便更好地理解您的功能请求,例如截图、示例或用例。

image

miaotouy commented 4 months ago

还有其他自定义模型也是,像我的是使用中转API统一用openai格式调用,在使用claude-3-opus-20240229等模型时也无法上传图片

JamesClarke7283 commented 4 months ago

+1 Please add this feature for Ollama.