[Request] ollama本地大模型自定义选择是否支持视觉

[MarsSovereign]

🥰 需求描述

ollama运行的本地大模型，例如llava，是支持视觉的，但是目前lobechat中加载ollama运行的模型都是默认不支持视觉，而且没有选项可以自行打开

🧐 解决方案

当使用ollama本地模型时，允许用户自行选择是否打开视觉能力（其实其他能力也一样，比如插件）

📝 补充信息

No response

[lobehubbot]

👀 @MarsSovereign

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible. Please make sure you have given us as much context as possible.\ 非常感谢您提交 issue。我们会尽快调查此事，并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

🥰 Description of requirements

Large local models run by ollama, such as llava, support vision. However, currently, the models loaded by ollama in lobechat do not support vision by default, and there is no option to open it by yourself.

🧐 Solution

When using the ollama local model, users are allowed to choose whether to turn on visual capabilities (in fact, the same is true for other capabilities, such as plug-ins)

📝 Supplementary information

No response

[Luffyzm3D2Y]

我也发现了，lobe-chat似乎不支持Ollama中的支持视觉的大模型，在Ollama上下载了Llava，但是无法在lobe-chat上使用。。。。。

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

I also discovered that lobe-chat does not seem to support the large vision-supported models in Ollama. I downloaded Llava on Ollama, but it cannot be used on lobe-chat. . . . .

[Luffyzm3D2Y]

而且希望Ollama中的自定义支持/不支持视觉的模型都能够使用Lobe-chat. 我不确定目前是否支持该功能

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

And I hope that custom models in Ollama that support/do not support vision can use Lobe-chat.

[Luffyzm3D2Y]

我也发现了，lobe-chat似乎不支持Ollama中的支持视觉的大模型，在Ollama上下载了Llava，但是无法在lobe-chat上使用。。。。。

可以看一下这个issue #1351，在前端更新设置之后就没有这个问题了。

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

I also discovered that lobe-chat does not seem to support the large visual-supported models in Ollama. I downloaded Llava on Ollama, but it cannot be used on lobe-chat. . . . .

You can take a look at this issue #1351. After updating the front-end settings, this problem disappears.

[arvinxx]

这是支持的

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

This is supported

[lobehubbot]

✅ @MarsSovereign

This issue is closed, If you have any questions, you can comment and reply.\ 此问题已经关闭。如果您有任何问题，可以留言并回复。