search

lobehub / lobe-chat

🤯 Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Azure / DeepSeek), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT/ Claude application.
https://chat-preview.lobehub.com
Other
44.33k stars 9.94k forks source link

[Request] 自定义模型使用Gemini-pro-vision时增加图片上传选项 #790

Closed Feiyuyu0503 closed 10 months ago

Feiyuyu0503 commented 10 months ago

🥰 需求描述 | Feature Description

我已经拥有将Gemini-pro-vision的调用转换成openai api格式调用的api，但是在对话中选择Gemini-pro-vision时，没有图片上传选项。

🧐 解决方案 | Proposed Solution

是否可能根据模型名是否带有'vision'来开启图片上传选项？

📝 补充信息 | Additional Information

No response

lobehubbot commented 10 months ago

👀 @Feiyuyu0503

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible. Please make sure you have given us as much context as possible.\ 非常感谢您提交 issue。我们会尽快调查此事，并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

arvinxx commented 10 months ago

倒也可以，我改下

lobehubbot commented 10 months ago

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

That's okay, I'll change it

Feiyuyu0503 commented 10 months ago

倒也可以，我改下

多谢开发者！ 借楼再问一下，是否有可能将这里的'dall-e-3'变成可配置模型名呢？ https://github.com/lobehub/lobe-chat/blob/dc7642d8dea5d2ac04a79aa394c540e560b5d642/src/services/imageGeneration.ts#L11 因为我使用的api已经将其他绘画模型的调用适配成openai image generation的格式，https:///v1/image/generations，但是只支持包括sd等的其他绘画模型，不支持dall-e-3

arvinxx commented 10 months ago

@Feiyuyu0503 目前没有关于图像生成的配置，建议单独开个 issue 跟踪。这样后续在做 #737 这个的时候可以 ref 一下这个需求。

lobehubbot commented 10 months ago

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

@Feiyuyu0503 Currently there is no configuration for image generation. It is recommended to open a separate issue for tracking. In this way, you can ref this requirement when doing #737 later.

kokojacket commented 10 months ago

@Feiyuyu0503 转换项目能分享一下吗？

lobehubbot commented 10 months ago

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

@Feiyuyu0503 Can you share the conversion project?

Feiyuyu0503 commented 10 months ago

@kokojacket https://github.com/songquanpeng/one-api

lobehubbot commented 10 months ago

✅ @Feiyuyu0503

This issue is closed, If you have any questions, you can comment and reply.\ 此问题已经关闭。如果您有任何问题，可以留言并回复。

lobehubbot commented 10 months ago

:tada: This issue has been resolved in version 0.117.3 :tada:

The release is available on:

Your semantic-release bot :package::rocket: