labring / FastGPT

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.
https://fastgpt.in
Other
16.92k stars 4.52k forks source link

help!调用多模态模型MiniCPM-Llama3-V-2_5异常 #1616

Closed 13829386012 closed 3 months ago

13829386012 commented 3 months ago

例行检查

你的版本

问题描述, 日志截图 在调用多模态模型MiniCPM-Llama3-V-2_5时,文字聊天正常,打开vision后上传图片时,报错:Service Unavailable503, 请问要如何设置才能正确使用,这个问题困扰我好几日,非常需要帮助 image config设置如下: image

复现步骤

预期结果

相关截图

lijiajun1997 commented 3 months ago

需要模型按openai的api标准才行

ifkd111 commented 3 months ago

需要模型按openai的api标准才行

额用oneapi接的,所以应该怎么操作呢?

13829386012 commented 3 months ago

需要模型按openAI的API標準才行

需要模型按openai的api标准才行

请问需要怎么操作呢

c121914yu commented 3 months ago

需要模型按openAI的API標準才行

需要模型按openai的api标准才行

请问需要怎么操作呢

改模型接口兼容openai,或者改oneapi,让它兼容你的模型。

ifkd111 commented 3 months ago

怎么改模型接口匹配openai