search

langgenius / dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
https://dify.ai
Other
48.42k stars 6.92k forks source link

glm4v not get the response #6433

Closed Frank-Zeng closed 1 month ago

Frank-Zeng commented 3 months ago

Self Checks

Dify version

0.6.14

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

I have workflow with local glm4v to read upload image, and I have see the logs from the glm4v server, it has normal response,but the Dify workflow node, it didn't get the glm4v response and return empty string. when I use gpt4o instead of the glm4v, it's works fine, but the glm4v server is compatiable OpenAI restful API, all of the interface and parameter is compatiable, so how to debug or resolve this issue? Thx. image

✔️ Expected Behavior

GLM4V response has correct show in dify workflow.

❌ Actual Behavior

GLM4V response show empty string in dify workflow.

Frank-Zeng commented 3 months ago

the vision LLM node get empty text in the response like below: image

crazywoola commented 3 months ago

Can you paste a screenshot of the LLM itself.

Frank-Zeng commented 3 months ago

Can you paste a screenshot of the LLM itself. image

crazywoola commented 2 months ago

How did you deploy the glm4v? openai-competiable?

Frank-Zeng commented 2 months ago

How did you deploy the glm4v? openai-competiable?

I reference this repo to deploy glm4v: https://github.com/xusenlinzy/api-for-open-llm

the input image parameter handled by below code: image