Using llama3.2-vision to upload local images results in an error.

langgenius / dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

Other

51.5k stars 7.44k forks source link

Self Checks

[X] This is only for bug report, if you would like to ask a question, please head to Discussions.
[X] I have searched for existing issues search for existing issues, including closed ones.
[X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
[X] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
[X] Please do not modify this template :) and fill in all the required fields.

Dify version

0.11.0

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

The following error occurs when uploading pictures locally:

Query or prefix prompt is too long, you can reduce the prefix prompt, or shrink the max token, or switch to a llm with a larger token limit size.

There is no error when uploading pictures using URL.

✔️ Expected Behavior

No response

❌ Actual Behavior

No response

I found a similar closed issue that might help you resolve the error you're encountering. The issue suggests the following solutions for the "Query or prefix prompt is too long" error:

Reduce the Prefix Prompt: Shorten the initial part of your prompt to fit within the token limit.
Lower the Max Token Setting: Decrease the max token setting further to allow more space for the prompt within the model's token limit.
Use a Model with a Larger Token Limit: If possible, switch to a model that supports a larger token limit to accommodate your needs.

Ensure that the sum of prompt tokens and max tokens does not exceed the model's context size ^[1].

To continue talking to Dosu, mention @dosu.

langgenius / dify