Support llm configuration for prompt generation etc.

langgenius / dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

Other

53.59k stars 7.85k forks source link

Self Checks

[X] I have searched for existing issues search for existing issues, including closed ones.
[X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
[X] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
[X] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

I've noticed that some part of the functions that require llm (like prompt generating and Q&A part in knowledge base) do not support the configuration of llm (like choosing model, setting max token), this caused some problems. For example, in prompt generation, I often encountered cases when the prompt is incomplete (caused by too little max token), and also, the default model for prompt generation and Q&A seems to be gpt-4o, while I would like to use gpt-4o-mini.

Therefore, I hope there is a llm config in the setting part for the case I mentioned above.

2. Additional context or comments

No response

3. Can you help us with this feature?

[ ] I am interested in contributing to this feature.

Hi, @HeMuling. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

You requested enhancements to language model configuration options.
Experiencing issues with incomplete prompts due to token limits.
Prefer using gpt-4o-mini over the default gpt-4o.
Suggested adding options for model selection and token limit adjustments.
No further comments or developments on the issue.

Next Steps:

Is this issue still relevant to the latest version of the Dify repository? If so, please comment to keep the discussion open.
Otherwise, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

langgenius / dify