您好，大模型负载如何配置，目前进入模型负载配置页面，点击没反应。

[tianfengliu]

Self Checks

• [X] This is only for bug report, if you would like to ask a question, please head to Discussions.
• [X] I have searched for existing issues search for existing issues, including closed ones.
• [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
• [X] Please do not modify this template :) and fill in all the required fields.

Dify version

0.7.2

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

进入大模型配置，选中一个大模型，点击设置负载均衡，点负载均衡没反应。

✔️ Expected Behavior

可以设置本地我部署的2个大模型节点

❌ Actual Behavior

点击没反应

[dosubot[bot]]

Hello @tianfengliu! I'm here to assist you with any bugs, questions, or contributions you may have regarding the repository. Let's tackle this issue together!

To configure load balancing for large models in version 0.7.2 of Dify, follow these steps:

1. Navigate to Model Provider -- Model List -- Configure Model Load Balancing.
2. Click Add Configuration to add different API keys for the same model. Ensure you add at least one additional model credential to enable load balancing.
3. If clicking on the load balancing option has no response, ensure that you have subscribed to the SaaS paid services or purchased the enterprise edition, as load balancing is a paid feature.

If the load balancing option is still unresponsive, you can try the following steps:

• Ensure that the modelLoadBalancingEnabled flag is set to true in your configuration.
• Check if the draftConfig object is properly initialized and contains the necessary configurations.
• Verify that the toggleModalBalancing function is being called correctly to enable the load balancing modal.
• Make sure that the setShowModelLoadBalancingEntryModal function is correctly set up to handle the modal display for adding or editing configurations.

Supporting evidence from the document:

• "模型负载均衡为付费特性，您可以通过订阅 SaaS 付费服务或者购买企业版来开启该功能。"
• "默认配置中的 API Key 为初次配置模型供应商时添加的凭据，您需要点击 增加配置 添加同一模型的不同 API Key 来正常使用负载均衡功能。"
• "需要额外添加至少 1 个模型凭据即可保存并开启负载均衡。"
• "const modelLoadBalancingEnabled = useProviderContextSelector(state => state.modelLoadBalancingEnabled)"
• "const toggleModalBalancing = useCallback((enabled: boolean) => { ... })"
• "const setShowModelLoadBalancingEntryModal = useModalContextSelector(state => state.setShowModelLoadBalancingEntryModal)" ^[1][2][3].

Additionally, there are similar discussions that might be helpful:

• Xinference failed to access the local model ^[4].
• add self deploy llm model, add error. ^[5].
• 请问如何添加本地大模型。以及我在‘添加LocalAI'时报错 ^[6].

To continue talking to Dosu, mention @dosu.

[tianfengliu]

企业版价格多少？怎么联系？

[dosubot[bot]]

企业版的价格没有具体说明，需要联系销售获取定价信息。您可以通过以下电子邮件地址联系 Dify 以获取更多信息：business@dify.ai ^[1].

To continue talking to Dosu, mention @dosu.