Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
[X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
[X] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
[X] Please do not modify this template :) and fill in all the required fields.
1. Is this request related to a challenge you're experiencing? Tell me about your story.
I tried using OpenAI-API-compatible in dify with deploying models provided by deepinfra.
All models return empty.
I'd like to request that Dify add support for the DeepInfra platform and specifically the gemma-2-27b-it model.
Reasoning:
Multilingual Excellence: gemma-2-27b-it is currently considered one of the best open-source models for multilingual tasks. Integrating it would significantly enhance Dify's capabilities in understanding and generating code across various languages.
Self Checks
1. Is this request related to a challenge you're experiencing? Tell me about your story.
I tried using OpenAI-API-compatible in dify with deploying models provided by deepinfra. All models return empty.
I'd like to request that Dify add support for the DeepInfra platform and specifically the gemma-2-27b-it model.
Reasoning: Multilingual Excellence: gemma-2-27b-it is currently considered one of the best open-source models for multilingual tasks. Integrating it would significantly enhance Dify's capabilities in understanding and generating code across various languages.
Technical Details: Model: gemma-2-27b-it Platform: DeepInfra (https://deepinfra.com/google/gemma-2-27b-it/api)
I'd be happy to provide any additional information or assistance to help with this integration.
2. Additional context or comments
No response
3. Can you help us with this feature?