langgenius / dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
https://dify.ai
Other
50.75k stars 7.29k forks source link

Add Support for DeepInfra and gemma-2-27b-it Model #6437

Closed sevenjay closed 1 month ago

sevenjay commented 3 months ago

Self Checks

1. Is this request related to a challenge you're experiencing? Tell me about your story.

I tried using OpenAI-API-compatible in dify with deploying models provided by deepinfra. All models return empty. image

I'd like to request that Dify add support for the DeepInfra platform and specifically the gemma-2-27b-it model.

Reasoning: Multilingual Excellence: gemma-2-27b-it is currently considered one of the best open-source models for multilingual tasks. Integrating it would significantly enhance Dify's capabilities in understanding and generating code across various languages.

Technical Details: Model: gemma-2-27b-it Platform: DeepInfra (https://deepinfra.com/google/gemma-2-27b-it/api)

I'd be happy to provide any additional information or assistance to help with this integration.

2. Additional context or comments

No response

3. Can you help us with this feature?

sevenjay commented 3 months ago

DeepInfra supports Llama 3.1 70B in a good price. please support DeepInfra, too.

shinebarbhuiya commented 3 months ago

Please add support for DeepInfra