langgenius / dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
https://dify.ai
Other
53.24k stars 7.77k forks source link

Support Kserve LLM endpoint #9927

Open gxx-ljy opened 1 month ago

gxx-ljy commented 1 month ago

Self Checks

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Hope it can support llms deployed by kserve

2. Additional context or comments

https://kserve.github.io/website/latest/modelserving/v1beta1/llm/huggingface/text_generation/

3. Can you help us with this feature?

dosubot[bot] commented 1 day ago

Hi, @gxx-ljy. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

Next Steps:

Thank you for your understanding and contribution!