Open gxx-ljy opened 1 month ago
Hope it can support llms deployed by kserve
https://kserve.github.io/website/latest/modelserving/v1beta1/llm/huggingface/text_generation/
Hi, @gxx-ljy. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.
Issue Summary:
Next Steps:
Thank you for your understanding and contribution!
Self Checks
1. Is this request related to a challenge you're experiencing? Tell me about your story.
Hope it can support llms deployed by kserve
2. Additional context or comments
https://kserve.github.io/website/latest/modelserving/v1beta1/llm/huggingface/text_generation/
3. Can you help us with this feature?