Open zhipeng9802 opened 1 month ago
This issue is stale because it has been open for 7 days with no activity.
This issue was closed because it has been inactive for 5 days since being marked as stale.
@qinxuye REST方式请求LoRA模型,说的就是这个feature。
@qinxuye REST方式请求LoRA模型,说的就是这个feature。
收到,我看下
This issue is stale because it has been open for 7 days with no activity.
Feature request / 功能建议
Compatible with OpenAI when using LoRA adapters eg. http://localhost:9997/v1/chat/completions ...
In addition: Dynamically serving LoRA Adapters
Motivation / 动机
Uniform request protocol and use xinf platform
Your contribution / 您的贡献
vllm official document https://docs.vllm.ai/en/latest/models/lora.html