微调后的模型是否支持使用vLLM进行推理？

Ablustrund / LoRAMoE

LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment

242 stars 17 forks source link

Open Shubao-Zhao opened 4 months ago