search

OpenBMB / MiniCPM-V

MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone
Apache License 2.0
7.86k stars 547 forks source link

关于多batch加速 #255

Closed middleknight closed 3 weeks ago

middleknight commented 3 weeks ago

请问离线模型部署支持多batch加速么？

Cuiunbo commented 3 weeks ago

您好，目前版本并不支持batch推理，非常欢迎自行实现并提交您的PR～