search

OpenBMB / MiniCPM-V

MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone
Apache License 2.0
7.86k stars 547 forks source link

关于多batch加速 #256

Closed middleknight closed 3 weeks ago

middleknight commented 3 weeks ago

请问离线模型部署支持多batch加速么？