Deploy MiniCPM-V 2.5 with vllm

OpenBMB / MiniCPM-V

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

Apache License 2.0

12.41k stars 871 forks source link

Closed zimoqingfeng closed 5 months ago

zimoqingfeng commented 5 months ago

Very impressive work for the community!

I am wondering how to deploy the MiniCPM-V 2.5 with vllm, and I have found that the repo https://github.com/OpenBMB/vllm/commit/94fcfc6582a347de3b26b377169bc78d06184c98 only support MiniCPM-V 2.0.

Looking forward to your reply.

iceflame89 commented 5 months ago

Thanks for your attention，we will support to deploy the MiniCPM-V 2.5 with vllm soon.

Cuiunbo commented 5 months ago

add to the Future Program, temporarily closed issue