xorbitsai / inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
https://inference.readthedocs.io
Apache License 2.0
5.57k stars 462 forks source link

FEAT: Request for MiniCPM-V model support #995

Closed onionknightdd closed 8 months ago

qinxuye commented 10 months ago

qwen 1.5 is being supported via https://github.com/xorbitsai/inference/pull/994

onionknightdd commented 10 months ago

qwen 1.5 is being supported via #994

great thanks for immediate reply !!!!!

qinxuye commented 10 months ago

I will reopen this issue and rename the title to support MiniCPM-V which is not supported yet.