search

modelscope / ms-swift

Use PEFT or Full-parameter to finetune 300+ LLMs or 80+ MLLMs. (Qwen2, GLM4v, Internlm2.5, Yi, Llama3.1, Llava-Video, Internvl2, MiniCPM-V-2.6, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)
https://swift.readthedocs.io/zh-cn/latest/Instruction/index.html
Apache License 2.0
3.39k stars 289 forks source link

[Help]请问MiniCPM2.5支持Web端交互推理吗？ #1060

Closed Egber1t closed 2 weeks ago

Egber1t commented 3 months ago

用vllm如下命令，显示不支持MiniCPM-2.5 CUDA_VISIBLE_DEVICES=0 swift app-ui --model_type minicpm-v-v2_5-chat--infer_backend vllm 然后在swift的gradio端口中也没有找到如何进行粘贴或者上传图片，进行推理，求解答谢谢！

wangdong1992 commented 2 months ago

me too

tastelikefeet commented 2 weeks ago

支持，请使用最新版本