[Bug]MiniCPM-V 2.0是没有支持吗？

InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

https://lmdeploy.readthedocs.io/en/latest/

Apache License 2.0

4.16k stars 376 forks source link

Open DankoZhang opened 1 month ago

DankoZhang commented 1 month ago

用lmdeploy加载MiniCPM-V 2.0，报了如下的错误：

采用pipeline模式加载的模型： pipe = pipeline(model_path)

lmdeploy==0.4.2

No response

DankoZhang commented 1 month ago

@lvhan028 大佬帮忙看看

lvhan028 commented 1 month ago

https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_5 is supported by lmdeploy 0.5.0 May upgrade lmdeploy and give a try.

DankoZhang commented 1 month ago

https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_5 is supported by lmdeploy 0.5.0 May upgrade lmdeploy and give a try.

@lvhan028 一样的错误，这个是MiniCPM-V 2.0，不是MiniCPM-Llama3-V-2_5，是现在还没支持么

irexyc commented 1 month ago

@DankoZhang

2.0没有支持。

有2.5了还用2.0是因为他小么？

DankoZhang commented 1 month ago

@DankoZhang

2.0没有支持。

有2.5了还用2.0是因为他小么？

@irexyc irexyc 是的，小一些。这个适配起来复杂么