OpenBMB / MiniCPM-V

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone
Apache License 2.0
12.59k stars 886 forks source link

请问为什么MiniCPM-V-2_6-int4的参数量只有4.76B? #655

Open quanmou opened 1 week ago

quanmou commented 1 week ago

是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?

该问题是否在FAQ中有解答? | Is there an existing answer for this in FAQ?

当前行为 | Current Behavior

huggingface页面看到MiniCPM-V-2_6-int4的参数量只有4.76B,有点不明白,因为说:This is the int4 quantized version of MiniCPM-V 2.6。而V2.6介绍页面说:The model is built on SigLip-400M and Qwen2-7B with a total of 8B parameters。那如果只是量化的话,参数量应该也是8B吧,求解释,多谢了

期望行为 | Expected Behavior

No response

复现方法 | Steps To Reproduce

No response

运行环境 | Environment

No response

备注 | Anything else?

No response

LDLINGLINGLING commented 1 week ago

你好,应该没有说过minicpmvint4是4.6b。量化只是低比特而已,并不会减少参数量