OpenBMB / MiniCPM

MiniCPM-2B: An end-side LLM outperforming Llama2-13B.
Apache License 2.0
4.38k stars 313 forks source link

[Bad Case]: MiniCPM-V2-2.0推理失败 #121

Closed cjxcn closed 2 months ago

cjxcn commented 2 months ago

Description / 描述

import torch
from PIL import Image
from transformers import AutoModel, AutoTokenizer

model = AutoModel.from_pretrained('MiniCPM-V-2.0', trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained('MiniCPM-V-2.0', trust_remote_code=True)

model.eval().cuda()

image = Image.open('/data/intern/chenjiaxing/pictures/pic.png').convert('RGB')
question = 'What is in the image?'
msgs = [{'role': 'user', 'content': question}]

res, context, _ = model.chat(
    image=image,
    msgs=msgs,
    context=None,
    tokenizer=tokenizer,
    sampling=True,
    temperature=0.7
)
print(res)

使用以上代码推理时,出现了以下错误:

Traceback (most recent call last):
  File "/data/intern/chenjiaxing/cv-intern-small-lmm/MiniCPM/func.py", line 11, in <module>
    model = AutoModel.from_pretrained('/data/intern/chenjiaxing/checkpoints/MiniCPM-V-2.0', trust_remote_code=True)
  File "/data/intern/chenjiaxing/miniconda3/envs/bunny/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 550, in from_pretrained
    model_class = get_class_from_dynamic_module(
  File "/data/intern/chenjiaxing/miniconda3/envs/bunny/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 501, in get_class_from_dynamic_module
    return get_class_in_module(class_name, final_module)
  File "/data/intern/chenjiaxing/miniconda3/envs/bunny/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 201, in get_class_in_module
    module = importlib.machinery.SourceFileLoader(name, module_path).load_module()
  File "<frozen importlib._bootstrap_external>", line 548, in _check_name_wrapper
  File "<frozen importlib._bootstrap_external>", line 1063, in load_module
  File "<frozen importlib._bootstrap_external>", line 888, in load_module
  File "<frozen importlib._bootstrap>", line 290, in _load_module_shim
  File "<frozen importlib._bootstrap>", line 719, in _load
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/home/app/.cache/huggingface/modules/transformers_modules/MiniCPM-V-2.0/modeling_minicpmv.py", line 13, in <module>
    from .modeling_minicpm import MiniCPMForCausalLM, MiniCPMPreTrainedModel
ModuleNotFoundError: No module named 'transformers_modules.MiniCPM-V-2'

Case Explaination / 案例解释

No response

zRzRzRzRzRzRzR commented 2 months ago

官方在魔搭社区的装错了 MiniCPM-V-2.0 是错的 MiniCPM-V-2才是对的 改成 MiniCPM-V-2就好了