search

cambrian-mllm / cambrian

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.
https://cambrian-mllm.github.io/
Apache License 2.0
1.77k stars 116 forks source link

[BUG] Unable to download model weights from Huggingface #59

Closed peiqi-liu closed 4 months ago

peiqi-liu commented 4 months ago

Hello,

I attempted to load Cambrian model weights from huggingface.

I used following commands to do so: from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("nyu-visionx/cambrian-8b")

However, I received error message saying: ValueError: The checkpoint you are trying to load has model type cambrian_llama but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

I tried to run the codes with different transformers version but I always had this error message.

penghao-wu commented 4 months ago

Our model is not integrated into transformers. You have to install our repo to load and use our models (see inference.py).

peiqi-liu commented 4 months ago

Got it. Thanks.