vikhyat / moondream

tiny vision language model
https://moondream.ai
Apache License 2.0
4.89k stars 435 forks source link

unknown model #64

Closed Asianfleet closed 6 months ago

Asianfleet commented 6 months ago

(main) (base) legion4080@LAPTOP-DTSSV3S1:~/MYXY/AI_pkgs/moondream$ python gradio_demo.py Using device: cuda If you run into issues, pass the --cpu flag to this script.

Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. Traceback (most recent call last): File "/home/legion4080/MYXY/AI_pkgs/moondream/gradio_demo.py", line 25, in moondream = AutoModelForCausalLM.from_pretrained( File "/home/legion4080/anaconda3/envs/main/lib/python3.9/site-packages/transformers/models/auto/auto_factory.py", line 556, in from_pretrained return model_class.from_pretrained( File "/home/legion4080/anaconda3/envs/main/lib/python3.9/site-packages/transformers/modeling_utils.py", line 3375, in from_pretrained model = cls(config, *model_args, **model_kwargs) File "/home/legion4080/.cache/huggingface/modules/transformers_modules/moondream2/moondream.py", line 16, in init self.vision_encoder = VisionEncoder() File "/home/legion4080/.cache/huggingface/modules/transformers_modules/moondream2/vision_encoder.py", line 98, in init VisualHolder(timm.create_model("vit_so400m_patch14_siglip_384")) File "/home/legion4080/anaconda3/envs/main/lib/python3.9/site-packages/timm/models/factory.py", line 78, in create_model raise RuntimeError('Unknown model (%s)' % model_name) RuntimeError: Unknown model (vit_so400m_patch14_siglip_384)

vikhyat commented 6 months ago

Looks like you have an old version of timm. Try pip install -U timm

T8star1984 commented 6 months ago

I have same question,and I try to update "timm",but it also report same error

ProGamerGov commented 6 months ago

@T8star1984 Try making a new conda instance and install the requirements.txt from this repo. That's how I solved this issue

Asianfleet commented 6 months ago

Thanks!i'll have a try.

vikhyat commented 6 months ago

Going to close this and use #65 as the tracking issue.