search

mu-cai / matryoshka-mm

Matryoshka Multimodal Models
https://matryoshka-mm.github.io/
Apache License 2.0
71 stars 4 forks source link

[Question] The usage of official weight #5

Open YuchenLiu98 opened 1 month ago

YuchenLiu98 commented 1 month ago

Question

Hello Authors,

Thanks for your amazing work and provide the trained weight in https://huggingface.co/mucai/llava-next-vicuna-7b-m3. When I download the weight and test, something wrong happens with " File "/home/ma-user/anaconda3/envs/PyTorch-2.1.0/lib/python3.9/site-packages/transformers/modeling_utils.py", line 4278, in _load_pretrained_model state_dict = load_state_dict(shard_file, is_quantized=is_quantized) File "/home/ma-user/anaconda3/envs/PyTorch-2.1.0/lib/python3.9/site-packages/transformers/modeling_utils.py", line 516, in load_state_dict with safe_open(checkpoint_file, framework="pt") as f: safetensors_rust.SafetensorError: Error while deserializing header: MetadataIncompleteBuffer" Do you have any idea on how to solve this problem? Thanks a lot for your help.

mu-cai commented 3 weeks ago

Can you try again?

I think just like the downloading process is broken?