Vision-CAIR / LongVU

https://vision-cair.github.io/LongVU
300 stars 21 forks source link

AttributeError: 'NoneType' object has no attribute 'image_mean' #10

Open cutiyu opened 3 weeks ago

cutiyu commented 3 weeks ago

in app.py file, init meth setting model_name = "cambrian_qwen" and model_path = "./checkpoints/longvu_qwen"。 but README tell us to download models for LongVU_Qwen2_7B_img 、LongVU_Qwen2_7B or LongVU_Llama3_2_3B_img LongVU_Llama3_2_3B.

when I setting one of those model_path :

    model_path = "./checkpoints/LongVU_Qwen2_7B"
    # model_path = "./checkpoints/LongVU_Qwen2_7B_img"
    # model_path = "./checkpoints/LongVU_Llama3_2_3B_img"
    # model_path = "./checkpoints/LongVU_Llama3_2_3B"

I found the model_name must be model_name = "cambrian_qwen" , if not , it will caused exception : AttributeError: 'NoneType' object has no attribute 'image_mean'

so: what is the relation for model_name = "cambrian_qwen" and model_path and if I setting model_path = "./checkpoints/LongVU_Llama3_2_3B then model_name also is "cambrian_qwen" ?

xiaoqian-shen commented 3 weeks ago

Thanks for raising this question. Since our model built on top of Cambrian architecture and we decide which module to use based on the model name here.