search

tingxueronghua / ChartLlama-code

MIT License
178 stars 17 forks source link

Is there any typo in the model https://huggingface.co/listen2you002/ChartLlama-13b/tree/main? #23

Open yanchuqiao opened 3 months ago

yanchuqiao commented 3 months ago

Hello. Thank you for releasing all these amazing work. I am encountering a ClipVision issue. When I try to load the Lora weigths from ChartLlama-13b model, the "mm_vision_tower": "/mnt/share_1227775/yandali/multimodal/models/ft_local/clip-vit-large-patch14-336/" was n't accessiable. I changed it to the openai/clip-vit-large-patch14-336, but then it has another problem of generating texts.

I am wondering is there any typo or issues here? Maybe I am wrong. Canyou help to fix it?

Thank you so much

sbY99 commented 2 weeks ago

I faced the same issue. Did you resolve it?