search

salesforce / LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence
BSD 3-Clause "New" or "Revised" License
9.97k stars 974 forks source link

transformers version support #757

Open YeonjeeJung opened 1 month ago

YeonjeeJung commented 1 month ago

Hi, I really appreciate your amazing research. So I would like to use this framework to verify my work.

However, now I want to use latest llama model in this framework but the latest transformers version (4.45.0) is not compatible with it. Do you have any support for this problem?

chenneJelly commented 1 month ago

I search the issue and i found that transformers==4.31.0 works

YeonjeeJung commented 1 month ago

@chenneJelly Thank you for sharing your experiment!

For more specifically, I am now want to replace the LLM model with LLaMA3.2. But latest transformers support this model. I tried transformers 4.33.0, and It worked for the models in BLIP-2 and InstructBLIP, but not LLaMA3.2

Does anyone have a solution?