search

LLaVA-VL / LLaVA-NeXT

Apache License 2.0
2.52k stars 186 forks source link

Unable to load interleave model #83

Closed justinphen closed 3 months ago

justinphen commented 3 months ago

When I was trying to run the gradio demo with the new llava-next-interleave-7b model, I ran into the following two errors. Any ideas?

Screenshot 2024-06-28 at 15 15 57
HaoZhang534 commented 3 months ago

When I was trying to run the gradio demo with the new llava-next-interleave-7b model, I ran into the following two errors. Any ideas? Screenshot 2024-06-28 at 15 15 57

You need to install llava-next first.

justinphen commented 3 months ago

When I was trying to run the gradio demo with the new llava-next-interleave-7b model, I ran into the following two errors. Any ideas? Screenshot 2024-06-28 at 15 15 57

You need to install llava-next first.

The thing is, I have already installed llava-next before running this file. So not sure what caused this problem...

jinsikbang commented 3 months ago

If you install flash attention module, then might be solved.