search

PKU-YuanGroup / MoE-LLaVA

Mixture-of-Experts for Large Vision-Language Models
https://arxiv.org/abs/2401.15947
Apache License 2.0
1.9k stars 121 forks source link

Support cuda 12 #37

Open fishfree opened 6 months ago

fishfree commented 6 months ago

Describe the issue

When I run deepspeed --include localhost:0 moellava/serve/gradio_web_server.py --model-path "LanguageBind/MoE-LLaVA-Phi2-2.7B-4e", it shows errors as below: OSError: libcufft.so.10: cannot open shared object file: No such file or directory

LinB203 commented 6 months ago

Sorry, it is not a error caused by MoE-LLaVA. It seems that is your cuda enviroment problem. You can google and solve it. Thanks.