search

baaivision / Emu3

Next-Token Prediction is All You Need
Apache License 2.0
1.79k stars 69 forks source link

Issues with flash_attn #39

Open ohjasd098 opened 1 week ago

ohjasd098 commented 1 week ago

ImportError: This modeling file requires the following packages that were not found in your environment: flash_attn. Run pip install flash_attn (emu3) @CHINAMI-JARNGAD:/mnt/d/Research/Emu3$ pip install flash_attn Requirement already satisfied: flash_attn in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (2.5.7) Requirement already satisfied: torch in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from flash_attn) (2.3.0) Requirement already satisfied: einops in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from flash_attn) (0.8.0) Requirement already satisfied: packaging in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from flash_attn) (24.1) Requirement already satisfied: ninja in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from flash_attn) (1.11.1.1) Requirement already satisfied: filelock in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from torch->flash_attn) (3.16.1) Requirement already satisfied: typing-extensions>=4.8.0 in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from torch->flash_attn) (4.12.2) Requirement already satisfied: sympy in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from torch->flash_attn) (1.13.3) Requirement already satisfied: networkx in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from torch->flash_attn) (3.4.2) Requirement already satisfied: jinja2 in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from torch->flash_attn) (3.1.4) Requirement already satisfied: fsspec in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from torch->flash_attn) (2024.10.0) Requirement already satisfied: MarkupSafe>=2.0 in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from jinja2->torch->flash_attn) (2.1.5) Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/xwp/anaconda3/envs/emu3/lib/python3.11/site-packages (from sympy->torch->flash_attn) (1.3.0) (emu3) @CHINAMI-JARNGAD:/mnt/d/Research/Emu3$

ryanzhangfan commented 1 week ago

Maybe you can try this to see if it works?