Building wheel for flash-attn (setup.py) ...(Stuck)

[lonly197]

Despite numerous attempts, even after downloading the compatible version directly from https://github.com/Dao-AILab/flash-attention/releases/ and attempting to install it, followed by executing 'pip install -e .', it still gets stuck at 'Building wheel for flash-attn (setup.py)' without any progress.

[adithya-s-k]

Which os and machine are you on?

[lonly197]

• Ubuntu 22.04.3
• gcc version 11.4.0
• Python 3.10.12
• torch 2.3.0+cu121
• region china

[adithya-s-k]

Ok ideally it should not cause a problem Have you tried using Docker ?

[adithya-s-k]

can you try pip install -r pyproject.toml

[lonly197]

After two hours, I received the error message 'ERROR: Failed building wheel for flash-attn'.

[adithya-s-k]

https://github.com/Dao-AILab/flash-attention/issues/420

have you tried pip install flash-attn --no-build-isolation then doing pip install -e .

[lonly197]

Dao-AILab/flash-attention#420

have you tried pip install flash-attn --no-build-isolation then doing pip install -e .

it work for me