Open pspdada opened 1 day ago
Specifying the version of flash-attn
to install can resolve this issue. It seems that the latest version of flash-attn
is incompatible with torch==2.0.1
specified in the pyproject.toml
. I was able to resolve the problem using the following version:
pip install flash-attn==2.1.0 --no-build-isolation
Would it be possible to add this to the README to prevent others from encountering the same problem?
Thank you for your suggestion!
I follow the instruction to set up env:
but encountered an error when try to load the model:
The code I use:
How can I solve this?