Thanks for your great work. But when I run run.sh, I met the error "ImportError: FlashAttention2 has been toggled on, but it cannot be used due to the following error:the package flash_attn seems to be not installed." as shown in the following image.
And when I try "pip install flash_attn", the following error appears as shown in the second image.
Does anybody know how to fix it? Thanks very much.
Thanks for your great work. But when I run run.sh, I met the error "ImportError: FlashAttention2 has been toggled on, but it cannot be used due to the following error:the package flash_attn seems to be not installed." as shown in the following image.
And when I try "pip install flash_attn", the following error appears as shown in the second image. Does anybody know how to fix it? Thanks very much.