Closed Forival closed 9 months ago
You said that Flash Attention version 2 is not currently supported and may require manual modifications to the model file. but In requirement.txt, you still have flash-attn2 installed. Does this cause some incompatibility issues?
Thanks for catching this! It should be removed. The file is updated!
You said that Flash Attention version 2 is not currently supported and may require manual modifications to the model file. but In requirement.txt, you still have flash-attn2 installed. Does this cause some incompatibility issues?