Disable AOTriton when USE_FLASH_ATTENTION=0 AND USE_MEM_EFF_ATTENTION=0 - Githubissues

ROCm / pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

http://pytorch.org

Other

219 stars 51 forks source link

Disable AOTriton when USE_FLASH_ATTENTION=0 AND USE_MEM_EFF_ATTENTION=0 #1536

Closed xinyazhang closed 1 month ago