Open A-transformer opened 1 month ago
Terminal will be reused by tasks, press any key to close it.
if include '-D CUTE_ARCH_LDSM_SM75_ACTIVATED'
is our code test on sm76 architect ?
Have not test sm75 series since the official FA implementation is at least sm80 and requires a GPU with Ampere architecture at least.
https://github.com/Dao-AILab/flash-attention/blob/bedf8774677315c5eb7e640eca6d7aa15e87775a/setup.py#L169
Terminal will be reused by tasks, press any key to close it.
if include '-D CUTE_ARCH_LDSM_SM75_ACTIVATED'
is our code test on sm76 architect ?