TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.
148
stars
10
forks
source link
feat(examples): Add the Host side implementation of FlashAttention and pass Single Traversel FlashAttention correctness in CUDA side. #125
Closed
KuangjuX closed 2 months ago