TiledTensor / TiledCUDA

TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.
MIT License
158 stars 10 forks source link

feat(examples): Add the Host side implementation of FlashAttention and pass Single Traversel FlashAttention correctness in CUDA side. #125

Closed KuangjuX closed 3 months ago