search

ROCm / flash-attention

Fast and memory-efficient exact attention
BSD 3-Clause "New" or "Revised" License
142 stars 46 forks source link

enable packed layouts and all configs #72

Closed micmelesse closed 3 months ago

micmelesse commented 3 months ago

enable qkvpacked & kvpacked varients of fwd and fwd_varlen