search

ROCm / triton

Development repository for the Triton language and compiler
MIT License
89 stars 27 forks source link

Couple of FA optimizations #608

Closed vgokhale closed 2 months ago

vgokhale commented 3 months ago

Set SM scale multiplication to a constexpr. Minor asm improvement.

Changed acc scaling to adjust for softmax division to multiplication with reciprocal. ~10% perf improvement.