feat: Triton flash attention backend for ROCm - Githubissues

PygmalionAI / aphrodite-engine

PygmalionAI's large-scale inference engine

https://pygmalion.chat

GNU Affero General Public License v3.0

606 stars 78 forks source link

feat: Triton flash attention backend for ROCm #407

Closed AlpinDale closed 1 month ago