MPS flash attention support

Vaibhavs10 / insanely-fast-whisper

Apache License 2.0

7.76k stars 547 forks source link

Open dreampuf opened 7 months ago

dreampuf commented 7 months ago

Is it possible to integrate it with metal-flash-attention to enable flash attention in macOS?