Closed psinger closed 1 month ago
Add more options for choosing attention implementation:
May be even more interesting now with FA3: https://github.com/Dao-AILab/flash-attention?tab=readme-ov-file#flashattention-3-beta-release
🚀 Feature
Add more options for choosing attention implementation: