search

h2oai / h2o-llmstudio

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
https://h2o.ai
Apache License 2.0
3.9k stars 402 forks source link

[FEATURE] More options for attention implementation #767

Closed psinger closed 1 month ago

psinger commented 2 months ago

🚀 Feature

Add more options for choosing attention implementation:

pascal-pfeiffer commented 1 month ago

May be even more interesting now with FA3: https://github.com/Dao-AILab/flash-attention?tab=readme-ov-file#flashattention-3-beta-release