search

axolotl-ai-cloud / axolotl

Go ahead and axolotl questions
https://axolotl-ai-cloud.github.io/axolotl/
Apache License 2.0
7.48k stars 808 forks source link

MLX Support #1119

Open fakerybakery opened 7 months ago

fakerybakery commented 7 months ago

Hi, It would be great to have MLX support in Axolotl. MLX has been shown to be able to quickly and efficiently finetune many LLMs, including 7B LLMs on consumer hardware. Thank you!

(edit: update)

winglian commented 7 months ago

These will be helpful

https://github.com/philipturner/metal-flash-attention

https://github.com/ml-explore/mlx/issues/129

fakerybakery commented 6 months ago

Since #1264 is merged, should I close this issue or are there plans to implement MLX support in the future (since MLX can be much faster)?