unslothai / unsloth

Finetune Llama 3.2, Mistral, Phi, Qwen & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
17.79k stars 1.24k forks source link

Support for Aya-23-8B #761

Open ashrafulparan2 opened 3 months ago

ashrafulparan2 commented 3 months ago

NotImplementedError: Unsloth: ashrafulparan/Aya-23-8b-4bit-bnb not supported yet! Make an issue to https://github.com/unslothai/unsloth!

danielhanchen commented 3 months ago

All model support will make this work!