unslothai / unsloth

Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
16.21k stars 1.11k forks source link

Support for Cohere 23 models #526

Open AlirezaF80 opened 4 months ago

AlirezaF80 commented 4 months ago

It's a really great multilingual model. Would love being able to train it faster with Unsloth! https://huggingface.co/CohereForAI/aya-23-8B https://huggingface.co/CohereForAI/aya-23-35B

shimmyshimmer commented 4 months ago

We're working on adding all model support!

katebsaber96 commented 4 months ago

I love to see this rolling. It is much needed for underrepresented languages like Persian.

danielhanchen commented 4 months ago

Working on all model support!

Qualzz commented 3 months ago

I'm confused, is this possible already ? Since the notebook it's written " # Choose ANY! eg teknium/OpenHermes-2.5-Mistral-7B "

danielhanchen commented 3 months ago

@Qualzz Not yet sorry - but technically Unsloth will check, and will error out if it doesnt worjk