search

unslothai / unsloth

Finetune Llama 3.2, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
16.49k stars 1.14k forks source link

gemma2 support #701

Open win4r opened 3 months ago

win4r commented 3 months ago

gemma2 support

👉👉👉我的哔哩哔哩频道 👉👉👉我的YouTube频道

danielhanchen commented 3 months ago

Working on it!!!

danielhanchen commented 3 months ago

Finally got it to work! Try updating Unsloth via (for local machines - Colab and Kaggle are ok with a refresh)

pip uninstall unsloth -y
pip install --upgrade --force-reinstall --no-cache-dir git+https://github.com/unslothai/unsloth.git

We also have a Colab notebook for Gemma 2: https://colab.research.google.com/drive/1vIrqH5uYDQwsJ4-OO3DErvuv4pBgVwk4?usp=sharing