unslothai / unsloth

Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
14.42k stars 951 forks source link

Does Alpaca + Gemma2 9b finetuning support Ollama? #726

Open finnbusse opened 1 month ago

finnbusse commented 1 month ago

Does it work, if I train Gemma 2 with my dataset, push it to Hugging Face and then download the GGUF-file to import it into Ollama?

danielhanchen commented 1 month ago

Yep it should function!