search

unslothai / unsloth

Finetune Llama 3.2, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
17.41k stars 1.21k forks source link

Does unsloth support token classification using phi3? #894

Open xinyudong93 opened 2 months ago

danielhanchen commented 2 months ago

In theory yes - you'll need to delete the Causal LM Head, and replace it with a Classification head manually