search

unslothai / unsloth

Finetune Llama 3.2, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
16.38k stars 1.13k forks source link

will it work on arm (aarch64) ? #587

Open zoldaten opened 4 months ago

zoldaten commented 4 months ago

hi ! i have installed unsloth on my raspberry pi 4b. but it needs torch with cuda. no cuda - no gain ?

danielhanchen commented 4 months ago

Ye sadly it must have a NVIDIA GPU