Excessive disk space consumption? How much is required?

unslothai / unsloth

Finetune Llama 3.2, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 80% less memory

https://unsloth.ai

Apache License 2.0

18.1k stars 1.26k forks source link

Excessive disk space consumption? How much is required? #1159

Open LostRuins opened 3 weeks ago

LostRuins commented 3 weeks ago

Hi,

I've been trying to setup unsloth on WSL2 with the simple command pip install "unsloth[cu121-torch211] @ git+https://github.com/unslothai/unsloth.git"

It seems to be creating about 30+ GB of files on disk, often downloading packages multiple times.

It earlier printed the warning

INFO: pip is looking at multiple versions of numpy to determine which version is compatible with other requirements. This could take a while.

Is this normal? How much disk space is a complete install of Unsloth supposed to take up?

LostRuins commented 3 weeks ago

Update: finally got it working with conda. Total install was 13GB. pip is hosed.

I have a new issue though, following the github conda instructions, I get this error

Unsloth: We fixed a gradient accumulation bug, but it seems like you don't have the latest transformers version!
Please update transformers via:
`pip uninstall transformers -y && pip install --upgrade --no-cache-dir "git+https://github.com/huggingface/transformers.git"`

do the readme instructions need updating?

danielhanchen commented 3 weeks ago

@LostRuins Apologies - ye the installation files can get a bit large - for now updating is not yet necessary - it's an optional thing if you want to try the bleedy edge with our fix