search

unslothai / unsloth

Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
15.2k stars 1.02k forks source link

Getting `OSError: [Errno 28] No space left on device` on Kaggle when saving #534

Open brand17 opened 3 months ago

brand17 commented 3 months ago

I try your example Kaggle Mistral 7b Unsloth notebook. The only thing I changed - I changed Flase to True in this line: if True: model.save_pretrained_merged("model", tokenizer, save_method = "merged_16bit",)

As a result I am always getting error: OSError: [Errno 28] No space left on device.

Please see here https://www.kaggle.com/code/brand17/kaggle-mistral-7b-unsloth-notebook/log?scriptVersionId=179659896

danielhanchen commented 3 months ago

Unfortunately Kaggle has 20GB of disk space - I would save and upload LoRA / QLoRA adapters, then load them in Google Colab to convert to 16bit