lyogavin / airllm

AirLLM 70B inference with single 4GB GPU

Apache License 2.0

4.03k stars 334 forks source link

Insuficient disk space #136

Open ulisesbussi opened 4 months ago

ulisesbussi commented 4 months ago

Was trying to work with AutoModel.from_pretrained("v2ray/Llama-3-70B") but the space in C:\Users\myuser.cache... was insuficient. So I was wondering if there was a way to change the location of the cache for the library. I've readed the code diagonally and didn't find an option

moming2k commented 4 months ago

I would like to know the default location as well. I am using MacOS.

moming2k commented 4 months ago

I found it in my home path .cache/huggingface/

I have moved this folder into my external harddisk and soft link this external harddisk folder to the original location.

Tdrinker commented 1 month ago

easy. You can do this:

Set custom cache directories and token

os.environ['HF_HOME'] = os.environ['TRANSFORMERS_CACHE'] = os.environ['HF_DATASETS_CACHE'] = os.environ['HF_MODULES_CACHE'] =

put the address to a location that you have enough space.