Closed sambar1729 closed 1 year ago
I am running finetune on falcon-7b
$ falcontune finetune \ --model=falcon-7b \ --weights=tiiuae/falcon-7b \ --dataset=../data/alpaca_data_cleaned.json \ --data_type=alpaca \ --lora_out_dir=./falcon-7b-alpaca/ \ --mbatch_size=1 \ --batch_size=2 \ --epochs=3 \ --lr=3e-4 \ --cutoff_len=256 \ --lora_r=8 \ --lora_alpha=16 \ --lora_dropout=0.05 \ --warmup_steps=5 \ --save_steps=50 \ --save_total_limit=3 \ --logging_steps=5 \ --target_modules='["query_key_value"]'
getting error:
miniconda3/envs/falcontune/lib/python3.9/ctypes/__init__.py", line 382, in __init__ self._handle = _dlopen(self._name, mode) OSError: libcurand.so.10: cannot open shared object file: No such file or directory
GPU: NVIDIA Corporation GA104M [GeForce RTX 3080 Mobile / Max-Q 8GB/16GB] (rev a1)
removed and reinstalled cuda, and now this error does not seem to occur.
I am running finetune on falcon-7b
getting error:
GPU: NVIDIA Corporation GA104M [GeForce RTX 3080 Mobile / Max-Q 8GB/16GB] (rev a1)