search

project-baize / baize-chatbot

Let ChatGPT teach your own chatbot in hours with a single GPU!
https://arxiv.org/abs/2304.01196
GNU General Public License v3.0
3.16k stars 282 forks source link

was trying this on gpt-j-6b but landed into error on finetuning #2

Open allthingssecurity opened 1 year ago

allthingssecurity commented 1 year ago

py", line 70, in set_module_8bit_tensor_to_device new_value = bnb.nn.Int8Params(new_value, requires_grad=False, has_fp16_weights=has_fp16_weights).to(device) File "/opt/conda/lib/python3.10/site-packages/bitsandbytes/nn/modules.py", line 196, in to return self.cuda(device) File "/opt/conda/lib/python3.10/site-packages/bitsandbytes/nn/modules.py", line 160, in cuda CB, CBt, SCB, SCBt, coo_tensorB = bnb.functional.double_quant(B) File "/opt/conda/lib/python3.10/site-packages/bitsandbytes/functional.py", line 1616, in double_quant row_stats, col_stats, nnz_row_ptr = get_colrow_absmax( File "/opt/conda/lib/python3.10/site-packages/bitsandbytes/functional.py", line 1505, in get_colrow_absmax lib.cget_col_row_stats(ptrA, ptrRowStats, ptrColStats, ptrNnzrows, ct.c_float(threshold), rows, cols) File "/opt/conda/lib/python3.10/ctypes/init.py", line 387, in getattr func = self.getitem(name) File "/opt/conda/lib/python3.10/ctypes/init.py", line 392, in getitem func = self._FuncPtr((name_or_ordinal, self)) AttributeError: /opt/conda/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cget_col_row_stats

Looks like bitsandbytes issue. Should I install it from source?

guoday commented 1 year ago

Have you tried this?

If bitsandbytes doesn't work, install it from source. Windows users can follow https://github.com/tloen/alpaca-lora/issues/17.