Could not load bitsandbytes native library: module 'jtorch.cuda' has no attribute 'get_device_capability'
Traceback (most recent call last):
File "/root/miniconda3/envs/peft/lib/python3.9/site-packages/bitsandbytes/cextension.py", line 109, in <module>
lib = get_native_library()
File "/root/miniconda3/envs/peft/lib/python3.9/site-packages/bitsandbytes/cextension.py", line 88, in get_native_library
cuda_specs = get_cuda_specs()
File "/root/miniconda3/envs/peft/lib/python3.9/site-packages/bitsandbytes/cuda_specs.py", line 38, in get_cuda_specs
highest_compute_capability=(get_compute_capabilities()[-1]),
File "/root/miniconda3/envs/peft/lib/python3.9/site-packages/bitsandbytes/cuda_specs.py", line 19, in get_compute_capabilities
return sorted(torch.cuda.get_device_capability(torch.cuda.device(i)) for i in range(torch.cuda.device_count()))
File "/root/miniconda3/envs/peft/lib/python3.9/site-packages/bitsandbytes/cuda_specs.py", line 19, in <genexpr>
return sorted(torch.cuda.get_device_capability(torch.cuda.device(i)) for i in range(torch.cuda.device_count()))
AttributeError: module 'jtorch.cuda' has no attribute 'get_device_capability'
CUDA Setup failed despite CUDA being available. Please run the following command to get more information:
python -m bitsandbytes
LDYang694
commented
2 days ago
好像和bitsandbytes库冲突了