Currently, it doesn’t work on Macs with M1/M2/M3 Silicon chips because the bitsandbytes module on Mac only goes up to version 0.42, which generates the following error:
'UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
warn("The installed version of bitsandbytes was compiled without GPU support. "
'NoneType' object has no attribute 'cadam32bit_grad_fp32'.
This issue has been fixed in later versions of bitsandbytes, but those are only available for Windows and Linux. I hope they find a solution for Mac soon."
Currently, it doesn’t work on Macs with M1/M2/M3 Silicon chips because the bitsandbytes module on Mac only goes up to version 0.42, which generates the following error: 'UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable. warn("The installed version of bitsandbytes was compiled without GPU support. " 'NoneType' object has no attribute 'cadam32bit_grad_fp32'.
This issue has been fixed in later versions of bitsandbytes, but those are only available for Windows and Linux. I hope they find a solution for Mac soon."