search

OpenBMB / cpm_kernels

Apache License 2.0
23 stars 7 forks source link

Need support for ROCm/hip on AMD GPU #5

Open Looong01 opened 1 year ago

Looong01 commented 1 year ago

cudart -> hiprt 

 File "/home/loong/anaconda3/envs/PyTorch/lib/python3.10/site-packages/cpm_kernels/kernels/base.py", line 48, in __call__
    func = self._prepare_func()
  File "/home/loong/anaconda3/envs/PyTorch/lib/python3.10/site-packages/cpm_kernels/kernels/base.py", line 36, in _prepare_func
    curr_device = cudart.cudaGetDevice()
  File "/home/loong/anaconda3/envs/PyTorch/lib/python3.10/site-packages/cpm_kernels/library/base.py", line 72, in wrapper
    raise RuntimeError("Library %s is not initialized" % self.__name)
RuntimeError: Library cudart is not initialized
lypenghao commented 1 year ago

我遇到了同样的问题 另外一个库 ROCm5.2.5 也不支持 bitsandbytes