agrocylo / bitsandbytes-rocm

8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs
MIT License
43 stars 5 forks source link

How to use after compile #3

Open ccbadd opened 1 year ago

ccbadd commented 1 year ago

Sorry if this is a dumb question but I am trying to use this with oobabooga. I have compiled it fine and run "python setup.py install" without issue. The part I cant figure out is how to use this to replace the regular version used by oobabooga. Any assistance would be greatly appreciated.