Here is the dummy template to port CUDA kernels. It's very naïve but should be okay for now.
There is a script to setup cudatoolkit and such and need some adjustements to make it terminal agnostic
TODO:
Add cudacheckerror
Create dev & release env (where the cuda kernels are compiled when doing pip install -e, cf gptq repo for inspiration)
@abourramouss @xrsrke
Here is the dummy template to port CUDA kernels. It's very naïve but should be okay for now. There is a script to setup cudatoolkit and such and need some adjustements to make it terminal agnostic
pip install -e, cf gptq repo for inspiration)