update to 4-bit - Githubissues

agrocylo / bitsandbytes-rocm

8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs

MIT License

43 stars 5 forks source link

Open leandroroser opened 1 year ago

leandroroser commented 1 year ago

Hi, any plan to update to the new version with support for 4-bit?

Thanks, Leandro

lukedupin commented 4 months ago

I just tested this project and it worked with 4-bit: https://github.com/Lzy17/bitsandbytes-rocm

Is there any path to merge these 2 repos into the main bitsandbytes repo?