Support extract_outliers, quantize_4bit and dequantize_4bit with Device Abstraction PR.

ROCm / bitsandbytes

8-bit CUDA functions for PyTorch

MIT License

38 stars 4 forks source link

Closed lcskrishna closed 6 months ago

lcskrishna commented 6 months ago

For the test failures - this PR needs to be cherry-picked: https://github.com/ROCm/bitsandbytes/pull/21

pnunna93 commented 6 months ago

BitsAndBytes_UT_summary_05_06.log

For the test failures - this PR needs to be cherry-picked: #21

Just pushed the change into device_abstraction branch, please rebase and check

lcskrishna commented 6 months ago

Latest unit tests runs: all successful after cherry-picking PRs. BitsAndBytes_UT_summary_05_07.log

lcskrishna commented 6 months ago