bitsandbytes-foundation / bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.
https://huggingface.co/docs/bitsandbytes/main/en/index
MIT License
6.14k stars 616 forks source link

Enable packaging for ROCm 6.2 #1367

Closed pnunna93 closed 2 weeks ago

pnunna93 commented 2 weeks ago

This PR enables ROCm packaging for 6.2 and also skips gemv_4bit_cpu tests as they are not yet enabled for ROCm.

CC: @Titus-von-Koeller @matthewdouglas @sunway513 @amathews-amd

github-actions[bot] commented 2 weeks ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.