search

bitsandbytes-foundation / bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.
https://huggingface.co/docs/bitsandbytes/main/en/index
MIT License
6.31k stars 634 forks source link

Nf4 grad #1357

Closed jiqing-feng closed 2 months ago

jiqing-feng commented 2 months ago

Hi @Titus-von-Koeller , please merge this PR for avoiding use ipex when tensor requires grad.