Closed KaifAhmad1 closed 6 months ago
HI @KaifAhmad1 ! This issue is a duplicate of https://github.com/huggingface/transformers/issues/29100 I think https://github.com/huggingface/transformers/issues/29100#issuecomment-1953346412 should fix it 🙏 I am closing this issue and we can discuss over in the transformers repo !
System Info
bitsandbytes = 0.42.0 OS = Windows 11 x64 cuda = 12.1 pip = 24.0 transformers = 4.37.2 GPU = Tesla T4
Reproduction
Expected behavior
It will return the output without raising any exception