bitsandbytes-foundation bitsandbytes issues

bitsandbytes-foundation / bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

https://huggingface.co/docs/bitsandbytes/main/en/index

MIT License

6.14k stars 616 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

[TESTS] Add global random seed for deterministic test

#1383 allrob23 opened 4 days ago
0
AdEMA NaN when loading from state_dict

#1382 darius-lam opened 5 days ago
0
Paged optimizer resuming from checkpoint - attributeError: 'int' object has no attribute 'cpu'

#1381 shivam15s opened 6 days ago
1
refine docs for multi-backend alpha release

#1380 Titus-von-Koeller closed 6 days ago
1
Fix optimizer support for Python <= 3.9

#1379 matthewdouglas closed 1 week ago
1
Release v44 not available for Mac

#1378 ACMCMC opened 1 week ago
2
Update pandas requirement from ~=2.2.2 to ~=2.2.3 in the major group

#1377 dependabot[bot] opened 1 week ago
1
Python 3.9 support broken in 0.44.0

#1376 Benzhaomin closed 1 week ago
0
chore: migrate config files to `pyproject.toml`

#1373 SauravMaheshkar opened 1 week ago
0
replace tl.libdevice.llrint with tl.extra.cuda.libdevice.rint

#1372 bjmsong opened 1 week ago
0
Model architecture is modified when I use BitsAndBytesConfig with default params

#1371 yunhao-tech opened 1 week ago
0
Release 0.44.0 does not belong to the current repository

#1370 ccoulombe closed 1 week ago
2
Add workflow to publish tagged releases to PyPI

#1369 matthewdouglas closed 1 week ago
1
Update pandas requirement from ~=2.2.2 to ~=2.2.3 in the major group

#1368 dependabot[bot] closed 1 week ago
2
Enable packaging for ROCm 6.2

#1367 pnunna93 closed 2 weeks ago
1
cpu benchmark

#1366 jiqing-feng closed 2 weeks ago
1
Change 8bit optimizer blocksize 2048->256; additional bf16 support

#1365 matthewdouglas closed 2 weeks ago
2
RuntimeError: CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasGemmEx

#1363 LukeLIN-web opened 2 weeks ago
1
Bump the minor-patch group with 3 updates

#1362 dependabot[bot] closed 2 weeks ago
0
Update matplotlib requirement from ~=3.9.1 to ~=3.9.2 in the major group

#1361 dependabot[bot] closed 2 weeks ago
0
Add AdEMAMix optimizer

#1360 matthewdouglas closed 2 weeks ago
1
Merge LoRA into 405B

#1359 junzhang-zj opened 3 weeks ago
4
check grad before using ipex

#1358 jiqing-feng closed 2 weeks ago
1
Nf4 grad

#1357 jiqing-feng closed 3 weeks ago
0
Lion Optimizer With Triton Kernel

#1356 lapp0 closed 3 weeks ago
1
cuda is available but import bnb error

#1355 ZeroneBo opened 3 weeks ago
2
Model not able to quantize

#1354 alielfilali01 opened 3 weeks ago
0
add CPU benchmark

#1353 jiqing-feng closed 2 weeks ago
1
docs: add internal reference to multi-backend guide

#1352 Titus-von-Koeller closed 2 weeks ago
1
docs: add internal reference to multi-backend guide

#1351 Titus-von-Koeller closed 3 weeks ago
1
Bug when using optimizer LAMB 32bits

#1350 FrsECM opened 1 month ago
0
fix nf4 memory issue by init op_context in forward

#1349 jiqing-feng closed 3 weeks ago
3
Nf4 reload

#1348 jiqing-feng closed 1 month ago
1
Torch autograd support for dequantize methods

#1347 yaldashbz opened 1 month ago
0
Bump the minor-patch group with 2 updates

#1346 dependabot[bot] closed 4 weeks ago
2
Update matplotlib requirement from ~=3.9.1 to ~=3.9.2 in the major group

#1345 dependabot[bot] closed 4 weeks ago
2
Add `move_to_device` kwarg to the optimizer's `load_state_dict`

#1344 koute closed 2 weeks ago
1
Cannot load decoder.lm_head.weight when loading 4 bit quantized model using VisionEncoderDecoder.from_pretrained

#1343 AditiJain14 opened 1 month ago
1
quantize_4bit/dequantize_4bit gives wrong output on in-contiguous tensor

#1342 chenqianfzh opened 1 month ago
0
Update for VS2022 17.11 compatibility with CUDA < 12.4

#1341 matthewdouglas closed 4 weeks ago
0
rm warn for multi backend

#1336 jiqing-feng closed 1 month ago
0
Bump the minor-patch group with 2 updates

#1335 dependabot[bot] closed 1 month ago
1
Update matplotlib requirement from ~=3.9.1 to ~=3.9.2 in the major group

#1334 dependabot[bot] closed 1 month ago
1
Update diagnostic functions for ROCm

#1333 pnunna93 closed 3 weeks ago
5
Linear8bitLt can not be moved back to cpu

#1332 Nerogar opened 1 month ago
0
Pretrained Causal LM cannot be loaded in 4bit/8bit

#1331 adrienchaton opened 1 month ago
6
Enable certain CUDA kernels to accept specified cuda stream

#1330 jeejeelee closed 1 month ago
8
Any plan to support block size 32?

#1329 lllyasviel opened 1 month ago
4
Cuda source cleanup , refactor and fixes

#1328 abhilash1910 closed 1 month ago
4
RuntimeError: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback):

#1327 pradeep10kumar opened 1 month ago
1