issues
search
Cornell-RelaxML
/
QuIP
Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"
338
stars
31
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
will it support group quant
#14
oreo0906
opened
1 month ago
1
gptq reorder canceled in quip?
#13
chenzx921020
opened
5 months ago
1
Multi gpu
#12
harshaUwm163
closed
6 months ago
0
Why only class Quant3Linear(nn.Module)? Does this work for 2bit, 3bit, and 4bit? I understand it is only for bit3 . Thanks
#11
yanni-code
closed
9 months ago
1
4bit or 2bit quantization model saved is fp 16, I am confused。Thank you
#10
yanni-code
closed
9 months ago
1
Thank you
#9
yanni-code
closed
10 months ago
0
support for llama
#8
Ottovonxu
closed
10 months ago
1
Do we still need to store U, V for each W
#7
xwuShirley
closed
11 months ago
2
group-size for quip
#6
xwuShirley
closed
1 year ago
1
error computing is not correct of covariant of pre and post process
#5
ozzzp
opened
1 year ago
1
How to use quantized model on inference
#4
yachty66
opened
1 year ago
1
Fix typo in README.md
#3
eltociear
closed
1 year ago
1
Evaluation on LLama
#2
NicoNico6
closed
1 year ago
4
fix typos
#1
yaohuicai
closed
1 year ago
1