issues
search
htqin
/
IR-QLoRA
[ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retention
53
stars
3
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
How To Create The Needed Conda Environment?
#7
EmiyaArcher233
opened
2 weeks ago
0
Does it support LLAMA3-8B-INSTRUCT or Qwen2-7b-instruct?
#6
LiMa-cas
opened
1 month ago
0
QLORA VS PTQ
#5
LiMa-cas
opened
1 month ago
0
RuntimeError: The size of tensor a (2048) must match the size of tensor b (1024) at non-singleton dimension 0
#4
ClancyCC
opened
1 month ago
0
AttributeError: 'IRQLoraLinear4bit' object has no attribute 'base_layer'. Did you mean: 'update_layer'
#3
xiaoleyang2018
opened
6 months ago
1
IR-QLoRA with Integer Quantizer
#2
Xingyu-Zheng
closed
6 months ago
0
Code for int4
#1
hoagy-davis-digges
closed
6 months ago
3