issues
search
ModelTC
/
llmc
This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".
https://arxiv.org/abs/2405.06001
Apache License 2.0
220
stars
26
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Update README_zh.md
#91
Harahan
closed
2 days ago
0
fix README
#90
Harahan
closed
2 days ago
0
fix readme
#89
Harahan
closed
2 days ago
0
Update README_ja.md
#88
Harahan
closed
2 days ago
0
Update README_zh.md
#87
Harahan
closed
2 days ago
0
Update README.md
#86
Harahan
closed
2 days ago
0
Update README_zh.md
#85
Harahan
closed
2 days ago
0
fix README
#84
Harahan
closed
2 days ago
0
Update doc
#83
gushiqiao
closed
2 days ago
0
Update doc
#82
gushiqiao
closed
2 days ago
0
Fix doc bug
#81
gushiqiao
closed
2 days ago
0
Fix doc bug
#80
gushiqiao
closed
2 days ago
0
Fix doc bug
#79
gushiqiao
closed
2 days ago
0
Fix doc bug
#78
gushiqiao
closed
2 days ago
0
Update vllm.md
#77
gushiqiao
closed
2 days ago
0
Fix doc bug
#76
gushiqiao
closed
2 days ago
0
Update doc
#75
gushiqiao
closed
2 days ago
0
Update backend/best practice docs
#74
gushiqiao
closed
2 days ago
0
Wanda OOM to be fixed
#73
guanchenl
opened
5 days ago
1
Update step_1_awq.yml
#72
gushiqiao
closed
5 days ago
0
Update step_1_awq.yml
#71
llmc-reviewer
closed
5 days ago
0
Format config and add vllm backend
#70
gushiqiao
closed
5 days ago
0
support max_num_workers in opencompass
#69
helloyongyang
closed
6 days ago
0
Update module_utils.py
#68
gushiqiao
closed
6 days ago
0
Roll back tp
#67
gushiqiao
closed
6 days ago
0
fix tp bug
#66
helloyongyang
closed
6 days ago
0
lightllm部署推理问题
#65
lzd19981105
opened
1 week ago
1
update doc and readme
#64
helloyongyang
closed
1 week ago
0
Yongyang
#63
helloyongyang
closed
1 week ago
0
update doc
#62
helloyongyang
closed
1 week ago
0
update docs
#61
helloyongyang
closed
1 week ago
0
Dev
#60
helloyongyang
closed
1 week ago
0
support opencompass eval
#59
helloyongyang
closed
1 week ago
0
awq_llama supports simulated TP
#58
SmudgedWings
closed
1 week ago
0
fail to run awq+omniquart on qwen2-7b
#57
gloritygithub11
opened
1 week ago
5
fail to start awq quantized model with lightllm on qwen2-7b-instruct
#56
gloritygithub11
opened
1 week ago
10
fail to run awq on qwen2-7b-instruct
#55
gloritygithub11
closed
2 weeks ago
2
fix tokenizer in lm-eval
#54
Harahan
closed
2 weeks ago
0
Fix bugs for pass ci
#53
gushiqiao
closed
2 weeks ago
0
Update cpu.txt
#52
llmc-reviewer
closed
2 weeks ago
0
support InternOmni for audio-vision-language model
#51
helloyongyang
closed
2 weeks ago
0
Fix GPTQ bugs and Add eval/vis feature
#50
gushiqiao
closed
2 weeks ago
0
fix ln_fc fuse && support 128g for abitrary shape
#49
Harahan
closed
2 weeks ago
0
Fix real_quant zp bug
#48
gushiqiao
closed
2 weeks ago
0
add some vlm models
#47
helloyongyang
closed
2 weeks ago
0
fix random port generation
#46
helloyongyang
closed
2 weeks ago
0
save_fix_json
#45
Harahan
closed
2 weeks ago
0
fix json save
#44
Harahan
closed
2 weeks ago
0
Update requirements
#43
Harahan
closed
2 weeks ago
0
update requirements
#42
Harahan
closed
2 weeks ago
0
Next