A relevant paper, NeurIPS 2022

Efficient-ML / Awesome-Model-Quantization

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

1.84k stars 205 forks source link

A relevant paper, NeurIPS 2022 #31

Closed liuzechun closed 1 year ago

liuzechun commented 1 year ago

BiT: Robustly Binarized Multi-distilled Transformer

[NeurIPS] BiT: Robustly Binarized Multi-distilled Transformer. [bnn] [code] [42:star:]

liuzechun commented 1 year ago

And the code for this paper is released:

[CVPR] Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation. [qnn] [code] [59:star:]

liuzechun commented 1 year ago

And three other papers: 2022:

[ICML] SDQ: Stochastic Differentiable Quantization with Mixed Precision [qnn]

2021:

[ICML] How Do Adam and Training Strategies Help BNNs Optimization?. [bnn] [code] [48:star:]
[CVPR] S2-bnn: Bridging the gap between self-supervised real and 1-bit neural networks via guided distribution calibration [bnn] [code] [52:star:]

Thanks a lot for the efforts!

htqin commented 1 year ago

Hi Zechun, thanks a lot for your help! The repo is updated and welcomes any further suggestions :)