search

zkkli / RepQ-ViT

[ICCV 2023] RepQ-ViT: Scale Reparameterization for Post-Training Quantization of Vision Transformers
Apache License 2.0
102 stars 8 forks source link

What does reconstruction mean in quantization. #8

Closed XA23i closed 4 months ago

XA23i commented 4 months ago

Hi, I notice in Table 1. there is "No REC" in column 3. And I wonder what it means and does it affects inference speed a lot. Thank you.

zkkli commented 4 months ago

Hi,

Reconstruction in this paper means whether or not reconstruction is needed in the process of obtaining a quantized model, e.g. layer-wise reconstruction or block-wise reconstruction. The fact that RepQ-ViT does not require reconstruction means that the model quantization process can be accomplished more quickly. Reconstruction has no effect on the inference process.

XA23i commented 4 months ago

Thank you for your quick reply. I've got it now.