Hello! Here's another question about the log sqrt2 quantization.

zkkli / RepQ-ViT

[ICCV 2023] RepQ-ViT: Scale Reparameterization for Post-Training Quantization of Vision Transformers

Apache License 2.0

102 stars 8 forks source link

Hello! Here's another question about the log sqrt2 quantization. #2

Closed GoatWu closed 8 months ago

GoatWu commented 10 months ago

It seems that, after the log sqrt2 quantization, the activations have different scale parameters at different positions. So, in actual hardware, would it be impossible to perform subsequent matrix multiplications using integer form?