Unlike conventional symmetric weight quantization, I found that StatQ will let rounded integer weight add a term (+ 0.5), This item may cause the StatQ not to be actually deployed on hardware.
If we remove the -0.5 and +0.5 terms, the integer value of the weight will have an extra value, that is, 2**(bit - 1) -1. How do you modify this formula and achieve the same performance?
Unlike conventional symmetric weight quantization, I found that StatQ will let rounded integer weight add a term (+ 0.5), This item may cause the StatQ not to be actually deployed on hardware.
If we remove the -0.5 and +0.5 terms, the integer value of the weight will have an extra value, that is, 2**(bit - 1) -1. How do you modify this formula and achieve the same performance?