Closed PeiyanFlying closed 1 year ago
Please keep QIntLayerNorm
in ln
mode during the calibration step.
After the calibration, call model.model_quant()
and it will set QIntLayerNorm
to int
mode.
Ok, sure! That works!
Sorry about another question. I read the code and the function 'def get_MN(self, x)' in QIntLayerNorm. I am a little confused. What does the M and N represent? Does the N represent the 'a' in the Equation (8)? And the function 'def get_MN(self, x)' is the Equantion (11) ?
I appreciate your help. Thanks so much!
No. They are in the Eq. (31) - (32) on the appendix of the paper.
Ok, sure. Many thanks for your help!
您好,请问我将 QIntLayerNorm 中的 self.mode 设置成了 ‘int’。但是,程序报错,请问可能是哪里出现的问题呢?麻烦了!谢谢您!