Closed jimmieliu closed 9 months ago
Previously, if you quantize a model with pre-trained parameter, the bias parameters in Linear will be lost, and you will get a all-zero bias. 修复quantize时候丢掉模型Linear的bias的问题。
@Sleepychord Does this bug exist? Whether this is the real problem of quantizing a ViT?
Thank you for your catching this bug!
you are welcome, and thank you all for your great works :)
Previously, if you quantize a model with pre-trained parameter, the bias parameters in Linear will be lost, and you will get a all-zero bias. 修复quantize时候丢掉模型Linear的bias的问题。