The weight quantization of sd does not have any loss of precision (W8A16), but even if the activation value uses dynamic quantization (W8A8), it will have a huge impact on the quality of the generated picture.
In your paper, you mentioned that you used brecq to reconstruct the transformer block and resnet block respectively, but in my experiment, the reconstruction loss did not converge.
The weight quantization of sd does not have any loss of precision (W8A16), but even if the activation value uses dynamic quantization (W8A8), it will have a huge impact on the quality of the generated picture.
In your paper, you mentioned that you used brecq to reconstruct the transformer block and resnet block respectively, but in my experiment, the reconstruction loss did not converge.
Do you have any good suggestions?