Does the bias absorption part work now?

jakc4103 / DFQ

PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.

MIT License

258 stars 45 forks source link

Does the bias absorption part work now? #22

Closed liming312 closed 4 years ago

liming312 commented 4 years ago

Hi jakc4103, Thanks a lot for your excellent code! In previous issues, you mentioned the bias absorption part did not work. Did you mean the absorption part reduced accuracy or just made no difference? Does bias absorption part work now?

jakc4103 commented 4 years ago

The code is in dfq.py, but it did not work. I am not exactly sure why, probably related to different implementation of cross layer equalization comparing to quic/aimet (the official implementation).

jakc4103 commented 4 years ago

Closing issue. Feel free to reopen.