deepglint / EasyQuant

EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activations.
Other
390 stars 70 forks source link

FaceDetection Task bad result? #5

Open xieydd opened 4 years ago

xieydd commented 4 years ago

Origin question is here https://github.com/deepglint/EasyQuant/issues/3#issuecomment-653895074 ; More clear:

  1. ncnn origin is ncnn origin post-training quantization TRT KLD function result, it almost same as origin float32 result.
  2. I will check my activation distribution
  3. I notice some layer get bad cosine distance val, you can see the below log

EQ.log

aitaoquanyi commented 4 years ago

Hi! Have you solved the problem?I'm going to use this quant framework, too.thanks

starimpact commented 4 years ago

the network should have bn layer.