About PTQ int8 optimization

deepcam-cn / yolov5-face

YOLO5Face: Why Reinventing a Face Detector (https://arxiv.org/abs/2105.12931) ECCV Workshops 2022)

GNU General Public License v3.0

2.06k stars 497 forks source link

About PTQ int8 optimization #158

Open neoragex2002 opened 2 years ago

neoragex2002 commented 2 years ago

Hi, guys,

Is that possible to apply the ptq int8 optimizations on yolov5face's torch2trt?

I tried to add the supports of int8 optimization by using widerface val-dataset for calibrations and compare it with fp16-only optimization, but found nearly-zero performance gains. Is my result correct?

Any help would be appreciated!