search

lewes6369 / TensorRT-Yolov3

TensorRT for Yolov3
MIT License
489 stars 165 forks source link

calibration sample for int8 #7

Closed Yuuuuuuuuuuuuuuuuuummy closed 5 years ago

Yuuuuuuuuuuuuuuuuuummy commented 5 years ago

hi i wander what's the calibration sample for int8? Could you please tell me more details? Thanks a lot!!!!

lewes6369 commented 5 years ago

Hi,@Yuuuuuuuuuuuuuuuuuummy .The sample is the image dataset for the calibration, they are used to calculate the color distribution to make the Quantification more reasonable. The more various samples will make the less accuracy lose in int8 Quantification.

You can see more details on tensorRT web.