search

lewes6369 / TensorRT-Yolov3

TensorRT for Yolov3
MIT License
489 stars 165 forks source link

the size of engine file #66

Open guods opened 4 years ago

guods commented 4 years ago

I create the int8 engine file on GPU 1060, the size of engine file is only 60M, the detection result is very poor. But I create the int8 engine file on GPU TiTAN X, the size of engine file is only 500-600M, the detection result is good.

lewes6369 commented 4 years ago

Are they same calibrations data feeding? And are they the same tensorRT version? My int8 engine by 1060 is also the 60M. Maybe your TiTAN X is created as mode fp32? I am very interesting in your results. Please inform me.Thanks

guods commented 4 years ago

They are same calibrations data feeding and tensorRT version, my TITAN X is create as model int8. The detection results is good on your 1060 as model int8? The lager defferences of detetcion results between int8 and float16?

guods commented 4 years ago

I created the int8 engine in 1060 1070, 2060 and T4, The speed become more and more slower, the test results become more and more better, and the files become more and more bigger.

guods commented 4 years ago

when I create Int8 engine on TiTan X, the warings "Int8 supprot resquested on hardware without native Int8 support, preformance will be negatively affected ...", but the engine file is created and I test the images and the detetction results is good, the speed become faster. The defference of sizes of engine file between int8 and float16 is small. You meet the problem? Could I communicate with you through QQ? My QQ number is 1120444895. Looking forward to your addition。

guods commented 4 years ago

I have solved it, the accuracy is poor because I only used one image as the calibration data . The ImageNet need 500 images to calibrate the engine, the result become good when I used 100 images as the calibration data.