Closed guods closed 4 years ago
@guods Hi,What is your platform?PC or nano?windows or ubuntu?And the INT8 precision need the calibration images.
@guods I just test the inference time on my platform(WIN10,GTX1050),the inference time is 200ms(FP32) and 60ms(INT8). How long is the calculation time on your platform?
@enazoe yolov3-416x416 | gtx1050 | INT8 | 25ms yolov3-416x416 | gtx1050 | FLOAT32 | 50ms the result on Ubuntu? INT8: the inference time on my platform is 17ms, the time of detection one image is 23ms.
@guods no ,the time in readme.md is 416416 model, 200ms(FP32) and 60ms(INT8)is 608608 , the detect function include the cv::resize method and other image preprocessing.And the opencv resize() method is slow at first call . In my mind, the tian x is more power to get low differnece detect time . And you can use for loop test one image more times.
oh,try yolov3 608x608 model ?,I get a different time of int8 and fp32.
@guods do not average the detect time and print per loop time
I try yolov3 608x608 model,I get a different time of int8 and fp32 (difference 2ms2~3ms) on TiTan X; on 940mx: difference 10ms
Thanks for your reply, I will try else GPU and PC.
Thank you for your work, but there are some questions. The speed of the three inference precison (INT8 FP16 FP32) for the one model is the same, I only modify the config.inference_precison?