get "Wrong" error when I convert to yolo4_fp16.rt

ceccocats / tkDNN

Deep neural network library and toolkit to do high performace inference on NVIDIA jetson platforms

GNU General Public License v2.0

718 stars 209 forks source link

Closed younger-diao closed 3 years ago

younger-diao commented 3 years ago

There is not any wrong when I convert to yolo4_fp32.rt,but get "Wrong" error when I convert to yolo4_fp16.rt. wrong

younger-diao commented 3 years ago

Although there are some wrongs during converting to yolo4_fp16.rt, it is normal by testing the yolo4_fp16.rt.

mive93 commented 3 years ago

It is totally normal, you are quantizing, so you have small errors. However, the results are very fine (in all my experience).

younger-diao commented 3 years ago

OK. I got it. Thanks a lot!