Closed 17702513221 closed 3 years ago
Hi, this is only the input data type. The actual computation will be FP16 which you can see in performance increase. You can change the input data type if you need to, it is a parameter of the createEngine function.
I watch #define USE_FP16 ,but the model plan is TYPE_FP32