how to use FP16 in demo?

YonghaoHe / LFFD-A-Light-and-Fast-Face-Detector-for-Edge-Devices

A light and fast one class detection framework for edge devices. We provide face detector, head detector, pedestrian detector, vehicle detector......

MIT License

1.32k stars 329 forks source link

how to use FP16 in demo? #19

Closed brucelee78 closed 3 years ago

brucelee78 commented 5 years ago

Hi,thank you to open your code! I use the demo in face_detection,on NVIDIA Jetson TX2, but the inference time is 70+ ms(640*480), I read your Readme.md file that inference time is 31.46ms(31.79FPS) on NVIDIA Jetson TX2，I think，I use the demo code probility works on FP32, so I want to know that how to use FP16 in your demo on NVIDIA Jetson TX2! thx

YonghaoHe commented 5 years ago

@brucelee78 We work on FP32 too. The latency is evaluated using TensorRT. Please check code in inference_speed_evaluation.

YonghaoHe commented 3 years ago

@brucelee78 We have released LFD, have a try!