search

wang-xinyu / tensorrtx

Implementation of popular deep learning networks with TensorRT network definition API
MIT License
6.98k stars 1.77k forks source link

Yolov5 v6.0 inference with FP16 #1540

Open anthai0908 opened 5 months ago

anthai0908 commented 5 months ago

Env

About this repo

For image preprocessing for inference, how can I turn my input image into FP16 format for faster inference

wang-xinyu commented 4 months ago

For v6.0 tag, it is using FP16 inference by default. This FP16 means the model/weights/inference is FP16, but the input tensor is still FP32, which is a regular setup.

https://github.com/wang-xinyu/tensorrtx/blob/b91b15d3e763c3d668ca18ebab5a1d633a21ecfa/yolov5/yolov5.cpp#L11

stale[bot] commented 2 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.