search

TrojanXu / yolov5-tensorrt

A tensorrt implementation of yolov5: https://github.com/ultralytics/yolov5
Apache License 2.0
190 stars 46 forks source link

TRT Inference script for batch size > 1 #34

Open makaveli10 opened 4 years ago

makaveli10 commented 4 years ago

I was wondering if you have any references for inference on a TensorRT engine with batch size > 1. Any help would be great! Thanks

TrojanXu commented 4 years ago

I also implemented the batching code for trt, just small modifications. It should work with specified packages versions.