Does this model supports batch inference?

deepcam-cn / yolov5-face

YOLO5Face: Why Reinventing a Face Detector (https://arxiv.org/abs/2105.12931) ECCV Workshops 2022)

GNU General Public License v3.0

2.09k stars 500 forks source link

Does this model supports batch inference? #292

Open PavelPanjaya opened 2 months ago

PavelPanjaya commented 2 months ago

I'm working on integrating this model into a project and need to know if it supports batch inference. If it does, could you provide some guidance or examples on how to implement it? If not, are there any plans to add this feature in the future?

Thanks in advance for your help!

PrinceP commented 2 months ago

The onnx model can be changed to dynamic. https://github.com/PrinceP/tensorrt-cpp-for-onnx?tab=readme-ov-file#yolov5-face