marcoslucianops / DeepStream-Yolo

NVIDIA DeepStream SDK 7.0 / 6.4 / 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models
MIT License
1.38k stars 343 forks source link

Adding image fusion model as primary inference and yolov5 as secondary detector. #550

Open faizan1234567 opened 1 week ago

faizan1234567 commented 1 week ago

Thank you for the wonderful work.

I am using yolov5 as an object detection model following image fusion. I have infrared and optical input streams, the image fusion model (in this case TarDAL takes two frames as input i.e. infrared and RGB and generates a fused frame from them. Therefore, at output I am getting one stream from the fusion model. After fusing, the next step is to detect objects from the fused frame using yolov5 or any other detector. You have implemented yolo variants on Jetson and GPU, how can I incorporate image fusion as a primary inference. What modifications would you suggest?

Also I was running NVIDIA deepstream python apps, the deepstream_test1 runs successfully and detects object. I am not sure how can I use yolov5 model with it to detect object.