IntelRealSense / librealsense

Intel® RealSense™ SDK
https://www.intelrealsense.com/
Apache License 2.0
7.6k stars 4.83k forks source link

Can I use yolo with Realsense camera? #9390

Closed dev-gw closed 3 years ago

dev-gw commented 3 years ago

Required Info
Camera Model { R200 / F200 / SR300 / ZR300 / D400 }
Firmware Version (Open RealSense Viewer --> Click info)
Operating System & Version {Win (8.1/10) / Linux (Ubuntu 14/16/17) / MacOS
Kernel Version (Linux Only) (e.g. 4.14.13)
Platform PC/Raspberry Pi/ NVIDIA Jetson / etc..
SDK Version { legacy / 2.<?>.<?> }
Language {C/C#/labview/nodejs/opencv/pcl/python/unity }
Segment {Robot/Smartphone/VR/AR/others }

Issue Description

Is it possible to do yolo v4 deepsort using an RGB camera and get the 3d coordinates of this tracked object? I plan to use the D455 and L515 camera.

MartyG-RealSense commented 3 years ago

Hi @kimgw-pl Using the D455 and L515 together in a multiple-camera arrangement would not be ideal if the cameras are going to be positioned so that their fields of view overlap, as infrared projection from the D455 could interfere with the L515's performance (as the L515 is sensitive to infrared). If the cameras have to be positioned close together then two D455 may work better if you have not yet purchased the cameras, as multiple 400 Series cameras do not interfere with each other.

YOLO can be used with RealSense cameras, yes. I do not have information about using RealSense with YOLOv4 DeepSort specifically.

A project using YOLOv4 and RealSense D435i is described in the paper at the link below.

https://www.proquest.com/docview/2532449285

This case provides advice from a RealSense team member at Intel Support regarding a query about YOLOv4, L515 and darknet:

https://support.intelrealsense.com/hc/en-us/community/posts/1500001173762-How-do-i-find-real-world-dimensions-of-an-object-using-L515-camera-and-darknet-


You can research the subject further by googling for "realsense" "yolov4" (including the quotation marks so that the search looks only for those exact terms).

MartyG-RealSense commented 3 years ago

Hi @kimgw-pl Do you require further assistance with this case, please? Thanks!

MartyG-RealSense commented 3 years ago

Case closed due to no further comments received.