Multi camera tracking from a single host PC

[cmdrogogov]

Apologies if this question has already been covered- I've read up over the past week and couldn't find much that directly addresses them;

Is it possible to run an OPT multi-camera setup from one host only? I am working on this as a personal project, and trying to avoid the expense of implementing a network and having multiple GPU-capable hosts. Three Jetson units, which seem to be as cheap as it's possible to get for OPT's requirements, would set me back nearly $1200, for instance. Running a Jetson Nano might be a better plan, but I can't find much information on setting up OPT on this device, and whether it would be performant, and whilst implementing a WiFi network would be easy for hosts, I'm fuzzy on how much network bandwidth is required per host.

So; Is it possible to run three Realsense cameras (A d415 and two D435's) from a single host?

• The D415 is currently functioning reliably with a 25ft active extender cable terminating in a powered USB 3.0 hub. There are occasional errors requiring a hardware reset when terminating the ROS processes, but those also occur with shorter cables, and might be indicative of a different issue.
• The two D435's (which I have not pulled the trigger on yet) would be connected to a new gen2 Orico powered hub
• The hub would connected to the host machine via a 3.1 Gen 2 USB C port capable of handling 10gbps
• This should satisfy the necessary bandwidth requirements.
• One D435 would run over a USB-Fiber extension cable to get the necessary distance.

The rig would to cover a square area of approximately 20ftx20ft.

I suspect that receiving 15gbps of data might require a beefier host for reasonable framerates, but I'm a little unclear as to how much this would stress a single host.

The data would be passed from this host to another machine hosting a Touchdesigner instance, but that host would be occupied with vfx processing and wouldn't be available to host a camera.

[MikoyChinese]

All you need just publish all camera data from a single host, if you need it, here some tips for you about how to run multi Resense devices.

Here the OpenPtrack V2:

1. Publish camera data(color and depth). eg: Kinetic v2, Realsense D400. How to publish these devices in ros check the official website.

2. Detection Node recived the camera datas which are already transform to the same world coordinate.(Check camera matrix).

3. Analyze the data, and handle it to get your own results.

[jburkeucla]

@cmdrogogov We have done this. @bsubbaraman can you please provide some pointers to info needed for multiple cameras on the same host?

[bsubbaraman]

To run >1 of the same imager type on a single host: you can configure OpenPTrack as usual, but when you create the files for multi-camera calibration, add the serial number of each imager as well.

While I have run 2 Kinectv2 from the same host, I haven't run >1 RealSense from the same host before (simply because I hadn't had access to >1 RealSense at one time). However, running multiple RealSense was confirmed to work from one of our users some time ago- I can't find the thread it was mentioned in now, but I'll link it to this comment when I can find it.