IntelRealSense / librealsense

Intel® RealSense™ SDK
https://www.intelrealsense.com/
Apache License 2.0
7.53k stars 4.81k forks source link

Computing power needed #7975

Closed oscarthorn closed 3 years ago

oscarthorn commented 3 years ago

Hi!

What is the cost in terms of processing power to get depth data from the D455? In terms of CPU? In terms of GPU (if needed)?

We are currently working on a embedded system (based on Xavier NX) and so we don't have much computing power to spare. Currently we are using the ZED2 but since the D455 seems to have some internal processing power we are wondering if it would reduce the load on the host compared to the ZED?

MartyG-RealSense commented 3 years ago

Hi @oscarthorn The 400 Series cameras have a Vision Processor D4 that performs processing work on captured camera data before sending it to the computer instead of doing all the work on the computer's CPU and GPU. This enables the 400 Series to run on low-specification, low power computing equipment.

The company Stemmer Imaging have a document on their site that provides more details about the D4.

https://www.stemmer-imaging.com/media/uploads/cameras/13/136603-Intel-RealSense-D4-Vision-Processor-Brochure.pdf

RealSense also supports CUDA optimization on devices with an Nvidia GPU such as Jetson.

In regard to an example of a low-spec and low-power configuration that has been used with RealSense, Raspberry Pi Zero can act as a minimum-spec reference. The 400 Series can work with any Intel or Arm processor though and is extremely flexible in regard to the hardware that it can be paired with.

https://www.raspberrypi.org/products/raspberry-pi-zero/

oscarthorn commented 3 years ago

Thanks for the quick answer, seems promising!

agrunnet commented 3 years ago

@oscarthorn yes I want to second what Marty said. The answer is “basically zero load on host CPU” because all depth processing happens on embedded ASIC. We have examples of full applications that run to read depth at 848x480 at 90fps, and track finger locations, for example, with CPU load for whole app being less than 5%. No GPU required.

That being said of course you can add processing to do more things, such as extra post processing.

MartyG-RealSense commented 3 years ago

Hi @oscarthorn Do you require further assistance with this case, please? Thanks!

oscarthorn commented 3 years ago

No, thanks for the help!

MartyG-RealSense commented 3 years ago

Thanks very much @oscarthorn for the update :)