IntelRealSense / librealsense

Intel® RealSense™ SDK
https://www.intelrealsense.com/
Apache License 2.0
7.63k stars 4.83k forks source link

Are there any resources or documentation available on how to use the Intel RealSense cameras (D455, D405) with Unity’s VFX Graph? #13511

Open polygolina opened 1 week ago

polygolina commented 1 week ago

Required Info
Camera Model D455, D405
Firmware Version 5.16.01
Operating System & Version Win (10)
Kernel Version (Linux Only) -
Platform PC
SDK Version legacy / 2.55.1
Language unity
Segment VFX

Issue Description

I’m interested in implementing these cameras within the VFX Graph in Unity but am finding it quite challenging. I tested Keijiro’s VFX project, but unfortunately, both cameras aren’t being recognized (https://github.com/IntelRealSense/librealsense/issues/10836). I’ve also tried combining the SDK with Keijiro’s project in a new project, but this didn’t work either.

I’d be very grateful for any tips or links to documented projects that could help me achieve this. Also, if possible, could you advise on which of the camera output (texture stream? profiles) would work best to integrate into the VFX Graph?

Thank you very much for any assistance!

MartyG-RealSense commented 1 week ago

Hi @polygolina There is not any further information available about the VFX Graph project or the best stream / profile configuration to use with it, unfortunately. The default stream profile will likely work fine though.

In regard to the non-detection of your cameras, the age of Keijiro’s project pre-dates the release of the D455 and D405. Support for D455 was introduced in SDK 2.38.1 and D405 in 2.51.1.

The project may work if you delete the RealSenseSDK2.0 folder in the project (which looks as though it is the very old SDK version 2.22) and replace it with a current version of the RealSenseSDK2.0 folder.

The easiest way to do this may be, once the old SDK folder has been deleted, to import into Unity the Intel.RealSense.unitypackage file from the 'Assets' file list at the bottom of the page at the link below to install the 2.55.1 version of the Unity wrapper into the Keijiro project.

https://github.com/IntelRealSense/librealsense/releases/tag/v2.55.1

image

I note that you mention "combining the SDK with Keijiro’s project in a new project". Have you already tried adding the latest SDK in your new project, please?