2024/05/27 Update: Updated the record3d_unity_streaming
to version 1.4
. To be used with Record3D 1.10 and newer.
2022/08/16 Update: To be used with Record3D 1.7.2 and newer.
2021/07/28 Update: Added support for higher-quality LiDAR RGB streaming. Use this Unity demo with Record3D 1.6 or newer.
2021/03/15 Update: For playback of pre-recorded videos, visit the record3d_offline_unity_demo
2020/09/26 Update: Optimized the project for Unity 2019.4.11f1
2020/09/17 Update: Introduced LiDAR support
This demo shows how to use the Record3D app to stream Point Clouds from your iPhone/iPad with the TrueDepth camera into Unity VFX Graph in real-time.
Disclaimer: the demo is in pre-alpha state; in case of wider interest I can continue developing this project into a Unity Plugin.
This project contains a modified Particles VFX of Keijiro Takahashi which demonstrates how to integrate Record3D live streaming into an existing VFX Graph.
libusbmuxd-dev
package — should be installed on Ubuntu by default, no action needed)This demo depends on the C++ library record3d_unity_streaming
which you will either need to build yourself or download pre-built (available only for Windows and macOS, you will need to build it yourslef if you are running on Linux).
Only one dll
file is needed: record3d_unity_streaming.dll
. Make sure it is in PATH
— the easiest way is to copy the file into C:\Windows\System32
and/or into C:\Windows\SysWOW64
.
Similar to Windows, only one dylib
file is needed: librecord3d_unity_streaming.dylib
. Just copy it into /usr/local/lib/
(create the folder if it doesn't exist yet). Alternatively, you can export
it into DYLD_LIBRARY_PATH
.
The first time you open this project on a new computer, restart Unity and re-open the project (there is a Unity bug due to which you must 1) open this project in Unity, 2) close Unity and 3) re-open the project for it to work correctly). You don't need to do this on subsequent runs.
Open the LiveStreaming scene (Assets/LiveStreaming.unity
).
Connect your iPhone or iPad to your computer via USB cable. To make things easier, try having connected only single iOS device (if multiple iOS devices are connected, you can change the index of USB device in the "Device Index" property of the "Record 3D Stream" Script).
Open Record3D, go to the Settings tab and enable "USB Streaming Mode" (purchase required).
Go to the Record tab and press the circular red toggle button (you should see "Started, Waiting for Connection" message on your iPhone/iPad).
Press the "Play" button in Unity and wait.
Live stream should appear — you can now switch into the Scene tab to inspect the live stream.
You can contact me at support@record3d.app if you have any questions or encounter problems.