This application allows for streaming point clouds to a Unity application or to a HoloLens and rendering them. Together with our other application, LiveScan3D, it can be used for viewing 3D data captured in real time (for example for telepresence) or pre-recorded data.
You will find a short presentation of the application in the video below (click to go to YouTube):
First of all you will need to setup the following apps:
Once you have all the above open LiveScanServer, connect a client and open the live view window (it is the contents of that window that are streamed to Hololens). Alternatively, you can also use the LiveScanPlayer and play pre-recorded data. Next, start the Unity application on the same machine as the server, if everything is fine it should be working. If it is not working, let me know and I will try to fix it.
If you got this far, getting it to work on Hololens should be easy, just make sure you deploy the app using XAML UWP build type instead of D3D (this is required by the touch keyboard). Once you deploy and start the app on Hololens all you need to do is input the IP number of the server and you should see the point cloud. If there are issues try rebuilding NetworkCommunication in Release mode, the resulting dll files should be automatically copied to /Assets/Plugins/x86/
The scene can be moved, scaled and rotated around the Y axis, the modes are chosen using the following voice commands:
If you use this software in your research, then please use the following citation:
Kowalski, M.; Naruniec, J.; Daniluk, M.: "LiveScan3D: A Fast and Inexpensive 3D Data Acquisition System for Multiple Kinect v2 Sensors". in 3D Vision (3DV), 2015 International Conference on, Lyon, France, 2015