Research mode Sensor Streamer using Websockets and Background Tasks
Tools/StreamerVLC prepared to register and trigger an extended duration out-of-process sensor streaming background task on the Microsoft HoloLens, using HoloLensForCV.
Send sensor frames from the eight research mode sensors, or the rgb camera (to be tested), through a background task. Stream synchronised stereo pairs from the front left and right visible light cameras, using JSON, through websockets.
Send Robot Operating System (ROS) messages (or services - to be added) as JSON strings using a ROSBridge websocket-server ROS node.
It is possible to use the ROSBridge websocket server, additionally, to send data to a Unity app using ROS# https://github.com/siemens/ros-sharp . One can use a Python or C++ ROS node to subscribe to and process sensor data and send messages to a foreground Unity HoloLens app (, or any non-Unity app using websockets.)
The foreground StreamerVLC can be suspended on the HoloLens without hindering the background streamer, allowing an immersive app developed in Unity to run simultaneously, while utilising the research mode sensor streams.
msftclas
commented
4 years ago
Research mode Sensor Streamer using Websockets and Background Tasks Tools/StreamerVLC prepared to register and trigger an extended duration out-of-process sensor streaming background task on the Microsoft HoloLens, using HoloLensForCV.
Send sensor frames from the eight research mode sensors, or the rgb camera (to be tested), through a background task. Stream synchronised stereo pairs from the front left and right visible light cameras, using JSON, through websockets.
Send Robot Operating System (ROS) messages (or services - to be added) as JSON strings using a ROSBridge websocket-server ROS node.
It is possible to use the ROSBridge websocket server, additionally, to send data to a Unity app using ROS# https://github.com/siemens/ros-sharp . One can use a Python or C++ ROS node to subscribe to and process sensor data and send messages to a foreground Unity HoloLens app (, or any non-Unity app using websockets.)
The foreground StreamerVLC can be suspended on the HoloLens without hindering the background streamer, allowing an immersive app developed in Unity to run simultaneously, while utilising the research mode sensor streams.