jdibenes / hl2ss

HoloLens 2 Sensor Streaming.
Other
185 stars 48 forks source link

Would it be possible to run the appxbundle in the background on the hololens? #29

Open Michelvl92 opened 1 year ago

Michelvl92 commented 1 year ago

Currently, this is not possible. Is this possible, and what would be the best way to do this?

I want to show a Unity application in the hololens 2 (the Unity application is currently running on an external computer that is rendering this unity view) and streamed to a viewer (that should be in the foreground). In the background, I want to run hl2ss server.

FlorianDirnberger commented 1 year ago

Did you find a solution so far, i would also be interested. Thanks

Birkenpapier commented 1 year ago

May I ask you to elaborate your request? Do you want to render the data in the background and then displaying on another machine?

manzoned commented 8 months ago

I would also be interested in this. I want to run the hl2ss app in the background to stream sensor data to python, send that data to unity via a socket, and then play the scene on the Hololens 2 via a Holographic Remote Player. For that to work both the hl2ss app and the holographic remote player would need to run simultaneously.

jdibenes commented 8 months ago

It seems it is not possible to run two holographic applications simultaneously. Here is an experimental 2D version of the appxbundle that can run alongside other apps: https://github.com/jdibenes/hl2ss/blob/main/etc/hl2ss_1.0.26.0_arm64_FLAT.appxbundle

manzoned commented 8 months ago

Thanks for sharing this. I can confirm that this 2D version can be run alongside other apps (e.g., Holographic Remoting Player).

However, I did notice some differences when running some of the sample codes in the viewer folder. For example, streaming the camera sensors works and plays, but the spatial input codes do not work properly/as with the original app bundle. The codes run, but the head, gaze and hand tracking do not provide proper values and are not projected onto the video frame.

zhangzhousuper commented 1 day ago

Any updates on this issue? Also interested, thx