microsoft / MixedRealityCompanionKit

This is a MixedRealityToolkit style repository for code bits and components that may not run directly on Microsoft HoloLens or immersive headsets but instead pair with them to build experiences.
MIT License
591 stars 286 forks source link

No holograms in Compositor #308

Closed hosulik closed 5 years ago

hosulik commented 5 years ago

Hello all, we tryied to run Spectator View pro with Sample Unity project. We followed all steps from manual, however after running project in the Unity editor, Compositor shows only feed from camera without holograms. There is not any error in console. In the game window the holograms are visible and they are also moving after change made in the second Hololens.

We used basic usb web camera with OpenCV 3.4.1. We made calibration, built projects, copied DLLs, deploy SpectatorViewPoseProvider, set IPs in SharingToSVAdapter in Unity project, turned off firewall. Then if we run sample in Unity Editor and SpectatorViewPoseProvider in the first Hololens, no holograms are showed in the compositor (camera feed is visible). However, we can request spatial mapping and it is visible in the compositor window. After connecting the second Hololens with Sample project, the holograms are not still visible in the compositor. We tryied it in Unity 2017.4.1 and 2017.4.4.

Does anyone any experience with this problem? Could this problem be related with camera and calibration? We do not have any camera to test with capture card. We just wanted to try the concept. Thank you for advice.

MrUncleXiang commented 5 years ago

Hi! Can you measure when you run this project, the first Hololens is running "SpectatorViewPoseProvider"? When i running, i will measure: 1.First Hololens running "SpectatorViewPoseProvider"; 2.Another Hololens running "SpectatorViewSample";

But you can't get the hologram in UnityEditor, i think you can measure the first Hololens which application was running. Hope can help.

MrUncleXiang commented 5 years ago

When you running the Unity Editor in PC, you can check the Unity Game window, if you move the Reality Camera, i mean the Camera not in the unity, the game window show the object move, maybe you should move the camera in the other position, maybe you will see the hologram.

hosulik commented 5 years ago

SpectatorViewPoseProvider is running on the first Hololens. In the Unity editor, the holograms are visible in the game window. According to the manual holograms should be visible in the compositor window even without the second Hololens. But they are not visible. Of course, we tried to move with camera, but nothing had change. We are waiting for capture card and camera to try it with another hardware.

MrUncleXiang commented 5 years ago

SpectatorViewPoseProvider is running on the first Hololens. In the Unity editor, the holograms are visible in the game window. According to the manual holograms should be visible in the compositor window even without the second Hololens. But they are not visible. Of course, we tried to move with camera, but nothing had change. We are waiting for capture card and camera to try it with another hardware.

I'm so sorry, i didn't describe clearly. I made the test, i hope can help.

I measure the SpectatorViewManager have a component "SpectatorViewManager", and its' argument "SpectatorViewHololensIP" is my first Hololens IP, because i use the wifi, so i write the first Hololens IP.

When i didn't open the first Hololens, i run the Unity, open the "Spectator View"->"Compositor" window, i can get the camera capture. but when i move the camera, the Scene window. didn't have any changed. And then, i open the first Hololens, and launch the "SpectatorViewPoseProvider", try to move the first Hololens, the Scene window show the object is moving, it's following my first Hololens.

If your game object following your move, you just need move the camera and Hololens, and measure the hologram is in your camera view.

hosulik commented 5 years ago

We have tried it with capture card. We had to look for holograms properly to see them in the compositor. Thank you for help.