search

microsoft / MixedReality-SpectatorView

Mixed reality spectator experiences
MIT License
194 stars 114 forks source link

Some problems in SpectatorView in two hololens #410

Open xiahuan357 opened 4 years ago

xiahuan357 commented 4 years ago

Two Hololen2，one User,one Spectator. windows10 18362.1016 Unity2019.2.19f1 Visual Studio 2019 Windows SDK 10 18362

The following problem come from the same project.

  1. If the asset name contains "/" , when I update the asset cache, I get an error saying "no path found." I changed the asset name, it work.
  2. The Hololens used as "Spectator" sees assets that are not in the same location as the Hololens used as User. And I cannot interaction with assets. Without any error, how should I check?
  3. Transparent objects display incorrectly on the Hololens used as "Spectator" .

The material setting like that: image

The results like that :

User: image

Spectator: image

  1. Can't see Dynamic Textures in the Compontent of Raw Image. The Dynamic Textures is a dynamic Video image.

  2. Finally, there are two error message , I don't know why it happens and how to fix it.

image

chrisfromwork commented 4 years ago

  1. this sounds like an issue with how asset caches are created. I don't know that there is a good way to fix this problem, but we should update the documentation to call out these potential issues.

  2. Spectator view supports bi directional synchronization. Spectator users won't be able to interact with content based on how the synchronization logic works here. I would suggest using a different synchronization process such as Photon if you need both hololens users to be able to interact with content. The fact that content is at different locations sounds like the localization strategy you have used may not have succeeded correctly. Are you using azure spatial anchors to align the scene or aruco/qr codes?

  3. Transparent objects displaying incorrectly may be due to the user hololens not having the correct shader compilcations that support transparency. If you update the included shaders in your unity project's graphics settings you may be able to include the transparent variant of the shader you care about. If a material declared for an asset in a compiled scene references the transparent shader variant you care about, it should get included in your project. So another workaround may be to include your application scene in your spectator hololens build as an additional scene (not the first scene in the scene build list so that the spectator hololens still runs through spectator scenarios).

  4. Dynamic textures aren't currently we supported. We don't have logic to stream texture values with spectator view's default synchronization stack.

  5. These errors sound like you may be dynamically creating meshes. Spectator views synchronization stack does not currently support dynamically created meshes.