search

RenderHeads / UnityPlugin-AVProVideo

AVPro Video is a multi-platform Unity plugin for advanced video playback
https://www.renderheads.com/products/avpro-video/
238 stars 29 forks source link

Only One Eye Rendering on Hololens 2 #539

Closed utzy closed 3 years ago

utzy commented 3 years ago

Describe the bug When using AVPro to show videos on the Hololens 2, only the left eye is rendering the video. The right eye stays black. Used to work on HL1.

Your Setup (please complete the following information):

To Reproduce

  1. Setup MRTK in UnityScene
  2. Add AVPro
  3. Add MediaPlayer with AutoOpen/AutoPlay
  4. Add Quad with ApplyToMesh and AVProUnlitOpaqueShader.
  5. Build for Hololens 2 UWP D3D Project. Use Master Config when building in Visual Studio.
AndrewRH commented 3 years ago

Hi,

I suspect your video may contain stereo metadata. Unfortunately our plugin has an issue on Windows platforms using Media Foundation where videos with stereo metadata only decode one eye. This doesn't happen on other platforms. The solution right now is to remove (or not embed in the first place) the stereo metadata from the video file.

If your video doesn't contain the stereo metadata then something is probably not set up correctly. Make sure you have the UpdateStereoMaterial comonent in your scene and set up, and that you have set the stereo packing format on the MediaPlayer component.

We have the upcoming AVPro Video 2.0 which thankfully has solved this issue.

Does this help?

utzy commented 3 years ago

Hi, thanks for the quick reply :) Maybe I should explain what we are trying to do. We do not want to play stereoscopic video using packing, etc.

We simply want to play a video as part of the AR world. Basically like you have a TV floating in front of you, when you wear the Hololens.

This is where the bug shows up and you can only see the TV in one eye. I was thinking this might be an issue due to stereo instancing on the shader or sth, but could not find an appropriate option. Do you still think this is an error in our setup?

AndrewRH commented 3 years ago

Hmm, and if you change the stereo instancing mode - does that help? If the whole TV mesh isn't appearing then it doesn't sound related to AVPro Video...

utzy commented 3 years ago

btw, we were not able to fix this bug. Instead we used the following workaround:

Use a Canvas and an AVPro Display_uGUI component with Default UI Material, instead of a Mesh and an ApplyToMesh component with Unlit Material.

stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

stale[bot] commented 3 years ago

This issue has been automatically closed because it has not had recent activity. If you wish to continue this issue, then please create a new issue as we do not monitor closed issues.