search

RenderHeads / UnityPlugin-AVProVideo

AVPro Video is a multi-platform Unity plugin for advanced video playback
https://www.renderheads.com/products/avpro-video/
233 stars 28 forks source link

White Dots / Screen Tearing #1972

Open Jack-Follows opened 3 weeks ago

Jack-Follows commented 3 weeks ago

Hi I am currently developing for Meta Quest 2.

I am running 8k videos in the app and I am experiencing white dots appearing randomly in both eyes occasionally. The right eye does have some screen tearing also.

Unity version: 2022.3.36f1 AVPro version: AVPro Video v3 - Core Mobile Edition (3.0.8) Operating System version: SQ3A.220605.009.A1 Device Model: Meta Quest 2 Video Specs: 8k, 30fps, HEVC, 3.5gb

I have followed the set up for OES however I am still receiving this error.

AVPro_Issue

I have also applied the OES material to the 360 video sphere in the level to ensure I am matching this.

Any time a video is played I am having this issue. I have tried on multiple videos but just cannot seem to find a fix. I have looked at previous issues on this topic but their fixes don't seem to work. Am I missing something?

https://github.com/RenderHeads/UnityPlugin-AVProVideo/issues/1416

I had attempted to enable the Stereo Debug Tinting however this did not show any tints at all (I did test in a build, I am unsure if this option only works in editor?).

Thanks in advance!

Chris-RH commented 3 weeks ago

Are you able to provide:

  1. A screen recording to show the dots/tearing
  2. A sample of the video you are playing

You can email to unitysupport@renderheads.com

Are you reproducing this error in a new project running only AVPro Video and minimal changes?

Jack-Follows commented 3 weeks ago

Hi Chris,

Sure thing, I've conducted a recording however it doesn't seem anywhere near as bad on the recording compared to the actual experience.

The app is designed to read files in from the movies folder on the headset and doesn't have any media embedded in the app.

The video file is too large to send over here, would you have any alternative routes to receive data?

I also have a zip file with the code included but again is too large to send over through Outlook/OneDrive.

All the above files are shared in confidence and under the understanding that these files will not be shared with any third-party companies or replicated otherwise. I'm sure you wouldn't but I just wanted to make sure I said it as there is code and videos which are both mine and my colleague's content.

If you need any further information, please do not hesitate to contact myself.

Thank you so much again for the speedy responses!

Look forward to your reply!

Kind regards,

Jack Follows.

From: Chris-RH @.> Sent: 19 August 2024 09:07 To: RenderHeads/UnityPlugin-AVProVideo @.> Cc: Jack Follows @.>; Author @.> Subject: Re: [RenderHeads/UnityPlugin-AVProVideo] White Dots / Screen Tearing (Issue #1972)

Are you able to provide:

  1. A screen recording to show the dots/tearing
  2. A sample of the video you are playing

You can email to @.**@.>

Are you reproducing this error in a new project running only AVPro Video and minimal changes?

— Reply to this email directly, view it on GitHubhttps://github.com/RenderHeads/UnityPlugin-AVProVideo/issues/1972#issuecomment-2295928630, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AV2N3AF6V7Y7BWMLMROT3XTZSGRSZAVCNFSM6AAAAABMVOAABSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOJVHEZDQNRTGA. You are receiving this because you authored the thread.

Chris-RH commented 3 weeks ago

Hi,

Please could you resend those files to our email address: unitysupport@renderheads.com A lot of devs use googledrive or dropbox for larger files.

Kind regards, Chris

Chris-RH commented 2 weeks ago

Hi,

Please could you resend those files to our email address: unitysupport@renderheads.com A lot of devs use googledrive or dropbox for larger files.

Kind regards, Chris

Jack-Follows commented 2 weeks ago

Hi Chris, apologies as I’ve been on holiday, leave it with me and I’ll get these sent across to you today!

Kind regards,

Jack Follows.

Sent from Outlook for iOShttps://aka.ms/o0ukef

From: Chris-RH @.> Sent: Monday, August 26, 2024 8:45:44 AM To: RenderHeads/UnityPlugin-AVProVideo @.> Cc: Jack Follows @.>; Author @.> Subject: Re: [RenderHeads/UnityPlugin-AVProVideo] White Dots / Screen Tearing (Issue #1972)

Hi,

Please could you resend those files to our email address: @.**@.> A lot of devs use googledrive or dropbox for larger files.

Kind regards, Chris

— Reply to this email directly, view it on GitHubhttps://github.com/RenderHeads/UnityPlugin-AVProVideo/issues/1972#issuecomment-2309561118, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AV2N3AGAVEWHOPM2QWBP6U3ZTLMKRAVCNFSM6AAAAABMVOAABSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBZGU3DCMJRHA. You are receiving this because you authored the thread.Message ID: @.***>

Jack-Follows commented 1 week ago

Hi Chris,

Just checking in to see if you received the code base and the video that I shared across google drive?

Kind regards,

Jack Follows.

Sent from Outlook for iOShttps://aka.ms/o0ukef

From: Jack Follows @.> Sent: Tuesday, August 27, 2024 9:21:16 AM To: RenderHeads/UnityPlugin-AVProVideo @.>; RenderHeads/UnityPlugin-AVProVideo @.> Cc: Author @.> Subject: Re: [RenderHeads/UnityPlugin-AVProVideo] White Dots / Screen Tearing (Issue #1972)

Hi Chris, apologies as I’ve been on holiday, leave it with me and I’ll get these sent across to you today!

Kind regards,

Jack Follows.

Sent from Outlook for iOShttps://aka.ms/o0ukef

From: Chris-RH @.> Sent: Monday, August 26, 2024 8:45:44 AM To: RenderHeads/UnityPlugin-AVProVideo @.> Cc: Jack Follows @.>; Author @.> Subject: Re: [RenderHeads/UnityPlugin-AVProVideo] White Dots / Screen Tearing (Issue #1972)

Hi,

Please could you resend those files to our email address: @.**@.> A lot of devs use googledrive or dropbox for larger files.

Kind regards, Chris

— Reply to this email directly, view it on GitHubhttps://github.com/RenderHeads/UnityPlugin-AVProVideo/issues/1972#issuecomment-2309561118, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AV2N3AGAVEWHOPM2QWBP6U3ZTLMKRAVCNFSM6AAAAABMVOAABSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBZGU3DCMJRHA. You are receiving this because you authored the thread.Message ID: @.***>

Ste-RH commented 1 week ago

We requested access to the files last week. Access has still not been granted.

Ste-RH commented 1 week ago

Your video is 75 mbit/sec. That is very high for a Quest2. Have you tried something a lot lower to see if the issue still happens? The lower the better for a test, try something like 10 mbit and if the problem goes away, increase it a bit - maybe up towards 40 mbit.

Jack-Follows commented 1 week ago

Brilliant, thanks for this info, will pass this onto my content creator so they can edit the videos accordingly. Once we have retested the videos, I’ll be back in contact to let you know how it goes!

Thanks again!

Sent from Outlook for iOShttps://aka.ms/o0ukef

From: Ste Butcher @.> Sent: Monday, September 2, 2024 12:34:54 PM To: RenderHeads/UnityPlugin-AVProVideo @.> Cc: Jack Follows @.>; Author @.> Subject: Re: [RenderHeads/UnityPlugin-AVProVideo] White Dots / Screen Tearing (Issue #1972)

Your video is 75 mbit/sec. That is very high for a Quest2. Have you tried something a lot lower to see if the issue still happens? The lower the better for a test, try something like 10 mbit and if the problem goes away, increase it a bit - maybe up towards 40 mbit.

— Reply to this email directly, view it on GitHubhttps://github.com/RenderHeads/UnityPlugin-AVProVideo/issues/1972#issuecomment-2324523505, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AV2N3AEQVAWWI7CQVDQXQWLZUREN5AVCNFSM6AAAAABMVOAABSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMRUGUZDGNJQGU. You are receiving this because you authored the thread.Message ID: @.***>

Jack-Follows commented 1 week ago

Hi Ste,

Just to follow on from your advice for the different spec videos, we tested, 10, 25, and 40 however the issue still persists.

The quality of the video was also massively reduced below 50 Mbps bitrate. This wouldn't be suitable for our needs as we need higher quality videos. Based on the YouTuber Hugh Hou (professional 360 video creator), he recommends for 8k videos to be played on Quest 2 at 100 Mbps bitrate as that's the maximum recommended (optimal) bitrate to run at.

Are there some settings either in C# or the editor that could be tweaked to accommodate 8k videos?

Ste-RH commented 4 days ago

There is no way you will get 8k @ 100mbit played back perfectly on a Quest2 when using Unity as the playback engine. Unity adds a fair amount of overhead compared to using a standalone video player application.

Have you tried lowering the resolution to 4k - just to check the issue goes away.

Chris-RH commented 4 days ago

For more info, here and here are some guidelines for MAXIMUM encoding recommendations for the Quest 2. Note, these are based on using built in players that will not have the added overhead that Unity has.

Jack-Follows commented 2 days ago

Hi both, thanks for the info! We are currently working on editing our videos to get the best quality at a lower res however, could video caching be our answer here in order to allow us to play higher quality (6k - 8k) videos at a higher bitrate without any issues?

If so what would be the best approach to ensure this is set up correctly to allow us the maximum capable stream from the headsets memory?

Chris-RH commented 2 days ago

Unfortunately caching won't help as the bottleneck is caused by decoding, not downloading. The device cannot decode at the high resolution/bitrate on top of Unity's overheads.

Jack-Follows commented 2 days ago

Ahh okay, not to worry. Have you or the team tested videos in the Quest 2? If so would what would be the best settings in both Unity and the video output from Premiere Pro to achieve the best quality?

Also looking into the specs of the Quest 3, it seems there is a much higher processing speed in both CPU and GPU. Has any of the team tested with Quest 3 and if so would that be capable of 8K+ videos?

Chris-RH commented 2 days ago

Its really difficult to say. We can't really say how your particular use case would push the hardware. In theory, you should be able push close to the recommended specs, but you need to make sure that you leave a bit of wiggle room. Its the type of thing that needs to be up to the individual developer. To test various pieces of hardware against their own use case and requirements.