AVPro Decklink with AVPro Video using DirectShow causes DeckLinkAudioOutput to not output audio

[drinsley]

We are using AVPro Decklink to output our video with a Blackmagic 8K Pro card. AVPro DeckLink SDI audio works fine on output on our system and DeckLinkAudioOutput.

We also AVPro Decklink in combination with AVPro Video to play clips and output video and audio, but we can't get audio output on the DeckLinkAudioOutput using DirectShow. The DeckLinkAudioOutput only works with MediaFoundation.

Your Setup (please complete the following information):

• Unity version: 2022.2.17
• AVPro Video version (number and edition (trial/core/ultra/enterprise)): 2.7.3 plugin v2.7.0f1-ultra
• AVPro Decklink version: 1.9.5
• Operating system version: Windows 10
• Device model: Blackmagic DeckLink 8k Pro
• Video specs (resolution, frame-rate, codec, file size): 1920x1080, 2997, Hap, 281mb, Audio AAC LC, 2 channels, mp4a-40-2

To Reproduce

1. Set AVPro DeckLink output to OneSubFullDuplex, Rec709, Sync to Input
2. Set AVPro Video to Direct Show, Audio Output Unity, Use Hap/NotchLC
3. Play a clip with audio on AVPro Decklink, you can hear the sound on the system and on output, and it shows audio on the DeckLinkAudioOutput
4. Play a clip with audio on AVPro Video, you can hear the sound on the system, but nothing on output, it does not show any audio coming out of the DeckLinkAudioOutput
5. It looks as though the AudioListener doesn't get the audio when playing in Direct Show
6. Setting to Direct Show and Audio Output to System Direct does not play audio on output either

Screenshots

Thanks, Doug

[Chris-RH]

Hi @drinsley

Unity Audio Output is a Media Foundation only option, see #1109 Basically "unity audio -> audio listener -> decklink output" so currently only Media Foundation can redirect the system audio back up to Unity so that DeckLink can use it.

I've put it down as an enhancement, but we're not 100% sure if it is possible to use Unity Audio Output with Directshow.

[v2k]

This is coming up again, any more thoughts on this? Playback performance seems poor with MediaFoundation, that's why we switched.

[RichRH]

Hi @v2k,

We're intrigued by the poor performance you're seeing in Media Foundation as improving potential issues related to a modern API (MF) as opposed to adding further support to a legacy API (DS - if even possible) would be our priortity.

Are you able to give any more information on the performance issues you're seeing? Have you tried the latest Video plugin? (Any sample videos/projects are always useful - private video/all projects should be sent to: unitysupport@renderheads.com)

Cheers,