Transport from audio

[gitpower2017]

there is the possibility that audio is also transmitted. Maybe the RPI will report to the PC/server as a USB soundcard?

[gitpower2017]

sorry for doppel posting. Ther was an error on my Browser

[mdevaev]

I will do it. There are two USB and TC358743 capabilities. Both will be supported.

[torpak]

@mdevaev TC358743 would mean getting the hdmi audio channel?

[piezza]

Would it also be possible to capture sound? My usecase is to use tools like MS Teams over pikvm remotely. So playing back and capturing sound in browser window would be cool!

[mdevaev]

Not right now but I'm working on it.

[mdevaev]

Not yet

[mdevaev]

Just some links for me to not forget:

• https://tools.ietf.org/id/draft-nandakumar-rtcweb-sdp-01.html
• https://tools.ietf.org/id/draft-ietf-rtcweb-sdp-08.html#rfc.section.5.2.6
• https://datatracker.ietf.org/doc/html/rfc4566
• https://datatracker.ietf.org/doc/html/draft-ietf-mmusic-data-channel-sdpneg-25
• https://developer.mozilla.org/ru/docs/Web/Media/Formats/WebRTC_codecs
• https://gist.github.com/albanpeignier/104902
• https://github.com/xiph/vorbis/blob/master/examples/encoder_example.c
• https://www.uni-due.de/~be0001/rn/index_e.html

[GralfR]

I'm just getting into it with what's laying around (pi4 2GB with USB-HDMI-capture). The first boot was good. Got my picture. And was asking for sound/audio, too. I got my test-signal from a DVB receiver/settopbox. That could be a usecase, too, but needs audio.

Looking forward to it.

[chilman408]

Question: When audio support is enabled, will it be enabled on V2 as well or just V3?

If it will be enabled for V2, is the current recommended hardware applicable (like the geekworm HDMI-CSI2)?

[mdevaev]

Geekworm have some hardware bugs so audio will not work on it.

[chilman408]

Geekworm have some hardware bugs so audio will not work on it.

Thank you, do you have a recommended hardware setup for V2? Would the Auvidea B101 work?

[mdevaev]

B101 will work, yes.

[chilman408]

Sorry one question, will the Auvidea B102 work?

[mdevaev]

Yes

[awkspace]

Would it be possible to offer a bounty for audio support over HDMI and/or USB? This would be useful to my workflow and I'd be happy to donate towards its development.

[mdevaev]

@awkspace It will be available on v3 hat - audio over hdmi.

[awkspace]

@mdevaev My understanding is that the hardware is available, but not the software, correct? I own a pre-assembled PiKVM V3 from PiShop.us, but there is no option to stream the audio from the WebUI. My question was whether I could donate to the development of this specific feature.

[mdevaev]

This feature is implemented in the hardware, yes. You can donate here if you want, https://patreon.com/pikvm, I will be grateful :)

[piezza]

I just wonder if it is not also possible to use Linux USB Audio Gadget driver for audio and transfer it bi-directional over WebRTC. Having both, speaker and mic would be great. I assume over HDMI only one direction will work?

[mdevaev]

Yep, only one direction.

[ghost]

Is the mic support currently blocked due to hardware or software?

if software, id like to purchase one and see if i can help

[mdevaev]

The reason is software only.

[mdevaev]

V3 users can test the audio right now: https://docs.pikvm.org/audio/

[bora-fsd]

Thank you @mdevaev. To confirm, is this to receive audio from the pikvm connected machine only? Or is there support to transmit microphone from web browser to pikvm as well?

[mdevaev]

This is only to recieve audio from the machine. Microphone support is not yet in the plans.

[json81]

V3 users can test the audio right now: https://docs.pikvm.org/audio/

Tested and working!

[awkspace]

Another 👍 here. Audio is working great on my v3. Thank you so much!!

[mdevaev]

I suppose it can be considered solved now :)

[moezden]

Hi @mdevaev, regarding

"Reverse audio transmission, that is, from the browser towards PiKVM (for example, to emulate a microphone) is not yet supported."

Can we expect a feature for mic emulation soon?

[mdevaev]

No, sorry.