search

Unity-Technologies / UnityRenderStreaming

Streaming server for Unity
Other
1.3k stars 359 forks source link

Video Multiplexing example #575

Open segatecm opened 2 years ago

segatecm commented 2 years ago

Hi all: I want to send some data with video frame synchronous, like camera position... I found some stuff like Multiplex Video Encoder, But I don't know how to do it. So please give me some advice, Thanks.

karasusan commented 2 years ago

Could you explain Multiplex Video Encoder? We are going to develop the Encoded Streams API for sending/receiving metadata with video frame synchronously. https://github.com/Unity-Technologies/com.unity.webrtc/issues/305

segatecm commented 2 years ago

A class name MultiplexEncoderFactory in webrtc c++ source code. It used to send metadata with video frame. I dont know how to use it in C#. So, please Help!

karasusan commented 2 years ago

Is this? https://source.chromium.org/chromium/chromium/src/+/main:third_party/webrtc/media/engine/multiplex_codec_factory.h

segatecm commented 2 years ago

Yes, MultiplexEncoderFactory. How can I use it in Unity?

karasusan commented 2 years ago

@segatecm Currently, we can not use it.

This module looks interesting. I searched about that, but there is not a lot of information. 😅

segatecm commented 2 years ago

Me too. I want to use it.But can not find any sample.

karasusan commented 2 years ago

memo: URS-368

segatecm commented 2 years ago

Thanks. Where can I check the URS-368 progress?

karasusan commented 2 years ago

@segatecm Sorry, this link is for an internal tracking system, so I cannot share that.

segatecm commented 2 years ago

OK. How long will this feathure be released?

karasusan commented 2 years ago

@segatecm It is difficult to add the feature immediately, please watch the ticket. https://github.com/Unity-Technologies/com.unity.webrtc/issues/578

segatecm commented 2 years ago

Thanks!