search

livekit / client-sdk-swift

LiveKit Swift Client SDK. Easily build live audio or video experiences into your mobile app, game or website.
https://livekit.io
Apache License 2.0
173 stars 84 forks source link

A way to send custom audio buffer #385

Open Yabby1997 opened 1 month ago

Yabby1997 commented 1 month ago

Is your feature request related to a problem? Please describe. What I need to implement is to send video and audio buffer on my own in a format of CMSampleBuffer. I found out that it is available to send video by using BufferCapturer but it seems there is no way to send audio in a similar manner.

Describe the solution you'd like Can you provide me a way to send audio buffer on my own if available? If not, will you planning to add a similar way to do so?

Describe alternatives you've considered Directly using LiveKitWebRTC rather using LiveKit.

Additional context

hiroshihorie commented 4 weeks ago

Unfortunately this is not possible at the moment, I want to add support for this.

Yabby1997 commented 3 weeks ago

Thanks for letting me know. It's sad to hear that it is not currently supported. I hope to see this feature updated soon.

hiroshihorie commented 3 days ago

I think I will need to re-write the WebRTC's AudioDeviceModule using AVAudioEngine and also provide a path to feed in custom buffers. Which will work for screen share also.