google / lyra

A Very Low-Bitrate Codec for Speech Compression
Apache License 2.0
3.82k stars 354 forks source link

Lyra + Gstreamer + webRTC - missing specs? #98

Closed rocco-haro closed 1 year ago

rocco-haro commented 1 year ago

Hi folks, first of all thanks for shipping version 2! So stoked on this work.

We're looking to explore integrating lyra into a gstreamer pipeline that is stacked with webRTC. I'm not the webRTC expert on our team, but my contacts are mentioning they had trouble finding the required specs in order to get started on building such an integration.

They mentioned RTP payloading/depayloading, and perhaps there are other items/specs needed to be understood before embarking on this journey.

We would greatly appreciate some guidance :)

aluebs commented 1 year ago

Exciting to hear that you are looking to integrate Lyra with WebRTC. There is no Lyra RTP spec, so a custom implementation would be needed. We have implemented our custom WebRTC wrapper ourselves for testing it in real calls, but it wasn't released because of how specific to our use-case it is.

rocco-haro commented 1 year ago

Wicked fast response, thanks for the clarification @aluebs!

Do you think we could get a RTP spec, and in return we could open source the custom implementation through the gstreamer community? We're working with the folks over at Centricular: https://www.centricular.com/about/

aluebs commented 1 year ago

Having an open-source WebRTC wrapper would be great. Let me bring it up with the team and come back to you.

rocco-haro commented 1 year ago

I sometimes miss github notifications, so feel free to drop me an email to continue the conversation rocco@kickback.space

rocco-haro commented 1 year ago

@aluebs i've come to learn that we actually won't be able to incorporate lyra into our project since we are purely web browser based at the moment. Thank you for the consideration!

aluebs commented 1 year ago

Thank you for letting us know.