pipecat-ai / pipecat

Open Source framework for voice and multimodal conversational AI
BSD 2-Clause "Simplified" License
3.12k stars 273 forks source link

WebRTC with FASTAPI #439

Closed keenborder786 closed 3 weeks ago

keenborder786 commented 3 weeks ago
pushpak1300 commented 3 weeks ago

Support for this would be great.

aconchillo commented 3 weeks ago

I'm not very familiar with aiortc but it looks like a WebRTC implementation. WebRTC doesn't use websockets for sending/receiving audio/video, it uses the UDP protocol instead which is how you can achieve low-latency.

Websockets (in the context of WebRTC) are usually used for the signalling part. That is, when two participants want to send media between each other they need to know where to send the media, what media is available, etc. WebRTC doesn't define how this data is exchanged so every one implementing WebRTC has their own way of exchanging this information.

keenborder786 commented 3 weeks ago

Ah Okay I see. I guess then if we want to use WebRTC we will have to use DialyCO

aconchillo commented 3 weeks ago

Ah Okay I see. I guess then if we want to use WebRTC we will have to use DialyCO

If you want low-latency and scalability built-in, yes, that's your best option.