search

Dregu / visio

Ultra fast live streaming raw h264 from Raspberry Pi to multiple browser clients with Node, websockets and Broadway
MIT License
37 stars 13 forks source link

How to add audio (jmuxer bransh) and stats ? #3

Open VigibotDev opened 6 years ago

VigibotDev commented 6 years ago

Hello,

I need to add low latency audio to my custom robot. How I can add audio - can you add a sample in documentation ?

You can look the raspberry PI/PIC32 low latency robot web here : http://www.serveurperso.com:8080/ It use visio for H264 and work very well :)

Thanks, Pascal

Dregu commented 6 years ago

Basically I have not yet added audio to the server side. I've tested some AAC streaming in audio only mode by running the server with the ADTS separator instead of h264 NAL separator (node index.js --separator=255,241,something,something) but there's no code to stream both atm. IIRC the client works perfecly, but the server isn't there. The jmuxer branch is a very recent experiment. I guess you could use separate servers for audio and video, and add a few lines for the audio on client side...

I'm currently experimenting with webrtc h264+opus with janus-gateway since webrtc support has landed in most browsers finally. I don't have anything to share right now.