Webrtc video/audio/text chat from client device somehow?

giongto35 / cloud-morph

Decentralize, Self-host Cloud Gaming/Application

MIT License

1.06k stars 106 forks source link

Webrtc video/audio/text chat from client device somehow? #76

Open stephen-t-dodds opened 2 years ago

stephen-t-dodds commented 2 years ago

I know this is a stretch for this project.

I have some projects that I use webrtc video and audio chat in the experience. Is it possible to cloud stream the game/experience but still have access to user hardware for webrtc video and audio chat?

Just curious and no pressure. Thanks!

giongto35 commented 2 years ago

what do you mean by user hardware? do you mean to stream it from your local machine instead of remote machine?

stephen-t-dodds commented 2 years ago

I mean the user camera is a passthrough camera to the remote machine. I hope I am saying that right.

Basically I want two users to be able to video chat while playing the game.

giongto35 commented 2 years ago

I think it's possible, We can follow the same idea of Video/Input Stream. It's a separated stream. Currently the Video Stream part is:

Video Stream: Game in Server -> Streaming in Server --broadcast--> User in Local.
Input Stream: Input in Local -> Streaming in Server --broadcast--> User in Local

With Video Chat: Video in Local -> Streaming in Server --broadcast--> User in Local But yeah, It still needs some modification.