search

manukautech / XMRemoteRobot

A web service app which enables remote-control of near and distant devices including over the public Internet. Live demo at:
https://xmrrae.azurewebsites.net
Apache License 2.0
1 stars 1 forks source link

2-11 – First Person View #3

Open manukautech opened 7 years ago

manukautech commented 7 years ago

Distant human operator can see and hear what the robot/device is seeing and hearing. John does have this working as a Skype call but it is complex to setup and run. Can we build this into our apps and Server? Warning – this is probably a big task! It may be better quality with “UDP streaming”. It may however be more reliable using our existing Server setup and encoding low resolution images into “base64” text to send as part of our present JSON message format. Another John warning – John understands that images/video is easier than audio (!) Try images first.

manukautech commented 5 years ago

Good progress on this in our related project XMRemoteMonitor:
https://github.com/manukautech/XMRemoteMonitor
Modifying "diff-cam-engine" gives us jpeg images which we handle as base64 strings of about 20K. It was previously running on a default of uncompressed png which gave base64 strings of about 600K. We also discover that SignalR is limited to base64 strings of max 32700 characters which means that it is possible to use SignalR as a simple custom video streaming method on condition that we stay with low to medium resolutions like 400 x 225 pixels.