When a user streams with a remote connection with their phone on vertical mode, the UI of the desktop app updates to try and match the video dimensions. This, in turn, messes up the UI, although the object detection engine does not adjust for this size and process and returns bounding boxes with an assumption that the video is in landscape mode.
Solution
The solution is to dig into the WebRTC documentation to see what is causing this issue and how to force landscape mode.
Problem
When a user streams with a remote connection with their phone on vertical mode, the UI of the desktop app updates to try and match the video dimensions. This, in turn, messes up the UI, although the object detection engine does not adjust for this size and process and returns bounding boxes with an assumption that the video is in landscape mode.
Solution
The solution is to dig into the WebRTC documentation to see what is causing this issue and how to force landscape mode.
Here is a screenshot of the problem: Screenshot of the problem