ant-media / Ant-Media-Server

Ant Media Server is a live streaming engine software that provides adaptive, ultra low latency streaming by using WebRTC technology with ~0.5 seconds latency. Ant Media Server is auto-scalable and it can run on-premise or on-cloud.
https://antmedia.io
Other
4.29k stars 636 forks source link

Whiteboard does not show drawing in correct position on receiving end #5490

Open timantmedia opened 1 year ago

timantmedia commented 1 year ago

Short description

Publishing and playing using the whiteboard sample page, does not show the drawing in the correct position.

Environment

Steps to reproduce

  1. Start publishing from the whiteboard sample page http://localhost:5080/LiveApp/canvas-publish.html
  2. Start playing from the whiteboard sample page http://localhost:5080/LiveApp/canvas-player.html
  3. Draw on the canvas and observe how the publish and play canvases do not show the drawing in the same position.

Expected behavior

Drawing or markings show show in the same position

Actual behavior

In the same area but incorrect position

Logs

Place logs on pastebin or elsewhere and put links here

Ask your questions on Ant Media Github Discussions

timantmedia commented 1 year ago

It seems if the <video> element is the same dimensions in both play and publish then the marks are seen in the correct position. But what if you are publishing in desktop and playing in mobile?

timantmedia commented 1 year ago

I also observed that sometimes the markings do not appear on the receiving player although no packets were lost.

timantmedia commented 1 year ago

As an example, the image below shows the result of the other user drawing a circle. The other markings are also either not aligned with what was drawn or distorted.

image