search

AgoraIO-Community / AR-Remote-Support

This is a POC of how to build a Remote support app (similar to Vuforia Chalk) using ARKit and Agora.io's Video SDK.
MIT License
23 stars 11 forks source link

[BUG] Touch input is not displayed on the broadcaster side #30

Open lichadehehehe opened 1 year ago

lichadehehehe commented 1 year ago

I would like to pay my tribute to @maxxfrazer for fixing the previous bug.

Describe the bug Touch input from the helpers' device is not displayed on the broadcaster device. A floating ar-ish white globe due to unknown causes can be seen floating in the video background of the broadcaster device. This might suggest a compatibility issue with the ar component.

To Reproduce Steps to reproduce the behavior:

  1. Build Ar Remote Support on two iOS devices
  2. Create "test" channel on one of the devices as the broadcaster
  3. White globe appears in the broadcaster's video feed
  4. Join "test" channel on another device as the helper
  5. Touches of the helper do not appear on either of the devices (broadcaster and helper)

Expected behavior Touches from the helper can be seen on the broadcaster's device

Screenshots IMG_0011 IMG_3866 IMG_3865 IMG_3864 IMG_3863

Smartphone (please complete the following information):

**Additional information

  1. "Incorrect NSStringEncoding value 0x8000100 detected. Assuming NSASCIIStringEncoding. Will stop this compatibility mapping behavior in the near future." can be seen spamming on the debugger window of both device's built application
  2. "touch points msg recieved arravofPoints: [ ]" can be seen on the debugger window of the broadcaster's device's built application

image

maxxfrazer commented 1 year ago

thanks for reporting this, looks like sessionIsActive isn't getting set on my local test, then the strings sent over RTM are encoded as "\"data\"", which is a bit annoying! These were originally done with Raw message types (with Data type), but for some reason a while ago we changed it back to a regular message.

I have it working locally now, I'll push this up to a branch and let you give it a try first to make sure we've got it sorted.

maxxfrazer commented 1 year ago

And the NSStringEncoding message looks to be coming from the package ARVideoKit, and the repo owner hasn't modified it in quite some time 😢

maxxfrazer commented 1 year ago

Those logs - definitely coming from Agora actually. I've seen an internal ticket that it's being fixed in the next patch. Sorry about that!

samersh commented 2 weeks ago

Are there any fixes for this issue ?? I am facing it and I don't know what to do!!