webapp on the ipad - screen capture video issues

[isolver]

I tried to run the webapp on the ipad. All the buttons seem to work well. The mirroring doesn't. The canvas remains gray. Can't check the browser console so I can't tell why.

Do we know if the MPEG1 decoder uses something special that won't work on the iPad?

[isolver]

Hum, I will try it out. Early in development I tried it on Amy's ipad than the video was coming through OK;

Do we know if the MPEG1 decoder uses something special that won't work on the iPad?

From the browser POV, all that is happening is that an html5 canvas is being updated with data; the browser render knows nothing about where the data originally came from.

What version ipad were you using (hardware and os version)?

Do other sites that use html5 canvas elements work?

If it is not a hardware related issue, I have:

• updated the NodeJS webserver that is the go between for the track app and the Webapp
• likely changed settings related to the generation of the video stream by ffmpeg
• likely changed how the canvas is resized based on web browser window width

So it is possible 1 of those three SW changes made it stop working.

All the fundamentals have not changed since I tried it on the ipad though.

[isolver]

So I tested again on my ipad mini, which is a version about 1 year old, so a new model ipad.

Everything runs fine. I can see the screen capture video etc. All buttons seem to work , but sometimes they need to be pressed twice for the action to occur. It seems like the first press often just displays the button description mini balloon, then the 2nd press actually causes the action.

The only 2 buttons that I could not get to work are the 2 overlay button for mouse and gaze. The presses for those 2 never even caused the button state graphics to change.

Overall, very nice actually. ;)

So I think maybe the ipad you have , or the web browser version, may be too old and not support html5 web canvases.

BTW, Using Safari on the ipad actually seemed better than chrome in terms of responsiveness.

[garyfeng]

hmm... I was using a 2013 ipad, should be the same as yours. I suspect the problem had to do with the multiple IP address on the View PC (actually the single PC doing both). In order for it to work, I chose the wireless IP for Bonjour, not the ethernet. I don't know if somehow the video stream server chose to use a different IP address.

Testing the ipad at ETS is complicated because the wired connection is on the intranet but not the wireless. I will set up a wireless AP at some point, so that Bonjour and the iPad should use the same IP.

So looks like this is not a bug per se.

BTW, I found too that I needed to double-tapping the buttons. Didn't try the eye overlay button.

[isolver]

That should work then HW wise; maybe also check you have the latest iOS update installed and the latest versions of chrome and safari.

Have also tried it on amy's ipad 2 ( probably ~ 3 years old). It is running the latest iOS etc, and it also runs the webapp fine on my home wireless network anyhow.

I wonder if your network at work is blocking wireless ports; 8082 and 8084 are used for the video web sockets. If those are blocked on the wireless network but open on your wired setup; that would explain the issue.

On Wed, Jun 18, 2014 at 11:10 PM, garyfeng notifications@github.com wrote:

hmm... I was using a 2013 ipad, should be the same as yours. I suspect the problem had to do with the multiple IP address on the View PC (actually the single PC doing both). In order for it to work, I chose the wireless IP for Bonjour, not the ethernet. I don't know if somehow the video stream server chose to use a different IP address.

Testing the ipad at ETS is complicated because the wired connection is on the intranet but not the wireless. I will set up a wireless AP at some point, so that Bonjour and the iPad should use the same IP.

So looks like this is not a bug per se.

BTW, I found too that I needed to double-tapping the buttons. Didn't try the eye overlay button.

— Reply to this email directly or view it on GitHub https://github.com/isolver/Confero/issues/81#issuecomment-46519341.

[garyfeng]

I checked the IP addresses. Looks like the wireless card on the laptop and the ipad IPs share the first 2 numbers but not the last 2. So I guess they are not on the same subnetwork? Again, all the interface stuff works, except for the video mirroring. Not sure if it has to do with the subnet issue or some sort of firewall the IT had put on. Will try with an access point of our own.

[garyfeng]

Gary will test if the ports are blocked.