search

m1k1o / neko

A self hosted virtual browser that runs in docker and uses WebRTC.
https://neko.m1k1o.net/
Apache License 2.0
5.96k stars 449 forks source link

Feature: Mobile support #251

Open superen7527 opened 1 year ago

superen7527 commented 1 year ago

Can you configure the Android resolution and ui? Similar to 1080*1920

m1k1o commented 1 year ago

Mobile support is only partial now.

superen7527 commented 1 year ago

Mobile support is only partial now.

hello, I can't type on my phone and send it to the browser. Nothing happens after typed

but,At the same time on hyperbeam.com, I can input any character through the phone input .I don't know what causes

m1k1o commented 1 year ago

Yes, only watching works now.

m1k1o commented 1 year ago

Related to https://github.com/m1k1o/neko/issues/115.

superen7527 commented 1 year ago

Yes, only watching works now.

Now the phone ui can control the mouse, and the input method will pop up (no matter where I click), and the input method input is invalid.

It should be optimized to: click the input box or the focus is on the place where input is required, and the input method will only pop up when the keyboard needs to pop up.

Also, I've used the old 1.2 version of guacamole, which just doesn't support the browser keyboard. The official solution at that time was to use js transmission, so that we could inject an input box on the page to pass any symbols.

Then I tried the latest 1.4 point guacamole, he has a built-in solution - injecting his own simulated keyboard on the interface.

But I prefer his other solution: directly use the user's input method to pass characters. After all, it is most convenient to use your usual input method on your mobile phone.

But for some reason I can't type Chinese, maybe it's because of xrdp, maybe it's because my remote configuration is wrong. But normally, he should support the input of Chinese payment. In other words, any character can be passed when it works normally.

So I thought you might be able to learn from that. Hope the above answer is helpful to you.

m1k1o commented 1 year ago

We have no way of knowing when to show on-screen keyboard. I do not know what event in Xorg would tell me this. Thats discussed in this Issue: https://github.com/m1k1o/neko/issues/115. So it would be really nice to have this but I need help from someone who knows how to do that.

superen7527 commented 1 year ago

We have no way of knowing when to show on-screen keyboard. I do not know what event in Xorg would tell me this. Thats discussed in this Issue: #115. So it would be really nice to have this but I need help from someone who knows how to do that.

Well, guacamole didn’t solve this problem either. It seems that there is no api to help. If the feedback is not perfect by injecting js focus monitoring, the address bar can’t take care of it (or judge the relative position of the mouse?) My The idea is very simple. If it cannot be solved perfectly, it is also a solution to keep popping up like now.

However, the mobile terminal input can learn from guacamole, just like the neko computer page, there will be an input box at the bottom to transmit text.

It doesn't matter if you can't do smart pop-up, now this is very good. Thanks for your work.

m1k1o commented 1 year ago

Touch events have been added as first step in adding mobile support. There are still missing touch gestures and on screen keyboard.

dpalmigiano commented 9 months ago

does it have mobile support yet (touch)?

m1k1o commented 9 months ago

Will be available in upcoming version with many new features. Stay tuned.