moonlight-stream / moonlight-android

GameStream client for Android
GNU General Public License v3.0
4.3k stars 681 forks source link

[Feature request]: Add Multi-Touch Toggle Option and Resolve Android Keyboard Shortcut Conflicts in Moonlight #1311

Open Ranko-sama opened 10 months ago

Ranko-sama commented 10 months ago

Is your feature request related to a problem? Please describe.

Dear Moonlight Development Team,

I appreciate the effort put into developing Moonlight, a remarkable game streaming software.While using a physical keyboard with my Android tablet, I've encountered a challenge where pressing the Win key, Alt+Tab, or even the middle mouse button triggers the physical keyboard shortcuts of the Android system, leading to an exit from Moonlight. Additionally, it seems that Moonlight has disabled multi-touch support at the code level, limiting the experience in scenarios that require swiping, like navigating maps, browsing images, or interacting in certain games.

Describe the solution you'd like

I would like to see the addition of a multi-touch setting toggle in Moonlight, along with an option to override the system's physical keyboard shortcuts. Multi-touch is crucial for enhancing the user experience on touch screen devices, especially in applications or games requiring intricate control.

Describe alternatives you've considered

I've noticed that "阿西西的日常," a Bilibili uploader from China, addressed these issues in a modified version of Moonlight for Android. Significantly, he achieved this by leveraging Android's accessibility features(Except that the middle mouse button still causes conflicts leading to Moonlight exiting, the middle button command has actually been issued). However, I am concerned about the long-term viability and compatibility of this solution with future official updates of Moonlight.Additionally, for multi-touch functionality in Moonlight, it's important to note that the host machine needs to use Sunshine.

Screenshots

Here are "阿西西的日常" videos for reference: Video Link 1 Video Link 2

I hope these insights are helpful for future Moonlight updates.

TrueZhuangJia commented 10 months ago

I play via iOS moonlight modified by the same uploader: https://b23.tv/fUWVnpA it works almost fine except for some glitches cause touch freeze which disappear after releasing both fingers. but I hope multi-touch can be added officially so I don't need to reinstall the modified app by self-signed certificate every 7 days. :)

maffinca69 commented 8 months ago

@TrueZhuangJia Hi. You can share modified ipa file? I can't find it...

TrueZhuangJia commented 7 months ago

@TrueZhuangJia Hi. You can share modified ipa file? I can't find it...

Hi, I created a fork to implement multi-touch on iOS (resolving the issue I mentioned). Have a try if you can sideload ipa on iOS. https://github.com/TrueZhuangJia/moonlight-ios-NativeMultiTouchPassthrough/tree/Moonlight-iOS-ZWM

maffinca69 commented 7 months ago

@TrueZhuangJia Hi, i can install it with AltStore?

TrueZhuangJia commented 7 months ago

@TrueZhuangJia Hi, i can install it with AltStore?

Not sure. You need a tool to sign the ipa file with your own apple account, in this way installation shall be refreshed every 7 days. To install it permanently requires Jailbreak or Trollstore.

unknown-o commented 2 months ago

I've also encountered an issue where some Android tablet devices will block special keyboard keys such as Windows, Alt, and ECS. The developers of Moonlight seem to have provided a root version to solve these problems, but there are still a lot of devices that cannot be rooted due to security or terms restrictions. The solution to this problem without root has been proposed, which is through Android accessibility permissions

1131

I've just used this code to verify that it does fix the problem

Why doesn't the repository owner make any response or comment on this PR