search

X-SLAYER / flutter_accessibility_service

Flutter plugin for interacting with Accessibility Service in Android.
https://pub.dev/packages/flutter_accessibility_service
MIT License
33 stars 24 forks source link

can we perform clicks? #10

Closed Ahtsham0715 closed 1 year ago

Ahtsham0715 commented 1 year ago

can we perform clicks on specific part of screen using this plugin outside of our app?.

X-SLAYER commented 1 year ago

We can't for the moment 2#issuecomment-1209044622

Ahtsham0715 commented 1 year ago

can you add this feature too?

X-SLAYER commented 1 year ago

can you add this feature too?

Yes I'm working on it

Ahtsham0715 commented 1 year ago

Great. When it will be available?

X-SLAYER commented 1 year ago

I'm still working on some tests but you could try the new updates of clicks and all are in the automation branch

X-SLAYER commented 1 year ago

You can check an overview of the new updates here Automate YouTube autoscroll

Ahtsham0715 commented 1 year ago

Okay I'll check. Thank you.

Ahtsham0715 commented 1 year ago

Brother, I tried this branch but it is not capturing text from the screen properly. main branch text capturing was perfect

X-SLAYER commented 1 year ago

did you log all the fields cuz text capturing you can find it on the subNodes too

Ahtsham0715 commented 1 year ago

Yes, I log all fields. it is working fine on youtube and giving nodeid's but when I try it on Facebook and other apps fields it always returns nodeid as null and also performActionbyText() method not working. Also in the previous version when I log capturedText it was showing all the text from the screen but in the latest version it is not capturing all text from the screen.

Ahtsham0715 commented 1 year ago

and click actions are not working too

X-SLAYER commented 1 year ago

I will re-check it

Ahtsham0715 commented 1 year ago

ok

Ahtsham0715 commented 1 year ago

Brother I tried the latest version but the problem is that it is working fine on youtube and other google apps but when it comes to third party apps like facebook or other it always return nodeId as empty or null.

X-SLAYER commented 1 year ago

In some apps you can find their nodeId even text even in flutter apps try for example build apps with Semantic widget and give it description it will be shown unlike some other ones

Ahtsham0715 commented 1 year ago

I have tried on facebook app but it always show nodeId as null or empty but the text part is working at some points

Ahtsham0715 commented 1 year ago

brother is there any other way to perform actions in apps that are not built with semantic widget?. Actually am working a auto clicker like app which can perform clicks at certain widgets periodically and it can also read or write text from the widgets