执行uiautomator dump页面xml命令时，动态UI无法捕获，有什么好的解决方案？

mnotgod96 / AppAgent

AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.

https://appagent-official.github.io/

MIT License

5.2k stars 563 forks source link

Open regcwt1226 opened 10 months ago

regcwt1226 commented 10 months ago

执行dump命令 adb -s device_serias shell uiautomator dump /sdcard/demo_app_2024-01-18_20-51-49_1.xml 失败，提示“ERROR: could not get idle state.”

twiceyuan commented 10 months ago

Perhaps you can try using the accessibility service API, but doing so will require developing an app to handle this part of the work.

Luoxin0903 commented 8 months ago

我解决了这个问题，方法是用appium 来替代shell uiautomator dump抓取层级结构并生成 xml图，不仅不报错，而且每次标签很全，appium支持终端和docker部署

xzq11111 commented 7 months ago

我解决了这个问题，方法是用appium 来替代shell uiautomator dump抓取层级结构并生成 xml图，不仅不报错，而且每次标签很全，appium支持终端和docker部署

请问appium抓取层级结构生成xml的具体命令是什么呢？或者有教程链接可以发一下么？

Luoxin0903 commented 7 months ago

其实动态元素捕捉这只是其中一坑，之后还得解决 docs文件跟抓取层级结构元素重复导致回放乱跑的问题，这个问题我用round数进行计数解决