执行uiautomator dump页面xml命令时，动态UI无法捕获，有什么好的解决方案？

mnotgod96 / AppAgent

AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.

https://appagent-official.github.io/

MIT License

4.72k stars 497 forks source link

Open regcwt1226 opened 6 months ago

regcwt1226 commented 6 months ago

执行dump命令 adb -s device_serias shell uiautomator dump /sdcard/demo_app_2024-01-18_20-51-49_1.xml 失败，提示“ERROR: could not get idle state.”

twiceyuan commented 6 months ago

Perhaps you can try using the accessibility service API, but doing so will require developing an app to handle this part of the work.

Luoxin0903 commented 4 months ago

我解决了这个问题，方法是用appium 来替代shell uiautomator dump抓取层级结构并生成 xml图，不仅不报错，而且每次标签很全，appium支持终端和docker部署

xzq11111 commented 3 months ago

我解决了这个问题，方法是用appium 来替代shell uiautomator dump抓取层级结构并生成 xml图，不仅不报错，而且每次标签很全，appium支持终端和docker部署

请问appium抓取层级结构生成xml的具体命令是什么呢？或者有教程链接可以发一下么？

Luoxin0903 commented 3 months ago

其实动态元素捕捉这只是其中一坑，之后还得解决 docs文件跟抓取层级结构元素重复导致回放乱跑的问题，这个问题我用round数进行计数解决