bytedance / Fastbot_Android

Fastbot(2.0) is a model-based testing tool for modeling GUI transitions to discover app stability problems
Other
1.01k stars 235 forks source link

测试覆盖率低 #249

Open zhliao opened 8 months ago

zhliao commented 8 months ago

机型:HTC 10 系统:安卓8.0.0 被测软件:TikTok 31.5.4 Fastbot版本号:2.3.23

使用了aapt: $ aapt dump --values strings [install_package_path.apk] > max.valid.strings $ adb push max.valid.strings /sdcard

Fastbot运行命令: $ adb shell CLASSPATH=/sdcard/monkeyq.jar:/sdcard/framework.jar:/sdcard/fastbot-thirdpart.jar exec app_process /system/bin com.android.commands.monkey.Monkey -p com.zhiliaoapp.musically --agent reuseq --running-minutes 90 --throttle 500 -v -v

分别运行了30, 60, 90分钟,每种时长各运行了大约10次,Activity测试覆盖率最高只有10%左右 (40 / 339)。与ASE2022 paper中的结果差别很大,请问运行命令中有什么地方可以改进吗?

haojunwei-hub commented 6 months ago

我也遇到了同样的问题,

wangchy0927 commented 6 months ago

官方说明: totalActivities:通过framework接口 PackageManager.getPackageInfo 获取,这包含app中所有的Activity,其中也包含了很多废弃、不可见、不可达等Activity