search

MobileNativeFoundation / bluepill

Bluepill is a reliable iOS testing tool that runs UI tests using multiple simulators on a single machine
BSD 2-Clause "Simplified" License
3.19k stars 232 forks source link

BP changes exit code the last second. #417

Closed chenxiao0228 closed 3 years ago

chenxiao0228 commented 4 years ago

{77485} 20200220.171610 [ INFO ] (BP-2) No more tests to run. {77485} 20200220.171610 [ INFO ] (BP-2) /Users/runner/runners/2.162.0/work/bluepill/bluepill/bp/src/Bluepill.m:604 finalExitStatus = BPExitStatusTestsAllPassed {77485} 20200220.171610 [ INFO ] (BP-2) Number of Executions: 2 {77485} 20200220.171610 [ INFO ] (BP-2) Final Exit Status: BPExitStatusAppCrashed {77485} 20200220.171610 [ INFO ] (BP-2) BP exiting 7 {77034} 20200220.171611 [ INFO ] (BLUEPILL) BP-2 (PID 77485) has finished with exit code 7.

This happens sometimes when a test passed after crashing. BP will change the exit code in the last second and cause a failure.

ravimandala commented 4 years ago

BP-2, in this case, had two runs. The second run is an extraneous one where no tests were run and it exited with BPExitStatusTestsAllPassed i.e., exit code 0. The first run might have had an app crash and the test passed on retry. Can you please check?