On the event of crashing shards (e.g, native Android crashes) reported, these are treated as device failures and not test result failures. Within matrix_ids.json, could report something like:
Test result processing of matrix_ids.json and would be confused on this outcome with a failure reported with no failing tests.
FTL returns exit code of 10 with these failing shards (https://firebase.google.com/docs/test-lab/ios/command-line) wondering if an additional device descriptor can be appended to this outcome (if possible through FTL endpoints to have that data added to the axes)
On the event of crashing shards (e.g, native Android crashes) reported, these are treated as device failures and not test result failures. Within
matrix_ids.json
, could report something like:Test result processing of
matrix_ids.json
and would be confused on this outcome with a failure reported with no failing tests.FTL returns exit code of
10
with these failing shards (https://firebase.google.com/docs/test-lab/ios/command-line) wondering if an additional device descriptor can be appended to this outcome (if possible through FTL endpoints to have that data added to the axes)