search

a7ex / xcresultparser

Parse the binary xcresult bundle from Xcode builds and testruns
MIT License
83 stars 24 forks source link

Skipped tests shows as failed in txt results #15

Closed alexnot95 closed 1 year ago

alexnot95 commented 1 year ago

We have a testplan with ~17 configurations (the difference between configurations are system region + system language) we use it to perform visual testing on different locales. Some of the tests are disabled: example:

func testOne() throws {
throw XCTSkip("Disabled")
}

In txt report I see that skipped tests shows as failed on different locales, but I assume they should be excluded from the report and shouldn't be recognized as failed tests

the command I used to generate txt report is: xcresultparser -o txt -s failed -f result.xcresult > results.txt

a7ex commented 1 year ago

Would it be possible to send me the xcresult file, so I can see what's going on, fix the issue and check the fix?

alexnot95 commented 1 year ago

Would it be possible to send me the xcresult file, so I can see what's going on, fix the issue and check the fix?

Yeah, I can send it on your email?

a7ex commented 1 year ago

Yes. please.

alexnot95 commented 1 year ago

@a7ex file sent

a7ex commented 1 year ago

This looks like a duplicate of the other issue you opened. To me it looks like XcresultKit is not interpreting the xcresult file, as you would expect it. There is nothing I can do about it. Sorry.