The SauceExtension is sometimes not reporting the result of the test to SauceLabs. Additional investigation is required. The reproduction is sporadic but there is usually at least one "non reported" test result in a large test run.
It is unclear from the surface what the direct problem would be.
Expected
A test result should always be sent to the SauceLabs API with the same response as the test runner.
Random thoughts that might help debug:
The driver is torn down prior to the extension obtaining the session id and sending the result. Not sure if this matters or not.
Repro
Send a parallel test run with at least 3 passing or failing tests to your own sauce labs account
Observe the results as they are reported and notice how some of them will display a ? even though the results of the test through JUNIT displays either pass or fail.
Bug
The
SauceExtensionis sometimes not reporting the result of the test to SauceLabs. Additional investigation is required. The reproduction is sporadic but there is usually at least one "non reported" test result in a large test run.It is unclear from the surface what the direct problem would be.
Expected
A test result should always be sent to the SauceLabs API with the same response as the test runner.
Random thoughts that might help debug: The driver is torn down prior to the extension obtaining the session id and sending the result. Not sure if this matters or not.
Repro
?even though the results of the test through JUNIT displays either pass or fail.