catapult-project / catapult

Deprecated Catapult GitHub. Please instead use http://crbug.com "Speed>Benchmarks" component for bugs and https://chromium.googlesource.com/catapult for downloading and editing source code..
https://chromium.googlesource.com/catapult
BSD 3-Clause "New" or "Revised" License
1.91k stars 563 forks source link

Pick up results from (partly) failed runs in Pinpoint #4574

Open betasheet opened 5 years ago

betasheet commented 5 years ago

If a test execution fails, Pinpoint currently won't pick up the results from the test bot even if a large part of the tests succeeded and (partial) results are available. Would it be possible for pinpoint to present the results even in the case of such failures?

Here's an example job, where 2 tests of 80 consistently fail, but results for the other 78 seem to be available, yet pinpoint doesn't pick them up: https://pinpoint-dot-chromeperf.appspot.com/job/15ace40a640000

perezju commented 5 years ago

@dave-2 @simonhatch