catapult-project / catapult

Deprecated Catapult GitHub. Please instead use http://crbug.com "Speed>Benchmarks" component for bugs and https://chromium.googlesource.com/catapult for downloading and editing source code..
https://chromium.googlesource.com/catapult
BSD 3-Clause "New" or "Revised" License
1.93k stars 564 forks source link

[📍] Pinpoint assigned blame to a change in that improved the metric #4404

Closed chcunningham closed 6 years ago

chcunningham commented 6 years ago

On this pinpoint run, many cls were considered as possible culprits. The tool called that out in the chromium bug, but assigned the bug to the least likely culprit - one that actually improved the metric.

image

Pinpoint run: https://pinpoint-dot-chromeperf.appspot.com/job/14babd5cc40000 chromium bug: http://crbug.com/828286

simonhatch commented 6 years ago

This is a known issue that we're hoping to address soon: #4123