search

kostmo / circleci-failure-tracker

A log analyzer for CircleCI. Note that this project is now hosted at pytorch/dr-ci
https://github.com/pytorch/dr-ci
5 stars 2 forks source link

Flaky pattern matches don't seem to affect build UI #11

Closed ezyang closed 5 years ago

ezyang commented 5 years ago

Go to https://circle.pytorch.org/commit-details.html?sha1=835a6b9da29dfc7261586b245592c438773791c0

Notice that the matched pattern is a flaky test. What I would like to see is "build succeeded, but some tests failed with flaky errors". I don't see anything like that on the page.

kostmo commented 5 years ago

If all of the failures were flaky, I'll now indicate that on the page, but for now I'm going to go with weaker language than declaring that the build succeeded.