Closed stephen-soltesz closed 1 month ago
Changes Missing Coverage | Covered Lines | Changed/Added Lines | % | ||
---|---|---|---|---|---|
parser/scamper1.go | 2 | 5 | 40.0% | ||
<!-- | Total: | 2 | 5 | 40.0% | --> |
Files with Coverage Reduction | New Missed Lines | % | ||
---|---|---|---|---|
active/active.go | 4 | 88.54% | ||
<!-- | Total: | 4 | --> |
Totals | |
---|---|
Change from base Build 7548: | -0.1% |
Covered Lines: | 3338 |
Relevant Lines: | 4963 |
Periodically, daily jobs fail due to errors like those below. Sometimes scamper1 generates rows that are greater than 100MB when the maximum supported Load row size is 100MB, leading to these failures. As well, since the parser/gardner system does not retry failed daily jobs, one large file prevents the whole day from loading successfully.
This change simply filters raw traces larger than 90MB to prevent this type of failure. It is an open question why scamper would ever generate a trace this large. This is likely to be an anomalous measurement already. This change does not address the root cause.
See also: https://github.com/m-lab/dev-tracker/issues/744
This change is