web-platform-tests / results-collection

Other
41 stars 46 forks source link

Missing Firefox stable results for a516e7edca #627

Closed foolip closed 5 years ago

foolip commented 5 years ago

https://wpt.fyi/test-runs?sha=a516e7edca

The Safari stable results are from Taskcluster, none were submitted from Buildbot.

jugglinmike commented 5 years ago

Typo in @foolip's report: it's the "Firefox stable" results (not "Safari stable") which are missing.

jugglinmike commented 5 years ago

We haven't uploaded results because the collection from chunk 8 of WPT timed out:

2018-11-09 05:43:19,076 INFO validate-wpt-results wpt-run:stdout 10:50.11 TEST_START: /html/the-xhtml-syntax/parsing-xhtml-documents/xhtml-mathml-dtd-entity-1.htm
2018-11-09 05:43:19,086 INFO validate-wpt-results wpt-run:stdout 10:50.12 INFO Closing window 4294967310
2018-11-09 05:43:25,363 INFO validate-wpt-results wpt-run:stdout 10:56.39 TEST_END: Test OK. Subtests passed 2125/2125. Unexpected 0
2018-11-09 05:43:25,364 INFO validate-wpt-results wpt-run:stdout 10:56.40 TEST_START: /html/the-xhtml-syntax/parsing-xhtml-documents/xhtml-mathml-dtd-entity-10.htm
2018-11-09 05:43:25,370 INFO validate-wpt-results wpt-run:stdout 10:56.40 INFO Closing window 4294967313
2018-11-09 05:43:26,439 INFO validate-wpt-results wpt-run:stdout 10:57.47 TEST_END: Test OK. Subtests passed 2231/2231. Unexpected 0
2018-11-09 05:43:26,440 INFO validate-wpt-results wpt-run:stdout 10:57.47 TEST_START: /html/the-xhtml-syntax/parsing-xhtml-documents/xhtml-mathml-dtd-entity-2.htm
2018-11-09 05:43:26,448 INFO validate-wpt-results wpt-run:stdout 10:57.48 INFO Closing window 4294967318

command timed out: 1200 seconds without output running ['xvfb-run', '--auto-servernum', '--error-file', '/var/log/xvfb/xvfb.log', 'run-and-verify.py', '--max-attempts', '3', '--log-wptreport', '/tmp/tmpLl8sOO/report.json', '--log-raw', '/tmp/tmpLl8sOO/log-raw.txt', '--', '--log-mach', '-', '--this-chunk', '8', '--total-chunks', '20', '--binary', '/home/gordon/worker/GNU_Linux_Chunked_Runner/build/firefox/firefox', '--webdriver-binary', '/home/gordon/worker/GNU_Linux_Chunked_Runner/build/geckodriver', '--install-fonts', '--no-headless', '--setpref', 'media.navigator.streams.fake=true', 'firefox'], attempting to kill
process killed by signal 9
program finished with exit code -1
elapsedTime=2113.678380

Earlier last month, we identified that behavior for that chunk (and the XML parsing tests specifically) to likely be an issue with resource limitations: gh-616. I'll close this as a duplicate and update that issue accordingly.

jugglinmike commented 5 years ago

(For now, I've manually triggered a retry for the missing data.)