web-platform-tests / results-collection

Other
41 stars 46 forks source link

Collection from Chrome interrupted by hanging process #625

Closed jugglinmike closed 5 years ago

jugglinmike commented 5 years ago

When running "chunk" number 3 of 20 in Chrome (both stable and "dev" channels), the WPT CLI occassionally fails to exit after testing is complete.

The logs for a recent error show that testing completed, but the process did not exit. While executing testharness tests, either wptrunner or Chromedriver seems to have fallen into a bad state: it fails to execute the final tests due to HTTP errors during WebDriver communication. I'm not sure if that's relevant, though.

Excerpt from the logs 2018-11-08 14:54:18,743 INFO validate-wpt-results wpt-run:stdout 5:00.81 INFO Running testharness tests 2018-11-08 14:54:18,743 INFO validate-wpt-results wpt-run:stdout 5:00.81 TEST_START: /wasm/jsapi/table/constructor.any.js 2018-11-08 14:54:18,743 INFO validate-wpt-results wpt-run:stdout 5:00.81 TEST_END: SKIP 2018-11-08 14:54:18,743 INFO validate-wpt-results wpt-run:stdout 5:00.81 TEST_START: /wasm/jsapi/table/get-set.any.js 2018-11-08 14:54:18,743 INFO validate-wpt-results wpt-run:stdout 5:00.81 TEST_END: SKIP 2018-11-08 14:54:18,743 INFO validate-wpt-results wpt-run:stdout 5:00.81 TEST_START: /wasm/jsapi/table/grow.any.js 2018-11-08 14:54:18,743 INFO validate-wpt-results wpt-run:stdout 5:00.81 TEST_END: SKIP 2018-11-08 14:54:18,743 INFO validate-wpt-results wpt-run:stdout 5:00.81 TEST_START: /wasm/jsapi/table/length.any.js 2018-11-08 14:54:18,743 INFO validate-wpt-results wpt-run:stdout 5:00.81 TEST_END: SKIP 2018-11-08 14:54:18,743 INFO validate-wpt-results wpt-run:stdout 5:00.81 TEST_START: /wasm/jsapi/table/toString.any.js 2018-11-08 14:54:18,743 INFO validate-wpt-results wpt-run:stdout 5:00.81 TEST_END: SKIP 2018-11-08 14:54:18,793 INFO validate-wpt-results wpt-run:stdout 5:00.86 pid:22148 Full command: /home/manuel/worker/GNU_Linux_Chunked_Runner/build/chromedriver --port=4445 --url-base=/ 2018-11-08 14:54:18,793 INFO validate-wpt-results wpt-run:stdout pid:22148 Starting ChromeDriver 2.43.600233 (523efee95e3d68b8719b3a1c83051aa63aa6b10d) on port 4445 2018-11-08 14:54:18,794 INFO validate-wpt-results wpt-run:stdout 5:00.86 pid:22148 Only local connections are allowed. 2018-11-08 14:54:19,296 INFO validate-wpt-results wpt-run:stdout 5:01.36 INFO Starting runner 2018-11-08 14:54:20,157 INFO validate-wpt-results wpt-run:stdout 5:02.22 TEST_START: /2dcontext/image-smoothing/imagesmoothing.html 2018-11-08 14:54:20,427 INFO validate-wpt-results wpt-run:stdout 5:02.49 TEST_END: Test OK. Subtests passed 9/9. Unexpected 0 2018-11-08 14:54:20,427 INFO validate-wpt-results wpt-run:stdout 5:02.49 TEST_START: /bluetooth/descriptor/readValue/gen-service-is-removed.https.html 2018-11-08 14:54:20,834 INFO validate-wpt-results wpt-run:stdout 5:02.90 TEST_END: Test OK. Subtests passed 0/1. Unexpected 1 2018-11-08 14:54:20,834 INFO validate-wpt-results wpt-run:stdout FAIL Service gets removed. Reject with InvalidStateError. - promise_test: Unhandled rejection with value: object "ReferenceError: Mojo is not defined" 2018-11-08 14:54:20,834 INFO validate-wpt-results wpt-run:stdout Error 2018-11-08 14:54:20,834 INFO validate-wpt-results wpt-run:stdout at AssertionError.get_stack (https://web-platform.test:8443/resources/testharness.js:2983:21) 2018-11-08 14:54:20,834 INFO validate-wpt-results wpt-run:stdout at new AssertionError (https://web-platform.test:8443/resources/testharness.js:2976:27) 2018-11-08 14:54:20,834 INFO validate-wpt-results wpt-run:stdout at assert (https://web-platform.test:8443/resources/testharness.js:2969:19) 2018-11-08 14:54:20,835 INFO validate-wpt-results wpt-run:stdout at Test. (https://web-platform.test:8443/resources/testharness.js:617:29) 2018-11-08 14:54:20,835 INFO validate-wpt-results wpt-run:stdout at Test.step (https://web-platform.test:8443/resources/testharness.js:1568:25) 2018-11-08 14:54:20,835 INFO validate-wpt-results wpt-run:stdout at https://web-platform.test:8443/resources/testharness.js:1592:35 2018-11-08 14:54:20,835 INFO validate-wpt-results wpt-run:stdout 2018-11-08 14:54:20,878 INFO validate-wpt-results wpt-run:stdout 5:02.94 INFO Closing logging queue 2018-11-08 14:54:20,879 INFO validate-wpt-results wpt-run:stdout 5:02.94 INFO queue closed 2018-11-08 14:54:20,916 INFO validate-wpt-results wpt-run:stdout 5:02.98 pid:22442 Full command: /home/manuel/worker/GNU_Linux_Chunked_Runner/build/chromedriver --port=4445 --url-base=/ 2018-11-08 14:54:20,916 INFO validate-wpt-results wpt-run:stdout pid:22442 Starting ChromeDriver 2.43.600233 (523efee95e3d68b8719b3a1c83051aa63aa6b10d) on port 4445 2018-11-08 14:54:20,916 INFO validate-wpt-results wpt-run:stdout 5:02.98 pid:22442 Only local connections are allowed. 2018-11-08 14:54:21,415 INFO validate-wpt-results wpt-run:stdout 5:03.48 INFO Starting runner 2018-11-08 14:54:22,317 INFO validate-wpt-results wpt-run:stdout 5:04.38 TEST_START: /bluetooth/descriptor/readValue/read-succeeds.https.html 2018-11-08 14:54:22,743 INFO validate-wpt-results wpt-run:stdout 5:04.80 TEST_END: Test OK. Subtests passed 0/1. Unexpected 1 2018-11-08 14:54:22,743 INFO validate-wpt-results wpt-run:stdout FAIL A read request succeeds and returns the descriptor's value. - promise_test: Unhandled rejection with value: object "ReferenceError: Mojo is not defined" 2018-11-08 14:54:22,747 INFO validate-wpt-results wpt-run:stdout Error 2018-11-08 14:54:22,747 INFO validate-wpt-results wpt-run:stdout at AssertionError.get_stack (https://web-platform.test:8443/resources/testharness.js:2983:21) 2018-11-08 14:54:22,747 INFO validate-wpt-results wpt-run:stdout at new AssertionError (https://web-platform.test:8443/resources/testharness.js:2976:27) 2018-11-08 14:54:22,748 INFO validate-wpt-results wpt-run:stdout at assert (https://web-platform.test:8443/resources/testharness.js:2969:19) 2018-11-08 14:54:22,748 INFO validate-wpt-results wpt-run:stdout at Test. (https://web-platform.test:8443/resources/testharness.js:617:29) 2018-11-08 14:54:22,748 INFO validate-wpt-results wpt-run:stdout at Test.step (https://web-platform.test:8443/resources/testharness.js:1568:25) 2018-11-08 14:54:22,748 INFO validate-wpt-results wpt-run:stdout at https://web-platform.test:8443/resources/testharness.js:1592:35 2018-11-08 14:54:22,748 INFO validate-wpt-results wpt-run:stdout 2018-11-08 14:54:22,784 INFO validate-wpt-results wpt-run:stdout 5:04.85 INFO Closing logging queue 2018-11-08 14:54:22,785 INFO validate-wpt-results wpt-run:stdout 5:04.85 INFO queue closed 2018-11-08 14:54:22,818 INFO validate-wpt-results wpt-run:stdout 5:04.88 pid:22731 Full command: /home/manuel/worker/GNU_Linux_Chunked_Runner/build/chromedriver --port=4445 --url-base=/ 2018-11-08 14:54:22,818 INFO validate-wpt-results wpt-run:stdout pid:22731 Starting ChromeDriver 2.43.600233 (523efee95e3d68b8719b3a1c83051aa63aa6b10d) on port 4445 2018-11-08 14:54:22,818 INFO validate-wpt-results wpt-run:stdout 5:04.88 pid:22731 Only local connections are allowed. 2018-11-08 14:54:23,320 INFO validate-wpt-results wpt-run:stdout 5:05.38 INFO Starting runner 2018-11-08 14:54:24,170 INFO validate-wpt-results wpt-run:stdout 5:06.23 TEST_START: /bluetooth/server/device-same-object.https.html 2018-11-08 14:54:24,531 INFO validate-wpt-results wpt-run:stdout 5:06.60 TEST_END: Test OK. Subtests passed 0/1. Unexpected 1 2018-11-08 14:54:24,531 INFO validate-wpt-results wpt-run:stdout FAIL [SameObject] test for BluetoothRemoteGATTServer's device. - promise_test: Unhandled rejection with value: object "ReferenceError: Mojo is not defined" 2018-11-08 14:54:24,531 INFO validate-wpt-results wpt-run:stdout Error 2018-11-08 14:54:24,531 INFO validate-wpt-results wpt-run:stdout at AssertionError.get_stack (https://web-platform.test:8443/resources/testharness.js:2983:21) 2018-11-08 14:54:24,531 INFO validate-wpt-results wpt-run:stdout at new AssertionError (https://web-platform.test:8443/resources/testharness.js:2976:27) 2018-11-08 14:54:24,531 INFO validate-wpt-results wpt-run:stdout at assert (https://web-platform.test:8443/resources/testharness.js:2969:19) 2018-11-08 14:54:24,531 INFO validate-wpt-results wpt-run:stdout at Test. (https://web-platform.test:8443/resources/testharness.js:617:29) 2018-11-08 14:54:24,531 INFO validate-wpt-results wpt-run:stdout at Test.step (https://web-platform.test:8443/resources/testharness.js:1568:25) 2018-11-08 14:54:24,531 INFO validate-wpt-results wpt-run:stdout at https://web-platform.test:8443/resources/testharness.js:1592:35 2018-11-08 14:54:24,531 INFO validate-wpt-results wpt-run:stdout 2018-11-08 14:54:24,576 INFO validate-wpt-results wpt-run:stdout 5:06.64 INFO Closing logging queue 2018-11-08 14:54:24,577 INFO validate-wpt-results wpt-run:stdout 5:06.64 INFO queue closed 2018-11-08 14:54:24,611 INFO validate-wpt-results wpt-run:stdout 5:06.68 pid:23020 Full command: /home/manuel/worker/GNU_Linux_Chunked_Runner/build/chromedriver --port=4445 --url-base=/ 2018-11-08 14:54:24,612 INFO validate-wpt-results wpt-run:stdout pid:23020 Starting ChromeDriver 2.43.600233 (523efee95e3d68b8719b3a1c83051aa63aa6b10d) on port 4445 2018-11-08 14:54:24,612 INFO validate-wpt-results wpt-run:stdout 5:06.68 pid:23020 Only local connections are allowed. 2018-11-08 14:54:25,116 INFO validate-wpt-results wpt-run:stdout 5:07.18 INFO Starting runner 2018-11-08 14:54:25,961 INFO validate-wpt-results wpt-run:stdout 5:08.02 TEST_START: /content-security-policy/reporting-api/reporting-api-doesnt-send-reports-without-violation.https.sub.html 2018-11-08 14:54:31,332 INFO validate-wpt-results wpt-run:stdout 5:13.40 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0 2018-11-08 14:54:31,333 INFO validate-wpt-results wpt-run:stdout 5:13.40 TEST_START: /content-security-policy/reporting-api/reporting-api-report-only-sends-reports-on-violation.https.sub.html 2018-11-08 14:54:36,614 INFO validate-wpt-results wpt-run:stdout 5:18.68 TEST_END: Test OK. Subtests passed 2/3. Unexpected 1 2018-11-08 14:54:36,615 INFO validate-wpt-results wpt-run:stdout FAIL Violation report status OK. - assert_equals: No such report. expected "" but got "false" 2018-11-08 14:54:36,615 INFO validate-wpt-results wpt-run:stdout at Test. (https://web-platform.test:8443/content-security-policy/support/checkReport.sub.js?reportField=violated-directive&reportValue=img-src%20%27none%27:64:11) 2018-11-08 14:54:36,615 INFO validate-wpt-results wpt-run:stdout at Test.step (https://web-platform.test:8443/resources/testharness.js:1568:25) 2018-11-08 14:54:36,615 INFO validate-wpt-results wpt-run:stdout at XMLHttpRequest. (https://web-platform.test:8443/resources/testharness.js:1592:35) 2018-11-08 14:54:36,615 INFO validate-wpt-results wpt-run:stdout 2018-11-08 14:54:36,663 INFO validate-wpt-results wpt-run:stdout 5:18.73 INFO Closing logging queue 2018-11-08 14:54:36,664 INFO validate-wpt-results wpt-run:stdout 5:18.73 INFO queue closed 2018-11-08 14:54:36,700 INFO validate-wpt-results wpt-run:stdout 5:18.76 INFO Starting runner 2018-11-08 14:54:36,703 INFO validate-wpt-results wpt-run:stdout 5:18.77 pid:23317 Full command: /home/manuel/worker/GNU_Linux_Chunked_Runner/build/chromedriver --port=4445 --url-base=/ 2018-11-08 14:54:36,703 INFO validate-wpt-results wpt-run:stdout pid:23317 Starting ChromeDriver 2.43.600233 (523efee95e3d68b8719b3a1c83051aa63aa6b10d) on port 4445 2018-11-08 14:54:36,704 INFO validate-wpt-results wpt-run:stdout 5:18.77 pid:23317 Only local connections are allowed. 2018-11-08 14:54:37,579 INFO validate-wpt-results wpt-run:stdout 5:19.64 TEST_START: /content-security-policy/reporting-api/reporting-api-report-to-overrides-report-uri-1.https.sub.html 2018-11-08 14:54:37,984 INFO validate-wpt-results wpt-run:stdout 5:20.05 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0 2018-11-08 14:54:37,984 INFO validate-wpt-results wpt-run:stdout 5:20.05 TEST_START: /content-security-policy/reporting-api/reporting-api-report-to-overrides-report-uri-2.https.sub.html 2018-11-08 14:54:38,151 INFO validate-wpt-results wpt-run:stdout 5:20.22 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0 2018-11-08 14:54:38,151 INFO validate-wpt-results wpt-run:stdout 5:20.22 TEST_START: /content-security-policy/reporting-api/reporting-api-sends-reports-on-violation.https.sub.html 2018-11-08 14:54:43,384 INFO validate-wpt-results wpt-run:stdout 5:25.45 TEST_END: Test OK. Subtests passed 2/3. Unexpected 1 2018-11-08 14:54:43,384 INFO validate-wpt-results wpt-run:stdout FAIL Violation report status OK. - assert_equals: No such report. expected "" but got "false" 2018-11-08 14:54:43,384 INFO validate-wpt-results wpt-run:stdout at Test. (https://web-platform.test:8443/content-security-policy/support/checkReport.sub.js?reportField=violated-directive&reportValue=img-src%20%27none%27:64:11) 2018-11-08 14:54:43,384 INFO validate-wpt-results wpt-run:stdout at Test.step (https://web-platform.test:8443/resources/testharness.js:1568:25) 2018-11-08 14:54:43,384 INFO validate-wpt-results wpt-run:stdout at XMLHttpRequest. (https://web-platform.test:8443/resources/testharness.js:1592:35) 2018-11-08 14:54:43,384 INFO validate-wpt-results wpt-run:stdout 2018-11-08 14:54:43,433 INFO validate-wpt-results wpt-run:stdout 5:25.50 INFO Closing logging queue 2018-11-08 14:54:43,433 INFO validate-wpt-results wpt-run:stdout 5:25.50 INFO queue closed 2018-11-08 14:54:43,468 INFO validate-wpt-results wpt-run:stdout 5:25.53 pid:23607 Full command: /home/manuel/worker/GNU_Linux_Chunked_Runner/build/chromedriver --port=4445 --url-base=/ 2018-11-08 14:54:43,468 INFO validate-wpt-results wpt-run:stdout pid:23607 Starting ChromeDriver 2.43.600233 (523efee95e3d68b8719b3a1c83051aa63aa6b10d) on port 4445 2018-11-08 14:54:43,469 INFO validate-wpt-results wpt-run:stdout 5:25.53 pid:23607 Only local connections are allowed. 2018-11-08 14:54:43,972 INFO validate-wpt-results wpt-run:stdout 5:26.03 INFO Starting runner 2018-11-08 14:54:44,820 INFO validate-wpt-results wpt-run:stdout 5:26.88 TEST_START: /content-security-policy/reporting-api/reporting-api-works-on-frame-src.https.sub.html 2018-11-08 14:54:50,213 INFO validate-wpt-results wpt-run:stdout 5:32.28 TEST_END: Test OK. Subtests passed 1/2. Unexpected 1 2018-11-08 14:54:50,213 INFO validate-wpt-results wpt-run:stdout FAIL Violation report status OK. - assert_equals: No such report. expected "" but got "false" 2018-11-08 14:54:50,213 INFO validate-wpt-results wpt-run:stdout at Test. (https://web-platform.test:8443/content-security-policy/support/checkReport.sub.js?reportField=violated-directive&reportValue=frame-src%20%27none%27:64:11) 2018-11-08 14:54:50,213 INFO validate-wpt-results wpt-run:stdout at Test.step (https://web-platform.test:8443/resources/testharness.js:1568:25) 2018-11-08 14:54:50,213 INFO validate-wpt-results wpt-run:stdout at XMLHttpRequest. (https://web-platform.test:8443/resources/testharness.js:1592:35) 2018-11-08 14:54:50,214 INFO validate-wpt-results wpt-run:stdout 2018-11-08 14:54:50,265 INFO validate-wpt-results wpt-run:stdout 5:32.33 INFO Closing logging queue 2018-11-08 14:54:50,265 INFO validate-wpt-results wpt-run:stdout 5:32.33 INFO queue closed 2018-11-08 14:54:50,294 INFO validate-wpt-results wpt-run:stdout 5:32.36 pid:23894 Full command: /home/manuel/worker/GNU_Linux_Chunked_Runner/build/chromedriver --port=4445 --url-base=/ 2018-11-08 14:54:50,294 INFO validate-wpt-results wpt-run:stdout pid:23894 Starting ChromeDriver 2.43.600233 (523efee95e3d68b8719b3a1c83051aa63aa6b10d) on port 4445 2018-11-08 14:54:50,294 INFO validate-wpt-results wpt-run:stdout 5:32.36 pid:23894 Only local connections are allowed. 2018-11-08 14:54:50,796 INFO validate-wpt-results wpt-run:stdout 5:32.86 INFO Starting runner 2018-11-08 14:54:51,652 INFO validate-wpt-results wpt-run:stdout 5:33.72 TEST_START: /content-security-policy/script-src/eval-allowed-in-report-only-mode-and-sends-report.html 2018-11-08 14:55:02,575 INFO validate-wpt-results wpt-run:stdout 5:44.64 TEST_END: Test TIMEOUT, expected OK. Subtests passed 1/2. Unexpected 1 2018-11-08 14:55:02,575 INFO validate-wpt-results wpt-run:stdout TIMEOUT Violation report status OK. - Test timed outTIMEOUT /content-security-policy/script-src/eval-allowed-in-report-only-mode-and-sends-report.html 2018-11-08 14:55:02,621 INFO validate-wpt-results wpt-run:stdout 5:44.69 INFO Closing logging queue 2018-11-08 14:55:02,622 INFO validate-wpt-results wpt-run:stdout 5:44.69 INFO queue closed 2018-11-08 14:55:02,661 INFO validate-wpt-results wpt-run:stdout 5:44.73 pid:24211 Full command: /home/manuel/worker/GNU_Linux_Chunked_Runner/build/chromedriver --port=4445 --url-base=/ 2018-11-08 14:55:02,661 INFO validate-wpt-results wpt-run:stdout pid:24211 Starting ChromeDriver 2.43.600233 (523efee95e3d68b8719b3a1c83051aa63aa6b10d) on port 4445 2018-11-08 14:55:02,661 INFO validate-wpt-results wpt-run:stdout 5:44.73 pid:24211 Only local connections are allowed. 2018-11-08 14:55:03,159 INFO validate-wpt-results wpt-run:stdout 5:45.22 INFO Starting runner 2018-11-08 14:55:32,682 INFO validate-wpt-results wpt-run:stdout 6:14.75 WARNING Post-connection steps failed 2018-11-08 14:55:32,683 INFO validate-wpt-results wpt-run:stdout 6:14.75 ERROR Traceback (most recent call last): 2018-11-08 14:55:32,683 INFO validate-wpt-results wpt-run:stdout File "/home/manuel/worker/GNU_Linux_Chunked_Runner/build/tools/wptrunner/wptrunner/executors/protocol.py", line 56, in setup 2018-11-08 14:55:32,683 INFO validate-wpt-results wpt-run:stdout self.after_connect() 2018-11-08 14:55:32,683 INFO validate-wpt-results wpt-run:stdout File "/home/manuel/worker/GNU_Linux_Chunked_Runner/build/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 222, in after_connect 2018-11-08 14:55:32,683 INFO validate-wpt-results wpt-run:stdout self.testharness.load_runner(self.executor.last_environment["protocol"]) 2018-11-08 14:55:32,683 INFO validate-wpt-results wpt-run:stdout File "/home/manuel/worker/GNU_Linux_Chunked_Runner/build/tools/wptrunner/wptrunner/executors/executorwebdriver.py", line 82, in load_runner 2018-11-08 14:55:32,683 INFO validate-wpt-results wpt-run:stdout self.runner_handle = self.webdriver.window_handle 2018-11-08 14:55:32,683 INFO validate-wpt-results wpt-run:stdout File "/home/manuel/worker/GNU_Linux_Chunked_Runner/build/tools/webdriver/webdriver/client.py", line 20, in inner 2018-11-08 14:55:32,683 INFO validate-wpt-results wpt-run:stdout return func(self, *args, **kwargs) 2018-11-08 14:55:32,683 INFO validate-wpt-results wpt-run:stdout File "/home/manuel/worker/GNU_Linux_Chunked_Runner/build/tools/webdriver/webdriver/client.py", line 548, in window_handle 2018-11-08 14:55:32,684 INFO validate-wpt-results wpt-run:stdout return self.send_session_command("GET", "window") 2018-11-08 14:55:32,685 INFO validate-wpt-results wpt-run:stdout File "/home/manuel/worker/GNU_Linux_Chunked_Runner/build/tools/webdriver/webdriver/client.py", line 508, in send_session_command 2018-11-08 14:55:32,685 INFO validate-wpt-results wpt-run:stdout return self.send_command(method, url, body) 2018-11-08 14:55:32,685 INFO validate-wpt-results wpt-run:stdout File "/home/manuel/worker/GNU_Linux_Chunked_Runner/build/tools/webdriver/webdriver/client.py", line 463, in send_command 2018-11-08 14:55:32,685 INFO validate-wpt-results wpt-run:stdout session=self) 2018-11-08 14:55:32,685 INFO validate-wpt-results wpt-run:stdout File "/home/manuel/worker/GNU_Linux_Chunked_Runner/build/tools/webdriver/webdriver/transport.py", line 162, in send 2018-11-08 14:55:32,685 INFO validate-wpt-results wpt-run:stdout response = conn.getresponse() 2018-11-08 14:55:32,686 INFO validate-wpt-results wpt-run:stdout File "/usr/lib/python2.7/httplib.py", line 1121, in getresponse 2018-11-08 14:55:32,686 INFO validate-wpt-results wpt-run:stdout response.begin() 2018-11-08 14:55:32,686 INFO validate-wpt-results wpt-run:stdout File "/usr/lib/python2.7/httplib.py", line 438, in begin 2018-11-08 14:55:32,686 INFO validate-wpt-results wpt-run:stdout version, status, reason = self._read_status() 2018-11-08 14:55:32,686 INFO validate-wpt-results wpt-run:stdout File "/usr/lib/python2.7/httplib.py", line 402, in _read_status 2018-11-08 14:55:32,686 INFO validate-wpt-results wpt-run:stdout raise BadStatusLine(line) 2018-11-08 14:55:32,686 INFO validate-wpt-results wpt-run:stdout BadStatusLine: ''

This isn't a fluke, but it is intermittent. For the same "chunk" of WPT, a subsequent collection for the experimental release of Chrome exhibited the same symptoms, but the corresponding collection from the stable release did not. I have not been able to reproduce this locally.