coverage not being reported since April 10

[Trott]

I mentioned this in the Slack on Friday but probably should have opened an issue instead. coverage.nodejs.org hasn't reported anything since April 10.

[richardlau]

The job, e.g. https://ci.nodejs.org/view/Node.js%20Daily/job/node-test-commit-linux-coverage-daily/869/nodes=benchmark/console is unable to ssh into the coveragedata host:

04:12:31 + rsync -r out coveragedata:coverage-out
04:12:31 ssh_exchange_identification: read: Connection reset by peer
04:12:39 rsync: connection unexpectedly closed (0 bytes received so far) [sender]
04:12:39 rsync error: unexplained error (code 255) at io.c(226) [sender=3.1.1]

I can't either :disappointed:

[mhdawson]

I've tried rebooting from the softlayer console. Now I just get:

ssh: connect to host 50.97.245.4 port 22: Connection refused

I'm wondering if it might be related to what happened to the release ci.

[mhdawson]

ok seems to have come back now and I can ssh in. Hopefully next coverage run will work.

Having said that @richardlau it might have failed because a cleanup is needed.

[richardlau]

Right, but without being able to ssh in I couldn't cleanup. I'll take a look now.

[richardlau]

I've run a cleanup. I've also started a run of the coverage job: https://ci.nodejs.org/view/Node.js%20Daily/job/node-test-commit-linux-coverage-daily/871/

log

Spots the typos (and corrections) 😅. ``` $ mv coverage-out coverage-out-apr-20210430 $ mkdir coverage-out $ cd coverage-out $ mkdir out $ cd out/ $ cd ../.. $ ls backups charts creds node syncbackup.sh updaterepo.sh.orig benchmarking coverage-out dorestore-cov.sh node-v4.2.2-linux-x64 synccharts.sh benchmarking-25June2019 coverage-out-16Jan2020 key.pem old synccoverage.sh benchmarking-save coverage-out-apr-20210430 keys old_node_modules u35745210@ftp.devrus.com bridge.js coverage-out-aug-2019 killrsync.sh result update cert.pem coverage-out-nov-20 mdawson-tmp setup.sh updaterepo.sh $ mv coverage-out-apr-20210430/ coverage-out-20210430 $ cd coverage-out/out/ $ cp ../../coverage-out-20210430/out/*.* . $ ls -al total 1176 drwxrwxr-x 2 benchmark benchmark 4096 Apr 29 18:17 . drwxrwxr-x 3 benchmark benchmark 4096 Apr 29 18:16 .. -rw-rw-r-- 1 benchmark benchmark 626 Apr 29 18:17 docopy.sh -rw-r--r-- 1 benchmark benchmark 77805 Apr 29 18:17 index.csv -rw-rw-r-- 1 benchmark benchmark 1093327 Apr 29 18:17 index.html -rw-rw-r-- 1 benchmark benchmark 390 Apr 29 18:17 keep.list -rw-rw-r-- 1 benchmark benchmark 257 Apr 29 18:17 restore.sh -rw-r--r-- 1 benchmark benchmark 3097 Apr 29 18:17 styles.css $ cat restore.sh export OLD=../../coverage-out-nov-20/out cp $OLD/index.html . cp $OLD/index.csv . echo "export OLD=$OLD" >docopy.sh ls -ltr $OLD | awk '{ print $9 }' | grep coverage | tail -n 15 >keep.list cat keep.list | awk '{ print "cp -r $OLD/"$1" ."}' >>docopy.sh $ vi restore.sh $ bash restore.sh $ ls -al total 1176 drwxrwxr-x 2 benchmark benchmark 4096 Apr 29 18:18 . drwxrwxr-x 3 benchmark benchmark 4096 Apr 29 18:16 .. -rw-rw-r-- 1 benchmark benchmark 628 Apr 29 18:18 docopy.sh -rw-r--r-- 1 benchmark benchmark 77805 Apr 29 18:18 index.csv -rw-rw-r-- 1 benchmark benchmark 1093327 Apr 29 18:18 index.html -rw-rw-r-- 1 benchmark benchmark 390 Apr 29 18:18 keep.list -rw-rw-r-- 1 benchmark benchmark 259 Apr 29 18:18 restore.sh -rw-r--r-- 1 benchmark benchmark 3097 Apr 29 18:17 styles.css $ cat docopy.sh export OLD=../../coverage-out-20210430/out cp -r $OLD/coverage-e57d8af7e2890b03 . cp -r $OLD/coverage-e96773b94bbfdfd0 . cp -r $OLD/coverage-eec20ed5c1407412 . cp -r $OLD/coverage-f0bf37317604061d . cp -r $OLD/coverage-f3821cd8d797bb9f . cp -r $OLD/coverage-f392ac0bbe3f3757 . cp -r $OLD/coverage-f3d3769f9f6da29f . cp -r $OLD/coverage-f562ec64e8e3d602 . cp -r $OLD/coverage-f658bd1e8f7cd0a3 . cp -r $OLD/coverage-f7b82de9936d037b . cp -r $OLD/coverage-f7dd330ba0e7bfa9 . cp -r $OLD/coverage-fa3997d75a44bb68 . cp -r $OLD/coverage-fc6d8f4b841bfca1 . cp -r $OLD/coverage-fe43bd8ddd16a614 . cp -r $OLD/coverage-fef21282ef360fc6 . $ bash docopy.sh $ ls -al total 2304 drwxrwxr-x 17 benchmark benchmark 4096 Apr 29 18:20 . drwxrwxr-x 3 benchmark benchmark 4096 Apr 29 18:16 .. drwxr-xr-x 3 benchmark benchmark 69632 Apr 29 18:18 coverage-e57d8af7e2890b03 drwxr-xr-x 3 benchmark benchmark 73728 Apr 29 18:18 coverage-e96773b94bbfdfd0 drwxr-xr-x 3 benchmark benchmark 73728 Apr 29 18:18 coverage-eec20ed5c1407412 drwxr-xr-x 3 benchmark benchmark 73728 Apr 29 18:18 coverage-f0bf37317604061d drwxr-xr-x 4 benchmark benchmark 69632 Apr 29 18:20 coverage-f3821cd8d797bb9f drwxr-xr-x 3 benchmark benchmark 73728 Apr 29 18:20 coverage-f392ac0bbe3f3757 drwxr-xr-x 3 benchmark benchmark 73728 Apr 29 18:20 coverage-f3d3769f9f6da29f drwxr-xr-x 3 benchmark benchmark 73728 Apr 29 18:20 coverage-f562ec64e8e3d602 drwxr-xr-x 3 benchmark benchmark 73728 Apr 29 18:20 coverage-f658bd1e8f7cd0a3 drwxr-xr-x 3 benchmark benchmark 73728 Apr 29 18:20 coverage-f7b82de9936d037b drwxr-xr-x 3 benchmark benchmark 69632 Apr 29 18:20 coverage-f7dd330ba0e7bfa9 drwxr-xr-x 3 benchmark benchmark 73728 Apr 29 18:20 coverage-fa3997d75a44bb68 drwxr-xr-x 3 benchmark benchmark 73728 Apr 29 18:20 coverage-fc6d8f4b841bfca1 drwxr-xr-x 3 benchmark benchmark 73728 Apr 29 18:20 coverage-fe43bd8ddd16a614 drwxr-xr-x 3 benchmark benchmark 73728 Apr 29 18:21 coverage-fef21282ef360fc6 -rw-rw-r-- 1 benchmark benchmark 628 Apr 29 18:18 docopy.sh -rw-r--r-- 1 benchmark benchmark 77805 Apr 29 18:18 index.csv -rw-rw-r-- 1 benchmark benchmark 1093327 Apr 29 18:18 index.html -rw-rw-r-- 1 benchmark benchmark 390 Apr 29 18:18 keep.list -rw-rw-r-- 1 benchmark benchmark 259 Apr 29 18:18 restore.sh -rw-r--r-- 1 benchmark benchmark 3097 Apr 29 18:17 styles.css $ ```

[richardlau]

hmm I guess I was also supposed to clean up on the test machine as well as the benchmark data machine.

[richardlau]

Cleaned up on both the test machine and benchmark data machine. Trying again: https://ci.nodejs.org/view/Node.js%20Daily/job/node-test-commit-linux-coverage-daily/872/

[richardlau]

Cleanup done on both the test and benchmark machine and the job passed. We have coverage on https://coverage.nodejs.org/ with click through data for the last 15 days (the cleanup involves deleting older directories).

[Trott]

Seems like this can be closed, but re-open if I'm mistaken of course.