Revert "[CI] fail fast stages" - Githubissues

elastic / beats-tester

E2E tests for the Beats

18 stars 22 forks source link

Revert "[CI] fail fast stages" #194

Closed v1v closed 3 years ago

v1v commented 3 years ago

Reverts elastic/beats-tester#186

Since there are more MacOS workers

elasticmachine commented 3 years ago

:broken_heart: Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

#### Build stats * Build Cause: `Pull request #194 opened` * Start Time: 2021-06-15T09:04:08.783+0000 * Duration: 33 min 0 sec * Commit: 7158e0ca3048c6ad0382cebbd314c502bc118719 #### Test stats :test_tube: | Test | Results | | ------------ | :-----------------------------: | | Failed | 17 | | Passed | 1490 | | Skipped | 990 | | Total | 2497 | #### Trends :test_tube: ![Image of Build Times](https://beats-ci.elastic.co/job/Beats/job/beats-tester-mbp/job/PR-194/buildTimeGraph/png) ![Image of Tests](https://beats-ci.elastic.co/job/Beats/job/beats-tester-mbp/job/PR-194/1/testReport/history/countGraph/png?start=0&end=25)

Test errors

Expand to view the tests failures

> Show only the first 10 test failures ##### `Test Hosts / Matrix - GROUPS = 'centos' / Test / [tester-awslinux] Packaging tests Packetbeat: test-beat : Check that packetbeat contains X-Pack features that=[u"'Unknown help topic' not in xpack_cmd_result.stderr"] – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194/src/roles/test-beat/tasks/common/assert.yml:119`

Expand to view the error details

``` Assertion failed ```

Expand to view the stacktrace

``` { "assertion": "'Unknown help topic' not in xpack_cmd_result.stderr", "changed": false, "evaluated_to": false, "msg": "Assertion failed" } ```

##### `Test Hosts / Matrix - GROUPS = 'centos' / Test / [tester-awslinux2] Packaging tests Packetbeat: test-beat : Check that packetbeat contains X-Pack features that=[u"'Unknown help topic' not in xpack_cmd_result.stderr"] – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194/src/roles/test-beat/tasks/common/assert.yml:119`

Expand to view the error details

``` Assertion failed ```

Expand to view the stacktrace

``` { "assertion": "'Unknown help topic' not in xpack_cmd_result.stderr", "changed": false, "evaluated_to": false, "msg": "Assertion failed" } ```

##### `Test Hosts / Matrix - GROUPS = 'centos' / Test / [tester-centos6-32] Packaging tests Packetbeat: test-beat : Check that packetbeat contains X-Pack features that=[u"'Unknown help topic' not in xpack_cmd_result.stderr"] – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194/src/roles/test-beat/tasks/common/assert.yml:119`

Expand to view the error details

``` Assertion failed ```

Expand to view the stacktrace

``` { "assertion": "'Unknown help topic' not in xpack_cmd_result.stderr", "changed": false, "evaluated_to": false, "msg": "Assertion failed" } ```

##### `Test Hosts / Matrix - GROUPS = 'centos' / Test / [tester-centos6-64] Packaging tests Packetbeat: test-beat : Check that packetbeat contains X-Pack features that=[u"'Unknown help topic' not in xpack_cmd_result.stderr"] – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194/src/roles/test-beat/tasks/common/assert.yml:119`

Expand to view the error details

``` Assertion failed ```

Expand to view the stacktrace

``` { "assertion": "'Unknown help topic' not in xpack_cmd_result.stderr", "changed": false, "evaluated_to": false, "msg": "Assertion failed" } ```

##### `Test Hosts / Matrix - GROUPS = 'centos' / Test / [tester-centos7-64] Packaging tests Packetbeat: test-beat : Check that packetbeat contains X-Pack features that=[u"'Unknown help topic' not in xpack_cmd_result.stderr"] – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194/src/roles/test-beat/tasks/common/assert.yml:119`

Expand to view the error details

``` Assertion failed ```

Expand to view the stacktrace

``` { "assertion": "'Unknown help topic' not in xpack_cmd_result.stderr", "changed": false, "evaluated_to": false, "msg": "Assertion failed" } ```

##### `Test Hosts / Matrix - GROUPS = 'centos' / Test / [tester-centos8-64] Packaging tests Packetbeat: test-beat : Check that packetbeat contains X-Pack features that=[u"'Unknown help topic' not in xpack_cmd_result.stderr"] – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194/src/roles/test-beat/tasks/common/assert.yml:119`

Expand to view the error details

``` Assertion failed ```

Expand to view the stacktrace

``` { "assertion": "'Unknown help topic' not in xpack_cmd_result.stderr", "changed": false, "evaluated_to": false, "msg": "Assertion failed" } ```

##### `Test Hosts / Matrix - GROUPS = 'sles' / Test / [tester-sles12-64] Packaging tests Packetbeat: test-beat : Check that packetbeat contains X-Pack features that=[u"'Unknown help topic' not in xpack_cmd_result.stderr"] – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194/src/roles/test-beat/tasks/common/assert.yml:119`

Expand to view the error details

``` Assertion failed ```

Expand to view the stacktrace

``` { "assertion": "'Unknown help topic' not in xpack_cmd_result.stderr", "changed": false, "evaluated_to": false, "msg": "Assertion failed" } ```

##### `Test Hosts / Matrix - GROUPS = 'debian' / Test / [tester-debian8-64] Packaging tests Packetbeat: test-beat : Check that packetbeat contains X-Pack features that=[u"'Unknown help topic' not in xpack_cmd_result.stderr"] – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194/src/roles/test-beat/tasks/common/assert.yml:119`

Expand to view the error details

``` Assertion failed ```

Expand to view the stacktrace

``` { "assertion": "'Unknown help topic' not in xpack_cmd_result.stderr", "changed": false, "evaluated_to": false, "msg": "Assertion failed" } ```

##### `Test Hosts / Matrix - GROUPS = 'debian' / Test / [tester-debian9-64] Packaging tests Packetbeat: test-beat : Check that packetbeat contains X-Pack features that=[u"'Unknown help topic' not in xpack_cmd_result.stderr"] – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194/src/roles/test-beat/tasks/common/assert.yml:119`

Expand to view the error details

``` Assertion failed ```

Expand to view the stacktrace

``` { "assertion": "'Unknown help topic' not in xpack_cmd_result.stderr", "changed": false, "evaluated_to": false, "msg": "Assertion failed" } ```

##### `Test Hosts / Matrix - GROUPS = 'debian' / Test / [tester-debian10-64] Packaging tests Packetbeat: test-beat : Check that packetbeat contains X-Pack features that=[u"'Unknown help topic' not in xpack_cmd_result.stderr"] – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194/src/roles/test-beat/tasks/common/assert.yml:119`

Expand to view the error details

``` Assertion failed ```

Expand to view the stacktrace

``` { "assertion": "'Unknown help topic' not in xpack_cmd_result.stderr", "changed": false, "evaluated_to": false, "msg": "Assertion failed" } ```

Steps errors

Expand to view the steps failures

##### `make batch`

Took 7 min 16 sec . View more details on here

##### `make batch`

Took 15 min 32 sec . View more details on here

##### `make batch`

Took 6 min 33 sec . View more details on here

##### `make batch`

Took 2 min 5 sec . View more details on here

##### `Recursively delete the current directory from the workspace`

Took 0 min 0 sec . View more details on here
Description: script returned exit code 2

Log output

Expand to view the last 100 lines of log output

``` [2021-06-15T09:36:18.062Z] Makefile:51: recipe for target 'ansible-playbook-run-elastic' failed [2021-06-15T09:36:18.062Z] make[2]: *** [ansible-playbook-run-elastic] Error 2 [2021-06-15T09:36:18.062Z] make[2]: Leaving directory '/var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194/src' [2021-06-15T09:36:18.062Z] Makefile:36: recipe for target 'run-group' failed [2021-06-15T09:36:18.062Z] make[1]: *** [run-group] Error 2 [2021-06-15T09:36:18.062Z] make[1]: Leaving directory '/var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194/src' [2021-06-15T09:36:18.063Z] Makefile:29: recipe for target 'batch' failed [2021-06-15T09:36:18.063Z] make: *** [batch] Error 1 [2021-06-15T09:36:18.452Z] Post stage [2021-06-15T09:36:18.477Z] Running in /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194/src [2021-06-15T09:36:18.622Z] Recording test results [2021-06-15T09:36:19.113Z] [Checks API] No suitable checks publisher found. [2021-06-15T09:36:19.249Z] Archiving artifacts [2021-06-15T09:36:20.871Z] + make clean [2021-06-15T09:36:20.871Z] vagrant destroy -f [2021-06-15T09:36:31.877Z] ==> tester-ubuntu2004-64: Forcing shutdown of VM... [2021-06-15T09:36:31.877Z] ==> tester-ubuntu2004-64: Destroying VM and associated drives... [2021-06-15T09:36:34.146Z] ==> tester-debian10-64: Forcing shutdown of VM... [2021-06-15T09:36:34.847Z] ==> tester-debian10-64: Destroying VM and associated drives... [2021-06-15T09:36:35.550Z] ==> tester-win19-64: VM not created. Moving on... [2021-06-15T09:36:35.550Z] ==> tester-centos8-64: VM not created. Moving on... [2021-06-15T09:36:36.253Z] ==> tester-awslinux2: VM not created. Moving on... [2021-06-15T09:36:36.956Z] ==> tester-ubuntu1804-64: Forcing shutdown of VM... [2021-06-15T09:36:38.408Z] ==> tester-ubuntu1804-64: Destroying VM and associated drives... [2021-06-15T09:36:39.862Z] ==> tester-ubuntu1404-64: Forcing shutdown of VM... [2021-06-15T09:36:40.563Z] ==> tester-ubuntu1404-64: Destroying VM and associated drives... [2021-06-15T09:36:42.018Z] ==> tester-sles12-64: VM not created. Moving on... [2021-06-15T09:36:42.719Z] ==> tester-debian9-64: Forcing shutdown of VM... [2021-06-15T09:36:43.421Z] ==> tester-debian9-64: Destroying VM and associated drives... [2021-06-15T09:36:44.124Z] ==> tester-awslinux: VM not created. Moving on... [2021-06-15T09:36:44.826Z] ==> tester-ubuntu1604-64: Forcing shutdown of VM... [2021-06-15T09:36:46.279Z] ==> tester-ubuntu1604-64: Destroying VM and associated drives... [2021-06-15T09:36:46.982Z] ==> tester-win12-64: VM not created. Moving on... [2021-06-15T09:36:46.982Z] ==> tester-centos7-64: VM not created. Moving on... [2021-06-15T09:36:47.881Z] ==> tester-debian8-64: Forcing shutdown of VM... [2021-06-15T09:36:49.334Z] ==> tester-debian8-64: Destroying VM and associated drives... [2021-06-15T09:36:50.787Z] ==> tester-ubuntu1204-32: Forcing shutdown of VM... [2021-06-15T09:36:51.489Z] ==> tester-ubuntu1204-32: Destroying VM and associated drives... [2021-06-15T09:36:52.193Z] ==> tester-centos6-64: VM not created. Moving on... [2021-06-15T09:36:52.193Z] ==> tester-centos6-32: VM not created. Moving on... [2021-06-15T09:36:52.193Z] Makefile:71: recipe for target 'clean' failed [2021-06-15T09:36:52.193Z] make: [clean] Error 2 (ignored) [2021-06-15T09:36:52.193Z] rm -r .vagrant [2021-06-15T09:36:53.316Z] Failed in branch Matrix - GROUPS = 'debian' [2021-06-15T09:36:54.572Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194 [2021-06-15T09:36:54.854Z] [INFO] getVaultSecret: Getting secrets [2021-06-15T09:36:54.898Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID [2021-06-15T09:36:55.728Z] + chmod 755 generate-build-data.sh [2021-06-15T09:36:55.728Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194/runs/1 FAILURE 1966674 [2021-06-15T09:36:55.728Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194/runs/1/steps/?limit=10000 -o steps-info.json [2021-06-15T09:36:57.071Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194/runs/1/tests/?status=FAILED -o tests-errors.json [2021-06-15T09:36:57.322Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194/runs/1/log/ -o pipeline-log.txt [2021-06-15T09:36:57.322Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194// -o job-info.json [2021-06-15T09:36:57.572Z] jq: error (at job-info.json:0): Cannot index string with string "_links" [2021-06-15T09:36:57.572Z] jq: error (at job-info.json:0): Cannot index string with string "_class" [2021-06-15T09:36:57.572Z] jq: error (at job-info.json:0): Cannot index string with string "downloadable" [2021-06-15T09:36:57.572Z] jq: error (at job-info.json:0): Cannot index string with string "id" [2021-06-15T09:36:57.572Z] jq: error (at job-info.json:0): Cannot index string with string "url" [2021-06-15T09:36:57.572Z] jq: error (at job-info.json:21): Cannot index boolean with string "author" [2021-06-15T09:36:57.572Z] jq: error (at job-info.json:21): Cannot index boolean with string "author" [2021-06-15T09:36:57.572Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194/runs/1/changeSet/ -o changeSet-info.json [2021-06-15T09:36:57.823Z] jq: error (at changeSet-info.json:1): Cannot index array with string "_links" [2021-06-15T09:36:57.823Z] jq: error (at changeSet-info.json:1): Cannot index array with string "_class" [2021-06-15T09:36:57.823Z] jq: error (at changeSet-info.json:1): Cannot index array with string "actions" [2021-06-15T09:36:57.823Z] jq: error (at changeSet-info.json:1): Cannot index array with string "latestRun" [2021-06-15T09:36:57.823Z] jq: error (at changeSet-info.json:1): Cannot index array with string "permissions" [2021-06-15T09:36:57.823Z] jq: error (at changeSet-info.json:1): Cannot index array with string "parameters" [2021-06-15T09:36:57.823Z] INFO: fetchAndPrepareArtifactsInfo (see artifacts-info.json) [2021-06-15T09:36:57.823Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194/runs/1/artifacts/ -o artifacts-info.json [2021-06-15T09:36:58.073Z] INFO: fetchAndPrepareTestsInfo (see tests-info.json) [2021-06-15T09:36:58.074Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194/runs/1/tests/?limit=10000000 -o tests-info.json [2021-06-15T09:36:59.936Z] INFO: fetchAndPrepareTestSummaryReport (see tests-summary.json) [2021-06-15T09:36:59.936Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194/runs/1/blueTestSummary/ -o tests-summary.json [2021-06-15T09:36:59.936Z] INFO: fetchAndPrepareBuildInfo (see build-info.json) [2021-06-15T09:36:59.936Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194/runs/1/ -o build-info.json [2021-06-15T09:37:00.868Z] Archiving artifacts [2021-06-15T09:37:00.898Z] Timeout set to expire in 5 min 0 sec [2021-06-15T09:37:01.454Z] Archiving artifacts [2021-06-15T09:37:01.949Z] [WARN] notifyIfPossible: could not fetch the nextBuild. [2021-06-15T09:37:02.115Z] Unable to find a build for artifact copy from: Beats/beats-tester-mbp/PR-194 [2021-06-15T09:37:02.276Z] Masking supported pattern matches of $GITHUB_TOKEN [2021-06-15T09:37:02.631Z] [WARN] githubApiCall: The REST API call https://api.github.com/repos/elastic/beats-tester/issues/194/comments return 0 elements [2021-06-15T09:37:03.894Z] Archiving artifacts [2021-06-15T09:37:03.996Z] Timeout set to expire in 5 min 0 sec [2021-06-15T09:37:04.109Z] [INFO] getVaultSecret: Getting secrets [2021-06-15T09:37:04.156Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID [2021-06-15T09:37:04.741Z] [INFO] sendDataToElasticsearch: sending data... [2021-06-15T09:37:06.392Z] [INFO] getVaultSecret: Getting secrets [2021-06-15T09:37:06.440Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID [2021-06-15T09:37:06.858Z] [INFO] sendDataToElasticsearch: sending data... [2021-06-15T09:37:07.106Z] [INFO] getVaultSecret: Getting secrets [2021-06-15T09:37:07.150Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID [2021-06-15T09:37:07.635Z] [INFO] sendDataToElasticsearch: sending data... [2021-06-15T09:37:07.924Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-194 [2021-06-15T09:37:07.998Z] [INFO] getVaultSecret: Getting secrets [2021-06-15T09:37:08.043Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID [2021-06-15T09:37:08.793Z] + chmod 755 generate-build-data.sh [2021-06-15T09:37:08.793Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194/runs/1 FAILURE 1979739 [2021-06-15T09:37:08.793Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194/runs/1/steps/?limit=10000 -o steps-info.json [2021-06-15T09:37:10.136Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-194/runs/1/tests/?status=FAILED -o tests-errors.json ```

v1v commented 3 years ago

Test failures already reported in https://github.com/elastic/beats-tester/issues/195

Although it failed in the windows ones, so I'll track that issue and move forward with this PR