search

elastic / beats-tester

E2E tests for the Beats
18 stars 22 forks source link

Update registry path for 7.9 #166

Closed v1v closed 4 years ago

v1v commented 4 years ago

The registry path changed in https://github.com/elastic/beats/pull/19633

Otherwise:

Error
file not found: /var/lib/filebeat/registry/filebeat/data.json
Stacktrace
{
"changed": false, 
"msg": "file not found: /var/lib/filebeat/registry/filebeat/data.json"
}

Test locally


$ cat run-settings-jenkins.yml 
# Beats "jenkins" build artifacts.
# Published by: https://beats-ci.elastic.co/job/elastic+beats+master+package/
beats_url_base: https://snapshots.elastic.co/8.0.0-7025cc53/downloads/beats
apm_url_base: https://snapshots.elastic.co/8.0.0-7025cc53/downloads/apm-server
version: 8.0.0-SNAPSHOT
$ RUN_SETTINGS=jenkins GROUPS=sles make batch
...
PLAY RECAP *************************************************************************************************************************************************************************************************
tester-sles12-64           : ok=382  changed=176  unreachable=0    failed=0    skipped=222  rescued=0    ignored=0   

vagrant destroy -f     tester-sles12-64
==> tester-sles12-64: Forcing shutdown of VM...
==> tester-sles12-64: Destroying VM and associated drives...
elasticmachine commented 4 years ago

:broken_heart: Build Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

#### Build stats * Build Cause: `[Started by user Victor Martinez]` * Start Time: 2020-09-02T11:57:41.520+0000 * Duration: 73 min 32 sec #### Test stats :test_tube: | Test | Results | | ------------ | :-----------------------------: | | Failed | 0 | | Passed | 4674 | | Skipped | 2736 | | Total | 7410 |

Steps errors

Expand to view the steps failures

* **Name**: `make batch` * Description: * Duration: 68 min 18 sec * Start Time: 2020-09-02T12:01:33.961+0000 * [log](https://beats-ci.elastic.co//blue/rest/organizations/jenkins/pipelines/Beats/pipelines/beats-tester-mbp/pipelines/PR-166/runs/3/steps/96/log) * **Name**: `Recursively delete the current directory from the workspace` * Description: script returned exit code 2 * Duration: 0 min 1 sec * Start Time: 2020-09-02T13:10:12.174+0000 * [log](https://beats-ci.elastic.co//blue/rest/organizations/jenkins/pipelines/Beats/pipelines/beats-tester-mbp/pipelines/PR-166/runs/3/steps/106/log)

Log output

Expand to view the last 100 lines of log output

``` [2020-09-02T13:09:48.974Z] tester-debian10-64: Selecting previously unselected package libio-html-perl. [2020-09-02T13:09:48.974Z] tester-debian10-64: Preparing to unpack .../18-libio-html-perl_1.001-1_all.deb ... [2020-09-02T13:09:48.974Z] tester-debian10-64: Unpacking libio-html-perl (1.001-1) ... [2020-09-02T13:09:48.974Z] tester-debian10-64: Selecting previously unselected package liblwp-mediatypes-perl. [2020-09-02T13:09:48.974Z] tester-debian10-64: Preparing to unpack .../19-liblwp-mediatypes-perl_6.02-1_all.deb ... [2020-09-02T13:09:48.974Z] tester-debian10-64: Unpacking liblwp-mediatypes-perl (6.02-1) ... [2020-09-02T13:09:48.974Z] tester-debian10-64: Selecting previously unselected package libhttp-message-perl. [2020-09-02T13:09:48.974Z] tester-debian10-64: Preparing to unpack .../20-libhttp-message-perl_6.18-1_all.deb ... [2020-09-02T13:09:48.974Z] tester-debian10-64: Unpacking libhttp-message-perl (6.18-1) ... [2020-09-02T13:09:48.974Z] tester-debian10-64: Selecting previously unselected package libio-string-perl. [2020-09-02T13:09:48.974Z] tester-debian10-64: Preparing to unpack .../21-libio-string-perl_1.08-3_all.deb ... [2020-09-02T13:09:48.974Z] tester-debian10-64: Unpacking libio-string-perl (1.08-3) ... [2020-09-02T13:09:48.975Z] tester-debian10-64: Selecting previously unselected package libparse-debianchangelog-perl. [2020-09-02T13:09:48.975Z] tester-debian10-64: Preparing to unpack .../22-libparse-debianchangelog-perl_1.2.0-13_all.deb ... [2020-09-02T13:09:48.975Z] tester-debian10-64: Unpacking libparse-debianchangelog-perl (1.2.0-13) ... [2020-09-02T13:09:48.975Z] tester-debian10-64: Selecting previously unselected package python-apt. [2020-09-02T13:09:48.975Z] tester-debian10-64: Preparing to unpack .../23-python-apt_1.8.4.1_amd64.deb ... [2020-09-02T13:09:48.975Z] tester-debian10-64: Unpacking python-apt (1.8.4.1) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up libxapian30:amd64 (1.4.11-1) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up libhtml-tagset-perl (3.20-3) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up liblwp-mediatypes-perl (6.02-1) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up python-apt (1.8.4.1) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up libencode-locale-perl (1.05-1) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up libio-string-perl (1.08-3) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up libsigc++-2.0-0v5:amd64 (2.10.1-2) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up aptitude-common (0.8.11-7) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up libio-html-perl (1.001-1) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up libboost-iostreams1.67.0:amd64 (1.67.0-13+deb10u1) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up libtimedate-perl (2.3000-2+deb10u1) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up libsub-name-perl (0.21-1+b3) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up libfcgi-perl (0.78-2+b3) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up libboost-system1.67.0:amd64 (1.67.0-13+deb10u1) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up libclass-accessor-perl (0.51-1) ... [2020-09-02T13:09:49.682Z] tester-debian10-64: Setting up liburi-perl (1.76-1) ... [2020-09-02T13:09:49.683Z] tester-debian10-64: Setting up libcwidget3v5:amd64 (0.5.17-11) ... [2020-09-02T13:09:49.683Z] tester-debian10-64: Setting up libhttp-date-perl (6.02-1) ... [2020-09-02T13:09:49.683Z] tester-debian10-64: Setting up aptitude (0.8.11-7) ... [2020-09-02T13:09:49.683Z] tester-debian10-64: update-alternatives: [2020-09-02T13:09:49.683Z] tester-debian10-64: using /usr/bin/aptitude-curses to provide /usr/bin/aptitude (aptitude) in auto mode [2020-09-02T13:09:49.683Z] tester-debian10-64: Setting up libhtml-parser-perl (3.72-3+b3) ... [2020-09-02T13:09:49.683Z] tester-debian10-64: Setting up libhttp-message-perl (6.18-1) ... [2020-09-02T13:09:49.683Z] tester-debian10-64: Setting up libcgi-pm-perl (4.40-1) ... [2020-09-02T13:09:49.683Z] tester-debian10-64: Setting up libparse-debianchangelog-perl (1.2.0-13) ... [2020-09-02T13:09:49.683Z] tester-debian10-64: Setting up libcgi-fast-perl (1:2.13-1) ... [2020-09-02T13:09:49.683Z] tester-debian10-64: Processing triggers for man-db (2.8.5-2) ... [2020-09-02T13:09:50.393Z] tester-debian10-64: Processing triggers for libc-bin (2.28-10) ... [2020-09-02T13:09:50.393Z] ==> tester-ubuntu1204-32: Box 'ubuntu/precise32' could not be found. Attempting to find and install... [2020-09-02T13:09:50.393Z] tester-ubuntu1204-32: Box Provider: virtualbox [2020-09-02T13:09:50.393Z] tester-ubuntu1204-32: Box Version: >= 0 [2020-09-02T13:09:51.867Z] The box 'ubuntu/precise32' could not be found or [2020-09-02T13:09:51.867Z] could not be accessed in the remote catalog. If this is a private [2020-09-02T13:09:51.867Z] box on HashiCorp's Vagrant Cloud, please verify you're logged in via [2020-09-02T13:09:51.867Z] `vagrant login`. Also, please double-check the name. The expanded [2020-09-02T13:09:51.867Z] URL and error message are shown below: [2020-09-02T13:09:51.867Z] [2020-09-02T13:09:51.867Z] URL: ["https://vagrantcloud.com/ubuntu/precise32"] [2020-09-02T13:09:51.867Z] Error: The requested URL returned error: 404 Not Found [2020-09-02T13:09:51.867Z] Makefile:36: recipe for target 'run-group' failed [2020-09-02T13:09:51.867Z] make[1]: *** [run-group] Error 1 [2020-09-02T13:09:51.867Z] make[1]: Leaving directory '/var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-166/src' [2020-09-02T13:09:51.867Z] Makefile:29: recipe for target 'batch' failed [2020-09-02T13:09:51.867Z] make: *** [batch] Error 1 [2020-09-02T13:09:52.230Z] Post stage [2020-09-02T13:09:52.245Z] Running in /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-166/src [2020-09-02T13:09:52.372Z] Recording test results [2020-09-02T13:09:54.440Z] Archiving artifacts [2020-09-02T13:09:56.691Z] + make clean [2020-09-02T13:09:56.691Z] vagrant destroy -f [2020-09-02T13:10:03.134Z] ==> tester-ubuntu2004-64: VM not created. Moving on... [2020-09-02T13:10:03.842Z] ==> tester-debian10-64: Forcing shutdown of VM... [2020-09-02T13:10:05.312Z] ==> tester-debian10-64: Destroying VM and associated drives... [2020-09-02T13:10:06.021Z] ==> tester-win19-64: VM not created. Moving on... [2020-09-02T13:10:06.021Z] ==> tester-centos8-64: VM not created. Moving on... [2020-09-02T13:10:06.022Z] ==> tester-awslinux2: VM not created. Moving on... [2020-09-02T13:10:06.022Z] ==> tester-ubuntu1804-64: VM not created. Moving on... [2020-09-02T13:10:06.022Z] ==> tester-ubuntu1404-64: VM not created. Moving on... [2020-09-02T13:10:06.022Z] ==> tester-sles12-64: VM not created. Moving on... [2020-09-02T13:10:06.731Z] ==> tester-debian9-64: Forcing shutdown of VM... [2020-09-02T13:10:08.202Z] ==> tester-debian9-64: Destroying VM and associated drives... [2020-09-02T13:10:08.910Z] ==> tester-awslinux: VM not created. Moving on... [2020-09-02T13:10:08.910Z] ==> tester-ubuntu1604-64: VM not created. Moving on... [2020-09-02T13:10:08.910Z] ==> tester-win12-64: VM not created. Moving on... [2020-09-02T13:10:08.910Z] ==> tester-centos7-64: VM not created. Moving on... [2020-09-02T13:10:09.621Z] ==> tester-debian8-64: Forcing shutdown of VM... [2020-09-02T13:10:11.092Z] ==> tester-debian8-64: Destroying VM and associated drives... [2020-09-02T13:10:11.092Z] ==> tester-ubuntu1204-32: VM not created. Moving on... [2020-09-02T13:10:11.805Z] ==> tester-centos6-64: VM not created. Moving on... [2020-09-02T13:10:11.805Z] ==> tester-centos6-32: VM not created. Moving on... [2020-09-02T13:10:11.805Z] Makefile:71: recipe for target 'clean' failed [2020-09-02T13:10:11.805Z] make: [clean] Error 2 (ignored) [2020-09-02T13:10:11.805Z] rm -r .vagrant [2020-09-02T13:10:13.208Z] Failed in branch Matrix - GROUPS = 'centos debian sles windows' [2020-09-02T13:10:13.441Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-166 [2020-09-02T13:10:13.515Z] [INFO] getVaultSecret: Getting secrets [2020-09-02T13:10:13.576Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID [2020-09-02T13:10:14.261Z] + chmod 755 generate-build-data.sh [2020-09-02T13:10:14.261Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-166/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-166/runs/3 FAILURE 4352477 [2020-09-02T13:10:14.261Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-166/runs/3/steps/?limit=10000 -o steps-info.json [2020-09-02T13:10:14.812Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-166/runs/3/tests/?status=FAILED -o tests-errors.json [2020-09-02T13:10:15.362Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-tester-mbp/PR-166/runs/3/log/ -o pipeline-log.txt ```

v1v commented 4 years ago

Environmental issue when fetching the vagrant boxes, since it runs on batches, the first batch worked as expected:

[2020-09-02T12:52:53.044Z] PLAY RECAP *********************************************************************
[2020-09-02T12:52:53.044Z] tester-awslinux            : ok=376  changed=177  unreachable=0    failed=0    skipped=228  rescued=0    ignored=0   
[2020-09-02T12:52:53.044Z] tester-awslinux2           : ok=376  changed=177  unreachable=0    failed=0    skipped=228  rescued=0    ignored=0   
[2020-09-02T12:52:53.044Z] tester-centos6-32          : ok=376  changed=177  unreachable=0    failed=0    skipped=228  rescued=0    ignored=0   
[2020-09-02T12:52:53.045Z] tester-centos6-64          : ok=376  changed=177  unreachable=0    failed=0    skipped=228  rescued=0    ignored=0   
[2020-09-02T12:52:53.045Z] tester-centos7-64          : ok=376  changed=177  unreachable=0    failed=0    skipped=228  rescued=0    ignored=0   
[2020-09-02T12:52:53.045Z] tester-centos8-64          : ok=376  changed=177  unreachable=0    failed=0    skipped=228  rescued=0    ignored=0