search

elastic / beats-tester

E2E tests for the Beats
18 stars 22 forks source link

Update debian 9 base image #222

Closed joshdover closed 1 year ago

joshdover commented 1 year ago

Tests are currently failing with errors like:

[2023-05-09T11:29:48.765Z]     tester-debian9-64: Ign:1 http://deb.debian.org/debian stretch InRelease

[2023-05-09T11:29:48.765Z]     tester-debian9-64: Ign:2 http://security.debian.org/debian-security stretch/updates InRelease

[2023-05-09T11:29:48.765Z]     tester-debian9-64: Err:3 http://deb.debian.org/debian stretch Release

[2023-05-09T11:29:48.765Z]     tester-debian9-64:   404  Not Found [IP: 146.75.122.132 80]

[2023-05-09T11:29:48.865Z]     tester-debian9-64: Err:4 http://security.debian.org/debian-security stretch/updates Release

[2023-05-09T11:29:48.865Z]     tester-debian9-64:   404  Not Found [IP: 146.75.122.132 80]

[2023-05-09T11:29:48.865Z]     tester-debian9-64: Reading package lists...

[2023-05-09T11:29:49.567Z]     tester-debian9-64: E

[2023-05-09T11:29:49.567Z]     tester-debian9-64: : 

[2023-05-09T11:29:49.567Z]     tester-debian9-64: The repository 'http://deb.debian.org/debian stretch Release' does no longer have a Release file.

[2023-05-09T11:29:49.567Z]     tester-debian9-64: E

[2023-05-09T11:29:49.567Z]     tester-debian9-64: : 

[2023-05-09T11:29:49.567Z]     tester-debian9-64: The repository 'http://security.debian.org/debian-security stretch/updates Release' does no longer have a Release file.

Uses an updated Debian 9 image which should have a mirror list that points to existing mirrors.

elasticmachine commented 1 year ago

:broken_heart: Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

#### Build stats * Start Time: 2023-05-11T13:58:00.435+0000 * Duration: 9 min 38 sec #### Test stats :test_tube: | Test | Results | | ------------ | :-----------------------------: | | Failed | 9 | | Passed | 34 | | Skipped | 178 | | Total | 221 |

Test errors 9

Expand to view the tests failures

##### `Test Hosts / Matrix - GROUPS = 'debian' / Test / [tester-ubuntu1804-64] Packaging tests Packetbeat: common : Download package with checksum (linux/darwin) url={{beat_url}}, dest={{workdir}}, validate_certs=False, timeout=60, checksum=sha512:{{ beat_sha512.split()[0] }} – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-222/src/roles/common/tasks/download.yml:1`

    Expand to view the error details

    ``` An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-amd64.deb.sha512 : HTTP Error 404: Not Found ```

    Expand to view the stacktrace

    ``` { "msg": "An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-amd64.deb.sha512 : HTTP Error 404: Not Found" } ```

##### `Test Hosts / Matrix - GROUPS = 'debian' / Test / [tester-debian9-64] Packaging tests Packetbeat: common : Download package with checksum (linux/darwin) url={{beat_url}}, dest={{workdir}}, validate_certs=False, timeout=60, checksum=sha512:{{ beat_sha512.split()[0] }} – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-222/src/roles/common/tasks/download.yml:1`
    Expand to view the error details

    ``` An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-amd64.deb.sha512 : HTTP Error 404: Not Found ```

    Expand to view the stacktrace

    ``` { "msg": "An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-amd64.deb.sha512 : HTTP Error 404: Not Found" } ```

##### `Test Hosts / Matrix - GROUPS = 'debian' / Test / [tester-debian10-64] Packaging tests Packetbeat: common : Download package with checksum (linux/darwin) url={{beat_url}}, dest={{workdir}}, validate_certs=False, timeout=60, checksum=sha512:{{ beat_sha512.split()[0] }} – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-222/src/roles/common/tasks/download.yml:1`
    Expand to view the error details

    ``` An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-amd64.deb.sha512 : HTTP Error 404: Not Found ```

    Expand to view the stacktrace

    ``` { "msg": "An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-amd64.deb.sha512 : HTTP Error 404: Not Found" } ```

##### `Test Hosts / Matrix - GROUPS = 'debian' / Test / [tester-ubuntu2004-64] Packaging tests Packetbeat: common : Download package with checksum (linux/darwin) url={{beat_url}}, dest={{workdir}}, validate_certs=False, timeout=60, checksum=sha512:{{ beat_sha512.split()[0] }} – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-222/src/roles/common/tasks/download.yml:1`
    Expand to view the error details

    ``` An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-amd64.deb.sha512 : HTTP Error 404: Not Found ```

    Expand to view the stacktrace

    ``` { "msg": "An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-amd64.deb.sha512 : HTTP Error 404: Not Found" } ```

##### `Test Hosts / Matrix - GROUPS = 'centos' / Test / [tester-awslinux] Packaging tests Packetbeat: common : Download package with checksum (linux/darwin) url={{beat_url}}, dest={{workdir}}, validate_certs=False, timeout=60, checksum=sha512:{{ beat_sha512.split()[0] }} – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-222/src/roles/common/tasks/download.yml:1`
    Expand to view the error details

    ``` An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-x86_64.rpm.sha512 : HTTP Error 404: Not Found ```

    Expand to view the stacktrace

    ``` { "msg": "An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-x86_64.rpm.sha512 : HTTP Error 404: Not Found" } ```

##### `Test Hosts / Matrix - GROUPS = 'centos' / Test / [tester-awslinux2] Packaging tests Packetbeat: common : Download package with checksum (linux/darwin) url={{beat_url}}, dest={{workdir}}, validate_certs=False, timeout=60, checksum=sha512:{{ beat_sha512.split()[0] }} – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-222/src/roles/common/tasks/download.yml:1`
    Expand to view the error details

    ``` An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-x86_64.rpm.sha512 : HTTP Error 404: Not Found ```

    Expand to view the stacktrace

    ``` { "msg": "An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-x86_64.rpm.sha512 : HTTP Error 404: Not Found" } ```

##### `Test Hosts / Matrix - GROUPS = 'centos' / Test / [tester-centos7-64] Packaging tests Packetbeat: common : Download package with checksum (linux/darwin) url={{beat_url}}, dest={{workdir}}, validate_certs=False, timeout=60, checksum=sha512:{{ beat_sha512.split()[0] }} – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-222/src/roles/common/tasks/download.yml:1`
    Expand to view the error details

    ``` An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-x86_64.rpm.sha512 : HTTP Error 404: Not Found ```

    Expand to view the stacktrace

    ``` { "msg": "An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-x86_64.rpm.sha512 : HTTP Error 404: Not Found" } ```

##### `Test Hosts / Matrix - GROUPS = 'sles' / Test / [tester-sles12-64] Packaging tests Packetbeat: common : Download package with checksum (linux/darwin) url={{beat_url}}, dest={{workdir}}, validate_certs=False, timeout=60, checksum=sha512:{{ beat_sha512.split()[0] }} – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-222/src/roles/common/tasks/download.yml:1`
    Expand to view the error details

    ``` An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-x86_64.rpm.sha512 : HTTP Error 404: Not Found ```

    Expand to view the stacktrace

    ``` { "msg": "An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/packetbeat/packetbeat-8.7.0-SNAPSHOT-x86_64.rpm.sha512 : HTTP Error 404: Not Found" } ```

##### `Test Hosts / Matrix - GROUPS = 'windows' / Test / [tester-win12-64] Packaging windows x86_64 tests for Metricbeat: common : Download package with checksum (windows) url={{beat_url}}, dest={{workdir}}, validate_certs=False, timeout=60, checksum={{ win_beat_sha512.split()[0] }}, checksum_algorithm=sha512 – /var/lib/jenkins/workspace/Beats_beats-tester-mbp_PR-222/src/roles/common/tasks/download.yml:12`
    Expand to view the error details

    ``` An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/metricbeat/metricbeat-8.7.0-SNAPSHOT-windows-x86_64.zip.sha512 : HTTP Error 404: Not Found ```

    Expand to view the stacktrace

    ``` { "msg": "An unhandled exception occurred while templating '{{ lookup('url', beat_url + '.sha512', split_lines=False, force=True) | trim }}'. Error was a , original message: An unhandled exception occurred while running the lookup plugin 'url'. Error was a , original message: Received HTTP error for https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots/metricbeat/metricbeat-8.7.0-SNAPSHOT-windows-x86_64.zip.sha512 : HTTP Error 404: Not Found" } ```

Steps errors 5

Expand to view the steps failures

##### `make batch`

  • Took 2 min 27 sec . View more details here
  • Description: #!/bin/bash ## Skip BEATS if no params. if [[ "https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots" != "null" && -n "https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots" ]] ; then echo "beats_url_base: https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots" > run-settings-jenkins.yml else ANSIBLE_EXTRA_FLAGS="--skip-tags beats" fi echo "version: 8.7.0-SNAPSHOT" >> run-settings-jenkins.yml ANSIBLE_EXTRA_FLAGS=${ANSIBLE_EXTRA_FLAGS} RUN_SETTINGS=jenkins make batch
##### `make batch`
  • Took 4 min 24 sec . View more details here
  • Description: #!/bin/bash ## Skip BEATS if no params. if [[ "https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots" != "null" && -n "https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots" ]] ; then echo "beats_url_base: https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots" > run-settings-jenkins.yml else ANSIBLE_EXTRA_FLAGS="--skip-tags beats" fi echo "version: 8.7.0-SNAPSHOT" >> run-settings-jenkins.yml ANSIBLE_EXTRA_FLAGS=${ANSIBLE_EXTRA_FLAGS} RUN_SETTINGS=jenkins make batch
##### `make batch`
  • Took 2 min 45 sec . View more details here
  • Description: #!/bin/bash ## Skip BEATS if no params. if [[ "https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots" != "null" && -n "https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots" ]] ; then echo "beats_url_base: https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots" > run-settings-jenkins.yml else ANSIBLE_EXTRA_FLAGS="--skip-tags beats" fi echo "version: 8.7.0-SNAPSHOT" >> run-settings-jenkins.yml ANSIBLE_EXTRA_FLAGS=${ANSIBLE_EXTRA_FLAGS} RUN_SETTINGS=jenkins make batch
##### `make batch`
  • Took 2 min 39 sec . View more details here
  • Description: #!/bin/bash ## Skip BEATS if no params. if [[ "https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots" != "null" && -n "https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots" ]] ; then echo "beats_url_base: https://storage.googleapis.com/beats-ci-artifacts/beats/snapshots" > run-settings-jenkins.yml else ANSIBLE_EXTRA_FLAGS="--skip-tags beats" fi echo "version: 8.7.0-SNAPSHOT" >> run-settings-jenkins.yml ANSIBLE_EXTRA_FLAGS=${ANSIBLE_EXTRA_FLAGS} RUN_SETTINGS=jenkins make batch
##### `Recursively delete the current directory from the workspace`
  • Took 0 min 0 sec . View more details here
  • Description: script returned exit code 2

:robot: GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with: - `/test` : Re-trigger the build.

joshdover commented 1 year ago

Need to update security repo too: https://unix.stackexchange.com/questions/744401/security-repo-for-debian-stretch-not-working-anymore

joshdover commented 1 year ago

I can't get vagrant to bring this machine up locally, I suspect because I'm using an M1 machine. Will find someone else with an Intel machine to fix this up.

michalpristas commented 1 year ago

do note merge i'm testing this

michalpristas commented 1 year ago

now it works

joshdover commented 1 year ago

This is now failing because the tests are trying to fetch snapshot versions that no longer exist. Will fix that in separate PR