search

elastic / logstash

Logstash - transport and process your logs, events, or other data
https://www.elastic.co/products/logstash
Other
14.2k stars 3.5k forks source link

aarch64 docker acceptance test fail #14301

Open kaisecheng opened 2 years ago

kaisecheng commented 2 years ago

Both full & oss aarch64 docker acceptance tests fail in main

[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path '.ci/java-versions.properties'
[EnvInject] - Variables injected successfully.
[EnvInject] - Injecting as environment variables the properties content
BUILD_JAVA_HOME=/var/lib/jenkins/.java/$LS_BUILD_JAVA
RUNTIME_JAVA_HOME=/var/lib/jenkins/.java/$LS_RUNTIME_JAVA

[EnvInject] - Variables injected successfully.
[aarch64] $ /usr/local/bin/runbld /tmp/jenkins2391955707350290924.sh
Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 -Dsun.jnu.encoding=UTF8
runbld>>> runbld started
runbld>>> 7.0.2/2eb54561e59ea0147404177885daac8cf658ae7b
runbld>>> The following profiles matched the job 'elastic+logstash+main+multijob-aarch64-docker-acceptance/flavor=full,nodes=aarch64' in order of occurrence in the config (last value wins).
runbld>>> Matches in the system config:
runbld>>> - Matched ^elastic\+logstash
runbld>>> Debug logging enabled.
runbld>>> Storing result
runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
runbld>>> BUILD: https://ci-stats.es.us-central1.gcp.cloud.es.io:9243/build/_doc/20220624195244-EA453AB6
runbld>>> Adding system facts.
runbld>>> Platform: ubuntu
runbld>>> Platform: ubuntu
runbld>>> Adding vcs info for the latest commit:  850570d0f31ce1abf83c7b500f68a811113e599a
runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
runbld>>> Adding /usr/lib/jvm/java-8-openjdk-arm64/bin to the path.
+ export PATH=/var/lib/jenkins/.rbenv/bin:/usr/lib/jvm/java-8-openjdk-arm64/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/sbin:/bin:/sbin
+ PATH=/var/lib/jenkins/.rbenv/bin:/usr/lib/jvm/java-8-openjdk-arm64/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/sbin:/bin:/sbin
++ rbenv init -
+ eval 'export PATH="/var/lib/jenkins/.rbenv/shims:${PATH}"
export RBENV_SHELL=bash
source '\''/var/lib/jenkins/.rbenv/libexec/../completions/rbenv.bash'\''
command rbenv rehash 2>/dev/null
rbenv() {
  local command
  command="$1"
  if [ "$#" -gt 0 ]; then
    shift
  fi

  case "$command" in
  rehash|shell)
    eval "$(rbenv "sh-$command" "$@")";;
  *)
    command rbenv "$command" "$@";;
  esac
}'
++ export PATH=/var/lib/jenkins/.rbenv/shims:/var/lib/jenkins/.rbenv/bin:/usr/lib/jvm/java-8-openjdk-arm64/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/sbin:/bin:/sbin
++ PATH=/var/lib/jenkins/.rbenv/shims:/var/lib/jenkins/.rbenv/bin:/usr/lib/jvm/java-8-openjdk-arm64/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/sbin:/bin:/sbin
++ export RBENV_SHELL=bash
++ RBENV_SHELL=bash
++ source /var/lib/jenkins/.rbenv/libexec/../completions/rbenv.bash
+++ complete -F _rbenv rbenv
++ command rbenv rehash
+ ci/docker_acceptance_tests.sh full
+ export JRUBY_OPTS=-J-Xmx1g
+ JRUBY_OPTS=-J-Xmx1g
+ export 'GRADLE_OPTS=-Xmx4g -Dorg.gradle.daemon=false -Dorg.gradle.logging.level=info -Dfile.encoding=UTF-8'
+ GRADLE_OPTS='-Xmx4g -Dorg.gradle.daemon=false -Dorg.gradle.logging.level=info -Dfile.encoding=UTF-8'
+ '[' -n /var/lib/jenkins/.java/openjdk11 ']'
+ GRADLE_OPTS='-Xmx4g -Dorg.gradle.daemon=false -Dorg.gradle.logging.level=info -Dfile.encoding=UTF-8 -Dorg.gradle.java.home=/var/lib/jenkins/.java/openjdk11'
+ SELECTED_TEST_SUITE=full
+ '[' -f Gemfile ']'
+ '[' -f Gemfile.lock ']'
+ LS_HOME=/var/lib/jenkins/workspace/elastic+logstash+main+multijob-aarch64-docker-acceptance/flavor/full/nodes/aarch64
+ QA_DIR=/var/lib/jenkins/workspace/elastic+logstash+main+multijob-aarch64-docker-acceptance/flavor/full/nodes/aarch64/qa
+ cd /var/lib/jenkins/workspace/elastic+logstash+main+multijob-aarch64-docker-acceptance/flavor/full/nodes/aarch64/qa
+ bundle check
Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 -Dsun.jnu.encoding=UTF8
The git source https://github.com/purbon/runner-tool.git is not yet checked out.
Please run `bundle install` before trying to start your application
+ bundle install
Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 -Dsun.jnu.encoding=UTF8
Fetching https://github.com/purbon/runner-tool.git
Fetching gem metadata from https://rubygems.org/......
Resolving dependencies..........
Fetching rake 13.0.6
Installing rake 13.0.6
Using bundler 2.2.29
Fetching diff-lcs 1.5.0
Fetching coderay 1.1.3
Fetching multi_json 1.15.0
Fetching excon 0.92.3
Installing multi_json 1.15.0
Installing coderay 1.1.3
Installing diff-lcs 1.5.0
Installing excon 0.92.3
Fetching ffi 1.15.5 (java)
Installing ffi 1.15.5 (java)
Fetching method_source 1.0.0
Fetching rspec-support 3.1.2
Fetching net-ssh 2.9.4
Installing method_source 1.0.0
Installing rspec-support 3.1.2
Installing net-ssh 2.9.4
Fetching stud 0.0.23
Installing stud 0.0.23
Fetching docker-api 2.2.0
Fetching rspec-core 3.1.7
Installing docker-api 2.2.0
Installing rspec-core 3.1.7
Fetching rspec-expectations 3.1.2
Fetching rspec-mocks 3.1.3
Installing rspec-expectations 3.1.2
Installing rspec-mocks 3.1.3
Fetching spoon 0.0.6
Installing spoon 0.0.6
Fetching pry 0.14.1 (java)
Fetching rspec 3.1.0
Fetching net-scp 1.2.1
Installing rspec 3.1.0
Installing pry 0.14.1 (java)
Installing net-scp 1.2.1
Using runner-tool 0.2.0 from https://github.com/purbon/runner-tool.git (at master@5ec0803)
Bundle complete! 6 Gemfile dependencies, 20 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.
+ echo 'Building Logstash artifacts'
+ cd /var/lib/jenkins/workspace/elastic+logstash+main+multijob-aarch64-docker-acceptance/flavor/full/nodes/aarch64
Building Logstash artifacts
building full docker images
+ [[ full == \o\s\s ]]
+ [[ full == \f\u\l\l ]]
+ echo 'building full docker images'
+ cd /var/lib/jenkins/workspace/elastic+logstash+main+multijob-aarch64-docker-acceptance/flavor/full/nodes/aarch64
+ rake artifact:docker
Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 -Dsun.jnu.encoding=UTF8
Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8 -Dsun.jnu.encoding=UTF8
Downloading https://services.gradle.org/distributions/gradle-7.3.1-bin.zip
...........10%...........20%...........30%...........40%...........50%...........60%...........70%...........80%...........90%...........100%
Initialized native services in: /var/lib/jenkins/.gradle/native
Initialized jansi services in: /var/lib/jenkins/.gradle/native

Welcome to Gradle 7.3.1!

Here are the highlights of this release:
 - Easily declare new test suites in Java projects
 - Support for Java 17
 - Support for Scala 3

For more details see https://docs.gradle.org/7.3.1/release-notes.html

FAILURE: Build failed with an exception.

* What went wrong:
Value '/var/lib/jenkins/.java/openjdk11' given for org.gradle.java.home Gradle property is invalid (Java home supplied is invalid)

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org
/var/lib/jenkins/workspace/elastic+logstash+main+multijob-aarch64-docker-acceptance/flavor/full/nodes/aarch64/bin/ruby: 83: cd: can't cd to /var/lib/jenkins/workspace/elastic+logstash+main+multijob-aarch64-docker-acceptance/flavor/full/nodes/aarch64/logstash-core/lib/jars
ls: cannot access '*.jar': No such file or directory
Using system java: /usr/lib/jvm/java-8-openjdk-arm64/bin/java
warning: ignoring JAVA_TOOL_OPTIONS=-Dfile.encoding=UTF8 -Dsun.jnu.encoding=UTF8
Error: Could not find or load main class org.logstash.launchers.JvmOptionsParser
runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
runbld>>> DURATION: 34469ms
runbld>>> STDOUT: 2102 bytes
runbld>>> STDERR: 3787 bytes
runbld>>> WRAPPED PROCESS: FAILURE (1)
runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/elastic+logstash+main+multijob-aarch64-docker-acceptance/flavor/full/nodes/aarch64
runbld>>> Storing build metadata:
runbld>>> Adding test report.
runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/elastic+logstash+main+multijob-aarch64-docker-acceptance/flavor/full/nodes/aarch64
runbld>>> Found 0 test output files
runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 0 Skipped: 0
runbld>>> Storing result
runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
runbld>>> BUILD: https://ci-stats.es.us-central1.gcp.cloud.es.io:9243/build/_doc/20220624195244-EA453AB6
runbld>>> MAILING: build-logstash@e***.co
runbld>>> Mail sent.  Output: {:code 0, :error :SUCCESS, :message "messages sent"}

runbld>>> NOTIFYING SLACK
Build step 'Execute shell' marked build as failure
Sending e-mails to: infra-root+build@elastic.co
Finished: FAILURE

The environment uses jdk8 instead of jdk11 runbld>>> Adding /usr/lib/jvm/java-8-openjdk-arm64/bin to the path

kaisecheng commented 2 years ago

maybe missing the following in aarch64.yml ?

LS_JAVA_HOME=${{BUILD_JAVA_HOME}}
JAVA_HOME=${{BUILD_JAVA_HOME}}