search

eclipse-openj9 / openj9

Eclipse OpenJ9: A Java Virtual Machine for OpenJDK that's optimized for small footprint, fast start-up, and high throughput. Builds on Eclipse OMR (https://github.com/eclipse/omr) and combines with the Extensions for OpenJDK for OpenJ9 repo.
Other
3.28k stars 721 forks source link

aarch64 mac Illegal instruction building system tests #15331

Closed pshipton closed 2 years ago

pshipton commented 2 years ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk11_j9_sanity.system_aarch64_mac_Nightly_testList_1/78

No diagnostics, just the compilation log. https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk11_j9_sanity.system_aarch64_mac_Nightly_testList_1/78/system_test_output.tar.gz

23:25:58  BUILD SUCCESSFUL
23:25:58  Total time: 56 seconds
23:25:58  /bin/sh: line 1:  4500 Illegal instruction: 4  ant -f scripts/build_test.xml -DTEST_ROOT=/Users/****/workspace/Test_openjdk11_j9_sanity.system_aarch64_mac_Nightly_testList_1/aqa-tests/TKG/.. -DBUILD_ROOT=/Users/****/workspace/Test_openjdk11_j9_sanity.system_aarch64_mac_Nightly_testList_1/aqa-tests/TKG/../../jvmtest -DJDK_VERSION=11 -DJDK_IMPL=openj9 -DJCL_VERSION=latest -DBUILD_LIST=system -DRESOURCES_DIR=/Users/****/workspace/Test_openjdk11_j9_sanity.system_aarch64_mac_Nightly_testList_1/aqa-tests/TKG/../../jvmtest/TestConfig/resources -DSPEC=osx_aarch64_nocmprssptrs -DTEST_JDK_HOME=/Users/****/workspace/Test_openjdk11_j9_sanity.system_aarch64_mac_Nightly_testList_1/openjdkbinary/j2sdk-image -DJVM_VERSION=openjdk11-openj9 -DLIB_DIR=/Users/****/workspace/Test_openjdk11_j9_sanity.system_aarch64_mac_Nightly_testList_1/aqa-tests/TKG/../TKG/lib 2>&1
23:25:58  132
23:25:58  make[1]: *** [compile] Error 1
23:25:58  make: *** [compile] Error 2
[Pipeline] }
23:25:58  $ ssh-agent -k
23:25:58  unset SSH_AUTH_SOCK;
23:25:58  unset SSH_AGENT_PID;
23:25:58  echo Agent pid 4372 killed;
23:25:59  [ssh-agent] Stopped.

@knn-k fyi

knn-k commented 2 years ago

No register dump, core, nor javacore files are available in the artifact.

pshipton commented 2 years ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_1/22/ - mac11-aarch64-6 TestAttachAPI_0 -Xshareclasses:name=test_aot -Xscmx400M -Xscmaxaot256m

No diagnostics. This is similar to the "Invalid JIT return address" problem https://github.com/eclipse-openj9/openj9/issues/14717 that occurs after tests are finished.

===============================================
GeneralTest suite
Total tests run: 27, Failures: 0, Skips: 0
===============================================

/bin/sh: line 1: 29913 Illegal instruction: 4  "/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_0/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:name=test_aot -Xscmx400M -Xscmaxaot256m -cp "/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_0/aqa-tests/TKG/../../jvmtest/TestConfig/resources:/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_0/aqa-tests/TKG/../TKG/lib/testng.jar:/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_0/aqa-tests/TKG/../TKG/lib/jcommander.jar:/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_0/aqa-tests/TKG/../../jvmtest/functional/Java8andUp/GeneralTest.jar" -Dcom.ibm.tools.attach.enable=yes -Dcom.ibm.tools.attach.timeout=15000 org.testng.TestNG -d "/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_0/aqa-tests/TKG/../TKG/output_16558058849486/TestAttachAPI_0_ITER_$itercnt" "/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_0/aqa-tests/TKG/../../jvmtest/functional/Java8andUp/testng.xml" -testnames TestAttachAPI -groups level.extended -excludegroups d.*.osx_aarch64_nocmprssptrs,d.*.arch.aarch,d.*.os.osx,d.*.bits.64,d.*.generic-all

TestAttachAPI_0_FAILED(ITER_2)
pshipton commented 2 years ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.openjdk_aarch64_mac_Personal/1/console - mac11-aarch64-3

12:46:17  + make _sanity.openjdk
12:46:17  JAVA_HOME is set to /Users/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_aarch64_mac_Personal/openjdkbinary/j2sdk-image
12:46:17  /Applications/Xcode.app/Contents/Developer/usr/bin/make -f makeGen.mk AUTO_DETECT=true MODE=tests TESTTARGET=sanity.openjdk TESTLIST=
12:46:17  perl scripts/configure.pl
12:46:17  /Users/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_aarch64_mac_Personal/openjdkbinary/j2sdk-image/bin/java -cp "./bin/TestKitGen.jar:./lib/json-simple.jar" org.testKitGen.MainRunner --mode=tests --spec=osx_aarch64_nocmprssptrs --jdkVersion=17 --impl=openj9 --vendor="eclipse" --buildList=openjdk --iterations=1 --testFlag= --testTarget=sanity.openjdk --testList= --numOfMachines= --testTime= --TRSSURL= 
12:46:17  Modes data parsed from resources/modes.xml and resources/ottawa.csv.
12:46:17  
12:46:17  Starting to generate test make files.
12:46:17  
12:46:18  Parsing /Users/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_aarch64_mac_Personal/aqa-tests/TKG/../openjdk/playlist.xml
12:46:18  
12:46:18  Generated /Users/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_aarch64_mac_Personal/aqa-tests/TKG/../openjdk/autoGen.mk
12:46:18  
12:46:18  Generated /Users/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_aarch64_mac_Personal/aqa-tests/TKG/../autoGen.mk
12:46:18  
12:46:18  Generated /Users/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_aarch64_mac_Personal/aqa-tests/TKG/../TKG/utils.mk
12:46:18  
12:46:18  Make files are generated successfully.
12:46:18  
12:46:18  make[1]: *** [autogen] Illegal instruction: 4
12:46:18  make: *** [_sanity.openjdk] Error 2
pshipton commented 2 years ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.system_aarch64_mac_Nightly_testList_2/104 - mac11-aarch64-2

20:19:45  BUILD SUCCESSFUL
20:19:45  Total time: 1 minute 6 seconds
20:19:45  /bin/sh: line 1: 22222 Illegal instruction: 4  ant -f scripts/build_test.xml -DTEST_ROOT=/Users/****/workspace/Test_openjdk17_j9_sanity.system_aarch64_mac_Nightly_testList_2/aqa-tests/TKG/.. -DBUILD_ROOT=/Users/****/workspace/Test_openjdk17_j9_sanity.system_aarch64_mac_Nightly_testList_2/aqa-tests/TKG/../../jvmtest -DJDK_VERSION=17 -DJDK_IMPL=openj9 -DJCL_VERSION=latest -DBUILD_LIST=system -DRESOURCES_DIR=/Users/****/workspace/Test_openjdk17_j9_sanity.system_aarch64_mac_Nightly_testList_2/aqa-tests/TKG/../../jvmtest/TestConfig/resources -DSPEC=osx_aarch64_nocmprssptrs -DTEST_JDK_HOME=/Users/****/workspace/Test_openjdk17_j9_sanity.system_aarch64_mac_Nightly_testList_2/openjdkbinary/j2sdk-image -DJVM_VERSION=openjdk17-openj9 -DLIB_DIR=/Users/****/workspace/Test_openjdk17_j9_sanity.system_aarch64_mac_Nightly_testList_2/aqa-tests/TKG/../TKG/lib 2>&1
pshipton commented 2 years ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk18_j9_sanity.system_aarch64_mac_Nightly_testList_2/101 - mac11-aarch64-4

No diagnostic files.

21:16:47  BUILD SUCCESSFUL
21:16:47  Total time: 1 minute 3 seconds
21:16:47  Unhandled exception
21:16:47  Type=Segmentation error vmState=0x00000000
21:16:47  J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000002
21:16:47  Handler1=000000010288E0F8 Handler2=00000001025F2E14 InaccessibleAddress=0000000000000038
21:16:47  x0=000000013282F260 x1=0000000000000000 x2=0000000000000002 x3=000000013282F30A
21:16:47  x4=0000000000000011 x5=0000000000000000 x6=0000000000000000 x7=0000000000000000
21:16:47  x8=0000000000000000 x9=0000000000000001 x10=0000000000000000 x11=0000000000000001
21:16:47  x12=00000000FFFFFFFF x13=0000000000007FBF x14=0000000000000001 x15=000000000000D536
21:16:47  x16=0000000192836654 x17=000000020118DAB0 x18=0000000000000000 x19=0000000000000038
21:16:47  x20=0000000131F0B7E0 x21=0000000000000010 x22=000000013282F220 x23=000000013282F248
21:16:47  x24=000000010273D000 x25=000000010258DE28 x26=0000000000000000 x27=0005E44678AE2214
21:16:47  x28=0000000132819468 x29(FP)=000000016DC6E940 x30(LR)=00000001027204C4 x31(SP)=000000016DC6E910
21:16:47  PC=000000010271C940 SP=000000016DC6E910
21:16:47  v0 ffffffffffffff00 (f: 4294967040.000000, d: nan)
21:16:47  v1 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v2 0706050403020100 (f: 50462976.000000, d: 7.949929e-275)
21:16:47  v3 0000000134854d00 (f: 881151232.000000, d: 2.557342e-314)
21:16:47  v4 0000000100000000 (f: 0.000000, d: 2.121996e-314)
21:16:47  v5 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v6 0000000100000001 (f: 1.000000, d: 2.121996e-314)
21:16:47  v7 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v8 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v9 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v10 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v11 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v13 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v16 0000000100000000 (f: 0.000000, d: 2.121996e-314)
21:16:47  v17 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v18 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v19 0000000000000002 (f: 2.000000, d: 9.881313e-324)
21:16:47  v20 00000000ffffffff (f: 4294967296.000000, d: 2.121996e-314)
21:16:47  v21 ffffffffffffffff (f: 4294967296.000000, d: nan)
21:16:47  v22 00000000ffffffff (f: 4294967296.000000, d: 2.121996e-314)
21:16:47  v23 ffffffffffffffff (f: 4294967296.000000, d: nan)
21:16:47  v24 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v25 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v26 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v27 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v28 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v29 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v30 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  v31 0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:16:47  Module=/Users/****/workspace/Test_openjdk18_j9_sanity.system_aarch64_mac_Nightly_testList_2/openjdkbinary/j2sdk-image/lib/default/libj9trc29.dylib
21:16:47  Module_base_address=0000000102710000 Symbol=freeBuffers
21:16:47  Symbol_address=000000010271C91C
21:16:47  Target=2_90_20220721_104 (Mac OS X 11.4)
21:16:47  CPU=aarch64 (8 logical CPUs) (0x400000000 RAM)
21:16:47  ----------- Stack Backtrace -----------
21:16:47  ---------------------------------------
21:16:47  JVMDUMP039I Processing dump event "gpf", detail "" at 2022/07/21 11:16:47 - please wait.
21:16:47  /bin/sh: line 1: 13955 Abort trap: 6           ant -f scripts/build_test.xml -DTEST_ROOT=/Users/****/workspace/Test_openjdk18_j9_sanity.system_aarch64_mac_Nightly_testList_2/aqa-tests/TKG/.. -DBUILD_ROOT=/Users/****/workspace/Test_openjdk18_j9_sanity.system_aarch64_mac_Nightly_testList_2/aqa-tests/TKG/../../jvmtest -DJDK_VERSION=18 -DJDK_IMPL=openj9 -DJCL_VERSION=latest -DBUILD_LIST=system -DRESOURCES_DIR=/Users/****/workspace/Test_openjdk18_j9_sanity.system_aarch64_mac_Nightly_testList_2/aqa-tests/TKG/../../jvmtest/TestConfig/resources -DSPEC=osx_aarch64_nocmprssptrs -DTEST_JDK_HOME=/Users/****/workspace/Test_openjdk18_j9_sanity.system_aarch64_mac_Nightly_testList_2/openjdkbinary/j2sdk-image -DJVM_VERSION=openjdk18-openj9 -DLIB_DIR=/Users/****/workspace/Test_openjdk18_j9_sanity.system_aarch64_mac_Nightly_testList_2/aqa-tests/TKG/../TKG/lib 2>&1
21:16:47  134
pshipton commented 2 years ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_1/32 testDDRExtJunit_StackMap_0

BUILD SUCCESSFUL
Total time: 11 seconds
/bin/sh: line 1: 86992 Illegal instruction: 4  ant -DJAVA_COMMAND="/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_1/openjdkbinary/j2sdk-image/bin/java" -DCOREGEN="j9vm.test.corehelper.StackMapCoreGenerator" -DTEST_ROOT=/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_1/aqa-tests/TKG/.. -DTEST_JDK_HOME=/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_1/openjdkbinary/j2sdk-image -DJDK_VERSION=17 -DTEST_RESROOT=/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_1/aqa-tests/TKG/../../jvmtest/functional/DDR_Test -DRESOURCES_DIR=/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_1/aqa-tests/TKG/../../jvmtest/TestConfig/resources -DREPORTDIR="/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_1/aqa-tests/TKG/../TKG/output_16588300514119/testDDRExtJunit_StackMap_0_ITER_$itercnt" -DOS=os.osx -DBITS=bits.64 -DLIB_DIR=/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_1/aqa-tests/TKG/../TKG/lib -Dtest.list="TestStackMap" -DEXTRADUMPOPT="-Xdump:system:events=throw,filter=*HelperExceptionForCoreGeneration*" -DADDITIONALEXPORTS=--add-exports=java.base/jdk.internal.org.objectweb.asm=ALL-UNNAMED -f ""/Users/jenkins/workspace/Test_openjdk17_j9_extended.functional_aarch64_mac_aot_Personal_testList_1/aqa-tests/TKG/../TKG/output_16588300514119/testDDRExtJunit_StackMap_0_ITER_$itercnt"/tck_ddrext.xml"

testDDRExtJunit_StackMap_0_FAILED(ITER_2)
pshipton commented 2 years ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.system_aarch64_mac_Nightly_testList_2/137

20:11:47  BUILD SUCCESSFUL
20:11:47  Total time: 1 minute 1 second
20:11:47  /bin/sh: line 1: 23034 Illegal instruction: 4  ant -f scripts/build_test.xml -DTEST_ROOT=/Users/****/workspace/Test_openjdk17_j9_sanity.system_aarch64_mac_Nightly_testList_2/aqa-tests/TKG/.. -DBUILD_ROOT=/Users/****/workspace/Test_openjdk17_j9_sanity.system_aarch64_mac_Nightly_testList_2/aqa-tests/TKG/../../jvmtest -DJDK_VERSION=17 -DJDK_IMPL=openj9 -DJCL_VERSION=latest -DBUILD_LIST=system -DRESOURCES_DIR=/Users/****/workspace/Test_openjdk17_j9_sanity.system_aarch64_mac_Nightly_testList_2/aqa-tests/TKG/../../jvmtest/TestConfig/resources -DSPEC=osx_aarch64_nocmprssptrs -DTEST_JDK_HOME=/Users/****/workspace/Test_openjdk17_j9_sanity.system_aarch64_mac_Nightly_testList_2/openjdkbinary/j2sdk-image -DJVM_VERSION=openjdk17-openj9 -DLIB_DIR=/Users/****/workspace/Test_openjdk17_j9_sanity.system_aarch64_mac_Nightly_testList_2/aqa-tests/TKG/../TKG/lib 2>&1
20:11:47  132
20:11:47  make[1]: *** [compile] Error 1
20:11:47  make: *** [compile] Error 2
pshipton commented 2 years ago

I think this is a problem with the JVM running ant, which is Java 17+0 Hotspot from Homebrew. We should update that, or move to Semeru. @AdamBrousseau

AdamBrousseau commented 2 years ago

Node was using ~/bootjdk/jdk17 which was temurin for some reason. Removed it and running a compile which should download a semeru 17 https://openj9-jenkins.osuosl.org/job/Pipeline-Build-Test-Personal/243/

pshipton commented 2 years ago

Was it removed on all the machines, or we're testing one machine first?

AdamBrousseau commented 2 years ago

1 machine to test (number 7). Didn't like running sh. Reconfig'd 7 to point at bootjdk 11 as the one on disk was already semeru. Bootjdk 17 download works now. I can either leave at 11 to run the node or bump to 17.

pshipton commented 2 years ago

Using 11 is fine. We've got many years before it goes out of support.

AdamBrousseau commented 2 years ago

k, I updated all the amacs. I also needed to add the UNB Artifactory ssl certificate to the java11's keystore.

pshipton commented 2 years ago

https://openj9-jenkins.osuosl.org/job/Test_openjdk11_j9_sanity.functional_aarch64_mac_Nightly_testList_0/140

21:25:31  /bin/sh: line 1: 76198 Abort trap: 6           ant -f scripts/build_test.xml -DTEST_ROOT=/Users/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_mac_Nightly_testList_0/aqa-tests/TKG/.. -DBUILD_ROOT=/Users/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_mac_Nightly_testList_0/aqa-tests/TKG/../../jvmtest -DJDK_VERSION=11 -DJDK_IMPL=openj9 -DJCL_VERSION=latest -DBUILD_LIST=functional/cmdLineTests/cmdLineTest_J9tests,functional/Jsr335,functional/NativeTest,functional/Jsr335_interfaceStaticMethod,functional/cmdLineTests/sigabrtHandlingTest,functional/cmdLineTests/jvmtitests,functional/UnsafeTest,functional/Java8andUp,functional/cmdLineTests/URLClassLoaderTests,functional/cmdLineTests/classLoaderTest,functional/VM_Test,functional/cmdLineTests/shareClassTests/SCHelperCompatTests,functional/cmdLineTests/openssl,functional/cmdLineTests/shareClassTests/ShareClassesSimpleSanity,functional/JLM_Tests,functional/Java9andUp,functional/JIT_Test,functional/SharedCPEntryInvokerTests,functional/cmdLineTests/shareClassTests/SCCommandLineOptionTests,functional/cmdLineTests/proxyFieldAccess,functional/cmdLineTests/gcRegressionTests,functional/cmdLineTests/gptest,functional/JavaAgentTest,functional/cmdLineTests/jython,functional/Java11andUp,functional/cmdLineTests/bootstrapMethodArgumentTest,functional/cmdLineTests/shareClassTests/URLHelperTests,functional/cmdLineTests/J9security,functional/OpenJ9_Jsr_292_API -DRESOURCES_DIR=/Users/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_mac_Nightly_testList_0/aqa-tests/TKG/../../jvmtest/TestConfig/resources -DSPEC=osx_aarch64_nocmprssptrs -DTEST_JDK_HOME=/Users/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_mac_Nightly_testList_0/openjdkbinary/j2sdk-image -DJVM_VERSION=openjdk11-openj9 -DLIB_DIR=/Users/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_mac_Nightly_testList_0/aqa-tests/TKG/../TKG/lib 2>&1
21:25:31  134
21:25:31  make[2]: *** [compile] Error 1
21:25:31  make[1]: *** [compile] Error 2
21:25:31  make: *** [testList_0] Error 2

Apparently "Abort trap 6" means "you are writing to memory you don't own".