Karm / mandrel-integration-tests

Integration tests for GraalVM and its Mandrel distribution. Runs Quarkus, Helidon and Micronaut applications and small targeted reproducers. The focus is solely on native-image utility and compilation of Java applications into native executables.
Apache License 2.0
5 stars 3 forks source link

[CI] Mandrel integration tests fail with Java 22 mandrel build of graal/master on Windows #207

Closed mandrel-bot closed 2 weeks ago

mandrel-bot commented 1 year ago

This is an issue to automatically track failures in Mandrel's CI runs.

Job Filter: Q main M 22 latest windows / Q Mandrel IT

mandrel-bot commented 10 months ago

Unfortunately, the build failed:

mandrel-bot commented 10 months ago

The build is still failing:

mandrel-bot commented 10 months ago

The build is still failing:

mandrel-bot commented 10 months ago

The build is still failing:

jerboaa commented 10 months ago

One failure I see is this:

 Warning: Please re-evaluate whether any experimental option is required, and either remove or unlock it. The build output lists all active experimental options, including where they come from and possible alternatives. If you think an experimental option should be considered as stable, please file an issue.
Error occurred during initialization of VM
Could not find agent library native-image-diagnostics-agent on the library path, with error: Can't find dependent libraries

Something changed in the native-image-diagnosticts-agent?

mandrel-bot commented 10 months ago

The build is still failing:

mandrel-bot commented 10 months ago

The build is still failing:

zakkak commented 10 months ago

Fails due to https://github.com/graalvm/mandrel/issues/580#issuecomment-1838481273

See https://github.com/graalvm/mandrel/actions/runs/7094964042/job/19311639748#step:10:5452

mandrel-bot commented 10 months ago

The build is still failing:

mandrel-bot commented 10 months ago

The build is still failing:

mandrel-bot commented 10 months ago

Build fixed:

mandrel-bot commented 9 months ago

Unfortunately, the build failed!

Filtered Logs:

2023-12-14T02:00:11.4943374Z Error: Could not find target method: private native com.oracle.svm.core.hub.Target_java_lang_PublicMethods_MethodList com.oracle.svm.core.hub.DynamicHub.getMethodsRecursive(java.lang.String,java.lang.Class[],boolean,boolean)
2023-12-14T02:00:22.5095657Z Error: Could not find target method: native java.lang.reflect.Method com.oracle.svm.core.hub.DynamicHub.findMethod(boolean,java.lang.String,java.lang.Class[])
2023-12-14T02:00:34.2020097Z Error: Could not find target method: native java.lang.reflect.Method com.oracle.svm.core.hub.DynamicHub.findMethod(boolean,java.lang.String,java.lang.Class[])
2023-12-14T02:00:42.1370579Z Error: Could not find target method: private native com.oracle.svm.core.hub.Target_java_lang_PublicMethods_MethodList com.oracle.svm.core.hub.DynamicHub.getMethodsRecursive(java.lang.String,java.lang.Class[],boolean,boolean)
2023-12-14T02:00:51.1969370Z Error: Could not find target method: native java.lang.reflect.Method com.oracle.svm.core.hub.DynamicHub.findMethod(boolean,java.lang.String,java.lang.Class[])
2023-12-14T02:01:02.0233673Z Error: Could not find target method: native java.lang.reflect.Method com.oracle.svm.core.hub.DynamicHub.findMethod(boolean,java.lang.String,java.lang.Class[])
2023-12-14T02:01:03.2395642Z [ERROR] Tests run: 12, Failures: 6, Errors: 0, Skipped: 6, Time elapsed: 69.069 s <<< FAILURE! - in org.graalvm.tests.integration.AppReproducersTest
2023-12-14T02:01:03.2453689Z [ERROR] calendarsBakedIn{TestInfo}  Time elapsed: 13.94 s  <<< FAILURE!
2023-12-14T02:01:03.2553062Z [ERROR] nativeJVMTextProcessing{TestInfo}  Time elapsed: 13.158 s  <<< FAILURE!
2023-12-14T02:01:03.2592419Z [ERROR] resLocationsE{TestInfo}  Time elapsed: 8.402 s  <<< FAILURE!
2023-12-14T02:01:03.2682240Z [ERROR] timezonesBakedIn{TestInfo}  Time elapsed: 9.051 s  <<< FAILURE!
2023-12-14T02:01:03.2699940Z [ERROR] randomNumbersReinit{TestInfo}  Time elapsed: 10.141 s  <<< FAILURE!
2023-12-14T02:01:03.2705930Z [ERROR] recordAnnotationsWorkPost22_1{TestInfo}  Time elapsed: 9.729 s  <<< FAILURE!
2023-12-14T02:01:36.0830462Z [ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: 32.822 s <<< FAILURE! - in org.graalvm.tests.integration.RuntimesSmokeTest
2023-12-14T02:01:36.0839378Z [ERROR] quarkusFullMicroProfile{TestInfo}  Time elapsed: 32.822 s  <<< FAILURE!
2023-12-14T02:01:36.6017566Z [ERROR] Failures: 
2023-12-14T02:01:36.6019241Z [ERROR]   AppReproducersTest.calendarsBakedIn:780 Expected pattern .*Year: (?:1|1086), dayOfYear: 1, type: (?:japanese|buddhist|gregory).* was not found in the log. ==> expected: <true> but was: <false>
2023-12-14T02:01:36.6026285Z [ERROR]   AppReproducersTest.nativeJVMTextProcessing:941 There were two same hashes b6951775b0375ea13fc977581e54eb36d483e95ed3bc1e62fcb8da59830f1ef9 expected in the log. One from JVM run and one for Native image run. 1 such hashes were found. Check build-and-run.log and report.md. ==> expected: <2> but was: <1>
2023-12-14T02:01:36.6030873Z [ERROR]   AppReproducersTest.randomNumbersReinit:140 There should have been 4 distinct lines in the log,showing 2 different pseudorandom sequences. The fact that there are less than 4 means the native imagewas not properly re-seeded. See https://github.com/oracle/graal/issues/2265. ==> expected: <4> but was: <0>
2023-12-14T02:01:36.6034067Z [ERROR]   AppReproducersTest.recordAnnotationsWorkPost22_1:794->recordAnnotationsWork:825 Expected pattern .*RCA annotation: @recordannotations\.RCA.* was not found in the log. ==> expected: <true> but was: <false>
2023-12-14T02:01:36.6036019Z [ERROR]   AppReproducersTest.resLocationsE:442->resLocations:470 Expected output and actual output have a different number of lines. Actual was: 'target\reslocations.exe' is not recognized as an internal or external command,
2023-12-14T02:01:36.6038671Z [ERROR]   AppReproducersTest.timezonesBakedIn:739 Expected pattern .*heure normale.*Europe centrale.* was not found in the log. There might be a problem with timezones inclusion. See https://github.com/oracle/graal/issues/2776 ==> expected: <true> but was: <false>
2023-12-14T02:01:36.6040582Z [ERROR]   RuntimesSmokeTest.quarkusFullMicroProfile:202->testRuntime:110 Timeout 10s was reached. Empty webpage does not contain string: `"UP"' ==> expected: <true> but was: <false>
2023-12-14T02:01:36.6041738Z [ERROR] Tests run: 17, Failures: 7, Errors: 0, Skipped: 10
2023-12-14T02:01:36.6102468Z [INFO] testsuite .......................................... FAILURE [01:55 min]
2023-12-14T02:01:36.6129423Z [ERROR]   mvn <args> -rf :testsuite

Link to failing CI run: https://github.com/graalvm/mandrel/actions/runs/7203300001/job/19623402085

zakkak commented 9 months ago

Caused by https://github.com/oracle/graal/pull/7993

It looks like LabsJDK moved to 22+27 faster than Temurin OpenJDK this time.

mandrel-bot commented 9 months ago

The build is still failing!

Filtered Logs:

2023-12-15T01:58:22.8911444Z Error: Could not find target method: native java.lang.reflect.Method com.oracle.svm.core.hub.DynamicHub.findMethod(boolean,java.lang.String,java.lang.Class[])
2023-12-15T01:58:34.0524218Z Error: Could not find target method: native java.lang.reflect.Method com.oracle.svm.core.hub.DynamicHub.findMethod(boolean,java.lang.String,java.lang.Class[])
2023-12-15T01:58:45.7362575Z Error: Could not find target method: private native com.oracle.svm.core.hub.Target_java_lang_PublicMethods_MethodList com.oracle.svm.core.hub.DynamicHub.getMethodsRecursive(java.lang.String,java.lang.Class[],boolean,boolean)
2023-12-15T01:58:54.0463781Z Error: Could not find target method: private native com.oracle.svm.core.hub.Target_java_lang_PublicMethods_MethodList com.oracle.svm.core.hub.DynamicHub.getMethodsRecursive(java.lang.String,java.lang.Class[],boolean,boolean)
2023-12-15T01:59:03.2211591Z Error: Could not find target method: private native com.oracle.svm.core.hub.Target_java_lang_PublicMethods_MethodList com.oracle.svm.core.hub.DynamicHub.getMethodsRecursive(java.lang.String,java.lang.Class[],boolean,boolean)
2023-12-15T01:59:14.3349912Z Error: Could not find target method: native java.lang.reflect.Method com.oracle.svm.core.hub.DynamicHub.findMethod(boolean,java.lang.String,java.lang.Class[])
2023-12-15T01:59:15.5733120Z [ERROR] Tests run: 12, Failures: 6, Errors: 0, Skipped: 6, Time elapsed: 67.855 s <<< FAILURE! - in org.graalvm.tests.integration.AppReproducersTest
2023-12-15T01:59:15.5734873Z [ERROR] calendarsBakedIn{TestInfo}  Time elapsed: 14.079 s  <<< FAILURE!
2023-12-15T01:59:15.5740543Z [ERROR] nativeJVMTextProcessing{TestInfo}  Time elapsed: 13.515 s  <<< FAILURE!
2023-12-15T01:59:15.5748313Z [ERROR] resLocationsE{TestInfo}  Time elapsed: 8.192 s  <<< FAILURE!
2023-12-15T01:59:15.5756412Z [ERROR] timezonesBakedIn{TestInfo}  Time elapsed: 9.396 s  <<< FAILURE!
2023-12-15T01:59:15.5762937Z [ERROR] randomNumbersReinit{TestInfo}  Time elapsed: 10.274 s  <<< FAILURE!
2023-12-15T01:59:15.5770675Z [ERROR] recordAnnotationsWorkPost22_1{TestInfo}  Time elapsed: 10.008 s  <<< FAILURE!
2023-12-15T01:59:47.4397296Z [ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: 31.875 s <<< FAILURE! - in org.graalvm.tests.integration.RuntimesSmokeTest
2023-12-15T01:59:47.4405484Z [ERROR] quarkusFullMicroProfile{TestInfo}  Time elapsed: 31.875 s  <<< FAILURE!
2023-12-15T01:59:47.9496830Z [ERROR] Failures: 
2023-12-15T01:59:47.9502393Z [ERROR]   AppReproducersTest.calendarsBakedIn:780 Expected pattern .*Year: (?:1|1086), dayOfYear: 1, type: (?:japanese|buddhist|gregory).* was not found in the log. ==> expected: <true> but was: <false>
2023-12-15T01:59:47.9507182Z [ERROR]   AppReproducersTest.nativeJVMTextProcessing:941 There were two same hashes b6951775b0375ea13fc977581e54eb36d483e95ed3bc1e62fcb8da59830f1ef9 expected in the log. One from JVM run and one for Native image run. 1 such hashes were found. Check build-and-run.log and report.md. ==> expected: <2> but was: <1>
2023-12-15T01:59:47.9512427Z [ERROR]   AppReproducersTest.randomNumbersReinit:140 There should have been 4 distinct lines in the log,showing 2 different pseudorandom sequences. The fact that there are less than 4 means the native imagewas not properly re-seeded. See https://github.com/oracle/graal/issues/2265. ==> expected: <4> but was: <0>
2023-12-15T01:59:47.9516799Z [ERROR]   AppReproducersTest.recordAnnotationsWorkPost22_1:794->recordAnnotationsWork:825 Expected pattern .*RCA annotation: @recordannotations\.RCA.* was not found in the log. ==> expected: <true> but was: <false>
2023-12-15T01:59:47.9520445Z [ERROR]   AppReproducersTest.resLocationsE:442->resLocations:470 Expected output and actual output have a different number of lines. Actual was: 'target\reslocations.exe' is not recognized as an internal or external command,
2023-12-15T01:59:47.9525188Z [ERROR]   AppReproducersTest.timezonesBakedIn:739 Expected pattern .*heure normale.*Europe centrale.* was not found in the log. There might be a problem with timezones inclusion. See https://github.com/oracle/graal/issues/2776 ==> expected: <true> but was: <false>
2023-12-15T01:59:47.9528892Z [ERROR]   RuntimesSmokeTest.quarkusFullMicroProfile:202->testRuntime:110 Timeout 10s was reached. Empty webpage does not contain string: `"UP"' ==> expected: <true> but was: <false>
2023-12-15T01:59:47.9531022Z [ERROR] Tests run: 17, Failures: 7, Errors: 0, Skipped: 10
2023-12-15T01:59:47.9567360Z [INFO] testsuite .......................................... FAILURE [01:50 min]
2023-12-15T01:59:47.9603935Z [ERROR]   mvn <args> -rf :testsuite

Link to failing CI run: https://github.com/graalvm/mandrel/actions/runs/7216793492/job/19663974447

mandrel-bot commented 9 months ago

Build fixed:

mandrel-bot commented 9 months ago

Unfortunately, the build failed!

Filtered Logs:

2023-12-21T02:01:52.0244225Z [ERROR] Tests run: 12, Failures: 2, Errors: 9, Skipped: 1, Time elapsed: 151.847 s <<< FAILURE! - in org.graalvm.tests.integration.AppReproducersTest
2023-12-21T02:01:52.0559059Z [ERROR] calendarsBakedIn{TestInfo}  Time elapsed: 0.016 s  <<< ERROR!
2023-12-21T02:01:52.0627060Z [ERROR] nativeJVMTextProcessing{TestInfo}  Time elapsed: 0.062 s  <<< ERROR!
2023-12-21T02:01:52.0650493Z [ERROR] versionsParsingMandrel{TestInfo}  Time elapsed: 0 s  <<< ERROR!
2023-12-21T02:01:52.0655956Z [ERROR] resLocationsA{TestInfo}  Time elapsed: 0 s  <<< ERROR!
2023-12-21T02:01:52.0661300Z [ERROR] resLocationsB{TestInfo}  Time elapsed: 0 s  <<< ERROR!
2023-12-21T02:01:52.0666669Z [ERROR] resLocationsC{TestInfo}  Time elapsed: 0 s  <<< ERROR!
2023-12-21T02:01:52.0673493Z [ERROR] resLocationsD{TestInfo}  Time elapsed: 0 s  <<< ERROR!
2023-12-21T02:01:52.0679074Z [ERROR] resLocationsE{TestInfo}  Time elapsed: 0 s  <<< ERROR!
2023-12-21T02:01:52.0684897Z [ERROR] timezonesBakedIn{TestInfo}  Time elapsed: 79.577 s  <<< FAILURE!
2023-12-21T02:01:52.0697786Z [ERROR] randomNumbersReinit{TestInfo}  Time elapsed: 68.47 s  <<< FAILURE!
2023-12-21T02:01:52.0710660Z [ERROR] recordAnnotationsWorkPost22_1{TestInfo}  Time elapsed: 0.016 s  <<< ERROR!
2023-12-21T02:01:52.0749604Z [ERROR] Tests run: 2, Failures: 0, Errors: 1, Skipped: 1, Time elapsed: 0 s <<< FAILURE! - in org.graalvm.tests.integration.RuntimesSmokeTest
2023-12-21T02:01:52.0751594Z [ERROR] quarkusFullMicroProfile{TestInfo}  Time elapsed: 0 s  <<< ERROR!
2023-12-21T02:01:52.5692199Z [ERROR] Failures: 
2023-12-21T02:01:52.5695972Z [ERROR]   AppReproducersTest.randomNumbersReinit:145 build-and-run.log log should not contain error or warning lines that are not whitelisted. See D:\a\mandrel\mandrel\testsuite\target\archived-logs\org.graalvm.tests.integration.AppReproducersTest\randomNumbersReinit\build-and-run.log and check these offending lines: 
2023-12-21T02:01:52.5704848Z [ERROR]   AppReproducersTest.timezonesBakedIn:743 build-and-run.log log should not contain error or warning lines that are not whitelisted. See D:\a\mandrel\mandrel\testsuite\target\archived-logs\org.graalvm.tests.integration.AppReproducersTest\timezonesBakedIn\build-and-run.log and check these offending lines: 
2023-12-21T02:01:52.5708432Z [ERROR]   AppReproducersTest.calendarsBakedIn � ExceptionInInitializer
2023-12-21T02:01:52.5709210Z [ERROR]   AppReproducersTest.nativeJVMTextProcessing:905->getSwitches:972 � NoClassDefFound
2023-12-21T02:01:52.5710086Z [ERROR]   AppReproducersTest.recordAnnotationsWorkPost22_1 � NoClassDefFound Could not i...
2023-12-21T02:01:52.5710917Z [ERROR]   AppReproducersTest.resLocationsA � NoClassDefFound Could not initialize class ...
2023-12-21T02:01:52.5711740Z [ERROR]   AppReproducersTest.resLocationsB � NoClassDefFound Could not initialize class ...
2023-12-21T02:01:52.5713334Z [ERROR]   AppReproducersTest.resLocationsC � NoClassDefFound Could not initialize class ...
2023-12-21T02:01:52.5714677Z [ERROR]   AppReproducersTest.resLocationsD � NoClassDefFound Could not initialize class ...
2023-12-21T02:01:52.5716065Z [ERROR]   AppReproducersTest.resLocationsE � NoClassDefFound Could not initialize class ...
2023-12-21T02:01:52.5717572Z [ERROR]   AppReproducersTest.versionsParsingMandrel � NoClassDefFound Could not initiali...
2023-12-21T02:01:52.5719181Z [ERROR]   RuntimesSmokeTest.quarkusFullMicroProfile:184 � NoClassDefFound Could not init...
2023-12-21T02:01:52.5720551Z [ERROR] Tests run: 17, Failures: 2, Errors: 10, Skipped: 5
2023-12-21T02:01:52.5759745Z [INFO] testsuite .......................................... FAILURE [02:45 min]
2023-12-21T02:01:52.5786915Z [ERROR]   mvn <args> -rf :testsuite

Link to failing CI run: https://github.com/graalvm/mandrel/actions/runs/7282848358/job/19846274907

jerboaa commented 9 months ago

Seems caused by:

[...] vendor version: Mandrel-WARNING: Could not parse jvmci version from JVMCIVersionCheck output:-Final

I.e. graal/master moved to JDK 23, we still build with JDK 22. Should be fixed with https://github.com/graalvm/mandrel/pull/648 once it merges since it will no longer use this ticket to report failures (instead use the JDK 23-based one).

zakkak commented 2 weeks ago

This configuration is no longer being tested.