search

Karm / mandrel-integration-tests

Integration tests for GraalVM and its Mandrel distribution. Runs Quarkus, Helidon and Micronaut applications and small targeted reproducers. The focus is solely on native-image utility and compilation of Java applications into native executables.
Apache License 2.0
5 stars 3 forks source link

[CI] Mandrel integration tests fail with Java 22 mandrel build of graal/master on Linux #208

Closed mandrel-bot closed 6 months ago

mandrel-bot commented 9 months ago

This is an issue to automatically track failures in Mandrel's CI runs.

Job Filter: Q main M 22 latest / Q Mandrel IT

mandrel-bot commented 8 months ago

Unfortunately, the build failed:

zakkak commented 8 months ago

This is caused by https://github.com/graalvm/mandrel/issues/598

jerboaa commented 8 months ago

This is caused by graalvm/mandrel#598

That doesn't seem right. This is a JDK 22-based ticket. The actual failures are (all tests that fail use Quarkus):

Error:  Failures: 
Error:    DebugSymbolsTest.debugSymbolsQuarkus:238 Quarkus executable does not exist. Compilation failed. Check the logs. ==> expected: <true> but was: <false>
Error:    JFRTest.jfrPerfTest:176->jfrPerfTestRun:214->startComparisonForBenchmark:254->runBenchmarkForApp:354 The test application failed to run. Check /home/runner/work/mandrel/mandrel/mandrel-integration-tests/testsuite/target/archived-logs/org.graalvm.tests.integration.JFRTest/jfrPerfTest/build-and-run.log ==> expected: not <null>
Error:    RuntimesSmokeTest.quarkusFullMicroProfile:192->testRuntime:98 Failed to find any executable in dir /home/runner/work/mandrel/mandrel/mandrel-integration-tests/apps/quarkus-full-microprofile/target, matching regexp .*

One of them fails with:

[1/8] Initializing...                                                                                    (0.0s @ 0.12GB)
Error: Substitution target for org.wildfly.common.Substitutions$Target_GraalDirectives is not loaded. Use field `onlyWith` in the `TargetClass` annotation to make substitution only active when needed.
com.oracle.svm.core.util.UserError$UserException: Substitution target for org.wildfly.common.Substitutions$Target_GraalDirectives is not loaded. Use field `onlyWith` in the `TargetClass` annotation to make substitution only active when needed.
    at org.graalvm.nativeimage.builder/com.oracle.svm.core.util.UserError.abort(UserError.java:73)
    at org.graalvm.nativeimage.builder/com.oracle.svm.hosted.substitute.AnnotationSubstitutionProcessor.findTargetClass(AnnotationSubstitutionProcessor.java:1098)
    at org.graalvm.nativeimage.builder/com.oracle.svm.hosted.substitute.AnnotationSubstitutionProcessor.findTargetClass(AnnotationSubstitutionProcessor.java:1047)
    at org.graalvm.nativeimage.builder/com.oracle.svm.hosted.substitute.AnnotationSubstitutionProcessor.findTargetClass(AnnotationSubstitutionProcessor.java:1043)
    at org.graalvm.nativeimage.builder/com.oracle.svm.hosted.substitute.AnnotationSubstitutionProcessor.handleClass(AnnotationSubstitutionProcessor.java:375)
    at org.graalvm.nativeimage.builder/com.oracle.svm.hosted.substitute.AnnotationSubstitutionProcessor.init(AnnotationSubstitutionProcessor.java:353)
    at org.graalvm.nativeimage.builder/com.oracle.svm.hosted.NativeImageGenerator.createAnnotationSubstitutionProcessor(NativeImageGenerator.java:1048)
    at org.graalvm.nativeimage.builder/com.oracle.svm.hosted.NativeImageGenerator.setupNativeImage(NativeImageGenerator.java:914)
    at org.graalvm.nativeimage.builder/com.oracle.svm.hosted.NativeImageGenerator.doRun(NativeImageGenerator.java:586)
    at org.graalvm.nativeimage.builder/com.oracle.svm.hosted.NativeImageGenerator.run(NativeImageGenerator.java:553)
    at org.graalvm.nativeimage.builder/com.oracle.svm.hosted.NativeImageGeneratorRunner.buildImage(NativeImageGeneratorRunner.java:524)
    at org.graalvm.nativeimage.builder/com.oracle.svm.hosted.NativeImageGeneratorRunner.build(NativeImageGeneratorRunner.java:699)
    at org.graalvm.nativeimage.builder/com.oracle.svm.hosted.NativeImageGeneratorRunner.start(NativeImageGeneratorRunner.java:139)
    at org.graalvm.nativeimage.builder/com.oracle.svm.hosted.NativeImageGeneratorRunner.main(NativeImageGeneratorRunner.java:94)
------------------------------------------------------------------------------------------------------------------------
                        1.1s (10.6% of total time) in 37 GCs | Peak RSS: 0.51GB | CPU load: 1.85
------------------------------------------------------------------------------------------------------------------------
Produced artifacts:
 /home/runner/work/mandrel/mandrel/mandrel-integration-tests/apps/quarkus-full-microprofile/target/quarkus-native-image-source-jar/quarkus-runner-build-output-stats.json (build_info)
========================================================================================================================
Finished generating 'quarkus-runner' in 9.0s.

So this looks to me like: https://github.com/quarkusio/quarkus/issues/36686

zakkak commented 8 months ago

You are right.

mandrel-bot commented 8 months ago

The build is still failing:

mandrel-bot commented 8 months ago

Build fixed:

mandrel-bot commented 7 months ago

Unfortunately, the build failed:

jerboaa commented 7 months ago

Current failures are due to Quarkus warnings. Tracked here: https://github.com/Karm/mandrel-integration-tests/issues/220

mandrel-bot commented 7 months ago

The build is still failing:

jerboaa commented 7 months ago

The build is still failing:

* Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/6858005425

Still caused by: https://github.com/Karm/mandrel-integration-tests/issues/220

mandrel-bot commented 7 months ago

The build is still failing:

mandrel-bot commented 7 months ago

The build is still failing:

zakkak commented 7 months ago

Still caused by: https://github.com/Karm/mandrel-integration-tests/issues/220

mandrel-bot commented 7 months ago

The build is still failing:

jerboaa commented 7 months ago

Failures are caused by: https://github.com/Karm/mandrel-integration-tests/issues/223

mandrel-bot commented 7 months ago

The build is still failing:

mandrel-bot commented 7 months ago

The build is still failing:

mandrel-bot commented 7 months ago

The build is still failing:

jerboaa commented 7 months ago

Failures still caused by: https://github.com/Karm/mandrel-integration-tests/issues/223

mandrel-bot commented 7 months ago

The build is still failing:

mandrel-bot commented 7 months ago

The build is still failing:

mandrel-bot commented 7 months ago

The build is still failing:

mandrel-bot commented 7 months ago

Build fixed:

mandrel-bot commented 7 months ago

Unfortunately, the build failed:

jerboaa commented 7 months ago

Caused by a new AWT related failure. See https://github.com/graalvm/mandrel/issues/580#issuecomment-1825392846 and https://github.com/graalvm/mandrel/actions/runs/6975817696/job/18983961492#step:11:11106

mandrel-bot commented 7 months ago

Build fixed:

mandrel-bot commented 7 months ago

Unfortunately, the build failed:

mandrel-bot commented 7 months ago

Build fixed:

mandrel-bot commented 7 months ago

Unfortunately, the build failed:

mandrel-bot commented 7 months ago

Build fixed:

mandrel-bot commented 7 months ago

Unfortunately, the build failed:

zakkak commented 7 months ago

Caused by https://github.com/oracle/graal/issues/7894

mandrel-bot commented 7 months ago

Build fixed:

mandrel-bot commented 7 months ago

Unfortunately, the build failed:

mandrel-bot commented 7 months ago

Build fixed:

mandrel-bot commented 7 months ago

Unfortunately, the build failed:

mandrel-bot commented 7 months ago

Build fixed:

mandrel-bot commented 7 months ago

Unfortunately, the build failed:

mandrel-bot commented 7 months ago

The build is still failing:

zakkak commented 7 months ago

Fails with:

[INFO] Results:
[INFO] 
Error:  Failures: 
Error:    AppReproducersTest.imageioAWTTest:501->imageioAWT:569 The test application failed to run. Check /home/runner/work/mandrel/mandrel/mandrel-integration-tests/testsuite/target/archived-logs/org.graalvm.tests.integration.AppReproducersTest/imageioAWTTest/build-and-run.log ==> expected: not <null>
Error:    JFRTest.jfrPerfTest:176->jfrPerfTestRun:214->startComparisonForBenchmark:254->runBenchmarkForApp:355 Timeout 10s was reached. Empty webpage does not contain string: `hello' ==> expected: <true> but was: <false>
[INFO] 
Error:  Tests run: 19, Failures: 2, Errors: 0, Skipped: 5
jerboaa commented 7 months ago

Could be a github runners slow down, will see if it persists before investigating.

I've seen this failure for many runs now. So I don't think it'll go away.

zakkak commented 7 months ago

Yes, I noticed it also shows up in Windows. I am looking into it.

mandrel-bot commented 7 months ago

The build is still failing:

zakkak commented 7 months ago

Still fails due to :

  1. The awt issue mentioned in https://github.com/graalvm/mandrel/issues/580#issuecomment-1825392846 due to update to JDK 22+25 (update: upstream issue https://github.com/oracle/graal/issues/7894)
  2. JFR test https://github.com/Karm/mandrel-integration-tests/issues/236
mandrel-bot commented 7 months ago

The build is still failing!

Filtered Logs:

2023-12-10T02:26:24.3733026Z Error: Error loading a referenced type: com.oracle.svm.hosted.substitute.DeletedElementException: Unsupported method jdk.internal.loader.NativeLibrary.findEntry0(long, String) is reachable
2023-12-10T02:33:53.8377445Z [INFO] testsuite .......................................... FAILURE [25:59 min]

Link to failing CI run: https://github.com/graalvm/mandrel/actions/runs/7154825726/job/19483074872

mandrel-bot commented 6 months ago

The build is still failing!

Filtered Logs:

2023-12-11T02:28:20.8667068Z Error: Error loading a referenced type: com.oracle.svm.hosted.substitute.DeletedElementException: Unsupported method jdk.internal.loader.NativeLibrary.findEntry0(long, String) is reachable
2023-12-11T02:36:03.7296398Z [INFO] testsuite .......................................... FAILURE [26:09 min]

Link to failing CI run: https://github.com/graalvm/mandrel/actions/runs/7161773572/job/19498384118

jerboaa commented 6 months ago

Caused by same two failures:

  1. The awt issue mentioned in https://github.com/graalvm/mandrel/issues/580#issuecomment-1825392846 due to update to JDK 22+25 (update: upstream issue https://github.com/oracle/graal/issues/7894)
  2. JFR test https://github.com/Karm/mandrel-integration-tests/issues/236
mandrel-bot commented 6 months ago

The build is still failing!

Filtered Logs:

2023-12-12T02:30:22.9463574Z [ERROR] Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 455.895 s <<< FAILURE! - in org.graalvm.tests.integration.JFRTest
2023-12-12T02:30:22.9465297Z [ERROR] jfrPerfTest{TestInfo}  Time elapsed: 280.757 s  <<< FAILURE!
2023-12-12T02:30:23.2739651Z [ERROR] Failures: 
2023-12-12T02:30:23.2741935Z [ERROR]   JFRTest.jfrPerfTest:176->jfrPerfTestRun:214->startComparisonForBenchmark:254->runBenchmarkForApp:355 Timeout 10s was reached. Empty webpage does not contain string: `hello' ==> expected: <true> but was: <false>
2023-12-12T02:30:23.2744404Z [ERROR] Tests run: 19, Failures: 1, Errors: 0, Skipped: 5
2023-12-12T02:30:23.2792478Z [INFO] testsuite .......................................... FAILURE [26:20 min]
2023-12-12T02:30:23.2817424Z [ERROR]   mvn <args> -rf :testsuite

Link to failing CI run: https://github.com/graalvm/mandrel/actions/runs/7175712688/job/19540013816

jerboaa commented 6 months ago

For the record the AWT failure got fixed with this upstream graalvm PR: https://github.com/oracle/graal/pull/7980

A fix for https://github.com/Karm/mandrel-integration-tests/issues/236 is in the works at https://github.com/quarkusio/quarkus/pull/37633

mandrel-bot commented 6 months ago

Build fixed: