[CI] Mandrel integration tests fail with Java 17 mandrel build of `graal/master` on Linux

Error:  Failures: 
Error:    AppReproducersTest.imageioAWTTest:429->imageioAWT:553 A different set of static libraries was expected. 
Expected: [libawt.a, libawt_headless.a, libfdlibm.a, libfontmanager.a, libjava.a, libjavajpeg.a, libjvm.a, liblcms.a, liblibchelper.a, libmanagement_ext.a, libnet.a, libnio.a, libzip.a]
Actual:   [libawt.a, libawt_headless.a, libfdlibm.a, libfontmanager.a, libjava.a, libjavajpeg.a, libjvm.a, liblcms.a, liblibchelper.a, libnet.a, libnio.a, libzip.a] ==> expected: <true> but was: <false>
Error:    DebugSymbolsTest.debugSymbolsSmokeGDB:137->carryOutGDBSession:388 There were errors in the GDB session. Note that commands in the session might depend on each other. Errors: 
Command 'info functions .*smoke.*' did not match the expected pattern '.*File debug_symbols_smoke/ClassA.java:.*java.lang.String \*debug_symbols_smoke.ClassA::toString\(void\).*File debug_symbols_smoke/Main.java:.*void debug_symbols_smoke.Main\$\$Lambda\$.*::accept\(java.lang.Object \*\).*void debug_symbols_smoke.Main::lambda\$thisIsTheEnd\$0\(java.io.ByteArrayOutputStream \*, debug_symbols_smoke.ClassA \*\).*void debug_symbols_smoke.Main::main\(java.lang.String\[\] \*\).*void debug_symbols_smoke.Main::thisIsTheEnd\(java.util.List \*\).*'.
Output was:
(gdb) All functions matching regular expression ".*smoke.*":

File debug_symbols_smoke/ClassA.java:
37: java.lang.String *debug_symbols_smoke.ClassA::toString();

File debug_symbols_smoke/Main.java:
    void debug_symbols_smoke.Main$$Lambda$266e79b8d6f77921b25a18aa4f6b7c05b882d790::accept(java.lang.Object*);
50: void debug_symbols_smoke.Main::lambda$thisIsTheEnd$0(java.io.ByteArrayOutputStream*, debug_symbols_smoke.ClassA*);
64: void debug_symbols_smoke.Main::main(java.lang.String[]*);
49: void debug_symbols_smoke.Main::thisIsTheEnd(java.util.List*);
 ==> expected: <true> but was: <false>

Both issues should be fixed once https://github.com/Karm/mandrel-integration-tests/pull/122 and both, https://github.com/oracle/graal/pull/5195 and https://github.com/Karm/mandrel-integration-tests/pull/119 are merged.

jerboaa commented 1 year ago

Both issues should be fixed once #122 and both, oracle/graal#5195 and #119 are merged.

All of these are merged now and we should (in theory) get passing tests for the next run. Let's see :)

mandrel-bot commented 1 year ago

The build is still failing:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3228707774

mandrel-bot commented 1 year ago

The build is still failing:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3231742219

jerboaa commented 1 year ago

Hmm, fails with:

Error:  Failures: 
Error:    AppReproducersTest.imageioAWTTest:429->imageioAWT:551 build-and-run.log log should not contain error or warning lines that are not whitelisted. See /home/runner/work/mandrel/mandrel/mandrel-integration-tests/testsuite/target/archived-logs/org.graalvm.tests.integration.AppReproducersTest/imageioAWTTest/build-and-run.log and check these offending lines: 
Warning: Could not resolve class com.orsoncharts.Chart3DHints for reflection configuration. Reason: java.lang.ClassNotFoundException: com.orsoncharts.Chart3DHints. ==> expected: <true> but was: <false>
[INFO] 
Error:  Tests run: 18, Failures: 1, Errors: 0, Skipped: 5

Now... Looking into it.

jerboaa commented 1 year ago

Turns out the warning includes ... class com.orsoncharts. and was likely masked due to the management_ext static lib issue being hit earlier. Fixed with #123.

mandrel-bot commented 1 year ago

The build is still failing:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3233862518

mandrel-bot commented 1 year ago

Build fixed:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3234766772

jerboaa commented 1 year ago

Finally! :)

mandrel-bot commented 1 year ago

Unfortunately, the build failed:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3247209243

mandrel-bot commented 1 year ago

Build fixed:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3254203961

mandrel-bot commented 1 year ago

Unfortunately, the build failed:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3270318066

mandrel-bot commented 1 year ago

The build is still failing:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3278518942

mandrel-bot commented 1 year ago

The build is still failing:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3286526516

mandrel-bot commented 1 year ago

Build fixed:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3294364997

mandrel-bot commented 1 year ago

Unfortunately, the build failed:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3301684769

mandrel-bot commented 1 year ago

The build is still failing:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3305606443

mandrel-bot commented 1 year ago

Build fixed:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3309773742

mandrel-bot commented 1 year ago

Unfortunately, the build failed:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3327267877

zakkak commented 1 year ago

This was due to a timeout

The job running on runner GitHub Actions 12 has exceeded the maximum execution time of 40 minutes.

mandrel-bot commented 1 year ago

The build is still failing:

Link to latest CI run: https://github.com/graalvm/mandrel/actions/runs/3334070073

zakkak commented 1 year ago

This has recently started timing out more than expected.

It looks like the last passing run was in https://github.com/graalvm/mandrel/actions/runs/3301684769 and it started timing out in https://github.com/graalvm/mandrel/actions/runs/3301684769/jobs/5447459008.

The interesting part is that both runs use:

mandrel: 083e7cf26a4c2616d5d91f57b51e3ca0df512ebd
workflows from mandrel default branch: 65f230c7c5cadc4ce88b8e3a97a238bdf02f2b1b
mandrel-packaging: e211a81a3ad06278cbc6da6845944a04909eee50
mandrel-integration-tests: 497f84a2cca3ee3d0f54f8707f2d4bab01b47fcb
GH runner version: 2.298.2

The only difference appears to be in the Quarkus commit hash:

the passing workflow used: afd91642a08f86e8565003cb1ca77d752a7ae9cc
the failing one used: c61912b1eadbb05e42232b4fa0534da34d2f92e8

I scheduled https://github.com/graalvm/mandrel/actions/runs/3335716989 to run CI with the latest mandrel using the passing Quarkus commit to see if it times out or not.

zakkak commented 1 year ago

The above run timed out as well, so it looks like it's not related to some code change in Quarkus either...

mandrel-bot commented 1 year ago

Build fixed: