UBI and Ubuntu 2404 test failure summary

[Haroon-Khel]

Using this issue to summarise the consistent failures of https://github.com/adoptium/infrastructure/issues/3586 and https://github.com/adoptium/infrastructure/issues/3501 as there were many common failures

UBI 8 and 9 JDK8 all platforms: Known issue https://github.com/adoptium/infrastructure/issues/2949 java/net/Inet6Address/B6206527.java java/net/ipv6tests/B6521014.java

both are excluded on linux for openj9 https://github.com/adoptium/aqa-tests/blob/7e3811b9d4c6fcf265d2fc7e9852412034fe6260/openjdk/excludes/ProblemList_openjdk8-openj9.txt#L150 and https://github.com/adoptium/aqa-tests/blob/7e3811b9d4c6fcf265d2fc7e9852412034fe6260/openjdk/excludes/ProblemList_openjdk8-openj9.txt#L166

I recommend exclusion for jdk8

UBI8 and 9 Known issue https://github.com/adoptium/infrastructure/issues/2631 java/nio/file/Files/probeContentType/Basic.java

excluded on windows for many jdk versions https://github.com/search?q=repo%3Aadoptium%2Faqa-tests+java%2Fnio%2Ffile%2FFiles%2FprobeContentType%2FBasic&type=code

UBI 8 and 9 and Ubuntu 2404, various tests within jdk_security3 are failing for jdk8 and 11, common ones are

sun/security/pkcs11/fips/TestTLS12.java
sun/security/pkcs11/Provider/Login.sh
sun/security/pkcs11/Secmod/AddPrivateKey.java
sun/security/pkcs11/Secmod/GetPrivateKey.java
sun/security/pkcs11/Secmod/JksSetPrivateKey.java
sun/security/pkcs11/Secmod/LoadKeystore.java
sun/security/pkcs11/Secmod/TrustAnchors.java
sun/security/tools/keytool/autotest.sh

Ubuntu 2404 and UBI 8 and 9, JDK 11 all platforms

java/time/test/java/time/format/TestUTCParse.java

[sxa]

Notes:

• Looking at the IPv6 test failures in the issue at infra#2949 it looks like it's passing on some machines and not others on the same host, and with the same OS. Is that correct? In which case we perhaps need to understand the difference instead of just exclude and see if we can make the failing machines work (Assuming this new problem is that same as that one in that issue). Also noting that the -1 machine mentioned in that issue as having been taken offline is now live again.
• Most of the pkcs11/JDK8 ones are covered by https://github.com/adoptium/aqa-tests/issues/5380
• The exception to the issue in the previous bullet point is TestTLS12 which was noted in the April triage as passing when run on our RHEL6 host, so this likely needs a new issue raised to look at it. infra#2625 suggests there is a fix for this, although it has now been excluded specifically on Linux/ppc64le
• autotest.sh failure was seen on Amazon Linux 2024 although this comment suggests it passed on an Ubuntu 24.04 system.
• Also noting that it's interesting that the IBM943 failure in the nio suite has not been seen on UBI, so that appears to have been Amazon linux specific
• TestUTCParse has been noted elsewhere (including macos) e.g. April triage but I don't believe an issue has been raised, so that should be done.
• Is the java nio Basic test specific to JDK8 too? And if so does that mean JDK17+ are all ok on Ubuntu 24.04 (Which seems consistent with the riscv64 testing at https://github.com/adoptium/infrastructure/issues/3598