Nightly Build&Test Triage Report

[andrew-m-leonard]

Report Nightly Build&Test problems here

[andrew-m-leonard]

Thurs 26th March: JDK8

• Brought build-osuosl-ppc64-aix-71-2 back online as it's the only xlc16 AIX machine that is needed to build jdk14+
• Test_openjdk8_hs_sanity.system_aarch64_linux ==> Intermittent Jenkins failure

  Caused: java.lang.ExceptionInInitializerError
  at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
  at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

• Test_openjdk8_j9_sanity.openjdk_ppc64le_linux_xl ==> Probable network glitch

  export callback object and bind in registry
  java.rmi.server.ExportException: Port already in use: 60004; nested exception is: 
  java.net.BindException: Address already in use (Bind failed)
  at sun.rmi.transport.tcp.TCPTransport.listen(TCPTransport.java:346)
  at sun.rmi.transport.tcp.TCPTransport.exportObject(TCPTransport.java:254)

• Test_openjdk8_hs_sanity.openjdk_s390x_linux : java/util/stream/test/org/openjdk/tests/java/util/stream/FlatMapOpTest.java.FlatMapOpTest ==> ???

  Program `/home/jenkins/workspace/Test_openjdk8_hs_sanity.openjdk_s390x_linux/openjdkbinary/j2sdk-image/bin/java' timed out (timeout set to 960000ms, elapsed time including timeout handling was 960500ms).  

• Test_openjdk8_hs_sanity.openjdk_s390x_linux : java/security/SignedObject/Chain.java.Chain ==> ???

  Agent error: java.lang.Exception: Agent 0 timed out with a timeout of 960 seconds;

• Test_openjdk8_j9_sanity.openjdk_s390x_linux_xl : sun/nio/cs/FindDecoderBugs.java.FindDecoderBugs ==> Possible Agent comms error

  Agent communication error: java.io.EOFException

• Test_openjdk8_j9_sanity.external_x86-64_linux_tomee ==> Dependency get glitch?

  Failed to execute goal on project gradle: Could not resolve dependencies for project org.apache.tomee.gradle:gradle:pom:8.0.0: Failed to collect dependencies at org.gradle:gradle-core:jar:3.0: Failed to read artifact descriptor for org.gradle:gradle-core:jar:3.0: Could not transfer artifact org.gradle:gradle-core:pom:3.0 from/to gradle-libs-releases-local (http://repo.gradle.org/gradle/libs-releases-local/): Access denied to: http://repo.gradle.org/gradle/libs-releases-local/org/gradle/gradle-core/3.0/gradle-core-3.0.pom , ReasonPhrase:Forbidden.

• Test_openjdk8_j9_sanity.external_x86-64_linux_thorntail-mp-tck ==> Network glitch?

  19:42:23  2020-03-25 19:42:23,675 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-2) MSC000001: Failed to start service org.wildfly.undertow.listener.default: org.jboss.msc.service.StartException in service org.wildfly.undertow.listener.default: WFLYUT0082: Could not start 'default' listener.
  19:42:23    at org.wildfly.extension.undertow.ListenerService.start(ListenerService.java:211)
  19:42:23    at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1739)
  19:42:23    at org.jboss.msc.service.ServiceControllerImpl$StartTask.execute(ServiceControllerImpl.java:1701)
  19:42:23    at org.jboss.msc.service.ServiceControllerImpl$ControllerTask.run(ServiceControllerImpl.java:1559)
  19:42:23    at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
  19:42:23    at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1982)
  19:42:23    at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1486)
  19:42:23    at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1377)
  19:42:23    at java.lang.Thread.run(Thread.java:821)
  19:42:23  Caused by: java.net.SocketException: Protocol family unavailable
  19:42:23    at sun.nio.ch.Net.bind0(Native Method)

• Test_openjdk8_hs_sanity.openjdk_x86-64_linux ==> Numerous failures!!

  java/io/FilePermission/Invalid.java.Invalid
  java/io/LineNumberReader/MarkSplitCRLF.java.MarkSplitCRLF
  java/io/Serializable/serialFilter/GlobalFilterTest.java.GlobalFilterTest
  java/lang/Class/getDeclaredField/FieldSetAccessibleTest.java.FieldSetAccessibleTest
  java/lang/ProcessBuilder/Basic.java.Basic
  java/lang/SecurityManager/CheckPackageAccess.java.CheckPackageAccess
  sun/misc/IOUtils/ReadAllBytes.java.ReadAllBytes
  sun/misc/IOUtils/ReadNBytes.java.ReadNBytes
  sun/misc/URLClassPath/JarClassPathFileEntry.java.JarClassPathFileEntry
  sun/net/www/B8185898.java.B8185898
  java/security/Signature/Offsets.java.Offsets
  java/security/Signature/SignatureGetInstance.java.SignatureGetInstance
  java/security/SignedObject/Chain.java.Chain
  java/security/cert/X509CRL/VerifyDefault.java.VerifyDefault
  java/security/cert/X509Certificate/VerifyDefault.java.VerifyDefault
  java/util/Locale/Bug8040211.java.Bug8040211
  java/util/Objects/CheckIndex.java.CheckIndex
  java/util/TimeZone/TimeZoneTest.java.TimeZoneTest

[andrew-m-leonard]

Thurs 26th March: JDK11

• Test_openjdk11_j9_sanity.openjdk_ppc64_aix ==> "Compiler Crash"/"Agent errors : all NEW

  java/nio/channels/AsynchronousSocketChannel/Basic.java.Basic
  java/util/concurrent/BlockingQueue/LastElement.java.LastElement
  java/util/stream/test/org/openjdk/tests/java/util/stream/WhileOpTest.java.WhileOpTest

• Test_openjdk11_j9_sanity.openjdk_ppc64le_linux ==> "Compiler Crash"/"Agent errors: all NEW

  java/lang/invoke/8009222/Test8009222.java.Test8009222
  java/rmi/MarshalledObject/compare/Compare.java.Compare
  java/util/Map/Defaults.java.Defaults
  java/util/stream/test/org/openjdk/tests/java/util/stream/SliceOpTest.java.SliceOpTest
  java/util/stream/test/org/openjdk/tests/java/util/stream/WhileOpTest.java.WhileOpTest

• Test_openjdk11_j9_sanity.openjdk_ppc64le_linux_xl ==> "Compiler Crash"/"Agent errors : all NEW

  java/io/Serializable/resolveClass/consTest/ConsTest.java.ConsTest
  java/net/httpclient/ShortResponseBodyWithRetry.java.ShortResponseBodyWithRetry
  java/util/Formatter/EncodingTest.java.EncodingTest
  java/util/concurrent/locks/Lock/CheckedLockLoops.java.CheckedLockLoops
  java/util/stream/test/org/openjdk/tests/java/util/stream/SliceOpTest.java.SliceOpTest

• Test_openjdk11_j9_sanity.openjdk_s390x_linux ==> "Compiler Crash"/"Agent errors : all NEW

  java/net/BindException/Test.java.Test
  java/net/httpclient/http2/ServerPush.java.ServerPush
  java/security/SecureClassLoader/DefineClassByteBuffer.java.DefineClassByteBuffer
  java/util/stream/test/org/openjdk/tests/java/util/stream/SliceOpTest.java.SliceOpTest

• Test_openjdk11_j9_sanity.openjdk_x86-64_linux ==> "Compiler Crash"/"Agent errors/Timeouts : all NEW

  java/security/KeyStore/PKCS12/EntryProtectionTest.java.EntryProtectionTest
  java/security/KeyStore/PKCS12/MetadataStoreLoadTest.java.MetadataStoreLoadTest
  java/util/concurrent/BlockingQueue/MultipleProducersSingleConsumerLoops.java.MultipleProducersSingleConsumerLoops
  java/util/stream/test/org/openjdk/tests/java/util/stream/SliceOpTest.java.SliceOpTest
  java/util/stream/test/org/openjdk/tests/java/util/stream/WhileOpTest.java.WhileOpTest

• Test_openjdk11_j9_sanity.openjdk_x86-64_linux_xl ==> "Compiler Crash" : all NEW

  java/rmi/Naming/LookupIPv6.java.LookupIPv6
  java/rmi/server/getRemoteClass/GetRemoteClass.java.GetRemoteClass

[andrew-m-leonard]

Thurs 26th March : JDK11

• Predominant issue with intermittent "Compiler Crash"

  00:27:03  java.lang.NullPointerException
  00:27:03    at jdk.compiler/com.sun.tools.javac.code.Symbol.complete(Symbol.java:642)
  00:27:03    at jdk.compiler/com.sun.tools.javac.code.Symbol$ClassSymbol.complete(Symbol.java:1326)
  00:27:03    at jdk.compiler/com.sun.tools.javac.code.Symbol$ClassSymbol.flags(Symbol.java:1259)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.Check.checkSunAPI(Check.java:3278)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.Attr.checkIdInternal(Attr.java:3933)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.Attr.checkId(Attr.java:3804)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.Attr.visitSelect(Attr.java:3696)
  00:27:03    at jdk.compiler/com.sun.tools.javac.tree.JCTree$JCFieldAccess.accept(JCTree.java:2114)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.Attr.attribTree(Attr.java:655)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.Attr.attribType(Attr.java:715)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.Attr.attribType(Attr.java:708)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.TypeEnter$ImportsPhase.attribImportType(TypeEnter.java:441)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.TypeEnter$ImportsPhase.doImport(TypeEnter.java:424)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.TypeEnter$ImportsPhase.resolveImports(TypeEnter.java:364)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.TypeEnter$ImportsPhase.runPhase(TypeEnter.java:321)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.TypeEnter$Phase.doCompleteEnvs(TypeEnter.java:282)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.TypeEnter$Phase.completeEnvs(TypeEnter.java:251)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.TypeEnter.complete(TypeEnter.java:198)
  00:27:03    at jdk.compiler/com.sun.tools.javac.code.Symbol.complete(Symbol.java:642)
  00:27:03    at jdk.compiler/com.sun.tools.javac.code.Symbol$ClassSymbol.complete(Symbol.java:1326)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.Enter.complete(Enter.java:583)
  00:27:03    at jdk.compiler/com.sun.tools.javac.comp.Enter.main(Enter.java:560)
  00:27:03    at jdk.compiler/com.sun.tools.javac.main.JavaCompiler.enterTrees(JavaCompiler.java:1066)
  00:27:03    at jdk.compiler/com.sun.tools.javac.main.JavaCompiler.compile(JavaCompiler.java:937)
  00:27:03    at jdk.compiler/com.sun.tools.javac.main.Main.compile(Main.java:311)
  00:27:03    at jdk.compiler/com.sun.tools.javac.main.Main.compile(Main.java:170)
  00:27:03    at jdk.compiler/com.sun.tools.javac.Main.compile(Main.java:75)
  00:27:03    at jdk.internal.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
  00:27:03    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  00:27:03    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
  00:27:03    at com.sun.javatest.regtest.agent.RegressionCompileCommand.run(RegressionCompileCommand.java:189)
  00:27:03    at com.sun.javatest.regtest.agent.CompileActionHelper.runCompile(CompileActionHelper.java:92)
  00:27:03    at com.sun.javatest.regtest.agent.AgentServer.doCompile(AgentServer.java:220)
  00:27:03    at com.sun.javatest.regtest.agent.AgentServer.run(AgentServer.java:190)
  00:27:03    at com.sun.javatest.regtest.agent.AgentServer.main(AgentServer.java:65)

[M-Davies]

Raised https://github.com/eclipse/openj9/issues/8992 for the sun/nio/cs/FindDecoderBugs.java failure

[andrew-m-leonard]

Fri 27th March: JDK8 OpenJ9:

• pLinux JVM crash, sanity.openjdk: java/nio/channels/DatagramChannel/MulticastSendReceiveTests.java https://github.com/eclipse/openj9/issues/9005
• special.openjdk most platforms:

  19:50:32  Error: JDK not found: /home/jenkins/workspace/Test_openjdk8_j9_special.openjdk_s390x_linux/openjdkbinary/j2re-image/jdk8u252-b07/bin/..

JDK11 OpenJ9: sanity.openjdk: java/util/zip/ZipFile/TestCleaner.java.TestCleaner ==> Timeout : rerun: https://ci.adoptopenjdk.net/job/Grinder/2598/ - Passes

JDK14 OpenJ9:

• Test_openjdk14_j9_sanity.openjdk_x86-64_mac_xl : java/nio/channels/SocketChannel/CloseDuringConnect.java.CloseDuringConnect Raised: https://github.com/eclipse/openj9/issues/9007 re-run: https://ci.adoptopenjdk.net/job/Grinder/2599/ - Passes

[M-Davies]

Fri 27th March : JDK11

• jdk11u-linux-s390x-openj9-linuxXL ===> Git fetch failure. Due to tags mismatch. Been occurring since wednesday night. Machine issue (no other jdk11/j9 builds affected by this)

[M-Davies]

Monday 30th March: JDK8

• Test_openjdk8_hs_sanity.openjdk_s390x_linux

java/security/SignedObject/Chain.java ===> Timeout. Thread lock? Intermittent java/util/stream/test/org/openjdk/tests/java/util/stream/FlatMapOpTest.java ===> Timeout. Thread Lock? Intermittent

• Test_openjdk8_hs_sanity.openjdk_x86-64_linux

Lots of failures! Most networking failures

java/net/CookieHandler/CookieManagerTest.java.CookieManagerTest
java/net/DatagramPacket/ReuseBuf.java.ReuseBuf
java/net/DatagramSocket/PortUnreachable.java.PortUnreachable
java/net/DatagramSocket/Send12k.java.Send12k
java/net/DatagramSocket/SendSize.java.SendSize
java/net/DatagramSocket/SetDatagramSocketImplFactory/ADatagramSocket.java.ADatagramSocket
java/net/HttpURLConnection/UnmodifiableMaps.java.UnmodifiableMaps
java/net/MulticastSocket/B6427403.java.B6427403
java/net/PlainSocketImpl/BigBacklog.java.BigBacklog
java/net/Socket/B6210227.java.B6210227
java/net/Socket/CloseAvailable.java.CloseAvailable
java/net/Socket/GetLocalAddress.java.GetLocalAddress
java/net/Socket/HttpProxy.java.HttpProxy
java/net/Socket/InheritTimeout.java.InheritTimeout
java/net/Socket/ReadTimeout.java.ReadTimeout
java/net/Socket/SetSoLinger.java.SetSoLinger
java/net/Socket/ShutdownBoth.java.ShutdownBoth
java/net/Socket/ShutdownInput.java.ShutdownInput
java/net/Socket/SoTimeout.java.SoTimeout
java/net/Socket/SocksConnectTimeout.java.SocksConnectTimeout
java/net/Socket/asyncClose/AsyncClose.java.AsyncClose
java/net/Socket/asyncClose/BrokenPipe.java.BrokenPipe
java/net/Socket/setReuseAddress/Basic.java.Basic
java/net/Socket/setReuseAddress/Restart.java.Restart
java/net/SocketInputStream/SocketTimeout.java.SocketTimeout
java/net/Socks/BadProxySelector.java.BadProxySelector
java/net/Socks/SocksProxyVersion.java.SocksProxyVersion
java/net/URLConnection/HandleContentTypeWithAttrs.java.HandleContentTypeWithAttrs
sun/net/www/protocol/http/B6299712.java.B6299712
sun/net/www/protocol/http/HttpOnly.java.HttpOnly
sun/net/www/protocol/http/NoCache.java.NoCache
sun/net/www/protocol/https/HttpsURLConnection/ImpactOnSNI.java.ImpactOnSNI
java/nio/channels/AsyncCloseAndInterrupt.java.AsyncCloseAndInterrupt
java/nio/channels/AsynchronousChannelGroup/Basic.java.Basic
java/nio/channels/AsynchronousChannelGroup/GroupOfOne.java.GroupOfOne
java/nio/channels/AsynchronousChannelGroup/Identity.java.Identity
java/nio/channels/AsynchronousChannelGroup/Restart.java.Restart
java/nio/channels/AsynchronousChannelGroup/Unbounded.java.Unbounded
java/nio/channels/AsynchronousFileChannel/Lock.java.Lock
java/nio/channels/AsynchronousServerSocketChannel/Basic.java.Basic
java/nio/channels/AsynchronousServerSocketChannel/WithSecurityManager.java.WithSecurityManager
java/nio/channels/AsynchronousSocketChannel/Basic.java.Basic
java/nio/channels/AsynchronousSocketChannel/DieBeforeComplete.java.DieBeforeComplete
java/nio/channels/AsynchronousSocketChannel/Leaky.java.Leaky
java/nio/channels/AsynchronousSocketChannel/StressLoopback.java.StressLoopback
java/nio/channels/Channels/Basic2.java.Basic2
java/nio/channels/DatagramChannel/AdaptDatagramSocket.java.AdaptDatagramSocket
java/nio/channels/DatagramChannel/Connect.java.Connect
java/nio/channels/DatagramChannel/ConnectedSend.java.ConnectedSend
java/nio/channels/DatagramChannel/Disconnect.java.Disconnect
java/nio/channels/DatagramChannel/IsBound.java.IsBound
java/nio/channels/DatagramChannel/IsConnected.java.IsConnected
java/nio/channels/DatagramChannel/NotBound.java.NotBound
java/nio/channels/DatagramChannel/ReceiveISA.java.ReceiveISA
java/nio/channels/DatagramChannel/SRTest.java.SRTest
java/nio/channels/DatagramChannel/Sender.java.Sender
java/nio/channels/FileChannel/LongTransferTest.java.LongTransferTest
java/nio/channels/FileChannel/Transfer.java.Transfer
java/nio/channels/Selector/Alias.java.Alias
java/nio/channels/Selector/BasicAccept.java.BasicAccept
java/nio/channels/Selector/BasicConnect.java.BasicConnect
java/nio/channels/Selector/ChangingInterests.java.ChangingInterests
java/nio/channels/Selector/CloseWhenKeyIdle.java.CloseWhenKeyIdle
java/nio/channels/Selector/Connect.java.Connect
java/nio/channels/Selector/ConnectWrite.java.ConnectWrite
java/nio/channels/Selector/KeysReady.java.KeysReady
java/nio/channels/Selector/OpRead.java.OpRead
java/nio/channels/Selector/OutOfBand.java.OutOfBand
java/nio/channels/Selector/ReadAfterConnect.java.ReadAfterConnect
java/nio/channels/Selector/RegAfterPreClose.java.RegAfterPreClose
java/nio/channels/Selector/SelectAfterRead.java.SelectAfterRead
java/nio/channels/Selector/SelectWrite.java.SelectWrite
java/nio/channels/Selector/SelectorLimit.java.SelectorLimit
java/nio/channels/Selector/SelectorTest.java.SelectorTest
java/nio/channels/ServerSocketChannel/AdaptServerSocket.java.AdaptServerSocket
java/nio/channels/ServerSocketChannel/Basic.java.Basic
java/nio/channels/ServerSocketChannel/NonBlockingAccept.java.NonBlockingAccept
java/nio/channels/SocketChannel/AdaptSocket.java.AdaptSocket
java/nio/channels/SocketChannel/Basic.java.Basic
java/nio/channels/SocketChannel/CloseAfterConnect.java.CloseAfterConnect
java/nio/channels/SocketChannel/CloseDuringWrite.java.CloseDuringWrite
java/nio/channels/SocketChannel/Connect.java.Connect
java/nio/channels/SocketChannel/ConnectState.java.ConnectState
java/nio/channels/SocketChannel/FinishConnect.java.FinishConnect
java/nio/channels/SocketChannel/GetChannel.java.GetChannel
java/nio/channels/SocketChannel/Hangup.java.Hangup
java/nio/channels/SocketChannel/IsConnectable.java.IsConnectable
java/nio/channels/SocketChannel/LocalAddress.java.LocalAddress
java/nio/channels/SocketChannel/OutOfBand.java.OutOfBand
java/nio/channels/SocketChannel/ShortWrite.java.ShortWrite
java/nio/channels/SocketChannel/Shutdown.java.Shutdown
java/nio/channels/SocketChannel/Stream.java.Stream
java/nio/channels/SocketChannel/VectorIO.java.VectorIO
java/nio/channels/SocketChannel/VectorParams.java.VectorParams
java/nio/channels/SocketChannel/Write.java.Write
java/nio/channels/etc/NetworkChannelTests.java.NetworkChannelTests
java/rmi/activation/Activatable/checkActivateRef/CheckActivateRef.java.CheckActivateRef
java/rmi/activation/Activatable/checkAnnotations/CheckAnnotations.java.CheckAnnotations
java/io/FilePermission/Invalid.java.Invalid
java/io/LineNumberReader/MarkSplitCRLF.java.MarkSplitCRLF
java/io/Serializable/serialFilter/GlobalFilterTest.java.GlobalFilterTest
java/lang/Class/getDeclaredField/FieldSetAccessibleTest.java.FieldSetAccessibleTest
java/lang/ProcessBuilder/Basic.java.Basic
java/lang/SecurityManager/CheckPackageAccess.java.CheckPackageAccess
sun/misc/IOUtils/ReadAllBytes.java.ReadAllBytes
sun/misc/IOUtils/ReadNBytes.java.ReadNBytes
sun/misc/URLClassPath/JarClassPathFileEntry.java.JarClassPathFileEntry
sun/net/www/B8185898.java.B8185898
java/security/Signature/Offsets.java.Offsets
java/security/Signature/SignatureGetInstance.java.SignatureGetInstance
java/security/SignedObject/Chain.java.Chain
java/security/cert/X509CRL/VerifyDefault.java.VerifyDefault
java/security/cert/X509Certificate/VerifyDefault.java.VerifyDefault
java/util/Locale/Bug8040211.java.Bug8040211
java/util/Objects/CheckIndex.java.CheckIndex
java/util/TimeZone/TimeZoneTest.java.TimeZoneTest

• Test_openjdk8_j9_sanity.openjdk_x86-64_linux_xl

java/net/MulticastSocket/SetGetNetworkInterfaceTest.java ===> Rasied on old closed issue https://github.com/AdoptOpenJDK/openjdk-tests/issues/1048

java.net.SocketException: Cannot assign requested address (Error setting socket option)
    at java.net.PlainDatagramSocketImpl.socketSetOption(PlainDatagramSocketImpl.java:74)
    at java.net.AbstractPlainDatagramSocketImpl.setOption(AbstractPlainDatagramSocketImpl.java:309)
    at java.net.MulticastSocket.setNetworkInterface(MulticastSocket.java:554)
    at SetGetNetworkInterfaceTest.main(SetGetNetworkInterfaceTest.java:54)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
    at java.lang.Thread.run(Thread.java:821)

java/net/MulticastSocket/SetOutgoingIf.java ===> Intermittent net issue. Seen before across JDK8 builds.

java.lang.RuntimeException: java.net.SocketTimeoutException: Receive timed out
    at SetOutgoingIf.main(SetOutgoingIf.java:153)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
    at java.lang.Thread.run(Thread.java:821)
Caused by: java.net.SocketTimeoutException: Receive timed out
    at java.net.DatagramSocket.receive(DatagramSocket.java:743)
    at SetOutgoingIf.main(SetOutgoingIf.java:149)
    ... 6 more

• Test_openjdk8_j9_sanity.openjdk_x86-64_mac

java/rmi/activation/Activatable/shutdownGracefully/ShutdownGracefully.java ===> Unclear failure. Kicked off a grinder to gather more info https://ci.adoptopenjdk.net/job/Grinder/2644/

20:23:39  Error: Port Library failed to initialize: -1
20:23:39  Error: Could not create the Java Virtual Machine.
20:23:39  Error: A fatal exception has occurred. Program will exit.
TEST RESULT: Failed. Unexpected exit from test [exit code: 1]

[andrew-m-leonard]

Thurs April 2nd 3 test jobs "completed" but got hung on slave executors at end of pipeline with below, had to kill "Executor" as job had actually finished to remove:

[Pipeline] End of Pipeline
java.lang.NullPointerException
    at org.jenkinsci.plugins.workflow.cps.FlowHead.markIfFail(FlowHead.java:176)
    at org.jenkinsci.plugins.workflow.cps.CpsStepContext$2.onSuccess(CpsStepContext.java:426)
    at org.jenkinsci.plugins.workflow.cps.CpsStepContext$2.onSuccess(CpsStepContext.java:381)
    at org.jenkinsci.plugins.workflow.cps.CpsFlowExecution$4$1.run(CpsFlowExecution.java:907)
    at org.jenkinsci.plugins.workflow.cps.CpsVmExecutorService$1.run(CpsVmExecutorService.java:38)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:131)
    at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
    at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Finished: FAILURE

jdk14 Windows & pLinux:

• ChaCha20 failure: https://github.com/eclipse/openj9/issues/9079

jdk14 Test_openjdk14_j9_sanity.external_x86-64_linux_openliberty-mp-tck:

• https://ci.adoptopenjdk.net/job/Test_openjdk14_j9_sanity.external_x86-64_linux_openliberty-mp-tck/38/console

  01:10:17  * What went wrong:
  01:10:17  Could not open cp_settings remapped class cache for 409m3kaqytwwj0d22h2u31acg (/root/.gradle/caches/5.6.2/scripts-remapped/settings_bimm3z0dwshuq5c7p2wfrtf2s/409m3kaqytwwj0d22h2u31acg/cp_settingsb2a26a14293d10114dbb1df3464ffd3c).
  01:10:17  > Could not open cp_settings generic class cache for settings file '/open-liberty/dev/settings.gradle' (/root/.gradle/caches/5.6.2/scripts/409m3kaqytwwj0d22h2u31acg/cp_settings/cp_settingsb2a26a14293d10114dbb1df3464ffd3c).
  01:10:17     > BUG! exception in phase 'semantic analysis' in source unit '_BuildScript_' Unsupported class file major version 58

[M-Davies]

Thurs April 2nd A whole bunch of sun Windows tests have been failing since 31st March

com/sun/jdi/ArrayLengthDumpTest.sh.ArrayLengthDumpTest
com/sun/jdi/BreakpointWithFullGC.sh.BreakpointWithFullGC
com/sun/jdi/CatchAllTest.sh.CatchAllTest
com/sun/jdi/CatchCaughtTest.sh.CatchCaughtTest
com/sun/jdi/CatchPatternTest.sh.CatchPatternTest
com/sun/jdi/CommandCommentDelimiter.sh.CommandCommentDelimiter
com/sun/jdi/DeoptimizeWalk.sh.DeoptimizeWalk
com/sun/jdi/EvalArgs.sh.EvalArgs
com/sun/jdi/EvalArraysAsList.sh.EvalArraysAsList
com/sun/jdi/EvalInterfaceStatic.sh.EvalInterfaceStatic
com/sun/jdi/GetLocalVariables3Test.sh.GetLocalVariables3Test
com/sun/jdi/GetLocalVariables4Test.sh.GetLocalVariables4Test
com/sun/jdi/JdbLockTest.sh.JdbLockTest
com/sun/jdi/JdbMethodExitTest.sh.JdbMethodExitTest
com/sun/jdi/JdbMissStep.sh.JdbMissStep
com/sun/jdi/JdbVarargsTest.sh.JdbVarargsTest
com/sun/jdi/MixedSuspendTest.sh.MixedSuspendTest
com/sun/jdi/NotAField.sh.NotAField
com/sun/jdi/NullLocalVariable.sh.NullLocalVariable
com/sun/jdi/Redefine-g.sh.Redefine-g
com/sun/jdi/RedefineAbstractClass.sh.RedefineAbstractClass
com/sun/jdi/RedefineAddPrivateMethod.sh.RedefineAddPrivateMethod
com/sun/jdi/RedefineAnnotation.sh.RedefineAnnotation
com/sun/jdi/RedefineChangeClassOrder.sh.RedefineChangeClassOrder
com/sun/jdi/RedefineClasses.sh.RedefineClasses
com/sun/jdi/RedefineClearBreakpoint.sh.RedefineClearBreakpoint
com/sun/jdi/RedefineException.sh.RedefineException
com/sun/jdi/RedefineFinal.sh.RedefineFinal
com/sun/jdi/RedefineImplementor.sh.RedefineImplementor
com/sun/jdi/RedefineIntConstantToLong.sh.RedefineIntConstantToLong
com/sun/jdi/RedefineMulti.sh.RedefineMulti
com/sun/jdi/RedefinePop.sh.RedefinePop
com/sun/jdi/RedefineStep.sh.RedefineStep
com/sun/jdi/RedefineTTYLineNumber.sh.RedefineTTYLineNumber
com/sun/jdi/StringConvertTest.sh.StringConvertTest
com/sun/jdi/WatchFramePop.sh.WatchFramePop

• https://ci.adoptopenjdk.net/job/Test_openjdk8_hs_sanity.openjdk_x86-64_windows/111/#showFailuresLink
• https://ci.adoptopenjdk.net/job/Test_openjdk8_hs_sanity.openjdk_x86-32_windows/95/#showFailuresLink

RAISED -> https://github.com/AdoptOpenJDK/openjdk-tests/issues/1711

[andrew-m-leonard]

Fri 3rd April

JDK14 & JDK8 zLinux :

• Looks like Network failure around 9:30pm UK time cause most of the jobs to fail...

JDK8 & 11:

• Windows build failed:

  [Pipeline] stage
  [Pipeline] { (build)
  [Pipeline] checkout
  No credentials specified
  Cloning the remote Git repository
  Cloning repository https://github.com/AdoptOpenJDK/openjdk-build.git
  ERROR: Failed to clean the workspace
  jenkins.util.io.CompositeIOException: Unable to delete 'C:\cygwin64\tmp\openjdk-build'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.
  at jenkins.util.io.PathRemover.forceRemoveDirectoryContents(PathRemover.java:90)

  Test_openjdk8_j9_sanity.external_x86-64_linux

  [Pipeline] End of Pipeline
  Also:   hudson.remoting.ProxyException: groovy.lang.MissingPropertyException: No such property: ‘DOCKERIMAGE_TAG’ for class: WorkflowScript
  Also:   hudson.remoting.ProxyException: groovy.lang.MissingPropertyException: No such property: ‘DOCKERIMAGE_TAG’ for class: WorkflowScript
  Also:   hudson.remoting.ProxyException: groovy.lang.MissingPropertyException: No such property: ‘DOCKERIMAGE_TAG’ for class: WorkflowScript
  hudson.remoting.ProxyException: groovy.lang.MissingPropertyException: No such property: ‘DOCKERIMAGE_TAG’ for class: WorkflowScript
  at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.unwrap(ScriptBytecodeAdapter.java:53)
  at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.getProperty(ScriptBytecodeAdapter.java

  Raised: https://github.com/AdoptOpenJDK/openjdk-build/issues/1651

JDK11 false reported failures: Test_openjdk11_j9_sanity.openjdk_ppc64le_linux, actually all passed but some old testoutput was picked up:

02:58:31  TAP Reports Processing: START
02:58:31  Looking for TAP results report in workspace using pattern: **/*.tap
02:59:33  Saving reports...
02:59:34  Processing '/home/jenkins/.jenkins/jobs/Test_openjdk11_j9_sanity.openjdk_ppc64le_linux/builds/190/tap-master-files/jvmtest/TKG/test_output_15851840293015/TestTargetResult.tap'
02:59:34  Parsing TAP test result [/home/jenkins/.jenkins/jobs/Test_openjdk11_j9_sanity.openjdk_ppc64le_linux/builds/190/tap-master-files/jvmtest/TKG/test_output_15851840293015/TestTargetResult.tap].
02:59:34  Processing '/home/jenkins/.jenkins/jobs/Test_openjdk11_j9_sanity.openjdk_ppc64le_linux/builds/190/tap-master-files/openjdk-tests/TKG/test_output_15851840293015/TestTargetResult.tap'
02:59:34  Parsing TAP test result [/home/jenkins/.jenkins/jobs/Test_openjdk11_j9_sanity.openjdk_ppc64le_linux/builds/190/tap-master-files/openjdk-tests/TKG/test_output_15851840293015/TestTargetResult.tap].
02:59:34  Processing '/home/jenkins/.jenkins/jobs/Test_openjdk11_j9_sanity.openjdk_ppc64le_linux/builds/190/tap-master-files/openjdk-tests/TKG/test_output_15858762263117/TestTargetResult.tap'
02:59:34  Parsing TAP test result [/home/jenkins/.jenkins/jobs/Test_openjdk11_j9_sanity.openjdk_ppc64le_linux/builds/190/tap-master-files/openjdk-tests/TKG/test_output_15858762263117/TestTargetResult.tap].
02:59:34  There are failed test cases. Marking build as UNSTABLE
02:59:34  TAP Reports Processing: FINISH

[M-Davies]

JDK8 & 11:

• Windows build failed:

[Pipeline] stage
[Pipeline] { (build)
[Pipeline] checkout
No credentials specified
Cloning the remote Git repository
Cloning repository https://github.com/AdoptOpenJDK/openjdk-build.git
ERROR: Failed to clean the workspace
jenkins.util.io.CompositeIOException: Unable to delete 'C:\cygwin64\tmp\openjdk-build'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.
  at jenkins.util.io.PathRemover.forceRemoveDirectoryContents(PathRemover.java:90)

@andrew-m-leonard This should be resolved thanks to @Willsparker

[M-Davies]

Mon 6th April

• jdk14/j9+hs/windows+windowsXL builds failing with tags errors since saturday

  Fetching origin
  HEAD is now at a67072cce1 Merge hotspot at HEAD
  AdoptOpenJDK.md marker file not found in fetched source to be built, this may mean the wrong SCMReference build parameter has been specified. Ensure the correct AdoptOpenJDK patch release tag is specified, eg.for build jdk-11.0.4+10, it would be jdk-11.0.4+10_adopt

[M-Davies]

Tues 7th April

• JDK14/j9/windows_x64 build. Configure arguments borked (since 03/04/2020)

  Running custom generated-configure.sh
  configure: error: unrecognized options: --with-version-opt, --without-version-pre, --with-version-build, --with-vendor-version-string, --disable-warnings-as-errors

  RAISED -> https://github.com/AdoptOpenJDK/openjdk-build/issues/1656

• https://github.com/AdoptOpenJDK/openjdk-build/issues/1634#issuecomment-609654038 is still failing on x32

[andrew-m-leonard]

Thurs 9th April

OpenJ9:

• xLinux builds mostly failed due to test-packet-ubuntu1604-x64-2 running out of disk space: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1266
• Test_openjdk8_j9_sanity.system_x86-64_windows could not contact test-godaddy-win2016-x64-4
• Test_openjdk8_j9_extended.system_x86-64_windows : Cannot contact test-godaddy-win2016-x64-1
• Test_openjdk8_j9_sanity.openjdk_ppc64le_linux_xl : network error : [exec] curl: (18) transfer closed with 46771 bytes remaining to read
• jdk14 mac&windows : com/sun/crypto/provider/Cipher/ChaCha20/OutputSizeTest.java.OutputSizeTest : https://github.com/eclipse/openj9/issues/9079

HotSpot

• xLinux builds mostly failed due to test-packet-ubuntu1604-x64-2 running out of disk space: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1266
• jdk8 numerous failures, implementation issues?
• jdk11&14 mac : 01:07:31 AG stderr Exception in thread "main" java.io.IOException: well-known file /var/folders/2z/dc49dy3x5s1dy1gjq_11wlkc0000gr/T/.java_pid70991 is not secure: file's group should be the current group (which is -1) but the group is 0 01:07:31 AG stderr at jdk.attach/sun.tools.attach.VirtualMachineImpl.checkPermissions(Native Method)
• jdk14 aarch64 numerous failures

[M-Davies]

jdk8 numerous failures, implementation issues?

• The windows failures for are known failures https://github.com/AdoptOpenJDK/openjdk-tests/pull/1724
• s390x failures look to be intermittents except for the /jdi/ tests. I'm not 100% sure what's going on here but these are consistently failing on s390x. Needs raising

jdk11&14 mac : 01:07:31 AG stderr Exception in thread "main" java.io.IOException: well-known file /var/folders/2z/dc49dy3x5s1dy1gjq_11wlkc0000gr/T/.java_pid70991 is not secure: file's group should be the current group (which is -1) but the group is 0

This seems like its been failing for a while and should be raised. Likely due to the debugger that the test spawns not having the same perms as the java_pid file. Understandable considering that the file seems to have been created in /var.
RAISED -> https://github.com/AdoptOpenJDK/openjdk-tests/issues/1725

[M-Davies]

Tues 14th April

• ~Windows builds failing due to https://github.com/AdoptOpenJDK/openjdk-build/issues/1659~ RESOLVED
• ~No tests ran over the easter weekend???~ Disabled due to upcoming release https://github.com/AdoptOpenJDK/openjdk-build/pull/1658

[M-Davies]

Fri 17th April

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_hs_sanity.openjdk_aarch64_linux java/lang/invoke/VarHandles/VarHandleTestByteArrayAsInt.java ===> First time seen. Should keep an eye on it

  01:33:55  test VarHandleTestByteArrayAsInt.testAccess(" VarHandle [ALIGNED, BIG_ENDIAN, READ_WRITE] -> java.nio.HeapByteBuffer[pos=0 lim=32 cap=32] [ALIGNED, LITTLE_ENDIAN, READ_WRITE] read write", VarHandleBaseByteArrayTest$VarHandleSourceAccessTestCase@75077b40): failure
  01:33:55  java.lang.AssertionError: weakCompareAndSetAcquire int expected [true] but found [false]
  01:33:55    at org.testng.Assert.fail(Assert.java:94)
  01:33:55    at org.testng.Assert.failNotEquals(Assert.java:496)
  01:33:55    at org.testng.Assert.assertEquals(Assert.java:125)
  01:33:55    at org.testng.Assert.assertEquals(Assert.java:288)
  01:33:55    at VarHandleTestByteArrayAsInt.testArrayReadWrite(VarHandleTestByteArrayAsInt.java:1531)
  01:33:55    at VarHandleTestByteArrayAsInt.lambda$accessTestCaseProvider$5(VarHandleTestByteArrayAsInt.java:159)
  01:33:55    at VarHandleBaseTest$AccessTestCase.testAccess(VarHandleBaseTest.java:405)
  01:33:55    at VarHandleTestByteArrayAsInt.testAccess(VarHandleTestByteArrayAsInt.java:196)
  01:33:55    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  01:33:55    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  01:33:55    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  01:33:55    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
  01:33:55    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:85)
  01:33:55    at org.testng.internal.Invoker.invokeMethod(Invoker.java:639)
  01:33:55    at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:821)
  01:33:55    at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1131)
  01:33:55    at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
  01:33:55    at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:108)
  01:33:55    at org.testng.TestRunner.privateRun(TestRunner.java:773)
  01:33:55    at org.testng.TestRunner.run(TestRunner.java:623)
  01:33:55    at org.testng.SuiteRunner.runTest(SuiteRunner.java:357)
  01:33:55    at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:352)
  01:33:55    at org.testng.SuiteRunner.privateRun(SuiteRunner.java:310)
  01:33:55    at org.testng.SuiteRunner.run(SuiteRunner.java:259)
  01:33:55    at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
  01:33:55    at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
  01:33:55    at org.testng.TestNG.runSuitesSequentially(TestNG.java:1185)
  01:33:55    at org.testng.TestNG.runSuitesLocally(TestNG.java:1110)
  01:33:55    at org.testng.TestNG.run(TestNG.java:1018)
  01:33:55    at com.sun.javatest.regtest.agent.TestNGRunner.main(TestNGRunner.java:94)
  01:33:55    at com.sun.javatest.regtest.agent.TestNGRunner.main(TestNGRunner.java:54)
  01:33:55    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  01:33:55    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  01:33:55    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  01:33:55    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
  01:33:55    at com.sun.javatest.regtest.agent.MainWrapper$MainThread.run(MainWrapper.java:127)
  01:33:55    at java.base/java.lang.Thread.run(Thread.java:834)

• Lot of failing tests on https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk14_hs_sanity.openjdk_aarch64_linux. Seems to be every night for the past 3 days. Investigating...

  java/lang/ProcessBuilder/Basic.java#id0.Basic_id0
  java/lang/ProcessBuilder/Basic.java#id1.Basic_id1
  java/lang/ProcessBuilder/InheritIO/InheritIO.sh.InheritIO
  java/lang/ProcessBuilder/SkipTest.java.SkipTest
  java/lang/RuntimeTests/exec/Duped.java.Duped
  java/lang/RuntimeTests/exec/ExecWithLotsOfArgs.java.ExecWithLotsOfArgs
  java/lang/RuntimeTests/exec/SetCwd.java.SetCwd
  java/util/logging/LoggingDeadlock2.java.LoggingDeadlock2
  java/util/zip/EntryCount64k.java.EntryCount64k

• Consistently failing test on https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk14_hs_sanity.openjdk_x86-32_windows jdk/jfr/event/compiler/TestAllocInNewTLAB.java

  java.lang.RuntimeException: Too few tlab objects allocated: expected 50 >= 80
  at jdk.test.lib.Asserts.fail(Asserts.java:594)
  at jdk.test.lib.Asserts.assertGreaterThanOrEqual(Asserts.java:288)
  at jdk.jfr.event.compiler.TestAllocInNewTLAB.main(TestAllocInNewTLAB.java:107)
  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.base/java.lang.reflect.Method.invoke(Method.java:564)
  at com.sun.javatest.regtest.agent.MainWrapper$MainThread.run(MainWrapper.java:127)
  at java.base/java.lang.Thread.run(Thread.java:832)

• ~https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk14_hs_sanity.openjdk_x86-64_mac~

  com/sun/jdi/ProcessAttachTest.java.ProcessAttachTest
  jdk/jfr/jcmd/TestJcmdStartStopDefault.java.TestJcmdStartStopDefault

  ~EXISTING ISSUE: https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1274.~ RESOLVING ===> https://github.com/AdoptOpenJDK/openjdk-tests/pull/1734

• ~https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_hs_sanity.openjdk_s390x_linux is seeing a lot of failures. Some known on windows: https://github.com/AdoptOpenJDK/openjdk-tests/issues/1711.~ TRIAGE ISSUE ===> https://github.com/AdoptOpenJDK/openjdk-tests/issues/1737

  java/util/stream/test/org/openjdk/tests/java/util/stream/StreamBuilderTest.java.StreamBuilderTest
  java/util/stream/test/org/openjdk/tests/java/util/stream/FlatMapOpTest.java.FlatMapOpTest
  java/util/stream/test/org/openjdk/tests/java/util/stream/TabulatorsTest.java.TabulatorsTest
  java/lang/invoke/MethodHandles/CatchExceptionTest.java.CatchExceptionTest
  com/sun/jdi/AllLineLocations.java.AllLineLocations
  com/sun/jdi/EarlyReturnTest.java.EarlyReturnTest
  com/sun/jdi/JdbMethodExitTest.sh.JdbMethodExitTest
  com/sun/jdi/MethodExitReturnValuesTest.java.MethodExitReturnValuesTest
  com/sun/jdi/NativeInstanceFilter.java.NativeInstanceFilter
  com/sun/jdi/PopAndStepTest.java.PopAndStepTest
  com/sun/jdi/PopAsynchronousTest.java.PopAsynchronousTest
  com/sun/jdi/PopSynchronousTest.java.PopSynchronousTest
  com/sun/jdi/Redefine-g.sh.Redefine-g
  com/sun/jdi/RedefineCrossStart.java.RedefineCrossStart
  com/sun/jdi/redefineMethod/RedefineTest.java.RedefineTest

• ~https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_hs_sanity.openjdk_x86-32_windows These tests should all have been excluded in https://github.com/AdoptOpenJDK/openjdk-tests/pull/1724???~ RESOLVING ===> https://github.com/AdoptOpenJDK/openjdk-tests/pull/1733
• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_hs_sanity.openjdk_x86-64_linux Failing test numbers seem to vary everynight. Needs investigating...
• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_hs_sanity.openjdk_x86-64_mac com/sun/jdi/ProcessAttachTest.sh===> Timeout. Failing for two days in a row
• ~https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_hs_sanity.openjdk_x86-64_windows EvalArraysAsList.sh should be excluded in https://github.com/AdoptOpenJDK/openjdk-tests/pull/1719???~ RESOLVING ===> https://github.com/AdoptOpenJDK/openjdk-tests/pull/1733

[M-Davies]

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_hs_sanity.openjdk_s390x_linux is seeing a lot of failures. Some known on windows: AdoptOpenJDK/openjdk-tests#1711. Needs triaging...

java/util/stream/test/org/openjdk/tests/java/util/stream/StreamBuilderTest.java.StreamBuilderTest
java/util/stream/test/org/openjdk/tests/java/util/stream/FlatMapOpTest.java.FlatMapOpTest
java/util/stream/test/org/openjdk/tests/java/util/stream/TabulatorsTest.java.TabulatorsTest
java/lang/invoke/MethodHandles/CatchExceptionTest.java.CatchExceptionTest
com/sun/jdi/AllLineLocations.java.AllLineLocations
com/sun/jdi/EarlyReturnTest.java.EarlyReturnTest
com/sun/jdi/JdbMethodExitTest.sh.JdbMethodExitTest
com/sun/jdi/MethodExitReturnValuesTest.java.MethodExitReturnValuesTest
com/sun/jdi/NativeInstanceFilter.java.NativeInstanceFilter
com/sun/jdi/PopAndStepTest.java.PopAndStepTest
com/sun/jdi/PopAsynchronousTest.java.PopAsynchronousTest
com/sun/jdi/PopSynchronousTest.java.PopSynchronousTest
com/sun/jdi/Redefine-g.sh.Redefine-g
com/sun/jdi/RedefineCrossStart.java.RedefineCrossStart
com/sun/jdi/redefineMethod/RedefineTest.java.RedefineTest

~The top three tests are going to be excluded under existing JBS issues https://github.com/AdoptOpenJDK/openjdk-tests/pull/1735. There are a few shell tests and these are due to be re-written in java~

JdbMethodExitTest.sh
Redefine-g.sh

https://bugs.openjdk.java.net/browse/JDK-8201652 ===> Added to https://github.com/AdoptOpenJDK/openjdk-tests/pull/1733

~To clarify, the remaining tests that need triage for s390x are~ RAISED ===> https://github.com/AdoptOpenJDK/openjdk-tests/issues/1737

> com/sun/jdi/AllLineLocations.java.AllLineLocations
> com/sun/jdi/EarlyReturnTest.java.EarlyReturnTest
> com/sun/jdi/MethodExitReturnValuesTest.java.MethodExitReturnValuesTest
> com/sun/jdi/NativeInstanceFilter.java.NativeInstanceFilter
> com/sun/jdi/PopAndStepTest.java.PopAndStepTest
> com/sun/jdi/PopAsynchronousTest.java.PopAsynchronousTest
> com/sun/jdi/PopSynchronousTest.java.PopSynchronousTest
> com/sun/jdi/RedefineCrossStart.java.RedefineCrossStart
> com/sun/jdi/redefineMethod/RedefineTest.java.RedefineTest

[M-Davies]

Mon 20th April

https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_hs_sanity.openjdk_x86-64_mac com/sun/jdi/ProcessAttachTest.sh===> Timeout. Failing for two days in a row

• ~Passed Saturday then failed again yesterday. Passing test was on test-macincloud-macos1010-x64-​2, failing ones on test-macincloud-macos1013-x64-​1&2.~ RAISED => https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1274#issuecomment-616530080

• ~https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-hotspot JDK-Next git rev-list couldn't find any tags. Been failing since last Thursday. Possible the git on the machines (build-azure-win2012r2-x64-1 & 2) are out of date as the docs for rev-list show a slightly different syntax. Failing code: https://github.com/AdoptOpenJDK/openjdk-build/blob/995c157903452e2c10751ab196567f281ff7fcd4/sbin/build.sh#L646~ RAISED => https://github.com/AdoptOpenJDK/openjdk-build/issues/1680

  Pulling latest tags and getting the latest update version using git fetch -q --tags --depth=1
  NOTE: This can take quite some time!  Please be patient
  From /cygdrive/j/jenkins/tmp/workspace/./build//src
  * branch                  HEAD       -> FETCH_HEAD
  usage: git rev-list [OPTION] <commit-id>... [ -- paths... ]
  limiting output:
  --max-count=<n>
  --max-age=<epoch>
  --min-age=<epoch>
  --sparse
  --no-merges
  --min-parents=<n>
  --no-min-parents
  --max-parents=<n>
  --no-max-parents
  --remove-empty
  --all
  --branches
  --tags
  --remotes
  --stdin
  --quiet
  ordering output:
  --topo-order
  --date-order
  --reverse
  formatting output:
  --parents
  --children
  --objects | --objects-edge
  --unpacked
  --header | --pretty
  --abbrev=<n> | --no-abbrev
  --abbrev-commit
  --left-right
  --count
  special purpose:
  --bisect
  --bisect-vars
  --bisect-all
  WARNING: Failed to identify latest tag in the repository
  Unable to detect git tag, exiting...

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-hotspot/525 Missing file in build

  
  === Output from failing command(s) repeated here ===

• For target support_native_java.desktop_libawt_Blit.obj: Blit.c ./src/java.desktop/share/native/libawt/java2d/loops/Blit.c(29): fatal error C1083: Cannot open include file: 'sun_java2d_loops_Blit.h': No such file or directory ... (rest of output omitted)

• All command lines available in /cygdrive/j/jenkins/tmp/workspace/build/src/build/windows-x86_64-normal-clientANDserver-release/make-support/failure-logs. === End of repeated output ===

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-openj9-windowsXL/289 Crypto failure

  Creating support/modules_libs/java.base/jrt-fs.jar
  Compiling 2 files for COMPILE_DEPEND
  /cygdrive/c/progra~2/mib055~1/2017/community/vc/tools/msvc/14.16.27023/bin/hostx86/x64/cl -E
  java.lang.InternalError: Unexpected CryptoAPI failure generating seed
  at java.base/sun.security.provider.NativeSeedGenerator.getSeedBytes(NativeSeedGenerator.java:62)
  at java.base/sun.security.provider.SeedGenerator.generateSeed(SeedGenerator.java:144)
  at java.base/sun.security.provider.AbstractDrbg.lambda$static$0(AbstractDrbg.java:524)
  at java.base/sun.security.provider.AbstractDrbg.getEntropyInput(AbstractDrbg.java:507)
  at java.base/sun.security.provider.AbstractDrbg.getEntropyInput(AbstractDrbg.java:494)
  at java.base/sun.security.provider.AbstractDrbg.instantiateIfNecessary(AbstractDrbg.java:696)
  at java.base/sun.security.provider.AbstractDrbg.engineNextBytes(AbstractDrbg.java:378)
  at java.base/sun.security.provider.AbstractDrbg.engineNextBytes(AbstractDrbg.java:334)
  at java.base/sun.security.provider.AbstractDrbg$SeederHolder.lambda$static$0(AbstractDrbg.java:558)
  at java.base/sun.security.provider.AbstractDrbg.getEntropyInput(AbstractDrbg.java:507)
  at java.base/sun.security.provider.AbstractDrbg.getEntropyInput(AbstractDrbg.java:494)
  at java.base/sun.security.provider.AbstractDrbg.instantiateIfNecessary(AbstractDrbg.java:696)
  at java.base/sun.security.provider.AbstractDrbg.engineNextBytes(AbstractDrbg.java:378)
  at java.base/sun.security.provider.AbstractDrbg.engineNextBytes(AbstractDrbg.java:334)
  at java.base/sun.security.provider.DRBG.engineNextBytes(DRBG.java:233)
  at java.base/java.security.SecureRandom.nextBytes(SecureRandom.java:741)
  at java.base/java.security.SecureRandom.next(SecureRandom.java:798)
  at java.base/java.util.Random.nextLong(Random.java:424)
  at java.base/java.io.File$TempDirectory.generateFile(File.java:1928)
  at java.base/java.io.File.createTempFile(File.java:2076)
  at java.base/java.io.File.createTempFile(File.java:2136)
  at jdk.jartool/sun.tools.jar.Main.createTemporaryFile(Main.java:1712)
  at jdk.jartool/sun.tools.jar.Main.run(Main.java:313)
  at jdk.jartool/sun.tools.jar.Main.main(Main.java:1669)

[M-Davies]

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_x86-64_mac_xl java/util/zip/ZipFile/TestCleaner.java is still timing out (also times out on windows_xl). Needs investigating...
• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_x86-64_windows_xl

  java/util/logging/CheckZombieLockTest.java===> Reused lock file. Seen before, EXCLUDED https://github.com/eclipse/openj9/issues/9186
  java/util/zip/ZipFile/TestCleaner.java===> Timeout. Same as above.

  Consistently failing test on https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk14_hs_sanity.openjdk_x86-32_windows jdk/jfr/event/compiler/TestAllocInNewTLAB.java

• ~https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk14_hs_sanity.openjdk_x86-32_windows Still failing~ ALREADY RAISED => https://github.com/AdoptOpenJDK/openjdk-tests/issues/1736
• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk14_hs_sanity.openjdk_x86-64_linux jdk/internal/math/FloatingDecimal/TestFloatingDecimal.java Timeout. First time seen.

[M-Davies]

Tuesday 21 April

• Seeing a lot of build failures. Raised in adopt slack and build https://github.com/AdoptOpenJDK/openjdk-build/issues/1683

[M-Davies]

Wed 22nd April BUILDS

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-windows-x64-openj9-windowsXL new error

  Creating support/modules_libs/java.base/jrt-fs.jar
  make[4]: *** [/cygdrive/j/jenkins/tmp/workspace/build/src/openj9/runtime/buildtools.mk:218: configure] Broken pipe
  make[3]: *** [/cygdrive/j/jenkins/tmp/workspace/build/src/closed/OpenJ9.gmk:427: run-preprocessors-j9] Broken pipe
  make[2]: *** [/cygdrive/j/jenkins/tmp/workspace/build/src/closed/custom/Main.gmk:56: j9vm-build] Error 2
  make[2]: *** Waiting for unfinished jobs....
  Note: Some input files use or override a deprecated API.
  Note: Recompile with -Xlint:deprecation for details.
  make[2]: *** [make/Main.gmk:86: buildtools-jdk] Error 141
  make[2]: INTERNAL: Exiting with 2 jobserver tokens available; should be 4!

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-ppc64le-openj9 && XL. Build passed, file extraction failed

  Archiving artifacts
  [Pipeline] }
  [Pipeline] // stage
  [Pipeline] }
  [Pipeline] // node
  [Pipeline] }
  [Pipeline] // stage
  [Pipeline] echo
  Execution error: Failed to extract /home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-linux-ppc64le-openj9/transfer of 9 files

• ~JDK8/HS&J9/mac&&macXL builds failed due to overnight sign code changes. The wrong xcode version was picked up. A new set of builds has been submitted that does pick up the right version.~ Not an issue.

[M-Davies]

Wed 22nd April Tests Failures

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_x86-64_linux
• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk14_hs_sanity.openjdk_ppc64le_linux JTReg fails to download

  23:13:45      [mkdir] Created dir: /home/jenkins/workspace/Test_openjdk14_hs_sanity.openjdk_ppc64le_linux/jvmtest/openjdk
  23:13:45       [echo] Getting Jtreg from https://ci.adoptopenjdk.net/job/jtreg/lastSuccessfulBuild/artifact/jtreg-4.2.0-tip.tar.gz
  23:15:51       [exec] curl: (7) Failed to connect to ci.adoptopenjdk.net port 443: Connection timed out

Unstables

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk14_hs_sanity.openjdk_aarch64_linux Various tests failing since yesterday

  com/sun/crypto/provider/Cipher/AES/TestGHASH.java.TestGHASH
  java/lang/ProcessBuilder/Basic.java#id0.Basic_id0
  java/lang/ProcessBuilder/Basic.java#id1.Basic_id1
  java/lang/ProcessBuilder/InheritIO/InheritIO.sh.InheritIO
  java/lang/ProcessBuilder/SkipTest.java.SkipTest
  java/lang/RuntimeTests/exec/Duped.java.Duped
  java/lang/RuntimeTests/exec/ExecWithLotsOfArgs.java.ExecWithLotsOfArgs
  java/lang/RuntimeTests/exec/SetCwd.java.SetCwd
  java/util/logging/LoggingDeadlock2.java.LoggingDeadlock2
  java/util/zip/EntryCount64k.java.EntryCount64k

• ~https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_j9_sanity.openjdk_x86-64_windows_xl Two tests failing since yesterday~ Added to intermittents list with explanation https://github.com/AdoptOpenJDK/openjdk-tests/issues/1596#issuecomment-617818377

  java/util/concurrent/FutureTask/ExplicitSet.java.ExplicitSet => TImeout
  java/util/concurrent/Semaphore/RacingReleases.java => Timeout

• ~https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk15_hs_sanity.openjdk_ppc64_aix~
• ~https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk15_j9_sanity.openjdk_ppc64_aix Test suites were not found. Needs Raising...~ NOT RAN SINCE MARCH

  Error: Group spec does not specify a valid test suite: 

[M-Davies]

Fri 24th April BUILDS

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-aix-ppc64-openj9
• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-aix-ppc64-openj9 Core dump

  Running ddrgen to generate j9ddr.dat and superset.dat
  Error: dwarf/AixSymbolTableParser.cpp:698 parseStabstringDeclarationIntoDwarfDie(const string &, Dwarf_Error *) - Unknown stabs tag: ';'
  Error: dwarf/AixSymbolTableParser.cpp:698 parseStabstringDeclarationIntoDwarfDie(const string &, Dwarf_Error *) - Unknown stabs tag: ';'
  run_omrddrgen.mk:82: recipe for target '../j9ddr.dat' failed
  gmake[4]: Leaving directory '/ramdisk0/build/workspace/build-scripts/jobs/jdk11u/jdk11u-aix-ppc64-openj9/workspace/build/src/build/aix-ppc64-normal-server-release/vm/ddr'
  gmake[4]: *** [../j9ddr.dat] IOT/Abort trap (core dumped)
  /ramdisk0/build/workspace/build-scripts/jobs/jdk11u/jdk11u-aix-ppc64-openj9/workspace/build/src/closed/OpenJ9.gmk:455: recipe for target 'build-j9' failed
  gmake[3]: *** [build-j9] Error 2
  /ramdisk0/build/workspace/build-scripts/jobs/jdk11u/jdk11u-aix-ppc64-openj9/workspace/build/src/closed/custom/Main.gmk:54: recipe for target 'j9vm-build' failed
  gmake[2]: *** [j9vm-build] Error 2

• ~https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-x64-openj9 Unable to fetch due to not finding m2 branch (doesn't exist in jdk11 anymore). All failing on build-digitalocean-centos69-x64-1.~

  Retrieving cacerts file if needed
  origin  https://github.com/ibmruntimes/openj9-openjdk-jdk11.git (fetch)
  origin  https://github.com/ibmruntimes/openj9-openjdk-jdk11.git (push)
  jdk11
  origin  https://github.com/ibmruntimes/openj9-openjdk-jdk11.git (fetch)
  Resetting the git openjdk source repository at /home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-x64-openj9/workspace/build/src in 10 seconds...
  Pulling latest changes from git openjdk source repository
  Fetching origin
  fatal: Couldn't find remote ref refs/heads/openj9-0.20.0-m2
  error: Could not fetch origin

  RAISED => https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1291

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-windows-x64-openj9 Connection glitch by the look of it

  IOException caught during compilation: Connection reset

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-windows-x64-openj9-windowsXL Casting exception

  Creating java.desktop.jmod
  java.lang.ClassCastException: java.lang.String incompatible with java.nio.file.FileTreeWalker$Event
  at java.base/java.nio.file.Files$$Lambda$6/0000000000000000.test(Unknown Source)
  at java.base/java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:176)
  at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
  at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
  at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
  at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
  at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
  at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
  at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
  at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:497)
  at java.base/jdk.internal.module.IllegalAccessMaps.generate(IllegalAccessMaps.java:98)
  at java.base/jdk.internal.module.ModuleBootstrap.addIllegalAccess(ModuleBootstrap.java:809)
  at java.base/jdk.internal.module.ModuleBootstrap.boot(ModuleBootstrap.java:450)
  at java.base/java.lang.ClassLoader.initializeClassLoaders(ClassLoader.java:211)
  at java.base/java.lang.Thread.initialize(Thread.java:430)
  at java.base/java.lang.Thread.<init>(Thread.java:155)

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x86-32-hotspot/

• Built Image not found because of the * in the path (should be windows-x86-normal-clientANDserver-release)

  Finished building OpenJDK for target 'images'
  Should have the source, I'm at /cygdrive/j/jenkins/tmp/workspace/build/src
  ls: cannot access '/cygdrive/j/jenkins/tmp/workspace/build/src/build/*/images/j2sdk-image': No such file or directory

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x86-32-openj9 Not sure what the failure is here. Looks similar to https://adoptopenjdk.slack.com/archives/C09NW3L2J/p1587459652122600 though

  Execution error: null

[M-Davies]

Fri 24th April TESTS Unknowns

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_hs_sanity.openjdk_x86-64_windows/195/ All tests passed but build was marked as unstable. Need to keep an eye on this.

Failures

• ~https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_x86-64_linux/206~
• ~https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_hs_sanity.openjdk_ppc64le_linux/186~ ~JTReg Timing out again.~ RAISED => https://github.com/AdoptOpenJDK/openjdk-tests/issues/1748

  01:20:48  getJtreg:
  01:20:48      [mkdir] Created dir: /home/jenkins/workspace/Test_openjdk11_j9_sanity.openjdk_x86-64_linux/jvmtest/openjdk
  01:20:48       [echo] Getting Jtreg from https://ci.adoptopenjdk.net/job/jtreg/lastSuccessfulBuild/artifact/jtreg-4.2.0-tip.tar.gz
  01:21:40       [exec] curl: (18) transfer closed with 3842596 bytes remaining to read
  01:21:40  
  01:21:40  BUILD FAILED

Unstables

• ~https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_hs_sanity.openjdk_s390x_linux Seems JdbMethodExitTest and Redefine-g were not excluded correctly in https://github.com/AdoptOpenJDK/openjdk-tests/pull/1738~ FOLLOW UP PR => https://github.com/AdoptOpenJDK/openjdk-tests/pull/1749
• ~https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_hs_sanity.openjdk_x86-64_linux Still lots of tests failing on x-linux~ Documenting in https://github.com/AdoptOpenJDK/openjdk-tests/issues/1750

  java/lang/Class/getDeclaredField/FieldSetAccessibleTest.java.FieldSetAccessibleTest
  java/lang/ProcessBuilder/Basic.java.Basic
  java/lang/SecurityManager/CheckPackageAccess.java.CheckPackageAccess
  sun/misc/IOUtils/ReadAllBytes.java.ReadAllBytes
  sun/misc/IOUtils/ReadNBytes.java.ReadNBytes
  sun/misc/URLClassPath/JarClassPathFileEntry.java.JarClassPathFileEntry
  java/util/Locale/Bug8040211.java.Bug8040211
  java/util/Objects/CheckIndex.java.CheckIndex
  java/util/TimeZone/TimeZoneTest.java.TimeZoneTest

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_j9_sanity.openjdk_x86-64_windows New failing test case (java/lang/ref/ReferenceEnqueuePending.java) on test-softlayer-win2012r2-x64-2

  
  Standard Output
  I must write 999 to prevent compiler optimizations.
  The following numbers were not found in the reference queue: 
  0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38  
  40 42 44 46 48 50 52 54 56 58 60 62 64 66 68 70 72 74 76 78  
  80 82 84 86 88 90 92 94 96 98 100 102 104 106 108 110 112 114 116 118  
  120 122 124 126 128 130 132 134 136 138 140 142 144 146 148 150 152 154 156 158  
  160 162 164 166 168 170 172 174 176 178 180 182 184 186 188 190 192 194 196 198  
  200 202 204 206 208 210 212 214 216 218 220 222 224 226 228 230 232 234 236 238  
  240 242 244 246 248 250 252 254 256 258 260 262 264 266 268 270 272 274 276 278  
  280 282 284 286 288 290 292 294 296 298 300 302 304 306 308 310 312 314 316 318  
  320 322 324 326 328 330 332 334 336 338 340 342 344 346 348 350 352 354 356 358  
  360 362 364 366 368 370 372 374 376 378 380 382 384 386 388 390 392 394 396 398  
  400 402 404 406 408 410 412 414 416 418 420 422 424 426 428 430 432 434 436 438  
  440 442 444 446 448 450 452 454 456 458 460 462 464 466 468 470 472 474 476 478  
  480 482 484 486 488 490 492 494 496 498 500 502 504 506 508 510 512 514 516 518  
  520 522 524 526 528 530 532 534 536 538 540 542 544 546 548 550 552 554 556 558  
  560 562 564 566 568 570 572 574 576 578 580 582 584 586 588 590 592 594 596 598  
  600 602 604 606 608 610 612 614 616 618 620 622 624 626 628 630 632 634 636 638  
  640 642 644 646 648 650 652 654 656 658 660 662 664 666 668 670 672 674 676 678  
  680 682 684 686 688 690 692 694 696 698 700 702 704 706 708 710 712 714 716 718  
  720 722 724 726 728 730 732 734 736 738 740 742 744 746 748 750 752 754 756 758  
  760 762 764 766 768 770 772 774 776 778 780 782 784 786 788 790 792 794 796 798  
  800 802 804 806 808 810 812 814 816 818 820 822 824 826 828 830 832 834 836 838  
  840 842 844 846 848 850 852 854 856 858 860 862 864 866 868 870 872 874 876 878  
  880 882 884 886 888 890 892 894 896 898 900 902 904 906 908 910 912 914 916 918  
  920 922 924 926 928 930 932 934 936 938 940 942 944 946 948 950 952 954 956 958  
  960 962 964 966 968 970 972 974 976 978 980 982 984 986 988 990 992 994 996 

Standard Error java.lang.RuntimeException: TEST FAILED: only 499 reference objects have been queued out of 999 at ReferenceEnqueuePending.checkResult(ReferenceEnqueuePending.java:148) at ReferenceEnqueuePending.main(ReferenceEnqueuePending.java:103) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298) at java.lang.Thread.run(Thread.java:821)

JavaTest Message: Test threw exception: java.lang.RuntimeException JavaTest Message: shutting down test

[M-Davies]

Mon 27th April BUILDS

• ~https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-windows-x64-hotspot seems to want to run tests even though they're disabled in the config files~ RAISED => https://github.com/AdoptOpenJDK/openjdk-build/issues/1712

  • https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-aix-ppc64-openj9
  • https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-aix-ppc64-openj9 Core dump

  ~Still coredumping~ RAISED => https://github.com/eclipse/openj9/issues/9369

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-windows-x64-hotspot

  Compiling 5 files for BUILD_VM_COMPILER_NODEINFO_PROCESSOR
  make[2]: *** [make/Main.gmk:364: create-source-revision-tracker] Error 127

[M-Davies]

Mon 27th April TESTS No unknown failures 🍾

[karianna]

@M-Davies - I'd like to parse this issue. Is there a definitive list of what's left to triage?

[M-Davies]

@karianna I'm in the process of writing up a summary comment of that last month right now

[M-Davies]

1 month summary

NEEDS TRIAGE

• JDI Tests are unstable across the board in JDK8
  • https://github.com/AdoptOpenJDK/openjdk-tests/issues/1711: Windows
  • https://github.com/AdoptOpenJDK/openjdk-tests/issues/1718: AIX
  • https://github.com/AdoptOpenJDK/openjdk-tests/issues/1737: s390x
  • The likely culprit behind these are the scaffolding structures as theroised here.
• Well known file exceptions in some tests on x64_mac
  • https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1274: Mac
  • George was last working on this. It seems to be a setup or significant arch difference between the 1010 and 1013 machines
• JDK8/HS/x64_linux is proving to be unstable everynight now
  • https://github.com/AdoptOpenJDK/openjdk-tests/issues/1750: Linux
  • The consistent problems seem to be down to godaddy-4 missing some dependancies. The more intermittent ones on other machines are due to the build being a hotspot-jfr build, rather than a standard nightly
• JDK-Next installer is failing
  • https://github.com/AdoptOpenJDK/openjdk-build/issues/1712: Windows
• JDK8 & 11 AIX OpenJ9 is failing to build. Looks like this is also an inf issue since it's fixed on the OpenJ9 Jenkins
  • https://github.com/eclipse/openj9/issues/9369: AIX

[karianna]

1 month summary

NEEDS TRIAGE

• JDI Tests are unstable across the board in JDK8

  • AdoptOpenJDK/openjdk-tests#1711: Windows
  • AdoptOpenJDK/openjdk-tests#1718: AIX
  • AdoptOpenJDK/openjdk-tests#1737: s390x
  • The likely culprit behind these are the scaffolding structures as theroised here.

• Well known file exceptions in some tests on x64_mac

  • AdoptOpenJDK/openjdk-infrastructure#1274: Mac
  • George was last working on this. It seems to be a setup or significant arch difference between the 1010 and 1013 machines

• JDK8/HS/x64_linux is proving to be unstable everynight now

  • AdoptOpenJDK/openjdk-tests#1750: Linux
  • The consistent problems seem to be down to godaddy-4 missing some dependancies. The more intermittent ones on other machines are still under investigation.

• JDK-Next attempting to run tests in the nightlies even though they're disabled in the config files. I'm waiting until tomorrows nightlies go through to see if it's a concurrency problem or not

  • 1712: Windows

• JDK8 & 11 AIX OpenJ9 is failing to build. Looks like this is also an inf issue since it's fixed on the OpenJ9 Jenkins

  • eclipse/openj9#9369: AIX

Thanks, I'll start making my folks at Microsoft aware and see if we can start to dig in as well (we have adopt replicated internally but on Azure Devops now)

[M-Davies]

Wed 29th April BUILDS

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot Make file fail on build-siteox-solaris10u9-x64-1

  Compiling ../generated/adfiles/ad_x86_64.cpp
  "/export/home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-solaris-x64-hotspot/workspace/build/src/hotspot/src/share/vm/runtime/thread.hpp", line 202: Warning: Identifier expected instead of "}".
  1 Warning(s) detected.
  gmake[6]: *** [/export/home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-solaris-x64-hotspot/workspace/build/src/hotspot/make/solaris/makefiles/rules.make:143: accessFlags.o] Error 2

• https://ci.adoptopenjdk.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-hotspot/520/console Wrong Boot jdk. Raised => https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1301

  configure: Found potential Boot JDK using configure arguments
  configure: Potential Boot JDK found at /Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home is incorrect JDK version (openjdk version "1.8.0_252"); ignoring
  configure: (Your Boot JDK version must be one of: 10 11)

[M-Davies]

Wed 29th April TESTS Failures None Unstables Wrong version number on sun/misc/Version/Version.java across JDK8 hotspot tests. First seen.

Standard Output

jdkVersionInfo: input=1.8.0_262-202004281802-b01 output=1.8.0_262-b1
JDK version = 1.8.0_262-b1  1.8.0_6-b1

Standard Error

java.lang.RuntimeException: Unmatched version: 1.8.0_262-b1 vs 1.8.0_6-b1
    at Version.main(Version.java:47)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
    at java.lang.Thread.run(Thread.java:748)

• Some tests are still running in the JDK8 nightlies even though they're excluded. Need to raise this.

  com/sun/jdi/JdbMethodExitTest.sh.JdbMethodExitTest
  com/sun/jdi/Redefine-g.sh.Redefine-g
  com/sun/jdi/EvalArraysAsList.sh.EvalArraysAsList

[M-Davies]

Thur 30th April BUILDS

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk/job/jdk-aix-ppc64-hotspot Net glitch. Reported to intermittent build fails https://github.com/AdoptOpenJDK/openjdk-build/issues/1450
• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9 VM build failure. Reported to openj9 https://github.com/eclipse/openj9/issues/9416

• For target support_jmods_java.compiler.jmod: Assertion failed at /Users/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-x64-openj9/workspace/build/src/build/macosx-x86_64-normal-server-release/vm/compiler/../compiler/compile/J9SymbolReferenceTable.cpp:811: containingClass != NULL VMState: 0x00050080 failed to get defining class of field ref cpIndex=35 in owning method J9Method=0xc5e3660 compiling jdk/internal/org/objectweb/asm/ClassWriter.(I)V at level: warm

JVMDUMP039I Processing dump event "abort", detail "" at 2020/04/30 00:59:05 - please wait. JVMDUMP032I JVM requested System dump using '/Users/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-x64-openj9/workspace/build/src/make/core.20200430.005905.52000.0001.dmp' in response to an event JVMDUMP012E Error in System dump: The core file created by child process with pid = 52079 was not found. Expected to find core file with name "/cores/core.52079" JVMDUMP032I JVM requested Java dump using '/Users/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-x64-openj9/workspace/build/src/make/javacore.20200430.005905.52000.0002.txt' in response to an event JVMDUMP010I Java dump written to /Users/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-x64-openj9/workspace/build/src/make/javacore.20200430.005905.52000.0002.txt JVMDUMP032I JVM requested Snap dump using '/Users/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-x64-openj9/workspace/build/src/make/Snap.20200430.005905.52000.0003.trc' in response to an event JVMDUMP010I Snap dump written to /Users/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-x64-openj9/workspace/build/src/make/Snap.20200430.005905.52000.0003.trc JVMDUMP007I JVM Requesting JIT dump using '/Users/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-x64-openj9/workspace/build/src/make/jitdump.20200430.005905.52000.0004.dmp' JVMDUMP010I JIT dump written to /Users/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-x64-openj9/workspace/build/src/make/jitdump.20200430.005905.52000.0004.dmp JVMDUMP013I Processed dump event "abort", detail "".

• All command lines available in /Users/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-mac-x64-openj9/workspace/build/src/build/macosx-x86_64-normal-server-release/make-support/failure-logs.

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9-macosXL Concurrency exception. Likely due to the manual execution of the pipeline jobs yesterday.

  Loading library openjdk-jenkins-helper@master
  [Pipeline] End of Pipeline
  java.util.ConcurrentModificationException
  at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:909)
  at java.util.ArrayList$Itr.next(ArrayList.java:859)
  at com.thoughtworks.xstream.converters.collections.CollectionConverter.marshal(CollectionConverter.java:73)
  at com.thoughtworks.xstream.core.AbstractReferenceMarshaller.convert(AbstractReferenceMarshaller.java:69)
  at com.thoughtworks.xstream.core.TreeMarshaller.convertAnother(TreeMarshaller.java:58)
  at com.thoughtworks.xstream.core.AbstractReferenceMarshaller$1.convertAnother(AbstractReferenceMarshaller.java:84)
  at hudson.util.RobustReflectionConverter.marshallField(RobustReflectionConverter.java:262)
  at hudson.util.RobustReflectionConverter$2.writeField(RobustReflectionConverter.java:249)
  Caused: java.lang.RuntimeException: Failed to serialize org.jenkinsci.plugins.workflow.libs.LibrariesAction#libraries for class org.jenkinsci.plugins.workflow.libs.LibrariesAction
  at hudson.util.RobustReflectionConverter$2.writeField(RobustReflectionConverter.java:253)
  at hudson.util.RobustReflectionConverter$2.visit(RobustReflectionConverter.java:221)
  at com.thoughtworks.xstream.converters.reflection.PureJavaReflectionProvider.visitSerializableFields(PureJavaReflectionProvider.java:138)
  at hudson.util.RobustReflectionConverter.doMarshal(RobustReflectionConverter.java:207)
  at hudson.util.RobustReflectionConverter.marshal(RobustReflectionConverter.java:148)
  at com.thoughtworks.xstream.core.AbstractReferenceMarshaller.convert(AbstractReferenceMarshaller.java:69)
  at com.thoughtworks.xstream.core.TreeMarshaller.convertAnother(TreeMarshaller.java:58)
  at com.thoughtworks.xstream.core.TreeMarshaller.convertAnother(TreeMarshaller.java:43)
  at com.thoughtworks.xstream.core.AbstractReferenceMarshaller$1.convertAnother(AbstractReferenceMarshaller.java:88)
  at com.thoughtworks.xstream.converters.collections.AbstractCollectionConverter.writeItem(AbstractCollectionConverter.java:64)
  at com.thoughtworks.xstream.converters.collections.CollectionConverter.marshal(CollectionConverter.java:74)
  at com.thoughtworks.xstream.core.AbstractReferenceMarshaller.convert(AbstractReferenceMarshaller.java:69)
  at com.thoughtworks.xstream.core.TreeMarshaller.convertAnother(TreeMarshaller.java:58)
  at com.thoughtworks.xstream.core.AbstractReferenceMarshaller$1.convertAnother(AbstractReferenceMarshaller.java:84)
  at hudson.util.RobustReflectionConverter.marshallField(RobustReflectionConverter.java:262)
  at hudson.util.RobustReflectionConverter$2.writeField(RobustReflectionConverter.java:249)
  Caused: java.lang.RuntimeException: Failed to serialize hudson.model.Actionable#actions for class org.jenkinsci.plugins.workflow.job.WorkflowRun
  at hudson.util.RobustReflectionConverter$2.writeField(RobustReflectionConverter.java:253)
  at hudson.util.RobustReflectionConverter$2.visit(RobustReflectionConverter.java:221)
  at com.thoughtworks.xstream.converters.reflection.PureJavaReflectionProvider.visitSerializableFields(PureJavaReflectionProvider.java:138)
  at hudson.util.RobustReflectionConverter.doMarshal(RobustReflectionConverter.java:207)
  at hudson.util.RobustReflectionConverter.marshal(RobustReflectionConverter.java:148)
  at com.thoughtworks.xstream.core.AbstractReferenceMarshaller.convert(AbstractReferenceMarshaller.java:69)
  at com.thoughtworks.xstream.core.TreeMarshaller.convertAnother(TreeMarshaller.java:58)
  at com.thoughtworks.xstream.core.TreeMarshaller.convertAnother(TreeMarshaller.java:43)
  at com.thoughtworks.xstream.core.TreeMarshaller.start(TreeMarshaller.java:82)
  at com.thoughtworks.xstream.core.AbstractTreeMarshallingStrategy.marshal(AbstractTreeMarshallingStrategy.java:37)
  at com.thoughtworks.xstream.XStream.marshal(XStream.java:1026)
  at com.thoughtworks.xstream.XStream.marshal(XStream.java:1015)
  at com.thoughtworks.xstream.XStream.toXML(XStream.java:988)
  at hudson.util.XStream2.toXMLUTF8(XStream2.java:313)
  at org.jenkinsci.plugins.workflow.support.PipelineIOUtils.writeByXStream(PipelineIOUtils.java:34)
  at org.jenkinsci.plugins.workflow.job.WorkflowRun.save(WorkflowRun.java:1191)
  at hudson.BulkChange.commit(BulkChange.java:98)
  at org.jenkinsci.plugins.workflow.cps.CpsFlowExecution.notifyListeners(CpsFlowExecution.java:1475)
  at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$3.run(CpsThreadGroup.java:488)
  at org.jenkinsci.plugins.workflow.cps.CpsVmExecutorService$1.run(CpsVmExecutorService.java:38)
  at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:131)
  at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
  at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59)
  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  at java.lang.Thread.run(Thread.java:748)
  Finished: FAILURE

  • https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot Make file fail on build-siteox-solaris10u9-x64-1

    Compiling ../generated/adfiles/ad_x86_64.cpp
    "/export/home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-solaris-x64-hotspot/workspace/build/src/hotspot/src/share/vm/runtime/thread.hpp", line 202: Warning: Identifier expected instead of "}".
    1 Warning(s) detected.
    gmake[6]: *** [/export/home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-solaris-x64-hotspot/workspace/build/src/hotspot/make/solaris/makefiles/rules.make:143: accessFlags.o] Error 2

  Re-occured on build-siteox-solaris10u9-x64-1. Raised at build https://github.com/AdoptOpenJDK/openjdk-build/issues/1722

[M-Davies]

Thur 30th April TESTS Failures

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_hs_sanity.openjdk_x86-64_mac/ Net glitch. Already reported https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1302

  18:33:52  Cannot contact test-macincloud-macos1013-x64-1: java.lang.InterruptedException
  18:42:12  wrapper script does not seem to be touching the log file in /Users/jenkins/workspace/Test_openjdk8_hs_sanity.openjdk_x86-64_mac@tmp/durable-58090d40
  18:42:12  (JENKINS-48300: if on an extremely laggy filesystem, consider -Dorg.jenkinsci.plugins.durabletask.BourneShellScript.HEARTBEAT_CHECK_INTERVAL=86400)

  Unstables

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_hs_sanity.openjdk_x86-32_windows java/lang/ProcessBuilder/checkHandles/CheckHandles.java on test-azure-win2012r2-x64-1

  java.lang.UnsatisfiedLinkError: 'long CheckHandles.getProcessHandleCount()'
  at CheckHandles.getProcessHandleCount(Native Method)
  at CheckHandles.main(CheckHandles.java:64)
  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.base/java.lang.reflect.Method.invoke(Method.java:566)
  at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
  at java.base/java.lang.Thread.run(Thread.java:834)

[M-Davies]

💡⚔️Mon 4th May ⭐ 🔫 No report currently due to jenkins restart https://adoptopenjdk.slack.com/archives/C09NW3L2J/p1588503144175500

[M-Davies]

Tues 5th May BUILDS

• Most AIX builds failed due to https://github.com/eclipse/openj9/issues/9369#issuecomment-623695102
• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-aarch64-openj9-linuxXL Installer failure
• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-ppc64le-openj9-linuxXL Net glitch

  Resolving downloads.apache.org (downloads.apache.org)... 88.99.95.219, 2a01:4f8:10a:201a::2
  Connecting to downloads.apache.org (downloads.apache.org)|88.99.95.219|:443... failed: Connection timed out.
  Connecting to downloads.apache.org (downloads.apache.org)|2a01:4f8:10a:201a::2|:443... failed: Network is unreachable.

• Solaris still failing to build as of https://github.com/AdoptOpenJDK/openjdk-build/issues/1722

[M-Davies]

Tues 5th May TESTS Due to the restart yesterday, I'll delay triaging the test failures until tomorrow

[M-Davies]

Wed 6th May BUILDS

• JDK-Next x-linux and p-linux builds failing with

  configure: error: Invalid value for --enable-jvm-feature-dtrace: 'auto'
  configure exiting with result code 1

  No record of --enable-jvm-feature-dtrace: 'auto' in our build scripts. Need to keep an eye on this.

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-windows-x64-openj9 Installer fail
• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-windows-x64-openj9-windowsXL Crypto fail on build-azure-win2012r2-x64-2

  java.lang.InternalError: Unexpected CryptoAPI failure generating seed
  at java.base/sun.security.provider.NativeSeedGenerator.getSeedBytes(NativeSeedGenerator.java:62)
  at java.base/sun.security.provider.SeedGenerator.generateSeed(SeedGenerator.java:144)
  at java.base/sun.security.provider.AbstractDrbg.lambda$static$0(AbstractDrbg.java:524)
  at java.base/sun.security.provider.AbstractDrbg.getEntropyInput(AbstractDrbg.java:507)
  at java.base/sun.security.provider.AbstractDrbg.getEntropyInput(AbstractDrbg.java:494)
  at java.base/sun.security.provider.AbstractDrbg.instantiateIfNecessary(AbstractDrbg.java:696)
  at java.base/sun.security.provider.AbstractDrbg.engineNextBytes(AbstractDrbg.java:378)
  at java.base/sun.security.provider.AbstractDrbg.engineNextBytes(AbstractDrbg.java:334)
  at java.base/sun.security.provider.AbstractDrbg$SeederHolder.lambda$static$0(AbstractDrbg.java:558)
  at java.base/sun.security.provider.AbstractDrbg.getEntropyInput(AbstractDrbg.java:507)
  at java.base/sun.security.provider.AbstractDrbg.getEntropyInput(AbstractDrbg.java:494)
  at java.base/sun.security.provider.AbstractDrbg.instantiateIfNecessary(AbstractDrbg.java:696)
  at java.base/sun.security.provider.AbstractDrbg.engineNextBytes(AbstractDrbg.java:378)
  at java.base/sun.security.provider.AbstractDrbg.engineNextBytes(AbstractDrbg.java:334)
  at java.base/sun.security.provider.DRBG.engineNextBytes(DRBG.java:233)
  at java.base/java.security.SecureRandom.nextBytes(SecureRandom.java:741)
  at java.base/java.security.SecureRandom.next(SecureRandom.java:798)
  at java.base/java.util.Random.nextLong(Random.java:424)
  at java.base/java.io.File$TempDirectory.generateFile(File.java:1928)
  at java.base/java.io.File.createTempFile(File.java:2076)
  at jdk.jartool/sun.tools.jar.Main.createTempFileInSameDirectoryAs(Main.java:236)
  at jdk.jartool/sun.tools.jar.Main.run(Main.java:354)
  at jdk.jartool/sun.tools.jar.Main.main(Main.java:1680)

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-openj9-macosXL Mac installer failure
• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x86-32-hotspot Crypto failure on build-azure-win2012r2-x64-1

  Creating langtools/dist/bootstrap/lib/javac.jar
  java.lang.InternalError: Unexpected CryptoAPI failure generating seed
  at sun.security.provider.NativeSeedGenerator.getSeedBytes(NativeSeedGenerator.java:61)
  at sun.security.provider.SeedGenerator.generateSeed(SeedGenerator.java:139)
  at sun.security.provider.SecureRandom$SeederHolder.<clinit>(SecureRandom.java:197)
  at sun.security.provider.SecureRandom.engineNextBytes(SecureRandom.java:214)
  at java.security.SecureRandom.nextBytes(SecureRandom.java:455)
  at java.security.SecureRandom.next(SecureRandom.java:477)
  at java.util.Random.nextLong(Random.java:334)
  at java.io.File$TempDirectory.generateFile(File.java:1882)
  at java.io.File.createTempFile(File.java:1987)
  at sun.tools.jar.Main.createTempFileInSameDirectoryAs(Main.java:140)
  at sun.tools.jar.Main.run(Main.java:212)
  at sun.tools.jar.Main.main(Main.java:1177)

[M-Davies]

Wed 6th May TESTS

Failures

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_x86-64_windows/ Fails to clean workspace

  ERROR: Failed to clean the workspace
  jenkins.util.io.CompositeIOException: Unable to delete 'C:\Users\jenkins\workspace\Test_openjdk11_j9_sanity.openjdk_x86-64_windows\openjdk-tests'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.

  Fallover from

  ERROR: Workspace has a .git repository, but it appears to be corrupt.
  hudson.plugins.git.GitException: Command "git rev-parse --is-inside-work-tree" returned status code 128:
  stdout: 
  stderr: fatal: not a git repository (or any parent up to mount point /cygdrive)
  Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).

  both fails on test-softlayer-win2012r2-x64-2 RAISED => https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1310

Unstables

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_hs_sanity.openjdk_x86-32_windows java/lang/ProcessBuilder/checkHandles/CheckHandles.java

  
  java.lang.UnsatisfiedLinkError: 'long CheckHandles.getProcessHandleCount()'
  at CheckHandles.getProcessHandleCount(Native Method)
  at CheckHandles.main(CheckHandles.java:64)
  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.base/java.lang.reflect.Method.invoke(Method.java:566)
  at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
  at java.base/java.lang.Thread.run(Thread.java:834)

JavaTest Message: Test threw exception: java.lang.UnsatisfiedLinkError JavaTest Message: shutting down test

- https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_x86-64_windows_xl/207  `java/util/zip/ZipFile/Zip64SizeTest.java` forced `test-softlayer-win2012r2-x64-2` to run out of space. RAISED => https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1311
- https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk14_hs_sanity.openjdk_aarch64_linux/73/ on `test-packet-ubuntu1604-armv8-2`

java/lang/ProcessBuilder/Basic.java#id0.Basic_id0 java/lang/ProcessBuilder/Basic.java#id1.Basic_id1 java/lang/ProcessBuilder/InheritIO/InheritIO.sh.InheritIO java/lang/ProcessBuilder/SkipTest.java.SkipTest java/lang/RuntimeTests/exec/Duped.java.Duped java/lang/RuntimeTests/exec/ExecWithLotsOfArgs.java.ExecWithLotsOfArgs java/lang/RuntimeTests/exec/SetCwd.java.SetCwd java/util/logging/LoggingDeadlock2.java.LoggingDeadlock2 java/util/zip/EntryCount64k.java.EntryCount64k

- https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_j9_sanity.openjdk_ppc64le_linux_xl/106/ `java/util/concurrent/locks/ReentrantLock/CancelledLockLoops.java` vmCrash on `test-osuosl-centos74-ppc64le-1`

18:59:41 stderr: 18:59:41 Unhandled exception 18:59:41 Type=Segmentation error vmState=0x00020011 18:59:41 J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001 18:59:41 Handler1=00003FFFA50C6EC0 Handler2=00003FFFA4F27280 18:59:41 R0=00003FFF98B08E60 R1=00003FFF63CCAD60 R2=00003FFF996DF600 R3=00003FFFA4276120 18:59:41 R4=00003FFF63CCAE10 R5=00003FFFA00BA1D0 R6=00003FFFA00BA1D0 R7=00003FFF640D02F0 18:59:41 R8=00003FFFA009C558 R9=0000003700000010 R10=0000000000000000 R11=0000000100000000 18:59:41 R12=00003FFFA5E4CE10 R13=00003FFF63CD6900 R14=0000000000000007 R15=0000000000000004 18:59:41 R16=00003FFFA00475A0 R17=00003FFF63CCB52F R18=0000000000000006 R19=0000000000020019 18:59:41 R20=0000000000000000 R21=00003FFFA5291E30 R22=0005A4EA67F65433 R23=00003FFF98B08CEC 18:59:41 R24=00003FFFA0012AD8 R25=00003FFF9971DAE0 R26=00003FFFA4276120 R27=00003FFFA4276318 18:59:41 R28=0000000000000000 R29=00003FFFA42761A8 R30=00003FFF63CCAE10 R31=00003FFF640C71D0 18:59:41 NIP=00003FFF98AE7368 MSR=800000000280F033 ORIG_GPR3=00003FFF98C4DFD0 CTR=00003FFFA5E4CE10 18:59:41 LINK=00003FFF98B08E60 XER=0000000000000000 CCR=0000000028004244 SOFTE=0000000000000001 18:59:41 TRAP=0000000000000300 DAR=0000003700000010 dsisr=0000000040000000 RESULT=0000000000000000 18:59:41 FPR0 00003fffa5290a08 (f: 2770930176.000000, d: 3.476603e-310) 18:59:41 FPR1 40525d4c40000000 (f: 1073741824.000000, d: 7.345778e+01) 18:59:41 FPR2 4004c6f320000000 (f: 536870912.000000, d: 2.597143e+00) 18:59:41 FPR3 3fe3333340000000 (f: 1073741824.000000, d: 6.000000e-01) 18:59:41 FPR4 3fe3333340000000 (f: 1073741824.000000, d: 6.000000e-01) 18:59:41 FPR5 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR6 3fe5555560000000 (f: 1610612736.000000, d: 6.666667e-01) 18:59:41 FPR7 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR8 4033000000000000 (f: 0.000000, d: 1.900000e+01) 18:59:41 FPR9 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR10 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR11 41cdcd6500000000 (f: 0.000000, d: 1.000000e+09) 18:59:41 FPR12 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR13 3fe27241f85b6064 (f: 4166737920.000000, d: 5.764475e-01) 18:59:41 FPR14 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR15 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR16 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR17 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR18 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR19 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR20 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR21 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR22 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR23 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR24 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR25 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR26 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR27 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR28 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR29 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR30 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 FPR31 0000000000000000 (f: 0.000000, d: 0.000000e+00) 18:59:41 Module=/home/jenkins/workspace/Test_openjdk8_j9_sanity.openjdk_ppc64le_linux_xl/openjdkbinary/j2sdk-image/jre/lib/ppc64le/default/libj9jit29.so 18:59:41 Module_base_address=00003FFF98970000 18:59:41 Target=2_90_20200505_165 (Linux 3.10.0-693.11.6.el7.ppc64le) 18:59:41 CPU=ppc64le (4 logical CPUs) (0x1de5a0000 RAM) 18:59:41 ----------- Stack Backtrace ----------- 18:59:41 (0x00003FFFA4F700E4 [libj9prt29.so+0x700e4]) 18:59:41 (0x00003FFFA4F28688 [libj9prt29.so+0x28688]) 18:59:41 (0x00003FFFA4F701A8 [libj9prt29.so+0x701a8]) 18:59:41 (0x00003FFFA4F70310 [libj9prt29.so+0x70310]) 18:59:41 (0x00003FFFA4F6FDE4 [libj9prt29.so+0x6fde4]) 18:59:41 (0x00003FFFA4F28688 [libj9prt29.so+0x28688]) 18:59:41 (0x00003FFFA4F6FED8 [libj9prt29.so+0x6fed8]) 18:59:41 (0x00003FFFA50C6D40 [libj9vm29.so+0xa6d40]) 18:59:41 (0x00003FFFA4F28688 [libj9prt29.so+0x28688]) 18:59:41 (0x00003FFFA50C7074 [libj9vm29.so+0xa7074]) 18:59:41 (0x00003FFFA4F274E0 [libj9prt29.so+0x274e0]) 18:59:41 __kernel_sigtramp_rt64+0x0 (0x00003FFFA5E90478) 18:59:41 (0x00003FFF63CCADB0 [+0x0]) 18:59:41 (0x00003FFF98B08E60 [libj9jit29.so+0x198e60]) 18:59:41 (0x00003FFFA4FB1840 [libj9hookable29.so+0x1840]) 18:59:41 (0x00003FFFA4B3CDD4 [libj9gc29.so+0x25cdd4]) 18:59:41 (0x00003FFFA4AB4D88 [libj9gc29.so+0x1d4d88]) 18:59:41 (0x00003FFFA4AB5008 [libj9gc29.so+0x1d5008]) 18:59:41 (0x00003FFFA4AC04AC [libj9gc29.so+0x1e04ac]) 18:59:41 (0x00003FFFA4B1B3EC [libj9gc29.so+0x23b3ec]) 18:59:41 (0x00003FFFA4A6C4FC [libj9gc29.so+0x18c4fc]) 18:59:41 (0x00003FFFA4B217C0 [libj9gc29.so+0x2417c0]) 18:59:41 (0x00003FFFA4B24008 [libj9gc29.so+0x244008]) 18:59:41 (0x00003FFFA4B2469C [libj9gc29.so+0x24469c]) 18:59:41 (0x00003FFFA4A5DA84 [libj9gc29.so+0x17da84]) 18:59:41 (0x00003FFFA4AB864C [libj9gc29.so+0x1d864c]) 18:59:41 (0x00003FFFA493A23C [libj9gc29.so+0x5a23c]) 18:59:41 (0x00003FFF993FCDD8 [libj9jit29.so+0xa8cdd8]) 18:59:41 (0x00003FFF99417470 [libj9jit29.so+0xaa7470]) 18:59:41 (0x00003FFFA50AAE44 [libj9vm29.so+0x8ae44]) 18:59:41 (0x00003FFFA511AD90 [libj9vm29.so+0xfad90]) 18:59:41 (0x00003FFFA4F28688 [libj9prt29.so+0x28688]) 18:59:41 (0x00003FFFA5116444 [libj9vm29.so+0xf6444]) 18:59:41 (0x00003FFFA4FF1248 [libj9thr29.so+0x11248]) 18:59:41 (0x00003FFFA5E48CD4 [libpthread.so.0+0x8cd4]) 18:59:41 clone+0xe4 (0x00003FFFA5D07E14 [libc.so.6+0x127e14])

Reported to https://github.com/eclipse/openj9/issues/2501#issuecomment-624576043

[M-Davies]

Thurs 7th May BUILDS

• JDK-Next x-linux and p-linux builds failing with

  configure: error: Invalid value for --enable-jvm-feature-dtrace: 'auto'
  configure exiting with result code 1

  No record of --enable-jvm-feature-dtrace: 'auto' in our build scripts. Need to keep an eye on this.

Re-occurred. RAISED => https://github.com/AdoptOpenJDK/openjdk-build/issues/1730

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-mac-x64-openj9-macosXL Segfault, first occurance

  Compiling 2732 files for java.desktop
  make[3]: *** [/Users/jenkins/workspace/build-scripts/jobs/jdk14u/jdk14u-mac-x64-openj9-macosXL/workspace/build/src/build/macosx-x86_64-server-release/support/modules_libs/java.base/libjimage.dylib] Segmentation fault: 11
  make[3]: *** Deleting file `/Users/jenkins/workspace/build-scripts/jobs/jdk14u/jdk14u-mac-x64-openj9-macosXL/workspace/build/src/build/macosx-x86_64-server-release/support/modules_libs/java.base/libjimage.dylib'

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-hotspot Installer fail
• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-openj9 && https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x86-32-openj9 Freetype failing to download

  --2020-05-06 12:52:31--  https://download.savannah.gnu.org/releases/freetype/freetype-2.5.3.tar.gz
  Resolving download.savannah.gnu.org (download.savannah.gnu.org)... 209.51.188.200, 2001:470:142:5::200
  Connecting to download.savannah.gnu.org (download.savannah.gnu.org)|209.51.188.200|:443... failed: Connection timed out.
  Connecting to download.savannah.gnu.org (download.savannah.gnu.org)|2001:470:142:5::200|:443... failed: Network is unreachable.

[M-Davies]

Thurs 7th May TESTS Failures NONE Unstables

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_hs_sanity.openjdk_x86-32_windows java/lang/ProcessBuilder/checkHandles/CheckHandles.java

  
  java.lang.UnsatisfiedLinkError: 'long CheckHandles.getProcessHandleCount()'
  at CheckHandles.getProcessHandleCount(Native Method)
  at CheckHandles.main(CheckHandles.java:64)
  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.base/java.lang.reflect.Method.invoke(Method.java:566)
  at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
  at java.base/java.lang.Thread.run(Thread.java:834)

JavaTest Message: Test threw exception: java.lang.UnsatisfiedLinkError JavaTest Message: shutting down test

> 
Reoccurred on `test-azure-win2012r2-x64-1` (last one was on `test-aws-win2019-x64-2`). RAISED AND EXCLUDED => https://github.com/AdoptOpenJDK/openjdk-tests/issues/1773
- https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_aarch64_linux_x `com/sun/crypto/provider/Cipher/AEAD/GCMLargeDataKAT.java` on `test-packet-ubuntu1604-armv8-2`

java.lang.UnsatisfiedLinkError: 'long CheckHandles.getProcessHandleCount()' at CheckHandles.getProcessHandleCount(Native Method) at CheckHandles.main(CheckHandles.java:64) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298) at java.base/java.lang.Thread.run(Thread.java:834)

UPDATED CheckHandle issue
- https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_j9_sanity.openjdk_ppc64le_linux `java/util/Date/DateGregorianCalendarTest.java` on `test-osuosl-ubuntu1604-ppc64le-2` Vmcrash, reported https://github.com/eclipse/openj9/issues/8652#issuecomment-625122227

19:27:02 Type=Segmentation error vmState=0x00020011

[M-Davies]

Tues 12th May BUILDS

• Some AIX and pLinux runs failed due to maintenance https://adoptopenjdk.slack.com/archives/C53GHCXL4/p1589212416121500
• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-s390x-openj9 && XL TR_TraceRA not declared

  /home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-s390x-openj9-linuxXL/workspace/build/src/build/linux-s390x-normal-server-release/vm/compiler/../compiler/z/codegen/S390PrivateLinkage.cpp: In member function 'void J9::Z::PrivateLinkage::alignLocalsOffset(uint32_t&, uint32_t)':
  /home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-s390x-openj9-linuxXL/workspace/build/src/build/linux-s390x-normal-server-release/vm/compiler/../compiler/z/codegen/S390PrivateLinkage.cpp:239:29: error: 'TR_TraceRA' was not declared in this scope
     if (comp()->getOption(TR_TraceRA))
                           ^~~~~~~~~~
  /home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-s390x-openj9-linuxXL/workspace/build/src/build/linux-s390x-normal-server-release/vm/compiler/../compiler/z/codegen/S390PrivateLinkage.cpp:239:29: note: suggested alternative: 'TR_TraceSA'
     if (comp()->getOption(TR_TraceRA))
                           ^~~~~~~~~~
                           TR_TraceSA
  /home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-s390x-openj9-linuxXL/workspace/build/src/build/linux-s390x-normal-server-release/vm/compiler/../compiler/z/codegen/S390PrivateLinkage.cpp: In member function 'void J9::Z::PrivateLinkage::mapCompactedStack(TR::ResolvedMethodSymbol*)':
  /home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-s390x-openj9-linuxXL/workspace/build/src/build/linux-s390x-normal-server-release/vm/compiler/../compiler/z/codegen/S390PrivateLinkage.cpp:443:32: error: 'TR_TraceRA' was not declared in this scope
        if (comp()->getOption(TR_TraceRA))
                              ^~~~~~~~~~
  /home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-s390x-openj9-linuxXL/workspace/build/src/build/linux-s390x-normal-server-release/vm/compiler/../compiler/z/codegen/S390PrivateLinkage.cpp:443:32: note: suggested alternative: 'TR_TraceSA'
        if (comp()->getOption(TR_TraceRA))
                              ^~~~~~~~~~
                              TR_TraceSA

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-mac-x64-openj9/ ClassCastException

  Creating images/jmods/java.security.sasl.jmod
  java.lang.ClassCastException: java.lang.String incompatible with java.nio.file.FileTreeWalker$Event
  at java.base/java.nio.file.Files$$Lambda$6/0000000000000000.test(Unknown Source)
  at java.base/java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:176)
  at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
  at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
  at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
  at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
  at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
  at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
  at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
  at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:497)
  at java.base/jdk.internal.module.IllegalAccessMaps.generate(IllegalAccessMaps.java:96)
  at java.base/jdk.internal.module.ModuleBootstrap.addIllegalAccess(ModuleBootstrap.java:784)
  at java.base/jdk.internal.module.ModuleBootstrap.boot(ModuleBootstrap.java:433)
  at java.base/java.lang.ClassLoader.initializeClassLoaders(ClassLoader.java:211)
  at java.base/java.lang.Thread.initialize(Thread.java:430)
  at java.base/java.lang.Thread.<init>(Thread.java:155)

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-windows-x64-openj9 127 in support_gensrc_jdk.localedata__cldr-gensrc.marker

  LightweightNonReentrantReaderWriterLock.cpp
  make[3]: *** [Gensrc-jdk.localedata.gmk:45: /cygdrive/j/jenkins/tmp/workspace/build/src/build/windows-x86_64-server-release/support/gensrc/jdk.localedata/_cldr-gensrc.marker] Error 127
  ConcurrentGCIncrementalUpdate.cpp
  make[2]: *** [make/Main.gmk:109: jdk.localedata-gensrc-src] Error 2

  Occurred once before (but not in the same module) https://github.com/AdoptOpenJDK/openjdk-build/issues/1634#issuecomment-619856124

• https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot Failed to fetch at start of run on build-siteox-solaris10u9-x64-1

  ERROR: Error fetching remote repo 'origin'
  hudson.plugins.git.GitException: Failed to fetch from https://github.com/AdoptOpenJDK/openjdk-build.git
  at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:909)
  at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1131)
  at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1167)
  at org.jenkinsci.plugins.workflow.steps.scm.SCMStep.checkout(SCMStep.java:124)
  at org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:93)
  at org.jenkinsci.plugins.workflow.steps.scm.SCMStep$StepExecutionImpl.run(SCMStep.java:80)
  at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
  at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  at java.lang.Thread.run(Thread.java:748)
  Caused by: hudson.plugins.git.GitException: Command "/opt/csw/bin/git fetch --tags --progress --prune https://github.com/AdoptOpenJDK/openjdk-build.git  +refs/pull/*:refs/remotes/origin/pr/* +refs/heads/master:refs/remotes/origin/master +refs/heads/*:refs/remotes/origin/*" returned status code 128:
  stdout: 
  stderr: fatal: unable to access 'https://github.com/AdoptOpenJDK/openjdk-build.git/': SSL certificate problem: certificate is not yet valid
  
  at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2430)
  at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:2044)
  at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$500(CliGitAPIImpl.java:81)
  at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:569)
  at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:161)
  at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:154)
  at hudson.remoting.UserRequest.perform(UserRequest.java:211)
  at hudson.remoting.UserRequest.perform(UserRequest.java:54)
  at hudson.remoting.Request$2.run(Request.java:369)
  at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
  ... 4 more

[M-Davies]

Tues 12th May TESTS Failures

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_x86-64_windows/ Failed to clean down before test start on test-softlayer-win2012r2-x64-2. Seems similar to https://github.com/AdoptOpenJDK/openjdk-build/issues/1634#issuecomment-624576173. Seems ok in grinder rerun https://ci.adoptopenjdk.net/view/Test_grinder/job/Grinder/3012/console

  ERROR: Failed to clean the workspace
  jenkins.util.io.CompositeIOException: Unable to delete 'C:\Users\jenkins\workspace\Test_openjdk11_j9_sanity.openjdk_x86-64_windows\openjdk-tests'. Tried 3 times (of a maximum of 3) waiting 0.1 sec between attempts.
  at jenkins.util.io.PathRemover.forceRemoveDirectoryContents(PathRemover.java:90)
  at hudson.Util.deleteContentsRecursive(Util.java:260)
  at hudson.Util.deleteContentsRecursive(Util.java:249)
  at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$2.execute(CliGitAPIImpl.java:739)
  at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:161)
  at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:154)
  at hudson.remoting.UserRequest.perform(UserRequest.java:211)
  at hudson.remoting.UserRequest.perform(UserRequest.java:54)
  at hudson.remoting.Request$2.run(Request.java:369)
  at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
  at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  at hudson.remoting.Engine$1.lambda$newThread$0(Engine.java:117)
  at java.lang.Thread.run(Thread.java:748)
  Suppressed: jenkins.util.io.CompositeIOException: Unable to remove file C:\Users\jenkins\workspace\Test_openjdk11_j9_sanity.openjdk_x86-64_windows\openjdk-tests\TKG\test_output_15879787133619\jdk_lang_j9_0\work\scratch_1\javacore.20200427.074037.11040.0001.txt

  Unstables

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_aarch64_linux/140 vm crashes. REPORTED => https://github.com/eclipse/openj9/issues/8987
• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk14_j9_sanity.openjdk_x86-64_windows/72/ java/util/zip/ZipFile/Zip64SizeTest.java forced test-softlayer-win2012r2-x64-2 to run out of space again. Already RASIED https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1311
• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_j9_sanity.openjdk_x86-64_windows/198/ java/util/concurrent/BlockingQueue/SingleProducerMultipleConsumerLoops.java on test-azure-win2012r2-x64-1 New failure, first seen

  22:01:19  direct:
  22:01:19  warning: [options] bootstrap class path not set in conjunction with -source 1.5
  22:01:19  warning: [options] source value 1.5 is obsolete and will be removed in a future release
  22:01:19  warning: [options] To suppress warnings about obsolete options, use -Xlint:-options.
  22:01:19  3 warnings
  22:01:19  
  22:01:19  ACTION: build -- Passed. All files up to date
  22:01:19  REASON: Named class compiled on demand
  22:01:19  TIME:   0.0 seconds
  22:01:19  messages:
  22:01:19  command: build SingleProducerMultipleConsumerLoops
  22:01:19  reason: Named class compiled on demand
  22:01:19  elapsed time (seconds): 0.0
  22:01:19  
  22:01:19  ACTION: main -- Error. Agent error: java.lang.Exception: Agent 3 timed out with a timeout of 4800 seconds; check console log for any additional details

[sxa]

Some AIX and pLinux runs failed due to maintenance

The referenced slack post was posted "yesterday" and said the maintenance was "tomorrow" therefore it will impact tonight's builds, not the ones being triaged today

[andrew-m-leonard]

Wed 13th May

• Windows installer failing with weird error: https://ci.adoptopenjdk.net/job/build-scripts/job/release/job/create_installer_windows/4014/console

  
  J:\jenkins\workspace\build-scripts\release\create_installer_windows\wix\SourceDir>call powershell.exe ./CreateSourceFolder.AdoptOpenJDK.ps1 
  filename : icedtea-web-1.8.3.win.bin.zip don't match regex ^OpenJDK\d+

J:\jenkins\workspace\build-scripts\release\create_installer_windows\wix\SourceDir>IF ERRORLEVEL 1 ( ECHO unzip failed
EXIT /b 2 ) unzip failed

- jdk14 Windows failure, unknown reason : https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk14u/job/jdk14u-windows-x64-openj9-windowsXL/68/console

Updating support/demos/image/jfc/TransparentRuler/src.zip make[2]: [make/Main.gmk:326: demos-jdk] Error 127 make[2]: Waiting for unfinished jobs....

- jdk8 Hotspot Solaris been failing for 2 weeks! (does anyone care about this?!)
https://ci.adoptopenjdk.net/view/Failing%20Builds/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-hotspot/

SSL certificate problem: certificate is not yet valid

- Test_openjdk8_j9_sanity.system_x86-64_mac
https://ci.adoptopenjdk.net/job/Test_openjdk8_j9_sanity.system_x86-64_mac/199/console

Caused: hudson.remoting.ProxyException: org.codehaus.groovy.runtime.InvokerInvocationException: java.io.IOException: Unable to create live FilePath for test-macincloud-macos1014-x64-2

- Test_openjdk11_j9_sanity.system_x86-64_linux_xl : MauveSingleThreadLoadTest_OpenJ9_0
https://ci.adoptopenjdk.net/job/Test_openjdk11_j9_sanity.system_x86-64_linux_xl/223/tapResults/
Issue raised: https://github.com/eclipse/openj9/issues/9543

LT FAIL: gnu.testlet.java.net.InetSocketAddress.InetSocketAddressTest: Error : test_Constructors failed - 0 Should not throw Exception here (number 0) LT FAIL: gnu.testlet.java.net.InetSocketAddress.InetSocketAddressTest: Error : test_Constructors failed - 2 Unexpected Exception here (number 0) LT FAIL: gnu.testlet.java.net.InetSocketAddress.InetSocketAddressTest: Error : test_Constructors failed - 3 Unexpected Exception here (number 0)

[M-Davies]

@andrew-m-leonard

• If the windows installer if failing due to the JDK-Next windows job, Haroon is working on that https://github.com/AdoptOpenJDK/openjdk-build/issues/1712. Otherwise, that's a new failure.
• ~The JDK14 windows failure is an intermittent that's occurred twice before in this report (Search this page for Error 127~ Now REPORTED https://github.com/AdoptOpenJDK/openjdk-build/issues/1741
• JDK8 Hotspot solaris has been reported https://github.com/AdoptOpenJDK/openjdk-build/issues/1722 but no one is looking into it
• The mac failure is new, not seen that before.

[M-Davies]

Wed 13th May BUILDS

• All JDK-Next jobs (save AIX-openj9) failing with missing rule. Will see if it reoccurs tomorrow.

  gmake[2]: *** No rule to make target 'test-image-failure-handler', needed by 'test-image'.  Stop.

[M-Davies]

Wed 13th May TESTS Failures None Unstables

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_aarch64_linux/141/. Same failure as https://github.com/eclipse/openj9/issues/8987

  java/util/concurrent/forkjoin/Integrate.java.Integrate
  java/util/concurrent/forkjoin/NQueensCS.java.NQueensCS
  java/util/logging/TestConfigurationListeners.java.TestConfigurationListeners

  Pack200 has been reported, along with the failures in https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_aarch64_linux/141/ to https://github.com/eclipse/openj9/issues/8987

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk14_hs_sanity.openjdk_aarch64_linux/78/ java/lang/invoke/VarHandles/VarHandleTestByteArrayAsInt.java on test-aws-rhel76-armv8-1 Same error as https://github.com/AdoptOpenJDK/openjdk-build/issues/1634#issuecomment-615126690
• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk14_j9_sanity.openjdk_x86-64_windows/73 java/util/logging/LoggingDeadlock2.java.LoggingDeadlock2 on test-aws-win2019-x64-2 (seen before on JDK14_aarch64_HS). First time seen on windows.

  02:31:42  stdout:
  02:31:42  2020-05-13T01:16:34.589642800
  02:31:42  2020-05-13T01:17:36.925089300
  02:31:42  2020-05-13T01:18:38.744359700
  02:31:42  2020-05-13T01:19:40.386475200
  02:31:42  2020-05-13T01:20:41.650572200
  02:31:42  2020-05-13T01:21:42.907888800
  02:31:42  2020-05-13T01:22:44.593429300
  02:31:42  2020-05-13T01:23:46.257974300
  02:31:42  2020-05-13T01:24:48.663222300
  02:31:42  2020-05-13T01:25:49.911273700
  02:31:42  2020-05-13T01:26:51.594812600
  02:31:42  2020-05-13T01:27:54.088468300
  02:31:42  2020-05-13T01:28:55.065983100
  02:31:42  2020-05-13T01:29:57.413649100
  02:31:42  2020-05-13T01:30:59.000526100
  02:31:42  stderr:
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  Error getting data from 41292: Exception connecting to 41292
  02:31:42  
  02:31:42  TEST RESULT: Error. Agent error: java.lang.Exception: Agent 2 timed out with a timeout of 960 seconds; check console log for any additional details

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk8_hs_sanity.openjdk_x86-64_linux/358/ is known https://github.com/AdoptOpenJDK/openjdk-tests/issues/1750#issuecomment-619974621

[M-Davies]

Thurs 14th May TESTS Failures

• https://ci.adoptopenjdk.net/job/Test_openjdk8_hs_sanity.openjdk_x86-64_windows/148/console => REPORTED https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/1328

Unstables

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_s390x_linux/216/ java/lang/ref/FinalizeOverride.java on test-marist-ubuntu1604-s390x-2. Firstseen.

  02:42:22  TEST RESULT: Error. Agent error: java.lang.Exception: Agent 24 timed out with a timeout of 960 seconds; check console log for any additional details

• https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_aarch64_linux/142 & https://ci.adoptopenjdk.net/view/Test_openjdk/job/Test_openjdk11_j9_sanity.openjdk_aarch64_linux_xl/109/ needs to be looked at