search

eclipse-openj9 / openj9

Eclipse OpenJ9: A Java Virtual Machine for OpenJDK that's optimized for small footprint, fast start-up, and high throughput. Builds on Eclipse OMR (https://github.com/eclipse/omr) and combines with the Extensions for OpenJDK for OpenJ9 repo.
Other
3.27k stars 721 forks source link

BruteArgumentMoverHandle.permuteArguments NullPointerException #8972

Closed pshipton closed 7 months ago

pshipton commented 4 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.system_x86-64_linux_xl_Nightly/319 TestIBMJlmRemoteMemoryNoAuth_0

CL1 stderr Exception in thread "main" java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
CL1 stderr  at net.openj9.test.extensions.MemoryPoolExtensionCommand.execute(MemoryPoolExtensionCommand.java:97)
CL1 stderr  at net.openj9.test.jlm.resources.VMData.invokeIBMMemoryPoolBeanTest(VMData.java:179)
CL1 stderr  at net.openj9.test.jlm.resources.MemoryData.writeData(MemoryData.java:112)
CL1 stderr  at net.openj9.test.jlm.remote.MemoryProfiler.getStatsViaProxy(MemoryProfiler.java:192)
CL1 stderr  at net.openj9.test.jlm.remote.MemoryProfiler.main(MemoryProfiler.java:119)
CL1 stderr Caused by: java.lang.invoke.StringConcatException: Generator failed
CL1 stderr  at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
CL1 stderr  at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
CL1 stderr  at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
CL1 stderr  at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
CL1 stderr  at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
CL1 stderr  at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
CL1 stderr  at java.base/java.lang.invoke.MethodHandle.invokeBsm(MethodHandle.java:963)
CL1 stderr  at java.base/java.lang.invoke.MethodHandle.resolveInvokeDynamic(MethodHandle.java:1093)
CL1 stderr  ... 5 more
CL1 stderr Caused by: java.lang.NullPointerException
CL1 stderr  at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
CL1 stderr  at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2911)
CL1 stderr  at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2928)
CL1 stderr  at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
CL1 stderr  at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
CL1 stderr  ... 12 more
DanHeidinga commented 4 years ago

@cathyzhyi FYI as I see an NPE coming from BruteArgumentMoverHandle

pshipton commented 4 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_extended.system_x86-64_linux_xl_Nightly/331 SharedClasses.SCM01.MultiThread_0

[2020-04-04T04:20:29.818Z] MT4 stderr Exception in thread "main" java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
[2020-04-04T04:20:29.818Z] MT4 stderr   at net.openj9.test.sc.LoaderSlaveMultiThread.logMessage(LoaderSlaveMultiThread.java:153)
[2020-04-04T04:20:29.818Z] MT4 stderr   at net.openj9.test.sc.LoaderSlaveMultiThread.run(LoaderSlaveMultiThread.java:134)
[2020-04-04T04:20:29.818Z] MT4 stderr   at net.openj9.test.sc.LoaderSlaveMultiThread.main(LoaderSlaveMultiThread.java:59)
[2020-04-04T04:20:29.818Z] MT4 stderr Caused by: java.lang.invoke.StringConcatException: Generator failed
[2020-04-04T04:20:29.818Z] MT4 stderr   at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
[2020-04-04T04:20:29.818Z] MT4 stderr   at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
[2020-04-04T04:20:29.818Z] MT4 stderr   at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
[2020-04-04T04:20:29.818Z] MT4 stderr   at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
[2020-04-04T04:20:29.818Z] MT4 stderr   at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
[2020-04-04T04:20:29.818Z] MT4 stderr   at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
[2020-04-04T04:20:29.818Z] MT4 stderr   at java.base/java.lang.invoke.MethodHandle.invokeBsm(MethodHandle.java:963)
[2020-04-04T04:20:29.818Z] MT4 stderr   at java.base/java.lang.invoke.MethodHandle.resolveInvokeDynamic(MethodHandle.java:1093)
[2020-04-04T04:20:29.818Z] MT4 stderr   ... 3 more
[2020-04-04T04:20:29.818Z] MT4 stderr Caused by: java.lang.NullPointerException
[2020-04-04T04:20:29.818Z] MT4 stderr   at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
[2020-04-04T04:20:29.818Z] MT4 stderr   at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2911)
[2020-04-04T04:20:29.818Z] MT4 stderr   at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2928)
[2020-04-04T04:20:29.818Z] MT4 stderr   at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
[2020-04-04T04:20:29.818Z] MT4 stderr   at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
[2020-04-04T04:20:29.818Z] MT4 stderr   ... 10 more
pshipton commented 4 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/333 SharedClasses.SCM01.MultiThread_0

MT2 stderr Exception in thread "Thread-691" java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
MT2 stderr Exception in thread "Thread-701" java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
MT2 stderr  at net.openj9.sc.classes.Test_Init_0697.makeString(Test_Init_0697.java:37)
MT2 stderr  at net.openj9.sc.classes.Test_Init_0697.stringOperations(Test_Init_0697.java:24)
MT2 stderr  at net.openj9.sc.classes.Test_Init_0697.getName(Test_Init_0697.java:7)
MT2 stderr  at net.openj9.test.sc.LoaderSlaveMultiThread$LoaderThread.run(LoaderSlaveMultiThread.java:213)
MT2 stderr  at java.base/java.lang.Thread.run(Thread.java:834)
MT2 stderr Caused by: java.lang.invoke.StringConcatException: Generator failed
MT2 stderr  at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
MT2 stderr  at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
MT2 stderr  at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
MT2 stderr  at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
MT2 stderr  at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)Exception in thread "Thread-665" Exception in thread "
cathyzhyi commented 4 years ago

I am not able to reproduce this locally or through grinder. It would be very helpful if we could get some coredumps for the failure from nightly build.

pshipton commented 4 years ago

@cathyzhyi pls provide the -Xdump options you want, and we can ask @Mesbah-Alam to help modify the test to include them.

cathyzhyi commented 4 years ago

@Mesbah-Alam could you help adding the following to the above a failing tests -Xdump:system+java:events=throw,filter=java/lang/NullPointerException#*java/lang/invoke/BruteArgumentMoverHandle.permuteArguments*

pshipton commented 4 years ago

The option was added in https://github.com/eclipse/openj9-systemtest/pull/114

JasonFengJ9 commented 4 years ago

Occurred in an internal acceptance build 448411:

 [AIX64] 80 SVT_Apps_1.SVT_Octane.NoOptions.1

Exception in thread "main" java.lang.NullPointerException
        at java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
        at java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2233)
        at java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2271)
        at jdk.internal.dynalink.ChainedCallSite.makePruneAndInvokeMethod(ChainedCallSite.java:240)
        at jdk.internal.dynalink.ChainedCallSite.relinkInternal(ChainedCallSite.java:196)
        at jdk.internal.dynalink.ChainedCallSite.relink(ChainedCallSite.java:161)
        at jdk.nashorn.internal.runtime.linker.LinkerCallSite.relink(LinkerCallSite.java:154)
        at jdk.internal.dynalink.DynamicLinker.relink(DynamicLinker.java:297)
        at java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
        at java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
        at java.lang.invoke.BruteArgumentMoverHandle.invokeExact_thunkArchetype_X(BruteArgumentMoverHandle.java:404)
        at java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
        at java.lang.invoke.FoldNonvoidHandle.invokeExact_thunkArchetype_X(FoldHandle.java:123)
        at java.lang.invoke.MutableCallSiteDynamicInvokerHandle.invokeExact_thunkArchetype_X(MutableCallSiteDynamicInvokerHandle.java:64)
        at jdk.nashorn.internal.scripts.Script$Recompilation$8$5614AA$base.RunSuites(/bluebird/javatest/lib/octane/base.js:144)
        at jdk.nashorn.internal.scripts.Script$\^eval\_.:program(<eval>:73)
        at jdk.nashorn.internal.runtime.ScriptFunctionData.invoke(ScriptFunctionData.java:649)
        at jdk.nashorn.internal.runtime.ScriptFunction.invoke(ScriptFunction.java:506)
        at jdk.nashorn.internal.runtime.ScriptRuntime.apply(ScriptRuntime.java:405)
        at jdk.nashorn.api.scripting.NashornScriptEngine.evalImpl(NashornScriptEngine.java:461)
        at jdk.nashorn.api.scripting.NashornScriptEngine.access$200(NashornScriptEngine.java:85)
        at jdk.nashorn.api.scripting.NashornScriptEngine$3.eval(NashornScriptEngine.java:522)
        at javax.script.CompiledScript.eval(CompiledScript.java:117)
        at com.ibm.octane.test.Octane.runTest(Octane.java:166)
        at com.ibm.octane.test.Octane.runAllTests(Octane.java:114)
        at com.ibm.octane.test.Octane.main(Octane.java:59)
pshipton commented 4 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_s390x_linux_Nightly/90 Caused many failures in this build. java/lang/String/Supplementary.java.Supplementary java/lang/String/ToLowerCase.java.ToLowerCase java/lang/String/ToUpperCase.java.ToUpperCase java/lang/String/UnicodeCasingTest.java.UnicodeCasingTest java/lang/StringBuffer/AppendCharSequence.java.AppendCharSequence java/lang/StringBuffer/AppendSB.java.AppendSB java/lang/StringBuffer/AppendStringBuilder.java.AppendStringBuilder java/lang/StringBuffer/BufferForwarding.java.BufferForwarding java/lang/StringBuffer/Exceptions.java.Exceptions java/lang/StringBuffer/IndexOf.java.IndexOf java/lang/StringBuffer/SetLength.java.SetLength java/lang/StringBuffer/Supplementary.java.Supplementary java/lang/StringBuilder/AppendStringBuffer.java.AppendStringBuffer java/lang/StringBuilder/BuilderForwarding.java.BuilderForwarding java/lang/StringBuilder/Exceptions.java.Exceptions java/lang/StringBuilder/Supplementary.java.Supplementary

Caused by: java.lang.NullPointerException
    at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
    at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2912)
    at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2929)
    at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
    at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
    ... 15 more
pshipton commented 4 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_extended.system_x86-64_linux_Release/37 SharedClasses.SCM01.MultiThread_0

MT4 stderr Exception in thread "main" java.lang.BootstrapMethodError: java.lang.NullPointerException
MT4 stderr  at java.management/java.lang.management.ManagementFactory$PlatformMBeanFinder.lambda$static$0(ManagementFactory.java:926)
MT4 stderr  at java.management/java.lang.management.ManagementFactory$PlatformMBeanFinder$$Lambda$13/0000000000000000.run(Unknown Source)
MT4 stderr  at java.base/java.security.AccessController.doPrivileged(AccessController.java:873)
MT4 stderr  at java.management/java.lang.management.ManagementFactory$PlatformMBeanFinder.<clinit>(ManagementFactory.java:922)
MT4 stderr  at java.management/java.lang.management.ManagementFactory.getPlatformMXBean(ManagementFactory.java:684)
MT4 stderr  at java.management/java.lang.management.ManagementFactory.getRuntimeMXBean(ManagementFactory.java:364)
MT4 stderr  at net.openj9.test.sc.LoaderSlaveMultiThread.main(LoaderSlaveMultiThread.java:64)
MT4 stderr Caused by: java.lang.NullPointerException
MT4 stderr  at java.base/java.lang.invoke.InnerClassLambdaMetafactory.buildCallSite(InnerClassLambdaMetafactory.java:231)
MT4 stderr  at java.base/java.lang.invoke.LambdaMetafactory.metafactory(LambdaMetafactory.java:329)
MT4 stderr  at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
MT4 stderr  at java.base/java.lang.invoke.MethodHandle.invokeBsm(MethodHandle.java:969)
MT4 stderr  at java.base/java.lang.invoke.MethodHandle.resolveInvokeDynamic(MethodHandle.java:1093)
MT4 stderr  ... 7 more
pshipton commented 4 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_x86-64_linux_xl_Nightly/72 java/lang/System/LoggerFinder/internal/api/LoggerFinderAPITest.java

java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
    at java.logging/java.util.logging.LogManager$LoggerContext.addLocalLogger(LogManager.java:799)
    at java.logging/java.util.logging.LogManager$LoggerContext.ensureDefaultLogger(LogManager.java:749)
    at java.logging/java.util.logging.LogManager$LoggerContext.ensureInitialized(LogManager.java:657)
    at java.logging/java.util.logging.LogManager$LoggerContext.getLoggerNames(LogManager.java:849)
    at java.logging/java.util.logging.LogManager.resetLoggerContext(LogManager.java:1455)
    at java.logging/java.util.logging.LogManager.reset(LogManager.java:1445)
    at java.logging/java.util.logging.LogManager.readConfiguration(LogManager.java:1575)
    at java.logging/java.util.logging.LogManager.readConfiguration(LogManager.java:1378)
    at java.logging/java.util.logging.LogManager.readPrimordialConfiguration(LogManager.java:445)
    at java.logging/java.util.logging.LogManager$2.run(LogManager.java:394)
    at java.base/java.security.AccessController.doPrivileged(AccessController.java:678)
    at java.logging/java.util.logging.LogManager.ensureLogManagerInitialized(LogManager.java:382)
    at java.logging/java.util.logging.LogManager.getLogManager(LogManager.java:430)
    at java.logging/java.util.logging.Logger.demandLogger(Logger.java:648)
    at java.logging/java.util.logging.Logger.getLogger(Logger.java:717)
    at java.logging/java.util.logging.Logger.getLogger(Logger.java:701)
    at LoggerFinderAPITest.<init>(LoggerFinderAPITest.java:183)
    at LoggerFinderAPITest.main(LoggerFinderAPITest.java:467)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
    at java.base/java.lang.Thread.run(Thread.java:836)
Caused by: java.lang.invoke.StringConcatException: Generator failed
    at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
    at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
    at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
    at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
    at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
    at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
    at java.base/java.lang.invoke.MethodHandle.invokeBsm(MethodHandle.java:963)
    at java.base/java.lang.invoke.MethodHandle.resolveInvokeDynamic(MethodHandle.java:1093)
    ... 24 more
Caused by: java.lang.NullPointerException
    at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
    at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2912)
    at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2929)
    at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
    at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
    ... 31 more
pshipton commented 4 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_x86-64_mac_Nightly/101 sun/misc/URLClassPath/ClassnameCharTest.java

java.lang.BootstrapMethodError: java.lang.NullPointerException
    at sun.net.www.protocol.http.HttpURLConnection.getNetProperty(HttpURLConnection.java:215)
    at sun.net.www.protocol.http.HttpURLConnection.<clinit>(HttpURLConnection.java:247)
    at sun.net.www.protocol.http.Handler.openConnection(Handler.java:62)
    at sun.net.www.protocol.http.Handler.openConnection(Handler.java:57)
    at java.net.URL.openConnection(URL.java:1002)
    at sun.applet.AppletClassLoader.getBytes(AppletClassLoader.java:319)
    at sun.applet.AppletClassLoader.access$100(AppletClassLoader.java:64)
    at sun.applet.AppletClassLoader$1.run(AppletClassLoader.java:206)
    at java.security.AccessController.doPrivileged(AccessController.java:770)
    at sun.applet.AppletClassLoader.findClass(AppletClassLoader.java:196)
    at ClassnameCharTest$MyAppletClassLoader.findClass(ClassnameCharTest.java:99)
    at ClassnameCharTest.realMain(ClassnameCharTest.java:81)
    at ClassnameCharTest.main(ClassnameCharTest.java:152)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
    at java.lang.Thread.run(Thread.java:823)
Caused by: java.lang.NullPointerException
    at java.lang.invoke.InnerClassLambdaMetafactory.buildCallSite(InnerClassLambdaMetafactory.java:226)
    at java.lang.invoke.LambdaMetafactory.metafactory(LambdaMetafactory.java:304)
    at java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
    at java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
    at java.lang.invoke.MethodHandle.invokeBsm(MethodHandle.java:900)
    at java.lang.invoke.MethodHandle.resolveInvokeDynamic(MethodHandle.java:951)
    ... 19 more
java.lang.AssertionError: Some tests failed
    at ClassnameCharTest.main(ClassnameCharTest.java:158)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
    at java.lang.Thread.run(Thread.java:823)
andrewcraik commented 3 years ago

@pshipton is this one still happening or is it resolved in later builds?

pshipton commented 3 years ago

I haven't seen anything since returning from vacation. @JasonFengJ9 have you seen this occur? Otherwise I'll close it.

pshipton commented 3 years ago

@andrewcraik There is one here from a PR build run yesterday. https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_x86-64_mac_Personal/7 jdk/lambda/ArrayCtorRefTest.java

15:31:21  test ArrayCtorRefTest.testLambdaInference(): failure
15:31:21  java.lang.BootstrapMethodError: java.lang.NullPointerException
15:31:21    at ArrayCtorRefTest.emptyArrayFactory(ArrayCtorRefTest.java:43)
15:31:21    at ArrayCtorRefTest.testLambdaInference(ArrayCtorRefTest.java:61)
15:31:21    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
15:31:21    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
15:31:21    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
15:31:21    at java.lang.reflect.Method.invoke(Method.java:498)
15:31:21    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:85)
15:31:21    at org.testng.internal.Invoker.invokeMethod(Invoker.java:639)
15:31:21    at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:821)
15:31:21    at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1131)
15:31:21    at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
15:31:21    at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:108)
15:31:21    at org.testng.TestRunner.privateRun(TestRunner.java:773)
15:31:21    at org.testng.TestRunner.run(TestRunner.java:623)
15:31:21    at org.testng.SuiteRunner.runTest(SuiteRunner.java:357)
15:31:21    at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:352)
15:31:21    at org.testng.SuiteRunner.privateRun(SuiteRunner.java:310)
15:31:21    at org.testng.SuiteRunner.run(SuiteRunner.java:259)
15:31:21    at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
15:31:21    at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
15:31:21    at org.testng.TestNG.runSuitesSequentially(TestNG.java:1185)
15:31:21    at org.testng.TestNG.runSuitesLocally(TestNG.java:1110)
15:31:21    at org.testng.TestNG.run(TestNG.java:1018)
15:31:21    at com.sun.javatest.regtest.agent.TestNGRunner.main(TestNGRunner.java:94)
15:31:21    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
15:31:21    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
15:31:21    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
15:31:21    at java.lang.reflect.Method.invoke(Method.java:498)
15:31:21    at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
15:31:21    at java.lang.Thread.run(Thread.java:823)
15:31:21  Caused by: java.lang.NullPointerException
15:31:21    at java.lang.invoke.InnerClassLambdaMetafactory.buildCallSite(InnerClassLambdaMetafactory.java:226)
15:31:21    at java.lang.invoke.LambdaMetafactory.metafactory(LambdaMetafactory.java:304)
15:31:21    at java.lang.invoke.MethodHandle.invokeBsm(MethodHandle.java:900)
15:31:21    at java.lang.invoke.MethodHandle.resolveInvokeDynamic(MethodHandle.java:951)
15:31:21    ... 30 more
andrewcraik commented 3 years ago

@nbhuiyan could you please have a look?

nbhuiyan commented 3 years ago

I have been trying to reproduce this on Grinder as well as locally with Xdump options to obtain core dumps I can use for my investigation. Unfortunately, after 100 iterations on Grinder and almost 200 iterations locally of running the failed test target, I could not reproduce this failure. Are there any other recent builds where this happened?

pshipton commented 3 years ago

Are there any other recent builds where this happened?

I haven't seen it, but will report here if it shows up again.

JasonFengJ9 commented 3 years ago

I haven't seen anything since returning from vacation. @JasonFengJ9 have you seen this occur? Otherwise I'll close it.

@pshipton no, I haven't seen it for a while, also tried TRSS search in recent builds and no hits either.

pshipton commented 3 years ago

Even though I'm not convinced the problem is resolved given https://github.com/eclipse/openj9/issues/8972#issuecomment-696829594, I'll close it. We can reopen if the problem is seen again.

pshipton commented 3 years ago

A bunch more here https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_x86-64_linux_xl_Nightly/162 Caused 19 failures in the same test run. java/lang/String/Supplementary.java.Supplementary java/lang/String/ToLowerCase.java.ToLowerCase java/lang/String/ToUpperCase.java.ToUpperCase java/lang/String/UnicodeCasingTest.java.UnicodeCasingTest java/lang/StringBuffer/AppendCharSequence.java.AppendCharSequence java/lang/StringBuffer/AppendSB.java.AppendSB java/lang/StringBuffer/AppendStringBuilder.java.AppendStringBuilder java/lang/StringBuffer/BufferForwarding.java.BufferForwarding java/lang/StringBuffer/Exceptions.java.Exceptions java/lang/StringBuffer/IndexOf.java.IndexOf java/lang/StringBuffer/SetLength.java.SetLength java/lang/StringBuffer/Supplementary.java.Supplementary java/lang/StringBuilder/AppendStringBuffer.java.AppendStringBuffer java/lang/StringBuilder/BuilderForwarding.java.BuilderForwarding java/lang/StringBuilder/Exceptions.java.Exceptions java/lang/StringBuilder/Supplementary.java.Supplementary java/lang/System/Logger/Level/LoggerLevelTest.java.LoggerLevelTest java/lang/System/Logger/interface/LoggerInterfaceTest.java.LoggerInterfaceTest java/lang/System/LoggerFinder/internal/api/LoggerFinderAPITest.java.LoggerFinderAPITest

nbhuiyan commented 3 years ago

Resuming my investigation into this failure again.

pshipton commented 3 years ago

Another one in an internal test job_output.php?id=657892400 [Linux Hammer]

pshipton commented 3 years ago

Another series of failures https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_s390x_linux_xl_Nightly/169 java/lang/String/Supplementary.java.Supplementary java/lang/String/ToUpperCase.java.ToUpperCase java/lang/String/UnicodeCasingTest.java.UnicodeCasingTest java/lang/StringBuffer/AppendCharSequence.java.AppendCharSequence java/lang/StringBuffer/AppendSB.java.AppendSB java/lang/StringBuffer/AppendStringBuilder.java.AppendStringBuilder java/lang/StringBuffer/BufferForwarding.java.BufferForwarding java/lang/StringBuffer/Exceptions.java.Exceptions java/lang/StringBuffer/IndexOf.java.IndexOf java/lang/StringBuilder/BuilderForwarding.java.BuilderForwarding java/lang/StringBuilder/Exceptions.java.Exceptions java/lang/StringBuilder/Supplementary.java.Supplementary

pshipton commented 3 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_s390x_linux_Nightly/192 java/lang/System/Logger/Level/LoggerLevelTest.java.LoggerLevelTest java/lang/System/LoggerFinder/internal/api/LoggerFinderAPITest.java.LoggerFinderAPITest

pshipton commented 3 years ago

I wonder if https://github.com/eclipse/openj9/issues/10759 is related.

nbhuiyan commented 3 years ago

After at least 100 iterations of the failing target in each platform this failure surfaced in recently, I have been unable to reproduce it. I am not able to investigate further without being able to reproduce it and obtaining the core dumps. I will continue trying to reproduce this. I am not sure about how long it might take to achieve that.

pshipton commented 3 years ago

How about if we modify all the openjdk java/lang testing to have the -Xdump option you need, so the next time it occurs in the nightly builds there will be a core file.

nbhuiyan commented 3 years ago

That will be fantastic! Please add the Xdump option in comment above for jdk_lang_j9.

pshipton commented 3 years ago

Created https://github.com/AdoptOpenJDK/openjdk-tests/pull/1989

Does the option change the JIT behavior? It's interesting we haven't seen the problem again in the system testing since the option was added (although we might have missing something while I was on vacation).

nbhuiyan commented 3 years ago

Does the option change the JIT behavior? It's interesting we haven't seen the problem again in the system testing since the option was added (although we might have missing something while I was on vacation).

I would be really surprised if that was the case. I did perform Grinder runs without the -Xdump option but could not reproduce the failure even then.

andrewcraik commented 3 years ago

Given the lack of progress I am moving this to the next release - we aren't likely to have a fix in time for the release.

pshipton commented 3 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/508 SharedClasses.SCM01.MultiCL_0

STF 01:12:09.888 - +------ Step 6 - Start java processes using LoaderSlaveMultiCL
STF 01:12:09.889 - | Run multiple concurrent foreground processes
STF 01:12:09.889 - |   Program:     /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java
STF 01:12:09.889 - |   Mnemonic:    MCL
STF 01:12:09.889 - |   Instances:   5
STF 01:12:09.889 - |   Echo:        ECHO_ON
STF 01:12:09.889 - |   Expectation: CLEAN_RUN within 2h
STF 01:12:09.889 - |
STF 01:12:09.891 - Running command: /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java -Xshareclasses:name=SCC_SysTest_Workload_Cache,cacheDir=/home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/caches -classpath /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/jvmtest/system/openj9-systemtest/openj9.test.sharedClasses/bin net.openj9.test.sc.LoaderSlaveMultiCL /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/tmp/classes.jar
STF 01:12:09.891 - Redirecting stderr to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL1.stderr
STF 01:12:09.891 - Redirecting stdout to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL1.stdout
STF 01:12:09.896 - Running command: /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java -Xshareclasses:name=SCC_SysTest_Workload_Cache,cacheDir=/home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/caches -classpath /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/jvmtest/system/openj9-systemtest/openj9.test.sharedClasses/bin net.openj9.test.sc.LoaderSlaveMultiCL /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/tmp/classes.jar
STF 01:12:09.896 - Redirecting stderr to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL2.stderr
STF 01:12:09.896 - Redirecting stdout to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL2.stdout
STF 01:12:09.899 - Running command: /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java -Xshareclasses:name=SCC_SysTest_Workload_Cache,cacheDir=/home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/caches -classpath /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/jvmtest/system/openj9-systemtest/openj9.test.sharedClasses/bin net.openj9.test.sc.LoaderSlaveMultiCL /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/tmp/classes.jar
STF 01:12:09.899 - Redirecting stderr to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL3.stderr
STF 01:12:09.899 - Redirecting stdout to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL3.stdout
STF 01:12:09.902 - Running command: /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java -Xshareclasses:name=SCC_SysTest_Workload_Cache,cacheDir=/home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/caches -classpath /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/jvmtest/system/openj9-systemtest/openj9.test.sharedClasses/bin net.openj9.test.sc.LoaderSlaveMultiCL /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/tmp/classes.jar
STF 01:12:09.902 - Redirecting stderr to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL4.stderr
STF 01:12:09.902 - Redirecting stdout to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL4.stdout
STF 01:12:09.906 - Running command: /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java -Xshareclasses:name=SCC_SysTest_Workload_Cache,cacheDir=/home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/caches -classpath /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/jvmtest/system/openj9-systemtest/openj9.test.sharedClasses/bin net.openj9.test.sc.LoaderSlaveMultiCL /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/tmp/classes.jar
STF 01:12:09.906 - Redirecting stderr to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL5.stderr
STF 01:12:09.906 - Redirecting stdout to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdk-tests/TKG/test_output_16030829356080/SharedClasses.SCM01.MultiCL_0/20201019-010910-SharedClasses/results/6.MCL5.stdout
STF 01:12:09.909 - Monitoring processes: MCL1 MCL2 MCL3 MCL4 MCL5
MCL1 stderr Exception in thread "main" java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
MCL1 stderr     at net.openj9.sc.classes.Test_Init_0132.stringOperations(Test_Init_0132.java:20)
MCL1 stderr     at net.openj9.sc.classes.Test_Init_0132.getName(Test_Init_0132.java:7)
MCL1 stderr     at net.openj9.test.sc.LoaderSlaveMultiCL.run(LoaderSlaveMultiCL.java:115)
MCL1 stderr     at net.openj9.test.sc.LoaderSlaveMultiCL.main(LoaderSlaveMultiCL.java:52)
MCL1 stderr Caused by: java.lang.invoke.StringConcatException: Generator failed
MCL1 stderr     at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
MCL1 stderr     at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
MCL1 stderr     at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
MCL1 stderr     at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
MCL1 stderr     at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
MCL1 stderr     at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
MCL1 stderr     at java.base/java.lang.invoke.MethodHandleResolver.invokeBsm(MethodHandleResolver.java:175)
MCL1 stderr     at java.base/java.lang.invoke.MethodHandleResolver.resolveInvokeDynamic(MethodHandleResolver.java:237)
MCL1 stderr     ... 4 more
MCL1 stderr Caused by: java.lang.NullPointerException
MCL1 stderr     at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
MCL1 stderr     at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2936)
MCL1 stderr     at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2953)
MCL1 stderr     at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
MCL1 stderr     at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
MCL1 stderr     ... 11 more
STF 01:12:25.119 - **FAILED** Process MCL1 ended with exit code (1) and not the expected exit code/s (0)
STF 01:12:25.120 - Monitoring Report Summary:
STF 01:12:25.120 -   o Process MCL1 ended with exit code (1) and not the expected exit code/s (0)
STF 01:12:25.120 -   o Process MCL2 is still running
STF 01:12:25.120 -   o Process MCL3 is still running
STF 01:12:25.120 -   o Process MCL4 is still running
STF 01:12:25.120 -   o Process MCL5 is still running
nbhuiyan commented 3 years ago

@pshipton Unfortunately, we did not get a core dump from that crash. The dump option was not set for the run:

23:09:17  ===============================================
23:09:17  Running test SharedClasses.SCM01.MultiCL_0 ...
23:09:17  ===============================================
23:09:17  SharedClasses.SCM01.MultiCL_0 Start Time: Mon Oct 19 01:09:09 2020 Epoch Time (ms): 1603084149924
23:09:17  "/home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:destroyAll; "/home/jenkins/workspace/Test_openjdk11_j9_extended.system_x86-64_linux_Nightly/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:groupAccess,destroyAll; echo "cache cleanup done";
23:09:17  JVMSHRC005I No shared class caches available
23:09:17  JVMSHRC005I No shared class caches available
23:09:17  cache cleanup done
23:09:17  variation: NoOptions
23:09:17  JVM_OPTIONS:

I was under the impression that eclipse/openj9-systemtest#114 would have resulted in this test being run with the -Xdump option set up.

pshipton commented 3 years ago

https://github.com/eclipse/openj9-systemtest/pull/114 only modified the MT (MultiThread) scenario, while the NPE occurred in the MultiCL scenario. @Mesbah-Alam can we modify this scenario as well please.

pshipton commented 3 years ago

https://github.com/eclipse/openj9-systemtest/pull/120 has modified all the test variants to run with the -Xdump option.

pshipton commented 3 years ago

There are NPEs related to InnerClassLambdaMetafactory.buildCallSite reported in https://github.com/eclipse/openj9/issues/10929

nbhuiyan commented 3 years ago

Still no luck in reproducing this failure with the dump option set. Seems like the failures do not show up after setting up the -Xdump options. At this time we do not have a way to investigate this further and therefore this issue can not be resolved as part of 0.24.

0xdaryl commented 3 years ago

Given the inability to reproduce this problem with any form of diagnostic aids this is not going to be resolved for 0.24, hence moving this out to JDK16.

However, if the existing diagnostic procedures are not proving to be effective we will have to brainstorm more creative and bespoke approaches for 0.25.

pshipton commented 3 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.system_s390x_linux_Nightly_testList_1/30 TestJlmRemoteThreadNoAuth_0

CL1 stderr Exception in thread "main" java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
CL1 stderr  at net.adoptopenjdk.test.jlm.resources.ThreadData.writeData(ThreadData.java:269)
CL1 stderr  at net.adoptopenjdk.test.jlm.remote.ThreadProfiler.getStatsViaProxy(ThreadProfiler.java:135)
CL1 stderr  at net.adoptopenjdk.test.jlm.remote.ThreadProfiler.main(ThreadProfiler.java:97)
CL1 stderr Caused by: java.lang.invoke.StringConcatException: Generator failed
CL1 stderr  at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
CL1 stderr  at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
CL1 stderr  at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
CL1 stderr  at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
CL1 stderr  at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
CL1 stderr  at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
CL1 stderr  at java.base/java.lang.invoke.MethodHandleResolver.invokeBsm(MethodHandleResolver.java:176)
CL1 stderr  at java.base/java.lang.invoke.MethodHandleResolver.resolveInvokeDynamic(MethodHandleResolver.java:238)
CL1 stderr  ... 3 more
CL1 stderr Caused by: java.lang.NullPointerException
CL1 stderr  at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
CL1 stderr  at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2930)
CL1 stderr  at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2947)
CL1 stderr  at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
CL1 stderr  at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
CL1 stderr  ... 10 more
liqunl commented 3 years ago

Found 13 failures with the same symptom in my pbuild (the String, StringBuilder and StringBuffer tests) https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk11_j9_sanity.openjdk_s390x_linux_Personal/12/testReport/

pshipton commented 3 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_x86-64_mac_Release/23 java/lang/StringBuilder/BuilderForwarding.java.BuilderForwarding java/lang/System/Logger/Level/LoggerLevelTest.java.LoggerLevelTest java/lang/System/LoggerFinder/internal/api/LoggerFinderAPITest.java.LoggerFinderAPITest

pshipton commented 3 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_s390x_linux_mixed_OpenJDK11/1 java/lang/String/Supplementary.java java/lang/String/ToLowerCase.java java/lang/String/ToUpperCase.java java/lang/String/UnicodeCasingTest.java java/lang/StringBuffer/AppendCharSequence.java java/lang/StringBuffer/AppendSB.java java/lang/StringBuffer/AppendStringBuilder.java java/lang/StringBuffer/BufferForwarding.java java/lang/StringBuffer/Exceptions.java java/lang/StringBuffer/IndexOf.java

03:59:19  java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
03:59:19    at BufferForwarding.insertintObject(BufferForwarding.java:195)
03:59:19    at BufferForwarding.executeTestMethods(BufferForwarding.java:55)
03:59:19    at BufferForwarding.main(BufferForwarding.java:45)
03:59:19    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
03:59:19    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
03:59:19    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
03:59:19    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
03:59:19    at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:312)
03:59:19    at java.base/java.lang.Thread.run(Thread.java:836)
03:59:19  Caused by: java.lang.invoke.StringConcatException: Generator failed
03:59:19    at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
03:59:19    at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
03:59:19    at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
03:59:19    at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
03:59:19    at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
03:59:19    at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
03:59:19    at java.base/java.lang.invoke.MethodHandleResolver.invokeBsm(MethodHandleResolver.java:176)
03:59:19    at java.base/java.lang.invoke.MethodHandleResolver.resolveInvokeDynamic(MethodHandleResolver.java:238)
03:59:19    ... 9 more
03:59:19  Caused by: java.lang.NullPointerException
03:59:19    at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
03:59:19    at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2946)
03:59:19    at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2963)
03:59:19    at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
03:59:19    at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
03:59:19    ... 16 more
0xdaryl commented 3 years ago

No updates on this long-standing problem for 0.25. Moving out to 0.26.

pshipton commented 3 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.system_s390x_linux_mixed_Nightly_testList_2/10 TestJlmRemoteThreadNoAuth_1 https://140-211-168-230-openstack.osuosl.org/artifactory/ci-eclipse-openj9/Test/Test_openjdk11_j9_sanity.system_s390x_linux_mixed_Nightly_testList_2/10/system_test_output.tar.gz

STF 04:47:13.225 - +------ Step 7 - Wait for processes to complete
STF 04:47:13.225 - | Wait for processes to meet expectations
STF 04:47:13.225 - |   Processes: [LT2, CL2]
STF 04:47:13.225 - |
STF 04:47:13.225 - Monitoring processes: CL2 LT2
CL2 j> 2021/02/20 04:47:13.353 ServerURL=service:jmx:rmi:///jndi/rmi://localhost:1234/jmxrmi
CL2 j> 2021/02/20 04:47:13.428 Attempting to connect
CL2 j> 2021/02/20 04:47:13.687 Connection established!
CL2 j> 2021/02/20 04:47:24.001 Writing report data ...
CL2 stderr Exception in thread "main" java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
CL2 stderr  at net.adoptopenjdk.test.jlm.resources.ThreadData.writeData(ThreadData.java:618)
CL2 stderr  at net.adoptopenjdk.test.jlm.remote.ThreadProfiler.getStatsViaServer(ThreadProfiler.java:199)
CL2 stderr  at net.adoptopenjdk.test.jlm.remote.ThreadProfiler.main(ThreadProfiler.java:99)
CL2 stderr Caused by: java.lang.invoke.StringConcatException: Generator failed
CL2 stderr  at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
CL2 stderr  at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
CL2 stderr  at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
CL2 stderr  at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
CL2 stderr  at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
CL2 stderr  at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
CL2 stderr  at java.base/java.lang.invoke.MethodHandleResolver.invokeBsm(MethodHandleResolver.java:176)
CL2 stderr  at java.base/java.lang.invoke.MethodHandleResolver.resolveInvokeDynamic(MethodHandleResolver.java:238)
CL2 stderr  ... 3 more
CL2 stderr Caused by: java.lang.NullPointerException
CL2 stderr  at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
CL2 stderr  at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2946)
CL2 stderr  at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2963)
CL2 stderr  at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
CL2 stderr  at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
CL2 stderr  ... 10 more
STF 04:47:26.838 - **FAILED** Process CL2 ended with exit code (1) and not the expected exit code/s (0)
JasonFengJ9 commented 3 years ago

Another occurrence at an internal build 466738 (job_output.php?id=671263935)

671263935 - [AIX64] 80 SVT_Apps_1.SVT_Octane.NoOptions.1
Exception in thread "main" java.lang.NullPointerException
        at java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
        at java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2258)
        at java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2296)
        at jdk.internal.dynalink.ChainedCallSite.makePruneAndInvokeMethod(ChainedCallSite.java:240)
        at jdk.internal.dynalink.ChainedCallSite.relinkInternal(ChainedCallSite.java:196)
        at jdk.internal.dynalink.ChainedCallSite.relink(ChainedCallSite.java:161)
        at jdk.nashorn.internal.runtime.linker.LinkerCallSite.relink(LinkerCallSite.java:154)
        at jdk.internal.dynalink.DynamicLinker.relink(DynamicLinker.java:297)
        at java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:300)
        at java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
        at java.lang.invoke.BruteArgumentMoverHandle.invokeExact_thunkArchetype_X(BruteArgumentMoverHandle.java:404)
        at java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
        at java.lang.invoke.FoldNonvoidHandle.invokeExact_thunkArchetype_X(FoldHandle.java:123)
        at java.lang.invoke.MutableCallSiteDynamicInvokerHandle.invokeExact_thunkArchetype_X(MutableCallSiteDynamicInvokerHandle.java:64)
        at jdk.nashorn.internal.scripts.Script$Recompilation$76$12196$base.RunStep#RunNextSetup(/bluebird/javatest/lib/octane/base.js:358)
        at java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
        at java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
        at java.lang.invoke.InvokeExactHandle.invokeExact_thunkArchetype_X(InvokeExactHandle.java:87)
        at java.lang.invoke.FoldNonvoidHandle.invokeExact_thunkArchetype_X(FoldHandle.java:121)
        at java.lang.invoke.MutableCallSiteDynamicInvokerHandle.invokeExact_thunkArchetype_X(MutableCallSiteDynamicInvokerHandle.java:64)
        at jdk.nashorn.internal.scripts.Script$Recompilation$73$11852A$base.RunStep(/bluebird/javatest/lib/octane/base.js:389)
        at java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
        at java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
        at java.lang.invoke.InvokeExactHandle.invokeExact_thunkArchetype_X(InvokeExactHandle.java:87)
        at java.lang.invoke.FoldNonvoidHandle.invokeExact_thunkArchetype_X(FoldHandle.java:121)
        at java.lang.invoke.MutableCallSiteDynamicInvokerHandle.invokeExact_thunkArchetype_X(MutableCallSiteDynamicInvokerHandle.java:64)
        at jdk.nashorn.internal.scripts.Script$Recompilation$72$5859$base.RunSuites#RunStep(/bluebird/javatest/lib/octane/base.js:157)
        at java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
        at java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
        at java.lang.invoke.InvokeExactHandle.invokeExact_thunkArchetype_X(InvokeExactHandle.java:87)
        at java.lang.invoke.FoldNonvoidHandle.invokeExact_thunkArchetype_X(FoldHandle.java:121)
        at java.lang.invoke.MutableCallSiteDynamicInvokerHandle.invokeExact_thunkArchetype_X(MutableCallSiteDynamicInvokerHandle.java:64)
        at jdk.nashorn.internal.scripts.Script$Recompilation$71$5614AA$base.RunSuites(/bluebird/javatest/lib/octane/base.js:173)
        at java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
        at java.lang.invoke.InvokeExactHandle.invokeExact_thunkArchetype_X(InvokeExactHandle.java:87)
        at java.lang.invoke.MutableCallSiteDynamicInvokerHandle.invokeExact_thunkArchetype_X(MutableCallSiteDynamicInvokerHandle.java:64)
        at jdk.nashorn.internal.scripts.Script$60$\^eval\_.:program(<eval>:73)
        at java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
        at jdk.nashorn.internal.runtime.ScriptFunctionData.invoke(ScriptFunctionData.java:649)
        at jdk.nashorn.internal.runtime.ScriptFunction.invoke(ScriptFunction.java:506)
        at jdk.nashorn.internal.runtime.ScriptRuntime.apply(ScriptRuntime.java:405)
        at jdk.nashorn.api.scripting.NashornScriptEngine.evalImpl(NashornScriptEngine.java:461)
        at jdk.nashorn.api.scripting.NashornScriptEngine.access$200(NashornScriptEngine.java:85)
        at jdk.nashorn.api.scripting.NashornScriptEngine$3.eval(NashornScriptEngine.java:522)
        at javax.script.CompiledScript.eval(CompiledScript.java:117)
        at com.ibm.octane.test.Octane.runTest(Octane.java:166)
        at com.ibm.octane.test.Octane.runAllTests(Octane.java:114)
        at com.ibm.octane.test.Octane.main(Octane.java:59)
0xdaryl commented 3 years ago

Some progress is being made but a fix won't be likely for 0.26. Moving out.

pshipton commented 3 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk8_j9_sanity.openjdk_x86-64_mac_Nightly/304 sun/misc/URLClassPath/ClassnameCharTest.java

22:31:52  STDERR:
22:31:52  java.lang.BootstrapMethodError: java.lang.NullPointerException
22:31:52    at sun.net.www.protocol.http.HttpURLConnection.getNetProperty(HttpURLConnection.java:215)
22:31:52    at sun.net.www.protocol.http.HttpURLConnection.<clinit>(HttpURLConnection.java:247)
22:31:52    at sun.net.www.protocol.http.Handler.openConnection(Handler.java:62)
22:31:52    at sun.net.www.protocol.http.Handler.openConnection(Handler.java:57)
22:31:52    at java.net.URL.openConnection(URL.java:1002)
22:31:52    at sun.applet.AppletClassLoader.getBytes(AppletClassLoader.java:319)
22:31:52    at sun.applet.AppletClassLoader.access$100(AppletClassLoader.java:64)
22:31:52    at sun.applet.AppletClassLoader$1.run(AppletClassLoader.java:206)
22:31:52    at java.security.AccessController.doPrivileged(AccessController.java:774)
22:31:52    at sun.applet.AppletClassLoader.findClass(AppletClassLoader.java:196)
22:31:52    at ClassnameCharTest$MyAppletClassLoader.findClass(ClassnameCharTest.java:99)
22:31:52    at ClassnameCharTest.realMain(ClassnameCharTest.java:81)
22:31:52    at ClassnameCharTest.main(ClassnameCharTest.java:152)
22:31:52    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
22:31:52    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
22:31:52    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
22:31:52    at java.lang.reflect.Method.invoke(Method.java:498)
22:31:52    at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:312)
22:31:52    at java.lang.Thread.run(Thread.java:823)
22:31:52  Caused by: java.lang.NullPointerException
22:31:52    at java.lang.invoke.InnerClassLambdaMetafactory.buildCallSite(InnerClassLambdaMetafactory.java:226)
22:31:52    at java.lang.invoke.LambdaMetafactory.metafactory(LambdaMetafactory.java:304)
22:31:52    at java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
22:31:52    at java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
22:31:52    at java.lang.invoke.MethodHandleResolver.invokeBsm(MethodHandleResolver.java:113)
22:31:52    at java.lang.invoke.MethodHandleResolver.resolveInvokeDynamic(MethodHandleResolver.java:164)
22:31:52    ... 19 more
22:31:52  java.lang.AssertionError: Some tests failed
22:31:52    at ClassnameCharTest.main(ClassnameCharTest.java:158)
22:31:52    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
22:31:52    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
22:31:52    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
22:31:52    at java.lang.reflect.Method.invoke(Method.java:498)
22:31:52    at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:312)
22:31:52    at java.lang.Thread.run(Thread.java:823)
pshipton commented 3 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_x86-64_mac_Nightly/293 java/lang/Double/ParseHexFloatingPoint.java.ParseHexFloatingPoint java/lang/Double/ToHexString.java.ToHexString java/lang/Float/ParseFloat.java.ParseFloat java/lang/Integer/BitTwiddle.java.BitTwiddle java/lang/Integer/Unsigned.java.Unsigned java/lang/invoke/lambda/MetafactoryDescriptorTest.java.MetafactoryDescriptorTest

23:39:05  java.lang.BootstrapMethodError: java.lang.invoke.StringConcatException: Generator failed
23:39:05    at ParseHexFloatingPoint.significandAlignmentTests(ParseHexFloatingPoint.java:322)
23:39:05    at ParseHexFloatingPoint.doubleTests(ParseHexFloatingPoint.java:258)
23:39:05    at ParseHexFloatingPoint.main(ParseHexFloatingPoint.java:439)
23:39:05    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
23:39:05    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
23:39:05    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
23:39:05    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
23:39:05    at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:312)
23:39:05    at java.base/java.lang.Thread.run(Thread.java:836)
23:39:05  Caused by: java.lang.invoke.StringConcatException: Generator failed
23:39:05    at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:764)
23:39:05    at java.base/java.lang.invoke.StringConcatFactory.doStringConcat(StringConcatFactory.java:665)
23:39:05    at java.base/java.lang.invoke.StringConcatFactory.makeConcatWithConstants(StringConcatFactory.java:581)
23:39:05    at java.base/java.lang.invoke.DirectHandle.invokeExact_thunkArchetype_L(DirectHandle.java:302)
23:39:05    at java.base/java.lang.invoke.CollectHandle.invokeExact_thunkArchetype_X(CollectHandle.java:130)
23:39:05    at java.base/java.lang.invoke.AsTypeHandle.invokeExact_thunkArchetype_X(AsTypeHandle.java:49)
23:39:05    at java.base/java.lang.invoke.MethodHandleResolver.invokeBsm(MethodHandleResolver.java:176)
23:39:05    at java.base/java.lang.invoke.MethodHandleResolver.resolveInvokeDynamic(MethodHandleResolver.java:238)
23:39:05    ... 9 more
23:39:05  Caused by: java.lang.NullPointerException
23:39:05    at java.base/java.lang.invoke.BruteArgumentMoverHandle.permuteArguments(BruteArgumentMoverHandle.java:286)
23:39:05    at java.base/java.lang.invoke.MethodHandles.dropArgumentsUnsafe(MethodHandles.java:2946)
23:39:05    at java.base/java.lang.invoke.MethodHandles.dropArguments(MethodHandles.java:2963)
23:39:05    at java.base/java.lang.invoke.StringConcatFactory$MethodHandleInlineCopyStrategy.generate(StringConcatFactory.java:1536)
23:39:05    at java.base/java.lang.invoke.StringConcatFactory.generate(StringConcatFactory.java:756)
pshipton commented 3 years ago

https://ci.eclipse.org/openj9/job/Test_openjdk11_j9_sanity.openjdk_x86-64_linux_Nightly/348 jdk_util_1 java/util/ResourceBundle/getBaseBundleName/TestGetBaseBundleName.java java/util/ResourceBundle/modules/layer/LayerTest.java java/util/ResourceBundle/modules/unnamed/UnNamedTest.java java/util/regex/RegExTest.java