search

eclipse-openj9 / openj9

Eclipse OpenJ9: A Java Virtual Machine for OpenJDK that's optimized for small footprint, fast start-up, and high throughput. Builds on Eclipse OMR (https://github.com/eclipse/omr) and combines with the Extensions for OpenJDK for OpenJ9 repo.
Other
3.28k stars 721 forks source link

JTreg test fail : java/util/stream/test/org/openjdk/tests/java/util/stream/ToArrayOpTest.java #3447

Open ben-walsh opened 6 years ago

ben-walsh commented 6 years ago

Test https://github.com/ibmruntimes/openj9-openjdk-jdk11/blob/openj9/test/jdk/java/util/stream/test/org/openjdk/tests/java/util/stream/ToArrayOpTest.java fails a varying number of sub-tests with exceptions of the form ...

test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):empty", java.util.stream.TestData$AbstractTestData$RefTestData@2b44b05c): failure
java.lang.AssertionError: expected [class [Ljava.lang.Integer;] but found [class [Ljava.lang.Integer;]
    at org.testng.Assert.fail(Assert.java:94)
    at org.testng.Assert.failNotEquals(Assert.java:496)
    at org.testng.Assert.assertArrayEquals(Assert.java:157)
    at org.testng.Assert.assertEquals(Assert.java:119)
    at org.testng.Assert.assertEquals(Assert.java:167)
    at org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations(ToArrayOpTest.java:113)
    at jdk.internal.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:85)
    at org.testng.internal.Invoker.invokeMethod(Invoker.java:639)
    at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:821)
    at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1131)
    at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
    at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:108)
    at org.testng.TestRunner.privateRun(TestRunner.java:773)
    at org.testng.TestRunner.run(TestRunner.java:623)
    at org.testng.SuiteRunner.runTest(SuiteRunner.java:357)
    at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:352)
    at org.testng.SuiteRunner.privateRun(SuiteRunner.java:310)
    at org.testng.SuiteRunner.run(SuiteRunner.java:259)
    at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
    at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
    at org.testng.TestNG.runSuitesSequentially(TestNG.java:1185)
    at org.testng.TestNG.runSuitesLocally(TestNG.java:1110)
    at org.testng.TestNG.run(TestNG.java:1018)
    at com.sun.javatest.regtest.agent.TestNGRunner.main(TestNGRunner.java:94)
    at com.sun.javatest.regtest.agent.TestNGRunner.main(TestNGRunner.java:54)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    at com.sun.javatest.regtest.agent.MainWrapper$MainThread.run(MainWrapper.java:115)
    at java.base/java.lang.Thread.run(Thread.java:825)

I see no difference between the expected class and actual class in any of the failures.

Log archive : ToArrayOpProb.tar.gz

These example three consecutive runs illustrate the variability of these strange failures ...

test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:0..1000", RefTestData[HashSet:0..1000]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:0..1000", java.util.stream.TestData$AbstractTestData$RefTestData@50c11889): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:0..1000", RefTestData[TreeSet:0..1000]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:0..1000", java.util.stream.TestData$AbstractTestData$RefTestData@7f2c2735): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:0..100", RefTestData[array:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@95265e27): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:0..100", RefTestData[ArrayList:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):0..100", java.util.stream.TestData$AbstractTestData$RefTestData@1c934636): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@62558cf6): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:0..100", RefTestData[LinkedList:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:0..100", RefTestData[HashSet:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@5146a7a1): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:0..100", RefTestData[TreeSet:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@3f6eea05): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:100x[1]", RefTestData[array:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@a28b8bd0): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:100x[1]", RefTestData[ArrayList:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@fd1b410c): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@7706a946): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@6268dab3): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:100x[1]", RefTestData[HashSet:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@ec594cd): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:100x[1]", RefTestData[TreeSet:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@5e01907a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:2x[0..100]", RefTestData[array:2x[0..100]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@66e33e1): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@b268de90): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@acfd29ff): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@cd394b37): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@906288c5): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@ef06573): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@eff5f946): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@14f5887a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@7e490d46): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@6c703334): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@cb0d22c3): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@11f58f3a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@ab86028c): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@d0f418d7): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@a56fdd64): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@a881c763): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@ca7a80b7): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@fb48b70e): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@ea1d96bb): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@53239681): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@99906ac7): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@4a923248): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@af35685d): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@a5157f2c): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@dd96e1d4): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@6d9e2401): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@9b9d6798): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@2e844144): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@257e562e): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:empty", RefTestData[array:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:empty", java.util.stream.TestData$AbstractTestData$RefTestData@bf5150a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:empty", RefTestData[ArrayList:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):empty", java.util.stream.TestData$AbstractTestData$RefTestData@b268cf06): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:empty", java.util.stream.TestData$AbstractTestData$RefTestData@4be27f24): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:empty", RefTestData[LinkedList:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:empty", RefTestData[HashSet:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:empty", java.util.stream.TestData$AbstractTestData$RefTestData@55fb8958): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:empty", RefTestData[TreeSet:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:empty", java.util.stream.TestData$AbstractTestData$RefTestData@2dd4843a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:0..1", RefTestData[array:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@8f7c5603): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:0..1", RefTestData[ArrayList:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):0..1", java.util.stream.TestData$AbstractTestData$RefTestData@24bb565e): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@de67d302): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:0..1", RefTestData[LinkedList:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:0..1", RefTestData[HashSet:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@a9c8d4cb): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:0..1", RefTestData[TreeSet:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:0..1", RefTestData[SpinedBuffer:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:0..10", RefTestData[array:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@3d77dfb3): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:0..10", RefTestData[ArrayList:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):0..10", java.util.stream.TestData$AbstractTestData$RefTestData@6421274): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@8eda7fd2): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:0..10", RefTestData[LinkedList:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:0..10", RefTestData[HashSet:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@b55acdce): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:0..10", RefTestData[TreeSet:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@7196fa6f): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:0..1000", java.util.stream.TestData$AbstractTestData$RefTestData@50c11889): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:0..1000", RefTestData[TreeSet:0..1000]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:0..1000", java.util.stream.TestData$AbstractTestData$RefTestData@7f2c2735): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:0..100", RefTestData[array:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@95265e27): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:0..100", RefTestData[ArrayList:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):0..100", java.util.stream.TestData$AbstractTestData$RefTestData@1c934636): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@62558cf6): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:0..100", RefTestData[LinkedList:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:0..100", RefTestData[HashSet:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@5146a7a1): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:0..100", RefTestData[TreeSet:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@3f6eea05): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:100x[1]", RefTestData[array:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@a28b8bd0): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:100x[1]", RefTestData[ArrayList:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@fd1b410c): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@7706a946): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@6268dab3): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:100x[1]", RefTestData[HashSet:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@ec594cd): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:100x[1]", RefTestData[TreeSet:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@5e01907a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:2x[0..100]", RefTestData[array:2x[0..100]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@66e33e1): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@b268de90): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@acfd29ff): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@cd394b37): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@906288c5): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@ef06573): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@eff5f946): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@14f5887a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@7e490d46): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@6c703334): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@cb0d22c3): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@11f58f3a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@ab86028c): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@d0f418d7): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@a56fdd64): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@a881c763): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@ca7a80b7): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@fb48b70e): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@ea1d96bb): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@53239681): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@99906ac7): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@4a923248): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@af35685d): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@a5157f2c): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@dd96e1d4): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@6d9e2401): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@9b9d6798): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@2e844144): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@257e562e): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:empty", RefTestData[array:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:empty", java.util.stream.TestData$AbstractTestData$RefTestData@bf5150a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:empty", RefTestData[ArrayList:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):empty", java.util.stream.TestData$AbstractTestData$RefTestData@b268cf06): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:empty", java.util.stream.TestData$AbstractTestData$RefTestData@4be27f24): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:empty", RefTestData[LinkedList:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:empty", RefTestData[HashSet:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:empty", java.util.stream.TestData$AbstractTestData$RefTestData@55fb8958): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:empty", RefTestData[TreeSet:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:empty", java.util.stream.TestData$AbstractTestData$RefTestData@2dd4843a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:0..1", RefTestData[array:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@8f7c5603): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:0..1", RefTestData[ArrayList:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):0..1", java.util.stream.TestData$AbstractTestData$RefTestData@24bb565e): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@de67d302): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:0..1", RefTestData[LinkedList:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:0..1", RefTestData[HashSet:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@a9c8d4cb): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:0..1", RefTestData[TreeSet:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:0..1", RefTestData[SpinedBuffer:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:0..10", RefTestData[array:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@3d77dfb3): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:0..10", RefTestData[ArrayList:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):0..10", java.util.stream.TestData$AbstractTestData$RefTestData@6421274): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@8eda7fd2): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:0..10", RefTestData[LinkedList:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:0..10", RefTestData[HashSet:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@b55acdce): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:0..10", RefTestData[TreeSet:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@7196fa6f): failure
test result: Failed. Execution failed: `main' threw exception: java.lang.Exception: failures: 167
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:0..1000", RefTestData[HashSet:0..1000]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:0..1000", java.util.stream.TestData$AbstractTestData$RefTestData@54a5dd4f): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:0..1000", RefTestData[TreeSet:0..1000]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:0..1000", java.util.stream.TestData$AbstractTestData$RefTestData@35262933): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:0..100", RefTestData[array:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@e1b2d75c): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:0..100", RefTestData[ArrayList:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):0..100", java.util.stream.TestData$AbstractTestData$RefTestData@1adacd51): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@b815c324): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:0..100", RefTestData[LinkedList:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:0..100", RefTestData[HashSet:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@76997d1): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:0..100", RefTestData[TreeSet:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@10c6a20a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:100x[1]", RefTestData[array:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@948d51a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:100x[1]", RefTestData[ArrayList:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@9aff1666): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@b69ea23e): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@d9756ac3): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:100x[1]", RefTestData[HashSet:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@a7a6fabb): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:100x[1]", RefTestData[TreeSet:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@24d8696a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:2x[0..100]", RefTestData[array:2x[0..100]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@67025cd): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@9ea10b1e): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@b5edbdee): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@2dee2106): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@b80c24e0): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@ba60cbc0): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@be561792): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@24b993e4): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@e94aad95): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@9931c37): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@ddea90ec): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@7ccc8846): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@a1d4d2c2): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@685cdc50): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@ec963bf7): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@dc83ec66): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@31530ff1): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@50982c97): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@5f11e990): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@d5ab1678): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@3926e279): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@b6d00849): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@8e6a4bf2): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@367039ff): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@3e402a6b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@8e93c3d8): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@29a8c588): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@3cb3603a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@dd9e76f4): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:empty", RefTestData[array:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:empty", java.util.stream.TestData$AbstractTestData$RefTestData@81ad4b76): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:empty", RefTestData[ArrayList:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):empty", java.util.stream.TestData$AbstractTestData$RefTestData@15a6741b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:empty", java.util.stream.TestData$AbstractTestData$RefTestData@6b362477): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:empty", RefTestData[LinkedList:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:empty", RefTestData[HashSet:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:empty", java.util.stream.TestData$AbstractTestData$RefTestData@376cf877): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:empty", RefTestData[TreeSet:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:empty", java.util.stream.TestData$AbstractTestData$RefTestData@4b4a4b39): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:0..1", RefTestData[array:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@33222c0): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:0..1", RefTestData[ArrayList:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):0..1", java.util.stream.TestData$AbstractTestData$RefTestData@7ba4213b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@a1d006b4): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:0..1", RefTestData[LinkedList:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:0..1", RefTestData[HashSet:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@3ada116b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:0..1", RefTestData[TreeSet:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:0..1", RefTestData[SpinedBuffer:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:0..10", RefTestData[array:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@20e5c83e): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:0..10", RefTestData[ArrayList:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):0..10", java.util.stream.TestData$AbstractTestData$RefTestData@ca79ce05): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@996236e1): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:0..10", RefTestData[LinkedList:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:0..10", RefTestData[HashSet:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@ffa8a3df): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:0..10", RefTestData[TreeSet:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@74369231): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@9931c37): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@ddea90ec): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@7ccc8846): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@a1d4d2c2): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@685cdc50): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@ec963bf7): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@dc83ec66): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@31530ff1): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@50982c97): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@5f11e990): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@d5ab1678): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@3926e279): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@b6d00849): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@8e6a4bf2): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@367039ff): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@3e402a6b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@8e93c3d8): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@29a8c588): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@3cb3603a): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@dd9e76f4): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:empty", RefTestData[array:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:empty", java.util.stream.TestData$AbstractTestData$RefTestData@81ad4b76): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:empty", RefTestData[ArrayList:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):empty", java.util.stream.TestData$AbstractTestData$RefTestData@15a6741b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:empty", java.util.stream.TestData$AbstractTestData$RefTestData@6b362477): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:empty", RefTestData[LinkedList:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:empty", RefTestData[HashSet:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:empty", java.util.stream.TestData$AbstractTestData$RefTestData@376cf877): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:empty", RefTestData[TreeSet:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:empty", java.util.stream.TestData$AbstractTestData$RefTestData@4b4a4b39): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:0..1", RefTestData[array:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@33222c0): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:0..1", RefTestData[ArrayList:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):0..1", java.util.stream.TestData$AbstractTestData$RefTestData@7ba4213b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@a1d006b4): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:0..1", RefTestData[LinkedList:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:0..1", RefTestData[HashSet:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@3ada116b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:0..1", RefTestData[TreeSet:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:0..1", RefTestData[SpinedBuffer:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:0..10", RefTestData[array:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@20e5c83e): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:0..10", RefTestData[ArrayList:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):0..10", java.util.stream.TestData$AbstractTestData$RefTestData@ca79ce05): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@996236e1): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:0..10", RefTestData[LinkedList:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:0..10", RefTestData[HashSet:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@ffa8a3df): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:0..10", RefTestData[TreeSet:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@74369231): failure
test result: Failed. Execution failed: `main' threw exception: java.lang.Exception: failures: 134
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):0..1000", java.util.stream.TestData$AbstractTestData$RefTestData@ce0dd37d): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:0..1000", java.util.stream.TestData$AbstractTestData$RefTestData@ae4c393e): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:0..1000", java.util.stream.TestData$AbstractTestData$RefTestData@6ee7580): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:0..1000", RefTestData[HashSet:0..1000]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:0..1000", java.util.stream.TestData$AbstractTestData$RefTestData@142ce329): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:0..1000", RefTestData[TreeSet:0..1000]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:0..1000", java.util.stream.TestData$AbstractTestData$RefTestData@a46f8b16): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:0..100", RefTestData[array:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@3d5ddb65): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:0..100", RefTestData[ArrayList:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):0..100", java.util.stream.TestData$AbstractTestData$RefTestData@de95bdaa): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@d057bbf5): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:0..100", RefTestData[LinkedList:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:0..100", RefTestData[HashSet:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@403b1109): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:0..100", RefTestData[TreeSet:0..100]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:0..100", java.util.stream.TestData$AbstractTestData$RefTestData@f19db2c8): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:100x[1]", RefTestData[array:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@9657c2aa): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:100x[1]", RefTestData[ArrayList:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@885c7): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@cf60acbf): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@cd1a0fc1): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:100x[1]", RefTestData[HashSet:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@d3846d34): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:100x[1]", RefTestData[TreeSet:100x[1]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:100x[1]", java.util.stream.TestData$AbstractTestData$RefTestData@a1fca0e6): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:2x[0..100]", RefTestData[array:2x[0..100]]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@5c70e277): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@8b8836f6): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@36a51a9b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@6c15a63f): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@9097facd): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@f490aa31): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@499b7362): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@3f283d01): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:2x[0..100]", java.util.stream.TestData$AbstractTestData$RefTestData@cf702069): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@a2c82df8): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@fc609d30): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@c353ee10): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@6371afd5): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@7ea95ed4): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@7a93b1b2): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@c0e7965b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@983e0f0d): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@a646d00d): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@18b623c): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@54dc1ede): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@6759c90d): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@b2a58398): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@204ed3f6): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@a42eab): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@4bf1216b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@f126b6b5): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@77176b2c): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@234ebb19): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@6e94693d): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:empty", RefTestData[array:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:empty", java.util.stream.TestData$AbstractTestData$RefTestData@7b39f731): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:empty", RefTestData[ArrayList:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):empty", java.util.stream.TestData$AbstractTestData$RefTestData@2dbe198f): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:empty", java.util.stream.TestData$AbstractTestData$RefTestData@f9097233): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:empty", RefTestData[LinkedList:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:empty", RefTestData[HashSet:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:empty", java.util.stream.TestData$AbstractTestData$RefTestData@855ced44): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:empty", RefTestData[TreeSet:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:empty", java.util.stream.TestData$AbstractTestData$RefTestData@cdf097cd): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:0..1", RefTestData[array:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@21f6f5d8): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:0..1", RefTestData[ArrayList:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):0..1", java.util.stream.TestData$AbstractTestData$RefTestData@c01d8d9d): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@aad04a08): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:0..1", RefTestData[LinkedList:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:0..1", RefTestData[HashSet:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@c5655984): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:0..1", RefTestData[TreeSet:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:0..1", RefTestData[SpinedBuffer:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("array:0..10", RefTestData[array:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.asList:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@97e3ffd7): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList:0..10", RefTestData[ArrayList:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("DelegatingStream(ArrayList):0..10", java.util.stream.TestData$AbstractTestData$RefTestData@fdb83d98): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("ArrayList.Sublist:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@9cb6f42b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedList:0..10", RefTestData[LinkedList:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("HashSet:0..10", RefTestData[HashSet:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("LinkedHashSet:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@6b596247): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("TreeSet:0..10", RefTestData[TreeSet:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testDistinctAndSortedPermutations("SpinedBuffer:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@cc9a5323): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@fc609d30): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@c353ee10): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@6371afd5): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@7ea95ed4): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@7a93b1b2): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@c0e7965b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@983e0f0d): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@a646d00d): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:reverse 0..100", java.util.stream.TestData$AbstractTestData$RefTestData@18b623c): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@54dc1ede): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@6759c90d): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@b2a58398): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@204ed3f6): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@a42eab): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@4bf1216b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@f126b6b5): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@77176b2c): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@234ebb19): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:pseudorandom", java.util.stream.TestData$AbstractTestData$RefTestData@6e94693d): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:empty", RefTestData[array:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:empty", java.util.stream.TestData$AbstractTestData$RefTestData@7b39f731): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:empty", RefTestData[ArrayList:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):empty", java.util.stream.TestData$AbstractTestData$RefTestData@2dbe198f): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:empty", java.util.stream.TestData$AbstractTestData$RefTestData@f9097233): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:empty", RefTestData[LinkedList:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:empty", RefTestData[HashSet:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:empty", java.util.stream.TestData$AbstractTestData$RefTestData@855ced44): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:empty", RefTestData[TreeSet:empty]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:empty", java.util.stream.TestData$AbstractTestData$RefTestData@cdf097cd): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:0..1", RefTestData[array:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@21f6f5d8): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:0..1", RefTestData[ArrayList:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):0..1", java.util.stream.TestData$AbstractTestData$RefTestData@c01d8d9d): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@aad04a08): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:0..1", RefTestData[LinkedList:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:0..1", RefTestData[HashSet:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:0..1", java.util.stream.TestData$AbstractTestData$RefTestData@c5655984): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:0..1", RefTestData[TreeSet:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:0..1", RefTestData[SpinedBuffer:0..1]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("array:0..10", RefTestData[array:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.asList:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@97e3ffd7): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList:0..10", RefTestData[ArrayList:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("DelegatingStream(ArrayList):0..10", java.util.stream.TestData$AbstractTestData$RefTestData@fdb83d98): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("ArrayList.Sublist:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@9cb6f42b): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedList:0..10", RefTestData[LinkedList:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("HashSet:0..10", RefTestData[HashSet:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("LinkedHashSet:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@6b596247): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("TreeSet:0..10", RefTestData[TreeSet:0..10]): failure
test org.openjdk.tests.java.util.stream.ToArrayOpTest.testStatefulOpPermutations("SpinedBuffer:0..10", java.util.stream.TestData$AbstractTestData$RefTestData@cc9a5323): failure
test result: Failed. Execution failed: `main' threw exception: java.lang.Exception: failures: 136

Test passes against Hotspot.

ben-walsh commented 6 years ago

Five consecutive runs of the test with the -Xint JVM option showed no faliures whatsoever. However, the test took considerably longer to complete, as would be expected.

Log archive of one such successful run : ToArrayOpXInt.tar.gz

smlambert commented 5 years ago

Test excluded: https://github.com/AdoptOpenJDK/openjdk-tests/pull/661