search

adoptium / aqa-tests

Home of test infrastructure for Adoptium builds
https://adoptium.net/aqavit
Apache License 2.0
127 stars 306 forks source link

System tests Overview #4453

Open llxia opened 1 year ago

llxia commented 1 year ago

We would like to go over our existing system tests and understand what we are running:

This exercise is related to the feature: Off-Heap Technology for Large Arrays in Region-Based Garbage Collector. We may need to add long-running tests for balanced GC with different heap sizes.

Modes: https://github.com/adoptium/TKG/blob/master/resources/modes.xml

Mesbah-Alam commented 1 year ago
Test Mode GC Policy + other jvm opts used Load Heap size duration Impl platform Description
DaaLoadTest_daa1_5m Mode110,Mode610 -Xgcpolicy:gencon DAA1 load 5m OpenJ9, IBM all DAA is a Math's library that comes with IBM's sdk, its aim is to boost Math's performance, specially for z/OS based systems. This library is particularly useful to allow JIT optimisation on legacy programs such as COBOL that contain native data structures (e.g. Packed Decimal) that wouldn't otherwise be exploited by the JIT. DAA1, DAA2, DAA3 and DAA_all are a varied mix of test cases used to verify that the IBM Data Access Accelerator API functions work correctly in a load environment.
DaaLoadTest_daa2_5m Mode110,Mode610 -Xgcpolicy:gencon DAA2 load 5m OpenJ9, IBM all
DaaLoadTest_daa3_5m Mode110,Mode610 -Xgcpolicy:gencon DAA3 load 5m OpenJ9, IBM all
DaaLoadTest_all_5m Mode110,Mode610 -Xgcpolicy:gencon DAA_All load 5m OpenJ9, IBM all
DaaLoadTest_daa1_CS_5m N/A -Xgcpolicy:gencon -Xgc:concurrentScavenge
DaaLoadTest_daa2_CS_5m N/A -Xgcpolicy:gencon -Xgc:concurrentScavenge 5m OpenJ9, IBM bits.64,^arch.arm
DaaLoadTest_daa3_CS_5m N/A -Xgcpolicy:gencon -Xgc:concurrentScavenge 5m OpenJ9, IBM bits.64,^arch.arm
DaaLoadTest_all_CS_5m N/A -Xgcpolicy:gencon -Xgc:concurrentScavenge 5m OpenJ9, IBM bits.64,^arch.arm
DaaLoadTest_daa1_special_5m Mode101, Mode103, Mode104, Mode107, Mode112, Mode113, Mode121, Mode122, Mode145, Mode187, Mode301, Mode351, Mode501, Mode551, Mode553, Mode554, Mode555, Mode556, Mode557, Mode607, Mode614, Mode615, Mode687, Mode688, Mode107-OSRG, Mode110-OSRG, Mode610-OSRG, Mode612-OSRG, Mode645, -Xgcpolicy:gencon -Xgc:dynamicBreadthFirstScanOrdering -Xgcpolicy:optthruput modes: {101, 103, 104, 107, 607, 107-OSRG}. -Xgcpolicy:gencon modes: {112, 113, 145, 614, 615, 687, 688, 110-OSRG, 610-OSRG, 612-OSRG, 645}. -Xgcpolicy:optavgpause modes: {121, 122, 187}. -Xgcpolicy:metronome modes {301, 351}. -Xgcpolicy:balanced modes: {501, 551, 553, 554, 555, 556, 557}. Details in modes.xml. 5m OpenJ9, IBM
DaaLoadTest_daa2_special_5m Mode101, Mode103, Mode104, Mode107, Mode112, Mode113, Mode121, Mode122, Mode145, Mode187, Mode301, Mode351, Mode501, Mode551, Mode553, Mode554, Mode555, Mode556, Mode557, Mode607, Mode614, Mode615, Mode687, Mode688, Mode107-OSRG, Mode110-OSRG, Mode610-OSRG, Mode612-OSRG, Mode645, -Xgcpolicy:gencon -Xgc:dynamicBreadthFirstScanOrdering -Xgcpolicy:optthruput modes: {101, 103, 104, 107, 607, 107-OSRG}. -Xgcpolicy:gencon modes: {112, 113, 145, 614, 615, 687, 688, 110-OSRG, 610-OSRG, 612-OSRG, 645}. -Xgcpolicy:optavgpause modes: {121, 122, 187}. -Xgcpolicy:metronome modes {301, 351}. -Xgcpolicy:balanced modes: {501, 551, 553, 554, 555, 556, 557}. Details in modes.xml. 5m OpenJ9, IBM
DaaLoadTest_daa3_special_5m Mode101, Mode103, Mode104, Mode107, Mode112, Mode113, Mode121, Mode122, Mode145, Mode187, Mode301, Mode351, Mode501, Mode551, Mode553, Mode554, Mode555, Mode556, Mode557, Mode607, Mode614, Mode615, Mode687, Mode688, Mode107-OSRG, Mode110-OSRG, Mode610-OSRG, Mode612-OSRG, Mode645, -Xgcpolicy:gencon -Xgc:dynamicBreadthFirstScanOrdering -Xgcpolicy:optthruput modes: {101, 103, 104, 107, 607, 107-OSRG}. -Xgcpolicy:gencon modes: {112, 113, 145, 614, 615, 687, 688, 110-OSRG, 610-OSRG, 612-OSRG, 645}. -Xgcpolicy:optavgpause modes: {121, 122, 187}. -Xgcpolicy:metronome modes {301, 351}. -Xgcpolicy:balanced modes: {501, 551, 553, 554, 555, 556, 557}. Details in modes.xml. 5m OpenJ9, IBM
DaaLoadTest_daa_all_special_5m Mode101, Mode103, Mode104, Mode107, Mode112, Mode113, Mode121, Mode122, Mode145, Mode187, Mode301, Mode351, Mode501, Mode551, Mode553, Mode554, Mode555, Mode556, Mode557, Mode607, Mode614, Mode615, Mode687, Mode688, Mode107-OSRG, Mode110-OSRG, Mode610-OSRG, Mode612-OSRG, Mode645, -Xgcpolicy:gencon -Xgc:dynamicBreadthFirstScanOrdering -Xgcpolicy:optthruput modes: {101, 103, 104, 107, 607, 107-OSRG}. -Xgcpolicy:gencon modes: {112, 113, 145, 614, 615, 687, 688, 110-OSRG, 610-OSRG, 612-OSRG, 645}. -Xgcpolicy:optavgpause modes: {121, 122, 187}. -Xgcpolicy:metronome modes {301, 351}. -Xgcpolicy:balanced modes: {501, 551, 553, 554, 555, 556, 557}. Details in modes.xml. 5m OpenJ9, IBM
5m OpenJ9, IBM
LambdaLoadTest_HS_5m Mode150, Mode650, Mode1000 No GC option specified lambda load HotSpot The SVT lambda tests are a series of JUnit tests which verify that lambda expressions are working as expected. Details in doc.
LambdaLoadTest_J9_5m Mode110,Mode610 -Xgcpolicy:gencon 5m OpenJ9, IBM all [see
LambdaLoadTest_CS_5m N/A -Xgcpolicy:gencon -Xgc:concurrentScavenge 5m OpenJ9, IBM bits.64
LambdaLoadTest_special_J9_5m Mode101, Mode103, Mode104, Mode107, Mode112, Mode113, Mode121, Mode122, Mode145, Mode187, Mode301, Mode351, Mode501, Mode551, Mode553, Mode554, Mode555, Mode556, Mode557, Mode607, Mode614, Mode615, Mode687, Mode688, Mode107-OSRG, Mode110-OSRG, Mode610-OSRG, Mode612-OSRG, Mode645, -Xgcpolicy:gencon -Xgc:dynamicBreadthFirstScanOrdering -Xgcpolicy:optthruput modes: {101, 103, 104, 107, 607, 107-OSRG}. -Xgcpolicy:gencon modes: {112, 113, 145, 614, 615, 687, 688, 110-OSRG, 610-OSRG, 612-OSRG, 645}. -Xgcpolicy:optavgpause modes: {121, 122, 187}. -Xgcpolicy:metronome modes {301, 351}. -Xgcpolicy:balanced modes: {501, 551, 553, 554, 555, 556, 557}. Details in modes.xml. 5m OpenJ9, IBM
ParallelStreamsLoadTest_HS Mode150, Mode650, Mode1000 No GC option specified parallel streams load HotSpot
ParallelStreamsLoadTest_J9 Mode110,Mode610 -Xgcpolicy:gencon OpenJ9, IBM all
ParallelStreamsLoadTest_CS N/A -Xgcpolicy:gencon -Xgc:concurrentScavenge OpenJ9, IBM bits.64
ParallelStreamsLoadTest_special_J9 Mode101, Mode103, Mode104, Mode107, Mode112, Mode121, Mode122, Mode145, Mode187, Mode301, Mode351, Mode501, Mode551, Mode553, Mode554, Mode555, Mode556, Mode557, Mode607, Mode615, Mode687, Mode688, Mode107-OSRG, Mode110-OSRG, Mode610-OSRG, Mode612-OSRG, Mode645, -Xgcpolicy:gencon -Xgc:dynamicBreadthFirstScanOrdering -Xgcpolicy:optthruput modes: {101, 103, 104, 107, 607, 107-OSRG}. -Xgcpolicy:gencon modes: {112, 113, 145, 614, 615, 687, 688, 110-OSRG, 610-OSRG, 612-OSRG, 645}. -Xgcpolicy:optavgpause modes: {121, 122, 187}. -Xgcpolicy:metronome modes {301, 351}. -Xgcpolicy:balanced modes: {501, 551, 553, 554, 555, 556, 557}. Details in modes.xml. OpenJ9, IBM modes disabled on Win
MathLoadTest_all_5m Mode150, Mode650, Mode1000 No GC option specified math load 5m all all The Math suite contains simple tests which are designed to exercise the Math apis. Details here.
MathLoadTest_autosimd_5m Mode150, Mode650, Mode1000 No GC option specified autosimd load 5m all all
MathLoadTest_bigdecimal_5m Mode150, Mode650, Mode1000 No GC option specified bigdecimal load 5m all all
MathLoadTest_all_CS_5m N/A -Xgcpolicy:gencon -Xgc:concurrentScavenge math load 5m OpenJ9, IBM bits.64,^arch.arm
MathLoadTest_autosimd_CS_5m N/A -Xgcpolicy:gencon -Xgc:concurrentScavenge autosimd load 5m OpenJ9, IBM bits.64,^arch.arm
MathLoadTest_bigdecimal_CS_5m N/A -Xgcpolicy:gencon -Xgc:concurrentScavenge bigdecimal load 5m OpenJ9, IBM bits.64,^arch.arm
MathLoadTest_all_special_5m Mode101, Mode103, Mode104, Mode107, Mode112, Mode113, Mode121, Mode122, Mode145, Mode187, Mode301, Mode351, Mode501, Mode551, Mode553, Mode554, Mode555, Mode556, Mode557, Mode607, Mode614, Mode615, Mode687, Mode688, Mode107-OSRG, Mode110-OSRG, Mode610-OSRG, Mode612-OSRG, Mode645, -Xgcpolicy:gencon -Xgc:dynamicBreadthFirstScanOrdering -Xgcpolicy:optthruput modes: {101, 103, 104, 107, 607, 107-OSRG}. -Xgcpolicy:gencon modes: {112, 113, 145, 614, 615, 687, 688, 110-OSRG, 610-OSRG, 612-OSRG, 645}. -Xgcpolicy:optavgpause modes: {121, 122, 187}. -Xgcpolicy:metronome modes {301, 351}. -Xgcpolicy:balanced modes: {501, 551, 553, 554, 555, 556, 557}. Details in modes.xml. math load 5m OpenJ9, IBM
MathLoadTest_autosimd_special_5m Mode101, Mode103, Mode104, Mode107, Mode112, Mode113, Mode121, Mode122, Mode145, Mode187, Mode301, Mode351, Mode501, Mode551, Mode553, Mode554, Mode555, Mode556, Mode557, Mode607, Mode614, Mode615, Mode687, Mode688, Mode107-OSRG, Mode110-OSRG, Mode610-OSRG, Mode612-OSRG, Mode645, -Xgcpolicy:gencon -Xgc:dynamicBreadthFirstScanOrdering -Xgcpolicy:optthruput modes: {101, 103, 104, 107, 607, 107-OSRG}. -Xgcpolicy:gencon modes: {112, 113, 145, 614, 615, 687, 688, 110-OSRG, 610-OSRG, 612-OSRG, 645}. -Xgcpolicy:optavgpause modes: {121, 122, 187}. -Xgcpolicy:metronome modes {301, 351}. -Xgcpolicy:balanced modes: {501, 551, 553, 554, 555, 556, 557}. Details in modes.xml. autosimd load 5m OpenJ9, IBM
MathLoadTest_bigdecimal_special_5m Mode101, Mode103, Mode104, Mode107, Mode112, Mode113, Mode121, Mode122, Mode145, Mode187, Mode301, Mode351, Mode501, Mode551, Mode553, Mode554, Mode555, Mode556, Mode557, Mode607, Mode614, Mode615, Mode687, Mode688, Mode107-OSRG, Mode110-OSRG, Mode610-OSRG, Mode612-OSRG, Mode645, -Xgcpolicy:gencon -Xgc:dynamicBreadthFirstScanOrdering -Xgcpolicy:optthruput modes: {101, 103, 104, 107, 607, 107-OSRG}. -Xgcpolicy:gencon modes: {112, 113, 145, 614, 615, 687, 688, 110-OSRG, 610-OSRG, 612-OSRG, 645}. -Xgcpolicy:optavgpause modes: {121, 122, 187}. -Xgcpolicy:metronome modes {301, 351}. -Xgcpolicy:balanced modes: {501, 551, 553, 554, 555, 556, 557}. Details in modes.xml. bigdecimal load 5m OpenJ9, IBM
MiniMix_5m Mode150, Mode650, Mode1000 No GC option specified mix-more load 5m all Mix of Mauve, bigdecimal, lang, nio, concurrent load tests
MiniMix_aot_5m N/A N/A -Xmx3g -Xms3g 5m all
MiniMix_3h Mode551, Mode110-CS -Xgcpolicy:balanced, -Xgcpolicy:gencon -Xgc:concurrentScavenge' 3h OpenJ9, IBM
ClassLoadingTest_5m Mode150, Mode650, Mode1000 No GC option specified Classloading load 5m all The Classloading suite contains tests which are designed to exercise different aspects of Java classloading. Details here.
ClassLoadingTest_CS_5m -Xgcpolicy:gencon -Xgc:concurrentScavenge 5m all bits.64,^arch.arm
ClassLoadingTest_special_5m Mode101, Mode103, Mode104, Mode107, Mode112, Mode113, Mode121, Mode122, Mode145, Mode187, Mode301, Mode351, Mode501, Mode551, Mode553, Mode554, Mode555, Mode556, Mode557, Mode607, Mode614, Mode615, Mode687, Mode688, Mode107-OSRG, Mode110-OSRG, Mode610-OSRG, Mode612-OSRG, Mode645, -Xgcpolicy:gencon -Xgc:dynamicBreadthFirstScanOrdering -Xgcpolicy:optthruput modes: {101, 103, 104, 107, 607, 107-OSRG}. -Xgcpolicy:gencon modes: {112, 113, 145, 614, 615, 687, 688, 110-OSRG, 610-OSRG, 612-OSRG, 645}. -Xgcpolicy:optavgpause modes: {121, 122, 187}. -Xgcpolicy:metronome modes {301, 351}. -Xgcpolicy:balanced modes: {501, 551, 553, 554, 555, 556, 557}. Details in modes.xml. 5m all
ConcurrentLoadTest_5m Mode150, Mode650, Mode1000 No GC option specified Concurrent load 5m all ConcurrentLoadTest runs concurrency unit tests in a load test environment.
DBBLoadTest_5m Mode150, Mode650, Mode1000 No GC option specified Direct Byte Buffer , nio 5m all ^os.zos The nio tests were written to test this Java NIO API when it was introduced, the nio2 tests were later written when the Java NIO API was extended (from Java 1.7) to cover new functionality, the most significant being asynchronous I/O.The Direct Byte Buffer load test allocates direct memory ByteBuffers and dereferences them. Details here.
LockingLoadTest Mode150, Mode650, Mode1000 No GC option specified Locking, mini-mix The Locker test was created to exercise lock contention against String and array objects.
NioLoadTest_5m Mode150, Mode650, Mode1000 No GC option specified nio load 5m all ^arch.arm,^os.zos The nio tests were written to test this Java NIO API when it was introduced, the nio2 tests were later written when the Java NIO API was extended (from Java 1.7) to cover new functionality, the most significant being asynchronous I/O.
UtilLoadTest_5m Mode150, Mode650, Mode1000 No GC option specified util 5m all
HCRLateAttachWorkload Mode150, Mode650, Mode1000 No GC option specified Runs mixed load of lang, util and math all (JDK 8 only) The HCRLoadTest runs a mixture of different unit tests repeatedly. Shortly after that process starts, we launch another one to late-attach a javaagent to the first process. This agent makes rapid, repeated changes to the java.lang.String class in the form of new method calls added into existing methods. These changes should not cause any change in behaviour, barring defects.
HCRLateAttachWorkload_previewEnabled Mode150, Mode650, Mode1000 No GC option specified all (JDK 11+)
HeapHogLoadTest_5m Mode110,Mode610 -Xgcpolicy:gencon + -Xdisableexcessivegc HeapHog 5m OpenJ9, IBM This test is designed to fill the heap but leave a specified space, rather than fill a specified space. Should allow the heap to be quickly filled to allow the testing of large heaps.
ObjectTreeLoadTest_5m Mode110,Mode610 -Xgcpolicy:gencon + -Xnoclassgc ObjectTree 5m OpenJ9, IBM The ObjectTree test class creates a large object tree and fills up the memory over time.
SharedClassesAPI Mode110,Mode610 -Xgcpolicy:gencon Runs a mix of lang, util and math loads OpenJ9, IBM The test plugin runs a set of tests that use various combinations of shared classes options and cache locations, the tests are then repeated for each API type (Java or JVMTI). The Java API is accessed through the package com.ibm.oti.shared via the SharedClassesCacheChecker class and the native API is available as JVMTI extension functions. Each test starts multiple JVMs running a small mini-mix workload connecting to multiple shared classes caches and later starts another JVM to query/delete the caches using either the Java API or the JVMTI API. 
SharedClassesWorkload Mode110,Mode610 -Xgcpolicy:gencon Runs a mix of lang, util and math loads OpenJ9, IBM  Runs a workload with shared classes creating a named cache in the results directory Checks that a cache was created. Does another workload run using this named cache. Checks no other caches exist. Deletes the cache. Does two sequential workload runs, with multiple JVM instances in each run, creating and using a common cache. Checks that only one cache was created. Deletes the cache.
SC_Softmx_Increase Mode110,Mode610 -Xgcpolicy:gencon OpenJ9, IBM Starts Jvm1 that sets softmx to say 1mb and shared cache hard limit to say 20mb. Jvm1 fills up cache, Jvm2 will check if cache's usage has reached softmx, if yes, then Jvm2 will adjust softmx to increased value of e.g. 2mb. Start Jvm3 and continue loading the cache.
SC_Softmx_UpDown Mode110,Mode610 -Xgcpolicy:gencon OpenJ9, IBM Start 2 jvms that write to the cache. Increase cache size so they can complete execution. Decrease the cache size so that further attempts to write to cache fails.
SC_Softmx_JitAot Mode110,Mode610 -Xgcpolicy:gencon OpenJ9, IBM Test if we can write AOT and JIT data even after cache is soft full, as long as we have reserved spaces for JIT and AOT data in the cache.
SharedClasses.SCM01.SingleCL Mode110,Mode610 -Xgcpolicy:gencon + -Xshareclasses:name=${cacheName},cacheDir=${cacheDir}${cacheOperation} One classLoader, loads all classes (20000) in a single jar file. This is the simplest test in the suite, its aim is to populate the cache in the simplest and most obvious way without stressing the classpath caching. OpenJ9, IBM Runs various extremes of classloading, whilst mixing -Xshareclasses options which are either diagnostic in nature or are likely options for customers.
SharedClasses.SCM01.MultiCL Mode110,Mode610 -Xgcpolicy:gencon + -Xshareclasses:name=${cacheName},cacheDir=${cacheDir}${cacheOperation} As above, however a separate classLoader is used to load each class from the jar file. This test introduces multiple classLoaders to stress the classpath caching OpenJ9, IBM
SharedClasses.SCM01.MultiThread Mode110,Mode610 -Xgcpolicy:gencon + -Xshareclasses:name=${cacheName},cacheDir=${cacheDir}${cacheOperation} As “Single Class Loader”, however a thread is forked to load each class file from the jar. This test is aimed at stressing the concurrent access control without being too demanding on the rest of the caching code. OpenJ9, IBM
SharedClasses.SCM01.MultiThreadMultiCL Mode110,Mode610 -Xgcpolicy:gencon + -Xshareclasses:name=${cacheName},cacheDir=${cacheDir}${cacheOperation} As “Multiple Class Loader”, however each classLoader is created in it's own forked thread. The most stressful test for loading classes from a single jar - just a combination of the multiple classloaders and threads to make life difficult OpenJ9, IBM
SharedClasses.SCM23.SingleCL Mode110,Mode610 -Xgcpolicy:gencon + -Xshareclasses:name=${cacheName},cacheDir=${cacheDir}${cacheOperation} -Xaot:forceAoT,count=1 One classLoader, loads all classes (20000) in a single jar file. This is the simplest test in the suite, its aim is to populate the cache in the simplest and most obvious way without stressing the classpath caching. OpenJ9, IBM
SharedClasses.SCM23.MultiCL Mode110,Mode610 -Xgcpolicy:gencon + -Xshareclasses:name=${cacheName},cacheDir=${cacheDir}${cacheOperation} -Xaot:forceAoT,count=1 As above, however a separate classLoader is used to load each class from the jar file. This test introduces multiple classLoaders to stress the classpath caching OpenJ9, IBM
SharedClasses.SCM23.MultiThread Mode110,Mode610 -Xgcpolicy:gencon + -Xshareclasses:name=${cacheName},cacheDir=${cacheDir}${cacheOperation} -Xaot:forceAoT,count=1 As Single Class Loader, however a thread is forked to load each class file from the jar. This test is aimed at stressing the concurrent access control without being too demanding on the rest of the caching code. OpenJ9, IBM
SharedClasses.SCM23.MultiThreadMultiCL Mode110,Mode610 -Xgcpolicy:gencon + -Xshareclasses:name=${cacheName},cacheDir=${cacheDir}${cacheOperation} -Xaot:forceAoT,count=1 As Multiple Class Loader, however each classLoader is created in it's own forked thread. The most stressful test for loading classes from a single jar - just a combination of the multiple classloaders and threads to make life difficult. OpenJ9, IBM
OpenJ9, IBM ^os.osx
MauveSingleThrdLoad_J9_5m Mode110,Mode610 -Xgcpolicy:gencon Mauve-all load 5m The MauveSingleThrdLoad runs a subset of tests from the GNU mauve project. The tests run on a single thread because some of them exercise swing and awt which are not thread safe.
MauveSingleThrdLoad_HS_5m Mode150, Mode650, Mode1000 No GC option specified Mauve-all load 5m Hotspot all
MauveSingleInvocLoad_J9_5m Mode110,Mode610 -Xgcpolicy:gencon Mauve-all load 5m OpenJ9, IBM ^os.osx The tests are run once to identify any issues which do not actually require a load test.
MauveSingleInvocLoad_HS_5m Mode150, Mode650, Mode1000 No GC option specified Mauve-all load 5m Hotspot
MauveMultiThrdLoad_5m Mode150, Mode650, Mode1000 No GC option specified Mauve Multi-thread 5m All The MauveMultiThrdLoad runs a subset of tests from the GNU mauve project. All tests are thread safe.
MauveSingleThrdLoad_CS_5m N/A -Xgcpolicy:gencon -Xgc:concurrentScavenge Mauve-all load 5m OpenJ9, IBM bits.64,^arch.arm
MauveSingleInvocLoad_CS_5m N/A -Xgcpolicy:gencon -Xgc:concurrentScavenge Mauve-all load 5m OpenJ9, IBM bits.64,^arch.arm
MauveMultiThrdLoad_CS_5m N/A -Xgcpolicy:gencon -Xgc:concurrentScavenge Mauve Multi-thread 5m OpenJ9, IBM bits.64,^arch.arm
MauveMultiThrdLoad_special_5m Mode101, Mode103, Mode104, Mode107, Mode112, Mode113, Mode121, Mode122, Mode145, Mode187, Mode301, Mode351, Mode501, Mode551, Mode553, Mode554, Mode555, Mode556, Mode557, Mode607, Mode614, Mode615, Mode687, Mode688, Mode107-OSRG, Mode110-OSRG, Mode610-OSRG, Mode612-OSRG, Mode645, -Xgcpolicy:gencon -Xgc:dynamicBreadthFirstScanOrdering -Xgcpolicy:optthruput modes: {101, 103, 104, 107, 607, 107-OSRG}. -Xgcpolicy:gencon modes: {112, 113, 145, 614, 615, 687, 688, 110-OSRG, 610-OSRG, 612-OSRG, 645}. -Xgcpolicy:optavgpause modes: {121, 122, 187}. -Xgcpolicy:metronome modes {301, 351}. -Xgcpolicy:balanced modes: {501, 551, 553, 554, 555, 556, 557}. Details in modes.xml. Mauve Multi-thread 5m OpenJ9, IBM (JDK 8 only)
MauveSingleThrdLoad_special_5m Mode101, Mode103, Mode104, Mode107, Mode112, Mode113, Mode121, Mode122, Mode145, Mode187, Mode301, Mode351, Mode501, Mode551, Mode553, Mode554, Mode555, Mode556, Mode557, Mode607, Mode614, Mode615, Mode687, Mode688, Mode107-OSRG, Mode110-OSRG, Mode610-OSRG, Mode612-OSRG, Mode645, -Xgcpolicy:gencon -Xgc:dynamicBreadthFirstScanOrdering -Xgcpolicy:optthruput modes: {101, 103, 104, 107, 607, 107-OSRG}. -Xgcpolicy:gencon modes: {112, 113, 145, 614, 615, 687, 688, 110-OSRG, 610-OSRG, 612-OSRG, 645}. -Xgcpolicy:optavgpause modes: {121, 122, 187}. -Xgcpolicy:metronome modes {301, 351}. -Xgcpolicy:balanced modes: {501, 551, 553, 554, 555, 556, 557}. Details in modes.xml. Mauve-all load 5m OpenJ9, IBM (JDK 8 only)
MauveSingleInvocLoad_special_5m Mode101, Mode103, Mode104, Mode107, Mode112, Mode113, Mode121, Mode122, Mode145, Mode187, Mode301, Mode351, Mode501, Mode551, Mode553, Mode554, Mode555, Mode556, Mode557, Mode607, Mode614, Mode615, Mode687, Mode688, Mode107-OSRG, Mode110-OSRG, Mode610-OSRG, Mode612-OSRG, Mode645, -Xgcpolicy:gencon -Xgc:dynamicBreadthFirstScanOrdering -Xgcpolicy:optthruput modes: {101, 103, 104, 107, 607, 107-OSRG}. -Xgcpolicy:gencon modes: {112, 113, 145, 614, 615, 687, 688, 110-OSRG, 610-OSRG, 612-OSRG, 645}. -Xgcpolicy:optavgpause modes: {121, 122, 187}. -Xgcpolicy:metronome modes {301, 351}. -Xgcpolicy:balanced modes: {501, 551, 553, 554, 555, 556, 557}. Details in modes.xml. Mauve-all load 5m OpenJ9, IBM (JDK 8 only)
TestJlmLocal Mode150, Mode650, Mode1000 No GC option specified All Tests java.lang.management where a JVM monitors itself via its platform MBeans using a local connection.
TestJlmRemoteClassAuth Mode150, Mode650, Mode1000 No GC option specified Server runs a mini-mix load test which is a mix of openjdk.test.lang, openjdk.test.util and openjdk.test.math. All ^os.win,^os.zos A java.lang.management system test scenario for class related beans where a 'client' JVM monitors a remote 'server' JVM via the server's platform MBeans with both password file based security and ssl based security enabled.
TestJlmRemoteClassNoAuth Mode150, Mode650, Mode1000 No GC option specified Server runs a mini-mix load test which is a mix of openjdk.test.lang, openjdk.test.util and openjdk.test.math. All A java.lang.management system test scenario for Class related beans where a 'client' JVM monitors a remote 'server' JVM via the server's platform MBeans with ssl security disabled.
TestJlmRemoteMemoryAuth Mode150, Mode650, Mode1000 No GC option specified Server runs a mini-mix load test which is a mix of openjdk.test.lang, openjdk.test.util and openjdk.test.math. All A java.lang.management system test scenario for memory related beans where a 'client' JVM monitors a remote 'server' JVM via the server's platform MBeans with both password file based security and ssl based security enabled.
TestJlmRemoteMemoryNoAuth Mode150, Mode650, Mode1000 No GC option specified Server runs a mini-mix load test which is a mix of openjdk.test.lang, openjdk.test.util and openjdk.test.math. All A java.lang.management system test scenario for memory related beans  where a 'client' JVM monitors a remote 'server' JVM via the server's platform MBeans with ssl security disabled.
TestJlmRemoteNotifierProxyAuth Mode150, Mode650, Mode1000 No GC option specified Server runs a mini-mix load test which is a mix of openjdk.test.lang, openjdk.test.util and openjdk.test.math. All A java.lang.management system test scenario (for memory related beans)  where a 'client' JVM monitors a remote 'server' JVM via server's platform MBeans using a proxy connection with both password file based security and ssl based security enabled.
TestJlmRemoteThreadAuth Mode150, Mode650, Mode1000 No GC option specified Server runs a mini-mix load test which is a mix of openjdk.test.lang, openjdk.test.util and openjdk.test.math. All ^os.win,^os.zos A java.lang.management system test scenario for thread elated beans where a 'client' JVM monitors a remote 'server' JVM via the server's platform MBeans with both password file based security and ssl based security enabled.
TestJlmRemoteThreadNoAuth Mode150, Mode650, Mode1000 No GC option specified Server runs a mini-mix load test which is a mix of openjdk.test.lang, openjdk.test.util and openjdk.test.math. All A java.lang.management system test scenario for Thread related beans where a 'client' JVM monitors a remote 'server' JVM via the server's platform MBeans with ssl security disabled.
TestIBMJlmLocal Mode110,Mode610 -Xgcpolicy:gencon OpenJ9, IBM A com.ibm.lang.management APIs system test scenario where a JVM monitors itself via its platform MBeans using a local connection.
TestIBMJlmRemoteClassAuth Mode110,Mode610 -Xgcpolicy:gencon Server runs a mini-mix load test which is a mix of openjdk.test.lang, openjdk.test.util and openjdk.test.math. OpenJ9, IBM These tests exercise com.ibm.lang.management APIs withn MBeans for a remote JVM using secure proxy and server connections
TestIBMJlmRemoteClassNoAuth Mode110,Mode610 -Xgcpolicy:gencon Server runs a mini-mix load test which is a mix of openjdk.test.lang, openjdk.test.util and openjdk.test.math. OpenJ9, IBM These tests exercise com.ibm.lang.management APIs with MBeans for a remote JVM using non-secure proxy and server connections
TestIBMJlmRemoteMemoryAuth Mode110,Mode610 -Xgcpolicy:gencon Server runs a mini-mix load test which is a mix of openjdk.test.lang, openjdk.test.util and openjdk.test.math. OpenJ9, IBM These tests exercise com.ibm.lang.management APIs with MBeans for a remote JVM using secure proxy and server connections
TestIBMJlmRemoteMemoryNoAuth Mode110,Mode610 -Xgcpolicy:gencon Server runs a mini-mix load test which is a mix of openjdk.test.lang, openjdk.test.util and openjdk.test.math. OpenJ9, IBM These tests exercise com.ibm.lang.management APIs with MBeans for a remote JVM using non-secure proxy and server connections
CpMp_CpMp Mode150, Mode650, Mode1000 No GC option specified All Modularity tests for JDK 9+ Tests various features of modularity
CpMp_MP Mode150, Mode650, Mode1000 No GC option specified All
CpMp2 Mode150, Mode650, Mode1000 No GC option specified All
CpMp3 Mode150, Mode650, Mode1000 No GC option specified All
CpMpModJar Mode150, Mode650, Mode1000 No GC option specified All
CpMpModJar2 Mode150, Mode650, Mode1000 No GC option specified All
CpMpModJar3 Mode150, Mode650, Mode1000 No GC option specified All
InternalAPIs Mode150, Mode650, Mode1000 No GC option specified All
AutoMod1 Mode150, Mode650, Mode1000 No GC option specified All
AutoMod2 Mode150, Mode650, Mode1000 No GC option specified All
AutoMod_Impl1 Mode150, Mode650, Mode1000 No GC option specified All
AutoMod_Impl2 Mode150, Mode650, Mode1000 No GC option specified All
AutoMod_Impl3 Mode150, Mode650, Mode1000 No GC option specified All
SLTest Mode150, Mode650, Mode1000 No GC option specified ^os.zos
PatMod_PlatMod Mode150, Mode650, Mode1000 No GC option specified All
PatMod_AppMod Mode150, Mode650, Mode1000 No GC option specified All
PatMod_Unex Mode150, Mode650, Mode1000 No GC option specified All
PatMod_Adv Mode150, Mode650, Mode1000 No GC option specified All
PatModImg_PlatMod Mode150, Mode650, Mode1000 No GC option specified ^os.zos
PatModImg_AppMod Mode150, Mode650, Mode1000 No GC option specified ^os.zos
PatModImg_Unex Mode150, Mode650, Mode1000 No GC option specified ^os.zos
PatModImg_Adv Mode150, Mode650, Mode1000 No GC option specified ^os.zos
UpgModPath_Exp Mode150, Mode650, Mode1000 No GC option specified All
UpgModPath_ExpImg Mode150, Mode650, Mode1000 No GC option specified ^os.zos
UpgModPath_Jar Mode150, Mode650, Mode1000 No GC option specified All
UpgModPath_JarImg Mode150, Mode650, Mode1000 No GC option specified ^os.zos
Jlink_ReqMod Mode150, Mode650, Mode1000 No GC option specified ^os.zos
Jlink_AddMLimitM Mode150, Mode650, Mode1000 No GC option specified ^os.win,^os.zos
CpMpJlink Mode150, Mode650, Mode1000 No GC option specified ^os.zos
Jlink_GenOpt Mode150, Mode650, Mode1000 No GC option specified All
LayersTest Mode150, Mode650, Mode1000 No GC option specified All
CLTest Mode150, Mode650, Mode1000 No GC option specified All
CLTestImg Mode150, Mode650, Mode1000 No GC option specified ^os.zos
CLLoad Mode150, Mode650, Mode1000 No GC option specified This STF test defines a load test where we drive the modularity class loading junit test class in a multi-threaded fashion.
Jcstress Currently No mode specified No GC option specified Java Concurrency stress tests currently running in dev.system. List of targets here
SyntheticGCWorkload_concurrentSlackAuto_100k_J9 Currently No mode specified -Xmx1g -Xms1g -Xdump:none -Xgcpolicy:gencon -Xnocompactgc -Xgcthreads16 -Xgc:tenureBytesDeviationBoost=0 -Xgc:concurrentKickoffTenuringHeadroom=0 -Xmx1g -Xms1g arch.x86,bits.64,os.linux A Multi-Threaded Tunable Synthetic GC Workload. Details here
SyntheticGCWorkload_concurrentSlackAuto_10M_J9 Currently No mode specified -Xmx1g -Xms1g -Xdump:none -Xgcpolicy:gencon -Xnocompactgc -Xgcthreads16 -Xgc:tenureBytesDeviationBoost=0 -Xgc:concurrentKickoffTenuringHeadroom=0 -Xmx1g -Xms1g arch.x86,bits.64,os.linux Same as above, but run with 10M