search

adoptium / aqa-tests

Home of test infrastructure for Adoptium builds
https://adoptium.net/aqavit
Apache License 2.0
130 stars 308 forks source link

Add TestMemStressAll and TestMultiThread* and 3rd party dependencies #5332

Closed JinhangZhang closed 4 months ago

JinhangZhang commented 4 months ago

This PR aims to solve the issue #5312 which caused by the dependency ,and also add the TestMemStressAll and TestMultiThread* related tests for OpenJCEPlus

JinhangZhang commented 4 months ago

@jasonkatonica FYI

llxia commented 4 months ago

@JinhangZhang Could you update the title and commit message to Add TestMemStressAll and TestMultiThread*? And in the commit message, please reference https://github.com/adoptium/aqa-tests/issues/5312.

Also, will we add TestIntegration in a separate PR? https://github.com/ibmruntimes/OpenJCEPlus/blob/semeru-java11/pom.xml#L384

Please provide testing Grinders for PR.

llxia commented 4 months ago

This PR should be merged with https://github.com/adoptium/TKG/pull/551 together.

JinhangZhang commented 4 months ago

Yes, TestIntegration will be in a separate PR.

Also, will we add TestIntegration in a separate PR? https://github.com/ibmruntimes/OpenJCEPlus/blob/semeru-java11/pom.xml#L384

llxia commented 4 months ago

From what I understand, junit_vintage_engine,junit_platform_suite,junit_jupiter_api,junit_jupiter_engine,junit_jupiter_params,junit_platform_suite_api are jars that are needed for TestIntegration. Why are we adding them to this PR?

JinhangZhang commented 4 months ago

From what I understand, junit_vintage_engine,junit_platform_suite,junit_jupiter_api,junit_jupiter_engine,junit_jupiter_params,junit_platform_suite_api are jars that are needed for TestIntegration. Why are we adding them to this PR?

OpenJCEPlus contains this TestIntegration test in the pom file, we need those jars to compile it. Otherwise, the openjceplus project will not be compiled

JinhangZhang commented 4 months ago

Grinder jobs: https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder_FIPS/1481/ TestAll fails Grinder jobs: https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder_FIPS/1482/ shows the failed cases (TestECDSASignatureInteropSunEC ) which is a known issue right now. Will be fixed soon.

llxia commented 4 months ago

re https://github.com/adoptium/aqa-tests/pull/5332#issuecomment-2122720028, ic, so we will compile TestIntegration now, but enable TestIntegration execution in a separate PR. 3rd party jars are needed for compilation.

llxia commented 4 months ago

I noticed job FAILURE in https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder_FIPS/1481/console

01:24:56.566  ]: The incoming YAML document exceeds the limit: 3145728 code points.

What is the difference between two Grinder runs?

JinhangZhang commented 4 months ago

I noticed job FAILURE in https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder_FIPS/1481/console

01:24:56.566  ]: The incoming YAML document exceeds the limit: 3145728 code points.

What is the difference between two Grinder runs?

1482 only execute the TestAll.java, 1481 runs TestMemStressAll.java, TestMultithread.java, TestMultithreadFIPS.java and TestAll.java. 1482 is only used to demo the failed cases.

llxia commented 4 months ago

shows the failed cases (TestECDSASignatureInteropSunEC ) which is a known issue right now. Will be fixed soon.

Do we have an open issue for this? If so, please provide the link. Thanks

JinhangZhang commented 4 months ago

shows the failed cases (TestECDSASignatureInteropSunEC ) which is a known issue right now. Will be fixed soon.

Do we have an open issue for this? If so, please provide the link. Thanks

The issue link is: jit-crypto/issues/445

llxia commented 4 months ago

Having an issue running https://openj9-jenkins.osuosl.org/job/test.getDependency/. I would prefer to hold this PR until the 3rd party libs are downloaded on the Jenkins job.

FYI @AdamBrousseau

llxia commented 4 months ago

I got a passed run: https://openj9-jenkins.osuosl.org/job/test.getDependency/1116/