search

adoptium / aqa-tests

Home of test infrastructure for Adoptium builds
https://adoptium.net/aqavit
Apache License 2.0
129 stars 308 forks source link

dragonwell standard version run dragonwell8_feature_jdk0 test target error #3911

Closed sendaoYan closed 2 years ago

sendaoYan commented 2 years ago

Describe the bug dragonwell standard version run dragonwell8_feature_jdk0 test target error, which complaint Error: Cannot find file: test/jdk/com/alibaba/wisp2

===============================================
Running test dragonwell8_feature_jdk0_0 ...
===============================================
dragonwell8_feature_jdk0_0 Start Time: Sun Aug  7 20:16:24 2022 Epoch Time (ms): 1659874584004
Nothing to be done for setup.
variation: NoOptions
JVM_OPTIONS:  
{ itercnt=1; \
mkdir -p "/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../TKG/output_16598745833020/dragonwell8_feature_jdk0_0"; \
cd "/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../TKG/output_16598745833020/dragonwell8_feature_jdk0_0"; \
"/mnt_array/yansendao.ysd/software/jdk/2022-07/std/dragonwell-11.0.16.12+8-GA/bin/java" -Xmx512m -jar "/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../../jvmtest/openjdk/jtreg/lib/jtreg.jar" \
                -agentvm -a -ea -esa -v:fail,error,time,nopass -retain:fail,error,*.dmp,javacore.*,heapdump.*,*.trc -ignore:quiet -timeoutFactor:8 -xml:verify -concurrency:24  -vmoptions:"-Xmx512m  " \
                -w ""/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../TKG/output_16598745833020/dragonwell8_feature_jdk0_0"/work" \
                -r ""/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../TKG/output_16598745833020/dragonwell8_feature_jdk0_0"/report" \
                -jdk:"/mnt_array/yansendao.ysd/software/jdk/2022-07/std/dragonwell-11.0.16.12+8-GA" \
                -exclude:"/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../openjdk/openjdk-jdk/test/jdk/ProblemList.txt" \
                -exclude:"/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../../jvmtest/openjdk/excludes/ProblemList_openjdk11.txt" \
                 \
                -exclude:"/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../openjdk/excludes/vendors/alibaba/ProblemList_openjdk11.txt" \
                "/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../openjdk/openjdk-jdk/test/jdk/com/alibaba/wisp2"; \
                if [ $? -eq 0 ] ; then echo ""; echo "dragonwell8_feature_jdk0_0""_PASSED"; echo ""; cd /mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/..;  else echo ""; echo "dragonwell8_feature_jdk0_0""_FAILED"; echo ""; fi; } 2>&1 | tee -a "/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../TKG/output_16598745833020/TestTargetResult";
Error: Cannot find file: /mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../openjdk/openjdk-jdk/test/jdk/com/alibaba/wisp2

dragonwell8_feature_jdk0_0_FAILED

Nothing to be done for teardown.
dragonwell8_feature_jdk0_0 Finish Time: Sun Aug  7 20:16:24 2022 Epoch Time (ms): 1659874584263
make[3]: Leaving directory '/mnt_array/yansendao.ysd/202207/aqa-tests-std11/openjdk'
make[2]: Leaving directory '/mnt_array/yansendao.ysd/202207/aqa-tests-std11'
cd "/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../TKG/scripts"; \
perl "resultsSum.pl" --failuremk="/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../TKG/failedtargets.mk" --resultFile="/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../TKG/output_16598745833020/TestTargetResult" --platFile="/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../TKG/resources/buildPlatformMap.properties" --diagnostic=failure --jdkVersion=11 --jdkImpl=hotspot --jdkVendor="alibaba" --spec=linux_x86-64 --buildList=openjdk --customTarget= --testTarget=dragonwell8_feature_jdk0 --tapPath=/mnt_array/yansendao.ysd/202207/aqa-tests-std11/TKG/../TKG/output_16598745833020/ --tapName=

TEST TARGETS SUMMARY
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
FAILED test targets:
        dragonwell8_feature_jdk0_0

TOTAL: 1   EXECUTED: 1   PASSED: 0   FAILED: 1   DISABLED: 0   SKIPPED: 0
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

To Reproduce Steps to reproduce the behavior (or Grinder rerun link):

export JAVA_HOME=${HOME}/software/jdk/2022-07/std/dragonwell-11.0.16.12+8-GA
export JDK_VERSION=11
export TEST_JDK_HOME=$JAVA_HOME
export PATH=$JAVA_HOME/bin:$PATH
export USE_TESTENV_PROPERTIES=true
export JDK_IMPL=hotspot
export BUILD_LIST=openjdk
cd aqa-tests
./compile.sh
cd TKG
make _dragonwell8_feature_jdk0

Expected behavior skip releate test target

Screenshots If applicable, add screenshots to help explain your problem.

Additional context

Dragonwell8/dragonwell11 will release standard version and entended version. The diffrence between them is, The standard version doesn’t include dragonwell feature(such as wisp/jwarmup etc..), The extended version include dragonwell feature.

image

The sanity.openjdk and extended.openjdk contains several dragonwell feature tests, such as https://github.com/adoptium/aqa-tests/blob/master/openjdk/playlist.xml#L1933

But the standard dragonwell doesn’t support these tests, so the git repo branch doesn’t contains these testcases. When we run sanity.openjdk and extended.openjdk test target, it will complaint “Cannot find file”

So we should skip dragonwell feature tests when the dragonwell version is standard version.

sendaoYan commented 2 years ago

patch:

git diff
diff --git a/openjdk/playlist.xml b/openjdk/playlist.xml
index aac12fe3..499da908 100644
--- a/openjdk/playlist.xml
+++ b/openjdk/playlist.xml
@@ -1943,6 +1943,9 @@
                        $(Q)$(JTREG_JDK_TEST_DIR)/com/alibaba/wisp2$(Q); \
                        $(TEST_STATUS)
                </command>
+               <features>
+                       <feature>Dragonwell_Standard:nonapplicable</feature>
+               </features>
                <versions>
                        <version>8</version>
                        <version>11</version>
@@ -1972,6 +1975,9 @@
                        $(Q)$(JTREG_JDK_TEST_DIR)/com/alibaba/wisp$(Q); \
                        $(TEST_STATUS)
                </command>
+               <features>
+                       <feature>Dragonwell_Standard:nonapplicable</feature>
+               </features>
                <versions>
                        <version>8</version>
                        <version>11</version>
@@ -2003,6 +2009,9 @@
                        $(Q)$(JTREG_JDK_TEST_DIR)/com/alibaba/rcm$(Q); \
                        $(TEST_STATUS)
                </command>
+               <features>
+                       <feature>Dragonwell_Standard:nonapplicable</feature>
+               </features>
                <versions>
                        <version>8</version>
                </versions>
@@ -2031,6 +2040,9 @@
                        $(Q)$(JTREG_JDK_TEST_DIR)/com/alibaba/management$(Q); \
                        $(TEST_STATUS)
                </command>
+               <features>
+                       <feature>Dragonwell_Standard:nonapplicable</feature>
+               </features>
                <versions>
                        <version>8</version>
                </versions>
@@ -2060,6 +2072,9 @@
                        $(Q)$(JTREG_JDK_TEST_DIR)/multi-tenant$(Q); \
                        $(TEST_STATUS)
                </command>
+               <features>
+                       <feature>Dragonwell_Standard:nonapplicable</feature>
+               </features>
                <versions>
                        <version>8</version>
                </versions>
@@ -2088,6 +2103,9 @@
                        $(Q)$(JTREG_JDK_TEST_DIR)/elastic-heap$(Q); \
                        $(TEST_STATUS)
                </command>
+               <features>
+                       <feature>Dragonwell_Standard:nonapplicable</feature>
+               </features>
                <versions>
                        <version>8</version>
                </versions>
@@ -2116,6 +2134,9 @@
                        $(Q)$(JTREG_HOTSPOT_TEST_DIR)/elastic-heap$(Q); \
                        $(TEST_STATUS)
                </command>
+               <features>
+                       <feature>Dragonwell_Standard:nonapplicable</feature>
+               </features>
                <versions>
                        <version>8</version>
                </versions>
@@ -2144,6 +2165,9 @@
                        $(Q)$(JTREG_HOTSPOT_TEST_DIR)/jwarmup$(Q); \
                        $(TEST_STATUS)
                </command>
+               <features>
+                       <feature>Dragonwell_Standard:nonapplicable</feature>
+               </features>
                <versions>
                        <version>8</version>
                </versions>
@@ -2173,6 +2197,9 @@
                        $(Q)$(JTREG_HOTSPOT_TEST_DIR)/multi-tenant$(Q); \
                        $(TEST_STATUS)
                </command>
+               <features>
+                       <feature>Dragonwell_Standard:nonapplicable</feature>
+               </features>
                <versions>
                        <version>8</version>
                </versions>