search

adoptium / aqa-tests

Home of test infrastructure for Adoptium builds
https://adoptium.net/aqavit
Apache License 2.0
132 stars 312 forks source link

test dacapo-xalan_0 fails on JDK8 Arm32 #3122

Open Haroon-Khel opened 2 years ago

Haroon-Khel commented 2 years ago

test dacapo-xalan_0 in the jdk8 hs extended perf test suite fails on arm32

Latest failure https://ci.adoptopenjdk.net/job/Test_openjdk8_hs_extended.perf_arm_linux/26/tapResults/ I have rerun the test on other arm32 machines, still fails

===============================================
Running test dacapo-xalan_0 ...
===============================================
dacapo-xalan_0 Start Time: Wed Nov  3 13:19:34 2021 Epoch Time (ms): 1635945574285
variation: NoOptions
JVM_OPTIONS:  
Using scaled threading model. 32 processors detected, 32 threads used to drive the workload, in a possible range of [1,100]
===== DaCapo 9.12-MR1 xalan starting =====
; SystemID: file:///home/jenkins/workspace/Grinder/aqa-tests/TKG/output_16359455736097/dacapo-xalan_0/./scratch/xalan/xmlspec.xsl; Line#: 639; Column#: 29
javax.xml.transform.TransformerException: java.lang.RuntimeException: Programmer assertion is incorrect! - Can not setRoot on a non-iterated NodeSequence!
    at org.apache.xalan.transformer.TransformerImpl.executeChildTemplates(TransformerImpl.java:2405)
    at org.apache.xalan.templates.ElemLiteralResult.execute(ElemLiteralResult.java:1376)
    at org.apache.xalan.templates.ElemApplyTemplates.transformSelectedNodes(ElemApplyTemplates.java:395)
    at org.apache.xalan.templates.ElemApplyTemplates.execute(ElemApplyTemplates.java:178)
sxa commented 12 months ago

Seems less frequent on the odroid systems:

Machine Result
test-docker-ubuntu2004-armv7l-1 FAILED 5/5
test-docker-ubuntu2004-armv7l-2 FAILED 5/5
test-docker-ubuntu2204-armv7l-1 FAILED 3/5
test-sxa-armv7l-ubuntu2004-odroid-2 PASSED 5/5
test-sxa-armv7l-ubuntu2004-odroid-1 FAILED 1/5
sxa commented 12 months ago

So the above suggests it's inconsistent but more reliable on the odroid systems. It may be worth attempting to run these in a docker container on the odroid system to see if it's in any way related to running in a container but I feel we need to get these running reliably on all systems.

Other dacapo related issues:

sxa commented 12 months ago

TC grinder 3872 on the containerized system gave problems:

11:48:37  TESTING:
11:48:37  Using scaled threading model. 16 processors detected, 16 threads used to drive the workload, in a possible range of [1,100]
11:48:37  ===== DaCapo 9.12-MR1 xalan starting =====
11:48:38  ; SystemID: [file:///home/jenkins/workspace/Grinder/aqa-tests/TKG/output_16989257163928/dacapo-xalan_0/./scratch/xalan/xmlspec.xsl;](file:///home/jenkins/workspace/Grinder/aqa-tests/TKG/output_16989257163928/dacapo-xalan_0/scratch/xalan/xmlspec.xsl;) Line#: 1440; Column#: 35
11:48:38  javax.xml.transform.TransformerException: java.lang.NullPointerException
11:48:38    at org.apache.xalan.templates.ElemValueOf.execute(ElemValueOf.java:293)

which was ultimately an ArrayIndexOutOfBounds exception

Failed 2/10 times on the mythic machine in TC (Grinder 3874) so there is definitely some flakiness here:

12:16:58  TESTING:
12:16:58  Using scaled threading model. 4 processors detected, 4 threads used to drive the workload, in a possible range of [1,100]
12:16:59  ===== DaCapo 9.12-MR1 xalan starting =====
12:17:02  ; SystemID: [file:///home/jenkins/workspace/Grinder/aqa-tests/TKG/output_1698927417724/dacapo-xalan_0/./scratch/xalan/xmlspec.xsl;](file:///home/jenkins/workspace/Grinder/aqa-tests/TKG/output_1698927417724/dacapo-xalan_0/scratch/xalan/xmlspec.xsl;) Line#: 511; Column#: 29
12:17:02  javax.xml.transform.TransformerException: java.lang.RuntimeException: Programmer assertion is incorrect! - Can not setRoot on a non-iterated NodeSequence!