Performance degradation for the same code with IBM Semeru Runtime Open Edition 11.0.13.0

[VincentSalewyn]

We have 2 different releases for SPSS Modeler Premium.

18.3: Windows: 8u265-b01 openj9 Mac: 8u265-b01 Hotspot Linux: IBM JRE 8.0.6.25

18.4: IBM Semeru Runtime Open Edition 11.0.13.0 Download link: https://github.com/ibmruntimes/semeru11-binaries/releases/tag/jdk-11.0.13%2B8_openj9-0.29.0

We did the following test on Mac machine: Text Analytics Scoring for a big corpora and huge set of categories.

First test in 18.4 (so using JRE 11): Stream execution complete, Elapsed=567.0 sec, CPU=2017.1 sec

Second test on 18.4 replacing shipped JRE (JRE 11) by the one from 18.3 (JRE 8): 18.4 JRE 8: Stream execution complete, Elapsed=437.0 sec, CPU=1560.87 sec

What can explain such a difference on CPU time ?

[pshipton]

What processor is in the Mac machine running the test? Is it x86 or Aarch64/M1?

[hanzhhan]

x86

[pshipton]

The concern is that on Mac x86, Hotspot jdk8 (July 2020 - 20_03) is faster than OpenJ9 jdk11 (0.29 / 11.0.13 - 21_04). There is a newer OpenJ9 version (0.35 / 11.0.17 - 22_04) but I don't know if it would improve the performance. @0xdaryl @knn-k

[0xdaryl]

Just to be clear, you are comparing an x64 Semeru JDK 11 on macOS vs an x64 HotSpot JDK 8 ?

It is difficult to explain the results generally without looking at what the application or workload is doing. There have been some performance degradations observed between JDK 8 and 11 for a variety of reasons (maybe on the order of 10%), but that doesn't account for your full difference.

Is this application and workload something I can run to analyze and provide you with a more meaningful answer? I think you're an IBMer so you can reach out to me (Daryl Maier) directly internally and we can discuss.