search

dragonwell-project / dragonwell21

GNU General Public License v2.0
70 stars 20 forks source link

[dragonwell21][nightly][perf]specjbb2015 regress #92

Closed sendaoYan closed 3 months ago

sendaoYan commented 3 months ago

【环境准备】

记录过程共计4个二进制包：
oss://compiler-ci-bucket/dragonwell21/20240719-141802-726-#131-linux.aarch64.release.master-64dff318febb7cf639d95e039591e4e89e4db0de.jdk.tar.gz                                                                         
oss://compiler-ci-bucket/dragonwell21/20240724-001811-283-#137-linux.aarch64.release.master-102db0f07a0d1ded72c828b98e9ca20acf7907ce.jdk.tar.gz                                                                         

oss://compiler-ci-bucket/dragonwell21/20240727-001810-915-#140-linux.aarch64.release.master-e58378d55c2b645d60516d22e9d281444e02c4d2.jdk.tar.gz                                                                                             
oss://compiler-ci-bucket/dragonwell21/20240801-001815-355-#145-linux.aarch64.release.master-a8ee437430791518849d1ba4eeb8fc91169f54fa.jdk.tar.gz                                     

specjbb_opt='-server -Xms31g -Xmx31g -XX:MetaspaceSize=512m -XX:MaxMetaspaceSize=512m -XX:+UseG1GC -XX:+DisableExplicitGC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/admin/.jenkins/workspace/dragonwell21.nightly.pipeline@4 -Dcom.sun.management.jmxremote.port=9981 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dfile.encoding=UTF-8'

硬件
实例ID:
i-bp1g32s9c3t7nyfiu9so
IP地址:
121.40.238.1
Region/Zone:
cn-hangzhou/cn-hangzhou-j
规格:
ecs.g8y.32xlarge
带宽:
10
系统盘:
SSD云盘/50G
数据盘:
/500G/1个
软件
镜像:
aliyun_3_arm64_20G_dengbao_alibase_20240528.vhd

【测试记录】 

对应的测试链接：
    max-jOPS critical-jOPS  测试链接
7月22日   -1.25%  -1.07%  https://tone.aliyun-inc.com/ws/xesljfzh/test_result/342941
7月23日   -5.00%  -1.22%  https://tone.aliyun-inc.com/ws/xesljfzh/test_result/343447
7月24日   -2.62%  -3.35%  https://tone.aliyun-inc.com/ws/xesljfzh/test_result/344011
7月25日   -1.25%  0.37%   https://tone.aliyun-inc.com/ws/xesljfzh/test_result/344421
7月26日   -3.75%  -7.34%  https://tone.aliyun-inc.com/ws/xesljfzh/test_result/345070
7月27日   -5.00%  -4.06%  https://tone.aliyun-inc.com/ws/xesljfzh/test_result/345703
7月29日   -4.76%  -7.30%  https://tone.aliyun-inc.com/ws/xesljfzh/test_result/346649
7月30日   -6.25%  -5.67%  https://tone.aliyun-inc.com/ws/xesljfzh/test_result/347218
7月31日   -6.25%  -3.60%  https://tone.aliyun-inc.com/ws/xesljfzh/test_result/347726
8月1日    -7.28%  -6.53%  https://tone.aliyun-inc.com/ws/xesljfzh/test_result/348224

截图记录：

image

【版本信息】

[wb-wq628200@CompilerTest-aarch64-2 bin]$ uname -a ; cat /etc/os-release ; free -h; lscpu| head -n 25;./java -version; ./java -Xinternalversion
Linux CompilerTest-aarch64-2 5.10.134-16.1.al8.aarch64 #1 SMP Thu Dec 7 22:04:51 CST 2023 aarch64 aarch64 aarch64 GNU/Linux
NAME="Alibaba Cloud Linux"
VERSION="3 (Soaring Falcon)"
ID="alinux"
ID_LIKE="rhel fedora centos anolis"
VERSION_ID="3"
UPDATE_ID="9"
PLATFORM_ID="platform:al8"
PRETTY_NAME="Alibaba Cloud Linux 3 (Soaring Falcon)"
ANSI_COLOR="0;31"
HOME_URL="https://www.aliyun.com/"

              total        used        free      shared  buff/cache   available
Mem:          122Gi       1.3Gi        39Gi       0.0Ki        81Gi       119Gi
Swap:            0B          0B          0B
Architecture:        aarch64
Byte Order:          Little Endian
CPU(s):              32
On-line CPU(s) list: 0-31
Thread(s) per core:  1
Core(s) per socket:  32
Socket(s):           1
NUMA node(s):        1
Vendor ID:           ARM
Model:               0
Model name:          Neoverse-N2
Stepping:            r0p0
CPU MHz:             3000.000
CPU max MHz:         3000.0000
CPU min MHz:         3000.0000
BogoMIPS:            100.00
L1d cache:           64K
L1i cache:           64K
L2 cache:            1024K
L3 cache:            65536K
NUMA node0 CPU(s):   0-31
Flags:               fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm ssbs sb dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh
openjdk version "21.0.3.0.3" 2024-08-01
OpenJDK Runtime Environment (build 21.0.3.0.3+21)
OpenJDK 64-Bit Server VM (build 21.0.3.0.3+21, mixed mode, sharing)
OpenJDK 64-Bit Server VM (21.0.3.0.3+21) for linux-aarch64 JRE (21.0.3.0.3+21), built on 2024-07-31T16:19:51Z by "admin" with gcc 7.3.1 20180303 (Red Hat 7.3.1-5)
sendaoYan commented 3 months ago

数据.xlsx

sendaoYan commented 3 months ago

跑5次取平均值的结果： 测试链接： 0724：https://tone.aliyun-inc.com/ws/xesljfzh/test_result/348437?tab=1 0727：https://tone.aliyun-inc.com/ws/xesljfzh/test_result/348436?tab=1

dragonwell21 max-jOPS critical-jOPS max-jOPS decrease critical-jOPS decrease
20240724 binary 112758.80 64243.20 -4.17% -4.24%
20240727 binary 113249.40 64280.00 -3.75% -4.19%
kuaiwei commented 3 months ago

我用baseline jdk跑的是相似的结果，可能和测试环境还有浮动相关 https://tone.aliyun-inc.com/ws/xesljfzh/test_result/349544 max-jOps : 112614.80±1.03% critical-jOps : 64061.40±1.33%

sendaoYan commented 3 months ago

我用baseline jdk跑的是相似的结果，可能和测试环境还有浮动相关 https://tone.aliyun-inc.com/ws/xesljfzh/test_result/349544 max-jOps : 112614.80±1.03% critical-jOps : 64061.40±1.33%

之前ecs从32c换成128c且做了绑核之后，测试基线没有做调整。重新调整之后，测试记录显示7.26和7.29出现2次明显的critical性能下降。后续的测试显示性能恢复正常，应该在ecs环境存在性能波动 image