Open mikezhang1234567890 opened 3 years ago
fyi @tajila @babsingh
FYI @vijaysun-omr
FYI @andrewcraik Q1. Would you know a benchmark from the BumbleBench suite, which will allow us to vary the size of (or time spent in) a critical section and number of concurrent threads accessing that critical section? Q2. Are there any Skylake machines available in the open? Is there a preference for a non-Skylake machine for benchmarking?
@babsingh Q2 - I don't know what hardware is available in the open unfortunately, you will need to ask on the Slack channel to see who knows what boxes are available. If you need something at IBM we can discuss offline.
Q1 - There isn't a BumbleBench benchmark in the suite at present. I have written a simple one and will send it to you offline rather than cluttering the comments with code. It uses a Thread.sleep to cause a certain number of nanoseconds of work to be done in the critical section which seems to work well for varying contention on platforms where the timer has sufficiently fine resolution.
I see this problem with skylake hardware using Oracle JDK and OpenJDK hotspot using a JMH benchmark regarding synchronization.
https://github.com/chrishantha/microbenchmarks
Here is a xls showing the ops where the graphs above came from. OpenJDK8_292-256Threads.xls
@gss2002 Thanks for sharing your results. How do the Skylake and Haswell machines compare in terms of number of CPUs and RAM? Were the two machines comparable? On Linux, the following commands will show these details:
# CPUs
lscpu
# RAM
free -m
dmidecode --type memory
01dn (haswell): 01dn ~]$ lscpu Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 48 On-line CPU(s) list: 0-47 Thread(s) per core: 2 Core(s) per socket: 12 Socket(s): 2 NUMA node(s): 2 Vendor ID: GenuineIntel CPU family: 6 Model: 63 Model name: Intel(R) Xeon(R) CPU E5-2690 v3 @ 2.60GHz Stepping: 2 CPU MHz: 2598.413 CPU max MHz: 3500.0000 CPU min MHz: 1200.0000 BogoMIPS: 5199.77 Virtualization: VT-x L1d cache: 32K L1i cache: 32K L2 cache: 256K L3 cache: 30720K NUMA node0 CPU(s): 0-11,24-35 NUMA node1 CPU(s): 12-23,36-47 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm xsaveopt cqm_llc cqm_occup_llc dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d
01dn ~]$ free -m total used free shared buff/cache available Mem: 257672 12866 186275 606 58530 239688 Swap: 65495 0 65495 01dn ~]$ sudo dmidecode --type memory
Getting SMBIOS data from sysfs. SMBIOS 3.0 present.
Handle 0x003B, DMI type 16, 23 bytes Physical Memory Array Location: System Board Or Motherboard Use: System Memory Error Correction Type: Multi-bit ECC Maximum Capacity: 256 GB Error Information Handle: Not Provided Number Of Devices: 4
Handle 0x003D, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x003B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMMA1
Bank Locator: P0_Node0_Channel0_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 712EC3CB
Asset Tag: P1_DIMMA1_AssetTag (Date:16/5)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x003F, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x003B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMMA2
Bank Locator: P0_Node0_Channel0_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 712EC3D4
Asset Tag: P1_DIMMA2_AssetTag (Date:16/5)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x0041, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x003B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMMB1
Bank Locator: P0_Node0_Channel1_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 31B53D7D
Asset Tag: P1_DIMMB1_AssetTag (Date:16/20)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x0043, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x003B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMMB2
Bank Locator: P0_Node0_Channel1_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 31B5177A
Asset Tag: P1_DIMMB2_AssetTag (Date:16/20)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x0045, DMI type 16, 23 bytes Physical Memory Array Location: System Board Or Motherboard Use: System Memory Error Correction Type: Multi-bit ECC Maximum Capacity: 256 GB Error Information Handle: Not Provided Number Of Devices: 4
Handle 0x0047, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x0045
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMMC1
Bank Locator: P0_Node0_Channel2_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 31B513ED
Asset Tag: P1_DIMMC1_AssetTag (Date:16/20)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x0049, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x0045
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMMC2
Bank Locator: P0_Node0_Channel2_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 712EC495
Asset Tag: P1_DIMMC2_AssetTag (Date:16/5)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x004B, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x0045
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMMD1
Bank Locator: P0_Node0_Channel3_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 31B5176D
Asset Tag: P1_DIMMD1_AssetTag (Date:16/20)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x004D, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x0045
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P1_DIMMD2
Bank Locator: P0_Node0_Channel3_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 712EC3DE
Asset Tag: P1_DIMMD2_AssetTag (Date:16/5)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x004F, DMI type 16, 23 bytes Physical Memory Array Location: System Board Or Motherboard Use: System Memory Error Correction Type: Multi-bit ECC Maximum Capacity: 256 GB Error Information Handle: Not Provided Number Of Devices: 4
Handle 0x0051, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x004F
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMME1
Bank Locator: P1_Node1_Channel0_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 31B51408
Asset Tag: P2_DIMME1_AssetTag (Date:16/20)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x0053, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x004F
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMME2
Bank Locator: P1_Node1_Channel0_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 31B514D2
Asset Tag: P2_DIMME2_AssetTag (Date:16/20)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x0055, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x004F
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMMF1
Bank Locator: P1_Node1_Channel1_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 31B51B96
Asset Tag: P2_DIMMF1_AssetTag (Date:16/20)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x0057, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x004F
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMMF2
Bank Locator: P1_Node1_Channel1_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 31B514DA
Asset Tag: P2_DIMMF2_AssetTag (Date:16/20)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x0059, DMI type 16, 23 bytes Physical Memory Array Location: System Board Or Motherboard Use: System Memory Error Correction Type: Multi-bit ECC Maximum Capacity: 256 GB Error Information Handle: Not Provided Number Of Devices: 4
Handle 0x005B, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x0059
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMMG1
Bank Locator: P1_Node1_Channel2_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 31B514BE
Asset Tag: P2_DIMMG1_AssetTag (Date:16/20)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x005D, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x0059
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMMG2
Bank Locator: P1_Node1_Channel2_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 31B514D5
Asset Tag: P2_DIMMG2_AssetTag (Date:16/20)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x005F, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x0059
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMMH1
Bank Locator: P1_Node1_Channel3_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 31B514BC
Asset Tag: P2_DIMMH1_AssetTag (Date:16/20)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
Handle 0x0061, DMI type 17, 40 bytes
Memory Device
Array Handle: 0x0059
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 16384 MB
Form Factor: DIMM
Set: None
Locator: P2_DIMMH2
Bank Locator: P1_Node1_Channel3_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2400 MT/s
Manufacturer: Hynix Semiconductor
Serial Number: 31B51771
Asset Tag: P2_DIMMH2_AssetTag (Date:16/20)
Part Number: HMA42GR7AFR4N-UH
Rank: 2
Configured Memory Speed: 1866 MT/s
Minimum Voltage: Unknown
Maximum Voltage: Unknown
Configured Voltage: Unknown
06dn (skylake): 06dn ~]$ lscpu Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 72 On-line CPU(s) list: 0-71 Thread(s) per core: 2 Core(s) per socket: 18 Socket(s): 2 NUMA node(s): 2 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz Stepping: 4 CPU MHz: 1313.684 CPU max MHz: 3700.0000 CPU min MHz: 1000.0000 BogoMIPS: 4600.00 Virtualization: VT-x L1d cache: 32K L1i cache: 32K L2 cache: 1024K L3 cache: 25344K NUMA node0 CPU(s): 0-17,36-53 NUMA node1 CPU(s): 18-35,54-71 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 invpcid_single intel_ppin intel_pt ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts pku ospke md_clear spec_ctrl intel_stibp flush_l1d
06dn ~]$ free -m total used free shared buff/cache available Mem: 385419 15416 301492 272 68510 364968 Swap: 65495 0 65495
06dn ~]$ sudo dmidecode --type memory
Getting SMBIOS data from sysfs. SMBIOS 3.2 present.
Handle 0x0029, DMI type 16, 23 bytes Physical Memory Array Location: System Board Or Motherboard Use: System Memory Error Correction Type: Single-bit ECC Maximum Capacity: 2304 GB Error Information Handle: Not Provided Number Of Devices: 4
Handle 0x002B, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0029
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMA1
Bank Locator: P0_Node0_Channel0_Dimm0
Type: DDR4
Type Detail: Synchronous Registered (Buffered)
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 528C49BC
Asset Tag: P1-DIMMA1_AssetTag (date:18/30)
Part Number: HMA84GR7AFR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x002C, DMI type 17, 84 bytes Memory Device Array Handle: 0x0029 Error Information Handle: Not Provided Total Width: Unknown Data Width: Unknown Size: No Module Installed Form Factor: DIMM Set: None Locator: P1-DIMMA2 Bank Locator: P0_Node0_Channel0_Dimm1 Type: Unknown Type Detail: Unknown Speed: Unknown Manufacturer: NO DIMM Serial Number: NO DIMM Asset Tag: NO DIMM Part Number: NO DIMM Rank: Unknown Configured Memory Speed: Unknown Minimum Voltage: 1.2 V Maximum Voltage: 1.2 V Configured Voltage: 1.2 V Memory Technology: Unknown Memory Operating Mode Capability: Volatile memory Firmware Version: NO DIMM Module Manufacturer ID: Unknown Module Product ID: Unknown Memory Subsystem Controller Manufacturer ID: Unknown Memory Subsystem Controller Product ID: Unknown Non-Volatile Size: None Volatile Size: None Cache Size: None Logical Size: None
Handle 0x002D, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0029
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMB1
Bank Locator: P0_Node0_Channel1_Dimm0
Type: DDR4
Type Detail: Synchronous Registered (Buffered)
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 528C49B6
Asset Tag: P1-DIMMB1_AssetTag (date:18/30)
Part Number: HMA84GR7AFR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x002F, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0029
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMC1
Bank Locator: P0_Node0_Channel2_Dimm0
Type: DDR4
Type Detail: Synchronous Registered (Buffered)
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 528C49BA
Asset Tag: P1-DIMMC1_AssetTag (date:18/30)
Part Number: HMA84GR7AFR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0031, DMI type 16, 23 bytes Physical Memory Array Location: System Board Or Motherboard Use: System Memory Error Correction Type: Single-bit ECC Maximum Capacity: 2304 GB Error Information Handle: Not Provided Number Of Devices: 4
Handle 0x0033, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0031
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMD1
Bank Locator: P0_Node1_Channel0_Dimm0
Type: DDR4
Type Detail: Synchronous Registered (Buffered)
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 528C49F8
Asset Tag: P1-DIMMD1_AssetTag (date:18/30)
Part Number: HMA84GR7AFR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0034, DMI type 17, 84 bytes Memory Device Array Handle: 0x0031 Error Information Handle: Not Provided Total Width: Unknown Data Width: Unknown Size: No Module Installed Form Factor: DIMM Set: None Locator: P1-DIMMD2 Bank Locator: P0_Node1_Channel0_Dimm1 Type: Unknown Type Detail: Unknown Speed: Unknown Manufacturer: NO DIMM Serial Number: NO DIMM Asset Tag: NO DIMM Part Number: NO DIMM Rank: Unknown Configured Memory Speed: Unknown Minimum Voltage: 1.2 V Maximum Voltage: 1.2 V Configured Voltage: 1.2 V Memory Technology: Unknown Memory Operating Mode Capability: Volatile memory Firmware Version: NO DIMM Module Manufacturer ID: Unknown Module Product ID: Unknown Memory Subsystem Controller Manufacturer ID: Unknown Memory Subsystem Controller Product ID: Unknown Non-Volatile Size: None Volatile Size: None Cache Size: None Logical Size: None
Handle 0x0035, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0031
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMME1
Bank Locator: P0_Node1_Channel1_Dimm0
Type: DDR4
Type Detail: Synchronous Registered (Buffered)
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 528C4A0B
Asset Tag: P1-DIMME1_AssetTag (date:18/30)
Part Number: HMA84GR7AFR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0037, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0031
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMF1
Bank Locator: P0_Node1_Channel2_Dimm0
Type: DDR4
Type Detail: Synchronous Registered (Buffered)
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 528C49A5
Asset Tag: P1-DIMMF1_AssetTag (date:18/30)
Part Number: HMA84GR7AFR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0039, DMI type 16, 23 bytes Physical Memory Array Location: System Board Or Motherboard Use: System Memory Error Correction Type: Single-bit ECC Maximum Capacity: 2304 GB Error Information Handle: Not Provided Number Of Devices: 4
Handle 0x003B, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0039
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMA1
Bank Locator: P1_Node0_Channel0_Dimm0
Type: DDR4
Type Detail: Synchronous Registered (Buffered)
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 528C4A26
Asset Tag: P2-DIMMA1_AssetTag (date:18/30)
Part Number: HMA84GR7AFR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x003C, DMI type 17, 84 bytes Memory Device Array Handle: 0x0039 Error Information Handle: Not Provided Total Width: Unknown Data Width: Unknown Size: No Module Installed Form Factor: DIMM Set: None Locator: P2-DIMMA2 Bank Locator: P1_Node0_Channel0_Dimm1 Type: Unknown Type Detail: Unknown Speed: Unknown Manufacturer: NO DIMM Serial Number: NO DIMM Asset Tag: NO DIMM Part Number: NO DIMM Rank: Unknown Configured Memory Speed: Unknown Minimum Voltage: 1.2 V Maximum Voltage: 1.2 V Configured Voltage: 1.2 V Memory Technology: Unknown Memory Operating Mode Capability: Volatile memory Firmware Version: NO DIMM Module Manufacturer ID: Unknown Module Product ID: Unknown Memory Subsystem Controller Manufacturer ID: Unknown Memory Subsystem Controller Product ID: Unknown Non-Volatile Size: None Volatile Size: None Cache Size: None Logical Size: None
Handle 0x003D, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0039
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMB1
Bank Locator: P1_Node0_Channel1_Dimm0
Type: DDR4
Type Detail: Synchronous Registered (Buffered)
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 528C4A0C
Asset Tag: P2-DIMMB1_AssetTag (date:18/30)
Part Number: HMA84GR7AFR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x003F, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0039
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMC1
Bank Locator: P1_Node0_Channel2_Dimm0
Type: DDR4
Type Detail: Synchronous Registered (Buffered)
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 528C4A30
Asset Tag: P2-DIMMC1_AssetTag (date:18/30)
Part Number: HMA84GR7AFR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0041, DMI type 16, 23 bytes Physical Memory Array Location: System Board Or Motherboard Use: System Memory Error Correction Type: Single-bit ECC Maximum Capacity: 2304 GB Error Information Handle: Not Provided Number Of Devices: 4
Handle 0x0043, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0041
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMD1
Bank Locator: P1_Node1_Channel0_Dimm0
Type: DDR4
Type Detail: Synchronous Registered (Buffered)
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 528C4976
Asset Tag: P2-DIMMD1_AssetTag (date:18/30)
Part Number: HMA84GR7AFR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0044, DMI type 17, 84 bytes Memory Device Array Handle: 0x0041 Error Information Handle: Not Provided Total Width: Unknown Data Width: Unknown Size: No Module Installed Form Factor: DIMM Set: None Locator: P2-DIMMD2 Bank Locator: P1_Node1_Channel0_Dimm1 Type: Unknown Type Detail: Unknown Speed: Unknown Manufacturer: NO DIMM Serial Number: NO DIMM Asset Tag: NO DIMM Part Number: NO DIMM Rank: Unknown Configured Memory Speed: Unknown Minimum Voltage: 1.2 V Maximum Voltage: 1.2 V Configured Voltage: 1.2 V Memory Technology: Unknown Memory Operating Mode Capability: Volatile memory Firmware Version: NO DIMM Module Manufacturer ID: Unknown Module Product ID: Unknown Memory Subsystem Controller Manufacturer ID: Unknown Memory Subsystem Controller Product ID: Unknown Non-Volatile Size: None Volatile Size: None Cache Size: None Logical Size: None
Handle 0x0045, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0041
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMME1
Bank Locator: P1_Node1_Channel1_Dimm0
Type: DDR4
Type Detail: Synchronous Registered (Buffered)
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 528C4987
Asset Tag: P2-DIMME1_AssetTag (date:18/30)
Part Number: HMA84GR7AFR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0047, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0041
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMF1
Bank Locator: P1_Node1_Channel2_Dimm0
Type: DDR4
Type Detail: Synchronous Registered (Buffered)
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 528C4979
Asset Tag: P2-DIMMF1_AssetTag (date:18/30)
Part Number: HMA84GR7AFR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
@babsingh
We have additional Skylake Chipset that is a 6240 that I haven't full benchmarked which with openjdk but the performance from what I saw with Oracle is lagging behind the haswell not as much as the 6140 chip though.
61dn ~]$ sudo lscpu Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 72 On-line CPU(s) list: 0-71 Thread(s) per core: 2 Core(s) per socket: 18 Socket(s): 2 NUMA node(s): 2 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Gold 6240 CPU @ 2.60GHz Stepping: 7 CPU MHz: 2652.526 CPU max MHz: 3900.0000 CPU min MHz: 1000.0000 BogoMIPS: 5200.00 Virtualization: VT-x L1d cache: 32K L1i cache: 32K L2 cache: 1024K L3 cache: 25344K NUMA node0 CPU(s): 0-17,36-53 NUMA node1 CPU(s): 18-35,54-71 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch epb cat_l3 cdp_l3 invpcid_single intel_ppin intel_pt ssbd mba ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts pku ospke avx512_vnni md_clear spec_ctrl intel_stibp flush_l1d arch_capabilities
61dn ~]$ free -m total used free shared buff/cache available Mem: 772460 13092 612211 4182 147156 749758 Swap: 65495 0 65495
61dn ~]$ sudo dmidecode --type memory
Getting SMBIOS data from sysfs. SMBIOS 3.2 present.
Handle 0x001B, DMI type 16, 23 bytes Physical Memory Array Location: System Board Or Motherboard Use: System Memory Error Correction Type: Single-bit ECC Maximum Capacity: 2304 GB Error Information Handle: Not Provided Number Of Devices: 6
Handle 0x001D, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x001B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMA1
Bank Locator: P0_Node0_Channel0_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B6FA9
Asset Tag: P1-DIMMA1_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x001E, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x001B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMA2
Bank Locator: P0_Node0_Channel0_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B6FBA
Asset Tag: P1-DIMMA2_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x001F, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x001B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMB1
Bank Locator: P0_Node0_Channel1_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B6FB5
Asset Tag: P1-DIMMB1_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0020, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x001B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMB2
Bank Locator: P0_Node0_Channel1_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B6FB8
Asset Tag: P1-DIMMB2_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0021, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x001B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMC1
Bank Locator: P0_Node0_Channel2_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B6FBC
Asset Tag: P1-DIMMC1_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0022, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x001B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMC2
Bank Locator: P0_Node0_Channel2_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B6FC3
Asset Tag: P1-DIMMC2_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0023, DMI type 16, 23 bytes Physical Memory Array Location: System Board Or Motherboard Use: System Memory Error Correction Type: Single-bit ECC Maximum Capacity: 2304 GB Error Information Handle: Not Provided Number Of Devices: 6
Handle 0x0025, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0023
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMD1
Bank Locator: P0_Node1_Channel0_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B6FD5
Asset Tag: P1-DIMMD1_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0026, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0023
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMD2
Bank Locator: P0_Node1_Channel0_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B6FC4
Asset Tag: P1-DIMMD2_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0027, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0023
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMME1
Bank Locator: P0_Node1_Channel1_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B6FB9
Asset Tag: P1-DIMME1_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0028, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0023
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMME2
Bank Locator: P0_Node1_Channel1_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B6FCC
Asset Tag: P1-DIMME2_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0029, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0023
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMF1
Bank Locator: P0_Node1_Channel2_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B71F7
Asset Tag: P1-DIMMF1_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x002A, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0023
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P1-DIMMF2
Bank Locator: P0_Node1_Channel2_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B7200
Asset Tag: P1-DIMMF2_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x002B, DMI type 16, 23 bytes Physical Memory Array Location: System Board Or Motherboard Use: System Memory Error Correction Type: Single-bit ECC Maximum Capacity: 2304 GB Error Information Handle: Not Provided Number Of Devices: 6
Handle 0x002D, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x002B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMA1
Bank Locator: P1_Node0_Channel0_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B6FC1
Asset Tag: P2-DIMMA1_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x002E, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x002B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMA2
Bank Locator: P1_Node0_Channel0_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B716D
Asset Tag: P2-DIMMA2_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x002F, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x002B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMB1
Bank Locator: P1_Node0_Channel1_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B7201
Asset Tag: P2-DIMMB1_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0030, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x002B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMB2
Bank Locator: P1_Node0_Channel1_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B7203
Asset Tag: P2-DIMMB2_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0031, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x002B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMC1
Bank Locator: P1_Node0_Channel2_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B71FE
Asset Tag: P2-DIMMC1_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0032, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x002B
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMC2
Bank Locator: P1_Node0_Channel2_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B7216
Asset Tag: P2-DIMMC2_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0033, DMI type 16, 23 bytes Physical Memory Array Location: System Board Or Motherboard Use: System Memory Error Correction Type: Single-bit ECC Maximum Capacity: 2304 GB Error Information Handle: Not Provided Number Of Devices: 6
Handle 0x0035, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0033
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMD1
Bank Locator: P1_Node1_Channel0_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B6FCF
Asset Tag: P2-DIMMD1_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0036, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0033
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMD2
Bank Locator: P1_Node1_Channel0_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B6FB7
Asset Tag: P2-DIMMD2_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0037, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0033
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMME1
Bank Locator: P1_Node1_Channel1_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B7217
Asset Tag: P2-DIMME1_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0038, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0033
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMME2
Bank Locator: P1_Node1_Channel1_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B6FCE
Asset Tag: P2-DIMME2_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x0039, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0033
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMF1
Bank Locator: P1_Node1_Channel2_Dimm0
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B7209
Asset Tag: P2-DIMMF1_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
Handle 0x003A, DMI type 17, 84 bytes
Memory Device
Array Handle: 0x0033
Error Information Handle: Not Provided
Total Width: 72 bits
Data Width: 64 bits
Size: 32 GB
Form Factor: DIMM
Set: None
Locator: P2-DIMMF2
Bank Locator: P1_Node1_Channel2_Dimm1
Type: DDR4
Type Detail: Synchronous
Speed: 2666 MT/s
Manufacturer: SK Hynix
Serial Number: 341B7218
Asset Tag: P2-DIMMF2_AssetTag (date:19/44)
Part Number: HMA84GR7CJR4N-VK
Rank: 2
Configured Memory Speed: 2666 MT/s
Minimum Voltage: 1.2 V
Maximum Voltage: 1.2 V
Configured Voltage: 1.2 V
Memory Technology: DRAM
Memory Operating Mode Capability: Volatile memory
Firmware Version: 0000
Module Manufacturer ID: Bank 1, Hex 0xAD
Module Product ID: Unknown
Memory Subsystem Controller Manufacturer ID: Unknown
Memory Subsystem Controller Product ID: Unknown
Non-Volatile Size: None
Volatile Size: 32 GB
Cache Size: None
Logical Size: None
This table summarizes https://github.com/eclipse-openj9/openj9/issues/10773#issuecomment-839769275 and https://github.com/eclipse-openj9/openj9/issues/10773#issuecomment-839784805.
Machine | CPUs | CPUs per core | Cores per socket | Sockets | CPU frequency | Total RAM | Memory speed | Memory type |
---|---|---|---|---|---|---|---|---|
01dn (haswell) | 48 | 12 | 2 | 2 | 2.60 GHz | 16 GB x 16 units = 256 GB | 2400 MT/s | DDR4 |
06dn / 6140 (skylake) | 72 | 18 | 2 | 2 | 2.30 GHz | 32 GB x 12 units = 384 GB | 2666 MT/s | DDR4 |
6240 (skylake) | 72 | 18 | 2 | 2 | 2.60 GHz | 32 GB x 24 units = 768 GB | 2666 MT/s | DDR4 |
The Skylake machines have better spec than the Haswell machine, but the Haswell machine is performing better than the Skylake machines. The results in https://github.com/eclipse-openj9/openj9/issues/10773#issuecomment-839742510 are credible. To compensate for longer PAUSE
insns on Skylake, either the number of PAUSE
instructions will need to be reduced in the spin-loops or we may need to replace the PAUSE
instruction with another option (e.g. nops
). This will potentially restore the performance on the Skylake machines.
@babsingh we actually applied the latest Supermicro Bios update 3.4 which provides a current microcode to the 06dn node and we also applied the RHEL 7.x latest microcode update in hopes this would improve performance and it did not.
06dn ]# rpm -qa | grep -i microcode microcode_ctl-2.1-73.8.el7.x86_64
dmidecode BIOS info: Getting SMBIOS data from sysfs. SMBIOS 3.2 present. 95 structures occupying 6757 bytes. Table at 0x6F3C5000.
Handle 0x0000, DMI type 0, 26 bytes BIOS Information Vendor: American Megatrends Inc. Version: 3.4 Release Date: 11/03/2020 Address: 0xF0000 Runtime Size: 64 kB ROM Size: 64 MB Characteristics: PCI is supported BIOS is upgradeable BIOS shadowing is allowed Boot from CD is supported Selectable boot is supported BIOS ROM is socketed EDD is supported 5.25"/1.2 MB floppy services are supported (int 13h) 3.5"/720 kB floppy services are supported (int 13h) 3.5"/2.88 MB floppy services are supported (int 13h) Print screen service is supported (int 5h) Serial services are supported (int 14h) Printer services are supported (int 17h) ACPI is supported USB legacy is supported BIOS boot specification is supported Targeted content distribution is supported UEFI is supported BIOS Revision: 5.14
Handle 0x0001, DMI type 1, 27 bytes System Information Manufacturer: Supermicro Product Name: SSG-6029P-E1CR12L
RHEL 7.8 Kernel and GLIBC versions: 3.10.0-1127.el7.x86_64 #1 SMP Tue Feb 18 16:39:12 EST 2020 x86_64 x86_64 x86_64 GNU/Linux 06dn ]# rpm -qa | grep -i glibc glibc-devel-2.17-307.el7.1.x86_64
In my discussions with Intel Engineers on this issue we've un-covered they mentioned this also not sure how this could relate along with the pause instructions - https://software.intel.com/content/www/us/en/develop/articles/software-security-guidance/best-practices/mitigation-strategies-jcc-microcode.html?wapkw=skylake%20jcc
Here are the CPU Specific Specs: Haswell e5-2690-v3 - https://ark.intel.com/content/www/us/en/ark/products/81713/intel-xeon-processor-e5-2690-v3-30m-cache-2-60-ghz.html Skylake Gold 6140 - https://ark.intel.com/content/www/us/en/ark/products/120485/intel-xeon-gold-6140-processor-24-75m-cache-2-30-ghz.html Skylake Gold 6240 - https://ark.intel.com/content/www/us/en/ark/products/192443/intel-xeon-gold-6240-processor-24-75m-cache-2-60-ghz.html
Supermicro system/motherboard specs respective to each chipset above: e5-2690-v3 (SSG-6028R-E1CR12L/X10DRH-iT) - https://www.supermicro.com/en/products/system/2U/6028/SSG-6028R-E1CR12L.cfm / https://www.supermicro.com/en/products/motherboard/X10DRH-iT?locale=en
Skylake Gold 6140 (SSG-6029P-E1CR12L/X11DPH-T) - https://www.supermicro.com/en/products/system/2U/6029/SSG-6029P-E1CR12L.cfm / https://www.supermicro.com/en/products/motherboard/X11DPH-T?locale=en
Skylake Gold 6240 (SYS-6029U-E1CRTP/X11DPU) - https://www.supermicro.com/products/system/2U/6029/SYS-6029U-E1CRTP.cfm / https://www.supermicro.com/en/products/motherboard/X11DPU
I will be attaching the updated benchmark for 6240 chipset shortly.
This includes the two original along with the Skylake Gold 6240 chipset. I may have some additional benchmarks coming from some other *Well Series processors coming later today or tomorrow.
Background
In Skylake and later, the PAUSE instruction takes an order of magnitude more cycles than it did in previous architectures. https://aloiskraus.wordpress.com/2018/06/16/why-skylakex-cpus-are-sometimes-50-slower-how-intel-has-broken-existing-code/ provides good background information on this.
From Agner Fog's instructions table, here are the latencies of the PAUSE instructions on Skylake and previous generations:
Potential Impact On Locking Code
Conceptually, the PAUSE instruction should allow other threads to do work, and not block the other threads. However, if PAUSE takes 10x longer, then more time will be spent on spinning. A unit step in the spin code will take more time proportionate to the slowdown in the PAUSE instruction. This will increase the time to acquire a lock between unit steps, thus decreasing the throughput of lock acquiring operations. In this case, CAS might be cheaper than PAUSE instructions in low contention cases.
Uses of PAUSE insn in OpenJ9/OMR
In OpenJ9/OMR, PAUSE instruction is used in AtomicOperations::yieldCPU(). Here are the places, where yieldCPU is used:
OpenJ9: https://github.com/eclipse/openj9/search?q=yieldCPU&unscoped_q=yieldCPU BytecodeInterpreter.hpp::inlThreadOnSpinWait FastJNI_java_lang_Thread.cpp::Fast_java_lang_Thread_onSpinWait ObjectMonitor.cpp::spinOnFlatLock [Controllable by cmdline option: spin1/2/yield] ObjectMonitor.cpp::spinOnTryEnter [Controllable by cmdline option: tryenterspin1/2/yield]
OMR: https://github.com/eclipse/omr/search?q=yieldCPU&unscoped_q=yieldCPU LightweightNonReentrantReaderWriterLock.cpp::enterRead LightweightNonReentrantReaderWriterLock.cpp::enterWrite gcspinlock.cpp::omrgc_spinlock_acquire [Disabled] threadhelpers.cpp::omrthread_mcs_lock threadhelpers.cpp::omrthread_spinlock_acquire [Controllable by cmdline option: threetierspin1/2/3]
Nested vs Non-Nested Mode
In the nested mode, the number of PAUSE insns = (yieldCount * spinCount2):
In the non-nested mode, the number of PAUSE insns = spinCount2:
Note: Non-nested mode is only available for spinOnFlatLock and spinOnTryEnter.
Experiments to verify the impact of the PAUSE instruction change
Currently, we don't have evidence that the PAUSE instruction change has caused a performance regression, so we will run experiments varying the number of PAUSE instructions to see the performance impact. We do this by using command line options to control the number of instructions as mentioned in the above two sections.
Default spin counts:
-Xthr:spin1=256,spin2=32,yield=45,tryEnterSpin1=256,tryEnterSpin2=32,tryEnterYield=45,threeTierSpinCount1=256,threeTierSpinCount2=32,threeTierSpinCount3=45
The below experiments will show if changing the number of PAUSE insns will improve performance: [Experiment 1] No spinning (spin-loops may execute ~1 pause per acquire):
-Xthr:minimizeUserCPU
[Experiment 2] Enable non-nested modes:
-Xthr:noNestedSpinning,noTryEnterNestedSpinning
[Experiment 3] Reduce spinCount2 by a factor of 10-15 to account for the slow down in the PAUSE insn:
-Xthr:spin1=256,spin2=3,yield=45,tryEnterSpin1=256,tryEnterSpin2=3,tryEnterYield=45,threeTierSpinCount1=256,threeTierSpinCount2=3,threeTierSpinCount3=45
[Experiment 4] Reduce yieldCount by a factor of 10-15 to account for the slow down in the PAUSE insn:
-Xthr:spin1=256,spin2=32,yield=4,tryEnterSpin1=256,tryEnterSpin2=32,tryEnterYield=4,threeTierSpinCount1=256,threeTierSpinCount2=32,threeTierSpinCount3=4
[Experiment 5] Reduce spinCount2 (by a factor of 3) and yieldCount (by a factor of 5) to account for 15x slow down in PAUSE:
-Xthr:spin1=256,spin2=11,yield=9,tryEnterSpin1=256,tryEnterSpin2=11,tryEnterYield=9,threeTierSpinCount1=256,threeTierSpinCount2=11,threeTierSpinCount3=9
[Experiment 6] Double the number of PAUSE insn to verify regression:
-Xthr:spin1=256,spin2=48,yield=60,tryEnterSpin1=256,tryEnterSpin2=48,tryEnterYield=60,threeTierSpinCount1=256,threeTierSpinCount2=48,threeTierSpinCount3=60
[Experiment 7] Default parameters
Benchmarks to be used
Bumblebench will be used as the framework for these experiments: https://github.com/AdoptOpenJDK/bumblebench/tree/master/net/adoptopenjdk/bumblebench Specific benchmark TBD
Machines to be used
TBD, but will involve one Skylake machine and one pre-Skylake.