coreos / bugs

Issue tracker for CoreOS Container Linux
https://coreos.com/os/eol/
146 stars 30 forks source link

Frequent CoreOS crashing on HP Gen9 #2108

Open x86brandon opened 7 years ago

x86brandon commented 7 years ago

Issue Report

We are seeing frequent CoreOS crashes across a fleet of DL 380 Gen 9's. Sometimes every few hours to every day or two. It's difficult to get a panic captured, but I managed to get a video from the iLO. pstore wasn't getting them.

Apologies in advance for the lack of quality on the screenshots. It took a lot just to get these.

Container Linux Version


$ cat /etc/os-release

NAME="Container Linux by CoreOS"
ID=coreos
VERSION=1409.6.0
VERSION_ID=1409.6.0
BUILD_ID=2017-07-06-0128
PRETTY_NAME="Container Linux by CoreOS 1409.6.0 (Ladybug)"
ANSI_COLOR="38;5;75"
HOME_URL="https://coreos.com/"
BUG_REPORT_URL="https://issues.coreos.com"
COREOS_BOARD="amd64-usr"

### Environment ###

HP DL 380 Gen 9, 256 GB RAM, Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz

Running Spark/Cassandra

![screen shot 2017-08-16 at 5 02 15 pm](https://user-images.githubusercontent.com/423954/29390434-3154210c-82a5-11e7-9176-00ae5f6bd50d.png)
![screen shot 2017-08-16 at 5 02 32 pm](https://user-images.githubusercontent.com/423954/29390437-315630d2-82a5-11e7-9d57-c18ff25c1718.png)
![screen shot 2017-08-16 at 5 02 36 pm](https://user-images.githubusercontent.com/423954/29390435-315466e4-82a5-11e7-90bb-d4632bd3d2ea.png)
![screen shot 2017-08-16 at 5 02 40 pm](https://user-images.githubusercontent.com/423954/29390436-31555360-82a5-11e7-8aa7-5959a147866b.png)
x86brandon commented 7 years ago

screen shot 2017-08-16 at 5 02 15 pm

x86brandon commented 7 years ago

screen shot 2017-08-16 at 5 02 32 pm

x86brandon commented 7 years ago

screen shot 2017-08-16 at 5 02 36 pm

x86brandon commented 7 years ago

Here is as slowed of a video as I can get.

https://www.youtube.com/watch?v=kUgeI3Zoelo

bgilbert commented 7 years ago

Was there a previous version of Container Linux that did not have this problem?

We'll shortly be rolling out a new stable release that updates to the 4.12 kernel. Please give that a try and let us know whether you're still seeing the issue.

x86brandon commented 7 years ago

@bgilbert Previous version also seemed to have issues.

x86brandon commented 7 years ago

@bgilbert Finally got a real good one. This is the 4.12 kernel that was released yesterday.

 [93390.395353]  run_timer_softirq+0x1db/0x440                                   
 [93390.400078]  ? sched_clock+0x9/0x10                                          
 [93390.404130]  ? sched_clock+0x9/0x10                                          
 [93390.408182]  ? sched_clock_cpu+0x11/0xb0                                     
 [93390.412707]  __do_softirq+0xf5/0x278                                         
 [93390.416844]  irq_exit+0xae/0xb0                                              
 [93390.420500]  smp_apic_timer_interrupt+0x3d/0x50                              
 [93390.425683]  apic_timer_interrupt+0x89/0x90                                  
 [93390.430496] RIP: 0033:0x7f8c15aae57d                                         
 [93390.434627] RSP: 002b:00007f8bb88dacc0 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10                                                                           
 [93390.443302] RAX: 0000000005675d00 RBX: 0000000542352440 RCX: 000000070d6e8fc8
 [93390.451362] RDX: 0000000542352440 RSI: 000000054470d7d8 RDI: 00000000f807bdac
 [93390.459460] RBP: 00000007137c4158 R08: 00000000a80077c3 R09: 00000000a80077c3
 [93390.467523] R10: 00000000000071ba R11: 0000006d05675d09 R12: 0000000000000000
 [93390.475574] R13: 000000054470d7d8 R14: 000000070d73f000 R15: 00007f8ae0004000
 [93390.483626]  </IRQ>                                                          
 [93390.486136] Code: 8b 45 00 85 c0 0f 84 d3 00 00 00 41 f6 46 18 80 0f 84 02 01 00 00 85 c0 0f 8e b8 00 00 00 31 db eb 3b ba ff ff ff ff 49 0f bd d4 <41> 80 bb 04 03 00 00 00 75 7d 49 8d bb 18 03 00 00 4c 89 e2 4c                          
 [93390.507431] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8c5e3f403e50       
 [93390.514834] CR2: 0000000000000304                                            
 [93390.518692] ---[ end trace 779ed8dd6dfa457e ]---                             
 [93390.529123] Kernel panic - not syncing: Fatal exception in interrupt         
 [93390.400078]  ? sched_clock+0x9/0x10                                          
 [93390.404130]  ? sched_clock+0x9/0x10                                          
 [93390.408182]  ? sched_clock_cpu+0x11/0xb0                                     
 [93390.412707]  __do_softirq+0xf5/0x278                                         
 [93390.416844]  irq_exit+0xae/0xb0                                              
 [93390.420500]  smp_apic_timer_interrupt+0x3d/0x50                              
 [93390.425683]  apic_timer_interrupt+0x89/0x90                                  
 [93390.430496] RIP: 0033:0x7f8c15aae57d                                         
 [93390.434627] RSP: 002b:00007f8bb88dacc0 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10                                                                           
 [93390.443302] RAX: 0000000005675d00 RBX: 0000000542352440 RCX: 000000070d6e8fc8
 [93390.451362] RDX: 0000000542352440 RSI: 000000054470d7d8 RDI: 00000000f807bdac
 [93390.459460] RBP: 00000007137c4158 R08: 00000000a80077c3 R09: 00000000a80077c3
 [93390.467523] R10: 00000000000071ba R11: 0000006d05675d09 R12: 0000000000000000
 [93390.475574] R13: 000000054470d7d8 R14: 000000070d73f000 R15: 00007f8ae0004000
 [93390.483626]  </IRQ>                                                          
 [93390.486136] Code: 8b 45 00 85 c0 0f 84 d3 00 00 00 41 f6 46 18 80 0f 84 02 01 00 00 85 c0 0f 8e b8 00 00 00 31 db eb 3b ba ff ff ff ff 49 0f bd d4 <41> 80 bb 04 03 00 00 00 75 7d 49 8d bb 18 03 00 00 4c 89 e2 4c                          
 [93390.507431] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8c5e3f403e50       
 [93390.514834] CR2: 0000000000000304                                            
 [93390.518692] ---[ end trace 779ed8dd6dfa457e ]---                             
 [93390.529123] Kernel panic - not syncing: Fatal exception in interrupt         
 [93391.591854] Shutting down cpus with NMI                                       04 03 00 00 00 75 7d 49 8d bb 18 03 00 00 4c 89 e2 4c                          
 [93390.507431] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8c5e3f403e50       
 [93390.514834] CR2: 0000000000000304                                            
 [93390.518692] ---[ end trace 779ed8dd6dfa457e ]---                             
 [93390.529123] Kernel panic - not syncing: Fatal exception in interrupt         
 [93391.591854] Shutting down cpus with NMI                                      
 [93391.833985] Kernel Offset: 0x2c000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)                                      
 [93391.851218] ---[ end Kernel panic - not syncing: Fatal exception in interrupt
 [93391.859288] sched: Unexpected reschedule of offline CPU#0!                   
 [93391.865531] ------------[ cut here ]------------                             
 [93391.870820] WARNING: CPU: 24 PID: 21589 at ../source/arch/x86/kernel/smp.c:128 native_smp_send_reschedule+0x3c/0x40                                          
 [93391.882661] Modules linked in: binfmt_misc xt_nat veth xfrm_user xfrm_algo xt_addrtype iptable_filter xt_conntrack br_netfilter bridge stp llc ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c crc32c_generic vxlan ip6_udp_tunnel udp_tunnel overlay bonding ipmi_ssif nls_ascii nls_cp437 vfat fat sb_edac edac_core coretemp x86_pkg_temp_thermal kvm_intel kvm irqbypass psmouse mousedev ipmi_si evdev pcc_cpufreq ipmi_devintf hpilo i2c_i801 ipmi_msghandler button sch_fq_codel ext4 crc16 jbd2 fscrypto mbcache sd_mod hid_generic usbhid hid crc32c_intel uhci_hcd igb xhci_pci i2c_algo_bit aesni_intel aes_x86_64 ehci_pci ixgbe xhci_hcd tg3 crypto_simd i2c_core hpsa ehci_hcd cryptd glue_helper hwmon ptp scsi_transport_sas usbcore pps_core                                                                                                                                                                                                                                                                                                                                                                                                   
 [93392.837633] R13: ffff8c5e2eb01f48 R14: ffff8c5e32903800 R15: 00000000000ff2a1
 [93392.845687]  ? iommu_flush_iotlb_psi+0x120/0x120                             
 [93392.850964]  call_timer_fn+0x35/0x140                                        
 [93392.855192]  run_timer_softirq+0x1db/0x440                                   
 [93392.859897]  ? sched_clock+0x9/0x10                                          
 [93392.863931]  ? sched_clock+0x9/0x10                                          
 [93392.867969]  ? sched_clock_cpu+0x11/0xb0                                     
 [93392.872484]  __do_softirq+0xf5/0x278                                         
 [93392.876616]  irq_exit+0xae/0xb0                                              
 [93392.880271]  smp_apic_timer_interrupt+0x3d/0x50                              
 [93392.885454]  apic_timer_interrupt+0x89/0x90                                  
 [93392.890256] RIP: 0033:0x7f8c15aae57d                                         
 [93392.894388] RSP: 002b:00007f8bb88dacc0 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10                                                                           
 [93392.903067] RAX: 0000000005675d00 RBX: 0000000542352440 RCX: 000000070d6e8fc8
 [93392.911116] RDX: 0000000542352440 RSI: 000000054470d7d8 RDI: 00000000f807bdac
 [93392.919171] RBP: 00000007137c4158 R08: 00000000a80077c3 R09: 00000000a80077c3
 [93392.927222] R10: 00000000000071ba R11: 0000006d05675d09 R12: 0000000000000000
 [93392.935276] R13: 000000054470d7d8 R14: 000000070d73f000 R15: 00007f8ae0004000
 [93392.943331]  </IRQ>                                                          
 [93392.945838] Code: cd 00 0f 92 c0 84 c0 74 14 48 8b 05 7f b0 9f 00 be fd 00 00 00 ff 90 a0 00 00 00 5d c3 89 fe 48 c7 c7 88 8a 9c ad e8 07 a2 13 00 <0f> ff 5d c3 0f 1f 44 00 00 8b 05 bd ef cb 02 85 c0 74 01 c3 55                          
 [93392.967127] ---[ end trace 779ed8dd6dfa4580 ]---
x86brandon commented 7 years ago
   [108889.367676] BUG: unable to handle kernel NULL pointer dereference at 0000000000000304                                                                       
   [108889.376753] IP: flush_unmaps_timeout+0xa7/0x1c0                             
   [108889.382045] PGD 207174a067                                                  
   [108889.382045] P4D 207174a067                                                  
   [108889.385414] PUD 1fd1078067                                                  
   [108889.388780] PMD 0                                                           
   [108889.392145]                                                                 
   [108889.396586] Oops: 0000 [#1] SMP                                             
   [108889.400335] Modules linked in: mousedev hid_generic usbhid hid binfmt_misc xt_nat veth xfrm_user xfrm_algo xt_addrtype iptable_filter xt_conntrack br_netfilter bridge stp llc ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c crc32c_generic vxlan ip6_udp_tunnel udp_tunnel overlay bonding nls_ascii nls_cp437 ipmi_ssif vfat fat sb_edac edac_core coretemp x86_pkg_temp_thermal kvm_intel kvm psmouse evdev irqbypass ipmi_si pcc_cpufreq ipmi_devintf i2c_i801 hpilo ipmi_msghandler button sch_fq_codel ext4 crc16 jbd2 fscrypto mbcache sd_mod uhci_hcd crc32c_intel igb aesni_intel ehci_pci xhci_pci ehci_hcd aes_x86_64 i2c_algo_bit crypto_simd ixgbe xhci_hcd tg3 i2c_core cryptd hpsa glue_helper hwmon ptp usbcore scsi_transport_sas pps_core                                                                  
   [108889.655892] RDX: 0000000000000000 RSI: ffff8d9fbf218618 RDI: 0000000000000000                                                                               
   [108889.664182] RBP: ffffa21b58983ea0 R08: 0000000000000001 R09: 00000000fffffff
   [108889.672473] R10: ffffa21b58983e38 R11: ffff8d9fbf217e24 R12: 0000000000000001                                                                               
   [108889.680767] R13: 0000000000000001 R14: 0000000000000008 R15: 00006308c813a51
   [108889.689105]  </IRQ>                                                         
   [108889.691707]  ? cpuidle_enter_state+0xd4/0x270                               
   [108889.696795]  cpuidle_enter+0x17/0x20                                        
   [108889.701024]  call_cpuidle+0x23/0x40                                         
   [108889.705157]  do_idle+0x17f/0x1d0                                            
   [108889.709003]  cpu_startup_entry+0x71/0x80                                    
   [108889.713615]  start_secondary+0x151/0x190                                    
   [108889.718225]  secondary_startup_64+0x9f/0x9f                                 
   [108889.723120] Code: 8b 45 00 85 c0 0f 84 d3 00 00 00 41 f6 46 18 80 0f 84 02 01 00 00 85 c0 0f 8e b8 00 00 00 31 db eb 3b ba ff ff ff ff 49 0f bd d4 <41> 80 bb 04 03 00 00 00 75 7d 49 8d bb 18 03 00 00 4c 89 e2 4c                         
   [108889.744483] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8d9fbf203e50      
   [108889.751960] CR2: 0000000000000304                                           
   [108889.755909] ---[ end trace be85bac082d84df1 ]---                            
   [108889.765360] Kernel panic - not syncing: Fatal exception in interrupt                                                                                        
   [108889.744483] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8d9fbf203e50      
   [108889.751960] CR2: 0000000000000304                                           
   [108889.755909] ---[ end trace be85bac082d84df1 ]---                            
   [108889.765360] Kernel panic - not syncing: Fatal exception in interrupt        
   [108890.127488] Kernel Offset: 0x1a000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)                                     
   [108890.146085] ERST: [Firmware Warn]: Firmware does not respond in time.       
   [108890.153470] ---[ end Kernel panic - not syncing: Fatal exception in interrupt                                                                               
   [108890.161776] sched: Unexpected reschedule of offline CPU#0!                  
   [108890.168117] ------------[ cut here ]------------                            
   [108890.173499] WARNING: CPU: 8 PID: 0 at ../source/arch/x86/kernel/smp.c:128 native_smp_send_reschedule+0x3c/0x40                                              
   [108890.188499] Modules linked in: mousedev hid_generic usbhid hid binfmt_misc xt_nat veth xfrm_user xfrm_algo xt_addrtype iptable_filter xt_conntrack br_netfilter bridge stp llc ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c crc32c_generic vxlan ip6_udp_tunnel udp_tunnel overlay bonding nls_ascii nls_cp437 ipmi_ssif vfat fat sb_edac edac_core coretemp x86_pkg_temp_thermal kvm_intel kvm psmouse evdev irqbypass ipmi_si pcc_cpufreq ipmi_devintf i2c_i801 hpilo ipmi_msghandler button sch_fq_codel ext4 crc16 jbd2 fscrypto mbcache sd_mod uhci_hcd crc32c_intel igb aesni_intel ehci_pci xhci_pci ehci_hcd aes_x86_64 i2c_algo_bit crypto_simd ixgbe xhci_hcd tg3 i2c_core cryptd hpsa glue_helper hwmon ptp usbcore scsi_transport_sas pps_core                                                                                                                                                  6                                                                                                                                                               
   [108890.663280] RSP: 0018:ffffa21b58983e68 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10                                                                          
   [108890.672046] RAX: ffff8d9fbf21ae00 RBX: ffffc21b3fa02100 RCX: 000000000000001f                                                                               
   [108890.680336] RDX: 0000000000000000 RSI: ffff8d9fbf218618 RDI: 0000000000000000                                                                               
   [108890.688681] RBP: ffffa21b58983ea0 R08: 0000000000000001 R09: 00000000ffffffff                                                                               
   [108890.696976] R10: ffffa21b58983e38 R11: ffff8d9fbf217e24 R12: 0000000000000001                                                                               
   [108890.705267] R13: 0000000000000001 R14: 0000000000000008 R15: 00006308c813a51f                                                                               
   [108890.713552]  </IRQ>                                                         
   [108890.716155]  ? cpuidle_enter_state+0xd4/0x270                               
   [108890.721243]  cpuidle_enter+0x17/0x20                                        
   [108890.725469]  call_cpuidle+0x23/0x40                                         
   [108890.729600]  do_idle+0x17f/0x1d0                                            
   [108890.733445]  cpu_startup_entry+0x71/0x80                                    
   [108890.738057]  start_secondary+0x151/0x190                                    
   [108890.742671]  secondary_startup_64+0x9f/0x9f                                 
   [108890.747570] Code: cd 00 0f 92 c0 84 c0 74 14 48 8b 05 7f b0 9f 00 be fd 00 00 00 ff 90 a0 00 00 00 5d c3 89 fe 48 c7 c7 88 8a 9c 9b e8 07 a2 13 00 <0f> ff 5d c3 0f 1f 44 00 00 8b 05 bd ef cb 02 85 c0 74 01 c3 55                         
   [108890.768935] ---[ end trace be85bac082d84df2 ]---
x86brandon commented 7 years ago

From another host.

x86brandon commented 7 years ago
 [441582.843551] BUG: unable to handle kernel NULL pointer dereference at 0000000000000304                                                                       
 [441582.852624] IP: flush_unmaps_timeout+0xa7/0x1c0                             
 [441582.857904] PGD 0                                                           
 [441582.857904] P4D 0                                                           
 [441582.860414]                                                                 
 [441582.864867] Oops: 0000 [#1] SMP                                             
 [441582.868616] Modules linked in: binfmt_misc xt_nat veth xfrm_user xfrm_algo xt_addrtype iptable_filter xt_conntrack br_netfilter bridge stp llc ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c crc32c_generic vxlan ip6_udp_tunnel udp_tunnel overlay bonding ipmi_ssif sb_edac nls_ascii edac_core nls_cp437 vfat fat coretemp x86_pkg_temp_thermal kvm_intel kvm ipmi_si irqbypass psmouse mousedev evdev pcc_cpufreq ipmi_devintf i2c_i801 hpilo ipmi_msghandler button sch_fq_codel ext4 crc16 jbd2 fscrypto mbcache sd_mod hid_generic usbhid hid uhci_hcd crc32c_intel igb aesni_intel i2c_algo_bit aes_x86_64 tg3 xhci_pci ehci_pci i2c_core ixgbe crypto_simd cryptd xhci_hcd ehci_hcd glue_helper hpsa hwmon ptp scsi_transport_sas usbcore pps_core                                                                  f                                                                               
 [441583.133184] RDX: 0000000000000000 RSI: ffff8a723f258618 RDI: 0000000000000000                                                                               
 [441583.141473] RBP: ffff9aaed898bea0 R08: 0000000000000001 R09: 0000000000000036                                                                               
 [441583.149799] R10: ffff9aaed898be38 R11: ffff8a723f257e24 R12: 0000000000000001                                                                               
 [441583.158108] R13: 0000000000000001 R14: 0000000000000009 R15: 0001919e0486aa27                                                                               
 [441583.170102]  </IRQ>                                                         
 [441583.172706]  ? cpuidle_enter_state+0xd4/0x270                               
 [441583.177816]  cpuidle_enter+0x17/0x20                                        
 [441583.182054]  call_cpuidle+0x23/0x40                                         
 [441583.186183]  do_idle+0x17f/0x1d0                                            
 [441583.190028]  cpu_startup_entry+0x71/0x80                                    
 [441583.194639]  start_secondary+0x151/0x190                                    
 [441583.199272]  secondary_startup_64+0x9f/0x9f                                 
 [441583.204168] Code: 8b 45 00 85 c0 0f 84 d3 00 00 00 41 f6 46 18 80 0f 84 02 01 00 00 85 c0 0f 8e b8 00 00 00 31 db eb 3b ba ff ff ff ff 49 0f bd d4 <41> 80 bb 04 03 00 00 00 75 7d 49 8d bb 18 03 00 00 4c 89 e2 4c                         
 [441583.225544] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8a723f243e50      
 [441583.233035] CR2: 0000000000000304                                           
 [441583.236984] ---[ end trace e2608e03bf6fdf7d ]---                            
 [441583.246798] Kernel panic - not syncing: Fatal exception in interrupt                                                                                        
 [441583.133184] RDX: 0000000000000000 RSI: ffff8a723f258618 RDI: 0000000000000000                                                                               
 [441583.141473] RBP: ffff9aaed898bea0 R08: 0000000000000001 R09: 0000000000000036                                                                               
 [441583.149799] R10: ffff9aaed898be38 R11: ffff8a723f257e24 R12: 0000000000000001                                                                               
 [441583.158108] R13: 0000000000000001 R14: 0000000000000009 R15: 0001919e0486aa27                                                                               
 [441583.170102]  </IRQ>                                                         
 [441583.172706]  ? cpuidle_enter_state+0xd4/0x270                               
 [441583.177816]  cpuidle_enter+0x17/0x20                                        
 [441583.182054]  call_cpuidle+0x23/0x40                                        
 [441583.186183]  do_idle+0x17f/0x1d0                                            
 [441583.190028]  cpu_startup_entry+0x71/0x80                                    
 [441583.194639]  start_secondary+0x151/0x190                                    
 [441583.199272]  secondary_startup_64+0x9f/0x9f                                 
 [441583.204168] Code: 8b 45 00 85 c0 0f 84 d3 00 00 00 41 f6 46 18 80 0f 84 02 01 00 00 85 c0 0f 8e b8 00 00 00 31 db eb 3b ba ff ff ff ff 49 0f bd d4 <41> 80 bb 04 03 00 00 00 75 7d 49 8d bb 18 03 00 00 4c 89 e2 4c                         
 [441583.225544] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8a723f243e50      
 [441583.233035] CR2: 0000000000000304                                           
 [441583.236984] ---[ end trace e2608e03bf6fdf7d ]---                            
 [441583.246798] Kernel panic - not syncing: Fatal exception in interrupt        
 [441584.298981] Shutting down cpus with NMI                                     
 [441583.149799] R10: ffff9aaed898be38 R11: ffff8a723f257e24 R12: 0000000000000001                                                                               
 [441583.158108] R13: 0000000000000001 R14: 0000000000000009 R15: 0001919e0486aa27                                                                               
 [441583.170102]  </IRQ>                                                         
 [441583.172706]  ? cpuidle_enter_state+0xd4/0x270                               
 [441583.177816]  cpuidle_enter+0x17/0x20                                        
 [441583.182054]  call_cpuidle+0x23/0x40                                         
 [441583.186183]  do_idle+0x17f/0x1d0                                            
 [441583.190028]  cpu_startup_entry+0x71/0x80                                    
 [441583.194639]  start_secondary+0x151/0x190                                    
 [441583.199272]  secondary_startup_64+0x9f/0x9f                                
 [441583.204168] Code: 8b 45 00 85 c0 0f 84 d3 00 00 00 41 f6 46 18 80 0f 84 02 01 00 00 85 c0 0f 8e b8 00 00 00 31 db eb 3b ba ff ff ff ff 49 0f bd d4 <41> 80 bb 04 03 00 00 00 75 7d 49 8d bb 18 03 00 00 4c 89 e2 4c                         
 [441583.225544] RIP: flush_unmaps_timeout+0xa7/0x1c0 RSP: ffff8a723f243e50      
 [441583.233035] CR2: 0000000000000304                                           
 [441583.236984] ---[ end trace e2608e03bf6fdf7d ]---                            
 [441583.246798] Kernel panic - not syncing: Fatal exception in interrupt        
 [441584.298981] Shutting down cpus with NMI                                     
 [441584.487072] Kernel Offset: 0x38000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)                                     
 [441584.504464] ---[ end Kernel panic - not syncing: Fatal exception in interrupt

Another one

bgilbert commented 7 years ago

Thanks for the detailed info. flush_unmaps_timeout+0xa7 is this line:

https://github.com/coreos/linux/blob/5614d6af6222fab53adddc3258cf8c28b9be3030/drivers/iommu/intel-iommu.c#L1575

Could you post the output of dmesg from one of these machines when it's running normally?

As a workaround, you could try passing intel_iommu=strict on the kernel command line, or if that doesn't work, intel_iommu=off. If you're booting from disk rather than PXE, see these examples for adding kernel arguments to the GRUB config.

x86brandon commented 7 years ago
[    0.000000] Linux version 4.12.7-coreos (jenkins@jenkins-worker-1) (gcc version 4.9.4 (Gentoo Hardened 4.9.4 p1.0, pie-0.6.4) ) #1 SMP Tue Aug 15 23:54:56 UTC 2017
[    0.000000] Command line: BOOT_IMAGE=/coreos/vmlinuz-b mount.usr=PARTUUID=e03dd35c-7c2d-4a47-b3fe-27f15780a57c rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 verity.usrhash=909bed8701dbc93906cc0d718e308d1e415366a23cc5a4868ad7a6538a2e6dca
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x0000000000093fff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000094000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005a700fff] usable
[    0.000000] BIOS-e820: [mem 0x000000005a701000-0x000000005b540fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000005b541000-0x00000000790fefff] usable
[    0.000000] BIOS-e820: [mem 0x00000000790ff000-0x00000000791fefff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000791ff000-0x000000007b5fefff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000007b5ff000-0x000000007b7fefff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000007b7ff000-0x000000007b7fffff] usable
[    0.000000] BIOS-e820: [mem 0x000000007b800000-0x000000008fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff800000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000407fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.8 present.
[    0.000000] DMI: HP ProLiant DL380 Gen9/ProLiant DL380 Gen9, BIOS P89 02/17/2017
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] e820: last_pfn = 0x4080000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: write-back
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-DFFFF write-protect
[    0.000000]   E0000-EFFFF uncachable
[    0.000000]   F0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 000080000000 mask 3FFF80000000 uncachable
[    0.000000]   1 base 004080000000 mask 3FFF80000000 uncachable
[    0.000000]   2 base 008000000000 mask 3F8000000000 uncachable
[    0.000000]   3 base 010000000000 mask 3F0000000000 uncachable
[    0.000000]   4 base 038000000000 mask 3FC000000000 uncachable
[    0.000000]   5 base 00007C000000 mask 3FFFFC000000 uncachable
[    0.000000]   6 base 00007FC00000 mask 3FFFFFC00000 uncachable
[    0.000000]   7 disabled
[    0.000000]   8 disabled
[    0.000000]   9 disabled
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WC  UC- WT
[    0.000000] e820: last_pfn = 0x7b800 max_arch_pfn = 0x400000000
[    0.000000] Base memory trampoline at [ffff9e02c008d000] 8d000 size 28672
[    0.000000] Using GB pages for direct mapping
[    0.000000] BRK [0x1cdbda6000, 0x1cdbda6fff] PGTABLE
[    0.000000] BRK [0x1cdbda7000, 0x1cdbda7fff] PGTABLE
[    0.000000] BRK [0x1cdbda8000, 0x1cdbda8fff] PGTABLE
[    0.000000] BRK [0x1cdbda9000, 0x1cdbda9fff] PGTABLE
[    0.000000] BRK [0x1cdbdaa000, 0x1cdbdaafff] PGTABLE
[    0.000000] BRK [0x1cdbdab000, 0x1cdbdabfff] PGTABLE
[    0.000000] BRK [0x1cdbdac000, 0x1cdbdacfff] PGTABLE
[    0.000000] BRK [0x1cdbdad000, 0x1cdbdadfff] PGTABLE
[    0.000000] BRK [0x1cdbdae000, 0x1cdbdaefff] PGTABLE
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F4F00 000024 (v02 HP    )
[    0.000000] ACPI: XSDT 0x000000007B7E8188 0000EC (v01 HP     ProLiant 00000001      01000013)
[    0.000000] ACPI: FACP 0x000000007B7F6000 00010C (v05 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: DSDT 0x000000007B7DF000 0080E4 (v02 HP     DSDT     00000002 HPAG 00020000)
[    0.000000] ACPI: FACS 0x000000007B541000 000040
[    0.000000] ACPI: UEFI 0x000000007B579000 000042 (v01 HP     ProLiant 00000002      01000013)
[    0.000000] ACPI: MCEJ 0x000000007B7FC000 000130 (v01 HP     ProLiant 00000001 INTL 0100000D)
[    0.000000] ACPI: SSDT 0x000000007B7FB000 000064 (v02 HP     SpsNvs   00000002 INTL 20130328)
[    0.000000] ACPI: HEST 0x000000007B7FA000 0000A8 (v01 HP     ProLiant 00000001 INTL 00000001)
[    0.000000] ACPI: BERT 0x000000007B7F9000 000030 (v01 HP     ProLiant 00000001 INTL 00000001)
[    0.000000] ACPI: ERST 0x000000007B7F8000 000230 (v01 HP     ProLiant 00000001 INTL 00000001)
[    0.000000] ACPI: EINJ 0x000000007B7F7000 000150 (v01 HP     ProLiant 00000001 INTL 00000001)
[    0.000000] ACPI: HPET 0x000000007B7F5000 000038 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: PMCT 0x000000007B7F4000 000064 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: WDDT 0x000000007B7F3000 000040 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: APIC 0x000000007B7F2000 0003EA (v03 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: MCFG 0x000000007B7F1000 00003C (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: SLIT 0x000000007B7F0000 000030 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: SRAT 0x000000007B7EF000 000380 (v03 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: SPMI 0x000000007B7EE000 000041 (v05 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: RASF 0x000000007B7ED000 000030 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: SPCR 0x000000007B7EC000 000050 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: MSCT 0x000000007B7EB000 000064 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: BDAT 0x000000007B7EA000 000030 (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: PCCT 0x000000007B7E9000 00006E (v01 HP     ProLiant 00000001 HP   00000001)
[    0.000000] ACPI: SSDT 0x000000007B7D8000 006FBE (v02 HP     PCISSDT  00000002 HPAG 00020000)
[    0.000000] ACPI: SSDT 0x000000007B7D7000 0001CB (v02 HP     TIMESSDT 00000002 HPAG 00020000)
[    0.000000] ACPI: SSDT 0x000000007B7D6000 0002F2 (v01 HP     pmab     00000001 INTL 20130328)
[    0.000000] ACPI: DMAR 0x000000007B7FD000 000380 (v01 INTEL  INTEL ID 00000001 ?    00000001)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] SRAT: PXM 0 -> APIC 0x0000 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0002 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0004 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0006 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0008 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x000a -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x000c -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x000e -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x0010 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0012 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0014 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0016 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0018 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x001a -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x001c -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x001e -> Node 1
[    0.000000] SRAT: PXM 0 -> APIC 0x0001 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0003 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0005 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0007 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x0009 -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x000b -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x000d -> Node 0
[    0.000000] SRAT: PXM 0 -> APIC 0x000f -> Node 0
[    0.000000] SRAT: PXM 1 -> APIC 0x0011 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0013 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0015 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0017 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x0019 -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x001b -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x001d -> Node 1
[    0.000000] SRAT: PXM 1 -> APIC 0x001f -> Node 1
[    0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x207fffffff]
[    0.000000] ACPI: SRAT: Node 1 PXM 1 [mem 0x2080000000-0x407fffffff]
[    0.000000] NUMA: Initialized distance table, cnt=2
[    0.000000] NODE_DATA(0) allocated [mem 0x207fffa000-0x207fffffff]
[    0.000000] NODE_DATA(1) allocated [mem 0x407fff9000-0x407fffefff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x000000407fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x0000000000093fff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x000000005a700fff]
[    0.000000]   node   0: [mem 0x000000005b541000-0x00000000790fefff]
[    0.000000]   node   0: [mem 0x000000007b7ff000-0x000000007b7fffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x000000207fffffff]
[    0.000000]   node   1: [mem 0x0000002080000000-0x000000407fffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000207fffffff]
[    0.000000] On node 0 totalpages: 33522259
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 22 pages reserved
[    0.000000]   DMA zone: 3987 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 7627 pages used for memmap
[    0.000000]   DMA32 zone: 488128 pages, LIFO batch:31
[    0.000000]   Normal zone: 516096 pages used for memmap
[    0.000000]   Normal zone: 33030144 pages, LIFO batch:31
[    0.000000] Initmem setup node 1 [mem 0x0000002080000000-0x000000407fffffff]
[    0.000000] On node 1 totalpages: 33554432
[    0.000000]   Normal zone: 524288 pages used for memmap
[    0.000000]   Normal zone: 33554432 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: X2APIC_NMI (uid[0x00] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x01] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x02] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x03] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x04] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x05] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x06] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x07] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x08] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x09] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x0a] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x0b] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x0c] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x0d] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x0e] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x0f] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x10] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x11] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x12] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x13] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x14] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x15] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x16] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x17] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x18] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x19] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x1a] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x1b] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x1c] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x1d] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x1e] high level lint[0x1])
[    0.000000] ACPI: X2APIC_NMI (uid[0x1f] high level lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high level lint[0x1])
[    0.000000] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[    0.000000] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47
[    0.000000] IOAPIC[2]: apic_id 10, version 32, address 0xfec40000, GSI 48-71
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 32 CPUs, 0 hotplug CPUs
[    0.000000] e820: [mem 0x90000000-0xff7fffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:32 nr_node_ids:2
[    0.000000] percpu: Embedded 37 pages/cpu @ffff9e22bfa00000 s114648 r8192 d28712 u262144
[    0.000000] pcpu-alloc: s114648 r8192 d28712 u262144 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 16 17 18 19 20 21 22 23
[    0.000000] pcpu-alloc: [1] 08 09 10 11 12 13 14 15 [1] 24 25 26 27 28 29 30 31
[    0.000000] Built 2 zonelists in Node order, mobility grouping on.  Total pages: 66028594
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: rootflags=rw mount.usrflags=ro BOOT_IMAGE=/coreos/vmlinuz-b mount.usr=PARTUUID=e03dd35c-7c2d-4a47-b3fe-27f15780a57c rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 verity.usrhash=909bed8701dbc93906cc0d718e308d1e415366a23cc5a4868ad7a6538a2e6dca
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] Memory: 263994676K/268306764K available (6239K kernel code, 1215K rwdata, 2652K rodata, 32412K init, 744K bss, 4312088K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=32, Nodes=2
[    0.000000] ftrace: allocating 26291 entries in 103 pages
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  RCU debugfs-based tracing is enabled.
[    0.000000]  RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=32.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=32
[    0.000000] NR_IRQS:33024 nr_irqs:1496 16
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[    0.000000] hpet clockevent registered
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.001000] tsc: Detected 2397.081 MHz processor
[    0.002000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4794.16 BogoMIPS (lpj=2397081)
[    0.003005] pid_max: default: 32768 minimum: 301
[    0.004021] ACPI: Core revision 20170303
[    0.008366] ACPI: 5 ACPI AML tables successfully acquired and loaded
[    0.009054] Security Framework initialized
[    0.010002] SELinux:  Initializing.
[    0.011010] SELinux:  Starting in permissive mode
[    0.021367] Dentry cache hash table entries: 33554432 (order: 16, 268435456 bytes)
[    0.066550] Inode-cache hash table entries: 16777216 (order: 15, 134217728 bytes)
[    0.086531] Mount-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.087185] Mountpoint-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.089924] CPU: Physical Processor ID: 0
[    0.090003] CPU: Processor Core ID: 0
[    0.091008] mce: CPU supports 22 MCE banks
[    0.092017] CPU0: Thermal monitoring enabled (TM1)
[    0.093020] process: using mwait in idle threads
[    0.094004] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024
[    0.095002] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4
[    0.097199] Freeing SMP alternatives memory: 24K
[    0.099590] smpboot: Max logical packages: 4
[    0.100020] DMAR: Host address width 46
[    0.101003] DMAR: DRHD base: 0x000000fbffc000 flags: 0x0
[    0.102009] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap d2078c106f0466 ecap f020de
[    0.103002] DMAR: DRHD base: 0x000000c7ffc000 flags: 0x1
[    0.104009] DMAR: dmar1: reg_base_addr c7ffc000 ver 1:0 cap d2078c106f0466 ecap f020de
[    0.105002] DMAR: RMRR base: 0x00000079170000 end: 0x00000079172fff
[    0.106005] DMAR: RMRR base: 0x000000791f4000 end: 0x000000791f7fff
[    0.107004] DMAR: RMRR base: 0x000000791de000 end: 0x000000791f3fff
[    0.108008] DMAR: RMRR base: 0x000000791cb000 end: 0x000000791dbfff
[    0.109004] DMAR: RMRR base: 0x000000791dc000 end: 0x000000791ddfff
[    0.110002] DMAR: RMRR base: 0x0000005a701000 end: 0x0000005a740fff
[    0.111004] DMAR: ATSR flags: 0x0
[    0.112005] DMAR: ATSR flags: 0x0
[    0.113006] DMAR-IR: IOAPIC id 10 under DRHD base  0xfbffc000 IOMMU 0
[    0.114002] DMAR-IR: IOAPIC id 8 under DRHD base  0xc7ffc000 IOMMU 1
[    0.115002] DMAR-IR: IOAPIC id 9 under DRHD base  0xc7ffc000 IOMMU 1
[    0.116002] DMAR-IR: HPET id 0 under DRHD base 0xc7ffc000
[    0.117005] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[    0.118840] DMAR-IR: Enabled IRQ remapping in x2apic mode
[    0.119000] x2apic enabled
[    0.119005] Switched APIC routing to cluster x2apic.
[    0.121560] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.131376] TSC deadline timer enabled
[    0.131381] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz (family: 0x6, model: 0x3f, stepping: 0x2)
[    0.132118] Performance Events: PEBS fmt2+, Haswell events, full-width counters, Broken BIOS detected, complain to your hardware vendor.
[    0.133002] [Firmware Bug]: the BIOS has corrupted hw-PMU resources (MSR 38d is 330)
[    0.134001] Intel PMU driver.
[    0.135006] ... version:                3
[    0.136001] ... bit width:              48
[    0.137000] ... generic registers:      4
[    0.138001] ... value mask:             0000ffffffffffff
[    0.139001] ... max period:             00007fffffffffff
[    0.140000] ... fixed-purpose events:   3
[    0.141001] ... event mask:             000000070000000f
[    0.143802] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[    0.144018] smp: Bringing up secondary CPUs ...
[    0.145091] x86: Booting SMP configuration:
[    0.146001] .... node  #0, CPUs:        #1  #2  #3  #4  #5  #6  #7
[    0.567002] .... node  #1, CPUs:    #8  #9 #10 #11 #12 #13 #14 #15
[    1.051003] .... node  #0, CPUs:   #16 #17 #18 #19 #20 #21 #22 #23
[    1.533002] .... node  #1, CPUs:   #24 #25 #26 #27 #28 #29 #30 #31
[    2.016058] smp: Brought up 2 nodes, 32 CPUs
[    2.018002] smpboot: Total of 32 processors activated (153639.02 BogoMIPS)
[    2.020752] sched_clock: Marking stable (2020000000, 0)->(2439500342, -419500342)
[    2.036239] devtmpfs: initialized
[    2.040129] x86/mm: Memory block size: 2048MB
[    2.047566] PM: Registering ACPI NVS region [mem 0x791ff000-0x7b5fefff] (37748736 bytes)
[    2.057728] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    2.068823] futex hash table entries: 8192 (order: 7, 524288 bytes)
[    2.076152] pinctrl core: initialized pinctrl subsystem
[    2.082874] NET: Registered protocol family 16
[    2.088117] cpuidle: using governor menu
[    2.092641] Error parsing PCC subspaces from PCCT
[    2.098057] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    2.106724] ACPI: bus type PCI registered
[    2.111329] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    2.118674] dca service started, version 1.12.1
[    2.123867] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[    2.134455] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
[    2.142133] PCI: Using configuration type 1 for base access
[    2.148460] PCI: HP ProLiant DL380 detected, enabling pci=bfsort.
[    2.155656] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    2.165315] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    2.172523] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    2.180393] ACPI: Added _OSI(Module Device)
[    2.185205] ACPI: Added _OSI(Processor Device)
[    2.190301] ACPI: Added _OSI(3.0 _SCP Extensions)
[    2.195681] ACPI: Added _OSI(Processor Aggregator Device)
[    2.207974] ACPI: Interpreter enabled
[    2.212218] ACPI: (supports S0 S5)
[    2.216165] ACPI: Using IOAPIC for interrupt routing
[    2.226015] HEST: Table parsing has been initialized.
[    2.231781] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    2.248213] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus 7f])
[    2.254936] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.264294] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    2.271810] PCI host bridge to bus 0000:7f
[    2.276522] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.282482] pci 0000:7f:08.0: [8086:2f80] type 00 class 0x088000
[    2.282537] pci 0000:7f:08.3: [8086:2f83] type 00 class 0x088000
[    2.282584] pci 0000:7f:09.0: [8086:2f90] type 00 class 0x088000
[    2.282628] pci 0000:7f:09.3: [8086:2f93] type 00 class 0x088000
[    2.282673] pci 0000:7f:0b.0: [8086:2f81] type 00 class 0x088000
[    2.282707] pci 0000:7f:0b.1: [8086:2f36] type 00 class 0x110100
[    2.282746] pci 0000:7f:0b.2: [8086:2f37] type 00 class 0x110100
[    2.282787] pci 0000:7f:0c.0: [8086:2fe0] type 00 class 0x088000
[    2.282824] pci 0000:7f:0c.1: [8086:2fe1] type 00 class 0x088000
[    2.282863] pci 0000:7f:0c.2: [8086:2fe2] type 00 class 0x088000
[    2.282901] pci 0000:7f:0c.3: [8086:2fe3] type 00 class 0x088000
[    2.282940] pci 0000:7f:0c.4: [8086:2fe4] type 00 class 0x088000
[    2.282978] pci 0000:7f:0c.5: [8086:2fe5] type 00 class 0x088000
[    2.283014] pci 0000:7f:0c.6: [8086:2fe6] type 00 class 0x088000
[    2.283050] pci 0000:7f:0c.7: [8086:2fe7] type 00 class 0x088000
[    2.283094] pci 0000:7f:0f.0: [8086:2ff8] type 00 class 0x088000
[    2.283127] pci 0000:7f:0f.1: [8086:2ff9] type 00 class 0x088000
[    2.283166] pci 0000:7f:0f.4: [8086:2ffc] type 00 class 0x088000
[    2.283203] pci 0000:7f:0f.5: [8086:2ffd] type 00 class 0x088000
[    2.283241] pci 0000:7f:0f.6: [8086:2ffe] type 00 class 0x088000
[    2.283283] pci 0000:7f:10.0: [8086:2f1d] type 00 class 0x088000
[    2.283320] pci 0000:7f:10.1: [8086:2f34] type 00 class 0x110100
[    2.283359] pci 0000:7f:10.5: [8086:2f1e] type 00 class 0x088000
[    2.283395] pci 0000:7f:10.6: [8086:2f7d] type 00 class 0x110100
[    2.283432] pci 0000:7f:10.7: [8086:2f1f] type 00 class 0x088000
[    2.283470] pci 0000:7f:12.0: [8086:2fa0] type 00 class 0x088000
[    2.283512] pci 0000:7f:12.1: [8086:2f30] type 00 class 0x110100
[    2.283554] pci 0000:7f:12.2: [8086:2f70] type 00 class 0x088000
[    2.283593] pci 0000:7f:13.0: [8086:2fa8] type 00 class 0x088000
[    2.283636] pci 0000:7f:13.1: [8086:2f71] type 00 class 0x088000
[    2.283679] pci 0000:7f:13.2: [8086:2faa] type 00 class 0x088000
[    2.283722] pci 0000:7f:13.3: [8086:2fab] type 00 class 0x088000
[    2.283764] pci 0000:7f:13.4: [8086:2fac] type 00 class 0x088000
[    2.283806] pci 0000:7f:13.5: [8086:2fad] type 00 class 0x088000
[    2.283847] pci 0000:7f:13.6: [8086:2fae] type 00 class 0x088000
[    2.283886] pci 0000:7f:13.7: [8086:2faf] type 00 class 0x088000
[    2.283926] pci 0000:7f:14.0: [8086:2fb0] type 00 class 0x088000
[    2.283969] pci 0000:7f:14.1: [8086:2fb1] type 00 class 0x088000
[    2.284013] pci 0000:7f:14.2: [8086:2fb2] type 00 class 0x088000
[    2.284051] pci 0000:7f:14.3: [8086:2fb3] type 00 class 0x088000
[    2.284095] pci 0000:7f:14.4: [8086:2fbc] type 00 class 0x088000
[    2.284135] pci 0000:7f:14.5: [8086:2fbd] type 00 class 0x088000
[    2.284175] pci 0000:7f:14.6: [8086:2fbe] type 00 class 0x088000
[    2.284218] pci 0000:7f:14.7: [8086:2fbf] type 00 class 0x088000
[    2.284265] pci 0000:7f:15.0: [8086:2fb4] type 00 class 0x088000
[    2.284308] pci 0000:7f:15.1: [8086:2fb5] type 00 class 0x088000
[    2.284350] pci 0000:7f:15.2: [8086:2fb6] type 00 class 0x088000
[    2.284393] pci 0000:7f:15.3: [8086:2fb7] type 00 class 0x088000
[    2.284439] pci 0000:7f:16.0: [8086:2f68] type 00 class 0x088000
[    2.284487] pci 0000:7f:16.6: [8086:2f6e] type 00 class 0x088000
[    2.284524] pci 0000:7f:16.7: [8086:2f6f] type 00 class 0x088000
[    2.284565] pci 0000:7f:17.0: [8086:2fd0] type 00 class 0x088000
[    2.284607] pci 0000:7f:17.4: [8086:2fb8] type 00 class 0x088000
[    2.284646] pci 0000:7f:17.5: [8086:2fb9] type 00 class 0x088000
[    2.284685] pci 0000:7f:17.6: [8086:2fba] type 00 class 0x088000
[    2.284724] pci 0000:7f:17.7: [8086:2fbb] type 00 class 0x088000
[    2.284768] pci 0000:7f:1e.0: [8086:2f98] type 00 class 0x088000
[    2.284810] pci 0000:7f:1e.1: [8086:2f99] type 00 class 0x088000
[    2.284848] pci 0000:7f:1e.2: [8086:2f9a] type 00 class 0x088000
[    2.284887] pci 0000:7f:1e.3: [8086:2fc0] type 00 class 0x088000
[    2.284913] pci 0000:7f:1e.4: [8086:2f9c] type 00 class 0x088000
[    2.285125] pci 0000:7f:1f.0: [8086:2f88] type 00 class 0x088000
[    2.285160] pci 0000:7f:1f.2: [8086:2f8a] type 00 class 0x088000
[    2.285228] ACPI: PCI Root Bridge [UNC1] (domain 0000 [bus ff])
[    2.291948] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.301308] acpi PNP0A03:01: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    2.308823] PCI host bridge to bus 0000:ff
[    2.313535] pci_bus 0000:ff: root bus resource [bus ff]
[    2.319493] pci 0000:ff:08.0: [8086:2f80] type 00 class 0x088000
[    2.319542] pci 0000:ff:08.3: [8086:2f83] type 00 class 0x088000
[    2.319582] pci 0000:ff:09.0: [8086:2f90] type 00 class 0x088000
[    2.319619] pci 0000:ff:09.3: [8086:2f93] type 00 class 0x088000
[    2.319660] pci 0000:ff:0b.0: [8086:2f81] type 00 class 0x088000
[    2.319694] pci 0000:ff:0b.1: [8086:2f36] type 00 class 0x110100
[    2.319727] pci 0000:ff:0b.2: [8086:2f37] type 00 class 0x110100
[    2.319759] pci 0000:ff:0c.0: [8086:2fe0] type 00 class 0x088000
[    2.319792] pci 0000:ff:0c.1: [8086:2fe1] type 00 class 0x088000
[    2.319825] pci 0000:ff:0c.2: [8086:2fe2] type 00 class 0x088000
[    2.319857] pci 0000:ff:0c.3: [8086:2fe3] type 00 class 0x088000
[    2.319889] pci 0000:ff:0c.4: [8086:2fe4] type 00 class 0x088000
[    2.319922] pci 0000:ff:0c.5: [8086:2fe5] type 00 class 0x088000
[    2.319954] pci 0000:ff:0c.6: [8086:2fe6] type 00 class 0x088000
[    2.319986] pci 0000:ff:0c.7: [8086:2fe7] type 00 class 0x088000
[    2.320020] pci 0000:ff:0f.0: [8086:2ff8] type 00 class 0x088000
[    2.320052] pci 0000:ff:0f.1: [8086:2ff9] type 00 class 0x088000
[    2.320087] pci 0000:ff:0f.4: [8086:2ffc] type 00 class 0x088000
[    2.320117] pci 0000:ff:0f.5: [8086:2ffd] type 00 class 0x088000
[    2.320150] pci 0000:ff:0f.6: [8086:2ffe] type 00 class 0x088000
[    2.320187] pci 0000:ff:10.0: [8086:2f1d] type 00 class 0x088000
[    2.320221] pci 0000:ff:10.1: [8086:2f34] type 00 class 0x110100
[    2.320255] pci 0000:ff:10.5: [8086:2f1e] type 00 class 0x088000
[    2.320288] pci 0000:ff:10.6: [8086:2f7d] type 00 class 0x110100
[    2.320319] pci 0000:ff:10.7: [8086:2f1f] type 00 class 0x088000
[    2.320352] pci 0000:ff:12.0: [8086:2fa0] type 00 class 0x088000
[    2.320386] pci 0000:ff:12.1: [8086:2f30] type 00 class 0x110100
[    2.320420] pci 0000:ff:12.2: [8086:2f70] type 00 class 0x088000
[    2.320459] pci 0000:ff:13.0: [8086:2fa8] type 00 class 0x088000
[    2.320498] pci 0000:ff:13.1: [8086:2f71] type 00 class 0x088000
[    2.320532] pci 0000:ff:13.2: [8086:2faa] type 00 class 0x088000
[    2.320569] pci 0000:ff:13.3: [8086:2fab] type 00 class 0x088000
[    2.320606] pci 0000:ff:13.4: [8086:2fac] type 00 class 0x088000
[    2.320649] pci 0000:ff:13.5: [8086:2fad] type 00 class 0x088000
[    2.320687] pci 0000:ff:13.6: [8086:2fae] type 00 class 0x088000
[    2.320722] pci 0000:ff:13.7: [8086:2faf] type 00 class 0x088000
[    2.320759] pci 0000:ff:14.0: [8086:2fb0] type 00 class 0x088000
[    2.320797] pci 0000:ff:14.1: [8086:2fb1] type 00 class 0x088000
[    2.320835] pci 0000:ff:14.2: [8086:2fb2] type 00 class 0x088000
[    2.320874] pci 0000:ff:14.3: [8086:2fb3] type 00 class 0x088000
[    2.320912] pci 0000:ff:14.4: [8086:2fbc] type 00 class 0x088000
[    2.320948] pci 0000:ff:14.5: [8086:2fbd] type 00 class 0x088000
[    2.320983] pci 0000:ff:14.6: [8086:2fbe] type 00 class 0x088000
[    2.321018] pci 0000:ff:14.7: [8086:2fbf] type 00 class 0x088000
[    2.321056] pci 0000:ff:15.0: [8086:2fb4] type 00 class 0x088000
[    2.321094] pci 0000:ff:15.1: [8086:2fb5] type 00 class 0x088000
[    2.321134] pci 0000:ff:15.2: [8086:2fb6] type 00 class 0x088000
[    2.321176] pci 0000:ff:15.3: [8086:2fb7] type 00 class 0x088000
[    2.321218] pci 0000:ff:16.0: [8086:2f68] type 00 class 0x088000
[    2.321259] pci 0000:ff:16.6: [8086:2f6e] type 00 class 0x088000
[    2.321296] pci 0000:ff:16.7: [8086:2f6f] type 00 class 0x088000
[    2.321334] pci 0000:ff:17.0: [8086:2fd0] type 00 class 0x088000
[    2.321371] pci 0000:ff:17.4: [8086:2fb8] type 00 class 0x088000
[    2.321409] pci 0000:ff:17.5: [8086:2fb9] type 00 class 0x088000
[    2.321446] pci 0000:ff:17.6: [8086:2fba] type 00 class 0x088000
[    2.321482] pci 0000:ff:17.7: [8086:2fbb] type 00 class 0x088000
[    2.321526] pci 0000:ff:1e.0: [8086:2f98] type 00 class 0x088000
[    2.321562] pci 0000:ff:1e.1: [8086:2f99] type 00 class 0x088000
[    2.321598] pci 0000:ff:1e.2: [8086:2f9a] type 00 class 0x088000
[    2.321635] pci 0000:ff:1e.3: [8086:2fc0] type 00 class 0x088000
[    2.321663] pci 0000:ff:1e.4: [8086:2f9c] type 00 class 0x088000
[    2.321705] pci 0000:ff:1f.0: [8086:2f88] type 00 class 0x088000
[    2.321743] pci 0000:ff:1f.2: [8086:2f8a] type 00 class 0x088000
[    2.322349] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[    2.329359] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.338783] acpi PNP0A08:00: _OSC: platform does not support [AER]
[    2.345853] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.354635] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.364154] acpi PNP0A08:00: ignoring host bridge window [mem 0x000c4000-0x000cbfff window] (conflicts with Video ROM [mem 0x000c0000-0x000c7fff])
[    2.379206] PCI host bridge to bus 0000:00
[    2.383920] pci_bus 0000:00: root bus resource [io  0x0000-0x03af window]
[    2.391599] pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7 window]
[    2.399275] pci_bus 0000:00: root bus resource [io  0x03b0-0x03bb window]
[    2.406954] pci_bus 0000:00: root bus resource [io  0x03c0-0x03df window]
[    2.414715] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.423304] pci_bus 0000:00: root bus resource [io  0x1000-0x9fff window]
[    2.430980] pci_bus 0000:00: root bus resource [mem 0x90000000-0xc7ffbfff window]
[    2.439569] pci_bus 0000:00: root bus resource [mem 0x38000000000-0x39fffffffff window]
[    2.448734] pci_bus 0000:00: root bus resource [bus 00-7e]
[    2.454982] pci 0000:00:00.0: [8086:2f00] type 00 class 0x060000
[    2.455118] pci 0000:00:01.0: [8086:2f02] type 01 class 0x060400
[    2.455171] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    2.455260] pci 0000:00:01.1: [8086:2f03] type 01 class 0x060400
[    2.455311] pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
[    2.455403] pci 0000:00:02.0: [8086:2f04] type 01 class 0x060400
[    2.455455] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[    2.455526] pci 0000:00:02.0: System wakeup disabled by ACPI
[    2.461993] pci 0000:00:02.1: [8086:2f05] type 01 class 0x060400
[    2.462045] pci 0000:00:02.1: PME# supported from D0 D3hot D3cold
[    2.462136] pci 0000:00:02.2: [8086:2f06] type 01 class 0x060400
[    2.462187] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
[    2.462249] pci 0000:00:02.2: System wakeup disabled by ACPI
[    2.468705] pci 0000:00:02.3: [8086:2f07] type 01 class 0x060400
[    2.468756] pci 0000:00:02.3: PME# supported from D0 D3hot D3cold
[    2.468847] pci 0000:00:03.0: [8086:2f08] type 01 class 0x060400
[    2.468898] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    2.468960] pci 0000:00:03.0: System wakeup disabled by ACPI
[    2.475427] pci 0000:00:03.1: [8086:2f09] type 01 class 0x060400
[    2.475478] pci 0000:00:03.1: PME# supported from D0 D3hot D3cold
[    2.475567] pci 0000:00:03.2: [8086:2f0a] type 01 class 0x060400
[    2.475618] pci 0000:00:03.2: PME# supported from D0 D3hot D3cold
[    2.475680] pci 0000:00:03.2: System wakeup disabled by ACPI
[    2.482138] pci 0000:00:03.3: [8086:2f0b] type 01 class 0x060400
[    2.482189] pci 0000:00:03.3: PME# supported from D0 D3hot D3cold
[    2.482281] pci 0000:00:04.0: [8086:2f20] type 00 class 0x088000
[    2.482291] pci 0000:00:04.0: reg 0x10: [mem 0x39ffff2c000-0x39ffff2ffff 64bit]
[    2.482405] pci 0000:00:04.1: [8086:2f21] type 00 class 0x088000
[    2.482415] pci 0000:00:04.1: reg 0x10: [mem 0x39ffff28000-0x39ffff2bfff 64bit]
[    2.482531] pci 0000:00:04.2: [8086:2f22] type 00 class 0x088000
[    2.482541] pci 0000:00:04.2: reg 0x10: [mem 0x39ffff24000-0x39ffff27fff 64bit]
[    2.482654] pci 0000:00:04.3: [8086:2f23] type 00 class 0x088000
[    2.482664] pci 0000:00:04.3: reg 0x10: [mem 0x39ffff20000-0x39ffff23fff 64bit]
[    2.482777] pci 0000:00:04.4: [8086:2f24] type 00 class 0x088000
[    2.482786] pci 0000:00:04.4: reg 0x10: [mem 0x39ffff1c000-0x39ffff1ffff 64bit]
[    2.482898] pci 0000:00:04.5: [8086:2f25] type 00 class 0x088000
[    2.482908] pci 0000:00:04.5: reg 0x10: [mem 0x39ffff18000-0x39ffff1bfff 64bit]
[    2.483019] pci 0000:00:04.6: [8086:2f26] type 00 class 0x088000
[    2.483029] pci 0000:00:04.6: reg 0x10: [mem 0x39ffff14000-0x39ffff17fff 64bit]
[    2.483144] pci 0000:00:04.7: [8086:2f27] type 00 class 0x088000
[    2.483154] pci 0000:00:04.7: reg 0x10: [mem 0x39ffff10000-0x39ffff13fff 64bit]
[    2.483273] pci 0000:00:05.0: [8086:2f28] type 00 class 0x088000
[    2.483380] pci 0000:00:05.1: [8086:2f29] type 00 class 0x088000
[    2.483505] pci 0000:00:05.2: [8086:2f2a] type 00 class 0x088000
[    2.483617] pci 0000:00:05.4: [8086:2f2c] type 00 class 0x080020
[    2.483624] pci 0000:00:05.4: reg 0x10: [mem 0x93803000-0x93803fff]
[    2.483748] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000
[    2.483926] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330
[    2.483942] pci 0000:00:14.0: reg 0x10: [mem 0x39ffff00000-0x39ffff0ffff 64bit]
[    2.483994] pci 0000:00:14.0: PME# supported from D3hot D3cold
[    2.484082] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320
[    2.484098] pci 0000:00:1a.0: reg 0x10: [mem 0x93801000-0x938013ff]
[    2.484182] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[    2.484275] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060401
[    2.484339] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    2.484377] pci 0000:00:1c.0: Enabling MPC IRBNCE
[    2.493309] pci 0000:00:1c.0: Intel PCH root port ACS workaround enabled
[    2.500967] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400
[    2.501032] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold
[    2.501050] pci 0000:00:1c.2: Enabling MPC IRBNCE
[    2.506431] pci 0000:00:1c.2: Intel PCH root port ACS workaround enabled
[    2.514102] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400
[    2.514166] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[    2.514180] pci 0000:00:1c.4: Enabling MPC IRBNCE
[    2.519564] pci 0000:00:1c.4: Intel PCH root port ACS workaround enabled
[    2.527195] pci 0000:00:1c.4: System wakeup disabled by ACPI
[    2.533661] pci 0000:00:1c.6: [8086:8d1c] type 01 class 0x060400
[    2.533726] pci 0000:00:1c.6: PME# supported from D0 D3hot D3cold
[    2.533740] pci 0000:00:1c.6: Enabling MPC IRBNCE
[    2.539151] pci 0000:00:1c.6: Intel PCH root port ACS workaround enabled
[    2.546824] pci 0000:00:1c.7: [8086:8d1e] type 01 class 0x060400
[    2.546889] pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
[    2.546903] pci 0000:00:1c.7: Enabling MPC IRBNCE
[    2.552285] pci 0000:00:1c.7: Intel PCH root port ACS workaround enabled
[    2.559949] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320
[    2.559965] pci 0000:00:1d.0: reg 0x10: [mem 0x93800000-0x938003ff]
[    2.560047] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[    2.560145] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100
[    2.560317] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500
[    2.560330] pci 0000:00:1f.3: reg 0x10: [mem 0x39ffff31000-0x39ffff310ff 64bit]
[    2.560350] pci 0000:00:1f.3: reg 0x20: [io  0x3000-0x301f]
[    2.560466] pci 0000:00:01.0: PCI bridge to [bus 03]
[    2.566163] pci 0000:00:01.1: PCI bridge to [bus 0e]
[    2.571913] pci 0000:00:02.0: PCI bridge to [bus 05]
[    2.577610] pci 0000:00:02.1: PCI bridge to [bus 0f]
[    2.583363] pci 0000:04:00.0: [8086:1528] type 00 class 0x020000
[    2.583376] pci 0000:04:00.0: reg 0x10: [mem 0x92e00000-0x92ffffff pref]
[    2.583393] pci 0000:04:00.0: reg 0x1c: [mem 0x93004000-0x93007fff pref]
[    2.583411] pci 0000:04:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    2.583456] pci 0000:04:00.0: PME# supported from D0 D3hot D3cold
[    2.583479] pci 0000:04:00.0: reg 0x184: [mem 0x93400000-0x93403fff 64bit]
[    2.583481] pci 0000:04:00.0: VF(n) BAR0 space: [mem 0x93400000-0x934fffff 64bit] (contains BAR0 for 64 VFs)
[    2.594666] pci 0000:04:00.0: reg 0x190: [mem 0x93500000-0x93503fff 64bit]
[    2.594667] pci 0000:04:00.0: VF(n) BAR3 space: [mem 0x93500000-0x935fffff 64bit] (contains BAR3 for 64 VFs)
[    2.606049] pci 0000:04:00.1: [8086:1528] type 00 class 0x020000
[    2.606062] pci 0000:04:00.1: reg 0x10: [mem 0x92c00000-0x92dfffff pref]
[    2.606080] pci 0000:04:00.1: reg 0x1c: [mem 0x93000000-0x93003fff pref]
[    2.606097] pci 0000:04:00.1: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    2.606141] pci 0000:04:00.1: PME# supported from D0 D3hot D3cold
[    2.606161] pci 0000:04:00.1: reg 0x184: [mem 0x93600000-0x93603fff 64bit]
[    2.606163] pci 0000:04:00.1: VF(n) BAR0 space: [mem 0x93600000-0x936fffff 64bit] (contains BAR0 for 64 VFs)
[    2.617352] pci 0000:04:00.1: reg 0x190: [mem 0x93700000-0x93703fff 64bit]
[    2.617353] pci 0000:04:00.1: VF(n) BAR3 space: [mem 0x93700000-0x937fffff 64bit] (contains BAR3 for 64 VFs)
[    2.631557] pci 0000:00:02.2: PCI bridge to [bus 04]
[    2.637244] pci 0000:00:02.2:   bridge window [mem 0x93400000-0x937fffff]
[    2.637247] pci 0000:00:02.2:   bridge window [mem 0x92c00000-0x930fffff 64bit pref]
[    2.637280] pci 0000:00:02.3: PCI bridge to [bus 10]
[    2.643037] pci 0000:08:00.0: [103c:3239] type 00 class 0x010400
[    2.643049] pci 0000:08:00.0: reg 0x10: [mem 0x93200000-0x932fffff 64bit]
[    2.643056] pci 0000:08:00.0: reg 0x18: [mem 0x93300000-0x933003ff 64bit]
[    2.643062] pci 0000:08:00.0: reg 0x20: [io  0x2000-0x20ff]
[    2.643071] pci 0000:08:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    2.643104] pci 0000:08:00.0: PME# supported from D0 D1 D3hot
[    2.643159] pci 0000:00:03.0: PCI bridge to [bus 08]
[    2.648830] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    2.648832] pci 0000:00:03.0:   bridge window [mem 0x93200000-0x933fffff]
[    2.648859] pci 0000:00:03.1: PCI bridge to [bus 11]
[    2.654609] pci 0000:00:03.2: PCI bridge to [bus 0b]
[    2.660379] pci 0000:00:03.3: PCI bridge to [bus 12]
[    2.666088] pci 0000:00:1c.0: PCI bridge to [bus 13] (subtractive decode)
[    2.673772] pci 0000:00:1c.0:   bridge window [io  0x0000-0x03af window] (subtractive decode)
[    2.673773] pci 0000:00:1c.0:   bridge window [io  0x03e0-0x0cf7 window] (subtractive decode)
[    2.673774] pci 0000:00:1c.0:   bridge window [io  0x03b0-0x03bb window] (subtractive decode)
[    2.673778] pci 0000:00:1c.0:   bridge window [io  0x03c0-0x03df window] (subtractive decode)
[    2.673779] pci 0000:00:1c.0:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[    2.673780] pci 0000:00:1c.0:   bridge window [io  0x1000-0x9fff window] (subtractive decode)
[    2.673781] pci 0000:00:1c.0:   bridge window [mem 0x90000000-0xc7ffbfff window] (subtractive decode)
[    2.673782] pci 0000:00:1c.0:   bridge window [mem 0x38000000000-0x39fffffffff window] (subtractive decode)
[    2.673831] pci 0000:01:00.0: [103c:3306] type 00 class 0x088000
[    2.673853] pci 0000:01:00.0: reg 0x10: [io  0x1200-0x12ff]
[    2.673866] pci 0000:01:00.0: reg 0x14: [mem 0x92a8d000-0x92a8d1ff]
[    2.673878] pci 0000:01:00.0: reg 0x18: [io  0x1100-0x11ff]
[    2.674053] pci 0000:01:00.1: [102b:0533] type 00 class 0x030000
[    2.674075] pci 0000:01:00.1: reg 0x10: [mem 0x91000000-0x91ffffff pref]
[    2.674088] pci 0000:01:00.1: reg 0x14: [mem 0x92a88000-0x92a8bfff]
[    2.674100] pci 0000:01:00.1: reg 0x18: [mem 0x92000000-0x927fffff]
[    2.674264] pci 0000:01:00.2: [103c:3307] type 00 class 0x088000
[    2.674285] pci 0000:01:00.2: reg 0x10: [io  0x1000-0x10ff]
[    2.674298] pci 0000:01:00.2: reg 0x14: [mem 0x92a8c000-0x92a8c0ff]
[    2.674310] pci 0000:01:00.2: reg 0x18: [mem 0x92900000-0x929fffff]
[    2.674323] pci 0000:01:00.2: reg 0x1c: [mem 0x92a00000-0x92a7ffff]
[    2.674335] pci 0000:01:00.2: reg 0x20: [mem 0x92a80000-0x92a87fff]
[    2.674348] pci 0000:01:00.2: reg 0x24: [mem 0x92800000-0x928fffff]
[    2.674360] pci 0000:01:00.2: reg 0x30: [mem 0x00000000-0x0000ffff pref]
[    2.674424] pci 0000:01:00.2: PME# supported from D0 D3hot D3cold
[    2.674490] pci 0000:01:00.4: [103c:3300] type 00 class 0x0c0300
[    2.674557] pci 0000:01:00.4: reg 0x20: [io  0x1300-0x131f]
[    2.677796] pci 0000:00:1c.2: PCI bridge to [bus 01]
[    2.683484] pci 0000:00:1c.2:   bridge window [io  0x1000-0x1fff]
[    2.683487] pci 0000:00:1c.2:   bridge window [mem 0x90000000-0x92afffff]
[    2.683561] pci 0000:02:00.0: [14e4:1657] type 00 class 0x020000
[    2.683589] pci 0000:02:00.0: reg 0x10: [mem 0x93190000-0x9319ffff 64bit pref]
[    2.683606] pci 0000:02:00.0: reg 0x18: [mem 0x931a0000-0x931affff 64bit pref]
[    2.683622] pci 0000:02:00.0: reg 0x20: [mem 0x931b0000-0x931bffff 64bit pref]
[    2.683633] pci 0000:02:00.0: reg 0x30: [mem 0x00000000-0x0003ffff pref]
[    2.683721] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[    2.683826] pci 0000:02:00.1: [14e4:1657] type 00 class 0x020000
[    2.683854] pci 0000:02:00.1: reg 0x10: [mem 0x93160000-0x9316ffff 64bit pref]
[    2.683870] pci 0000:02:00.1: reg 0x18: [mem 0x93170000-0x9317ffff 64bit pref]
[    2.683887] pci 0000:02:00.1: reg 0x20: [mem 0x93180000-0x9318ffff 64bit pref]
[    2.683898] pci 0000:02:00.1: reg 0x30: [mem 0x00000000-0x0003ffff pref]
[    2.683985] pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
[    2.684077] pci 0000:02:00.2: [14e4:1657] type 00 class 0x020000
[    2.684105] pci 0000:02:00.2: reg 0x10: [mem 0x93130000-0x9313ffff 64bit pref]
[    2.684121] pci 0000:02:00.2: reg 0x18: [mem 0x93140000-0x9314ffff 64bit pref]
[    2.684138] pci 0000:02:00.2: reg 0x20: [mem 0x93150000-0x9315ffff 64bit pref]
[    2.684148] pci 0000:02:00.2: reg 0x30: [mem 0x00000000-0x0003ffff pref]
[    2.684236] pci 0000:02:00.2: PME# supported from D0 D3hot D3cold
[    2.684326] pci 0000:02:00.3: [14e4:1657] type 00 class 0x020000
[    2.684353] pci 0000:02:00.3: reg 0x10: [mem 0x93100000-0x9310ffff 64bit pref]
[    2.684370] pci 0000:02:00.3: reg 0x18: [mem 0x93110000-0x9311ffff 64bit pref]
[    2.684386] pci 0000:02:00.3: reg 0x20: [mem 0x93120000-0x9312ffff 64bit pref]
[    2.684397] pci 0000:02:00.3: reg 0x30: [mem 0x00000000-0x0003ffff pref]
[    2.684487] pci 0000:02:00.3: PME# supported from D0 D3hot D3cold
[    2.687539] pci 0000:00:1c.4: PCI bridge to [bus 02]
[    2.693214] pci 0000:00:1c.4:   bridge window [mem 0x93100000-0x931fffff 64bit pref]
[    2.693257] pci 0000:00:1c.6: PCI bridge to [bus 14]
[    2.698965] pci 0000:00:1c.7: PCI bridge to [bus 15]
[    2.704699] pci_bus 0000:00: on NUMA node 0
[    2.704829] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[    2.713181] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 *10 11 12 14 15)
[    2.721529] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 *9 10 11 12 14 15)
[    2.729881] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 *5 6 7 9 10 11 12 14 15)
[    2.738229] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[    2.747829] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[    2.757416] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[    2.767007] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[    2.776797] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[    2.783808] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.793252] acpi PNP0A08:01: _OSC: platform does not support [AER]
[    2.800319] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.809111] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.818556] PCI host bridge to bus 0000:80
[    2.823268] pci_bus 0000:80: root bus resource [io  0xa000-0xffff window]
[    2.830944] pci_bus 0000:80: root bus resource [mem 0xc8000000-0xfbffbfff window]
[    2.839546] pci_bus 0000:80: root bus resource [mem 0x3a000000000-0x3bfffffffff window]
[    2.848708] pci_bus 0000:80: root bus resource [bus 80-fe]
[    2.854955] pci 0000:80:00.0: [8086:2f01] type 01 class 0x060400
[    2.854999] pci 0000:80:00.0: PME# supported from D0 D3hot D3cold
[    2.855070] pci 0000:80:01.0: [8086:2f02] type 01 class 0x060400
[    2.855112] pci 0000:80:01.0: PME# supported from D0 D3hot D3cold
[    2.855139] pci 0000:80:01.0: System wakeup disabled by ACPI
[    2.861602] pci 0000:80:01.1: [8086:2f03] type 01 class 0x060400
[    2.861643] pci 0000:80:01.1: PME# supported from D0 D3hot D3cold
[    2.861696] pci 0000:80:02.0: [8086:2f04] type 01 class 0x060400
[    2.861737] pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
[    2.861765] pci 0000:80:02.0: System wakeup disabled by ACPI
[    2.868221] pci 0000:80:02.1: [8086:2f05] type 01 class 0x060400
[    2.868262] pci 0000:80:02.1: PME# supported from D0 D3hot D3cold
[    2.868316] pci 0000:80:02.2: [8086:2f06] type 01 class 0x060400
[    2.868357] pci 0000:80:02.2: PME# supported from D0 D3hot D3cold
[    2.868412] pci 0000:80:02.3: [8086:2f07] type 01 class 0x060400
[    2.868453] pci 0000:80:02.3: PME# supported from D0 D3hot D3cold
[    2.868503] pci 0000:80:03.0: [8086:2f08] type 01 class 0x060400
[    2.868543] pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
[    2.868569] pci 0000:80:03.0: System wakeup disabled by ACPI
[    2.875028] pci 0000:80:03.1: [8086:2f09] type 01 class 0x060400
[    2.875069] pci 0000:80:03.1: PME# supported from D0 D3hot D3cold
[    2.875122] pci 0000:80:03.2: [8086:2f0a] type 01 class 0x060400
[    2.875163] pci 0000:80:03.2: PME# supported from D0 D3hot D3cold
[    2.875216] pci 0000:80:03.3: [8086:2f0b] type 01 class 0x060400
[    2.875256] pci 0000:80:03.3: PME# supported from D0 D3hot D3cold
[    2.875305] pci 0000:80:04.0: [8086:2f20] type 00 class 0x088000
[    2.875314] pci 0000:80:04.0: reg 0x10: [mem 0x3bffff1c000-0x3bffff1ffff 64bit]
[    2.875381] pci 0000:80:04.1: [8086:2f21] type 00 class 0x088000
[    2.875389] pci 0000:80:04.1: reg 0x10: [mem 0x3bffff18000-0x3bffff1bfff 64bit]
[    2.875456] pci 0000:80:04.2: [8086:2f22] type 00 class 0x088000
[    2.875464] pci 0000:80:04.2: reg 0x10: [mem 0x3bffff14000-0x3bffff17fff 64bit]
[    2.875531] pci 0000:80:04.3: [8086:2f23] type 00 class 0x088000
[    2.875539] pci 0000:80:04.3: reg 0x10: [mem 0x3bffff10000-0x3bffff13fff 64bit]
[    2.875605] pci 0000:80:04.4: [8086:2f24] type 00 class 0x088000
[    2.875613] pci 0000:80:04.4: reg 0x10: [mem 0x3bffff0c000-0x3bffff0ffff 64bit]
[    2.875681] pci 0000:80:04.5: [8086:2f25] type 00 class 0x088000
[    2.875689] pci 0000:80:04.5: reg 0x10: [mem 0x3bffff08000-0x3bffff0bfff 64bit]
[    2.875753] pci 0000:80:04.6: [8086:2f26] type 00 class 0x088000
[    2.875761] pci 0000:80:04.6: reg 0x10: [mem 0x3bffff04000-0x3bffff07fff 64bit]
[    2.875830] pci 0000:80:04.7: [8086:2f27] type 00 class 0x088000
[    2.875838] pci 0000:80:04.7: reg 0x10: [mem 0x3bffff00000-0x3bffff03fff 64bit]
[    2.875904] pci 0000:80:05.0: [8086:2f28] type 00 class 0x088000
[    2.875967] pci 0000:80:05.1: [8086:2f29] type 00 class 0x088000
[    2.876043] pci 0000:80:05.2: [8086:2f2a] type 00 class 0x088000
[    2.876106] pci 0000:80:05.4: [8086:2f2c] type 00 class 0x080020
[    2.876112] pci 0000:80:05.4: reg 0x10: [mem 0xc8600000-0xc8600fff]
[    2.876211] pci 0000:80:00.0: PCI bridge to [bus 91]
[    2.881963] pci 0000:81:00.0: [8086:1521] type 00 class 0x020000
[    2.881978] pci 0000:81:00.0: reg 0x10: [mem 0xc8300000-0xc83fffff]
[    2.881995] pci 0000:81:00.0: reg 0x1c: [mem 0xc850c000-0xc850ffff]
[    2.882012] pci 0000:81:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    2.882060] pci 0000:81:00.0: PME# supported from D0 D3hot D3cold
[    2.882081] pci 0000:81:00.0: reg 0x184: [mem 0xc84ec000-0xc84effff]
[    2.882082] pci 0000:81:00.0: VF(n) BAR0 space: [mem 0xc84ec000-0xc850bfff] (contains BAR0 for 8 VFs)
[    2.892598] pci 0000:81:00.0: reg 0x190: [mem 0xc84cc000-0xc84cffff]
[    2.892599] pci 0000:81:00.0: VF(n) BAR3 space: [mem 0xc84cc000-0xc84ebfff] (contains BAR3 for 8 VFs)
[    2.903200] pci 0000:81:00.1: [8086:1521] type 00 class 0x020000
[    2.903214] pci 0000:81:00.1: reg 0x10: [mem 0xc8200000-0xc82fffff]
[    2.903231] pci 0000:81:00.1: reg 0x1c: [mem 0xc84c8000-0xc84cbfff]
[    2.903248] pci 0000:81:00.1: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    2.903294] pci 0000:81:00.1: PME# supported from D0 D3hot D3cold
[    2.903312] pci 0000:81:00.1: reg 0x184: [mem 0xc84a8000-0xc84abfff]
[    2.903313] pci 0000:81:00.1: VF(n) BAR0 space: [mem 0xc84a8000-0xc84c7fff] (contains BAR0 for 8 VFs)
[    2.913909] pci 0000:81:00.1: reg 0x190: [mem 0xc8488000-0xc848bfff]
[    2.913910] pci 0000:81:00.1: VF(n) BAR3 space: [mem 0xc8488000-0xc84a7fff] (contains BAR3 for 8 VFs)
[    2.924506] pci 0000:81:00.2: [8086:1521] type 00 class 0x020000
[    2.924519] pci 0000:81:00.2: reg 0x10: [mem 0xc8100000-0xc81fffff]
[    2.924536] pci 0000:81:00.2: reg 0x1c: [mem 0xc8484000-0xc8487fff]
[    2.924554] pci 0000:81:00.2: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    2.924599] pci 0000:81:00.2: PME# supported from D0 D3hot D3cold
[    2.924617] pci 0000:81:00.2: reg 0x184: [mem 0xc8464000-0xc8467fff]
[    2.924619] pci 0000:81:00.2: VF(n) BAR0 space: [mem 0xc8464000-0xc8483fff] (contains BAR0 for 8 VFs)
[    2.935135] pci 0000:81:00.2: reg 0x190: [mem 0xc8444000-0xc8447fff]
[    2.935136] pci 0000:81:00.2: VF(n) BAR3 space: [mem 0xc8444000-0xc8463fff] (contains BAR3 for 8 VFs)
[    2.945719] pci 0000:81:00.3: [8086:1521] type 00 class 0x020000
[    2.945733] pci 0000:81:00.3: reg 0x10: [mem 0xc8000000-0xc80fffff]
[    2.945749] pci 0000:81:00.3: reg 0x1c: [mem 0xc8440000-0xc8443fff]
[    2.945766] pci 0000:81:00.3: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    2.945812] pci 0000:81:00.3: PME# supported from D0 D3hot D3cold
[    2.945833] pci 0000:81:00.3: reg 0x184: [mem 0xc8420000-0xc8423fff]
[    2.945834] pci 0000:81:00.3: VF(n) BAR0 space: [mem 0xc8420000-0xc843ffff] (contains BAR0 for 8 VFs)
[    2.956351] pci 0000:81:00.3: reg 0x190: [mem 0xc8400000-0xc8403fff]
[    2.956352] pci 0000:81:00.3: VF(n) BAR3 space: [mem 0xc8400000-0xc841ffff] (contains BAR3 for 8 VFs)
[    2.969880] pci 0000:80:01.0: PCI bridge to [bus 81]
[    2.975556] pci 0000:80:01.0:   bridge window [mem 0xc8000000-0xc85fffff]
[    2.975587] pci 0000:80:01.1: PCI bridge to [bus 8e]
[    2.981323] pci 0000:80:02.0: PCI bridge to [bus 84]
[    2.987030] pci 0000:80:02.1: PCI bridge to [bus 8f]
[    2.992726] pci 0000:80:02.2: PCI bridge to [bus 87]
[    2.998425] pci 0000:80:02.3: PCI bridge to [bus 90]
[    3.004159] pci 0000:80:03.0: PCI bridge to [bus 88]
[    3.009855] pci 0000:80:03.1: PCI bridge to [bus 8b]
[    3.015549] pci 0000:80:03.2: PCI bridge to [bus 8c]
[    3.021247] pci 0000:80:03.3: PCI bridge to [bus 8d]
[    3.026952] pci_bus 0000:80: on NUMA node 1
[    3.027070] ACPI: Enabled 9 GPEs in block 00 to 3F
[    3.032776] pci 0000:01:00.1: vgaarb: setting as boot VGA device
[    3.039638] pci 0000:01:00.1: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    3.049384] pci 0000:01:00.1: vgaarb: bridge control possible
[    3.055908] vgaarb: loaded
[    3.059175] PCI: Using ACPI for IRQ routing
[    3.067889] PCI: pci_cache_line_size set to 64 bytes
[    3.068155] e820: reserve RAM buffer [mem 0x00094000-0x0009ffff]
[    3.068156] e820: reserve RAM buffer [mem 0x5a701000-0x5bffffff]
[    3.068156] e820: reserve RAM buffer [mem 0x790ff000-0x7bffffff]
[    3.068157] e820: reserve RAM buffer [mem 0x7b800000-0x7bffffff]
[    3.068540] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    3.075543] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    3.084254] clocksource: Switched to clocksource hpet
[    3.100996] VFS: Disk quotas dquot_6.6.0
[    3.105558] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    3.113419] pnp: PnP ACPI init
[    3.117320] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[    3.117453] system 00:01: [io  0x0500-0x053f] has been reserved
[    3.124164] system 00:01: [io  0x0400-0x047f] has been reserved
[    3.130875] system 00:01: [io  0x0540-0x057f] has been reserved
[    3.137582] system 00:01: [io  0x0600-0x061f] has been reserved
[    3.144293] system 00:01: [io  0x0880-0x0883] has been reserved
[    3.151003] system 00:01: [io  0x0800-0x081f] has been reserved
[    3.157712] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved
[    3.165219] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved
[    3.172692] system 00:01: [mem 0xff000000-0xffffffff] could not be reserved
[    3.180545] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved
[    3.188073] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved
[    3.195554] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved
[    3.203030] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved
[    3.210501] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[    3.210533] pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active)
[    3.210553] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[    3.210674] pnp: PnP ACPI: found 4 devices
[    3.221300] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    3.231479] pci 0000:00:1c.4: BAR 14: assigned [mem 0x92b00000-0x92bfffff]
[    3.239237] pci 0000:00:01.0: PCI bridge to [bus 03]
[    3.244900] pci 0000:00:01.1: PCI bridge to [bus 0e]
[    3.250561] pci 0000:00:02.0: PCI bridge to [bus 05]
[    3.256220] pci 0000:00:02.1: PCI bridge to [bus 0f]
[    3.261883] pci 0000:04:00.0: BAR 6: assigned [mem 0x93080000-0x930fffff pref]
[    3.270163] pci 0000:04:00.1: BAR 6: no space for [mem size 0x00080000 pref]
[    3.278114] pci 0000:04:00.1: BAR 6: failed to assign [mem size 0x00080000 pref]
[    3.286597] pci 0000:00:02.2: PCI bridge to [bus 04]
[    3.292256] pci 0000:00:02.2:   bridge window [mem 0x93400000-0x937fffff]
[    3.299927] pci 0000:00:02.2:   bridge window [mem 0x92c00000-0x930fffff 64bit pref]
[    3.308780] pci 0000:00:02.3: PCI bridge to [bus 10]
[    3.314441] pci 0000:08:00.0: BAR 6: assigned [mem 0x93380000-0x933fffff pref]
[    3.322721] pci 0000:00:03.0: PCI bridge to [bus 08]
[    3.328377] pci 0000:00:03.0:   bridge window [io  0x2000-0x2fff]
[    3.335280] pci 0000:00:03.0:   bridge window [mem 0x93200000-0x933fffff]
[    3.342947] pci 0000:00:03.1: PCI bridge to [bus 11]
[    3.348606] pci 0000:00:03.2: PCI bridge to [bus 0b]
[    3.354266] pci 0000:00:03.3: PCI bridge to [bus 12]
[    3.359925] pci 0000:00:1c.0: PCI bridge to [bus 13]
[    3.365586] pci 0000:01:00.2: BAR 6: assigned [mem 0x90000000-0x9000ffff pref]
[    3.373868] pci 0000:00:1c.2: PCI bridge to [bus 01]
[    3.379528] pci 0000:00:1c.2:   bridge window [io  0x1000-0x1fff]
[    3.386431] pci 0000:00:1c.2:   bridge window [mem 0x90000000-0x92afffff]
[    3.394100] pci 0000:02:00.0: BAR 6: assigned [mem 0x92b00000-0x92b3ffff pref]
[    3.402378] pci 0000:02:00.1: BAR 6: assigned [mem 0x92b40000-0x92b7ffff pref]
[    3.410656] pci 0000:02:00.2: BAR 6: assigned [mem 0x92b80000-0x92bbffff pref]
[    3.418936] pci 0000:02:00.3: BAR 6: assigned [mem 0x92bc0000-0x92bfffff pref]
[    3.427217] pci 0000:00:1c.4: PCI bridge to [bus 02]
[    3.432875] pci 0000:00:1c.4:   bridge window [mem 0x92b00000-0x92bfffff]
[    3.440541] pci 0000:00:1c.4:   bridge window [mem 0x93100000-0x931fffff 64bit pref]
[    3.449401] pci 0000:00:1c.6: PCI bridge to [bus 14]
[    3.455068] pci 0000:00:1c.7: PCI bridge to [bus 15]
[    3.460732] pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
[    3.460733] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
[    3.460737] pci_bus 0000:00: resource 6 [io  0x03b0-0x03bb window]
[    3.460737] pci_bus 0000:00: resource 7 [io  0x03c0-0x03df window]
[    3.460738] pci_bus 0000:00: resource 8 [mem 0x000a0000-0x000bffff window]
[    3.460739] pci_bus 0000:00: resource 9 [io  0x1000-0x9fff window]
[    3.460741] pci_bus 0000:00: resource 10 [mem 0x90000000-0xc7ffbfff window]
[    3.460742] pci_bus 0000:00: resource 11 [mem 0x38000000000-0x39fffffffff window]
[    3.460743] pci_bus 0000:04: resource 1 [mem 0x93400000-0x937fffff]
[    3.460744] pci_bus 0000:04: resource 2 [mem 0x92c00000-0x930fffff 64bit pref]
[    3.460745] pci_bus 0000:08: resource 0 [io  0x2000-0x2fff]
[    3.460746] pci_bus 0000:08: resource 1 [mem 0x93200000-0x933fffff]
[    3.460748] pci_bus 0000:13: resource 4 [io  0x0000-0x03af window]
[    3.460749] pci_bus 0000:13: resource 5 [io  0x03e0-0x0cf7 window]
[    3.460749] pci_bus 0000:13: resource 6 [io  0x03b0-0x03bb window]
[    3.460750] pci_bus 0000:13: resource 7 [io  0x03c0-0x03df window]
[    3.460751] pci_bus 0000:13: resource 8 [mem 0x000a0000-0x000bffff window]
[    3.460752] pci_bus 0000:13: resource 9 [io  0x1000-0x9fff window]
[    3.460753] pci_bus 0000:13: resource 10 [mem 0x90000000-0xc7ffbfff window]
[    3.460754] pci_bus 0000:13: resource 11 [mem 0x38000000000-0x39fffffffff window]
[    3.460755] pci_bus 0000:01: resource 0 [io  0x1000-0x1fff]
[    3.460756] pci_bus 0000:01: resource 1 [mem 0x90000000-0x92afffff]
[    3.460757] pci_bus 0000:02: resource 1 [mem 0x92b00000-0x92bfffff]
[    3.460758] pci_bus 0000:02: resource 2 [mem 0x93100000-0x931fffff 64bit pref]
[    3.460859] pci 0000:80:00.0: PCI bridge to [bus 91]
[    3.466521] pci 0000:81:00.0: BAR 6: assigned [mem 0xc8580000-0xc85fffff pref]
[    3.474802] pci 0000:81:00.1: BAR 6: no space for [mem size 0x00080000 pref]
[    3.482750] pci 0000:81:00.1: BAR 6: failed to assign [mem size 0x00080000 pref]
[    3.491220] pci 0000:81:00.2: BAR 6: no space for [mem size 0x00080000 pref]
[    3.499170] pci 0000:81:00.2: BAR 6: failed to assign [mem size 0x00080000 pref]
[    3.507642] pci 0000:81:00.3: BAR 6: no space for [mem size 0x00080000 pref]
[    3.515593] pci 0000:81:00.3: BAR 6: failed to assign [mem size 0x00080000 pref]
[    3.524063] pci 0000:80:01.0: PCI bridge to [bus 81]
[    3.529723] pci 0000:80:01.0:   bridge window [mem 0xc8000000-0xc85fffff]
[    3.540737] pci 0000:80:01.1: PCI bridge to [bus 8e]
[    3.546401] pci 0000:80:02.0: PCI bridge to [bus 84]
[    3.552060] pci 0000:80:02.1: PCI bridge to [bus 8f]
[    3.557727] pci 0000:80:02.2: PCI bridge to [bus 87]
[    3.563396] pci 0000:80:02.3: PCI bridge to [bus 90]
[    3.569059] pci 0000:80:03.0: PCI bridge to [bus 88]
[    3.574719] pci 0000:80:03.1: PCI bridge to [bus 8b]
[    3.580377] pci 0000:80:03.2: PCI bridge to [bus 8c]
[    3.586041] pci 0000:80:03.3: PCI bridge to [bus 8d]
[    3.591704] pci_bus 0000:80: resource 4 [io  0xa000-0xffff window]
[    3.591705] pci_bus 0000:80: resource 5 [mem 0xc8000000-0xfbffbfff window]
[    3.591708] pci_bus 0000:80: resource 6 [mem 0x3a000000000-0x3bfffffffff window]
[    3.591710] pci_bus 0000:81: resource 1 [mem 0xc8000000-0xc85fffff]
[    3.591783] NET: Registered protocol family 2
[    3.597171] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[    3.606348] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.614066] TCP: Hash tables configured (established 524288 bind 65536)
[    3.621683] UDP hash table entries: 65536 (order: 9, 2097152 bytes)
[    3.629118] UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes)
[    3.637117] NET: Registered protocol family 1
[    3.855457] pci 0000:01:00.1: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    3.865426] PCI: CLS 64 bytes, default 64
[    4.318572] DMAR: dmar0: Using Queued invalidation
[    4.324054] DMAR: dmar1: Using Queued invalidation
[    4.329566] DMAR: Setting RMRR:
[    4.333687] DMAR: Setting identity map for device 0000:00:14.0 [0x5a701000 - 0x5a740fff]
[    4.343273] DMAR: Setting identity map for device 0000:00:1a.0 [0x5a701000 - 0x5a740fff]
[    4.352837] DMAR: Setting identity map for device 0000:00:1d.0 [0x5a701000 - 0x5a740fff]
[    4.362476] DMAR: Setting identity map for device 0000:01:00.0 [0x5a701000 - 0x5a740fff]
[    4.372099] DMAR: Setting identity map for device 0000:01:00.1 [0x5a701000 - 0x5a740fff]
[    4.381697] DMAR: Setting identity map for device 0000:01:00.2 [0x5a701000 - 0x5a740fff]
[    4.391278] DMAR: Setting identity map for device 0000:01:00.4 [0x5a701000 - 0x5a740fff]
[    4.400535] DMAR: Setting identity map for device 0000:01:00.0 [0x791dc000 - 0x791ddfff]
[    4.409785] DMAR: Setting identity map for device 0000:01:00.1 [0x791dc000 - 0x791ddfff]
[    4.419030] DMAR: Setting identity map for device 0000:01:00.2 [0x791dc000 - 0x791ddfff]
[    4.428278] DMAR: Setting identity map for device 0000:01:00.4 [0x791dc000 - 0x791ddfff]
[    4.437878] DMAR: Setting identity map for device 0000:08:00.0 [0x791dc000 - 0x791ddfff]
[    4.447132] DMAR: Setting identity map for device 0000:01:00.0 [0x791cb000 - 0x791dbfff]
[    4.456370] DMAR: Setting identity map for device 0000:01:00.1 [0x791cb000 - 0x791dbfff]
[    4.465610] DMAR: Setting identity map for device 0000:01:00.2 [0x791cb000 - 0x791dbfff]
[    4.474848] DMAR: Setting identity map for device 0000:01:00.4 [0x791cb000 - 0x791dbfff]
[    4.484089] DMAR: Setting identity map for device 0000:01:00.0 [0x791de000 - 0x791f3fff]
[    4.493335] DMAR: Setting identity map for device 0000:01:00.1 [0x791de000 - 0x791f3fff]
[    4.502570] DMAR: Setting identity map for device 0000:01:00.2 [0x791de000 - 0x791f3fff]
[    4.511811] DMAR: Setting identity map for device 0000:01:00.4 [0x791de000 - 0x791f3fff]
[    4.521441] DMAR: Setting identity map for device 0000:02:00.0 [0x791de000 - 0x791f3fff]
[    4.531017] DMAR: Setting identity map for device 0000:04:00.0 [0x791de000 - 0x791f3fff]
[    4.540610] DMAR: Setting identity map for device 0000:81:00.0 [0x791de000 - 0x791f3fff]
[    4.549868] DMAR: Setting identity map for device 0000:01:00.0 [0x791f4000 - 0x791f7fff]
[    4.559107] DMAR: Setting identity map for device 0000:01:00.1 [0x791f4000 - 0x791f7fff]
[    4.568341] DMAR: Setting identity map for device 0000:01:00.2 [0x791f4000 - 0x791f7fff]
[    4.577582] DMAR: Setting identity map for device 0000:01:00.4 [0x791f4000 - 0x791f7fff]
[    4.586822] DMAR: Setting identity map for device 0000:02:00.0 [0x791f4000 - 0x791f7fff]
[    4.596365] DMAR: Setting identity map for device 0000:02:00.1 [0x791f4000 - 0x791f7fff]
[    4.605940] DMAR: Setting identity map for device 0000:02:00.2 [0x791f4000 - 0x791f7fff]
[    4.615564] DMAR: Setting identity map for device 0000:02:00.3 [0x791f4000 - 0x791f7fff]
[    4.624845] DMAR: Setting identity map for device 0000:04:00.0 [0x791f4000 - 0x791f7fff]
[    4.634462] DMAR: Setting identity map for device 0000:04:00.1 [0x791f4000 - 0x791f7fff]
[    4.643714] DMAR: Setting identity map for device 0000:08:00.0 [0x791f4000 - 0x791f7fff]
[    4.652947] DMAR: Setting identity map for device 0000:81:00.0 [0x791f4000 - 0x791f7fff]
[    4.662569] DMAR: Setting identity map for device 0000:81:00.1 [0x791f4000 - 0x791f7fff]
[    4.672198] DMAR: Setting identity map for device 0000:81:00.2 [0x791f4000 - 0x791f7fff]
[    4.681827] DMAR: Setting identity map for device 0000:81:00.3 [0x791f4000 - 0x791f7fff]
[    4.691078] DMAR: Setting identity map for device 0000:00:1a.0 [0x79170000 - 0x79172fff]
[    4.700329] DMAR: Setting identity map for device 0000:00:1d.0 [0x79170000 - 0x79172fff]
[    4.709578] DMAR: Prepare 0-16MiB unity mapping for LPC
[    4.715894] DMAR: Setting identity map for device 0000:00:1f.0 [0x0 - 0xffffff]
[    4.724287] DMAR: Intel(R) Virtualization Technology for Directed I/O
[    4.731701] iommu: Adding device 0000:00:00.0 to group 0
[    4.737774] iommu: Adding device 0000:00:01.0 to group 1
[    4.743862] iommu: Adding device 0000:00:01.1 to group 2
[    4.749933] iommu: Adding device 0000:00:02.0 to group 3
[    4.756004] iommu: Adding device 0000:00:02.1 to group 4
[    4.762075] iommu: Adding device 0000:00:02.2 to group 5
[    4.768147] iommu: Adding device 0000:00:02.3 to group 6
[    4.774222] iommu: Adding device 0000:00:03.0 to group 7
[    4.780292] iommu: Adding device 0000:00:03.1 to group 8
[    4.786368] iommu: Adding device 0000:00:03.2 to group 9
[    4.792441] iommu: Adding device 0000:00:03.3 to group 10
[    4.798795] iommu: Adding device 0000:00:04.0 to group 11
[    4.804965] iommu: Adding device 0000:00:04.1 to group 11
[    4.811133] iommu: Adding device 0000:00:04.2 to group 11
[    4.817296] iommu: Adding device 0000:00:04.3 to group 11
[    4.823472] iommu: Adding device 0000:00:04.4 to group 11
[    4.829635] iommu: Adding device 0000:00:04.5 to group 11
[    4.835797] iommu: Adding device 0000:00:04.6 to group 11
[    4.841963] iommu: Adding device 0000:00:04.7 to group 11
[    4.848226] iommu: Adding device 0000:00:05.0 to group 12
[    4.854396] iommu: Adding device 0000:00:05.1 to group 12
[    4.860559] iommu: Adding device 0000:00:05.2 to group 12
[    4.866726] iommu: Adding device 0000:00:05.4 to group 12
[    4.872894] iommu: Adding device 0000:00:11.0 to group 13
[    4.879059] iommu: Adding device 0000:00:14.0 to group 14
[    4.885228] iommu: Adding device 0000:00:1a.0 to group 15
[    4.891401] iommu: Adding device 0000:00:1c.0 to group 16
[    4.897567] iommu: Adding device 0000:00:1c.2 to group 17
[    4.903733] iommu: Adding device 0000:00:1c.4 to group 18
[    4.909899] iommu: Adding device 0000:00:1c.6 to group 19
[    4.916065] iommu: Adding device 0000:00:1c.7 to group 20
[    4.922236] iommu: Adding device 0000:00:1d.0 to group 21
[    4.928451] iommu: Adding device 0000:00:1f.0 to group 22
[    4.934618] iommu: Adding device 0000:00:1f.3 to group 22
[    4.940884] iommu: Adding device 0000:01:00.0 to group 23
[    4.947054] iommu: Adding device 0000:01:00.1 to group 23
[    4.953223] iommu: Adding device 0000:01:00.2 to group 23
[    4.959395] iommu: Adding device 0000:01:00.4 to group 23
[    4.965669] iommu: Adding device 0000:02:00.0 to group 24
[    4.971847] iommu: Adding device 0000:02:00.1 to group 24
[    4.978018] iommu: Adding device 0000:02:00.2 to group 24
[    4.984206] iommu: Adding device 0000:02:00.3 to group 24
[    4.990380] iommu: Adding device 0000:04:00.0 to group 25
[    4.996551] iommu: Adding device 0000:04:00.1 to group 26
[    5.002727] iommu: Adding device 0000:08:00.0 to group 27
[    5.008939] iommu: Adding device 0000:7f:08.0 to group 28
[    5.015106] iommu: Adding device 0000:7f:08.3 to group 28
[    5.021320] iommu: Adding device 0000:7f:09.0 to group 29
[    5.027488] iommu: Adding device 0000:7f:09.3 to group 29
[    5.033730] iommu: Adding device 0000:7f:0b.0 to group 30
[    5.039904] iommu: Adding device 0000:7f:0b.1 to group 30
[    5.046074] iommu: Adding device 0000:7f:0b.2 to group 30
[    5.052431] iommu: Adding device 0000:7f:0c.0 to group 31
[    5.058600] iommu: Adding device 0000:7f:0c.1 to group 31
[    5.064770] iommu: Adding device 0000:7f:0c.2 to group 31
[    5.070940] iommu: Adding device 0000:7f:0c.3 to group 31
[    5.077106] iommu: Adding device 0000:7f:0c.4 to group 31
[    5.083283] iommu: Adding device 0000:7f:0c.5 to group 31
[    5.089453] iommu: Adding device 0000:7f:0c.6 to group 31
[    5.095626] iommu: Adding device 0000:7f:0c.7 to group 31
[    5.101905] iommu: Adding device 0000:7f:0f.0 to group 32
[    5.108078] iommu: Adding device 0000:7f:0f.1 to group 32
[    5.114245] iommu: Adding device 0000:7f:0f.4 to group 32
[    5.120413] iommu: Adding device 0000:7f:0f.5 to group 32
[    5.126583] iommu: Adding device 0000:7f:0f.6 to group 32
[    5.132874] iommu: Adding device 0000:7f:10.0 to group 33
[    5.139046] iommu: Adding device 0000:7f:10.1 to group 33
[    5.145219] iommu: Adding device 0000:7f:10.5 to group 33
[    5.151395] iommu: Adding device 0000:7f:10.6 to group 33
[    5.157564] iommu: Adding device 0000:7f:10.7 to group 33
[    5.163794] iommu: Adding device 0000:7f:12.0 to group 34
[    5.169963] iommu: Adding device 0000:7f:12.1 to group 34
[    5.176149] iommu: Adding device 0000:7f:12.2 to group 34
[    5.182504] iommu: Adding device 0000:7f:13.0 to group 35
[    5.192054] iommu: Adding device 0000:7f:13.1 to group 35
[    5.198224] iommu: Adding device 0000:7f:13.2 to group 35
[    5.204394] iommu: Adding device 0000:7f:13.3 to group 35
[    5.210564] iommu: Adding device 0000:7f:13.4 to group 35
[    5.216737] iommu: Adding device 0000:7f:13.5 to group 35
[    5.222915] iommu: Adding device 0000:7f:13.6 to group 35
[    5.229083] iommu: Adding device 0000:7f:13.7 to group 35
[    5.235437] iommu: Adding device 0000:7f:14.0 to group 36
[    5.241608] iommu: Adding device 0000:7f:14.1 to group 36
[    5.247813] iommu: Adding device 0000:7f:14.2 to group 36
[    5.253983] iommu: Adding device 0000:7f:14.3 to group 36
[    5.260154] iommu: Adding device 0000:7f:14.4 to group 36
[    5.266327] iommu: Adding device 0000:7f:14.5 to group 36
[    5.272504] iommu: Adding device 0000:7f:14.6 to group 36
[    5.278671] iommu: Adding device 0000:7f:14.7 to group 36
[    5.284930] iommu: Adding device 0000:7f:15.0 to group 37
[    5.291101] iommu: Adding device 0000:7f:15.1 to group 37
[    5.297273] iommu: Adding device 0000:7f:15.2 to group 37
[    5.303447] iommu: Adding device 0000:7f:15.3 to group 37
[    5.309684] iommu: Adding device 0000:7f:16.0 to group 38
[    5.315866] iommu: Adding device 0000:7f:16.6 to group 38
[    5.322043] iommu: Adding device 0000:7f:16.7 to group 38
[    5.328327] iommu: Adding device 0000:7f:17.0 to group 39
[    5.334499] iommu: Adding device 0000:7f:17.4 to group 39
[    5.340673] iommu: Adding device 0000:7f:17.5 to group 39
[    5.346846] iommu: Adding device 0000:7f:17.6 to group 39
[    5.353018] iommu: Adding device 0000:7f:17.7 to group 39
[    5.359305] iommu: Adding device 0000:7f:1e.0 to group 40
[    5.365483] iommu: Adding device 0000:7f:1e.1 to group 40
[    5.371692] iommu: Adding device 0000:7f:1e.2 to group 40
[    5.377865] iommu: Adding device 0000:7f:1e.3 to group 40
[    5.384041] iommu: Adding device 0000:7f:1e.4 to group 40
[    5.390250] iommu: Adding device 0000:7f:1f.0 to group 41
[    5.396426] iommu: Adding device 0000:7f:1f.2 to group 41
[    5.402594] iommu: Adding device 0000:80:00.0 to group 42
[    5.408755] iommu: Adding device 0000:80:01.0 to group 43
[    5.414923] iommu: Adding device 0000:80:01.1 to group 44
[    5.421086] iommu: Adding device 0000:80:02.0 to group 45
[    5.427252] iommu: Adding device 0000:80:02.1 to group 46
[    5.433422] iommu: Adding device 0000:80:02.2 to group 47
[    5.439589] iommu: Adding device 0000:80:02.3 to group 48
[    5.445756] iommu: Adding device 0000:80:03.0 to group 49
[    5.451922] iommu: Adding device 0000:80:03.1 to group 50
[    5.458094] iommu: Adding device 0000:80:03.2 to group 51
[    5.464266] iommu: Adding device 0000:80:03.3 to group 52
[    5.470619] iommu: Adding device 0000:80:04.0 to group 53
[    5.476793] iommu: Adding device 0000:80:04.1 to group 53
[    5.482969] iommu: Adding device 0000:80:04.2 to group 53
[    5.489146] iommu: Adding device 0000:80:04.3 to group 53
[    5.495363] iommu: Adding device 0000:80:04.4 to group 53
[    5.501539] iommu: Adding device 0000:80:04.5 to group 53
[    5.507722] iommu: Adding device 0000:80:04.6 to group 53
[    5.513905] iommu: Adding device 0000:80:04.7 to group 53
[    5.520166] iommu: Adding device 0000:80:05.0 to group 54
[    5.526343] iommu: Adding device 0000:80:05.1 to group 54
[    5.532518] iommu: Adding device 0000:80:05.2 to group 54
[    5.538697] iommu: Adding device 0000:80:05.4 to group 54
[    5.544862] iommu: Adding device 0000:81:00.0 to group 55
[    5.551029] iommu: Adding device 0000:81:00.1 to group 56
[    5.557196] iommu: Adding device 0000:81:00.2 to group 57
[    5.563357] iommu: Adding device 0000:81:00.3 to group 58
[    5.569571] iommu: Adding device 0000:ff:08.0 to group 59
[    5.575748] iommu: Adding device 0000:ff:08.3 to group 59
[    5.581963] iommu: Adding device 0000:ff:09.0 to group 60
[    5.588145] iommu: Adding device 0000:ff:09.3 to group 60
[    5.594383] iommu: Adding device 0000:ff:0b.0 to group 61
[    5.600561] iommu: Adding device 0000:ff:0b.1 to group 61
[    5.606732] iommu: Adding device 0000:ff:0b.2 to group 61
[    5.613079] iommu: Adding device 0000:ff:0c.0 to group 62
[    5.619315] iommu: Adding device 0000:ff:0c.1 to group 62
[    5.625501] iommu: Adding device 0000:ff:0c.2 to group 62
[    5.631682] iommu: Adding device 0000:ff:0c.3 to group 62
[    5.637859] iommu: Adding device 0000:ff:0c.4 to group 62
[    5.644041] iommu: Adding device 0000:ff:0c.5 to group 62
[    5.650217] iommu: Adding device 0000:ff:0c.6 to group 62
[    5.656400] iommu: Adding device 0000:ff:0c.7 to group 62
[    5.662679] iommu: Adding device 0000:ff:0f.0 to group 63
[    5.668857] iommu: Adding device 0000:ff:0f.1 to group 63
[    5.675047] iommu: Adding device 0000:ff:0f.4 to group 63
[    5.681223] iommu: Adding device 0000:ff:0f.5 to group 63
[    5.687407] iommu: Adding device 0000:ff:0f.6 to group 63
[    5.693694] iommu: Adding device 0000:ff:10.0 to group 64
[    5.699875] iommu: Adding device 0000:ff:10.1 to group 64
[    5.706054] iommu: Adding device 0000:ff:10.5 to group 64
[    5.712233] iommu: Adding device 0000:ff:10.6 to group 64
[    5.718416] iommu: Adding device 0000:ff:10.7 to group 64
[    5.724657] iommu: Adding device 0000:ff:12.0 to group 65
[    5.730839] iommu: Adding device 0000:ff:12.1 to group 65
[    5.737016] iommu: Adding device 0000:ff:12.2 to group 65
[    5.743369] iommu: Adding device 0000:ff:13.0 to group 66
[    5.749549] iommu: Adding device 0000:ff:13.1 to group 66
[    5.755731] iommu: Adding device 0000:ff:13.2 to group 66
[    5.761915] iommu: Adding device 0000:ff:13.3 to group 66
[    5.768104] iommu: Adding device 0000:ff:13.4 to group 66
[    5.774283] iommu: Adding device 0000:ff:13.5 to group 66
[    5.780465] iommu: Adding device 0000:ff:13.6 to group 66
[    5.786647] iommu: Adding device 0000:ff:13.7 to group 66
[    5.793001] iommu: Adding device 0000:ff:14.0 to group 67
[    5.799188] iommu: Adding device 0000:ff:14.1 to group 67
[    5.805370] iommu: Adding device 0000:ff:14.2 to group 67
[    5.811559] iommu: Adding device 0000:ff:14.3 to group 67
[    5.817744] iommu: Adding device 0000:ff:14.4 to group 67
[    5.823925] iommu: Adding device 0000:ff:14.5 to group 67
[    5.830109] iommu: Adding device 0000:ff:14.6 to group 67
[    5.836289] iommu: Adding device 0000:ff:14.7 to group 67
[    5.842547] iommu: Adding device 0000:ff:15.0 to group 68
[    5.848736] iommu: Adding device 0000:ff:15.1 to group 68
[    5.854920] iommu: Adding device 0000:ff:15.2 to group 68
[    5.861104] iommu: Adding device 0000:ff:15.3 to group 68
[    5.867491] iommu: Adding device 0000:ff:16.0 to group 69
[    5.873674] iommu: Adding device 0000:ff:16.6 to group 69
[    5.879854] iommu: Adding device 0000:ff:16.7 to group 69
[    5.886132] iommu: Adding device 0000:ff:17.0 to group 70
[    5.892315] iommu: Adding device 0000:ff:17.4 to group 70
[    5.898497] iommu: Adding device 0000:ff:17.5 to group 70
[    5.904683] iommu: Adding device 0000:ff:17.6 to group 70
[    5.910867] iommu: Adding device 0000:ff:17.7 to group 70
[    5.917148] iommu: Adding device 0000:ff:1e.0 to group 71
[    5.923332] iommu: Adding device 0000:ff:1e.1 to group 71
[    5.929518] iommu: Adding device 0000:ff:1e.2 to group 71
[    5.935704] iommu: Adding device 0000:ff:1e.3 to group 71
[    5.941890] iommu: Adding device 0000:ff:1e.4 to group 71
[    5.948101] iommu: Adding device 0000:ff:1f.0 to group 72
[    5.954286] iommu: Adding device 0000:ff:1f.2 to group 72
[    5.961813] Intel CQM monitoring enabled
[    5.967069] RAPL PMU: API unit is 2^-32 Joules, 4 fixed counters, 655360 ms ovfl timer
[    5.976163] RAPL PMU: hw unit of domain pp0-core 2^-14 Joules
[    5.982702] RAPL PMU: hw unit of domain package 2^-14 Joules
[    5.989145] RAPL PMU: hw unit of domain dram 2^-14 Joules
[    5.995401] RAPL PMU: hw unit of domain pp1-gpu 2^-14 Joules
[    6.004635] audit: initializing netlink subsys (disabled)
[    6.010862] audit: type=2000 audit(1503106895.894:1): state=initialized audit_enabled=0 res=1
[    6.011444] Initialise system trusted keyrings
[    6.011535] workingset: timestamp_bits=39 max_order=26 bucket_order=0
[    6.013003] SELinux:  Registering netfilter hooks
[    6.330576] Key type asymmetric registered
[    6.335279] Asymmetric key parser 'x509' registered
[    6.340856] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
[    6.349420] io scheduler noop registered
[    6.353934] io scheduler deadline registered
[    6.358870] io scheduler cfq registered (default)
[    6.364240] io scheduler mq-deadline registered
[    6.369448] io scheduler kyber registered
[    6.379442] pcieport 0000:00:01.0: Signaling PME with IRQ 25
[    6.385892] pcieport 0000:00:01.1: Signaling PME with IRQ 26
[    6.392325] pcieport 0000:00:02.0: Signaling PME with IRQ 28
[    6.398775] pcieport 0000:00:02.1: Signaling PME with IRQ 29
[    6.405211] pcieport 0000:00:02.2: Signaling PME with IRQ 30
[    6.411643] pcieport 0000:00:02.3: Signaling PME with IRQ 31
[    6.418080] pcieport 0000:00:03.0: Signaling PME with IRQ 33
[    6.424526] pcieport 0000:00:03.1: Signaling PME with IRQ 34
[    6.430963] pcieport 0000:00:03.2: Signaling PME with IRQ 35
[    6.437403] pcieport 0000:00:03.3: Signaling PME with IRQ 36
[    6.443845] pcieport 0000:00:1c.2: Signaling PME with IRQ 37
[    6.450281] pcieport 0000:00:1c.4: Signaling PME with IRQ 38
[    6.456726] pcieport 0000:00:1c.6: Signaling PME with IRQ 39
[    6.463170] pcieport 0000:00:1c.7: Signaling PME with IRQ 40
[    6.469610] pcieport 0000:80:00.0: Signaling PME with IRQ 41
[    6.476082] pcieport 0000:80:01.0: Signaling PME with IRQ 43
[    6.482552] pcieport 0000:80:01.1: Signaling PME with IRQ 44
[    6.507515] pcieport 0000:80:02.0: Signaling PME with IRQ 46
[    6.525510] pcieport 0000:80:02.1: Signaling PME with IRQ 47
[    6.543518] pcieport 0000:80:02.2: Signaling PME with IRQ 48
[    6.561515] pcieport 0000:80:02.3: Signaling PME with IRQ 49
[    6.579524] pcieport 0000:80:03.0: Signaling PME with IRQ 51
[    6.597504] pcieport 0000:80:03.1: Signaling PME with IRQ 52
[    6.615508] pcieport 0000:80:03.2: Signaling PME with IRQ 53
[    6.633516] pcieport 0000:80:03.3: Signaling PME with IRQ 54
[    6.639974] intel_idle: MWAIT substates: 0x2120
[    6.639975] intel_idle: v0.4.1 model 0x3F
[    6.641417] intel_idle: lapic_timer_reliable_states 0xffffffff
[    6.642350] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.650926] pstore: using zlib compression
[    6.655662] pstore: Registered erst as persistent store backend
[    6.662600] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    6.671129] ioatdma: Intel(R) QuickData Technology Driver 4.00
[    6.824020] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.851718] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    6.884028] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    6.896192] i8042: PNP: No PS/2 controller found.
[    6.901621] i8042: Probing ports directly.
[    6.908141] serio: i8042 KBD port at 0x60,0x64 irq 1
[    6.913823] serio: i8042 AUX port at 0x60,0x64 irq 12
[    6.919664] rtc_cmos 00:00: RTC can wake from S4
[    6.925127] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
[    6.932075] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[    6.941122] ip_tables: (C) 2000-2006 Netfilter Core Team
[    6.947320] NET: Registered protocol family 10
[    6.952814] Segment Routing with IPv6
[    6.957331] NET: Registered protocol family 17
[    6.962444] Key type dns_resolver registered
[    6.970010] microcode: sig=0x306f2, pf=0x1, revision=0x39
[    6.977101] microcode: Microcode Update Driver: v2.2.
[    6.977282] registered taskstats version 1
[    6.987800] Loading compiled-in X.509 certificates
[    6.995091] alg: No test for pkcs1pad(rsa,sha256) (pkcs1pad(rsa-generic,sha256))
[    7.004448] Loaded X.509 cert 'CoreOS, Inc: Module signing key for 4.12.7-coreos: ce09240b0423dc9a9afc51976e5bd459bb818b48'
[    7.017117] ima: No TPM chip found, activating TPM-bypass! (rc=-19)
[    7.025406] rtc_cmos 00:00: setting system clock to 2017-08-19 01:41:39 UTC (1503106899)
[    7.043859] Freeing unused kernel memory: 32412K
[    7.049171] Write protecting the kernel read-only data: 12288k
[    7.056616] Freeing unused kernel memory: 1936K
[    7.061819] tsc: Refined TSC clocksource calibration: 2397.223 MHz
[    7.068846] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x228df8107c2, max_idle_ns: 440795272256 ns
[    7.080591] Freeing unused kernel memory: 1444K
[    7.090378] random: systemd: uninitialized urandom read (16 bytes read)
[    7.098114] random: systemd: uninitialized urandom read (16 bytes read)
[    7.105599] random: systemd: uninitialized urandom read (16 bytes read)
[    7.115621] systemd[1]: systemd 233 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK -SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT -GNUTLS -ACL +XZ +LZ4 +SECCOMP +BLKID -ELFUTILS +KMOD -IDN default-hierarchy=legacy)
[    7.138816] systemd[1]: Detected architecture x86-64.
[    7.144572] systemd[1]: Running in initial RAM disk.
[    7.151067] systemd[1]: No hostname configured.
[    7.156256] systemd[1]: Set hostname to <localhost>.
[    7.161944] random: systemd: uninitialized urandom read (16 bytes read)
[    7.169426] systemd[1]: Initializing machine ID from random generator.
[    7.179076] random: systemd: uninitialized urandom read (16 bytes read)
[    7.187770] random: systemd: uninitialized urandom read (16 bytes read)
[    7.189346] random: systemd-cryptse: uninitialized urandom read (16 bytes read)
[    7.213808] random: systemd: uninitialized urandom read (16 bytes read)
[    7.221297] random: systemd: uninitialized urandom read (16 bytes read)
[    7.228827] random: systemd: uninitialized urandom read (16 bytes read)
[    7.240531] systemd[1]: Listening on udev Control Socket.
[    7.247367] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[    7.257103] systemd[1]: Listening on Journal Audit Socket.
[    7.263930] systemd[1]: Reached target Local File Systems.
[    7.282509] audit: type=1130 audit(1503106899.757:2): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=kmod-static-nodes comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.306793] audit: type=1130 audit(1503106899.781:3): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-tmpfiles-setup-dev comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.333907] audit: type=1130 audit(1503106899.808:4): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-cmdline comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.358080] audit: type=1130 audit(1503106899.832:5): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-journald comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.380789] device-mapper: uevent: version 1.0.3
[    7.386188] device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com
[    7.413391] audit: type=1130 audit(1503106899.887:6): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-pre-udev comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.440635] audit: type=1130 audit(1503106899.915:7): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-udevd comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.478660] audit: type=1130 audit(1503106899.953:8): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-pre-trigger comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.579646] audit: type=1130 audit(1503106900.054:9): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-udev-trigger comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    7.604207] SCSI subsystem initialized
[    7.608827] pps_core: LinuxPPS API ver. 1 registered
[    7.608828] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    7.625735] ACPI: bus type USB registered
[    7.625771] usbcore: registered new interface driver usbfs
[    7.625783] usbcore: registered new interface driver hub
[    7.625893] usbcore: registered new device driver usb
[    7.648664] PTP clock support registered
[    7.655428] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    7.664431] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.0.0-k
[    7.664554] tg3.c:v3.137 (May 11, 2014)
[    7.664971] HP HPSA Driver (v 3.4.18-0)
[    7.664984] hpsa 0000:08:00.0: can't disable ASPM; OS doesn't have ASPM control
[    7.665592] hpsa 0000:08:00.0: Logical aborts not supported
[    7.682432] tg3 0000:02:00.0 eth0: Tigon3 [partno(N/A) rev 5719001] (PCI Express) MAC address e0:07:1b:f6:6c:a4
[    7.682435] tg3 0000:02:00.0 eth0: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    7.682438] tg3 0000:02:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    7.682439] tg3 0000:02:00.0 eth0: dma_rwctrl[00000001] dma_mask[64-bit]
[    7.696105] tg3 0000:02:00.1 eth1: Tigon3 [partno(N/A) rev 5719001] (PCI Express) MAC address e0:07:1b:f6:6c:a5
[    7.696107] tg3 0000:02:00.1 eth1: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    7.696109] tg3 0000:02:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    7.696110] tg3 0000:02:00.1 eth1: dma_rwctrl[00000001] dma_mask[64-bit]
[    7.704610] scsi host0: hpsa
[    7.710173] tg3 0000:02:00.2 eth2: Tigon3 [partno(N/A) rev 5719001] (PCI Express) MAC address e0:07:1b:f6:6c:a6
[    7.710175] tg3 0000:02:00.2 eth2: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    7.710177] tg3 0000:02:00.2 eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    7.710178] tg3 0000:02:00.2 eth2: dma_rwctrl[00000001] dma_mask[64-bit]
[    7.725192] tg3 0000:02:00.3 eth3: Tigon3 [partno(N/A) rev 5719001] (PCI Express) MAC address e0:07:1b:f6:6c:a7
[    7.725193] tg3 0000:02:00.3 eth3: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    7.725194] tg3 0000:02:00.3 eth3: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    7.725195] tg3 0000:02:00.3 eth3: dma_rwctrl[00000001] dma_mask[64-bit]
[    7.729988] random: fast init done
[    7.730277] hpsa 0000:08:00.0: scsi 0:0:0:0: added RAID              HP       P840             controller SSDSmartPathCap- En- Exp=1
[    7.730279] hpsa 0000:08:00.0: scsi 0:0:1:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730281] hpsa 0000:08:00.0: scsi 0:0:2:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730283] hpsa 0000:08:00.0: scsi 0:0:3:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730285] hpsa 0000:08:00.0: scsi 0:0:4:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730287] hpsa 0000:08:00.0: scsi 0:0:5:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730288] hpsa 0000:08:00.0: scsi 0:0:6:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730290] hpsa 0000:08:00.0: scsi 0:0:7:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730292] hpsa 0000:08:00.0: scsi 0:0:8:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730293] hpsa 0000:08:00.0: scsi 0:0:9:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730295] hpsa 0000:08:00.0: scsi 0:0:10:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730297] hpsa 0000:08:00.0: scsi 0:0:11:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730299] hpsa 0000:08:00.0: scsi 0:0:12:0: masked Direct-Access     ATA      MK0480GFDKR      PHYS DRV SSDSmartPathCap- En- Exp=0
[    7.730301] hpsa 0000:08:00.0: scsi 0:1:0:0: added Direct-Access     HP       LOGICAL VOLUME   RAID-1(+0) SSDSmartPathCap+ En+ Exp=1
[    7.730303] hpsa 0000:08:00.0: scsi 0:1:0:1: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730304] hpsa 0000:08:00.0: scsi 0:1:0:2: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730306] hpsa 0000:08:00.0: scsi 0:1:0:3: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730308] hpsa 0000:08:00.0: scsi 0:1:0:4: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730309] hpsa 0000:08:00.0: scsi 0:1:0:5: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730311] hpsa 0000:08:00.0: scsi 0:1:0:6: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730313] hpsa 0000:08:00.0: scsi 0:1:0:7: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730314] hpsa 0000:08:00.0: scsi 0:1:0:8: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730316] hpsa 0000:08:00.0: scsi 0:1:0:9: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730318] hpsa 0000:08:00.0: scsi 0:1:0:10: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[    7.730869] scsi 0:0:0:0: RAID              HP       P840             5.04 PQ: 0 ANSI: 5
[    7.763661] ehci-pci: EHCI PCI platform driver
[    7.763948] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    7.763955] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    7.763969] ehci-pci 0000:00:1a.0: debug port 2
[    7.767898] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
[    7.767909] ehci-pci 0000:00:1a.0: irq 18, io mem 0x93801000
[    7.774553] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    7.774705] hub 1-0:1.0: USB hub found
[    7.774708] hub 1-0:1.0: 2 ports detected
[    7.775100] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    7.775105] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    7.775131] ehci-pci 0000:00:1d.0: debug port 2
[    7.779038] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
[    7.779042] ehci-pci 0000:00:1d.0: irq 18, io mem 0x93800000
[    7.785537] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    7.785682] hub 2-0:1.0: USB hub found
[    7.785687] hub 2-0:1.0: 2 ports detected
[    8.282844] ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[    8.282866] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    8.282867] clocksource: Switched to clocksource tsc
[    8.282869] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    8.310819] AVX2 version of gcm_enc/dec engaged.
[    8.310820] AES CTR mode by8 optimization enabled
[    8.311328] uhci_hcd: USB Universal Host Controller Interface driver
[    8.313281] xhci_hcd 0000:00:14.0: xHCI Host Controller
[    8.313289] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3
[    8.314499] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x00009810
[    8.314507] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported
[    8.314708] hub 3-0:1.0: USB hub found
[    8.314745] hub 3-0:1.0: 15 ports detected
[    8.315579] xhci_hcd 0000:00:14.0: xHCI Host Controller
[    8.315581] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4
[    8.315642] uhci_hcd 0000:01:00.4: UHCI Host Controller
[    8.316008] hub 4-0:1.0: USB hub found
[    8.316019] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    8.316020] igb: Copyright (c) 2007-2014 Intel Corporation.
[    8.316027] hub 4-0:1.0: 6 ports detected
[    8.316380] uhci_hcd 0000:01:00.4: new USB bus registered, assigned bus number 5
[    8.316403] uhci_hcd 0000:01:00.4: detected 8 ports
[    8.316404] uhci_hcd 0000:01:00.4: port count misdetected? forcing to 2 ports
[    8.316438] uhci_hcd 0000:01:00.4: irq 19, io base 0x00001300
[    8.316973] hub 5-0:1.0: USB hub found
[    8.316977] hub 5-0:1.0: 2 ports detected
[    8.382945] igb 0000:81:00.0: DCA enabled
[    8.383067] igb 0000:81:00.0: added PHC on eth4
[    8.383069] igb 0000:81:00.0: Intel(R) Gigabit Ethernet Network Connection
[    8.383072] igb 0000:81:00.0: eth4: (PCIe:5.0Gb/s:Width x4) 3c:a8:2a:5c:6a:d4
[    8.383365] igb 0000:81:00.0: eth4: PBA No: H73100-004
[    8.383366] igb 0000:81:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.402260] hub 1-1:1.0: USB hub found
[    8.402361] hub 1-1:1.0: 6 ports detected
[    8.403132] hub 2-1:1.0: USB hub found
[    8.403239] hub 2-1:1.0: 8 ports detected
[    8.450901] igb 0000:81:00.1: DCA enabled
[    8.450980] igb 0000:81:00.1: added PHC on eth5
[    8.450980] igb 0000:81:00.1: Intel(R) Gigabit Ethernet Network Connection
[    8.450982] igb 0000:81:00.1: eth5: (PCIe:5.0Gb/s:Width x4) 3c:a8:2a:5c:6a:d5
[    8.451266] igb 0000:81:00.1: eth5: PBA No: H73100-004
[    8.451267] igb 0000:81:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.518921] igb 0000:81:00.2: DCA enabled
[    8.518984] igb 0000:81:00.2: added PHC on eth6
[    8.518984] igb 0000:81:00.2: Intel(R) Gigabit Ethernet Network Connection
[    8.518985] igb 0000:81:00.2: eth6: (PCIe:5.0Gb/s:Width x4) 3c:a8:2a:5c:6a:d6
[    8.519270] igb 0000:81:00.2: eth6: PBA No: H73100-004
[    8.519271] igb 0000:81:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.548287] ixgbe 0000:04:00.0: Multiqueue Enabled: Rx Queue count = 32, Tx Queue count = 32 XDP Queue count = 0
[    8.583628] ixgbe 0000:04:00.0: PCI Express bandwidth of 32GT/s available
[    8.583629] ixgbe 0000:04:00.0: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[    8.586949] igb 0000:81:00.3: DCA enabled
[    8.587108] igb 0000:81:00.3: added PHC on eth7
[    8.587109] igb 0000:81:00.3: Intel(R) Gigabit Ethernet Network Connection
[    8.587110] igb 0000:81:00.3: eth7: (PCIe:5.0Gb/s:Width x4) 3c:a8:2a:5c:6a:d7
[    8.587395] igb 0000:81:00.3: eth7: PBA No: H73100-004
[    8.587395] igb 0000:81:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    8.628630] usb 5-1: new full-speed USB device number 2 using uhci_hcd
[    8.679619] ixgbe 0000:04:00.0: MAC: 3, PHY: 0, PBA No: G74768-012
[    8.686647] ixgbe 0000:04:00.0: 5c:b9:01:9c:c8:dc
[    8.686659] usb 3-3: new high-speed USB device number 2 using xhci_hcd
[    8.689131] scsi 0:1:0:0: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.721915] scsi 0:1:0:1: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.746906] scsi 0:1:0:2: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.781161] hidraw: raw HID events driver (C) Jiri Kosina
[    8.791830] scsi 0:1:0:3: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.793894] usbcore: registered new interface driver usbhid
[    8.793895] usbhid: USB HID core driver
[    8.813231] input: BMC Virtual Keyboard  as /devices/pci0000:00/0000:00:1c.2/0000:01:00.4/usb5/5-1/5-1:1.0/0003:03F0:7029.0001/input/input2
[    8.838598] ixgbe 0000:04:00.0: Intel(R) 10 Gigabit Network Connection
[    8.838779] scsi 0:1:0:4: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.866881] hub 3-3:1.0: USB hub found
[    8.871293] hub 3-3:1.0: 2 ports detected
[    8.871777] scsi 0:1:0:5: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.878669] hid-generic 0003:03F0:7029.0001: input,hidraw0: USB HID v1.01 Keyboard [BMC Virtual Keyboard ] on usb-0000:01:00.4-1/input0
[    8.878755] input: BMC Virtual Keyboard  as /devices/pci0000:00/0000:00:1c.2/0000:01:00.4/usb5/5-1/5-1:1.1/0003:03F0:7029.0002/input/input3
[    8.878779] hid-generic 0003:03F0:7029.0002: input,hidraw1: USB HID v1.01 Mouse [BMC Virtual Keyboard ] on usb-0000:01:00.4-1/input1
[    8.941956] scsi 0:1:0:6: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.966873] scsi 0:1:0:7: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    8.992001] scsi 0:1:0:8: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    9.016855] scsi 0:1:0:9: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    9.041937] scsi 0:1:0:10: Direct-Access     HP       LOGICAL VOLUME   5.04 PQ: 0 ANSI: 5
[    9.069427] sd 0:1:0:0: [sda] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069604] sd 0:1:0:1: [sdb] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069606] sd 0:1:0:1: [sdb] 4096-byte physical blocks
[    9.069621] sd 0:1:0:2: [sdc] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069622] sd 0:1:0:2: [sdc] 4096-byte physical blocks
[    9.069650] sd 0:1:0:1: [sdb] Write Protect is off
[    9.069651] sd 0:1:0:1: [sdb] Mode Sense: 73 00 00 08
[    9.069679] sd 0:1:0:2: [sdc] Write Protect is off
[    9.069681] sd 0:1:0:2: [sdc] Mode Sense: 73 00 00 08
[    9.069691] sd 0:1:0:3: [sdd] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069693] sd 0:1:0:3: [sdd] 4096-byte physical blocks
[    9.069755] sd 0:1:0:3: [sdd] Write Protect is off
[    9.069756] sd 0:1:0:3: [sdd] Mode Sense: 73 00 00 08
[    9.069767] sd 0:1:0:1: [sdb] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.069775] sd 0:1:0:4: [sde] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069776] sd 0:1:0:4: [sde] 4096-byte physical blocks
[    9.069804] sd 0:1:0:2: [sdc] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.069844] sd 0:1:0:4: [sde] Write Protect is off
[    9.069846] sd 0:1:0:4: [sde] Mode Sense: 73 00 00 08
[    9.069880] sd 0:1:0:3: [sdd] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.069883] sd 0:1:0:5: [sdf] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069885] sd 0:1:0:5: [sdf] 4096-byte physical blocks
[    9.069918] sd 0:1:0:5: [sdf] Write Protect is off
[    9.069920] sd 0:1:0:5: [sdf] Mode Sense: 73 00 00 08
[    9.069933] sd 0:1:0:7: [sdh] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069934] sd 0:1:0:7: [sdh] 4096-byte physical blocks
[    9.069940] sd 0:1:0:4: [sde] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.069953] sd 0:1:0:6: [sdg] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.069955] sd 0:1:0:6: [sdg] 4096-byte physical blocks
[    9.069971] sd 0:1:0:7: [sdh] Write Protect is off
[    9.069973] sd 0:1:0:7: [sdh] Mode Sense: 73 00 00 08
[    9.069994] sd 0:1:0:6: [sdg] Write Protect is off
[    9.069996] sd 0:1:0:6: [sdg] Mode Sense: 73 00 00 08
[    9.070001] sd 0:1:0:5: [sdf] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.070041] sd 0:1:0:7: [sdh] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.070069] sd 0:1:0:6: [sdg] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.070465] sd 0:1:0:8: [sdi] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.070466] sd 0:1:0:8: [sdi] 4096-byte physical blocks
[    9.070502] sd 0:1:0:8: [sdi] Write Protect is off
[    9.070503] sd 0:1:0:8: [sdi] Mode Sense: 73 00 00 08
[    9.070628] sd 0:1:0:8: [sdi] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.070736] sd 0:1:0:9: [sdj] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.070738] sd 0:1:0:9: [sdj] 4096-byte physical blocks
[    9.070781] sd 0:1:0:9: [sdj] Write Protect is off
[    9.070783] sd 0:1:0:9: [sdj] Mode Sense: 73 00 00 08
[    9.070826] sd 0:1:0:10: [sdk] 937637552 512-byte logical blocks: (480 GB/447 GiB)
[    9.070828] sd 0:1:0:10: [sdk] 4096-byte physical blocks
[    9.070879] sd 0:1:0:10: [sdk] Write Protect is off
[    9.070881] sd 0:1:0:10: [sdk] Mode Sense: 73 00 00 08
[    9.070928] sd 0:1:0:9: [sdj] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.070940] sd 0:1:0:10: [sdk] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.073116] sd 0:1:0:6: [sdg] Attached SCSI disk
[    9.073226] sd 0:1:0:7: [sdh] Attached SCSI disk
[    9.074277] sd 0:1:0:9: [sdj] Attached SCSI disk
[    9.075025] sd 0:1:0:2: [sdc] Attached SCSI disk
[    9.075030] sd 0:1:0:4: [sde] Attached SCSI disk
[    9.075099] sd 0:1:0:3: [sdd] Attached SCSI disk
[    9.075149] sd 0:1:0:1: [sdb] Attached SCSI disk
[    9.075258] sd 0:1:0:5: [sdf] Attached SCSI disk
[    9.075997] sd 0:1:0:8: [sdi] Attached SCSI disk
[    9.076018] sd 0:1:0:10: [sdk] Attached SCSI disk
[    9.164199] ixgbe 0000:04:00.1: Multiqueue Enabled: Rx Queue count = 32, Tx Queue count = 32 XDP Queue count = 0
[    9.199652] ixgbe 0000:04:00.1: PCI Express bandwidth of 32GT/s available
[    9.199655] ixgbe 0000:04:00.1: (Speed:5.0GT/s, Width: x8, Encoding Loss:20%)
[    9.295661] ixgbe 0000:04:00.1: MAC: 3, PHY: 0, PBA No: G74768-012
[    9.295663] ixgbe 0000:04:00.1: 5c:b9:01:9c:c8:dd
[    9.442710] ixgbe 0000:04:00.1: Intel(R) 10 Gigabit Network Connection
[    9.485376] sd 0:1:0:0: [sda] 4096-byte physical blocks
[    9.485417] sd 0:1:0:0: [sda] Write Protect is off
[    9.485418] sd 0:1:0:0: [sda] Mode Sense: 73 00 00 08
[    9.485469] sd 0:1:0:0: [sda] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[    9.488416]  sda: sda1 sda2 sda3 sda4 sda6 sda7 sda9
[    9.493514] sd 0:1:0:0: [sda] Attached SCSI disk
[    9.540663] audit: type=1130 audit(1503106902.015:10): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-initqueue comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    9.910234] EXT4-fs (sda9): mounted filesystem with ordered data mode. Opts: (null)
[    9.927446] EXT4-fs (sda4): mounted filesystem without journal. Opts: (null)
[   10.096367] systemd-journald[351]: Received SIGTERM from PID 1 (systemd).
[   10.110668] systemd: 22 output lines suppressed due to ratelimiting
[   10.143600] SELinux: 4096 avtab hash slots, 13428 rules.
[   10.145077] SELinux: 4096 avtab hash slots, 13428 rules.
[   10.145526] SELinux:  6 users, 6 roles, 1327 types, 55 bools, 1 sens, 1024 cats
[   10.145528] SELinux:  92 classes, 13428 rules
[   10.146043] SELinux:  Permission validate_trans in class security not defined in policy.
[   10.155304] SELinux:  Permission getrlimit in class process not defined in policy.
[   10.163984] SELinux:  Permission module_load in class system not defined in policy.
[   10.172814] SELinux:  Class cap_userns not defined in policy.
[   10.179338] SELinux:  Class cap2_userns not defined in policy.
[   10.185958] SELinux:  Class sctp_socket not defined in policy.
[   10.192580] SELinux:  Class icmp_socket not defined in policy.
[   10.199200] SELinux:  Class ax25_socket not defined in policy.
[   10.205823] SELinux:  Class ipx_socket not defined in policy.
[   10.212352] SELinux:  Class netrom_socket not defined in policy.
[   10.219161] SELinux:  Class atmpvc_socket not defined in policy.
[   10.225973] SELinux:  Class x25_socket not defined in policy.
[   10.232499] SELinux:  Class rose_socket not defined in policy.
[   10.239117] SELinux:  Class decnet_socket not defined in policy.
[   10.245932] SELinux:  Class atmsvc_socket not defined in policy.
[   10.252773] SELinux:  Class rds_socket not defined in policy.
[   10.259317] SELinux:  Class irda_socket not defined in policy.
[   10.265957] SELinux:  Class pppox_socket not defined in policy.
[   10.272690] SELinux:  Class llc_socket not defined in policy.
[   10.279231] SELinux:  Class can_socket not defined in policy.
[   10.285774] SELinux:  Class tipc_socket not defined in policy.
[   10.292417] SELinux:  Class bluetooth_socket not defined in policy.
[   10.299539] SELinux:  Class iucv_socket not defined in policy.
[   10.306191] SELinux:  Class rxrpc_socket not defined in policy.
[   10.312919] SELinux:  Class isdn_socket not defined in policy.
[   10.319572] SELinux:  Class phonet_socket not defined in policy.
[   10.326402] SELinux:  Class ieee802154_socket not defined in policy.
[   10.333612] SELinux:  Class caif_socket not defined in policy.
[   10.340246] SELinux:  Class alg_socket not defined in policy.
[   10.346799] SELinux:  Class nfc_socket not defined in policy.
[   10.353336] SELinux:  Class vsock_socket not defined in policy.
[   10.360079] SELinux:  Class kcm_socket not defined in policy.
[   10.366620] SELinux:  Class qipcrtr_socket not defined in policy.
[   10.373682] SELinux:  Class smc_socket not defined in policy.
[   10.380228] SELinux: the above unknown classes and permissions will be allowed
[   10.388582] SELinux:  Completing initialization.
[   10.388583] SELinux:  Setting up existing superblocks.
[   10.406011] systemd[1]: Successfully loaded SELinux policy in 277.447ms.
[   10.421570] systemd[1]: Relabelled /dev and /run in 5.792ms.
[   11.216369] kauditd_printk_skb: 34 callbacks suppressed
[   11.222351] audit: type=1130 audit(1503106903.690:45): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-journald comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.222354] audit: type=1131 audit(1503106903.690:46): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-journald comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.273185] audit: type=1130 audit(1503106903.747:47): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=initrd-switch-root comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.301854] audit: type=1131 audit(1503106903.747:48): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=initrd-switch-root comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.327646] audit: type=1130 audit(1503106903.802:49): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-journald comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.352596] audit: type=1131 audit(1503106903.802:50): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-journald comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.384322] audit: type=1305 audit(1503106903.858:51): audit_enabled=1 old=1 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 res=1
[   11.404689] audit: type=1130 audit(1503106903.879:52): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-fsck@dev-disk-by\x2dpartuuid-e03dd35c\x2d7c2d\x2d4a47\x2db3fe\x2d27f15780a57c comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.436436] audit: type=1131 audit(1503106903.879:53): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-fsck@dev-disk-by\x2dpartuuid-e03dd35c\x2d7c2d\x2d4a47\x2db3fe\x2d27f15780a57c comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.485222] audit: type=1130 audit(1503106903.959:54): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-fsck-root comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   11.537926] systemd-journald[852]: Received request to flush runtime journal from PID 1
[   11.549153] systemd-journald[852]: File /var/log/journal/5febec48382b49d2b9bb70a77b4934aa/system.journal corrupted or uncleanly shut down, renaming and replacing.
[   11.609877] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4
[   11.618374] ACPI: Power Button [PWRF]
[   11.623113] ipmi message handler version 39.2
[   11.630081] ipmi device interface
[   11.636367] pcc-cpufreq: (v1.10.00) driver loaded with frequency limits: 1200 MHz, 2400 MHz
[   11.649861] ipmi_si IPI0001:00: ipmi_si: probing via ACPI
[   11.657476] ipmi_si IPI0001:00: [io  0x0ca2-0x0ca3] regsize 1 spacing 1 irq 0
[   11.658255] ixgbe 0000:04:00.0 eno49: renamed from eth8
[   11.671485] ipmi_si: Adding ACPI-specified kcs state machine
[   11.677997] IPMI System Interface driver.
[   11.680435] random: crng init done
[   11.686689] ipmi_si: probing via SMBIOS
[   11.691117] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[   11.692991] ixgbe 0000:04:00.1 eno50: renamed from eth9
[   11.703802] ipmi_si: SMBIOS-specified kcs state machine: duplicate
[   11.710818] ipmi_si: probing via SPMI
[   11.715075] ipmi_si: SPMI: io 0xca3 regsize 1 spacing 1 irq 0
[   11.715154] ipmi_si: Adding SPMI-specified kcs state machine
[   11.715157] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[   11.739798] mousedev: PS/2 mouse device common for all mice
[   11.747588] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   11.766072] EXT4-fs (sda6): recovery complete
[   11.771084] EXT4-fs (sda6): mounted filesystem with ordered data mode. Opts: commit=600
[   11.775261] igb 0000:81:00.1 ens6f1: renamed from eth5
[   11.789852] igb 0000:81:00.2 ens6f2: renamed from eth6
[   11.796212] FAT-fs (sda1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
[   11.816946] EDAC MC: Ver: 3.0.0
[   11.821884] igb 0000:81:00.3 ens6f3: renamed from eth7
[   11.827963] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[   11.827983] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[   11.828005] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[   11.828013] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[   11.828019] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[   11.828026] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[   11.828029] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[   11.828035] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[   11.828042] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[   11.828045] EDAC sbridge: Seeking for: PCI ID 8086:2f60
[   11.828057] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[   11.828064] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[   11.828073] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[   11.828076] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[   11.828082] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[   11.828091] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[   11.828094] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[   11.828100] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[   11.828107] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[   11.828110] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[   11.828116] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[   11.828124] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[   11.828127] EDAC sbridge: Seeking for: PCI ID 8086:2fac
[   11.828133] EDAC sbridge: Seeking for: PCI ID 8086:2fac
[   11.828140] EDAC sbridge: Seeking for: PCI ID 8086:2fac
[   11.828143] EDAC sbridge: Seeking for: PCI ID 8086:2fad
[   11.828149] EDAC sbridge: Seeking for: PCI ID 8086:2fad
[   11.828157] EDAC sbridge: Seeking for: PCI ID 8086:2fad
[   11.828160] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[   11.828167] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[   11.828175] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[   11.828177] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[   11.828184] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[   11.828192] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[   11.828194] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[   11.828213] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[   11.828232] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[   11.828234] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[   11.828241] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[   11.828247] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[   11.828248] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[   11.828256] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[   11.828263] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[   11.828265] EDAC sbridge: Seeking for: PCI ID 8086:2f79
[   11.828275] EDAC sbridge: Seeking for: PCI ID 8086:2f6a
[   11.828287] EDAC sbridge: Seeking for: PCI ID 8086:2f6b
[   11.828309] EDAC sbridge: Seeking for: PCI ID 8086:2f6c
[   11.828320] EDAC sbridge: Seeking for: PCI ID 8086:2f6d
[   11.828513] EDAC MC0: Giving out device to module sbridge_edac.c controller Haswell Socket#0: DEV 0000:7f:12.0 (INTERRUPT)
[   11.841191] EDAC MC1: Giving out device to module sbridge_edac.c controller Haswell Socket#1: DEV 0000:ff:12.0 (INTERRUPT)
[   11.853716] EDAC sbridge:  Ver: 1.1.1
[   11.877903] igb 0000:81:00.0 ens6f0: renamed from eth4
[   11.899071] tg3 0000:02:00.1 eno2: renamed from eth1
[   11.911470] ipmi_si IPI0001:00: Found new BMC (man_id: 0x00000b, prod_id: 0x2000, dev_id: 0x13)
[   11.917879] tg3 0000:02:00.0 eno1: renamed from eth0
[   11.927140] ipmi_si IPI0001:00: IPMI kcs interface initialized
[   11.935608] IPMI SSIF Interface driver
[   11.946867] tg3 0000:02:00.2 eno3: renamed from eth2
[   11.973872] tg3 0000:02:00.3 eno4: renamed from eth3
[   12.244229] Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)
[   12.251673] bond1 (uninitialized): Setting MII monitoring interval to 1000
[   12.251674] bond1 (uninitialized): Setting resend_igmp to 1
[   12.265803] IPv6: ADDRCONF(NETDEV_UP): bond1: link is not ready
[   12.411895] pps pps0: new PPS source ptp8
[   12.416507] ixgbe 0000:04:00.1: registered PHC device on eno50
[   12.556817] IPv6: ADDRCONF(NETDEV_UP): eno50: link is not ready
[   12.710227] pps pps1: new PPS source ptp9
[   12.714836] ixgbe 0000:04:00.0: registered PHC device on eno49
[   12.855139] IPv6: ADDRCONF(NETDEV_UP): eno49: link is not ready
[   12.974244] bond1: Enslaving ens6f3 as a backup interface with a down link
[   13.095131] IPv6: ADDRCONF(NETDEV_UP): ens6f2: link is not ready
[   13.165968] EXT4-fs (sdb): recovery complete
[   13.170914] EXT4-fs (sdb): mounted filesystem with ordered data mode. Opts: (null)
[   13.297904] bond1: Enslaving ens6f1 as a backup interface with a down link
[   13.322979] EXT4-fs (sdc): recovery complete
[   13.327937] EXT4-fs (sdc): mounted filesystem with ordered data mode. Opts: (null)
[   13.417522] IPv6: ADDRCONF(NETDEV_UP): ens6f0: link is not ready
[   13.472357] EXT4-fs (sdd): recovery complete
[   13.477343] EXT4-fs (sdd): mounted filesystem with ordered data mode. Opts: (null)
[   13.544911] IPv6: ADDRCONF(NETDEV_UP): eno4: link is not ready
[   13.622459] EXT4-fs (sde): recovery complete
[   13.627439] EXT4-fs (sde): mounted filesystem with ordered data mode. Opts: (null)
[   13.672077] bond1: Enslaving eno3 as a backup interface with a down link
[   13.679971] EXT4-fs (sdf): recovery complete
[   13.684946] EXT4-fs (sdf): mounted filesystem with ordered data mode. Opts: (null)
[   13.777284] EXT4-fs (sdg): recovery complete
[   13.782267] EXT4-fs (sdg): mounted filesystem with ordered data mode. Opts: (null)
[   13.799727] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready
[   13.890977] EXT4-fs (sdh): recovery complete
[   13.896095] EXT4-fs (sdh): mounted filesystem with ordered data mode. Opts: (null)
[   13.927760] bond1: Enslaving eno1 as a backup interface with a down link
[   13.964489] EXT4-fs (sdi): recovery complete
[   13.969527] EXT4-fs (sdi): mounted filesystem with ordered data mode. Opts: (null)
[   14.121271] EXT4-fs (sdj): recovery complete
[   14.126332] EXT4-fs (sdj): mounted filesystem with ordered data mode. Opts: (null)
[   14.283652] EXT4-fs (sdk): recovery complete
[   14.288736] EXT4-fs (sdk): mounted filesystem with ordered data mode. Opts: (null)
[   16.419395] igb 0000:81:00.3 ens6f3: igb: ens6f3 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   16.570407] igb 0000:81:00.2 ens6f2: igb: ens6f2 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   16.581211] IPv6: ADDRCONF(NETDEV_CHANGE): ens6f2: link becomes ready
[   16.947464] igb 0000:81:00.1 ens6f1: igb: ens6f1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   17.365128] bond1: link status definitely up for interface ens6f3, 1000 Mbps full duplex
[   17.374117] bond1: making interface ens6f3 the new active one
[   17.380746] bond1: first active interface up!
[   17.385596] bond1: link status definitely up for interface ens6f1, 1000 Mbps full duplex
[   17.394715] IPv6: ADDRCONF(NETDEV_CHANGE): bond1: link becomes ready
[   37.959643] hpsa 0000:08:00.0: Acknowledging event: 0xc0000000 (HP SSD Smart Path configuration change)
[   38.018204] hpsa 0000:08:00.0: scsi 0:1:0:0: updated Direct-Access     HP       LOGICAL VOLUME   RAID-1(+0) SSDSmartPathCap+ En+ Exp=1
[   38.031569] hpsa 0000:08:00.0: scsi 0:1:0:1: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.044687] hpsa 0000:08:00.0: scsi 0:1:0:2: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.057943] hpsa 0000:08:00.0: scsi 0:1:0:3: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.071204] hpsa 0000:08:00.0: scsi 0:1:0:4: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.084455] hpsa 0000:08:00.0: scsi 0:1:0:5: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.097704] hpsa 0000:08:00.0: scsi 0:1:0:6: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.110953] hpsa 0000:08:00.0: scsi 0:1:0:7: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.124271] hpsa 0000:08:00.0: scsi 0:1:0:8: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.137523] hpsa 0000:08:00.0: scsi 0:1:0:9: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   38.150771] hpsa 0000:08:00.0: scsi 0:1:0:10: updated Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap+ En+ Exp=1
[   39.285572] nf_conntrack version 0.5.0 (65536 buckets, 262144 max)
[   39.834556] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[   39.850385] Bridge firewalling registered
[   39.895052] Initializing XFRM netlink socket
[   39.920473] IPv6: ADDRCONF(NETDEV_UP): docker0: link is not ready
[   40.475860] docker0: port 1(veth616b696) entered blocking state
[   40.482445] docker0: port 1(veth616b696) entered disabled state
[   40.489121] device veth616b696 entered promiscuous mode
[   40.495424] IPv6: ADDRCONF(NETDEV_UP): veth616b696: link is not ready
[   40.502738] docker0: port 1(veth616b696) entered blocking state
[   40.509456] docker0: port 1(veth616b696) entered forwarding state
[   40.516531] docker0: port 1(veth616b696) entered disabled state
[   40.562760] SELinux: mount invalid.  Same superblock, different security settings for (dev mqueue, type mqueue)
[   40.603627] eth0: renamed from vethca7f846
[   40.618590] IPv6: ADDRCONF(NETDEV_CHANGE): veth616b696: link becomes ready
[   40.626412] docker0: port 1(veth616b696) entered blocking state
[   40.633135] docker0: port 1(veth616b696) entered forwarding state
[   40.640142] IPv6: ADDRCONF(NETDEV_CHANGE): docker0: link becomes ready
bgilbert commented 5 years ago

Are you still seeing this on current versions of Container Linux?