search

open-power / op-build

Buildroot overlay for Open Power
GNU General Public License v2.0
105 stars 183 forks source link

Linux 4.14 lockup on DD2.2 with LSI SAS #1974

Open madscientist159 opened 6 years ago

madscientist159 commented 6 years ago

Not sure where to file this, putting it here until the actual failing component can be determined.

On a Talos system with DD2.2 CPUs and multiple LSI SAS controllers, under Debian (and presumably other distros), one or more of the controller drivers locks up. I'm not sure if this is hostboot, OPAL, or something else related to DD2.2 at this point.

What is interesting about the lockup is that it only happens after the system is installed, it does not impact the installation kernel even though the kernel versions should be identical. The installer has no issues communicating with the SAS disks.

Kernel log:

[    0.000000] mmu_features      = 0x3c006041
[    0.000000] firmware_features = 0x0000000010000000
[    0.000000] -----------------------------------------------------
[    0.000000] numa:   NODE_DATA [mem 0x3ff59a700-0x3ff5a3fff]
[    0.000000] numa:   NODE_DATA [mem 0x3ff580e00-0x3ff58a6ff]
[    0.000000] numa:     NODE_DATA(8) on node 0
[    0.000000] rfi-flush: Using mttrig type flush
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0000000)
[    0.000000] PCI host bridge /pciex@600c3c0000000 (primary) ranges:
[    0.000000]  MEM 0x000600c000000000..0x000600c07ffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006000000000000..0x0006003fffffffff -> 0x0006000000000000 (M64 #1..31)
[    0.000000]  Using M64 #31 as default window
[    0.000000]   512 (511) PE's M32: 0x80000000 [segment=0x400000]
[    0.000000]                  M64: 0x4000000000 [segment=0x20000000]
[    0.000000]   Allocated bitmap for 4088 MSIs (base IRQ 0xfe000)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0100000)
[    0.000000] PCI host bridge /pciex@600c3c0100000  ranges:
[    0.000000]  MEM 0x000600c080000000..0x000600c0fffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006004000000000..0x0006007fffffffff -> 0x0006004000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0xfd800)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0200000)
[    0.000000] PCI host bridge /pciex@600c3c0200000  ranges:
[    0.000000]  MEM 0x000600c100000000..0x000600c17ffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006008000000000..0x000600bfffffffff -> 0x0006008000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0xfd000)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0300000)
[    0.000000] PCI host bridge /pciex@600c3c0300000  ranges:
[    0.000000]  MEM 0x000600c180000000..0x000600c1fffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006020000000000..0x0006023fffffffff -> 0x0006020000000000 (M64 #1..31)
[    0.000000]  Using M64 #31 as default window
[    0.000000]   512 (511) PE's M32: 0x80000000 [segment=0x400000]
[    0.000000]                  M64: 0x4000000000 [segment=0x20000000]
[    0.000000]   Allocated bitmap for 4088 MSIs (base IRQ 0xfc000)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0400000)
[    0.000000] PCI host bridge /pciex@600c3c0400000  ranges:
[    0.000000]  MEM 0x000600c200000000..0x000600c27ffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006024000000000..0x0006027fffffffff -> 0x0006024000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0xfb800)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0500000)
[    0.000000] PCI host bridge /pciex@600c3c0500000  ranges:
[    0.000000]  MEM 0x000600c280000000..0x000600c2fffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006028000000000..0x000602bfffffffff -> 0x0006028000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0xfb000)
[    0.000000] Initializing IODA2 PHB (/pciex@620c3c0000000)
[    0.000000] PCI host bridge /pciex@620c3c0000000  ranges:
[    0.000000]  MEM 0x000620c000000000..0x000620c07ffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006200000000000..0x0006203fffffffff -> 0x0006200000000000 (M64 #1..31)
[    0.000000]  Using M64 #31 as default window
[    0.000000]   512 (511) PE's M32: 0x80000000 [segment=0x400000]
[    0.000000]                  M64: 0x4000000000 [segment=0x20000000]
[    0.000000]   Allocated bitmap for 4088 MSIs (base IRQ 0x1fe000)
[    0.000000] Initializing IODA2 PHB (/pciex@620c3c0100000)
[    0.000000] PCI host bridge /pciex@620c3c0100000  ranges:
[    0.000000]  MEM 0x000620c080000000..0x000620c0fffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006204000000000..0x0006207fffffffff -> 0x0006204000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0x1fd800)
[    0.000000] Initializing IODA2 PHB (/pciex@620c3c0200000)
[    0.000000] PCI host bridge /pciex@620c3c0200000  ranges:
[    0.000000]  MEM 0x000620c100000000..0x000620c17ffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006208000000000..0x000620bfffffffff -> 0x0006208000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0x1fd000)
[    0.000000] Initializing IODA2 PHB (/pciex@620c3c0300000)
[    0.000000] PCI host bridge /pciex@620c3c0300000  ranges:
[    0.000000]  MEM 0x000620c180000000..0x000620c1fffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006220000000000..0x0006223fffffffff -> 0x0006220000000000 (M64 #1..31)
[    0.000000]  Using M64 #31 as default window
[    0.000000]   512 (511) PE's M32: 0x80000000 [segment=0x400000]
[    0.000000]                  M64: 0x4000000000 [segment=0x20000000]
[    0.000000]   Allocated bitmap for 4088 MSIs (base IRQ 0x1fc000)
[    0.000000] OPAL nvram setup, 589824 bytes
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000000000-0x00000003ffffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x00000003ffffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x00000003ffffffff]
[    0.000000] Could not find start_pfn for node 8
[    0.000000] Initmem setup node 8 [mem 0x0000000000000000-0x0000000000000000]
[    0.000000] percpu: Embedded 2 pages/cpu @        (ptrval) s75416 r0 d55656 u131072
[    0.000000] Built 2 zonelists, mobility grouping on.  Total pages: 261920
[    0.000000] Policy zone: DMA
[    0.000000] Kernel command line: console=tty0 console=hvc0 powersave=off
[    0.000000] Memory: 16530624K/16777216K available (6528K kernel code, 1024K rwdata, 1856K rodata, 18176K init, 1851K bss, 246592K reserved, 0K cma-reserved)
[    0.000000] random: get_random_u64 called from __kmem_cache_create+0x3c/0x4b4 with crng_init=0
[    0.000000] SLUB: HWalign=128, Order=0-3, MinObjects=0, CPUs=32, Nodes=9
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  RCU event tracing is enabled.
[    0.000000]  RCU restricting CPUs from NR_CPUS=2048 to nr_cpu_ids=32.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=32
[    0.000000] NR_IRQS: 512, nr_irqs: 512, preallocated irqs: 16
[    0.000000] xive: Interrupt handling initialized with native backend
[    0.000000] xive: Using priority 7 for all interrupts
[    0.000000] xive: Using 64kB queues
[    0.000003] time_init: 56 bit decrementer (max: 7fffffffffffff)
[    0.000346] clocksource: timebase: mask: 0xffffffffffffffff max_cycles: 0x761537d007, max_idle_ns: 440795202126 ns
[    0.000759] clocksource: timebase mult[1f40000] shift[24] registered
[    0.001124] Console: colour dummy device 80x25
[    0.001878] console [tty0] enabled
[    0.002050] console [hvc0] enabled
[    0.002050] console [hvc0] enabled
[    0.002240] bootconsole [udbg0] disabled
[    0.002240] bootconsole [udbg0] disabled
[    0.002507] pid_max: default: 32768 minimum: 301
[    0.002666] Security Framework initialized
[    0.004316] Dentry cache hash table entries: 2097152 (order: 8, 16777216 bytes)
[    0.005337] Inode-cache hash table entries: 1048576 (order: 7, 8388608 bytes)
[    0.005537] Mount-cache hash table entries: 32768 (order: 2, 262144 bytes)
[    0.005670] Mountpoint-cache hash table entries: 32768 (order: 2, 262144 bytes)
[    0.006557] EEH: PowerNV platform initialized
[    0.006674] POWER9 performance monitor hardware support registered
[    0.006844] Hierarchical SRCU implementation.
[    0.007333] smp: Bringing up secondary CPUs ...
[    0.026873] smp: Brought up 2 nodes, 32 CPUs
[    0.027004] numa: Node 0 CPUs: 0-15
[    0.027104] numa: Node 8 CPUs: 16-31
[    0.027171] Using standard scheduler topology
[    0.030032] devtmpfs: initialized
[    0.040444] evm: security.capability
[    0.040829] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.041108] futex hash table entries: 8192 (order: 4, 1048576 bytes)
[    0.041657] random: fast init done
[    0.041711] NET: Registered protocol family 16
[    0.041881] EEH: No capable adapters found
[    0.042473] cpuidle: using governor menu
[    0.053234] PCI: Probing PCI hardware
[    0.053313] PCI host bridge to bus 0000:00
[    0.053373] pci_bus 0000:00: root bus resource [mem 0x600c000000000-0x600c07ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.053579] pci_bus 0000:00: root bus resource [mem 0x6000000000000-0x6003fbfffffff 64bit pref]
[    0.053717] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.053928] pci 0000:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.054029] pci 0000:00:00.0: disabling bridge mem windows
[    0.054307] pci 0000:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    0.054483] pci 0000:00:00.0: PCI bridge to [bus 01-ff]
[    0.054629] PCI host bridge to bus 0001:00
[    0.054676] pci_bus 0001:00: root bus resource [mem 0x600c080000000-0x600c0fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.054860] pci_bus 0001:00: root bus resource [mem 0x6004000000000-0x6007f7fffffff 64bit pref]
[    0.054999] pci_bus 0001:00: root bus resource [bus 00-ff]
[    0.055208] pci 0001:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.055294] pci 0001:00:00.0: disabling bridge mem windows
[    0.055575] pci 0001:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    0.055747] pci 0001:00:00.0: PCI bridge to [bus 01-ff]
[    0.055895] PCI host bridge to bus 0002:00
[    0.055937] pci_bus 0002:00: root bus resource [mem 0x600c100000000-0x600c17ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.056084] pci_bus 0002:00: root bus resource [mem 0x6008000000000-0x600bf7fffffff 64bit pref]
[    0.056217] pci_bus 0002:00: root bus resource [bus 00-ff]
[    0.056470] pci 0002:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.056563] pci 0002:00:00.0: disabling bridge mem windows
[    0.056811] pci 0002:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    0.056978] pci 0002:00:00.0: PCI bridge to [bus 01-ff]
[    0.057080] PCI host bridge to bus 0003:00
[    0.057142] pci_bus 0003:00: root bus resource [mem 0x600c180000000-0x600c1fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.057343] pci_bus 0003:00: root bus resource [mem 0x6020000000000-0x6023fbfffffff 64bit pref]
[    0.057489] pci_bus 0003:00: root bus resource [bus 00-ff]
[    0.057669] pci 0003:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.057761] pci 0003:00:00.0: disabling bridge mem windows
[    0.058257] pci 0003:01:00.0: Disabling memory decoding and releasing memory resources.
[    0.058343] pci 0003:01:00.0: BAR2 [mem size 0x00002000 64bit]: requesting alignment to 0x10000
[    0.058689] pci 0003:00:00.0: PCI bridge to [bus 01]
[    0.058873] PCI host bridge to bus 0004:00
[    0.058923] pci_bus 0004:00: root bus resource [mem 0x600c200000000-0x600c27ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.059075] pci_bus 0004:00: root bus resource [mem 0x6024000000000-0x6027f7fffffff 64bit pref]
[    0.059236] pci_bus 0004:00: root bus resource [bus 00-ff]
[    0.059470] pci 0004:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.059571] pci 0004:00:00.0: disabling bridge mem windows
[    0.060096] pci 0004:01:00.0: Disabling memory decoding and releasing memory resources.
[    0.060641] pci 0004:01:00.1: Disabling memory decoding and releasing memory resources.
[    0.060969] pci 0004:00:00.0: PCI bridge to [bus 01]
[    0.061182] PCI host bridge to bus 0005:00
[    0.061234] pci_bus 0005:00: root bus resource [mem 0x600c280000000-0x600c2fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.061405] pci_bus 0005:00: root bus resource [mem 0x6028000000000-0x602bf7fffffff 64bit pref]
[    0.061514] pci_bus 0005:00: root bus resource [bus 00-ff]
[    0.061765] pci 0005:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.061842] pci 0005:00:00.0: disabling bridge mem windows
[    0.062305] pci 0005:01:00.0: enabling Extended Tags
[    0.062373] pci 0005:01:00.0: Disabling memory decoding and releasing memory resources.
[    0.062482] pci 0005:01:00.0: disabling bridge mem windows
[    0.062776] pci 0005:00:00.0: PCI bridge to [bus 01-02]
[    0.063169] pci 0005:02:00.0: Disabling memory decoding and releasing memory resources.
[    0.063412] pci 0005:01:00.0: PCI bridge to [bus 02]
[    0.063591] PCI host bridge to bus 0030:00
[    0.063642] pci_bus 0030:00: root bus resource [mem 0x620c000000000-0x620c07ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.063805] pci_bus 0030:00: root bus resource [mem 0x6200000000000-0x6203fbfffffff 64bit pref]
[    0.063963] pci_bus 0030:00: root bus resource [bus 00-ff]
[    0.064132] pci 0030:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.064235] pci 0030:00:00.0: disabling bridge mem windows
[    0.064705] pci 0030:01:00.0: enabling Extended Tags
[    0.064760] pci 0030:01:00.0: Disabling memory decoding and releasing memory resources.
[    0.065086] pci 0030:00:00.0: PCI bridge to [bus 01]
[    0.065246] PCI host bridge to bus 0031:00
[    0.065314] pci_bus 0031:00: root bus resource [mem 0x620c080000000-0x620c0fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.065471] pci_bus 0031:00: root bus resource [mem 0x6204000000000-0x6207f7fffffff 64bit pref]
[    0.065609] pci_bus 0031:00: root bus resource [bus 00-ff]
[    0.065783] pci 0031:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.065889] pci 0031:00:00.0: disabling bridge mem windows
[    0.066324] pci 0031:01:00.0: enabling Extended Tags
[    0.066384] pci 0031:01:00.0: Disabling memory decoding and releasing memory resources.
[    0.066726] pci 0031:00:00.0: PCI bridge to [bus 01]
[    0.066890] PCI host bridge to bus 0032:00
[    0.066939] pci_bus 0032:00: root bus resource [mem 0x620c100000000-0x620c17ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.067099] pci_bus 0032:00: root bus resource [mem 0x6208000000000-0x620bf7fffffff 64bit pref]
[    0.067255] pci_bus 0032:00: root bus resource [bus 00-ff]
[    0.067449] pci 0032:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.067537] pci 0032:00:00.0: disabling bridge mem windows
[    0.067768] pci 0032:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    0.067941] pci 0032:00:00.0: PCI bridge to [bus 01-ff]
[    0.068082] PCI host bridge to bus 0033:00
[    0.068128] pci_bus 0033:00: root bus resource [mem 0x620c180000000-0x620c1fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.068294] pci_bus 0033:00: root bus resource [mem 0x6220000000000-0x6223fbfffffff 64bit pref]
[    0.068467] pci_bus 0033:00: root bus resource [bus 00-ff]
[    0.068651] pci 0033:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.068745] pci 0033:00:00.0: disabling bridge mem windows
[    0.069186] pci 0033:01:00.0: enabling Extended Tags
[    0.069236] pci 0033:01:00.0: Disabling memory decoding and releasing memory resources.
[    0.069563] pci 0033:00:00.0: PCI bridge to [bus 01]
[    0.069731] pci 0000:00     : [PE# 1fe] Secondary bus 0 associated with PE#1fe
[    0.070073] pci 0000:00:00.0: PCI bridge to [bus 01]
[    0.070175] pci 0001:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.070518] pci 0001:00:00.0: PCI bridge to [bus 01]
[    0.070623] pci 0002:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.070957] pci 0002:00:00.0: PCI bridge to [bus 01]
[    0.071067] pci 0003:00:00.0: BAR 8: assigned [mem 0x600c180000000-0x600c1803fffff]
[    0.071204] pci 0003:01:00.0: BAR 0: assigned [mem 0x600c180000000-0x600c18000ffff 64bit]
[    0.071351] pci 0003:01:00.0: BAR 2: assigned [mem 0x600c180010000-0x600c180011fff 64bit]
[    0.071486] pci 0003:00     : [PE# 1fe] Secondary bus 0 associated with PE#1fe
[    0.071846] pci 0003:01     : [PE# 1fd] Secondary bus 1 associated with PE#1fd
[    0.072176] pci 0003:01     : [PE# 1fd] Setting up 32-bit TCE table at 0..80000000
[    0.077980] IOMMU table initialized, virtual merging enabled
[    0.078060] pci 0003:01     : [PE# 1fd] Setting up window#0 0..7fffffff pg=1000
[    0.078201] pci 0003:01     : [PE# 1fd] Enabling 64-bit DMA bypass
[    0.078291] iommu: Adding device 0003:01:00.0 to group 0
[    0.078390] pci 0003:00:00.0: PCI bridge to [bus 01]
[    0.078478] pci 0003:00:00.0:   bridge window [mem 0x600c180000000-0x600c1ffefffff]
[    0.078642] pci 0004:00:00.0: BAR 9: assigned [mem 0x6024000000000-0x602403fffffff 64bit pref]
[    0.078780] pci 0004:01:00.0: BAR 0: assigned [mem 0x6024000000000-0x602400000ffff 64bit pref]
[    0.078935] pci 0004:01:00.0: BAR 2: assigned [mem 0x6024000010000-0x602400001ffff 64bit pref]
[    0.079069] pci 0004:01:00.0: BAR 4: assigned [mem 0x6024000020000-0x602400002ffff 64bit pref]
[    0.079227] pci 0004:01:00.1: BAR 0: assigned [mem 0x6024000030000-0x602400003ffff 64bit pref]
[    0.079360] pci 0004:01:00.1: BAR 2: assigned [mem 0x6024000040000-0x602400004ffff 64bit pref]
[    0.079515] pci 0004:01:00.1: BAR 4: assigned [mem 0x6024000050000-0x602400005ffff 64bit pref]
[    0.079671] pci 0004:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.080038] pci 0004:01     : [PE# 00] Secondary bus 1 associated with PE#0
[    0.080394] pci 0004:01     : [PE# 00] Setting up 32-bit TCE table at 0..80000000
[    0.086209] pci 0004:01     : [PE# 00] Setting up window#0 0..7fffffff pg=1000
[    0.086277] pci 0004:01     : [PE# 00] Enabling 64-bit DMA bypass
[    0.086365] iommu: Adding device 0004:01:00.0 to group 1
[    0.086438] iommu: Adding device 0004:01:00.1 to group 1
[    0.086508] pci 0004:00:00.0: PCI bridge to [bus 01]
[    0.086645] pci 0004:00:00.0:   bridge window [mem 0x6024000000000-0x6027f7fffffff 64bit pref]
[    0.086872] pci 0005:00:00.0: BAR 8: assigned [mem 0x600c280000000-0x600c2817fffff]
[    0.086952] pci 0005:01:00.0: BAR 8: assigned [mem 0x600c280000000-0x600c2817fffff]
[    0.087085] pci 0005:01:00.0: BAR 7: no space for [io  size 0x1000]
[    0.087206] pci 0005:01:00.0: BAR 7: failed to assign [io  size 0x1000]
[    0.087311] pci 0005:02:00.0: BAR 0: assigned [mem 0x600c280000000-0x600c280ffffff]
[    0.087434] pci 0005:02:00.0: BAR 1: assigned [mem 0x600c281000000-0x600c28101ffff]
[    0.087533] pci 0005:02:00.0: BAR 2: no space for [io  size 0x0080]
[    0.087654] pci 0005:02:00.0: BAR 2: failed to assign [io  size 0x0080]
[    0.087760] pci 0005:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.088116] pci 0005:02     : [PE# fd] Secondary bus 2..2 associated with PE#fd
[    0.088451] pci 0005:02     : [PE# fd] Setting up 32-bit TCE table at 0..80000000
[    0.094247] pci 0005:02     : [PE# fd] Setting up window#0 0..7fffffff pg=1000
[    0.094330] pci 0005:02     : [PE# fd] Enabling 64-bit DMA bypass
[    0.094434] iommu: Adding device 0005:02:00.0 to group 2
[    0.094522] pci 0005:01:00.0: PCI bridge to [bus 02]
[    0.094649] pci 0005:01:00.0:   bridge window [mem 0x600c280000000-0x600c2ffefffff]
[    0.094799] pci 0005:01     : [PE# fc] Secondary bus 1 associated with PE#fc
[    0.095153] pci 0005:00:00.0: PCI bridge to [bus 01-02]
[    0.095200] pci 0005:00:00.0:   bridge window [mem 0x600c280000000-0x600c2ffefffff]
[    0.095336] pci_bus 0005:00: Some PCI device resources are unassigned, try booting with pci=realloc
[    0.095534] pci 0030:00:00.0: BAR 8: assigned [mem 0x620c000000000-0x620c0003fffff]
[    0.095648] pci 0030:01:00.0: BAR 6: assigned [mem 0x620c000000000-0x620c0000fffff pref]
[    0.095781] pci 0030:01:00.0: BAR 3: assigned [mem 0x620c000100000-0x620c00013ffff 64bit]
[    0.095918] pci 0030:01:00.0: BAR 1: assigned [mem 0x620c000140000-0x620c00014ffff 64bit]
[    0.096057] pci 0030:01:00.0: BAR 0: no space for [io  size 0x0100]
[    0.096134] pci 0030:01:00.0: BAR 0: failed to assign [io  size 0x0100]
[    0.096261] pci 0030:00     : [PE# 1fe] Secondary bus 0 associated with PE#1fe
[    0.096616] pci 0030:01     : [PE# 1fd] Secondary bus 1 associated with PE#1fd
[    0.096933] pci 0030:01     : [PE# 1fd] Setting up 32-bit TCE table at 0..80000000
[    0.102790] pci 0030:01     : [PE# 1fd] Setting up window#0 0..7fffffff pg=1000
[    0.102865] pci 0030:01     : [PE# 1fd] Enabling 64-bit DMA bypass
[    0.102953] iommu: Adding device 0030:01:00.0 to group 3
[    0.103048] pci 0030:00:00.0: PCI bridge to [bus 01]
[    0.103172] pci 0030:00:00.0:   bridge window [mem 0x620c000000000-0x620c07fefffff]
[    0.103301] pci_bus 0030:00: Some PCI device resources are unassigned, try booting with pci=realloc
[    0.103457] pci 0031:00:00.0: BAR 8: assigned [mem 0x620c080000000-0x620c0807fffff]
[    0.103580] pci 0031:01:00.0: BAR 6: assigned [mem 0x620c080000000-0x620c0800fffff pref]
[    0.103667] pci 0031:01:00.0: BAR 3: assigned [mem 0x620c080100000-0x620c08013ffff 64bit]
[    0.103838] pci 0031:01:00.0: BAR 1: assigned [mem 0x620c080140000-0x620c08014ffff 64bit]
[    0.103946] pci 0031:01:00.0: BAR 0: no space for [io  size 0x0100]
[    0.104070] pci 0031:01:00.0: BAR 0: failed to assign [io  size 0x0100]
[    0.104176] pci 0031:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.104528] pci 0031:01     : [PE# fd] Secondary bus 1 associated with PE#fd
[    0.104842] pci 0031:01     : [PE# fd] Setting up 32-bit TCE table at 0..80000000
[    0.110684] pci 0031:01     : [PE# fd] Setting up window#0 0..7fffffff pg=1000
[    0.110763] pci 0031:01     : [PE# fd] Enabling 64-bit DMA bypass
[    0.110849] iommu: Adding device 0031:01:00.0 to group 4
[    0.110918] pci 0031:00:00.0: PCI bridge to [bus 01]
[    0.111024] pci 0031:00:00.0:   bridge window [mem 0x620c080000000-0x620c0ffefffff]
[    0.111128] pci_bus 0031:00: Some PCI device resources are unassigned, try booting with pci=realloc
[    0.111333] pci 0032:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.111688] pci 0032:00:00.0: PCI bridge to [bus 01]
[    0.111787] pci 0033:00:00.0: BAR 8: assigned [mem 0x620c180000000-0x620c1803fffff]
[    0.111911] pci 0033:01:00.0: BAR 6: assigned [mem 0x620c180000000-0x620c1800fffff pref]
[    0.112037] pci 0033:01:00.0: BAR 3: assigned [mem 0x620c180100000-0x620c18013ffff 64bit]
[    0.112178] pci 0033:01:00.0: BAR 1: assigned [mem 0x620c180140000-0x620c18014ffff 64bit]
[    0.112317] pci 0033:01:00.0: BAR 0: no space for [io  size 0x0100]
[    0.112400] pci 0033:01:00.0: BAR 0: failed to assign [io  size 0x0100]
[    0.112499] pci 0033:00     : [PE# 1fe] Secondary bus 0 associated with PE#1fe
[    0.112856] pci 0033:01     : [PE# 1fd] Secondary bus 1 associated with PE#1fd
[    0.113189] pci 0033:01     : [PE# 1fd] Setting up 32-bit TCE table at 0..80000000
[    0.118975] pci 0033:01     : [PE# 1fd] Setting up window#0 0..7fffffff pg=1000
[    0.119055] pci 0033:01     : [PE# 1fd] Enabling 64-bit DMA bypass
[    0.119165] iommu: Adding device 0033:01:00.0 to group 5
[    0.119272] pci 0033:00:00.0: PCI bridge to [bus 01]
[    0.119377] pci 0033:00:00.0:   bridge window [mem 0x620c180000000-0x620c1ffefffff]
[    0.119509] pci_bus 0033:00: Some PCI device resources are unassigned, try booting with pci=realloc
[    0.127323] pci 0005:02:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[    0.127404] pci 0005:02:00.0: vgaarb: bridge control possible
[    0.127499] pci 0005:02:00.0: vgaarb: setting as boot device (VGA legacy resources not available)
[    0.127659] vgaarb: loaded
[    0.127866] SCSI subsystem initialized
[    0.128093] usbcore: registered new interface driver usbfs
[    0.128182] usbcore: registered new interface driver hub
[    0.128364] usbcore: registered new device driver usb
[    0.128462] pps_core: LinuxPPS API ver. 1 registered
[    0.128541] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.128688] PTP clock support registered
[    0.129092] clocksource: Switched to clocksource timebase
[    0.129223] VFS: Disk quotas dquot_6.6.0
[    0.129341] VFS: Dquot-cache hash table entries: 8192 (order 0, 65536 bytes)
[    0.131732] NET: Registered protocol family 2
[    0.132012] TCP established hash table entries: 131072 (order: 4, 1048576 bytes)
[    0.132998] TCP bind hash table entries: 65536 (order: 4, 1048576 bytes)
[    0.133482] TCP: Hash tables configured (established 131072 bind 65536)
[    0.133648] UDP hash table entries: 8192 (order: 2, 262144 bytes)
[    0.133851] UDP-Lite hash table entries: 8192 (order: 2, 262144 bytes)
[    0.134140] NET: Registered protocol family 1
[    0.134221] pci 0003:00:00.0: enabling device (0105 -> 0107)
[    0.134337] pci 0003:01:00.0: enabling device (0140 -> 0142)
[    4.338575] nest_capp0_imc performance monitor hardware support registered
[    4.339946] core_imc performance monitor hardware support registered
[    4.340108] nest_nx_imc performance monitor hardware support registered
[    4.340257] nest_phb0_imc performance monitor hardware support registered
[    4.340395] nest_phb1_imc performance monitor hardware support registered
[    4.340535] nest_phb2_imc performance monitor hardware support registered
[    4.340677] nest_phb3_imc performance monitor hardware support registered
[    4.340849] nest_powerbus0_imc performance monitor hardware support registered
[    4.342196] thread_imc performance monitor hardware support registered
[    4.342327] nest_xlink1_imc performance monitor hardware support registered
[    4.345053] Initialise system trusted keyrings
[    4.345154] workingset: timestamp_bits=54 max_order=18 bucket_order=0
[    4.349024] Key type asymmetric registered
[    4.349066] Asymmetric key parser 'x509' registered
[    4.349221] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249)
[    4.349339] io scheduler noop registered
[    4.349490] io scheduler cfq registered (default)
[    4.349544] io scheduler mq-deadline registered
[    4.349636] io scheduler kyber registered
[    4.350255] ipmi message handler version 39.2
[    4.350316] ipmi device interface
[    4.568570] ipmi-powernv ibm,opal:ipmi: Found new BMC (man_id: 0x000000, prod_id: 0x0000, dev_id: 0x00)
[    5.157287] hvc0: raw protocol on /ibm,opal/consoles/serial@0 (boot console)
[    5.157358] hvc0: No interrupts property, using OPAL event
[    5.157799] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
[    5.158310] [drm] radeon kernel modesetting enabled.
[    5.161279] brd: module loaded
[    5.163539] loop: module loaded
[    5.163748] libphy: Fixed MDIO Bus: probed
[    5.163871] tg3.c:v3.137 (May 11, 2014)
[    5.163959] pci 0004:00:00.0: enabling device (0105 -> 0107)
[    5.164060] tg3 0004:01:00.0: enabling device (0140 -> 0142)
[    5.195092] tg3 0004:01:00.0: Using 64-bit DMA iommu bypass
[    5.195592] tg3 0004:01:00.0 eth0: Tigon3 [partno(BCM95719) rev 5719001] (PCI Express) MAC address 2c:09:4d:00:01:15
[    5.195743] tg3 0004:01:00.0 eth0: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    5.195879] tg3 0004:01:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    5.195989] tg3 0004:01:00.0 eth0: dma_rwctrl[00000000] dma_mask[64-bit]
[    5.196197] tg3 0004:01:00.1: enabling device (0140 -> 0142)
[    5.225836] tg3 0004:01:00.1: Using 64-bit DMA iommu bypass
[    5.226228] tg3 0004:01:00.1 eth1: Tigon3 [partno(BCM95719) rev 5719001] (PCI Express) MAC address 2c:09:4d:00:01:16
[    5.226321] tg3 0004:01:00.1 eth1: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    5.226496] tg3 0004:01:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    5.226619] tg3 0004:01:00.1 eth1: dma_rwctrl[00000000] dma_mask[64-bit]
[    5.226921] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    5.226998] ehci-pci: EHCI PCI platform driver
[    5.227193] xhci_hcd 0003:01:00.0: xHCI Host Controller
[    5.227314] xhci_hcd 0003:01:00.0: new USB bus registered, assigned bus number 1
[    5.227499] xhci_hcd 0003:01:00.0: Using 64-bit DMA iommu bypass
[    5.227642] xhci_hcd 0003:01:00.0: hcc params 0x0270f06d hci version 0x96 quirks 0x04000000
[    5.228379] hub 1-0:1.0: USB hub found
[    5.228429] hub 1-0:1.0: 4 ports detected
[    5.228622] xhci_hcd 0003:01:00.0: xHCI Host Controller
[    5.228710] xhci_hcd 0003:01:00.0: new USB bus registered, assigned bus number 2
[    5.228836] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
 Petitboot (v1.6.6-p836d356)                  T2P9D01 REV 1.00 A1000008
 ──────────────────────────────────────────────────────────────────────────────
  [Disk: sda2 / d67c140e-e09b-4bfb-a595-b5cf23b981a3]
    Debian GNU/Linux, with Linux 4.14.0-3-powerpc64le (recovery mode)
 *  Debian GNU/Linux, with Linux 4.14.0-3-powerpc64le
    Debian GNU/Linux

  System information
  System configuration
  System status log
  Language
  Rescan devices
  Retrieve config from URL
  Plugins (0)
  Exit to shell

 ──────────────────────────────────────────────────────────────────────────────
 Enter=accept, e=edit, n=new, x=exit, l=language, g=log, h=help
The system is going down NOW!
Sent SIGTERM to all processes
Sent SIGKILL to all processes
[   53.039756] kexec_core: Starting new kernel
[  156.028396583,5] OPAL: Switch to big-endian OS
[  156.271203591,5] OPAL: Switch to little-endian OS
[    0.000000] opal: OPAL detected !
[    0.000000] dt-cpu-ftrs: setup for ISA 3000
[    0.000000] dt-cpu-ftrs: not enabling: system-call-vectored (disabled or unsupported by kernel)
[    0.000000] dt-cpu-ftrs: final cpu/mmu features = 0x075c7afd18500249 0x3c006041
[    0.000000] radix-mmu: Page sizes from device-tree:
[    0.000000] radix-mmu: Page size shift = 12 AP=0x0
[    0.000000] radix-mmu: Page size shift = 16 AP=0x5
[    0.000000] radix-mmu: Page size shift = 21 AP=0x1
[    0.000000] radix-mmu: Page size shift = 30 AP=0x2
[    0.000000] radix-mmu: Initializing Radix MMU
[    0.000000] radix-mmu: Partition table c0000003ff7f0000
[    0.000000] radix-mmu: Mapped 0x0000000000000000-0x0000000001200000 with 64.0 KiB pages
[    0.000000] radix-mmu: Mapped 0x0000000001200000-0x0000000040000000 with 2.00 MiB pages
[    0.000000] radix-mmu: Mapped 0x0000000040000000-0x0000000400000000 with 1.00 GiB pages
[    0.000000] radix-mmu: Process table c0000003fe000000 and radix root for kernel: c0000000012a0000
[    0.000000] Linux version 4.14.0-3-powerpc64le (debian-kernel@lists.debian.org) (gcc version 7.2.0 (Debian 7.2.0-19)) #1 SMP Debian 4.14.13-1 (2018-01-14)
[    0.000000] Found initrd at 0xc000000003980000:0xc000000004d26393
[    0.000000] OPAL: Found memory mapped LPC bus on chip 0
[    0.000000] Using PowerNV machine description
[    0.000000] bootconsole [udbg0] enabled
[    0.000000] CPU maps initialized for 4 threads per core
 -> smp_release_cpus()
spinning_secondaries = 31
 <- smp_release_cpus()
[    0.000000] -----------------------------------------------------
[    0.000000] ppc64_pft_size    = 0x0
[    0.000000] phys_mem_size     = 0x400000000
[    0.000000] dcache_bsize      = 0x80
[    0.000000] icache_bsize      = 0x80
[    0.000000] cpu_features      = 0x075c7afd18500249
[    0.000000]   possible        = 0x5fffffff18500649
[    0.000000]   always          = 0x0000000018100040
[    0.000000] cpu_user_features = 0xdc0065c2 0xaec00000
[    0.000000] mmu_features      = 0x3c006041
[    0.000000] firmware_features = 0x0000000110000000
[    0.000000] -----------------------------------------------------
[    0.000000] cma: Reserved 832 MiB at 0x00000003c8000000
[    0.000000] numa:   NODE_DATA [mem 0x3ff57e300-0x3ff587fff]
[    0.000000] numa:   NODE_DATA [mem 0x3ff560600-0x3ff56a2ff]
[    0.000000] numa:     NODE_DATA(8) on node 0
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0000000)
[    0.000000] PCI host bridge /pciex@600c3c0000000 (primary) ranges:
[    0.000000]  MEM 0x000600c000000000..0x000600c07ffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006000000000000..0x0006003fffffffff -> 0x0006000000000000 (M64 #1..31)
[    0.000000]  Using M64 #31 as default window
[    0.000000]   512 (511) PE's M32: 0x80000000 [segment=0x400000]
[    0.000000]                  M64: 0x4000000000 [segment=0x20000000]
[    0.000000]   Allocated bitmap for 4088 MSIs (base IRQ 0xfe000)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0100000)
[    0.000000] PCI host bridge /pciex@600c3c0100000  ranges:
[    0.000000]  MEM 0x000600c080000000..0x000600c0fffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006004000000000..0x0006007fffffffff -> 0x0006004000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0xfd800)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0200000)
[    0.000000] PCI host bridge /pciex@600c3c0200000  ranges:
[    0.000000]  MEM 0x000600c100000000..0x000600c17ffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006008000000000..0x000600bfffffffff -> 0x0006008000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0xfd000)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0300000)
[    0.000000] PCI host bridge /pciex@600c3c0300000  ranges:
[    0.000000]  MEM 0x000600c180000000..0x000600c1fffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006020000000000..0x0006023fffffffff -> 0x0006020000000000 (M64 #1..31)
[    0.000000]  Using M64 #31 as default window
[    0.000000]   512 (511) PE's M32: 0x80000000 [segment=0x400000]
[    0.000000]                  M64: 0x4000000000 [segment=0x20000000]
[    0.000000]   Allocated bitmap for 4088 MSIs (base IRQ 0xfc000)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0400000)
[    0.000000] PCI host bridge /pciex@600c3c0400000  ranges:
[    0.000000]  MEM 0x000600c200000000..0x000600c27ffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006024000000000..0x0006027fffffffff -> 0x0006024000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0xfb800)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0500000)
[    0.000000] PCI host bridge /pciex@600c3c0500000  ranges:
[    0.000000]  MEM 0x000600c280000000..0x000600c2fffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006028000000000..0x000602bfffffffff -> 0x0006028000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0xfb000)
[    0.000000] Initializing IODA2 PHB (/pciex@620c3c0000000)
[    0.000000] PCI host bridge /pciex@620c3c0000000  ranges:
[    0.000000]  MEM 0x000620c000000000..0x000620c07ffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006200000000000..0x0006203fffffffff -> 0x0006200000000000 (M64 #1..31)
[    0.000000]  Using M64 #31 as default window
[    0.000000]   512 (511) PE's M32: 0x80000000 [segment=0x400000]
[    0.000000]                  M64: 0x4000000000 [segment=0x20000000]
[    0.000000]   Allocated bitmap for 4088 MSIs (base IRQ 0x1fe000)
[    0.000000] Initializing IODA2 PHB (/pciex@620c3c0100000)
[    0.000000] PCI host bridge /pciex@620c3c0100000  ranges:
[    0.000000]  MEM 0x000620c080000000..0x000620c0fffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006204000000000..0x0006207fffffffff -> 0x0006204000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0x1fd800)
[    0.000000] Initializing IODA2 PHB (/pciex@620c3c0200000)
[    0.000000] PCI host bridge /pciex@620c3c0200000  ranges:
[    0.000000]  MEM 0x000620c100000000..0x000620c17ffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006208000000000..0x000620bfffffffff -> 0x0006208000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0x1fd000)
[    0.000000] Initializing IODA2 PHB (/pciex@620c3c0300000)
[    0.000000] PCI host bridge /pciex@620c3c0300000  ranges:
[    0.000000]  MEM 0x000620c180000000..0x000620c1fffeffff -> 0x0000000080000000
[    0.000000]  MEM 0x0006220000000000..0x0006223fffffffff -> 0x0006220000000000 (M64 #1..31)
[    0.000000]  Using M64 #31 as default window
[    0.000000]   512 (511) PE's M32: 0x80000000 [segment=0x400000]
[    0.000000]                  M64: 0x4000000000 [segment=0x20000000]
[    0.000000]   Allocated bitmap for 4088 MSIs (base IRQ 0x1fc000)
[    0.000000] OPAL nvram setup, 589824 bytes
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000000000-0x00000003ffffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x00000003ffffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x00000003ffffffff]
[    0.000000] Could not find start_pfn for node 8
[    0.000000] Initmem setup node 8 [mem 0x0000000000000000-0x0000000000000000]
[    0.000000] percpu: Embedded 4 pages/cpu @c0000003c76a0000 s162840 r0 d99304 u262144
[    0.000000] Built 2 zonelists, mobility grouping on.  Total pages: 261888
[    0.000000] Policy zone: DMA
[    0.000000] Kernel command line: root=UUID=d67c140e-e09b-4bfb-a595-b5cf23b981a3 ro
[    0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[    0.000000] log_buf_len total cpu_extra contributions: 126976 bytes
[    0.000000] log_buf_len min size: 131072 bytes
[    0.000000] log_buf_len: 262144 bytes
[    0.000000] early log buf free: 121004(92%)
[    0.000000] PID hash table entries: 4096 (order: -1, 32768 bytes)
[    0.000000] Memory: 15667776K/16777216K available (9792K kernel code, 1600K rwdata, 2112K rodata, 1088K init, 2312K bss, 257472K reserved, 851968K cma-reserved)
[    0.000000] random: get_random_u32 called from cache_grow_begin+0x254/0x850 with crng_init=0
[    0.000000] ftrace: allocating 24878 entries in 10 pages
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  RCU restricting CPUs from NR_CPUS=2048 to nr_cpu_ids=32.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=32
[    0.000000] NR_IRQS: 512, nr_irqs: 512, preallocated irqs: 16
[    0.000000] xive: Interrupt handling initialized with native backend
[    0.000000] xive: Using priority 7 for all interrupts
[    0.000000] xive: Using 64kB queues
[    0.000002] time_init: 56 bit decrementer (max: 7fffffffffffff)
[    0.000485] clocksource: timebase: mask: 0xffffffffffffffff max_cycles: 0x761537d007, max_idle_ns: 440795202126 ns
[    0.001321] clocksource: timebase mult[1f40000] shift[24] registered
[    0.002557] Console: colour dummy device 80x25
[    0.002919] console [hvc0] enabled
[    0.002919] console [hvc0] enabled
[    0.003242] bootconsole [udbg0] disabled
[    0.003242] bootconsole [udbg0] disabled
[    0.003668] mempolicy: Disabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.003819] pid_max: default: 32768 minimum: 301
[    0.004162] Security Framework initialized
[    0.004204] Yama: disabled by default; enable with sysctl kernel.yama.*
[    0.004336] AppArmor: AppArmor initialized
[    0.005722] Dentry cache hash table entries: 2097152 (order: 8, 16777216 bytes)
[    0.006478] Inode-cache hash table entries: 1048576 (order: 7, 8388608 bytes)
[    0.006595] Mount-cache hash table entries: 32768 (order: 2, 262144 bytes)
[    0.006688] Mountpoint-cache hash table entries: 32768 (order: 2, 262144 bytes)
[    0.007501] EEH: PowerNV platform initialized
[    0.007561] POWER9 performance monitor hardware support registered
[    0.007669] Hierarchical SRCU implementation.
[    0.008582] smp: Bringing up secondary CPUs ...
[    0.029524] smp: Brought up 2 nodes, 32 CPUs
[    0.029575] numa: Node 0 CPUs: 0-15
[    0.029608] numa: Node 8 CPUs: 16-31
[    0.029640] Using standard scheduler topology
[    0.031754] devtmpfs: initialized
[    0.044501] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.044593] futex hash table entries: 8192 (order: 4, 1048576 bytes)
[    0.045442] NET: Registered protocol family 16
[    0.045883] cpuidle: using governor ladder
[    0.045976] cpuidle: using governor menu
[    0.051591] PCI: Probing PCI hardware
[    0.051691] PCI host bridge to bus 0000:00
[    0.051762] pci_bus 0000:00: root bus resource [mem 0x600c000000000-0x600c07ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.051928] pci_bus 0000:00: root bus resource [mem 0x6000000000000-0x6003fbfffffff 64bit pref]
[    0.052062] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.052105] random: fast init done
[    0.052298] pci 0000:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.052410] pci 0000:00:00.0: disabling bridge mem windows
[    0.052769] pci 0000:00:00.0: PCI bridge to [bus 01]
[    0.052911] PCI host bridge to bus 0001:00
[    0.052974] pci_bus 0001:00: root bus resource [mem 0x600c080000000-0x600c0fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.053137] pci_bus 0001:00: root bus resource [mem 0x6004000000000-0x6007f7fffffff 64bit pref]
[    0.053268] pci_bus 0001:00: root bus resource [bus 00-ff]
[    0.053419] pci 0001:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.053531] pci 0001:00:00.0: disabling bridge mem windows
[    0.053910] pci 0001:00:00.0: PCI bridge to [bus 01]
[    0.054051] PCI host bridge to bus 0002:00
[    0.054098] pci_bus 0002:00: root bus resource [mem 0x600c100000000-0x600c17ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.054276] pci_bus 0002:00: root bus resource [mem 0x6008000000000-0x600bf7fffffff 64bit pref]
[    0.054407] pci_bus 0002:00: root bus resource [bus 00-ff]
[    0.054582] pci 0002:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.054688] pci 0002:00:00.0: disabling bridge mem windows
[    0.055047] pci 0002:00:00.0: PCI bridge to [bus 01]
[    0.055188] PCI host bridge to bus 0003:00
[    0.055250] pci_bus 0003:00: root bus resource [mem 0x600c180000000-0x600c1fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.055399] pci_bus 0003:00: root bus resource [mem 0x6020000000000-0x6023fbfffffff 64bit pref]
[    0.055489] pci_bus 0003:00: root bus resource [bus 00-ff]
[    0.055636] pci 0003:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.055778] pci 0003:00:00.0: disabling bridge mem windows
[    0.056300] pci 0003:01:00.0: Disabling memory decoding and releasing memory resources.
[    0.056376] pci 0003:01:00.0: BAR2 [mem size 0x00002000 64bit]: requesting alignment to 0x10000
[    0.056808] pci 0003:00:00.0: PCI bridge to [bus 01]
[    0.057014] PCI host bridge to bus 0004:00
[    0.057065] pci_bus 0004:00: root bus resource [mem 0x600c200000000-0x600c27ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.057233] pci_bus 0004:00: root bus resource [mem 0x6024000000000-0x6027f7fffffff 64bit pref]
[    0.057385] pci_bus 0004:00: root bus resource [bus 00-ff]
[    0.057571] pci 0004:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.057663] pci 0004:00:00.0: disabling bridge mem windows
[    0.058260] pci 0004:01:00.0: Disabling memory decoding and releasing memory resources.
[    0.058822] pci 0004:01:00.1: Disabling memory decoding and releasing memory resources.
[    0.059225] pci 0004:00:00.0: PCI bridge to [bus 01]
[    0.059455] PCI host bridge to bus 0005:00
[    0.059496] pci_bus 0005:00: root bus resource [mem 0x600c280000000-0x600c2fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.059640] pci_bus 0005:00: root bus resource [mem 0x6028000000000-0x602bf7fffffff 64bit pref]
[    0.059821] pci_bus 0005:00: root bus resource [bus 00-ff]
[    0.060007] pci 0005:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.060098] pci 0005:00:00.0: disabling bridge mem windows
[    0.060605] pci 0005:01:00.0: Disabling memory decoding and releasing memory resources.
[    0.060682] pci 0005:01:00.0: disabling bridge mem windows
[    0.061023] pci 0005:00:00.0: PCI bridge to [bus 01-02]
[    0.061415] pci 0005:02:00.0: Disabling memory decoding and releasing memory resources.
[    0.061667] pci 0005:01:00.0: PCI bridge to [bus 02]
[    0.061848] PCI host bridge to bus 0030:00
[    0.061895] pci_bus 0030:00: root bus resource [mem 0x620c000000000-0x620c07ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.062027] pci_bus 0030:00: root bus resource [mem 0x6200000000000-0x6203fbfffffff 64bit pref]
[    0.062184] pci_bus 0030:00: root bus resource [bus 00-ff]
[    0.062430] pci 0030:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.062541] pci 0030:00:00.0: disabling bridge mem windows
[    0.063184] pci 0030:01:00.0: Disabling memory decoding and releasing memory resources.
[    0.063655] pci 0030:00:00.0: PCI bridge to [bus 01]
[    0.063834] PCI host bridge to bus 0031:00
[    0.063885] pci_bus 0031:00: root bus resource [mem 0x620c080000000-0x620c0fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.064017] pci_bus 0031:00: root bus resource [mem 0x6204000000000-0x6207f7fffffff 64bit pref]
[    0.064204] pci_bus 0031:00: root bus resource [bus 00-ff]
[    0.064411] pci 0031:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.064500] pci 0031:00:00.0: disabling bridge mem windows
[    0.065128] pci 0031:01:00.0: Disabling memory decoding and releasing memory resources.
[    0.065596] pci 0031:00:00.0: PCI bridge to [bus 01]
[    0.065783] PCI host bridge to bus 0032:00
[    0.065840] pci_bus 0032:00: root bus resource [mem 0x620c100000000-0x620c17ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.066000] pci_bus 0032:00: root bus resource [mem 0x6208000000000-0x620bf7fffffff 64bit pref]
[    0.066126] pci_bus 0032:00: root bus resource [bus 00-ff]
[    0.066318] pci 0032:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.066408] pci 0032:00:00.0: disabling bridge mem windows
[    0.066833] pci 0032:00:00.0: PCI bridge to [bus 01]
[    0.066990] PCI host bridge to bus 0033:00
[    0.067034] pci_bus 0033:00: root bus resource [mem 0x620c180000000-0x620c1fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.067213] pci_bus 0033:00: root bus resource [mem 0x6220000000000-0x6223fbfffffff 64bit pref]
[    0.067339] pci_bus 0033:00: root bus resource [bus 00-ff]
[    0.067547] pci 0033:00:00.0: Disabling memory decoding and releasing memory resources.
[    0.067660] pci 0033:00:00.0: disabling bridge mem windows
[    0.068287] pci 0033:01:00.0: Disabling memory decoding and releasing memory resources.
[    0.068755] pci 0033:00:00.0: PCI bridge to [bus 01]
[    0.068923] pci 0000:00     : [PE# 1fe] Secondary bus 0 associated with PE#1fe
[    0.069260] pci 0000:00:00.0: PCI bridge to [bus 01]
[    0.069359] pci 0001:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.069689] pci 0001:00:00.0: PCI bridge to [bus 01]
[    0.069783] pci 0002:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.070144] pci 0002:00:00.0: PCI bridge to [bus 01]
[    0.070243] pci 0003:00:00.0: BAR 14: assigned [mem 0x600c180000000-0x600c1803fffff]
[    0.070361] pci 0003:01:00.0: BAR 0: assigned [mem 0x600c180000000-0x600c18000ffff 64bit]
[    0.070494] pci 0003:01:00.0: BAR 2: assigned [mem 0x600c180010000-0x600c180011fff 64bit]
[    0.070634] pci 0003:00     : [PE# 1fe] Secondary bus 0 associated with PE#1fe
[    0.070985] pci 0003:01     : [PE# 1fd] Secondary bus 1 associated with PE#1fd
[    0.071310] pci 0003:01     : [PE# 1fd] Setting up 32-bit TCE table at 0..80000000
[    0.078857] IOMMU table initialized, virtual merging enabled
[    0.078927] pci 0003:01     : [PE# 1fd] Setting up window#0 0..7fffffff pg=1000
[    0.079046] pci 0003:01     : [PE# 1fd] Enabling 64-bit DMA bypass
[    0.079171] iommu: Adding device 0003:01:00.0 to group 0
[    0.079234] pci 0003:00:00.0: PCI bridge to [bus 01]
[    0.079336] pci 0003:00:00.0:   bridge window [mem 0x600c180000000-0x600c1ffefffff]
[    0.079496] pci 0004:00:00.0: BAR 15: assigned [mem 0x6024000000000-0x602403fffffff 64bit pref]
[    0.079623] pci 0004:01:00.0: BAR 0: assigned [mem 0x6024000000000-0x602400000ffff 64bit pref]
[    0.079778] pci 0004:01:00.0: BAR 2: assigned [mem 0x6024000010000-0x602400001ffff 64bit pref]
[    0.079927] pci 0004:01:00.0: BAR 4: assigned [mem 0x6024000020000-0x602400002ffff 64bit pref]
[    0.080078] pci 0004:01:00.1: BAR 0: assigned [mem 0x6024000030000-0x602400003ffff 64bit pref]
[    0.080223] pci 0004:01:00.1: BAR 2: assigned [mem 0x6024000040000-0x602400004ffff 64bit pref]
[    0.080366] pci 0004:01:00.1: BAR 4: assigned [mem 0x6024000050000-0x602400005ffff 64bit pref]
[    0.080512] pci 0004:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.080870] pci 0004:01     : [PE# 00] Secondary bus 1 associated with PE#0
[    0.081180] pci 0004:01     : [PE# 00] Setting up 32-bit TCE table at 0..80000000
[    0.088730] pci 0004:01     : [PE# 00] Setting up window#0 0..7fffffff pg=1000
[    0.088807] pci 0004:01     : [PE# 00] Enabling 64-bit DMA bypass
[    0.088915] iommu: Adding device 0004:01:00.0 to group 1
[    0.089000] iommu: Adding device 0004:01:00.1 to group 1
[    0.089086] pci 0004:00:00.0: PCI bridge to [bus 01]
[    0.089203] pci 0004:00:00.0:   bridge window [mem 0x6024000000000-0x6027f7fffffff 64bit pref]
[    0.089378] pci 0005:00:00.0: BAR 14: assigned [mem 0x600c280000000-0x600c2817fffff]
[    0.089464] pci 0005:01:00.0: BAR 14: assigned [mem 0x600c280000000-0x600c2817fffff]
[    0.089591] pci 0005:01:00.0: BAR 13: no space for [io  size 0x1000]
[    0.089718] pci 0005:01:00.0: BAR 13: failed to assign [io  size 0x1000]
[    0.089827] pci 0005:02:00.0: BAR 0: assigned [mem 0x600c280000000-0x600c280ffffff]
[    0.089942] pci 0005:02:00.0: BAR 1: assigned [mem 0x600c281000000-0x600c28101ffff]
[    0.090056] pci 0005:02:00.0: BAR 2: no space for [io  size 0x0080]
[    0.090146] pci 0005:02:00.0: BAR 2: failed to assign [io  size 0x0080]
[    0.090253] pci 0005:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.090616] pci 0005:02     : [PE# fd] Secondary bus 2..2 associated with PE#fd
[    0.090951] pci 0005:02     : [PE# fd] Setting up 32-bit TCE table at 0..80000000
[    0.098492] pci 0005:02     : [PE# fd] Setting up window#0 0..7fffffff pg=1000
[    0.098566] pci 0005:02     : [PE# fd] Enabling 64-bit DMA bypass
[    0.098655] iommu: Adding device 0005:02:00.0 to group 2
[    0.098733] pci 0005:01:00.0: PCI bridge to [bus 02]
[    0.098832] pci 0005:01:00.0:   bridge window [mem 0x600c280000000-0x600c2ffefffff]
[    0.098968] pci 0005:01     : [PE# fc] Secondary bus 1 associated with PE#fc
[    0.099348] pci 0005:00:00.0: PCI bridge to [bus 01-02]
[    0.099411] pci 0005:00:00.0:   bridge window [mem 0x600c280000000-0x600c2ffefffff]
[    0.099548] pci_bus 0005:00: Some PCI device resources are unassigned, try booting with pci=realloc
[    0.099733] pci 0030:00:00.0: BAR 14: assigned [mem 0x620c000000000-0x620c0003fffff]
[    0.099833] pci 0030:01:00.0: BAR 6: assigned [mem 0x620c000000000-0x620c0000fffff pref]
[    0.099949] pci 0030:01:00.0: BAR 3: assigned [mem 0x620c000100000-0x620c00013ffff 64bit]
[    0.100123] pci 0030:01:00.0: BAR 1: assigned [mem 0x620c000140000-0x620c00014ffff 64bit]
[    0.100225] pci 0030:01:00.0: BAR 0: no space for [io  size 0x0100]
[    0.100329] pci 0030:01:00.0: BAR 0: failed to assign [io  size 0x0100]
[    0.100448] pci 0030:00     : [PE# 1fe] Secondary bus 0 associated with PE#1fe
[    0.100802] pci 0030:01     : [PE# 1fd] Secondary bus 1 associated with PE#1fd
[    0.101130] pci 0030:01     : [PE# 1fd] Setting up 32-bit TCE table at 0..80000000
[    0.108694] pci 0030:01     : [PE# 1fd] Setting up window#0 0..7fffffff pg=1000
[    0.108776] pci 0030:01     : [PE# 1fd] Enabling 64-bit DMA bypass
[    0.108875] iommu: Adding device 0030:01:00.0 to group 3
[    0.108938] pci 0030:00:00.0: PCI bridge to [bus 01]
[    0.109030] pci 0030:00:00.0:   bridge window [mem 0x620c000000000-0x620c07fefffff]
[    0.109176] pci_bus 0030:00: Some PCI device resources are unassigned, try booting with pci=realloc
[    0.109358] pci 0031:00:00.0: BAR 14: assigned [mem 0x620c080000000-0x620c0807fffff]
[    0.109473] pci 0031:01:00.0: BAR 6: assigned [mem 0x620c080000000-0x620c0800fffff pref]
[    0.109609] pci 0031:01:00.0: BAR 3: assigned [mem 0x620c080100000-0x620c08013ffff 64bit]
[    0.109747] pci 0031:01:00.0: BAR 1: assigned [mem 0x620c080140000-0x620c08014ffff 64bit]
[    0.109859] pci 0031:01:00.0: BAR 0: no space for [io  size 0x0100]
[    0.109953] pci 0031:01:00.0: BAR 0: failed to assign [io  size 0x0100]
[    0.110070] pci 0031:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.110420] pci 0031:01     : [PE# fd] Secondary bus 1 associated with PE#fd
[    0.110751] pci 0031:01     : [PE# fd] Setting up 32-bit TCE table at 0..80000000
[    0.118291] pci 0031:01     : [PE# fd] Setting up window#0 0..7fffffff pg=1000
[    0.118371] pci 0031:01     : [PE# fd] Enabling 64-bit DMA bypass
[    0.118457] iommu: Adding device 0031:01:00.0 to group 4
[    0.118541] pci 0031:00:00.0: PCI bridge to [bus 01]
[    0.118647] pci 0031:00:00.0:   bridge window [mem 0x620c080000000-0x620c0ffefffff]
[    0.118811] pci_bus 0031:00: Some PCI device resources are unassigned, try booting with pci=realloc
[    0.118959] pci 0032:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.119316] pci 0032:00:00.0: PCI bridge to [bus 01]
[    0.119414] pci 0033:00:00.0: BAR 14: assigned [mem 0x620c180000000-0x620c1803fffff]
[    0.119548] pci 0033:01:00.0: BAR 6: assigned [mem 0x620c180000000-0x620c1800fffff pref]
[    0.119651] pci 0033:01:00.0: BAR 3: assigned [mem 0x620c180100000-0x620c18013ffff 64bit]
[    0.119807] pci 0033:01:00.0: BAR 1: assigned [mem 0x620c180140000-0x620c18014ffff 64bit]
[    0.119942] pci 0033:01:00.0: BAR 0: no space for [io  size 0x0100]
[    0.120021] pci 0033:01:00.0: BAR 0: failed to assign [io  size 0x0100]
[    0.120126] pci 0033:00     : [PE# 1fe] Secondary bus 0 associated with PE#1fe
[    0.120467] pci 0033:01     : [PE# 1fd] Secondary bus 1 associated with PE#1fd
[    0.120798] pci 0033:01     : [PE# 1fd] Setting up 32-bit TCE table at 0..80000000
[    0.128335] pci 0033:01     : [PE# 1fd] Setting up window#0 0..7fffffff pg=1000
[    0.128419] pci 0033:01     : [PE# 1fd] Enabling 64-bit DMA bypass
[    0.128509] iommu: Adding device 0033:01:00.0 to group 5
[    0.128584] pci 0033:00:00.0: PCI bridge to [bus 01]
[    0.128686] pci 0033:00:00.0:   bridge window [mem 0x620c180000000-0x620c1ffefffff]
[    0.128831] pci_bus 0033:00: Some PCI device resources are unassigned, try booting with pci=realloc
[    0.130112] EEH: PCI Enhanced I/O Error Handling Enabled
[    0.131969] cpuidle-powernv: Default stop: psscr = 0x0000000000000330,mask=0x00000000003003ff
[    0.132055] cpuidle-powernv: Deepest stop: psscr = 0x0000000000300330,mask=0x00000000003003ff
[    0.132184] cpuidle-powernv: Requested Level (RL) value of first deep stop = 0xf
[    0.134039] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.134101] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    0.135002] pci 0005:02:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[    0.135096] pci 0005:02:00.0: vgaarb: bridge control possible
[    0.135210] vgaarb: loaded
[    0.135377] SCSI subsystem initialized
[    0.135924] clocksource: Switched to clocksource timebase
[    0.152333] VFS: Disk quotas dquot_6.6.0
[    0.152419] VFS: Dquot-cache hash table entries: 8192 (order 0, 65536 bytes)
[    0.152735] AppArmor: AppArmor Filesystem Enabled
[    0.155488] NET: Registered protocol family 2
[    0.155745] TCP established hash table entries: 131072 (order: 4, 1048576 bytes)
[    0.156194] TCP bind hash table entries: 65536 (order: 4, 1048576 bytes)
[    0.156528] TCP: Hash tables configured (established 131072 bind 65536)
[    0.156669] UDP hash table entries: 8192 (order: 2, 262144 bytes)
[    0.156819] UDP-Lite hash table entries: 8192 (order: 2, 262144 bytes)
[    0.157097] NET: Registered protocol family 1
[    0.157193] pci 0003:00:00.0: enabling device (0101 -> 0103)
[    0.157285] pci 0003:01:00.0: enabling device (0140 -> 0142)
[    0.157477] Unpacking initramfs...
[    0.627594] Freeing initrd memory: 20096K
[    0.628499] nest_capp0_imc performance monitor hardware support registered
[    0.629811] core_imc performance monitor hardware support registered
[    0.629966] nest_nx_imc performance monitor hardware support registered
[    0.630097] nest_phb0_imc performance monitor hardware support registered
[    0.630212] nest_phb1_imc performance monitor hardware support registered
[    0.630349] nest_phb2_imc performance monitor hardware support registered
[    0.630477] nest_phb3_imc performance monitor hardware support registered
[    0.630650] nest_powerbus0_imc performance monitor hardware support registered
[    0.632063] thread_imc performance monitor hardware support registered
[    0.632185] nest_xlink1_imc performance monitor hardware support registered
[    0.633780] audit: initializing netlink subsys (disabled)
[    0.633930] audit: type=2000 audit(1521393710.628:1): state=initialized audit_enabled=0 res=1
[    0.636235] workingset: timestamp_bits=38 max_order=18 bucket_order=0
[    0.636711] zbud: loaded
[    1.097836] Key type asymmetric registered
[    1.097869] Asymmetric key parser 'x509' registered
[    1.097945] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)
[    1.098136] io scheduler noop registered
[    1.098212] io scheduler deadline registered
[    1.098316] io scheduler cfq registered (default)
[    1.098369] io scheduler mq-deadline registered
[    1.099127] pcieport 0004:00:00.0: enabling device (0101 -> 0103)
[    1.099232] pcieport 0005:00:00.0: enabling device (0101 -> 0103)
[    1.099463] pcieport 0030:00:00.0: enabling device (0101 -> 0103)
[    1.099643] pcieport 0031:00:00.0: enabling device (0101 -> 0103)
[    1.099837] pcieport 0033:00:00.0: enabling device (0101 -> 0103)
[    1.100060] pci 0005:01:00.0: enabling device (0141 -> 0143)
[    1.100160] pci 0005:02:00.0: enabling device (0141 -> 0143)
[    1.100244] Using unsupported 1024x768 vga at 600c280010000, depth=32, pitch=4096
[    1.183047] Console: switching to colour frame buffer device 128x48
[    1.265620] fb0: Open Firmware frame buffer device on /pciex@600c3c0500000/pci@0/pci@0/vga@0
[    1.265813] hvc0: raw protocol on /ibm,opal/consoles/serial@0 (boot console)
[    1.265934] hvc0: No interrupts property, using OPAL event
[    1.266364] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
[    1.266726] Linux agpgart interface v0.103
[    1.267074] mousedev: PS/2 mouse device common for all mice
[    1.527967] rtc-opal opal-rtc: rtc core: registered rtc-opal as rtc0
[    1.529556] powernv-cpufreq: cpufreq pstate min 99 nominal 66 max 0
[    1.529623] powernv-cpufreq: Workload Optimized Frequency is enabled in the platform
[    1.531780] ledtrig-cpu: registered to indicate activity on CPUs
[    1.532009] NET: Registered protocol family 10
[    1.532380] Segment Routing with IPv6
[    1.532424] mip6: Mobile IPv6
[    1.532473] NET: Registered protocol family 17
[    1.532552] mpls_gso: MPLS GSO support
[    1.533097] registered taskstats version 1
[    1.533164] zswap: loaded using pool lzo/zbud
[    1.533265] AppArmor: AppArmor sha1 policy hashing enabled
[    1.533330] ima: No TPM chip found, activating TPM-bypass! (rc=-19)
[    1.683951] rtc-opal opal-rtc: setting system clock to 2018-03-18 17:21:52 UTC (1521393712)
[    1.685281] Freeing unused kernel memory: 1088K
Loading, please wait...
starting version 238
[    1.736153] synth uevent: /devices/vio: failed to send uevent
[    1.736156] vio vio: uevent: failed to send synthetic uevent
[    1.737127] pps_core: LinuxPPS API ver. 1 registered
[    1.737177] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    1.737739] PTP clock support registered
[    1.743128] tg3.c:v3.137 (May 11, 2014)
[    1.743195] tg3 0004:01:00.0: enabling device (0140 -> 0142)
[    1.747332] mpt3sas version 15.100.00.00 loaded
[    1.747371] usbcore: registered new interface driver usbfs
[    1.747459] usbcore: registered new interface driver hub
[    1.747666] usbcore: registered new device driver usb
[    1.747673] mpt3sas 0030:01:00.0: enabling device (0140 -> 0142)
[    1.747690] mpt3sas 0030:01:00.0: Using 64-bit DMA iommu bypass
[    1.747696] mpt3sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (16541888 kB)
[    1.754066] xhci_hcd 0003:01:00.0: xHCI Host Controller
[    1.754108] xhci_hcd 0003:01:00.0: new USB bus registered, assigned bus number 1
[    1.754232] xhci_hcd 0003:01:00.0: Using 64-bit DMA iommu bypass
[    1.754315] xhci_hcd 0003:01:00.0: hcc params 0x0270f06d hci version 0x96 quirks 0x04000000
[    1.754653] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    1.754694] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.754742] usb usb1: Product: xHCI Host Controller
[    1.754772] usb usb1: Manufacturer: Linux 4.14.0-3-powerpc64le xhci-hcd
[    1.754805] usb usb1: SerialNumber: 0003:01:00.0
[    1.754946] hub 1-0:1.0: USB hub found
[    1.754984] hub 1-0:1.0: 4 ports detected
[    1.755164] xhci_hcd 0003:01:00.0: xHCI Host Controller
[    1.755195] xhci_hcd 0003:01:00.0: new USB bus registered, assigned bus number 2
[    1.755267] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    1.755356] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003
[    1.755394] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.755433] usb usb2: Product: xHCI Host Controller
[    1.755460] usb usb2: Manufacturer: Linux 4.14.0-3-powerpc64le xhci-hcd
[    1.755493] usb usb2: SerialNumber: 0003:01:00.0
[    1.755659] hub 2-0:1.0: USB hub found
[    1.755724] hub 2-0:1.0: 4 ports detected
[    1.761882] tg3 0004:01:00.0: Using 64-bit DMA iommu bypass
[    1.762176] tg3 0004:01:00.0 eth0: Tigon3 [partno(BCM95719) rev 5719001] (PCI Express) MAC address 2c:09:4d:00:01:15
[    1.762233] tg3 0004:01:00.0 eth0: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    1.762288] tg3 0004:01:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    1.762329] tg3 0004:01:00.0 eth0: dma_rwctrl[00000000] dma_mask[64-bit]
[    1.762471] tg3 0004:01:00.1: enabling device (0140 -> 0142)
[    1.778534] tg3 0004:01:00.1: Using 64-bit DMA iommu bypass
[    1.778784] tg3 0004:01:00.1 eth1: Tigon3 [partno(BCM95719) rev 5719001] (PCI Express) MAC address 2c:09:4d:00:01:16
[    1.778839] tg3 0004:01:00.1 eth1: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    1.778893] tg3 0004:01:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    1.778933] tg3 0004:01:00.1 eth1: dma_rwctrl[00000000] dma_mask[64-bit]
[    1.780092] tg3 0004:01:00.0 enP4p1s0f0: renamed from eth0
[    1.805562] mpt3sas_cm0: MSI-X vectors supported: 96, no of cores: 32, max_msix_vectors: -1
[    1.806668] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 64
[    1.806737] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 65
[    1.806835] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 66
[    1.806919] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 67
[    1.807001] mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 68
[    1.807088] mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 69
[    1.807138] mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 70
[    1.807214] mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 71
[    1.807332] mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 75
[    1.807428] mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 76
[    1.807512] mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 77
[    1.807597] mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 78
[    1.807682] mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 79
[    1.807765] mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 89
[    1.807847] mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 90
[    1.807936] mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 91
[    1.808016] mpt3sas0-msix16: PCI-MSI-X enabled: IRQ 92
[    1.808101] mpt3sas0-msix17: PCI-MSI-X enabled: IRQ 93
[    1.808181] mpt3sas0-msix18: PCI-MSI-X enabled: IRQ 94
[    1.808262] mpt3sas0-msix19: PCI-MSI-X enabled: IRQ 95
[    1.808330] mpt3sas0-msix20: PCI-MSI-X enabled: IRQ 96
[    1.808410] mpt3sas0-msix21: PCI-MSI-X enabled: IRQ 97
[    1.808493] mpt3sas0-msix22: PCI-MSI-X enabled: IRQ 98
[    1.808581] mpt3sas0-msix23: PCI-MSI-X enabled: IRQ 99
[    1.808666] mpt3sas0-msix24: PCI-MSI-X enabled: IRQ 100
[    1.808752] mpt3sas0-msix25: PCI-MSI-X enabled: IRQ 101
[    1.808834] mpt3sas0-msix26: PCI-MSI-X enabled: IRQ 102
[    1.808920] mpt3sas0-msix27: PCI-MSI-X enabled: IRQ 103
[    1.809008] mpt3sas0-msix28: PCI-MSI-X enabled: IRQ 104
[    1.809096] mpt3sas0-msix29: PCI-MSI-X enabled: IRQ 105
[    1.809182] mpt3sas0-msix30: PCI-MSI-X enabled: IRQ 106
[    1.809267] mpt3sas0-msix31: PCI-MSI-X enabled: IRQ 107
[    1.809352] mpt3sas_cm0: iomem(0x000620c000140000), mapped(0xc00c0000814f0000), size(65536)
[    1.809476] mpt3sas_cm0: ioport(0x0000000000000000), size(0)
[    1.820164] tg3 0004:01:00.1 enP4p1s0f1: renamed from eth1
[    1.910411] mpt3sas_cm0: Allocated physical memory: size(21292 kB)
[    1.910467] mpt3sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[    1.910530] mpt3sas_cm0: Scatter Gather Elements per IO(128)
[    1.958532] mpt3sas_cm0: LSISAS3008: FWVersion(14.00.00.00), ChipRevision(0x02), BiosVersion(08.11.00.00)
[    1.958606] mpt3sas_cm0: Protocol=(
[    1.958607] Initiator
[    1.958635] ,Target
[    1.958654] ),
[    1.958673] Capabilities=(
[    1.958692] TLR
[    1.958712] ,EEDP
[    1.958730] ,Snapshot Buffer
[    1.958749] ,Diag Trace Buffer
[    1.958777] ,Task Set Full
[    1.958805] ,NCQ
[    1.958824] )
[    1.958901] scsi host0: Fusion MPT SAS Host
[    2.087931] usb 1-4: new high-speed USB device number 2 using xhci_hcd
[    2.239015] usb 1-4: New USB device found, idVendor=05e3, idProduct=0610
[    2.239072] usb 1-4: New USB device strings: Mfr=0, Product=1, SerialNumber=0
[    2.239138] usb 1-4: Product: USB2.0 Hub
[    2.243814] hub 1-4:1.0: USB hub found
[    2.244387] hub 1-4:1.0: 4 ports detected
[   19.935922] Watchdog CPU:2 detected Hard LOCKUP other CPUS:3,28
[   36.831922] Watchdog CPU:2 detected Hard LOCKUP other CPUS:4,12,15
[   54.495917] Watchdog CPU:27 detected Hard LOCKUP other CPUS:17,20
[   89.567925] Watchdog CPU:30 detected Hard LOCKUP other CPUS:11,26
[  242.655956] INFO: task systemd-udevd:302 blocked for more than 120 seconds.
[  242.656026]       Not tainted 4.14.0-3-powerpc64le #1 Debian 4.14.13-1
[  242.656087] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  242.656162] systemd-udevd   D    0   302    287 0x00040002
[  242.656217] Call Trace:
[  242.656252] [c0000000032470b0] [c0000003c7c06780] 0xc0000003c7c06780 (unreliable)
[  242.656334] [c000000003247280] [c00000000001d0d8] __switch_to+0x298/0x480
[  242.656408] [c0000000032472e0] [c000000000978a44] __schedule+0x2a4/0xaf0
[  242.656472] [c0000000032473b0] [c0000000009792d0] schedule+0x40/0xc0
[  242.656539] [c0000000032473d0] [c00000000097e834] schedule_timeout+0x244/0x4d0
[  242.656610] [c0000000032474c0] [c00000000097a48c] wait_for_common+0x19c/0x300
[  242.656691] [c000000003247540] [c00000000012719c] flush_work+0x14c/0x2b0
[  242.656757] [c0000000032475d0] [c000000000127388] work_on_cpu+0x88/0xb0
[  242.656829] [c000000003247650] [c0000000005f58d0] pci_device_probe+0x230/0x250
[  242.656904] [c0000000032476b0] [c0000000006b8b68] driver_probe_device+0x3d8/0x580
[  242.656990] [c000000003247740] [c0000000006b8e5c] __driver_attach+0x14c/0x1a0
[  242.657068] [c0000000032477c0] [c0000000006b51cc] bus_for_each_dev+0x9c/0x100
[  242.657149] [c000000003247810] [c0000000006b7ecc] driver_attach+0x3c/0x60
[  242.657210] [c000000003247840] [c0000000006b74c8] bus_add_driver+0x2a8/0x360
[  242.657286] [c0000000032478d0] [c0000000006ba14c] driver_register+0x9c/0x180
[  242.657361] [c000000003247940] [c0000000005f34a4] __pci_register_driver+0x74/0xa0
[  242.657450] [c000000003247980] [c0080000036ab280] _mpt3sas_init+0x1ec/0x228 [mpt3sas]
[  242.657530] [c000000003247a00] [c00000000000d6c8] do_one_initcall+0x68/0x1e0
[  242.657602] [c000000003247ac0] [c0000000001d31ac] do_init_module+0x90/0x244
[  242.657668] [c000000003247b50] [c0000000001d1c24] load_module+0x3004/0x37a0
[  242.657738] [c000000003247d30] [c0000000001d26cc] SyS_finit_module+0xcc/0x140
[  242.657839] [c000000003247e30] [c00000000000b760] system_call+0x58/0x6c
madscientist159 commented 6 years ago

Note that the machine still boots from a recovery disk. I wonder if the LSI controller needs a hard reset the same way the USB controllers need to be reset on kexec(), and if the hard PCIe reset on kexec() should be generalized to all plugged PCIe devices?

System firmware versions:

 Primary platform versions:
        open-power-talos-ab0d559
        buildroot-2017.11.2-8-g4b6188e0f2
        skiboot-2154c2e
        hostboot-28927a7
        linux-v4.15.9-openpower1-p259257c
        petitboot-v1.6.6-p836d356
        machine-xml-f65c2a1
        occ-f72f857
        sbe-9b78381
        hcode-644d3f8

Note that this is built from our tree at https://git.raptorcs.com so some of the hashes may differ from the stock open-power repository versions.

madscientist159 commented 6 years ago

Not seeing this on a custom 4.16-rc5 recompile. Not sure why it happens on 4.14; the main issue here is that Debian Buster (the next release) is 4.14 AFAIK, so it's desirable to be able to boot the next Debian release without requiring a custom kernel.