linuxppc / issues

Issues repository for linuxppc
5 stars 0 forks source link

Kernel failed to kexec to new kernel when nosmp parameter passed. #154

Open pridhiviraj opened 6 years ago

pridhiviraj commented 6 years ago
 Petitboot (v1.7.1-p86c23dd)                                   8335-GTC 131B6DA
 ──────────────────────────────────────────────────────────────────────────────
  [Disk: sda2 / 861195cb-1a86-4ec9-a16c-57f3ef1d6dbe]
    Ubuntu, with Linux 4.15.0-15-generic (recovery mode)
    Ubuntu, with Linux 4.15.0-15-generic
    Ubuntu, with Linux 4.15.0-17-generic (recovery mode)
    Ubuntu, with Linux 4.15.0-17-generic
    Ubuntu, with Linux 4.15.0-23-generic (recovery mode)
    Ubuntu, with Linux 4.15.0-23-generic
    Ubuntu, with Linux 4.17.0+ (recovery mode)
 *  Ubuntu, with Linux 4.17.0+                          
    Ubuntu

  System information
  System configuration
  System status log
  Language
  Rescan devices
  Retrieve config from URL
  Plugins (0)
  Exit to shell
 ──────────────────────────────────────────────────────────────────────────────
 Enter=accept, e=edit, n=new, x=exit, l=language, g=log, h=help
The system is going down NOW!
Sent SIGTERM to all processes
Sent SIGKILL to all processes
[  205.848067] kexec_core: Starting new kernel
cpu 0x14: Vector: 300 (Data Access) at [c000001feb4a3780]
    pc: c0000000001ca910: internal_create_group+0x30/0x304
    lr: c0000000001ca900: internal_create_group+0x20/0x304
    sp: c000001feb4a3a00
   msr: 9000000000009033
   dar: 40
 dsisr: 40000000
  current = 0xc000001feb970c00
  paca    = 0xc00000000fdc5a00   softe: 3    irq_happened: 0x01
    pid   = 1861, comm = kexec
Linux version 4.16.13-openpower1 (ubuntu@nwblr2.in.ibm.com) (gcc version 6.4.0 (Buildroot 2018.02.1-00006-ga8d1126)) #2 SMP Mon Jun 11 10:55:16 EDT 2018
enter ? for help
[c000001feb4a3a00] c000001feb4a3ac0 (unreliable)
[c000001feb4a3aa0] c0000000004379b0 topology_add_dev+0x2c/0x40
[c000001feb4a3ac0] c000000000074f9c cpuhp_invoke_callback+0xe0/0x234
[c000001feb4a3b20] c000000000075b14 cpu_up+0x15c/0x1e0
[c000001feb4a3bc0] c0000000000308d8 default_machine_kexec+0x1f0/0x264
[c000001feb4a3c50] c00000000002fac8 machine_kexec+0x50/0x58
[c000001feb4a3c70] c0000000000ead88 kernel_kexec+0x98/0xb4
[c000001feb4a3ce0] c000000000095308 SyS_reboot+0x1c8/0x1f4
[c000001feb4a3e30] c00000000000b218 system_call+0x58/0x6c
--- Exception: c01 (System Call) at 00007fffa229f014
SP (7fffcd88f980) is in userspace
14:mon> 
14:mon> dl
[    0.000000] Allocated 2359296 bytes for 2048 pacas at         (ptrval)
[    0.000000] dt-cpu-ftrs: setup for ISA 3000
[    0.000000] dt-cpu-ftrs: not enabling: system-call-vectored (disabled or unsupported by kernel)
[    0.000000] dt-cpu-ftrs: final cpu/mmu features = 0x277c7afd18500249 0x3c006041
[    0.000000] radix-mmu: Page sizes from device-tree:
[    0.000000] radix-mmu: Page size shift = 12 AP=0x0
[    0.000000] radix-mmu: Page size shift = 16 AP=0x5
[    0.000000] radix-mmu: Page size shift = 21 AP=0x1
[    0.000000] radix-mmu: Page size shift = 30 AP=0x2
[    0.000000] radix-mmu: Initializing Radix MMU
[    0.000000] radix-mmu: Partition table         (ptrval)
[    0.000000] radix-mmu: Mapped 0x0000000000000000-0x0000000001200000 with 64.0 KiB pages
[    0.000000] radix-mmu: Mapped 0x0000000001200000-0x0000000040000000 with 2.00 MiB pages
[    0.000000] radix-mmu: Mapped 0x0000000040000000-0x0000002000000000 with 1.00 GiB pages
[    0.000000] radix-mmu: Mapped 0x0000200000000000-0x0000202000000000 with 1.00 GiB pages
[    0.000000] radix-mmu: Process table         (ptrval) and radix root for kernel:         (ptrval)
[    0.000000] OPAL: Found memory mapped LPC bus on chip 0
[    0.000000] ISA: Non-PCI bridge is /lpcm-opb@6030000000000/lpc@0
[    0.000000] Using PowerNV machine description
[    0.000000] bootconsole [udbg0] enabled
[    0.000000] CPU maps initialized for 4 threads per core
[    0.000000]  (thread shift is 2)
[    0.000000] Freed 2162688 bytes for unused pacas
[    0.000000] -----------------------------------------------------
[    0.000000] ppc64_pft_size    = 0x0
[    0.000000] phys_mem_size     = 0x4000000000
[    0.000000] dcache_bsize      = 0x80
[    0.000000] icache_bsize      = 0x80
[    0.000000] cpu_features      = 0x277c7afd18500249
[    0.000000]   possible        = 0xff7fffff18500649
[    0.000000]   always          = 0x0000000018100040
[    0.000000] cpu_user_features = 0xdc0065c2 0xaee00000
[    0.000000] mmu_features      = 0x3c006041
[    0.000000] firmware_features = 0x0000000010000000
[    0.000000] -----------------------------------------------------
[    0.000000] numa:   NODE_DATA [mem 0x1fffff6700-0x1fffffffff]
[    0.000000] numa:   NODE_DATA [mem 0x201ffc95e700-0x201ffc967fff]
[    0.000000] numa:   NODE_DATA [mem 0x201ffc934e00-0x201ffc93e6ff]
[    0.000000] numa:     NODE_DATA(252) on node 8
[    0.000000] numa:   NODE_DATA [mem 0x201ffc92b500-0x201ffc934dff]
[    0.000000] numa:     NODE_DATA(253) on node 8
[    0.000000] numa:   NODE_DATA [mem 0x201ffc921c00-0x201ffc92b4ff]
[    0.000000] numa:     NODE_DATA(254) on node 8
[    0.000000] numa:   NODE_DATA [mem 0x201ffc918300-0x201ffc921bff]
[    0.000000] numa:     NODE_DATA(255) on node 8
[    0.000000] rfi-flush: Using mttrig type flush
[    0.000000] rfi-flush: patched 6 locations
[    0.000000] stf-barrier: eieio barrier available
[    0.000000] stf-barrier: patched 60 entry locations (eieio barrier)
[    0.000000] stf-barrier: patched 6 exit locations (eieio barrier)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0000000)
[    0.000000] PCI host bridge /pciex@600c3c0000000 (primary) ranges:
[    0.000000]  MEM 0x000600c000000000..0x000600c07ffeffff -> 0x0000000080000000 
[    0.000000]  MEM 0x0006000000000000..0x0006003fffffffff -> 0x0006000000000000 (M64 #1..31)
[    0.000000]  Using M64 #31 as default window
[    0.000000]   512 (511) PE's M32: 0x80000000 [segment=0x400000]
[    0.000000]                  M64: 0x4000000000 [segment=0x20000000]
[    0.000000]   Allocated bitmap for 4088 MSIs (base IRQ 0xfe000)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0100000)
[    0.000000] PCI host bridge /pciex@600c3c0100000  ranges:
[    0.000000]  MEM 0x000600c080000000..0x000600c0fffeffff -> 0x0000000080000000 
[    0.000000]  MEM 0x0006004000000000..0x0006007fffffffff -> 0x0006004000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0xfd800)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0200000)
[    0.000000] PCI host bridge /pciex@600c3c0200000  ranges:
[    0.000000]  MEM 0x000600c100000000..0x000600c17ffeffff -> 0x0000000080000000 
[    0.000000]  MEM 0x0006008000000000..0x000600bfffffffff -> 0x0006008000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0xfd000)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0300000)
[    0.000000] PCI host bridge /pciex@600c3c0300000  ranges:
[    0.000000]  MEM 0x000600c180000000..0x000600c1fffeffff -> 0x0000000080000000 
[    0.000000]  MEM 0x0006020000000000..0x0006023fffffffff -> 0x0006020000000000 (M64 #1..31)
[    0.000000]  Using M64 #31 as default window
[    0.000000]   512 (511) PE's M32: 0x80000000 [segment=0x400000]
[    0.000000]                  M64: 0x4000000000 [segment=0x20000000]
[    0.000000]   Allocated bitmap for 4088 MSIs (base IRQ 0xfc000)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0400000)
[    0.000000] PCI host bridge /pciex@600c3c0400000  ranges:
[    0.000000]  MEM 0x000600c200000000..0x000600c27ffeffff -> 0x0000000080000000 
[    0.000000]  MEM 0x0006024000000000..0x0006027fffffffff -> 0x0006024000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0xfb800)
[    0.000000] Initializing IODA2 PHB (/pciex@600c3c0500000)
[    0.000000] PCI host bridge /pciex@600c3c0500000  ranges:
[    0.000000]  MEM 0x000600c280000000..0x000600c2fffeffff -> 0x0000000080000000 
[    0.000000]  MEM 0x0006028000000000..0x000602bfffffffff -> 0x0006028000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0xfb000)
[    0.000000] Initializing IODA2 PHB (/pciex@620c3c0000000)
[    0.000000] PCI host bridge /pciex@620c3c0000000  ranges:
[    0.000000]  MEM 0x000620c000000000..0x000620c07ffeffff -> 0x0000000080000000 
[    0.000000]  MEM 0x0006200000000000..0x0006203fffffffff -> 0x0006200000000000 (M64 #1..31)
[    0.000000]  Using M64 #31 as default window
[    0.000000]   512 (511) PE's M32: 0x80000000 [segment=0x400000]
[    0.000000]                  M64: 0x4000000000 [segment=0x20000000]
[    0.000000]   Allocated bitmap for 4088 MSIs (base IRQ 0x1fe000)
[    0.000000] Initializing IODA2 PHB (/pciex@620c3c0300000)
[    0.000000] PCI host bridge /pciex@620c3c0300000  ranges:
[    0.000000]  MEM 0x000620c180000000..0x000620c1fffeffff -> 0x0000000080000000 
[    0.000000]  MEM 0x0006220000000000..0x0006223fffffffff -> 0x0006220000000000 (M64 #1..31)
[    0.000000]  Using M64 #31 as default window
[    0.000000]   512 (511) PE's M32: 0x80000000 [segment=0x400000]
[    0.000000]                  M64: 0x4000000000 [segment=0x20000000]
[    0.000000]   Allocated bitmap for 4088 MSIs (base IRQ 0x1fd000)
[    0.000000] Initializing IODA2 PHB (/pciex@620c3c0400000)
[    0.000000] PCI host bridge /pciex@620c3c0400000  ranges:
[    0.000000]  MEM 0x000620c200000000..0x000620c27ffeffff -> 0x0000000080000000 
[    0.000000]  MEM 0x0006224000000000..0x0006227fffffffff -> 0x0006224000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0x1fc800)
[    0.000000] Initializing IODA2 PHB (/pciex@620c3c0500000)
[    0.000000] PCI host bridge /pciex@620c3c0500000  ranges:
[    0.000000]  MEM 0x000620c280000000..0x000620c2fffeffff -> 0x0000000080000000 
[    0.000000]  MEM 0x0006228000000000..0x000622bfffffffff -> 0x0006228000000000 (M64 #1..15)
[    0.000000]  Using M64 #15 as default window
[    0.000000]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    0.000000]                  M64: 0x4000000000 [segment=0x40000000]
[    0.000000]   Allocated bitmap for 2040 MSIs (base IRQ 0x1fc000)
[    0.000000] Initializing NPU_NVLINK PHB (/pciex@6030200000000)
[    0.000000] PCI host bridge /pciex@6030200000000  ranges:
[    0.000000]  MEM 0x0006030201600000..0x000603020171ffff -> 0x0006030201600000 
[    0.000000]   Not support M64 window
[    0.000000]   016 (015) PE's M32: 0x130000 [segment=0x13000]
[    0.000000] Initializing NPU_NVLINK PHB (/pciex@6230200000000)
[    0.000000] PCI host bridge /pciex@6230200000000  ranges:
[    0.000000]  MEM 0x0006230201600000..0x000623020171ffff -> 0x0006230201600000 
[    0.000000]   Not support M64 window
[    0.000000]   016 (015) PE's M32: 0x130000 [segment=0x13000]
[    0.000000] OPAL nvram setup, 589824 bytes
[    0.000000] Top of RAM: 0x202000000000, Total RAM: 0x4000000000
[    0.000000] Memory hole size: 33423360MB
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000000000-0x0000201fffffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x0000001fffffffff]
[    0.000000]   node   8: [mem 0x0000200000000000-0x0000201fffffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x0000001fffffffff]
[    0.000000] On node 0 totalpages: 2097152
[    0.000000]   DMA zone: 1792 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 2097152 pages, LIFO batch:1
[    0.000000] Initmem setup node 8 [mem 0x0000200000000000-0x0000201fffffffff]
[    0.000000] On node 8 totalpages: 2097152
[    0.000000]   DMA zone: 1792 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 2097152 pages, LIFO batch:1
[    0.000000] Could not find start_pfn for node 252
[    0.000000] Initmem setup node 252 [mem 0x0000000000000000-0x0000000000000000]
[    0.000000] On node 252 totalpages: 0
[    0.000000] Could not find start_pfn for node 253
[    0.000000] Initmem setup node 253 [mem 0x0000000000000000-0x0000000000000000]
[    0.000000] On node 253 totalpages: 0
[    0.000000] Could not find start_pfn for node 254
[    0.000000] Initmem setup node 254 [mem 0x0000000000000000-0x0000000000000000]
[    0.000000] On node 254 totalpages: 0
[    0.000000] Could not find start_pfn for node 255
[    0.000000] Initmem setup node 255 [mem 0x0000000000000000-0x0000000000000000]
[    0.000000] On node 255 totalpages: 0
[    0.000000] percpu: Embedded 2 pages/cpu @        (ptrval) s75288 r0 d55784 u131072
[    0.000000] pcpu-alloc: s75288 r0 d55784 u131072 alloc=2*65536
[    0.000000] pcpu-alloc: [0] 000 [0] 001 [0] 002 [0] 003 
[    0.000000] pcpu-alloc: [0] 004 [0] 005 [0] 006 [0] 007 
[    0.000000] pcpu-alloc: [0] 008 [0] 009 [0] 010 [0] 011 
[    0.000000] pcpu-alloc: [0] 012 [0] 013 [0] 014 [0] 015 
[    0.000000] pcpu-alloc: [0] 016 [0] 017 [0] 018 [0] 019 
[    0.000000] pcpu-alloc: [0] 020 [0] 021 [0] 022 [0] 023 
[    0.000000] pcpu-alloc: [0] 024 [0] 025 [0] 026 [0] 027 
[    0.000000] pcpu-alloc: [0] 028 [0] 029 [0] 030 [0] 031 
[    0.000000] pcpu-alloc: [0] 032 [0] 033 [0] 034 [0] 035 
[    0.000000] pcpu-alloc: [0] 036 [0] 037 [0] 038 [0] 039 
[    0.000000] pcpu-alloc: [0] 040 [0] 041 [0] 042 [0] 043 
[    0.000000] pcpu-alloc: [0] 044 [0] 045 [0] 046 [0] 047 
[    0.000000] pcpu-alloc: [0] 048 [0] 049 [0] 050 [0] 051 
[    0.000000] pcpu-alloc: [0] 052 [0] 053 [0] 054 [0] 055 
[    0.000000] pcpu-alloc: [0] 056 [0] 057 [0] 058 [0] 059 
[    0.000000] pcpu-alloc: [0] 060 [0] 061 [0] 062 [0] 063 
[    0.000000] pcpu-alloc: [0] 064 [0] 065 [0] 066 [0] 067 
[    0.000000] pcpu-alloc: [0] 068 [0] 069 [0] 070 [0] 071 
[    0.000000] pcpu-alloc: [1] 072 [1] 073 [1] 074 [1] 075 
[    0.000000] pcpu-alloc: [1] 076 [1] 077 [1] 078 [1] 079 
[    0.000000] pcpu-alloc: [1] 080 [1] 081 [1] 082 [1] 083 
[    0.000000] pcpu-alloc: [1] 084 [1] 085 [1] 086 [1] 087 
[    0.000000] pcpu-alloc: [1] 088 [1] 089 [1] 090 [1] 091 
[    0.000000] pcpu-alloc: [1] 092 [1] 093 [1] 094 [1] 095 
[    0.000000] pcpu-alloc: [1] 096 [1] 097 [1] 098 [1] 099 
[    0.000000] pcpu-alloc: [1] 100 [1] 101 [1] 102 [1] 103 
[    0.000000] pcpu-alloc: [1] 104 [1] 105 [1] 106 [1] 107 
[    0.000000] pcpu-alloc: [1] 108 [1] 109 [1] 110 [1] 111 
[    0.000000] pcpu-alloc: [1] 112 [1] 113 [1] 114 [1] 115 
[    0.000000] pcpu-alloc: [1] 116 [1] 117 [1] 118 [1] 119 
[    0.000000] pcpu-alloc: [1] 120 [1] 121 [1] 122 [1] 123 
[    0.000000] pcpu-alloc: [1] 124 [1] 125 [1] 126 [1] 127 
[    0.000000] pcpu-alloc: [1] 128 [1] 129 [1] 130 [1] 131 
[    0.000000] pcpu-alloc: [1] 132 [1] 133 [1] 134 [1] 135 
[    0.000000] pcpu-alloc: [1] 136 [1] 137 [1] 138 [1] 139 
[    0.000000] pcpu-alloc: [1] 140 [1] 141 [1] 142 [1] 143 
[    0.000000] Built 6 zonelists, mobility grouping on.  Total pages: 4190720
[    0.000000] Policy zone: DMA
[    0.000000] Kernel command line: console=tty0 console=hvc0 nosmp
[    0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[    0.000000] log_buf_len total cpu_extra contributions: 585728 bytes
[    0.000000] log_buf_len min size: 1048576 bytes
[    0.000000] log_buf_len: 2097152 bytes
[    0.000000] early log buf free: 1034448(98%)
[    0.000000] random: get_random_u64 called from __kmem_cache_create+0x3c/0x4b4 with crng_init=0
[    0.000000] SLUB: HWalign=128, Order=0-3, MinObjects=0, CPUs=144, Nodes=256
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  RCU event tracing is enabled.
[    0.000000]  RCU restricting CPUs from NR_CPUS=2048 to nr_cpu_ids=144.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=144
[    0.000000] NR_IRQS: 512, nr_irqs: 512, preallocated irqs: 16
[    0.000000] xive: Interrupt handling initialized with native backend
[    0.000000] xive: Using priority 7 for all interrupts
[    0.000000] xive: Using 64kB queues
[    0.000000] time_init: decrementer frequency = 512.000000 MHz
[    0.000000] time_init: processor frequency   = 3150.000000 MHz
[    0.000003] time_init: 56 bit decrementer (max: 7fffffffffffff)
[    0.000655] clocksource: timebase: mask: 0xffffffffffffffff max_cycles: 0x761537d007, max_idle_ns: 440795202126 ns
[    0.001427] clocksource: timebase mult[1f40000] shift[24] registered
[    0.001671] clockevent: decrementer mult[83126e98] shift[32] cpu[20]
[    0.001849] Console: colour dummy device 80x25
[    0.002664] console [tty0] enabled
[    0.002824] console [hvc0] enabled
[    0.003037] bootconsole [udbg0] disabled
[    0.003589] pid_max: default: 147456 minimum: 1152
[    0.005152] Security Framework initialized
[    0.014396] Dentry cache hash table entries: 16777216 (order: 11, 134217728 bytes)
[    0.019075] Inode-cache hash table entries: 8388608 (order: 10, 67108864 bytes)
[    0.019540] Mount-cache hash table entries: 262144 (order: 5, 2097152 bytes)
[    0.019824] Mountpoint-cache hash table entries: 262144 (order: 5, 2097152 bytes)
[    0.021457] EEH: PowerNV platform initialized
[    0.021579] POWER9 performance monitor hardware support registered
[    0.021747] Hierarchical SRCU implementation.
[    0.022697] smp: Bringing up secondary CPUs ...
[    0.022820] smp: Brought up 6 nodes, 1 CPU
[    0.022878] numa: Node 0 CPUs: 0-71
[    0.022929] numa: Node 8 CPUs: 72-143
[    0.022987] numa: Node 252 CPUs:
[    0.023045] numa: Node 253 CPUs:
[    0.023117] numa: Node 254 CPUs:
[    0.023199] numa: Node 255 CPUs:
[    0.023251] Using standard scheduler topology
[    0.027150] devtmpfs: initialized
[    0.040738] evm: security.capability
[    0.041175] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.041439] futex hash table entries: 65536 (order: 7, 8388608 bytes)
[    0.043116] NET: Registered protocol family 16
[    0.043286] EEH: No capable adapters found
[    0.043585] cpuidle: using governor menu
[    0.044599] xive: Interrupt 146 (HW 0x92) type mismatch, Linux says Level, FW says Edge
[    0.044712] xive: Interrupt 162 (HW 0x100092) type mismatch, Linux says Level, FW says Edge
[    0.045173] PCI: Probing PCI hardware
[    0.045251] PCI host bridge to bus 0000:00
[    0.045302] pci_bus 0000:00: root bus resource [mem 0x600c000000000-0x600c07ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.045438] pci_bus 0000:00: root bus resource [mem 0x6000000000000-0x6003fbfffffff 64bit pref]
[    0.045555] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.045631] pci_bus 0000:00: busn_res: [bus 00-ff] end is updated to ff
[    0.045696] pci 0000:00:00.0: [1014:04c1] type 01 class 0x060400
[    0.045767] pci 0000:00:00.0: Disabling memory decoding and releasing memory resources
[    0.045843] pci 0000:00:00.0: disabling bridge mem windows
[    0.046036] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    0.046112] pci 0000:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    0.046296] pci 0000:00:00.0: PCI bridge to [bus 01-ff]
[    0.046365] pci 0000:00:00.0:   bridge window [io  0x0000-0x0fff]
[    0.046388] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
[    0.046395] pci_bus 0000:00: busn_res: [bus 00-ff] end is updated to 01
[    0.046422] PCI host bridge to bus 0001:00
[    0.046464] pci_bus 0001:00: root bus resource [mem 0x600c080000000-0x600c0fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.046591] pci_bus 0001:00: root bus resource [mem 0x6004000000000-0x6007f7fffffff 64bit pref]
[    0.046706] pci_bus 0001:00: root bus resource [bus 00-ff]
[    0.046778] pci_bus 0001:00: busn_res: [bus 00-ff] end is updated to ff
[    0.046825] pci 0001:00:00.0: [1014:04c1] type 01 class 0x060400
[    0.046917] pci 0001:00:00.0: Disabling memory decoding and releasing memory resources
[    0.047000] pci 0001:00:00.0: disabling bridge mem windows
[    0.047174] pci 0001:00:00.0: PME# supported from D0 D3hot D3cold
[    0.047310] pci 0001:01:00.0: [104c:8241] type 00 class 0x0c0330
[    0.047355] pci 0001:01:00.0: reg 0x10: [mem 0x00000000-0x0000ffff 64bit]
[    0.047376] pci 0001:01:00.0: reg 0x18: [mem 0x00000000-0x00001fff 64bit]
[    0.047422] pci 0001:01:00.0: Disabling memory decoding and releasing memory resources
[    0.047493] pci 0001:01:00.0: BAR2 [mem size 0x00002000 64bit]: requesting alignment to 0x10000
[    0.047755] pci 0001:01:00.0: supports D1 D2
[    0.047758] pci 0001:01:00.0: PME# supported from D0 D1 D2 D3hot
[    0.047822] pci 0001:00:00.0: PCI bridge to [bus 01]
[    0.047890] pci 0001:00:00.0:   bridge window [io  0x0000-0x0fff]
[    0.047977] pci_bus 0001:00: busn_res: [bus 00-ff] end is updated to 01
[    0.048005] PCI host bridge to bus 0002:00
[    0.048041] pci_bus 0002:00: root bus resource [mem 0x600c100000000-0x600c17ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.048162] pci_bus 0002:00: root bus resource [mem 0x6008000000000-0x600bf7fffffff 64bit pref]
[    0.048249] pci_bus 0002:00: root bus resource [bus 00-ff]
[    0.048308] pci_bus 0002:00: busn_res: [bus 00-ff] end is updated to ff
[    0.048356] pci 0002:00:00.0: [1014:04c1] type 01 class 0x060400
[    0.048523] pci 0002:00:00.0: Disabling memory decoding and releasing memory resources
[    0.048624] pci 0002:00:00.0: disabling bridge mem windows
[    0.048773] pci 0002:00:00.0: PME# supported from D0 D3hot D3cold
[    0.048908] pci 0002:01:00.0: [1a03:1150] type 01 class 0x060400
[    0.048999] pci 0002:01:00.0: enabling Extended Tags
[    0.049043] pci 0002:01:00.0: Disabling memory decoding and releasing memory resources
[    0.049137] pci 0002:01:00.0: disabling bridge mem windows
[    0.049378] pci 0002:01:00.0: supports D1 D2
[    0.049381] pci 0002:01:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.049446] pci 0002:00:00.0: PCI bridge to [bus 01-02]
[    0.049496] pci 0002:00:00.0:   bridge window [io  0x0000-0x0fff]
[    0.049670] pci 0002:02:00.0: [1a03:2000] type 00 class 0x030000
[    0.049708] pci 0002:02:00.0: reg 0x10: [mem 0x00000000-0x00ffffff]
[    0.049721] pci 0002:02:00.0: reg 0x14: [mem 0x00000000-0x0001ffff]
[    0.049735] pci 0002:02:00.0: reg 0x18: [io  0x0000-0x007f]
[    0.049786] pci 0002:02:00.0: Disabling memory decoding and releasing memory resources
[    0.049975] pci 0002:02:00.0: supports D1 D2
[    0.049978] pci 0002:02:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.050034] pci 0002:01:00.0: PCI bridge to [bus 02]
[    0.050166] pci_bus 0002:00: busn_res: [bus 00-ff] end is updated to 02
[    0.050193] PCI host bridge to bus 0003:00
[    0.050235] pci_bus 0003:00: root bus resource [mem 0x600c180000000-0x600c1fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.050378] pci_bus 0003:00: root bus resource [mem 0x6020000000000-0x6023fbfffffff 64bit pref]
[    0.050513] pci_bus 0003:00: root bus resource [bus 00-ff]
[    0.050582] pci_bus 0003:00: busn_res: [bus 00-ff] end is updated to ff
[    0.050603] pci 0003:00:00.0: [1014:04c1] type 01 class 0x060400
[    0.050669] pci 0003:00:00.0: Disabling memory decoding and releasing memory resources
[    0.050765] pci 0003:00:00.0: disabling bridge mem windows
[    0.050921] pci 0003:00:00.0: PME# supported from D0 D3hot D3cold
[    0.051125] pci 0003:01:00.0: [15b3:1019] type 00 class 0x020700
[    0.051387] pci 0003:01:00.0: reg 0x10: [mem 0x00000000-0x1fffffff 64bit pref]
[    0.051706] pci 0003:01:00.0: Disabling memory decoding and releasing memory resources
[    0.052663] pci 0003:01:00.0: PME# supported from D3cold
[    0.052898] pci 0003:01:00.1: [15b3:1019] type 00 class 0x020700
[    0.053129] pci 0003:01:00.1: reg 0x10: [mem 0x00000000-0x1fffffff 64bit pref]
[    0.053446] pci 0003:01:00.1: Disabling memory decoding and releasing memory resources
[    0.054300] pci 0003:01:00.1: PME# supported from D3cold
[    0.054422] pci 0003:00:00.0: PCI bridge to [bus 01]
[    0.054492] pci 0003:00:00.0:   bridge window [io  0x0000-0x0fff]
[    0.054604] pci_bus 0003:00: busn_res: [bus 00-ff] end is updated to 01
[    0.054633] PCI host bridge to bus 0004:00
[    0.054666] pci_bus 0004:00: root bus resource [mem 0x600c200000000-0x600c27ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.054811] pci_bus 0004:00: root bus resource [mem 0x6024000000000-0x6027f7fffffff 64bit pref]
[    0.054944] pci_bus 0004:00: root bus resource [bus 00-ff]
[    0.055008] pci_bus 0004:00: busn_res: [bus 00-ff] end is updated to ff
[    0.055051] pci 0004:00:00.0: [1014:04c1] type 01 class 0x060400
[    0.055118] pci 0004:00:00.0: Disabling memory decoding and releasing memory resources
[    0.055223] pci 0004:00:00.0: disabling bridge mem windows
[    0.055363] pci 0004:00:00.0: PME# supported from D0 D3hot D3cold
[    0.055497] pci 0004:01:00.0: [10b5:8725] type 01 class 0x060400
[    0.055550] pci 0004:01:00.0: reg 0x10: [mem 0x00000000-0x0003ffff]
[    0.055603] pci 0004:01:00.0: Disabling memory decoding and releasing memory resources
[    0.055694] pci 0004:01:00.0: disabling bridge mem windows
[    0.055917] pci 0004:01:00.0: PME# supported from D0 D3hot D3cold
[    0.056017] pci 0004:01:00.1: [10b5:87d0] type 00 class 0x088000
[    0.056063] pci 0004:01:00.1: reg 0x10: [mem 0x00000000-0x00001fff]
[    0.056134] pci 0004:01:00.1: enabling Extended Tags
[    0.056210] pci 0004:01:00.1: Disabling memory decoding and releasing memory resources
[    0.056328] pci 0004:01:00.1: BAR0 [mem size 0x00002000]: requesting alignment to 0x10000
[    0.056588] pci 0004:01:00.2: [10b5:87d0] type 00 class 0x088000
[    0.056635] pci 0004:01:00.2: reg 0x10: [mem 0x00000000-0x00001fff]
[    0.056706] pci 0004:01:00.2: enabling Extended Tags
[    0.056761] pci 0004:01:00.2: Disabling memory decoding and releasing memory resources
[    0.056854] pci 0004:01:00.2: BAR0 [mem size 0x00002000]: requesting alignment to 0x10000
[    0.057184] pci 0004:01:00.3: [10b5:87d0] type 00 class 0x088000
[    0.057231] pci 0004:01:00.3: reg 0x10: [mem 0x00000000-0x00001fff]
[    0.057303] pci 0004:01:00.3: enabling Extended Tags
[    0.057377] pci 0004:01:00.3: Disabling memory decoding and releasing memory resources
[    0.057496] pci 0004:01:00.3: BAR0 [mem size 0x00002000]: requesting alignment to 0x10000
[    0.057770] pci 0004:01:00.4: [10b5:87d0] type 00 class 0x088000
[    0.057818] pci 0004:01:00.4: reg 0x10: [mem 0x00000000-0x00001fff]
[    0.057890] pci 0004:01:00.4: enabling Extended Tags
[    0.057939] pci 0004:01:00.4: Disabling memory decoding and releasing memory resources
[    0.058013] pci 0004:01:00.4: BAR0 [mem size 0x00002000]: requesting alignment to 0x10000
[    0.058346] pci 0004:00:00.0: PCI bridge to [bus 01-0a]
[    0.058419] pci 0004:00:00.0:   bridge window [io  0x0000-0x0fff]
[    0.058672] pci 0004:02:02.0: [10b5:8725] type 01 class 0x060400
[    0.058773] pci 0004:02:02.0: Disabling memory decoding and releasing memory resources
[    0.058883] pci 0004:02:02.0: disabling bridge mem windows
[    0.059078] pci 0004:02:02.0: PME# supported from D0 D3hot D3cold
[    0.059157] pci 0004:02:0a.0: [10b5:8725] type 01 class 0x060400
[    0.059258] pci 0004:02:0a.0: Disabling memory decoding and releasing memory resources
[    0.059334] pci 0004:02:0a.0: disabling bridge mem windows
[    0.059586] pci 0004:02:0a.0: PME# supported from D0 D3hot D3cold
[    0.059664] pci 0004:02:0b.0: [10b5:8725] type 01 class 0x060400
[    0.059765] pci 0004:02:0b.0: Disabling memory decoding and releasing memory resources
[    0.059835] pci 0004:02:0b.0: disabling bridge mem windows
[    0.060087] pci 0004:02:0b.0: PME# supported from D0 D3hot D3cold
[    0.060165] pci 0004:02:0c.0: [10b5:8725] type 01 class 0x060400
[    0.060267] pci 0004:02:0c.0: Disabling memory decoding and releasing memory resources
[    0.060320] pci 0004:02:0c.0: disabling bridge mem windows
[    0.060479] pci 0004:02:0c.0: PME# supported from D0 D3hot D3cold
[    0.060564] pci 0004:01:00.0: PCI bridge to [bus 02-0a]
[    0.062281] pci 0004:03:00.0: [1b4b:9235] type 00 class 0x010601
[    0.062319] pci 0004:03:00.0: reg 0x10: [io  0x8000-0x8007]
[    0.062334] pci 0004:03:00.0: reg 0x14: [io  0x8040-0x8043]
[    0.062350] pci 0004:03:00.0: reg 0x18: [io  0x8100-0x8107]
[    0.062366] pci 0004:03:00.0: reg 0x1c: [io  0x8140-0x8143]
[    0.062382] pci 0004:03:00.0: reg 0x20: [io  0x800000-0x80001f]
[    0.062398] pci 0004:03:00.0: reg 0x24: [mem 0x00900000-0x009007ff]
[    0.062414] pci 0004:03:00.0: reg 0x30: [mem 0x600c250000000-0x600c25000ffff pref]
[    0.062431] pci 0004:03:00.0: Disabling memory decoding and releasing memory resources
[    0.062486] pci 0004:03:00.0: BAR5 [mem size 0x00000800]: requesting alignment to 0x10000
[    0.062614] pci 0004:03:00.0: PME# supported from D3hot
[    0.062695] pci 0004:02:02.0: PCI bridge to [bus 03]
[    0.062870] pci 0004:04:00.0: [10de:1db1] type 00 class 0x030200
[    0.062923] pci 0004:04:00.0: reg 0x10: [mem 0x00000000-0x00ffffff]
[    0.062944] pci 0004:04:00.0: reg 0x14: [mem 0x00000000-0x3ffffffff 64bit pref]
[    0.062977] pci 0004:04:00.0: reg 0x1c: [mem 0x00000000-0x01ffffff 64bit pref]
[    0.063016] pci 0004:04:00.0: Disabling memory decoding and releasing memory resources
[    0.063245] pci 0004:02:0a.0: PCI bridge to [bus 04]
[    0.063435] pci 0004:05:00.0: [10de:1db1] type 00 class 0x030200
[    0.063488] pci 0004:05:00.0: reg 0x10: [mem 0x00000000-0x00ffffff]
[    0.063508] pci 0004:05:00.0: reg 0x14: [mem 0x00000000-0x3ffffffff 64bit pref]
[    0.063528] pci 0004:05:00.0: reg 0x1c: [mem 0x00000000-0x01ffffff 64bit pref]
[    0.063566] pci 0004:05:00.0: Disabling memory decoding and releasing memory resources
[    0.063833] pci 0004:02:0b.0: PCI bridge to [bus 05]
[    0.063971] pci 0004:02:0c.0: PCI bridge to [bus 06-0a]
[    0.064074] pci_bus 0004:00: busn_res: [bus 00-ff] end is updated to 0a
[    0.064107] PCI host bridge to bus 0005:00
[    0.064135] pci_bus 0005:00: root bus resource [mem 0x600c280000000-0x600c2fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.064200] pci_bus 0005:00: root bus resource [mem 0x6028000000000-0x602bf7fffffff 64bit pref]
[    0.064313] pci_bus 0005:00: root bus resource [bus 00-ff]
[    0.064390] pci_bus 0005:00: busn_res: [bus 00-ff] end is updated to ff
[    0.064411] pci 0005:00:00.0: [1014:04c1] type 01 class 0x060400
[    0.064478] pci 0005:00:00.0: Disabling memory decoding and releasing memory resources
[    0.064530] pci 0005:00:00.0: disabling bridge mem windows
[    0.064644] pci 0005:00:00.0: PME# supported from D0 D3hot D3cold
[    0.064786] pci 0005:01:00.0: [14e4:1657] type 00 class 0x020000
[    0.064836] pci 0005:01:00.0: reg 0x10: [mem 0x6028000000000-0x602800000ffff 64bit pref]
[    0.064857] pci 0005:01:00.0: reg 0x18: [mem 0x6028000010000-0x602800001ffff 64bit pref]
[    0.064878] pci 0005:01:00.0: reg 0x20: [mem 0x6028000020000-0x602800002ffff 64bit pref]
[    0.064905] pci 0005:01:00.0: Disabling memory decoding and releasing memory resources
[    0.065116] pci 0005:01:00.0: PME# supported from D0 D3hot D3cold
[    0.065212] pci 0005:01:00.1: [14e4:1657] type 00 class 0x020000
[    0.065263] pci 0005:01:00.1: reg 0x10: [mem 0x6028000030000-0x602800003ffff 64bit pref]
[    0.065297] pci 0005:01:00.1: reg 0x18: [mem 0x6028000040000-0x602800004ffff 64bit pref]
[    0.065319] pci 0005:01:00.1: reg 0x20: [mem 0x6028000050000-0x602800005ffff 64bit pref]
[    0.065346] pci 0005:01:00.1: Disabling memory decoding and releasing memory resources
[    0.065544] pci 0005:01:00.1: PME# supported from D0 D3hot D3cold
[    0.065596] pci 0005:00:00.0: PCI bridge to [bus 01]
[    0.065633] pci 0005:00:00.0:   bridge window [io  0x0000-0x0fff]
[    0.065734] pci_bus 0005:00: busn_res: [bus 00-ff] end is updated to 01
[    0.065762] PCI host bridge to bus 0030:00
[    0.065791] pci_bus 0030:00: root bus resource [mem 0x620c000000000-0x620c07ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.065855] pci_bus 0030:00: root bus resource [mem 0x6200000000000-0x6203fbfffffff 64bit pref]
[    0.065950] pci_bus 0030:00: root bus resource [bus 00-ff]
[    0.065985] pci_bus 0030:00: busn_res: [bus 00-ff] end is updated to ff
[    0.066010] pci 0030:00:00.0: [1014:04c1] type 01 class 0x060400
[    0.066093] pci 0030:00:00.0: Disabling memory decoding and releasing memory resources
[    0.066146] pci 0030:00:00.0: disabling bridge mem windows
[    0.066297] pci 0030:00:00.0: PME# supported from D0 D3hot D3cold
[    0.066448] pci 0030:01:00.0: [144d:a822] type 00 class 0x010802
[    0.066508] pci 0030:01:00.0: reg 0x10: [mem 0x00000000-0x00003fff 64bit]
[    0.066569] pci 0030:01:00.0: reg 0x30: [mem 0x00000000-0x0001ffff pref]
[    0.066590] pci 0030:01:00.0: Disabling memory decoding and releasing memory resources
[    0.066704] pci 0030:01:00.0: BAR0 [mem size 0x00004000 64bit]: requesting alignment to 0x10000
[    0.067001] pci 0030:00:00.0: PCI bridge to [bus 01]
[    0.067039] pci 0030:00:00.0:   bridge window [io  0x0000-0x0fff]
[    0.067103] pci_bus 0030:00: busn_res: [bus 00-ff] end is updated to 01
[    0.067130] PCI host bridge to bus 0033:00
[    0.067159] pci_bus 0033:00: root bus resource [mem 0x620c180000000-0x620c1fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.067223] pci_bus 0033:00: root bus resource [mem 0x6220000000000-0x6223fbfffffff 64bit pref]
[    0.067279] pci_bus 0033:00: root bus resource [bus 00-ff]
[    0.067314] pci_bus 0033:00: busn_res: [bus 00-ff] end is updated to ff
[    0.067339] pci 0033:00:00.0: [1014:04c1] type 01 class 0x060400
[    0.067423] pci 0033:00:00.0: Disabling memory decoding and releasing memory resources
[    0.067476] pci 0033:00:00.0: disabling bridge mem windows
[    0.067656] pci 0033:00:00.0: PME# supported from D0 D3hot D3cold
[    0.067886] pci 0033:01:00.0: [15b3:1019] type 00 class 0x020700
[    0.068158] pci 0033:01:00.0: reg 0x10: [mem 0x00000000-0x1fffffff 64bit pref]
[    0.068527] pci 0033:01:00.0: Disabling memory decoding and releasing memory resources
[    0.069475] pci 0033:01:00.0: PME# supported from D3cold
[    0.069724] pci 0033:01:00.1: [15b3:1019] type 00 class 0x020700
[    0.069982] pci 0033:01:00.1: reg 0x10: [mem 0x00000000-0x1fffffff 64bit pref]
[    0.070337] pci 0033:01:00.1: Disabling memory decoding and releasing memory resources
[    0.071182] pci 0033:01:00.1: PME# supported from D3cold
[    0.071344] pci 0033:00:00.0: PCI bridge to [bus 01]
[    0.071382] pci 0033:00:00.0:   bridge window [io  0x0000-0x0fff]
[    0.071505] pci_bus 0033:00: busn_res: [bus 00-ff] end is updated to 01
[    0.071533] PCI host bridge to bus 0034:00
[    0.071562] pci_bus 0034:00: root bus resource [mem 0x620c200000000-0x620c27ffeffff] (bus address [0x80000000-0xfffeffff])
[    0.071674] pci_bus 0034:00: root bus resource [mem 0x6224000000000-0x6227f7fffffff 64bit pref]
[    0.071730] pci_bus 0034:00: root bus resource [bus 00-ff]
[    0.071764] pci_bus 0034:00: busn_res: [bus 00-ff] end is updated to ff
[    0.071790] pci 0034:00:00.0: [1014:04c1] type 01 class 0x060400
[    0.071882] pci 0034:00:00.0: Disabling memory decoding and releasing memory resources
[    0.071935] pci 0034:00:00.0: disabling bridge mem windows
[    0.072056] pci 0034:00:00.0: PME# supported from D0 D3hot D3cold
[    0.072245] pci 0034:01:00.0: [14e4:1657] type 00 class 0x020000
[    0.072312] pci 0034:01:00.0: reg 0x10: [mem 0x00000000-0x0000ffff 64bit pref]
[    0.072338] pci 0034:01:00.0: reg 0x18: [mem 0x00000000-0x0000ffff 64bit pref]
[    0.072364] pci 0034:01:00.0: reg 0x20: [mem 0x00000000-0x0000ffff 64bit pref]
[    0.072381] pci 0034:01:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    0.072401] pci 0034:01:00.0: Disabling memory decoding and releasing memory resources
[    0.072641] pci 0034:01:00.0: PME# supported from D0 D3hot D3cold
[    0.072755] pci 0034:01:00.1: [14e4:1657] type 00 class 0x020000
[    0.072835] pci 0034:01:00.1: reg 0x10: [mem 0x00000000-0x0000ffff 64bit pref]
[    0.072862] pci 0034:01:00.1: reg 0x18: [mem 0x00000000-0x0000ffff 64bit pref]
[    0.072888] pci 0034:01:00.1: reg 0x20: [mem 0x00000000-0x0000ffff 64bit pref]
[    0.072904] pci 0034:01:00.1: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    0.072925] pci 0034:01:00.1: Disabling memory decoding and releasing memory resources
[    0.073181] pci 0034:01:00.1: PME# supported from D0 D3hot D3cold
[    0.073275] pci 0034:01:00.2: [14e4:1657] type 00 class 0x020000
[    0.073342] pci 0034:01:00.2: reg 0x10: [mem 0x00000000-0x0000ffff 64bit pref]
[    0.073369] pci 0034:01:00.2: reg 0x18: [mem 0x00000000-0x0000ffff 64bit pref]
[    0.073396] pci 0034:01:00.2: reg 0x20: [mem 0x00000000-0x0000ffff 64bit pref]
[    0.073412] pci 0034:01:00.2: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    0.073433] pci 0034:01:00.2: Disabling memory decoding and releasing memory resources
[    0.073691] pci 0034:01:00.2: PME# supported from D0 D3hot D3cold
[    0.073784] pci 0034:01:00.3: [14e4:1657] type 00 class 0x020000
[    0.073879] pci 0034:01:00.3: reg 0x10: [mem 0x00000000-0x0000ffff 64bit pref]
[    0.073906] pci 0034:01:00.3: reg 0x18: [mem 0x00000000-0x0000ffff 64bit pref]
[    0.073932] pci 0034:01:00.3: reg 0x20: [mem 0x00000000-0x0000ffff 64bit pref]
[    0.073949] pci 0034:01:00.3: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    0.073969] pci 0034:01:00.3: Disabling memory decoding and releasing memory resources
[    0.074228] pci 0034:01:00.3: PME# supported from D0 D3hot D3cold
[    0.074283] pci 0034:00:00.0: PCI bridge to [bus 01]
[    0.074322] pci 0034:00:00.0:   bridge window [io  0x0000-0x0fff]
[    0.074471] pci_bus 0034:00: busn_res: [bus 00-ff] end is updated to 01
[    0.074500] PCI host bridge to bus 0035:00
[    0.074529] pci_bus 0035:00: root bus resource [mem 0x620c280000000-0x620c2fffeffff] (bus address [0x80000000-0xfffeffff])
[    0.074653] random: fast init done
[    0.074719] pci_bus 0035:00: root bus resource [mem 0x6228000000000-0x622bf7fffffff 64bit pref]
[    0.074789] pci_bus 0035:00: root bus resource [bus 00-ff]
[    0.074823] pci_bus 0035:00: busn_res: [bus 00-ff] end is updated to ff
[    0.074849] pci 0035:00:00.0: [1014:04c1] type 01 class 0x060400
[    0.074934] pci 0035:00:00.0: Disabling memory decoding and releasing memory resources
[    0.075025] pci 0035:00:00.0: disabling bridge mem windows
[    0.075159] pci 0035:00:00.0: PME# supported from D0 D3hot D3cold
[    0.075312] pci 0035:01:00.0: [10b5:8725] type 01 class 0x060400
[    0.075378] pci 0035:01:00.0: reg 0x10: [mem 0x00000000-0x0003ffff]
[    0.075444] pci 0035:01:00.0: Disabling memory decoding and releasing memory resources
[    0.075497] pci 0035:01:00.0: disabling bridge mem windows
[    0.075708] pci 0035:01:00.0: PME# supported from D0 D3hot D3cold
[    0.075793] pci 0035:00:00.0: PCI bridge to [bus 01-09]
[    0.075832] pci 0035:00:00.0:   bridge window [io  0x0000-0x0fff]
[    0.076004] pci 0035:02:04.0: [10b5:8725] type 01 class 0x060400
[    0.076132] pci 0035:02:04.0: Disabling memory decoding and releasing memory resources
[    0.076186] pci 0035:02:04.0: disabling bridge mem windows
[    0.076417] pci 0035:02:04.0: PME# supported from D0 D3hot D3cold
[    0.076504] pci 0035:02:05.0: [10b5:8725] type 01 class 0x060400
[    0.076659] pci 0035:02:05.0: Disabling memory decoding and releasing memory resources
[    0.076712] pci 0035:02:05.0: disabling bridge mem windows
[    0.076905] pci 0035:02:05.0: PME# supported from D0 D3hot D3cold
[    0.076993] pci 0035:02:0d.0: [10b5:8725] type 01 class 0x060400
[    0.077135] pci 0035:02:0d.0: Disabling memory decoding and releasing memory resources
[    0.077189] pci 0035:02:0d.0: disabling bridge mem windows
[    0.077395] pci 0035:02:0d.0: PME# supported from D0 D3hot D3cold
[    0.077457] pci 0035:01:00.0: PCI bridge to [bus 02-09]
[    0.078607] pci 0035:03:00.0: [10de:1db1] type 00 class 0x030200
[    0.078686] pci 0035:03:00.0: reg 0x10: [mem 0x00000000-0x00ffffff]
[    0.078711] pci 0035:03:00.0: reg 0x14: [mem 0x00000000-0x3ffffffff 64bit pref]
[    0.078735] pci 0035:03:00.0: reg 0x1c: [mem 0x00000000-0x01ffffff 64bit pref]
[    0.078781] pci 0035:03:00.0: Disabling memory decoding and releasing memory resources
[    0.079066] pci 0035:02:04.0: PCI bridge to [bus 03]
[    0.079255] pci 0035:04:00.0: [10de:1db1] type 00 class 0x030200
[    0.079335] pci 0035:04:00.0: reg 0x10: [mem 0x00000000-0x00ffffff]
[    0.079386] pci 0035:04:00.0: reg 0x14: [mem 0x00000000-0x3ffffffff 64bit pref]
[    0.079410] pci 0035:04:00.0: reg 0x1c: [mem 0x00000000-0x01ffffff 64bit pref]
[    0.079457] pci 0035:04:00.0: Disabling memory decoding and releasing memory resources
[    0.079749] pci 0035:02:05.0: PCI bridge to [bus 04]
[    0.079906] pci 0035:02:0d.0: PCI bridge to [bus 05-09]
[    0.080020] pci_bus 0035:00: busn_res: [bus 00-ff] end is updated to 09
[    0.080050] PCI host bridge to bus 0006:00
[    0.080077] pci_bus 0006:00: root bus resource [mem 0x6030201600000-0x603020171ffff]
[    0.080127] pci_bus 0006:00: root bus resource [bus 00-ff]
[    0.080161] pci_bus 0006:00: busn_res: [bus 00-ff] end is updated to ff
[    0.080177] pci 0006:00:00.0: [1014:04ea] type 00 class 0x068001
[    0.080243] pci 0006:00:00.0: reg 0x10: [mem 0x6030201600000-0x603020161ffff 64bit]
[    0.080263] pci 0006:00:00.0: reg 0x18: [mem 0x60302016c0000-0x60302016cffff 64bit]
[    0.080288] pci 0006:00:00.0: Disabling memory decoding and releasing memory resources
[    0.080427] pci 0006:00:00.1: [1014:04ea] type 00 class 0x068001
[    0.080491] pci 0006:00:00.1: reg 0x10: [mem 0x6030201620000-0x603020163ffff 64bit]
[    0.080511] pci 0006:00:00.1: reg 0x18: [mem 0x60302016e0000-0x60302016effff 64bit]
[    0.080536] pci 0006:00:00.1: Disabling memory decoding and releasing memory resources
[    0.080674] pci 0006:00:00.2: [1014:04ea] type 00 class 0x068001
[    0.080725] pci 0006:00:00.2: reg 0x10: [mem 0x6030201640000-0x603020165ffff 64bit]
[    0.080744] pci 0006:00:00.2: reg 0x18: [mem 0x60302016e0000-0x60302016effff 64bit]
[    0.080770] pci 0006:00:00.2: Disabling memory decoding and releasing memory resources
[    0.080937] pci 0006:00:01.0: [1014:04ea] type 00 class 0x068001
[    0.080988] pci 0006:00:01.0: reg 0x10: [mem 0x6030201660000-0x603020167ffff 64bit]
[    0.081008] pci 0006:00:01.0: reg 0x18: [mem 0x6030201700000-0x603020170ffff 64bit]
[    0.081033] pci 0006:00:01.0: Disabling memory decoding and releasing memory resources
[    0.081199] pci 0006:00:01.1: [1014:04ea] type 00 class 0x068001
[    0.081250] pci 0006:00:01.1: reg 0x10: [mem 0x6030201680000-0x603020169ffff 64bit]
[    0.081270] pci 0006:00:01.1: reg 0x18: [mem 0x6030201700000-0x603020170ffff 64bit]
[    0.081296] pci 0006:00:01.1: Disabling memory decoding and releasing memory resources
[    0.082499] pci 0006:00:01.2: [1014:04ea] type 00 class 0x068001
[    0.082550] pci 0006:00:01.2: reg 0x10: [mem 0x60302016a0000-0x60302016bffff 64bit]
[    0.082570] pci 0006:00:01.2: reg 0x18: [mem 0x6030201720000-0x603020172ffff 64bit]
[    0.082596] pci 0006:00:01.2: Disabling memory decoding and releasing memory resources
[    0.083212] pci_bus 0006:00: busn_res: [bus 00-ff] end is updated to 00
[    0.083242] PCI host bridge to bus 0007:00
[    0.083287] pci_bus 0007:00: root bus resource [mem 0x6230201600000-0x623020171ffff]
[    0.084023] pci_bus 0007:00: root bus resource [bus 00-ff]
[    0.084111] pci_bus 0007:00: busn_res: [bus 00-ff] end is updated to ff
[    0.084141] pci 0007:00:00.0: [1014:04ea] type 00 class 0x068001
[    0.084196] pci 0007:00:00.0: reg 0x10: [mem 0x6230201600000-0x623020161ffff 64bit]
[    0.084217] pci 0007:00:00.0: reg 0x18: [mem 0x62302016c0000-0x62302016cffff 64bit]
[    0.084242] pci 0007:00:00.0: Disabling memory decoding and releasing memory resources
[    0.084488] pci 0007:00:00.1: [1014:04ea] type 00 class 0x068001
[    0.084544] pci 0007:00:00.1: reg 0x10: [mem 0x6230201620000-0x623020163ffff 64bit]
[    0.084564] pci 0007:00:00.1: reg 0x18: [mem 0x62302016e0000-0x62302016effff 64bit]
[    0.084589] pci 0007:00:00.1: Disabling memory decoding and releasing memory resources
[    0.085375] pci 0007:00:00.2: [1014:04ea] type 00 class 0x068001
[    0.085432] pci 0007:00:00.2: reg 0x10: [mem 0x6230201640000-0x623020165ffff 64bit]
[    0.085454] pci 0007:00:00.2: reg 0x18: [mem 0x62302016e0000-0x62302016effff 64bit]
[    0.085479] pci 0007:00:00.2: Disabling memory decoding and releasing memory resources
[    0.085860] pci 0007:00:01.0: [1014:04ea] type 00 class 0x068001
[    0.085916] pci 0007:00:01.0: reg 0x10: [mem 0x6230201660000-0x623020167ffff 64bit]
[    0.085937] pci 0007:00:01.0: reg 0x18: [mem 0x6230201700000-0x623020170ffff 64bit]
[    0.085962] pci 0007:00:01.0: Disabling memory decoding and releasing memory resources
[    0.086156] pci 0007:00:01.1: [1014:04ea] type 00 class 0x068001
[    0.086212] pci 0007:00:01.1: reg 0x10: [mem 0x6230201680000-0x623020169ffff 64bit]
[    0.086234] pci 0007:00:01.1: reg 0x18: [mem 0x6230201700000-0x623020170ffff 64bit]
[    0.086260] pci 0007:00:01.1: Disabling memory decoding and releasing memory resources
[    0.086805] pci 0007:00:01.2: [1014:04ea] type 00 class 0x068001
[    0.086861] pci 0007:00:01.2: reg 0x10: [mem 0x62302016a0000-0x62302016bffff 64bit]
[    0.086883] pci 0007:00:01.2: reg 0x18: [mem 0x6230201720000-0x623020172ffff 64bit]
[    0.086909] pci 0007:00:01.2: Disabling memory decoding and releasing memory resources
[    0.088107] pci_bus 0007:00: busn_res: [bus 00-ff] end is updated to 00
[    0.088137] pci 0000:00     : [PE# 1fe] Secondary bus 0 associated with PE#1fe
[    0.088769] pci 0000:00:00.0: PCI bridge to [bus 01]
[    0.089018] pci_bus 0000:00: resource 4 [mem 0x600c000000000-0x600c07ffeffff]
[    0.089020] pci_bus 0000:00: resource 5 [mem 0x6000000000000-0x6003fbfffffff 64bit pref]
[    0.089041] pci 0001:00:00.0: BAR 8: assigned [mem 0x600c080000000-0x600c0807fffff]
[    0.089308] pci 0001:01:00.0: BAR 0: assigned [mem 0x600c080000000-0x600c08000ffff 64bit]
[    0.089966] pci 0001:01:00.0: BAR 2: assigned [mem 0x600c080010000-0x600c080011fff 64bit]
[    0.090696] pci 0001:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.091238] pci 0001:01     : [PE# fd] Secondary bus 1 associated with PE#fd
[    0.091798] pci 0001:01     : [PE# fd] Setting up 32-bit TCE table at 0..80000000
[    0.097435] IOMMU table initialized, virtual merging enabled
[    0.097478] pci 0001:01     : [PE# fd] Setting up window#0 0..7fffffff pg=1000
[    0.097530] pci 0001:01     : [PE# fd] Enabling 64-bit DMA bypass
[    0.097572] pci 0001:00:00.0: PCI bridge to [bus 01]
[    0.097610] pci 0001:00:00.0:   bridge window [mem 0x600c080000000-0x600c0ffefffff]
[    0.097668] pci_bus 0001:00: resource 4 [mem 0x600c080000000-0x600c0fffeffff]
[    0.097671] pci_bus 0001:00: resource 5 [mem 0x6004000000000-0x6007f7fffffff 64bit pref]
[    0.097673] pci_bus 0001:01: resource 1 [mem 0x600c080000000-0x600c0ffefffff]
[    0.097705] pci 0002:00:00.0: BAR 8: assigned [mem 0x600c100000000-0x600c1017fffff]
[    0.097776] pci 0002:01:00.0: BAR 8: assigned [mem 0x600c100000000-0x600c1017fffff]
[    0.098520] pci 0002:01:00.0: BAR 7: no space for [io  size 0x1000]
[    0.098958] pci 0002:01:00.0: BAR 7: failed to assign [io  size 0x1000]
[    0.099595] pci 0002:02:00.0: BAR 0: assigned [mem 0x600c100000000-0x600c100ffffff]
[    0.100077] pci 0002:02:00.0: BAR 1: assigned [mem 0x600c101000000-0x600c10101ffff]
[    0.100254] pci 0002:02:00.0: BAR 2: no space for [io  size 0x0080]
[    0.100343] pci 0002:02:00.0: BAR 2: failed to assign [io  size 0x0080]
[    0.100445] pci 0002:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.100776] pci 0002:02     : [PE# fd] Secondary bus 2..2 associated with PE#fd
[    0.101069] pci 0002:02     : [PE# fd] Setting up 32-bit TCE table at 0..80000000
[    0.109163] pci 0002:02     : [PE# fd] Setting up window#0 0..7fffffff pg=1000
[    0.109235] pci 0002:02     : [PE# fd] Enabling 64-bit DMA bypass
[    0.109298] pci 0002:01:00.0: PCI bridge to [bus 02]
[    0.109361] pci 0002:01:00.0:   bridge window [mem 0x600c100000000-0x600c17fefffff]
[    0.109485] pci 0002:01     : [PE# fc] Secondary bus 1 associated with PE#fc
[    0.109809] pci 0002:00:00.0: PCI bridge to [bus 01-02]
[    0.109859] pci 0002:00:00.0:   bridge window [mem 0x600c100000000-0x600c17fefffff]
[    0.109983] pci_bus 0002:00: Some PCI device resources are unassigned, try booting with pci=realloc
[    0.110107] pci_bus 0002:00: resource 4 [mem 0x600c100000000-0x600c17ffeffff]
[    0.110110] pci_bus 0002:00: resource 5 [mem 0x6008000000000-0x600bf7fffffff 64bit pref]
[    0.110112] pci_bus 0002:01: resource 1 [mem 0x600c100000000-0x600c17fefffff]
[    0.110128] pci_bus 0002:02: resource 1 [mem 0x600c100000000-0x600c17fefffff]
[    0.110174] pci 0003:00:00.0: BAR 9: assigned [mem 0x6020000000000-0x602003fffffff 64bit pref]
[    0.110302] pci 0003:01:00.0: BAR 0: assigned [mem 0x6020000000000-0x602001fffffff 64bit pref]
[    0.110490] pci 0003:01:00.1: BAR 0: assigned [mem 0x6020020000000-0x602003fffffff 64bit pref]
[    0.110677] pci 0003:00     : [PE# 1fe] Secondary bus 0 associated with PE#1fe
[    0.110961] pci 0003:01     : [PE# 00] Secondary bus 1 associated with PE#0
[    0.111238] pci 0003:01     : [PE# 00] Setting up 32-bit TCE table at 0..80000000
[    0.116189] pci 0003:01     : [PE# 00] Setting up window#0 0..7fffffff pg=1000
[    0.116258] pci 0003:01     : [PE# 00] Enabling 64-bit DMA bypass
[    0.116311] pci 0003:00:00.0: PCI bridge to [bus 01]
[    0.116378] pci 0003:00:00.0:   bridge window [mem 0x6020000000000-0x6023fbfffffff 64bit pref]
[    0.116501] pci_bus 0003:00: resource 4 [mem 0x600c180000000-0x600c1fffeffff]
[    0.116517] pci_bus 0003:00: resource 5 [mem 0x6020000000000-0x6023fbfffffff 64bit pref]
[    0.116520] pci_bus 0003:01: resource 2 [mem 0x6020000000000-0x6023fbfffffff 64bit pref]
[    0.116709] pci 0004:00:00.0: BAR 9: assigned [mem 0x6024000000000-0x6024cffffffff 64bit pref]
[    0.116825] pci 0004:00:00.0: BAR 8: assigned [mem 0x600c200000000-0x600c202ffffff]
[    0.116926] pci 0004:01:00.0: BAR 9: assigned [mem 0x6024000000000-0x6024cffffffff 64bit pref]
[    0.117013] pci 0004:01:00.0: BAR 8: assigned [mem 0x600c200000000-0x600c2027fffff]
[    0.117102] pci 0004:01:00.0: BAR 0: assigned [mem 0x600c202800000-0x600c20283ffff]
[    0.117234] pci 0004:01:00.1: BAR 0: assigned [mem 0x600c202840000-0x600c202841fff]
[    0.117367] pci 0004:01:00.2: BAR 0: assigned [mem 0x600c202850000-0x600c202851fff]
[    0.117478] pci 0004:01:00.3: BAR 0: assigned [mem 0x600c202860000-0x600c202861fff]
[    0.117583] pci 0004:01:00.4: BAR 0: assigned [mem 0x600c202870000-0x600c202871fff]
[    0.117690] pci 0004:01:00.0: BAR 7: no space for [io  size 0x1000]
[    0.117746] pci 0004:01:00.0: BAR 7: failed to assign [io  size 0x1000]
[    0.117836] pci 0004:01:00.0: BAR 7: no space for [io  size 0x1000]
[    0.117938] pci 0004:01:00.0: BAR 7: failed to assign [io  size 0x1000]
[    0.118031] pci 0004:02:0a.0: BAR 9: assigned [mem 0x6024000000000-0x60245ffffffff 64bit pref]
[    0.118162] pci 0004:02:0b.0: BAR 9: assigned [mem 0x6024600000000-0x6024bffffffff 64bit pref]
[    0.118264] pci 0004:02:02.0: BAR 9: assigned [mem 0x6024c00000000-0x6024c3fffffff 64bit pref]
[    0.118395] pci 0004:02:0a.0: BAR 8: assigned [mem 0x600c200000000-0x600c200ffffff]
[    0.118494] pci 0004:02:0b.0: BAR 8: assigned [mem 0x600c201000000-0x600c201ffffff]
[    0.118595] pci 0004:02:02.0: BAR 8: assigned [mem 0x600c202000000-0x600c2027fffff]
[    0.118675] pci 0004:02:02.0: BAR 7: no space for [io  size 0x1000]
[    0.118778] pci 0004:02:02.0: BAR 7: failed to assign [io  size 0x1000]
[    0.118870] pci 0004:02:02.0: BAR 7: no space for [io  size 0x1000]
[    0.118959] pci 0004:02:02.0: BAR 7: failed to assign [io  size 0x1000]
[    0.119044] pci 0004:03:00.0: BAR 5: assigned [mem 0x600c202000000-0x600c2020007ff]
[    0.119157] pci 0004:03:00.0: BAR 6: assigned [mem 0x600c202010000-0x600c20201ffff pref]
[    0.119265] pci 0004:03:00.0: BAR 4: no space for [io  size 0x0020]
[    0.119350] pci 0004:03:00.0: BAR 4: failed to assign [io  size 0x0020]
[    0.119436] pci 0004:03:00.0: BAR 0: no space for [io  size 0x0008]
[    0.119523] pci 0004:03:00.0: BAR 0: failed to assign [io  size 0x0008]
[    0.119605] pci 0004:03:00.0: BAR 2: no space for [io  size 0x0008]
[    0.119687] pci 0004:03:00.0: BAR 2: failed to assign [io  size 0x0008]
[    0.119776] pci 0004:03:00.0: BAR 1: no space for [io  size 0x0004]
[    0.119866] pci 0004:03:00.0: BAR 1: failed to assign [io  size 0x0004]
[    0.119947] pci 0004:03:00.0: BAR 3: no space for [io  size 0x0004]
[    0.120038] pci 0004:03:00.0: BAR 3: failed to assign [io  size 0x0004]
[    0.120137] pci 0004:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.120429] pci 0004:03     : [PE# fd] Secondary bus 3 associated with PE#fd
[    0.120705] pci 0004:03     : [PE# fd] Setting up 32-bit TCE table at 0..80000000
[    0.125617] pci 0004:03     : [PE# fd] Setting up window#0 0..7fffffff pg=1000
[    0.125683] pci 0004:03     : [PE# fd] Enabling 64-bit DMA bypass
[    0.125754] pci 0004:02:02.0: PCI bridge to [bus 03]
[    0.125816] pci 0004:02:02.0:   bridge window [mem 0x600c202000000-0x600c2027fffff]
[    0.125907] pci 0004:02:02.0:   bridge window [mem 0x6024c00000000-0x6024c3fffffff 64bit pref]
[    0.126049] pci 0004:04:00.0: BAR 1: assigned [mem 0x6024000000000-0x60243ffffffff 64bit pref]
[    0.126223] pci 0004:04:00.0: BAR 3: assigned [mem 0x6024400000000-0x6024401ffffff 64bit pref]
[    0.126345] pci 0004:04:00.0: BAR 0: assigned [mem 0x600c200000000-0x600c200ffffff]
[    0.126526] pci 0004:04     : [PE# 00] Secondary bus 4 associated with PE#0
[    0.126958] pci 0004:04     : [PE# 00] Setting up 32-bit TCE table at 0..80000000
[    0.131858] pci 0004:04     : [PE# 00] Setting up window#0 0..7fffffff pg=1000
[    0.131931] pci 0004:04     : [PE# 00] Enabling 64-bit DMA bypass
[    0.132002] pci 0004:02:0a.0: PCI bridge to [bus 04]
[    0.132062] pci 0004:02:0a.0:   bridge window [mem 0x600c200000000-0x600c200ffffff]
[    0.132157] pci 0004:02:0a.0:   bridge window [mem 0x6024000000000-0x60245ffffffff 64bit pref]
[    0.132290] pci 0004:05:00.0: BAR 1: assigned [mem 0x6024800000000-0x6024bffffffff 64bit pref]
[    0.132425] pci 0004:05:00.0: BAR 3: assigned [mem 0x6024600000000-0x6024601ffffff 64bit pref]
[    0.132594] pci 0004:05:00.0: BAR 0: assigned [mem 0x600c201000000-0x600c201ffffff]
[    0.132766] pci 0004:05     : [PE# 18] Secondary bus 5 associated with PE#18
[    0.133211] pci 0004:05     : [PE# 18] Setting up 32-bit TCE table at 0..80000000
[    0.138115] pci 0004:05     : [PE# 18] Setting up window#0 0..7fffffff pg=1000
[    0.138187] pci 0004:05     : [PE# 18] Enabling 64-bit DMA bypass
[    0.138278] pci 0004:02:0b.0: PCI bridge to [bus 05]
[    0.138378] pci 0004:02:0b.0:   bridge window [mem 0x600c201000000-0x600c201ffffff]
[    0.138487] pci 0004:02:0b.0:   bridge window [mem 0x6024600000000-0x6024bffffffff 64bit pref]
[    0.138610] pci 0004:02:0c.0: PCI bridge to [bus 06-0a]
[    0.138700] pci 0004:02     : [PE# fc] Secondary bus 2 associated with PE#fc
[    0.138991] pci 0004:01:00.0: PCI bridge to [bus 02-0a]
[    0.139065] pci 0004:01:00.0:   bridge window [mem 0x600c200000000-0x600c27fefffff]
[    0.139177] pci 0004:01:00.0:   bridge window [mem 0x6024000000000-0x6027f7ff0ffff 64bit pref]
[    0.139293] pci 0004:01     : [PE# fb] Secondary bus 1 associated with PE#fb
[    0.139609] pci 0004:01     : [PE# fb] Setting up 32-bit TCE table at 0..80000000
[    0.144496] pci 0004:01     : [PE# fb] Setting up window#0 0..7fffffff pg=1000
[    0.144564] pci 0004:01     : [PE# fb] Enabling 64-bit DMA bypass
[    0.144627] pci 0004:00:00.0: PCI bridge to [bus 01-0a]
[    0.144690] pci 0004:00:00.0:   bridge window [mem 0x600c200000000-0x600c27fefffff]
[    0.144798] pci 0004:00:00.0:   bridge window [mem 0x6024000000000-0x6027f7ff0ffff 64bit pref]
[    0.144927] pci_bus 0004:00: Some PCI device resources are unassigned, try booting with pci=realloc
[    0.145061] pci_bus 0004:00: resource 4 [mem 0x600c200000000-0x600c27ffeffff]
[    0.145064] pci_bus 0004:00: resource 5 [mem 0x6024000000000-0x6027f7fffffff 64bit pref]
[    0.145067] pci_bus 0004:01: resource 1 [mem 0x600c200000000-0x600c27fefffff]
[    0.145083] pci_bus 0004:01: resource 2 [mem 0x6024000000000-0x6027f7ff0ffff 64bit pref]
[    0.145085] pci_bus 0004:02: resource 1 [mem 0x600c200000000-0x600c27fefffff]
[    0.145088] pci_bus 0004:02: resource 2 [mem 0x6024000000000-0x6027f7ff0ffff 64bit pref]
[    0.145104] pci_bus 0004:03: resource 1 [mem 0x600c202000000-0x600c2027fffff]
[    0.145106] pci_bus 0004:03: resource 2 [mem 0x6024c00000000-0x6024c3fffffff 64bit pref]
[    0.145109] pci_bus 0004:04: resource 1 [mem 0x600c200000000-0x600c200ffffff]
[    0.145112] pci_bus 0004:04: resource 2 [mem 0x6024000000000-0x60245ffffffff 64bit pref]
[    0.145114] pci_bus 0004:05: resource 1 [mem 0x600c201000000-0x600c201ffffff]
[    0.145117] pci_bus 0004:05: resource 2 [mem 0x6024600000000-0x6024bffffffff 64bit pref]
[    0.145153] pci 0005:00:00.0: BAR 9: assigned [mem 0x6028000000000-0x602803fffffff 64bit pref]
[    0.145291] pci 0005:01:00.0: BAR 0: assigned [mem 0x6028000000000-0x602800000ffff 64bit pref]
[    0.145431] pci 0005:01:00.0: BAR 2: assigned [mem 0x6028000010000-0x602800001ffff 64bit pref]
[    0.145564] pci 0005:01:00.0: BAR 4: assigned [mem 0x6028000020000-0x602800002ffff 64bit pref]
[    0.145694] pci 0005:01:00.1: BAR 0: assigned [mem 0x6028000030000-0x602800003ffff 64bit pref]
[    0.145821] pci 0005:01:00.1: BAR 2: assigned [mem 0x6028000040000-0x602800004ffff 64bit pref]
[    0.145957] pci 0005:01:00.1: BAR 4: assigned [mem 0x6028000050000-0x602800005ffff 64bit pref]
[    0.146083] pci 0005:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.146390] pci 0005:01     : [PE# 00] Secondary bus 1 associated with PE#0
[    0.146667] pci 0005:01     : [PE# 00] Setting up 32-bit TCE table at 0..80000000
[    0.151546] pci 0005:01     : [PE# 00] Setting up window#0 0..7fffffff pg=1000
[    0.151625] pci 0005:01     : [PE# 00] Enabling 64-bit DMA bypass
[    0.151696] pci 0005:00:00.0: PCI bridge to [bus 01]
[    0.151791] pci 0005:00:00.0:   bridge window [mem 0x6028000000000-0x602bf7fffffff 64bit pref]
[    0.151934] pci_bus 0005:00: resource 4 [mem 0x600c280000000-0x600c2fffeffff]
[    0.151937] pci_bus 0005:00: resource 5 [mem 0x6028000000000-0x602bf7fffffff 64bit pref]
[    0.151953] pci_bus 0005:01: resource 2 [mem 0x6028000000000-0x602bf7fffffff 64bit pref]
[    0.151988] pci 0030:00:00.0: BAR 8: assigned [mem 0x620c000000000-0x620c0003fffff]
[    0.152087] pci 0030:01:00.0: BAR 6: assigned [mem 0x620c000000000-0x620c00001ffff pref]
[    0.152193] pci 0030:01:00.0: BAR 0: assigned [mem 0x620c000020000-0x620c000023fff 64bit]
[    0.152319] pci 0030:00     : [PE# 1fe] Secondary bus 0 associated with PE#1fe
[    0.152633] pci 0030:01     : [PE# 1fd] Secondary bus 1 associated with PE#1fd
[    0.152932] pci 0030:01     : [PE# 1fd] Setting up 32-bit TCE table at 0..80000000
[    0.157851] pci 0030:01     : [PE# 1fd] Setting up window#0 0..7fffffff pg=1000
[    0.157990] pci 0030:01     : [PE# 1fd] Enabling 64-bit DMA bypass
[    0.158074] pci 0030:00:00.0: PCI bridge to [bus 01]
[    0.158174] pci 0030:00:00.0:   bridge window [mem 0x620c000000000-0x620c07fefffff]
[    0.158289] pci_bus 0030:00: resource 4 [mem 0x620c000000000-0x620c07ffeffff]
[    0.158291] pci_bus 0030:00: resource 5 [mem 0x6200000000000-0x6203fbfffffff 64bit pref]
[    0.158294] pci_bus 0030:01: resource 1 [mem 0x620c000000000-0x620c07fefffff]
[    0.158319] pci 0033:00:00.0: BAR 9: assigned [mem 0x6220000000000-0x622003fffffff 64bit pref]
[    0.158416] pci 0033:01:00.0: BAR 0: assigned [mem 0x6220000000000-0x622001fffffff 64bit pref]
[    0.158648] pci 0033:01:00.1: BAR 0: assigned [mem 0x6220020000000-0x622003fffffff 64bit pref]
[    0.158838] pci 0033:00     : [PE# 1fe] Secondary bus 0 associated with PE#1fe
[    0.159146] pci 0033:01     : [PE# 00] Secondary bus 1 associated with PE#0
[    0.159436] pci 0033:01     : [PE# 00] Setting up 32-bit TCE table at 0..80000000
[    0.164338] pci 0033:01     : [PE# 00] Setting up window#0 0..7fffffff pg=1000
[    0.164410] pci 0033:01     : [PE# 00] Enabling 64-bit DMA bypass
[    0.164482] pci 0033:00:00.0: PCI bridge to [bus 01]
[    0.164563] pci 0033:00:00.0:   bridge window [mem 0x6220000000000-0x6223fbfffffff 64bit pref]
[    0.164707] pci_bus 0033:00: resource 4 [mem 0x620c180000000-0x620c1fffeffff]
[    0.164710] pci_bus 0033:00: resource 5 [mem 0x6220000000000-0x6223fbfffffff 64bit pref]
[    0.164713] pci_bus 0033:01: resource 2 [mem 0x6220000000000-0x6223fbfffffff 64bit pref]
[    0.164765] pci 0034:00:00.0: BAR 9: assigned [mem 0x6224000000000-0x622403fffffff 64bit pref]
[    0.164893] pci 0034:00:00.0: BAR 8: assigned [mem 0x620c200000000-0x620c2007fffff]
[    0.165003] pci 0034:01:00.0: BAR 6: assigned [mem 0x620c200000000-0x620c20007ffff pref]
[    0.165094] pci 0034:01:00.1: BAR 6: assigned [mem 0x620c200080000-0x620c2000fffff pref]
[    0.165219] pci 0034:01:00.2: BAR 6: assigned [mem 0x620c200100000-0x620c20017ffff pref]
[    0.165321] pci 0034:01:00.3: BAR 6: assigned [mem 0x620c200180000-0x620c2001fffff pref]
[    0.165398] pci 0034:01:00.0: BAR 0: assigned [mem 0x6224000000000-0x622400000ffff 64bit pref]
[    0.165544] pci 0034:01:00.0: BAR 2: assigned [mem 0x6224000010000-0x622400001ffff 64bit pref]
[    0.165692] pci 0034:01:00.0: BAR 4: assigned [mem 0x6224000020000-0x622400002ffff 64bit pref]
[    0.165843] pci 0034:01:00.1: BAR 0: assigned [mem 0x6224000030000-0x622400003ffff 64bit pref]
[    0.165977] pci 0034:01:00.1: BAR 2: assigned [mem 0x6224000040000-0x622400004ffff 64bit pref]
[    0.166121] pci 0034:01:00.1: BAR 4: assigned [mem 0x6224000050000-0x622400005ffff 64bit pref]
[    0.166256] pci 0034:01:00.2: BAR 0: assigned [mem 0x6224000060000-0x622400006ffff 64bit pref]
[    0.166395] pci 0034:01:00.2: BAR 2: assigned [mem 0x6224000070000-0x622400007ffff 64bit pref]
[    0.166527] pci 0034:01:00.2: BAR 4: assigned [mem 0x6224000080000-0x622400008ffff 64bit pref]
[    0.166665] pci 0034:01:00.3: BAR 0: assigned [mem 0x6224000090000-0x622400009ffff 64bit pref]
[    0.166810] pci 0034:01:00.3: BAR 2: assigned [mem 0x62240000a0000-0x62240000affff 64bit pref]
[    0.166948] pci 0034:01:00.3: BAR 4: assigned [mem 0x62240000b0000-0x62240000bffff 64bit pref]
[    0.167084] pci 0034:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.167417] pci 0034:01     : [PE# 00] Secondary bus 1 associated with PE#0
[    0.167708] pci 0034:01     : [PE# 00] Setting up 32-bit TCE table at 0..80000000
[    0.172575] pci 0034:01     : [PE# 00] Setting up window#0 0..7fffffff pg=1000
[    0.172676] pci 0034:01     : [PE# 00] Enabling 64-bit DMA bypass
[    0.172756] pci 0034:00:00.0: PCI bridge to [bus 01]
[    0.172836] pci 0034:00:00.0:   bridge window [mem 0x620c200000000-0x620c27fefffff]
[    0.172954] pci 0034:00:00.0:   bridge window [mem 0x6224000000000-0x6227f7ff0ffff 64bit pref]
[    0.173071] pci_bus 0034:00: resource 4 [mem 0x620c200000000-0x620c27ffeffff]
[    0.173074] pci_bus 0034:00: resource 5 [mem 0x6224000000000-0x6227f7fffffff 64bit pref]
[    0.173077] pci_bus 0034:01: resource 1 [mem 0x620c200000000-0x620c27fefffff]
[    0.173079] pci_bus 0034:01: resource 2 [mem 0x6224000000000-0x6227f7ff0ffff 64bit pref]
[    0.173165] pci 0035:00:00.0: BAR 9: assigned [mem 0x6228000000000-0x6228bffffffff 64bit pref]
[    0.173276] pci 0035:00:00.0: BAR 8: assigned [mem 0x620c280000000-0x620c2827fffff]
[    0.173376] pci 0035:01:00.0: BAR 9: assigned [mem 0x6228000000000-0x6228bffffffff 64bit pref]
[    0.173489] pci 0035:01:00.0: BAR 8: assigned [mem 0x620c280000000-0x620c281ffffff]
[    0.173597] pci 0035:01:00.0: BAR 0: assigned [mem 0x620c282000000-0x620c28203ffff]
[    0.173700] pci 0035:02:04.0: BAR 9: assigned [mem 0x6228000000000-0x62285ffffffff 64bit pref]
[    0.173811] pci 0035:02:05.0: BAR 9: assigned [mem 0x6228600000000-0x6228bffffffff 64bit pref]
[    0.173927] pci 0035:02:04.0: BAR 8: assigned [mem 0x620c280000000-0x620c280ffffff]
[    0.174030] pci 0035:02:05.0: BAR 8: assigned [mem 0x620c281000000-0x620c281ffffff]
[    0.174128] pci 0035:03:00.0: BAR 1: assigned [mem 0x6228000000000-0x62283ffffffff 64bit pref]
[    0.174263] pci 0035:03:00.0: BAR 3: assigned [mem 0x6228400000000-0x6228401ffffff 64bit pref]
[    0.174391] pci 0035:03:00.0: BAR 0: assigned [mem 0x620c280000000-0x620c280ffffff]
[    0.174494] pci 0035:00     : [PE# fe] Secondary bus 0 associated with PE#fe
[    0.174830] pci 0035:03     : [PE# 00] Secondary bus 3 associated with PE#0
[    0.175283] pci 0035:03     : [PE# 00] Setting up 32-bit TCE table at 0..80000000
[    0.180148] pci 0035:03     : [PE# 00] Setting up window#0 0..7fffffff pg=1000
[    0.180219] pci 0035:03     : [PE# 00] Enabling 64-bit DMA bypass
[    0.180294] pci 0035:02:04.0: PCI bridge to [bus 03]
[    0.180347] pci 0035:02:04.0:   bridge window [mem 0x620c280000000-0x620c280ffffff]
[    0.180442] pci 0035:02:04.0:   bridge window [mem 0x6228000000000-0x62285ffffffff 64bit pref]
[    0.180598] pci 0035:04:00.0: BAR 1: assigned [mem 0x6228800000000-0x6228bffffffff 64bit pref]
[    0.180743] pci 0035:04:00.0: BAR 3: assigned [mem 0x6228600000000-0x6228601ffffff 64bit pref]
[    0.180909] pci 0035:04:00.0: BAR 0: assigned [mem 0x620c281000000-0x620c281ffffff]
[    0.181087] pci 0035:04     : [PE# 18] Secondary bus 4 associated with PE#18
[    0.181553] pci 0035:04     : [PE# 18] Setting up 32-bit TCE table at 0..80000000
[    0.186432] pci 0035:04     : [PE# 18] Setting up window#0 0..7fffffff pg=1000
[    0.186502] pci 0035:04     : [PE# 18] Enabling 64-bit DMA bypass
[    0.186569] pci 0035:02:05.0: PCI bridge to [bus 04]
[    0.186651] pci 0035:02:05.0:   bridge window [mem 0x620c281000000-0x620c281ffffff]
[    0.186765] pci 0035:02:05.0:   bridge window [mem 0x6228600000000-0x6228bffffffff 64bit pref]
[    0.186909] pci 0035:02:0d.0: PCI bridge to [bus 05-09]
[    0.187032] pci 0035:02     : [PE# fd] Secondary bus 2 associated with PE#fd
[    0.187346] pci 0035:01:00.0: PCI bridge to [bus 02-09]
[    0.187426] pci 0035:01:00.0:   bridge window [mem 0x620c280000000-0x620c2ffefffff]
[    0.187535] pci 0035:01:00.0:   bridge window [mem 0x6228000000000-0x622bf7ff0ffff 64bit pref]
[    0.187664] pci 0035:01     : [PE# fc] Secondary bus 1 associated with PE#fc
[    0.187965] pci 0035:00:00.0: PCI bridge to [bus 01-09]
[    0.188020] pci 0035:00:00.0:   bridge window [mem 0x620c280000000-0x620c2ffefffff]
[    0.188133] pci 0035:00:00.0:   bridge window [mem 0x6228000000000-0x622bf7ff0ffff 64bit pref]
[    0.188275] pci_bus 0035:00: resource 4 [mem 0x620c280000000-0x620c2fffeffff]
[    0.188277] pci_bus 0035:00: resource 5 [mem 0x6228000000000-0x622bf7fffffff 64bit pref]
[    0.188280] pci_bus 0035:01: resource 1 [mem 0x620c280000000-0x620c2ffefffff]
[    0.188283] pci_bus 0035:01: resource 2 [mem 0x6228000000000-0x622bf7ff0ffff 64bit pref]
[    0.188286] pci_bus 0035:02: resource 1 [mem 0x620c280000000-0x620c2ffefffff]
[    0.188288] pci_bus 0035:02: resource 2 [mem 0x6228000000000-0x622bf7ff0ffff 64bit pref]
[    0.188291] pci_bus 0035:03: resource 1 [mem 0x620c280000000-0x620c280ffffff]
[    0.188294] pci_bus 0035:03: resource 2 [mem 0x6228000000000-0x62285ffffffff 64bit pref]
[    0.188296] pci_bus 0035:04: resource 1 [mem 0x620c281000000-0x620c281ffffff]
[    0.188299] pci_bus 0035:04: resource 2 [mem 0x6228600000000-0x6228bffffffff 64bit pref]
[    0.188306] pci 0006:00:00.0: BAR 0: assigned [mem 0x6030201600000-0x603020161ffff 64bit]
[    0.188459] pci 0006:00:00.1: BAR 0: assigned [mem 0x6030201620000-0x603020163ffff 64bit]
[    0.188613] pci 0006:00:00.2: BAR 0: assigned [mem 0x6030201640000-0x603020165ffff 64bit]
[    0.188767] pci 0006:00:01.0: BAR 0: assigned [mem 0x6030201660000-0x603020167ffff 64bit]
[    0.188907] pci 0006:00:01.1: BAR 0: assigned [mem 0x6030201680000-0x603020169ffff 64bit]
[    0.189056] pci 0006:00:01.2: BAR 0: assigned [mem 0x60302016a0000-0x60302016bffff 64bit]
[    0.189197] pci 0006:00:00.0: BAR 2: assigned [mem 0x60302016c0000-0x60302016cffff 64bit]
[    0.189349] pci 0006:00:00.1: BAR 2: assigned [mem 0x60302016d0000-0x60302016dffff 64bit]
[    0.189510] pci 0006:00:00.2: BAR 2: assigned [mem 0x60302016e0000-0x60302016effff 64bit]
[    0.189656] pci 0006:00:01.0: BAR 2: assigned [mem 0x60302016f0000-0x60302016fffff 64bit]
[    0.189804] pci 0006:00:01.1: BAR 2: assigned [mem 0x6030201700000-0x603020170ffff 64bit]
[    0.189949] pci 0006:00:01.2: BAR 2: assigned [mem 0x6030201710000-0x603020171ffff 64bit]
[    0.190105] pci_bus 0006:00: resource 4 [mem 0x6030201600000-0x603020171ffff]
[    0.190112] pci 0007:00:00.0: BAR 0: assigned [mem 0x6230201600000-0x623020161ffff 64bit]
[    0.190280] pci 0007:00:00.1: BAR 0: assigned [mem 0x6230201620000-0x623020163ffff 64bit]
[    0.190432] pci 0007:00:00.2: BAR 0: assigned [mem 0x6230201640000-0x623020165ffff 64bit]
[    0.190591] pci 0007:00:01.0: BAR 0: assigned [mem 0x6230201660000-0x623020167ffff 64bit]
[    0.190744] pci 0007:00:01.1: BAR 0: assigned [mem 0x6230201680000-0x623020169ffff 64bit]
[    0.190900] pci 0007:00:01.2: BAR 0: assigned [mem 0x62302016a0000-0x62302016bffff 64bit]
[    0.191057] pci 0007:00:00.0: BAR 2: assigned [mem 0x62302016c0000-0x62302016cffff 64bit]
[    0.191208] pci 0007:00:00.1: BAR 2: assigned [mem 0x62302016d0000-0x62302016dffff 64bit]
[    0.191360] pci 0007:00:00.2: BAR 2: assigned [mem 0x62302016e0000-0x62302016effff 64bit]
[    0.191514] pci 0007:00:01.0: BAR 2: assigned [mem 0x62302016f0000-0x62302016fffff 64bit]
[    0.191668] pci 0007:00:01.1: BAR 2: assigned [mem 0x6230201700000-0x623020170ffff 64bit]
[    0.191826] pci 0007:00:01.2: BAR 2: assigned [mem 0x6230201710000-0x623020171ffff 64bit]
[    0.191982] pci_bus 0007:00: resource 4 [mem 0x6230201600000-0x623020171ffff]
[    0.192162] pci 0006:00:00.0: [PE# 0d] Associated device to PE
[    0.192298] pci 0006:00:00.1: Associating to existing PE d
[    0.192421] pci 0006:00:00.2: Associating to existing PE d
[    0.192550] pci 0006:00:01.0: [PE# 0c] Associated device to PE
[    0.192686] pci 0006:00:01.1: Associating to existing PE c
[    0.192814] pci 0006:00:01.2: Associating to existing PE c
[    0.193252] NPU6: Found 1 MMIO ATSD registers
[    0.193292] pci 0007:00:00.0: [PE# 0d] Associated device to PE
[    0.193517] pci 0007:00:00.1: Associating to existing PE d
[    0.193653] pci 0007:00:00.2: Associating to existing PE d
[    0.193799] pci 0007:00:01.0: [PE# 0c] Associated device to PE
[    0.193945] pci 0007:00:01.1: Associating to existing PE c
[    0.194090] pci 0007:00:01.2: Associating to existing PE c
[    0.194593] NPU7: Found 1 MMIO ATSD registers
[    0.201386] PCI: Probing PCI hardware done
[    0.205238] cpuidle-powernv: Default stop: psscr = 0x0000000000000330,mask=0x00000000003003ff
[    0.205312] cpuidle-powernv: Deepest stop: psscr = 0x0000000000300375,mask=0x00000000003003ff
[    0.205424] cpuidle-powernv: Requested Level (RL) value of first deep stop = 0x4
[    0.216170] pci 0002:02:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[    0.216291] pci 0002:02:00.0: vgaarb: bridge control possible
[    0.216356] pci 0002:02:00.0: vgaarb: setting as boot device (VGA legacy resources not available)
[    0.216451] vgaarb: loaded
[    0.216653] SCSI subsystem initialized
[    0.216725] libata version 3.00 loaded.
[    0.216777] usbcore: registered new interface driver usbfs
[    0.216854] usbcore: registered new interface driver hub
[    0.217004] usbcore: registered new device driver usb
[    0.217101] pps_core: LinuxPPS API ver. 1 registered
[    0.217167] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.217288] PTP clock support registered
[    0.217727] clocksource: Switched to clocksource timebase
[    0.220864] NET: Registered protocol family 2
[    0.221122] tcp_listen_portaddr_hash hash table entries: 65536 (order: 4, 1048576 bytes)
[    0.221672] TCP established hash table entries: 524288 (order: 6, 4194304 bytes)
[    0.223935] TCP bind hash table entries: 65536 (order: 4, 1048576 bytes)
[    0.224369] TCP: Hash tables configured (established 524288 bind 65536)
[    0.224683] UDP hash table entries: 65536 (order: 5, 2097152 bytes)
[    0.225437] UDP-Lite hash table entries: 65536 (order: 5, 2097152 bytes)
[    0.226683] NET: Registered protocol family 1
[    0.226769] pci 0001:00:00.0: enabling device (0105 -> 0107)
[    0.226860] pci 0001:01:00.0: enabling device (0140 -> 0142)
[    0.227168] PCI: CLS 0 bytes, default 128
[    2.349442] nest_capp0_imc performance monitor hardware support registered
[    2.349618] nest_capp1_imc performance monitor hardware support registered
[    2.350463] core_imc performance monitor hardware support registered
[    2.350616] nest_mba0_imc performance monitor hardware support registered
[    2.350761] nest_mba1_imc performance monitor hardware support registered
[    2.350911] nest_mba2_imc performance monitor hardware support registered
[    2.351042] nest_mba3_imc performance monitor hardware support registered
[    2.351192] nest_mba4_imc performance monitor hardware support registered
[    2.351324] nest_mba5_imc performance monitor hardware support registered
[    2.351469] nest_mba6_imc performance monitor hardware support registered
[    2.351610] nest_mba7_imc performance monitor hardware support registered
[    2.351767] nest_mcs01_imc performance monitor hardware support registered
[    2.351927] nest_mcs23_imc performance monitor hardware support registered
[    2.352117] nest_nvlink0_imc performance monitor hardware support registered
[    2.352307] nest_nvlink1_imc performance monitor hardware support registered
[    2.352499] nest_nvlink2_imc performance monitor hardware support registered
[    2.352686] nest_nvlink3_imc performance monitor hardware support registered
[    2.352874] nest_nvlink4_imc performance monitor hardware support registered
[    2.353064] nest_nvlink5_imc performance monitor hardware support registered
[    2.353230] nest_nx_imc performance monitor hardware support registered
[    2.353374] nest_phb0_imc performance monitor hardware support registered
[    2.353529] nest_phb1_imc performance monitor hardware support registered
[    2.353666] nest_phb2_imc performance monitor hardware support registered
[    2.353805] nest_phb3_imc performance monitor hardware support registered
[    2.353952] nest_phb4_imc performance monitor hardware support registered
[    2.354097] nest_phb5_imc performance monitor hardware support registered
[    2.354269] nest_powerbus0_imc performance monitor hardware support registered
[    2.355131] thread_imc performance monitor hardware support registered
[    2.355297] nest_xlink0_imc performance monitor hardware support registered
[    2.355456] nest_xlink1_imc performance monitor hardware support registered
[    2.355616] nest_xlink2_imc performance monitor hardware support registered
[    2.359450] Initialise system trusted keyrings
[    2.362407] workingset: timestamp_bits=54 max_order=22 bucket_order=0
[    2.367332] Key type asymmetric registered
[    2.367380] Asymmetric key parser 'x509' registered
[    2.367641] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)
[    2.367734] io scheduler noop registered
[    2.368113] io scheduler cfq registered (default)
[    2.368187] io scheduler mq-deadline registered
[    2.368256] io scheduler kyber registered
[    2.368610] ipmi message handler version 39.2
[    2.368675] ipmi device interface
[    2.445577] ipmi-powernv ibm,opal:ipmi: Found new BMC (man_id: 0x00a741, prod_id: 0x424f, dev_id: 0x00)
[    2.656299] hvc0: raw protocol on /ibm,opal/consoles/serial@0 (boot console)
[    2.656373] hvc0: No interrupts property, using OPAL event
[    2.657307] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
[    2.657843] [drm] radeon kernel modesetting enabled.
[    2.661129] brd: module loaded
[    2.665625] loop: module loaded
[    2.665754] ahci 0004:03:00.0: version 3.0
[    2.665766] pci 0004:00:00.0: enabling device (0105 -> 0107)
[    2.665816] pci 0004:01:00.0: enabling device (0545 -> 0547)
[    2.665866] pci 0004:02:02.0: enabling device (0545 -> 0547)
[    2.665913] ahci 0004:03:00.0: enabling device (0141 -> 0143)
[    2.666065] ahci 0004:03:00.0: Using 64-bit DMA iommu bypass
[    2.676196] ahci 0004:03:00.0: AHCI 0001.0000 32 slots 4 ports 6 Gbps 0xf impl SATA mode
[    2.676255] ahci 0004:03:00.0: flags: 64bit ncq sntf led only pmp fbs pio slum part sxs 
[    2.676889] scsi host0: ahci
[    2.677198] scsi host1: ahci
[    2.677356] scsi host2: ahci
[    2.677486] scsi host3: ahci
[    2.677621] ata1: SATA max UDMA/133 abar m2048@0x600c202000000 port 0x600c202000100 irq 88
[    2.677671] ata2: SATA max UDMA/133 abar m2048@0x600c202000000 port 0x600c202000180 irq 88
[    2.677720] ata3: SATA max UDMA/133 abar m2048@0x600c202000000 port 0x600c202000200 irq 88
[    2.677770] ata4: SATA max UDMA/133 abar m2048@0x600c202000000 port 0x600c202000280 irq 88
[    2.678330] libphy: Fixed MDIO Bus: probed
[    2.678532] tg3.c:v3.137 (May 11, 2014)
[    2.678585] pci 0005:00:00.0: enabling device (0105 -> 0107)
[    2.678705] tg3 0005:01:00.0: enabling device (0140 -> 0142)
[    2.712810] tg3 0005:01:00.0: Using 64-bit DMA iommu bypass
[    2.713205] tg3 0005:01:00.0 eth0: Tigon3 [partno(BCM95719) rev 5719001] (PCI Express) MAC address 70:e2:84:14:2d:93
[    2.713319] tg3 0005:01:00.0 eth0: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    2.713414] tg3 0005:01:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    2.713495] tg3 0005:01:00.0 eth0: dma_rwctrl[00000000] dma_mask[64-bit]
[    2.713652] tg3 0005:01:00.1: enabling device (0140 -> 0142)
[    2.744303] tg3 0005:01:00.1: Using 64-bit DMA iommu bypass
[    2.744693] tg3 0005:01:00.1 eth1: Tigon3 [partno(BCM95719) rev 5719001] (PCI Express) MAC address 70:e2:84:14:2d:94
[    2.744792] tg3 0005:01:00.1 eth1: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    2.744913] tg3 0005:01:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    2.745027] tg3 0005:01:00.1 eth1: dma_rwctrl[00000000] dma_mask[64-bit]
[    2.745279] pci 0034:00:00.0: enabling device (0105 -> 0107)
[    2.745358] tg3 0034:01:00.0: enabling device (0140 -> 0142)
[    2.776643] tg3 0034:01:00.0: Using 64-bit DMA iommu bypass
[    2.777038] tg3 0034:01:00.0 eth2: Tigon3 [partno(00RX892) rev 5719001] (PCI Express) MAC address 98:be:94:06:6d:f4
[    2.777111] tg3 0034:01:00.0 eth2: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    2.777175] tg3 0034:01:00.0 eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] TSOcap[1]
[    2.777245] tg3 0034:01:00.0 eth2: dma_rwctrl[00000000] dma_mask[64-bit]
[    2.777389] tg3 0034:01:00.1: enabling device (0140 -> 0142)
[    2.816644] tg3 0034:01:00.1: Using 64-bit DMA iommu bypass
[    2.817037] tg3 0034:01:00.1 eth3: Tigon3 [partno(00RX892) rev 5719001] (PCI Express) MAC address 98:be:94:06:6d:f5
[    2.817133] tg3 0034:01:00.1 eth3: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    2.817295] tg3 0034:01:00.1 eth3: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] TSOcap[1]
[    2.817392] tg3 0034:01:00.1 eth3: dma_rwctrl[00000000] dma_mask[64-bit]
[    2.817627] tg3 0034:01:00.2: enabling device (0140 -> 0142)
[    2.856645] tg3 0034:01:00.2: Using 64-bit DMA iommu bypass
[    2.857047] tg3 0034:01:00.2 eth4: Tigon3 [partno(00RX892) rev 5719001] (PCI Express) MAC address 98:be:94:06:6d:f6
[    2.857120] tg3 0034:01:00.2 eth4: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    2.857185] tg3 0034:01:00.2 eth4: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] TSOcap[1]
[    2.857235] tg3 0034:01:00.2 eth4: dma_rwctrl[00000000] dma_mask[64-bit]
[    2.857421] tg3 0034:01:00.3: enabling device (0140 -> 0142)
[    2.896644] tg3 0034:01:00.3: Using 64-bit DMA iommu bypass
[    2.897035] tg3 0034:01:00.3 eth5: Tigon3 [partno(00RX892) rev 5719001] (PCI Express) MAC address 98:be:94:06:6d:f7
[    2.897128] tg3 0034:01:00.3 eth5: attached PHY is 5719C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    2.897271] tg3 0034:01:00.3 eth5: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] TSOcap[1]
[    2.897370] tg3 0034:01:00.3 eth5: dma_rwctrl[00000000] dma_mask[64-bit]
[    2.897813] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    2.897882] ehci-pci: EHCI PCI platform driver
[    2.897985] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    2.898077] ohci-pci: OHCI PCI platform driver
[    2.898232] xhci_hcd 0001:01:00.0: xHCI Host Controller
[    2.898376] xhci_hcd 0001:01:00.0: new USB bus registered, assigned bus number 1
[    2.898551] xhci_hcd 0001:01:00.0: Using 64-bit DMA iommu bypass
[    2.898684] xhci_hcd 0001:01:00.0: hcc params 0x0270f06d hci version 0x96 quirks 0x04000000
[    2.899082] hub 1-0:1.0: USB hub found
[    2.899148] hub 1-0:1.0: 4 ports detected
[    2.899365] xhci_hcd 0001:01:00.0: xHCI Host Controller
[    2.899489] xhci_hcd 0001:01:00.0: new USB bus registered, assigned bus number 2
[    2.899590] xhci_hcd 0001:01:00.0: Host supports USB 3.0  SuperSpeed
[    2.899714] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    2.899976] hub 2-0:1.0: USB hub found
[    2.900051] hub 2-0:1.0: 4 ports detected
[    2.900373] usbcore: registered new interface driver usb-storage
[    3.008975] ata4: SATA link down (SStatus 0 SControl 300)
[    3.009055] ata3: SATA link down (SStatus 0 SControl 300)
[    3.077587] rtc-opal opal-rtc: rtc core: registered rtc-opal as rtc0
[    3.077656] i2c /dev entries driver
[    3.080694] at24 0-0050: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[    3.081105] at24 1-0050: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[    3.081513] at24 2-0050: 65536 byte 24c512 EEPROM, writable, 1 bytes/write
[    3.083176] at24 3-0052: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.083457] at24 3-0053: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.083746] at24 3-0054: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.084033] at24 3-0055: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.084397] at24 4-0052: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.084686] at24 4-0053: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.084967] at24 4-0054: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.085256] at24 4-0055: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.095662] random: crng init done
[    3.110096] at24 5-0050: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[    3.110857] at24 6-0050: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[    3.122361] at24 7-0052: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.122648] at24 7-0053: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.122943] at24 7-0054: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.123246] at24 7-0055: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.123614] at24 8-0052: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.123903] at24 8-0053: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.124189] at24 8-0054: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.124480] at24 8-0055: 256 byte spd EEPROM, read-only, 0 bytes/write
[    3.129913] powernv-cpufreq: cpufreq pstate min 0x5a nominal 0x27 max 0x0
[    3.129988] powernv-cpufreq: Workload Optimized Frequency is enabled in the platform
[    3.137245] Failed to register cpuidle device for cpu0
[    3.137317] Registration of powernv driver failed.
[    3.137500] usbcore: registered new interface driver usbhid
[    3.137578] usbhid: USB HID core driver
[    3.137770] ipip: IPv4 and MPLS over IPv4 tunneling driver
[    3.138027] NET: Registered protocol family 17
[    3.138088] Key type dns_resolver registered
[    3.138211] drmem: No dynamic reconfiguration memory found
[    3.138799] registered taskstats version 1
[    3.138830] Loading compiled-in X.509 certificates
[    3.143191] Loaded X.509 cert 'Build time autogenerated kernel key: 0184231bf00aaadaa875a70f0c66cad323e0d567'
[    3.146135] Key type encrypted registered
[    3.146166] ima: No TPM chip found, activating TPM-bypass! (rc=-19)
[    3.146223] ima: Allocated hash algorithm: sha1
[    3.146340] evm: HMAC attrs: 0x1
[    3.177560] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    3.177636] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    3.197758] ata2.00: ATA-10: ST2000NX0253         00LY418 00LY417IBM, BE35, max UDMA/133
[    3.197822] ata2.00: 3907029168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
[    3.198607] ata2.00: configured for UDMA/133
[    3.211316] ata1.00: ATA-10: ST2000NX0253         00LY418 00LY417IBM, BE35, max UDMA/133
[    3.211380] ata1.00: 3907029168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
[    3.212172] ata1.00: configured for UDMA/133
[    3.212364] scsi 0:0:0:0: Direct-Access     ATA      ST2000NX0253     BE35 PQ: 0 ANSI: 5
[    3.212737] scsi 1:0:0:0: Direct-Access     ATA      ST2000NX0253     BE35 PQ: 0 ANSI: 5
[    3.227559] rtc-opal opal-rtc: setting system clock to 2018-06-13 18:02:39 UTC (1528912959)
[    3.229112] Freeing unused kernel memory: 11904K
[    3.240388] udevd[1649]: starting version 3.2.5
[    3.255452] udevd[1651]: starting eudev-3.2.5
[    3.333331] pci 0002:00:00.0: enabling device (0105 -> 0107)
[    3.333422] pci 0002:01:00.0: enabling device (0145 -> 0147)
[    3.333517] ast 0002:02:00.0: enabling device (0140 -> 0142)
[    3.333652] [drm] platform has no IO space, trying MMIO
[    3.333707] [drm] VGA not enabled on entry, requesting chip POST
[    3.333801] [drm] Using P2A bridge for configuration
[    3.333882] [drm] AST 2500 detected
[    3.333934] [drm] Analog VGA only
[    3.334018] [drm] dram MCLK=800 Mhz type=7 bus_width=16 size=01000000
[    3.358838] pci 0003:00:00.0: enabling device (0105 -> 0107)
[    3.358911] mlx5_core 0003:01:00.0: enabling device (0140 -> 0142)
[    3.359036] mlx5_core 0003:01:00.0: Using 64-bit DMA iommu bypass
[    3.360786] [TTM] Zone  kernel: Available graphics memory: 133889184 kiB
[    3.360840] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    3.360889] [TTM] Initializing pool allocator
[    3.369949] mlx5_core 0003:01:00.0: firmware version: 16.21.62
[    3.377415] sd 1:0:0:0: [sdb] 3907029168 512-byte logical blocks: (2.00 TB/1.82 TiB)
[    3.377480] sd 1:0:0:0: [sdb] 4096-byte physical blocks
[    3.377782] sd 0:0:0:0: [sda] 3907029168 512-byte logical blocks: (2.00 TB/1.82 TiB)
[    3.377855] sd 0:0:0:0: [sda] 4096-byte physical blocks
[    3.377930] sd 1:0:0:0: [sdb] Write Protect is off
[    3.378003] sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    3.378029] sd 0:0:0:0: [sda] Write Protect is off
[    3.378108] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    3.378151] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.378282] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.382622] tg3 0005:01:00.0 enP5p1s0f0: renamed from eth0
[    3.383498] tg3 0005:01:00.1 enP5p1s0f1: renamed from eth1
[    3.391400] sd 0:0:0:0: Attached scsi generic sg0 type 0
[    3.391508] sd 1:0:0:0: Attached scsi generic sg1 type 0
[    3.414214] Console: switching to colour frame buffer device 128x48
[    3.433353] sd 1:0:0:0: [sdb] Attached SCSI removable disk
[    3.459279] tg3 0034:01:00.0 enP52p1s0f0: renamed from eth2
[    3.460359] tg3 0034:01:00.1 enP52p1s0f1: renamed from eth3
[    3.461429] tg3 0034:01:00.2 enP52p1s0f2: renamed from eth4
[    3.462767] tg3 0034:01:00.3 enP52p1s0f3: renamed from eth5
[    3.464183]  sda: sda1 sda2
[    3.464456] sd 0:0:0:0: [sda] Attached SCSI removable disk
[    3.474189] nvme nvme0: pci function 0030:01:00.0
[    3.474236] pci 0030:00:00.0: enabling device (0105 -> 0107)
[    3.474244] nvme 0030:01:00.0: enabling device (0140 -> 0142)
[    3.474253] nvme 0030:01:00.0: Using 64-bit DMA iommu bypass
[    3.605273] ast 0002:02:00.0: fb0: astdrmfb frame buffer device
[    3.605279] [drm] Initialized ast 0.1.0 20120228 for 0002:02:00.0 on minor 0
[    4.610712] device-mapper: ioctl: 4.37.0-ioctl (2017-09-20) initialised: dm-devel@redhat.com
[    4.761334] EXT4-fs (dm-2): INFO: recovery required on readonly filesystem
[    4.761336] EXT4-fs (dm-2): write access will be enabled during recovery
[    4.932579] EXT4-fs (dm-2): recovery complete
[    4.932646] EXT4-fs (dm-2): mounted filesystem with ordered data mode. Opts: (null)
[    5.108691] tg3 0005:01:00.0 enP5p1s0f0: Link is up at 1000 Mbps, full duplex
[    5.108694] tg3 0005:01:00.0 enP5p1s0f0: Flow control is on for TX and on for RX
[    5.108697] tg3 0005:01:00.0 enP5p1s0f0: EEE is disabled
[    5.925470] mlx5_core 0003:01:00.0: Port module event: module 0, Cable unplugged
[    5.932637] mlx5_core 0003:01:00.1: enabling device (0140 -> 0142)
[    5.932683] mlx5_core 0003:01:00.1: Using 64-bit DMA iommu bypass
[    5.934227] mlx5_core 0003:01:00.1: firmware version: 16.21.62
[    5.967880] nvme nvme0: Shutdown timeout set to 10 seconds
[    8.427920] mlx5_core 0003:01:00.1: Port module event: module 1, Cable unplugged
[    8.434746] pci 0033:00:00.0: enabling device (0105 -> 0107)
[    8.434762] mlx5_core 0033:01:00.0: enabling device (0140 -> 0142)
[    8.434809] mlx5_core 0033:01:00.0: Using 64-bit DMA iommu bypass
[    8.436433] mlx5_core 0033:01:00.0: firmware version: 16.21.62
[   10.918237] mlx5_core 0033:01:00.0: Port module event: module 0, Cable unplugged
[   10.924874] mlx5_core 0033:01:00.1: enabling device (0140 -> 0142)
[   10.924923] mlx5_core 0033:01:00.1: Using 64-bit DMA iommu bypass
[   10.926525] mlx5_core 0033:01:00.1: firmware version: 16.21.62
[   13.418211] mlx5_core 0033:01:00.1: Port module event: module 1, Cable unplugged
[  199.132024] mlx5_core 0033:01:00.1: Shutdown was called
[  199.137559] mlx5_core 0033:01:00.1: mlx5_enter_error_state:121:(pid 1861): start
[  199.137567] mlx5_core 0033:01:00.1: mlx5_enter_error_state:128:(pid 1861): end
[  199.137614] mlx5_core 0033:01:00.0: Shutdown was called
[  199.147605] mlx5_core 0033:01:00.0: mlx5_enter_error_state:121:(pid 1861): start
[  199.147615] mlx5_core 0033:01:00.0: mlx5_enter_error_state:128:(pid 1861): end
[  199.147660] mlx5_core 0003:01:00.1: Shutdown was called
[  199.157560] mlx5_core 0003:01:00.1: mlx5_enter_error_state:121:(pid 1861): start
[  199.157567] mlx5_core 0003:01:00.1: mlx5_enter_error_state:128:(pid 1861): end
[  200.750358] sd 1:0:0:0: [sdb] Synchronizing SCSI cache
[  200.750849] sd 0:0:0:0: [sda] Synchronizing SCSI cache
[  200.751664] mlx5_core 0003:01:00.0: Shutdown was called
[  200.757556] mlx5_core 0003:01:00.0: mlx5_enter_error_state:121:(pid 1861): start
[  200.757573] mlx5_core 0003:01:00.0: mlx5_enter_error_state:128:(pid 1861): end
[  205.848067] kexec_core: Starting new kernel
[  205.871879] kexec: Waking offline cpu 0.
[  205.872013] Unable to handle kernel paging request for data at address 0x00000040
[  205.872014] Faulting instruction address: 0xc0000000001ca910
14:mon> 
leitao commented 6 years ago

I was curious to see if this problem would only be reproducible with kexec or if the kernel would fail \ with the nosmp parameter independently of how it was invoked. . I was not able to reproduce it on a KVM guest with Grub.


# cat /proc/cpuinfo 
processor   : 0
cpu     : POWER8E (raw), altivec supported
clock       : 3425.000000MHz
revision    : 2.1 (pvr 004b 0201)

timebase    : 512000000
platform    : pSeries
model       : IBM pSeries (emulated by qemu)
machine     : CHRP IBM pSeries (emulated by qemu)
MMU     : Hash

#  cat /proc/cmdline 
BOOT_IMAGE=/boot/vmlinux-4.18.0-rc1htm+ root=UUID=cf58cf01-d75e-49cf-97a0-26cf6416ee63 ro xmon=on crashkernel=2G-4G:320M,4G-32G:512M,32G-64G:1024M,64G-128G:2048M,128G-:4096M@128M nosmp
mikey commented 6 years ago

@leitao not overly surprising it doesn't reproduce as a guest. There is a good chance this is powernv platform specific. Normally we get confused about where a CPU is, either in skiboot or linux or something low level like that.