kth5 / archpower

Unofficial Archlinux port to powerpc64le, powerpc64, powerpc and riscv64
https://archlinuxpower.org
82 stars 5 forks source link

[POWER8] Flags mismatch error on boot. #65

Closed BushyToaster88 closed 11 months ago

BushyToaster88 commented 12 months ago

While booting on my IBM Power S822 Server it gets stuck on a Flags mismatch error. I do know for a fact that PPC64LE works since Fedora and Debian booted.


Loading Linux linux ...
Loading initial ramdisk ...
OF stdout device is: /vdevice/vty@30000000
Preparing to boot Linux version 6.5.3-arch1-1 (linux@archpower) (gcc (GCC) 13.2.1 20230801, GNU ld (GNU Binutils) 2.41.0) #1 SMP Fri, 15 Sep 2023 09:16:52 +0000
Detected machine type: 0000000000000101
command line: BOOT_IMAGE=/arch/boot/ppc64le/vmlinuz-linux --- quiet archisobasedir=arch archisolabel=ARCH_202309
Max number of cores passed to firmware: 256 (NR_CPUS = 2048)
Calling ibm,client-architecture-support... done
memory layout at init:
  memory_limit : 0000000000000000 (16 MB aligned)
  alloc_bottom : 000000000f6d0000
  alloc_top    : 0000000020000000
  alloc_top_hi : 0000000020000000
  rmo_top      : 0000000020000000
  ram_top      : 0000000020000000
instantiating rtas at 0x000000001eca0000... done
prom_hold_cpus: skipped
copying OF device tree...
Building dt strings...
Building dt structure...
Device tree strings 0x000000000f6e0000 -> 0x000000000f6e1913
Device tree struct  0x000000000f6f0000 -> 0x000000000f700000
[    0.951964] vas: API is supported only with radix page tables
[    1.544812] genirq: Flags mismatch irq 16. 00000001 (hvc_console) vs. 00000001 (hvsi)
[    1.544834] hvc_open: request_irq failed with rc -16.
[    1.544860] Warning: unable to open an initial console.
[   32.098341] genirq: Flags mismatch irq 16. 00000001 (hvc_console) vs. 00000001 (hvsi)
[   32.098361] hvc_open: request_irq failed with rc -16.
[   62.601599] genirq: Flags mismatch irq 16. 00000001 (hvc_console) vs. 00000001 (hvsi)
[   62.601613] hvc_open: request_irq failed with rc -16.
[   93.104875] genirq: Flags mismatch irq 16. 00000001 (hvc_console) vs. 00000001 (hvsi)```
kth5 commented 12 months ago

Be aware that only POWER9 and up is supported and tested in powerpc64le. For POWER8 and below, may I recommend the powerpc64 variant.

With that said:

Can you boot with the option Arch Linux POWER Install (serial hvc0 as console)?

Does it also produce the same problem?

Then, it looks like it's falling back to the hash table based MMU instead of Radix. In theory that should be fine though.

BushyToaster88 commented 12 months ago

Using the serial hvc0 as console option produces the exact same error. I tried the powerpc64 also does the same thing

kth5 commented 12 months ago

I'm currently building a new linux-ppc64 with many more IBM pSeries specific options enabled including the native Hypervisor early console. So assuming you're running an LPAR here, this may help and give some more insight potentially.

This all will come up as a new ISO in a bit.

kth5 commented 12 months ago

New ISO here based on linux-ppc 6.6.4:

https://archlinuxpower.org/iso/beta/archpower-2023.12.05-powerpc64.iso https://archlinuxpower.org/iso/beta/archpower-2023.12.05-powerpc64.iso.sig

I do not have access to any pSeries machines and am limited to a POWER9 PowerNV via Raptor's Blackbird and then emulation. I really hope we can get some more insight, it just works (tm) or receive patches. :)

BushyToaster88 commented 12 months ago

It seems to fail the same, heres the whole kernel boot process.

If you want I can give you a VPN which will give you access to the servers serial console plus the HMC/ASMI. Gentoo, Alpine and Ubuntu all have the same issue, though on the PPC64LE. If this can get fixed hopefully it can fix the error on both little and big endian.

IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM IBM
  Booting a command list

Loading Linux linux-ppc64 ...
Loading initial ramdisk ...
OF stdout device is: /vdevice/vty@30000000
Preparing to boot Linux version 6.6.4-arch1-2-ppc64 (linux-ppc64@archpower) (powerpc64-unknown-linux-gnu-gcc (GCC) 13.20Detected machine type: 0000000000000101
command line: BOOT_IMAGE=/arch/boot/ppc64/vmlinuz-linux-ppc64 --- quiet arch=ppc64 archisobasedir=arch archisolabel=ARC7Max number of cores passed to firmware: 256 (NR_CPUS = 2048)
Calling ibm,client-architecture-support... done
memory layout at init:
  memory_limit : 0000000000000000 (16 MB aligned)
  alloc_bottom : 000000000e1d0000
  alloc_top    : 0000000020000000
  alloc_top_hi : 0000000020000000
  rmo_top      : 0000000020000000
  ram_top      : 0000000020000000
instantiating rtas at 0x000000001eca0000... done
prom_hold_cpus: skipped
copying OF device tree...
Building dt strings...
Building dt structure...
Device tree strings 0x000000000e1e0000 -> 0x000000000e1e1913
Device tree struct  0x000000000e1f0000 -> 0x000000000e200000
[    0.000000] hash-mmu: Page sizes from device-tree:
[    0.000000] hash-mmu: base_shift=12: shift=12, sllp=0x0000, avpnm=0x00000000, tlbiel=1, penc=0
[    0.000000] hash-mmu: base_shift=12: shift=16, sllp=0x0000, avpnm=0x00000000, tlbiel=1, penc=7
[    0.000000] hash-mmu: base_shift=12: shift=24, sllp=0x0000, avpnm=0x00000000, tlbiel=1, penc=56
[    0.000000] hash-mmu: base_shift=16: shift=16, sllp=0x0110, avpnm=0x00000000, tlbiel=1, penc=1
[    0.000000] hash-mmu: base_shift=16: shift=24, sllp=0x0110, avpnm=0x00000000, tlbiel=1, penc=8
[    0.000000] hash-mmu: base_shift=24: shift=24, sllp=0x0100, avpnm=0x00000001, tlbiel=0, penc=0
[    0.000000] hash-mmu: base_shift=34: shift=34, sllp=0x0120, avpnm=0x000007ff, tlbiel=0, penc=3
[    0.000000] Enabling pkeys with max key count 31
[    0.000000] Activating Kernel Userspace Access Prevention
[    0.000000] Activating Kernel Userspace Execution Prevention
[    0.000000] Using 1TB segments
[    0.000000] hash-mmu: Initializing hash mmu with SLB
[    0.000000] Linux version 6.6.4-arch1-2-ppc64 (linux-ppc64@archpower) (powerpc64-unknown-linux-gnu-gcc (GCC) 13.2.1 0[    0.000000] Found initrd at 0xc00000000c800000:0xc00000000e1c5ecc
[    0.000000] Hardware name: IBM,8284-22A POWER8E (raw) 0x4b0201 0xf000004 of:IBM,FW860.20 (SV860_082) hv:phyp pSeries
[    0.000000] printk: bootconsole [udbg0] enabled
[    0.000000] Partition configured for 80 cpus.
[    0.000000] CPU maps initialized for 8 threads per core
[    0.000000] numa: Partition configured for 32 NUMA nodes.
[    0.000000] -----------------------------------------------------
[    0.000000] phys_mem_size     = 0x3e50000000
[    0.000000] dcache_bsize      = 0x80
[    0.000000] icache_bsize      = 0x80
[    0.000000] cpu_features      = 0x000002fb8f5d9187
[    0.000000]   possible        = 0x001ffbfbffffb18f
[    0.000000]   always          = 0x0000000000000180
[    0.000000] cpu_user_features = 0xdc0065c2 0xef000000
[    0.000000] mmu_features      = 0x7c006e01
[    0.000000] firmware_features = 0x0000009fc45bfc57
[    0.000000] vmalloc start     = 0xc008000000000000
[    0.000000] IO start          = 0xc00a000000000000
[    0.000000] vmemmap start     = 0xc00c000000000000
[    0.000000] hash-mmu: ppc64_pft_size    = 0x20
[    0.000000] hash-mmu: htab_hash_mask    = 0x1ffffff
[    0.000000] -----------------------------------------------------
[    0.000000] numa:   NODE_DATA [mem 0x1e9feb8280-0x1e9febffff]
[    0.000000] numa:   NODE_DATA [mem 0x3e4fe78280-0x3e4fe7ffff]
[    0.000000] rfi-flush: fallback displacement flush available
[    0.000000] count-cache-flush: flush disabled.
[    0.000000] link-stack-flush: flush disabled.
[    0.000000] stf-barrier: hwsync barrier available
[    0.000000] lpar: H_BLOCK_REMOVE supports base psize:0 psize:0 block size:8
[    0.000000] lpar: H_BLOCK_REMOVE supports base psize:0 psize:2 block size:8
[    0.000000] lpar: H_BLOCK_REMOVE supports base psize:0 psize:10 block size:8
[    0.000000] lpar: H_BLOCK_REMOVE supports base psize:2 psize:2 block size:8
[    0.000000] lpar: H_BLOCK_REMOVE supports base psize:2 psize:10 block size:8
[    0.000000] PPC64 nvram contains 15360 bytes
[    0.000000] barrier-nospec: using ORI speculation barrier
[    0.000000] Zone ranges:
[    0.000000]   Normal   [mem 0x0000000000000000-0x0000003e4fffffff]
[    0.000000]   Device   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x0000001e9fffffff]
[    0.000000]   node   1: [mem 0x0000001ea0000000-0x0000003e4fffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x0000001e9fffffff]
[    0.000000] Initmem setup node 1 [mem 0x0000001ea0000000-0x0000003e4fffffff]
[    0.000000] Initializing node 2 as memoryless
[    0.000000] Initmem setup node 2 as memoryless
[    0.000000] Initializing node 3 as memoryless
[    0.000000] Initmem setup node 3 as memoryless
[    0.000000] Initializing node 4 as memoryless
[    0.000000] Initmem setup node 4 as memoryless
[    0.000000] Initializing node 5 as memoryless
[    0.000000] Initmem setup node 5 as memoryless
[    0.000000] Initializing node 6 as memoryless
[    0.000000] Initmem setup node 6 as memoryless
[    0.000000] Initializing node 7 as memoryless
[    0.000000] Initmem setup node 7 as memoryless
[    0.000000] Initializing node 8 as memoryless
[    0.000000] Initmem setup node 8 as memoryless
[    0.000000] Initializing node 9 as memoryless
[    0.000000] Initmem setup node 9 as memoryless
[    0.000000] Initializing node 10 as memoryless
[    0.000000] Initmem setup node 10 as memoryless
[    0.000000] Initializing node 11 as memoryless
[    0.000000] Initmem setup node 11 as memoryless
[    0.000000] Initializing node 12 as memoryless
[    0.000000] Initmem setup node 12 as memoryless
[    0.000000] Initializing node 13 as memoryless
[    0.000000] Initmem setup node 13 as memoryless
[    0.000000] Initializing node 14 as memoryless
[    0.000000] Initmem setup node 14 as memoryless
[    0.000000] Initializing node 15 as memoryless
[    0.000000] Initmem setup node 15 as memoryless
[    0.000000] Initializing node 16 as memoryless
[    0.000000] Initmem setup node 16 as memoryless
[    0.000000] Initializing node 17 as memoryless
[    0.000000] Initmem setup node 17 as memoryless
[    0.000000] Initializing node 18 as memoryless
[    0.000000] Initmem setup node 18 as memoryless
[    0.000000] Initializing node 19 as memoryless
[    0.000000] Initmem setup node 19 as memoryless
[    0.000000] Initializing node 20 as memoryless
[    0.000000] Initmem setup node 20 as memoryless
[    0.000000] Initializing node 21 as memoryless
[    0.000000] Initmem setup node 21 as memoryless
[    0.000000] Initializing node 22 as memoryless
[    0.000000] Initmem setup node 22 as memoryless
[    0.000000] Initializing node 23 as memoryless
[    0.000000] Initmem setup node 23 as memoryless
[    0.000000] Initializing node 24 as memoryless
[    0.000000] Initmem setup node 24 as memoryless
[    0.000000] Initializing node 25 as memoryless
[    0.000000] Initmem setup node 25 as memoryless
[    0.000000] Initializing node 26 as memoryless
[    0.000000] Initmem setup node 26 as memoryless
[    0.000000] Initializing node 27 as memoryless
[    0.000000] Initmem setup node 27 as memoryless
[    0.000000] Initializing node 28 as memoryless
[    0.000000] Initmem setup node 28 as memoryless
[    0.000000] Initializing node 29 as memoryless
[    0.000000] Initmem setup node 29 as memoryless
[    0.000000] Initializing node 30 as memoryless
[    0.000000] Initmem setup node 30 as memoryless
[    0.000000] Initializing node 31 as memoryless
[    0.000000] Initmem setup node 31 as memoryless
[    0.000000] percpu: Embedded 2 pages/cpu s70696 r0 d60376 u131072
[    0.000000] Kernel command line: BOOT_IMAGE=/arch/boot/ppc64/vmlinuz-linux-ppc64 --- quiet arch=ppc64 archisobasedir7[    0.000000] Unknown kernel command line parameters "--- verbose BOOT_IMAGE=/arch/boot/ppc64/vmlinuz-linux-ppc64 arch.[    0.000000] random: crng init done
[    0.000000] printk: log_buf_len individual max cpu contribution: 4096 bytes
[    0.000000] printk: log_buf_len total cpu_extra contributions: 323584 bytes
[    0.000000] printk: log_buf_len min size: 524288 bytes
[    0.000000] printk: log_buf_len: 1048576 bytes
[    0.000000] printk: early log buf free: 516088(98%)
[    0.000000] Fallback order for Node 0: 0 1
[    0.000000] Fallback order for Node 1: 1 0
[    0.000000] Fallback order for Node 2: 2 0 1
[    0.000000] Fallback order for Node 3: 3 0 1
[    0.000000] Fallback order for Node 4: 4 0 1
[    0.000000] Fallback order for Node 5: 5 0 1
[    0.000000] Fallback order for Node 6: 6 0 1
[    0.000000] Fallback order for Node 7: 7 0 1
[    0.000000] Fallback order for Node 8: 8 0 1
[    0.000000] Fallback order for Node 9: 9 0 1
[    0.000000] Fallback order for Node 10: 10 0 1
[    0.000000] Fallback order for Node 11: 11 0 1
[    0.000000] Fallback order for Node 12: 12 0 1
[    0.000000] Fallback order for Node 13: 13 0 1
[    0.000000] Fallback order for Node 14: 14 0 1
[    0.000000] Fallback order for Node 15: 15 0 1
[    0.000000] Fallback order for Node 16: 16 0 1
[    0.000000] Fallback order for Node 17: 17 0 1
[    0.000000] Fallback order for Node 18: 18 0 1
[    0.000000] Fallback order for Node 19: 19 0 1
[    0.000000] Fallback order for Node 20: 20 0 1
[    0.000000] Fallback order for Node 21: 21 0 1
[    0.000000] Fallback order for Node 22: 22 0 1
[    0.000000] Fallback order for Node 23: 23 0 1
[    0.000000] Fallback order for Node 24: 24 0 1
[    0.000000] Fallback order for Node 25: 25 0 1
[    0.000000] Fallback order for Node 26: 26 0 1
[    0.000000] Fallback order for Node 27: 27 0 1
[    0.000000] Fallback order for Node 28: 28 0 1
[    0.000000] Fallback order for Node 29: 29 0 1
[    0.000000] Fallback order for Node 30: 30 0 1
[    0.000000] Fallback order for Node 31: 31 0 1
[    0.000000] Built 2 zonelists, mobility grouping on.  Total pages: 4079724
[    0.000000] Policy zone: Normal
[    0.000000] mem auto-init: stack:off, heap alloc:on, heap free:off
[    0.000000] Memory: 260998976K/261357568K available (13696K kernel code, 3264K rwdata, 3072K rodata, 2816K init, 178)[    0.000000] SLUB: HWalign=128, Order=0-3, MinObjects=0, CPUs=80, Nodes=32
[    0.000000] rcu: Hierarchical RCU implementation.
[    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=2048 to nr_cpu_ids=80.
[    0.000000]  Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=80
[    0.000000] NR_IRQS: 512, nr_irqs: 512, preallocated irqs: 16
[    0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.000000] clocksource: timebase: mask: 0xffffffffffffffff max_cycles: 0x761537d007, max_idle_ns: 440795202126 ns
[    0.011941] clocksource: timebase mult[1f40000] shift[24] registered
[    0.012265] Console: colour dummy device 80x25
[    0.025470] printk: console [hvc0] enabled
[    0.025470] printk: console [hvc0] enabled
[    0.025499] printk: bootconsole [udbg0] disabled
[    0.025499] printk: bootconsole [udbg0] disabled
[    0.025794] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancinl[    0.025807] pid_max: default: 81920 minimum: 640
[    0.045024] LSM: initializing lsm=capability,yama,integrity
[    0.045036] Yama: becoming mindful.
[    0.055063] Dentry cache hash table entries: 16777216 (order: 11, 134217728 bytes, vmalloc)
[    0.060042] Inode-cache hash table entries: 8388608 (order: 10, 67108864 bytes, vmalloc)
[    0.060283] Mount-cache hash table entries: 262144 (order: 5, 2097152 bytes, vmalloc)
[    0.060464] Mountpoint-cache hash table entries: 262144 (order: 5, 2097152 bytes, vmalloc)
[    0.062429] RCU Tasks Trace: Setting shift to 7 and lim to 1 rcu_task_cb_adjust=1.
[    0.062492] POWER8 performance monitor hardware support registered
[    0.062513] power8-pmu: PMAO restore workaround active.
[    0.062542] rcu: Hierarchical SRCU implementation.
[    0.064714] rcu:     Max phase no-delay instances is 1000.
[    0.065863] smp: Bringing up secondary CPUs ...
[    0.100643] smp: Brought up 2 nodes, 80 CPUs
[    0.100663] numa: Node 0 CPUs: 0-39
[    0.100673] numa: Node 1 CPUs: 40-79
[    0.108685] devtmpfs: initialized
[    0.137423] PCI host bridge /pci@800000020000010  ranges:
[    0.137446]  MEM 0x00003fc000000000..0x00003fc07effffff -> 0x0000000080000000
[    0.137456]  MEM 0x0000300000000000..0x0000300fffffffff -> 0x0003d00000000000
[    0.137554] PCI host bridge /pci@800000020000013  ranges:
[    0.137567]  MEM 0x00003fc080000000..0x00003fc09fffffff -> 0x0000000080000000
[    0.137576]  MEM 0x0000301000000000..0x00003013ffffffff -> 0x0003d01000000000
[    0.137623] PCI host bridge /pci@800000020000014  ranges:
[    0.137635]  MEM 0x00003fc0a0000000..0x00003fc0bfffffff -> 0x00000000a0000000
[    0.137644]  MEM 0x0000301400000000..0x00003017ffffffff -> 0x0003d01400000000
[    0.137702] PCI host bridge /pci@800000020000015  ranges:
[    0.137714]  MEM 0x00003fc0c0000000..0x00003fc0cfffffff -> 0x00000000c0000000
[    0.137723]  MEM 0x0000301800000000..0x0000301bffffffff -> 0x0003d01800000000
[    0.137762] PCI host bridge /pci@800000020000018  ranges:
[    0.137774]  MEM 0x00003fc200000000..0x00003fc27effffff -> 0x0000000080000000
[    0.137783]  MEM 0x0000304000000000..0x0000304fffffffff -> 0x0003d04000000000
[    0.137837] PCI host bridge /pci@80000002000001b  ranges:
[    0.137847]  MEM 0x00003fc2f0000000..0x00003fc2f7ffffff -> 0x00000000f0000000
[    0.137895] PCI host bridge /pci@80000002000001d  ranges:
[    0.137907]  MEM 0x00003fc2a0000000..0x00003fc2bfffffff -> 0x00000000a0000000
[    0.137915]  MEM 0x0000305400000000..0x00003057ffffffff -> 0x0003d05400000000
[    0.137958] PCI host bridge /pci@80000002000001e  ranges:
[    0.137969]  MEM 0x00003fc2c0000000..0x00003fc2dfffffff -> 0x00000000c0000000
[    0.137978]  MEM 0x0000305800000000..0x0000305bffffffff -> 0x0003d05800000000
[    0.138014] PCI host bridge /pci@80000002000001f  ranges:
[    0.138026]  MEM 0x00003fc2e0000000..0x00003fc2efffffff -> 0x00000000e0000000
[    0.138035]  MEM 0x0000305c00000000..0x0000305fffffffff -> 0x0003d05c00000000
[    0.138194] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.138496] futex hash table entries: 32768 (order: 6, 4194304 bytes, vmalloc)
[    0.139324] pinctrl core: initialized pinctrl subsystem
[    0.140387] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.140514] IBM eBus Device Driver
[    0.140904] audit: initializing netlink subsys (disabled)
[    0.141035] audit: type=2000 audit(1701832779.104:1): state=initialized audit_enabled=0 res=1
[    0.141263] thermal_sys: Registered thermal governor 'fair_share'
[    0.141266] thermal_sys: Registered thermal governor 'bang_bang'
[    0.141274] thermal_sys: Registered thermal governor 'step_wise'
[    0.141280] thermal_sys: Registered thermal governor 'user_space'
[    0.141286] thermal_sys: Registered thermal governor 'power_allocator'
[    0.141445] cpuidle: using governor ladder
[    0.141472] cpuidle: using governor menu
[    0.141907] pstore: Using crash dump compression: deflate
[    0.141914] pstore: Registered nvram as persistent store backend
[    0.143262] EEH: pSeries platform initialized
[    0.180113] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[    0.180512] HugeTLB: registered 16.0 MiB page size, pre-allocated 0 pages
[    0.180521] HugeTLB: 0 KiB vmemmap can be freed for a 16.0 MiB page
[    0.180529] HugeTLB: registered 16.0 GiB page size, pre-allocated 0 pages
[    0.180536] HugeTLB: 0 KiB vmemmap can be freed for a 16.0 GiB page
[    0.183509] fbcon: Taking over console
[    0.183538] iommu: Default domain type: Translated
[    0.183544] iommu: DMA domain TLB invalidation policy: strict mode
[    0.184108] pps_core: LinuxPPS API ver. 1 registered
[    0.184115] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.184127] PTP clock support registered
[    0.184142] EDAC MC: Ver: 3.0.0
[    0.184708] NetLabel: Initializing
[    0.184714] NetLabel:  domain hash size = 128
[    0.184719] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    0.184750] NetLabel:  unlabeled traffic allowed by default
[    0.184774] PCI: Probing PCI hardware
[    0.184894] PCI host bridge to bus 0010:01
[    0.184902] pci_bus 0010:01: root bus resource [mem 0x3fc000000000-0x3fc07effffff] (bus address [0x80000000-0xfeffff)[    0.184915] pci_bus 0010:01: root bus resource [mem 0x300000000000-0x300fffffffff 64bit] (bus address [0x3d000000000)[    0.184928] pci_bus 0010:01: root bus resource [bus 01-ff]
[    0.262065] IOMMU table initialized, virtual merging enabled
[    0.262187] PCI host bridge to bus 0013:50
[    0.262195] pci_bus 0013:50: root bus resource [mem 0x3fc080000000-0x3fc09fffffff] (bus address [0x80000000-0x9fffff)[    0.262206] pci_bus 0013:50: root bus resource [mem 0x301000000000-0x3013ffffffff 64bit] (bus address [0x3d010000000)[    0.262218] pci_bus 0013:50: root bus resource [bus 50-ff]
[    0.339376] PCI host bridge to bus 0014:60
[    0.339384] pci_bus 0014:60: root bus resource [mem 0x3fc0a0000000-0x3fc0bfffffff] (bus address [0xa0000000-0xbfffff)[    0.339395] pci_bus 0014:60: root bus resource [mem 0x301400000000-0x3017ffffffff 64bit] (bus address [0x3d014000000)[    0.339407] pci_bus 0014:60: root bus resource [bus 60-ff]
[    0.416616] PCI host bridge to bus 0015:70
[    0.416623] pci_bus 0015:70: root bus resource [mem 0x3fc0c0000000-0x3fc0cfffffff] (bus address [0xc0000000-0xcfffff)[    0.416634] pci_bus 0015:70: root bus resource [mem 0x301800000000-0x301bffffffff 64bit] (bus address [0x3d018000000)[    0.416646] pci_bus 0015:70: root bus resource [bus 70-ff]
[    0.418534] pci 0015:70:00.0: No hypervisor support for SR-IOV on this device, IOV BARs disabled.
[    0.423188] pci 0015:70:00.0: PME# supported from D0 D3hot D3cold
[    0.427718] pci 0015:70:00.0: 63.008 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x8 link at 0015:70:00.0)[    0.507474] PCI host bridge to bus 0018:01
[    0.507481] pci_bus 0018:01: root bus resource [mem 0x3fc200000000-0x3fc27effffff] (bus address [0x80000000-0xfeffff)[    0.507493] pci_bus 0018:01: root bus resource [mem 0x304000000000-0x304fffffffff 64bit] (bus address [0x3d040000000)[    0.507505] pci_bus 0018:01: root bus resource [bus 01-ff]
[    0.585712] PCI host bridge to bus 001b:50
[    0.585719] pci_bus 001b:50: root bus resource [mem 0x3fc2f0000000-0x3fc2f7ffffff] (bus address [0xf0000000-0xf7ffff)[    0.585730] pci_bus 001b:50: root bus resource [bus 50-ff]
[    0.587558] pci 001b:50:00.0: No hypervisor support for SR-IOV on this device, IOV BARs disabled.
[    0.591947] pci 001b:50:00.0: supports D1 D2
[    0.591955] pci 001b:50:00.0: PME# supported from D0 D1 D2 D3hot
[    0.675937] PCI host bridge to bus 001d:70
[    0.675945] pci_bus 001d:70: root bus resource [mem 0x3fc2a0000000-0x3fc2bfffffff] (bus address [0xa0000000-0xbfffff)[    0.675956] pci_bus 001d:70: root bus resource [mem 0x305400000000-0x3057ffffffff 64bit] (bus address [0x3d054000000)[    0.675968] pci_bus 001d:70: root bus resource [bus 70-ff]
[    0.678641] pci 001d:70:00.0: No hypervisor support for SR-IOV on this device, IOV BARs disabled.
[    0.686042] pci 001d:70:00.0: PME# supported from D0 D3hot D3cold
[    0.702575] pci 001d:70:00.1: No hypervisor support for SR-IOV on this device, IOV BARs disabled.
[    0.709667] pci 001d:70:00.1: PME# supported from D0 D3hot D3cold
[    0.725038] pci 001d:70:00.2: No hypervisor support for SR-IOV on this device, IOV BARs disabled.
[    0.732124] pci 001d:70:00.2: PME# supported from D0 D3hot D3cold
[    0.747509] pci 001d:70:00.3: No hypervisor support for SR-IOV on this device, IOV BARs disabled.
[    0.754605] pci 001d:70:00.3: PME# supported from D0 D3hot D3cold
[    0.845279] PCI host bridge to bus 001e:80
[    0.845287] pci_bus 001e:80: root bus resource [mem 0x3fc2c0000000-0x3fc2dfffffff] (bus address [0xc0000000-0xdfffff)[    0.845299] pci_bus 001e:80: root bus resource [mem 0x305800000000-0x305bffffffff 64bit] (bus address [0x3d058000000)[    0.845311] pci_bus 001e:80: root bus resource [bus 80-ff]
[    0.923456] PCI host bridge to bus 001f:90
[    0.923465] pci_bus 001f:90: root bus resource [mem 0x3fc2e0000000-0x3fc2efffffff] (bus address [0xe0000000-0xefffff)[    0.923477] pci_bus 001f:90: root bus resource [mem 0x305c00000000-0x305fffffffff 64bit] (bus address [0x3d05c000000)[    0.923489] pci_bus 001f:90: root bus resource [bus 90-ff]
[    0.925506] pci 001f:90:00.0: No hypervisor support for SR-IOV on this device, IOV BARs disabled.
[    0.930554] pci 001f:90:00.0: PME# supported from D0 D3hot D3cold
[    0.935460] pci 001f:90:00.0: 63.008 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x8 link at 001f:90:00.0)[    1.022515] pci 001b:50:00.0: of_irq_parse_pci: no interrupt-map found, INTx interrupts not available
[    1.022532] PCI: OF: of_irq_parse_pci: possibly some PCI slots don't have level triggered interrupts capability
[    1.052062] EEH: Capable adapter found: recovery enabled.
[    1.052170] vgaarb: loaded
[    1.053133] clocksource: Switched to clocksource timebase
[    1.054152] VFS: Disk quotas dquot_6.6.0
[    1.054251] VFS: Dquot-cache hash table entries: 8192 (order 0, 65536 bytes)
[    1.058147] NET: Registered PF_INET protocol family
[    1.058357] IP idents hash table entries: 262144 (order: 5, 2097152 bytes, vmalloc)
[    1.064424] tcp_listen_portaddr_hash hash table entries: 65536 (order: 4, 1048576 bytes, vmalloc)
[    1.064657] Table-perturb hash table entries: 65536 (order: 2, 262144 bytes, vmalloc)
[    1.064949] TCP established hash table entries: 524288 (order: 6, 4194304 bytes, vmalloc)
[    1.066321] TCP bind hash table entries: 65536 (order: 5, 2097152 bytes, vmalloc)
[    1.066591] TCP: Hash tables configured (established 524288 bind 65536)
[    1.067021] MPTCP token hash table entries: 65536 (order: 4, 1572864 bytes, vmalloc)
[    1.067429] UDP hash table entries: 65536 (order: 5, 2097152 bytes, vmalloc)
[    1.067947] UDP-Lite hash table entries: 65536 (order: 5, 2097152 bytes, vmalloc)
[    1.068498] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    1.068514] NET: Registered PF_XDP protocol family
[    1.070283] PCI: CLS 128 bytes, default 128
[    1.070496] Trying to unpack rootfs image as initramfs...
[    1.073061] vas: API is supported only with radix page tables
[    1.074464] hv-24x7: read 1330 catalog entries, created 337 event attrs (0 failures), 169 descs
[    1.089760] Initialise system trusted keyrings
[    1.089996] workingset: timestamp_bits=38 max_order=22 bucket_order=0
[    1.090021] zbud: loaded
[    1.111740] Key type asymmetric registered
[    1.111773] Asymmetric key parser 'x509' registered
[    1.111935] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246)
[    1.112131] io scheduler mq-deadline registered
[    1.114521] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    1.114670] IPMI message handler: version 39.2
[    1.143227] HVCS: Driver registered.
[    1.143246] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    1.143984] ePAPR hypervisor byte channel driver
[    1.144146] Non-volatile memory driver v1.3
[    1.145277] ibmvmc: version 1.0
[    1.145341] ibmvmc: node 10:125
[    1.146109] rtc-generic rtc-generic: registered as rtc0
[    1.146183] rtc-generic rtc-generic: setting system clock to 2023-12-06T03:19:40 UTC (1701832780)
[    1.154002] ledtrig-cpu: registered to indicate activity on CPUs
[    1.154075] nx-crypto ibm,sym-encryption-v1: bogus sglen/databytelen for 0/6/1: 0/0 (ignored)
[    1.154089] nx-crypto ibm,sym-encryption-v1: bogus sglen/databytelen for 0/6/1: 0/0 (ignored)
[    1.154107] nx-crypto ibm,sym-encryption-v1: bogus sglen/databytelen for 0/20/1: 0/0 (ignored)
[    1.154171] hid: raw HID events driver (C) Jiri Kosina
[    1.154373] NET: Registered PF_PACKET protocol family
[    1.154473] Key type dns_resolver registered
[    1.158623] registered taskstats version 1
[    1.159801] Loading compiled-in X.509 certificates
[    1.165087] Key type .fscrypt registered
[    1.165097] Key type fscrypt-provisioning registered
[    1.165975] clk: Disabling unused clocks
[    1.609597] Freeing initrd memory: 26368K
[    1.609847] genirq: Flags mismatch irq 16. 00000001 (hvc_console) vs. 00000001 (hvsi)
[    1.609862] hvc_open: request_irq failed with rc -16.
[    1.609887] Warning: unable to open an initial console.
[    1.610098] Freeing unused kernel image (initmem) memory: 2816K
[    1.610106] This architecture does not have kernel memory protection.
[    1.610118] Run /init as init process
[    2.513042] synth uevent: /devices/vio: failed to send uevent
[    2.513063] vio vio: uevent: failed to send synthetic uevent: -19
[    2.513158] synth uevent: /devices/vio/4000: failed to send uevent
[    2.513166] vio 4000: uevent: failed to send synthetic uevent: -19
[    2.513204] synth uevent: /devices/vio/4001: failed to send uevent
[    2.513212] vio 4001: uevent: failed to send synthetic uevent: -19
[    2.513247] synth uevent: /devices/vio/4002: failed to send uevent
[    2.513254] vio 4002: uevent: failed to send synthetic uevent: -19
[    2.513289] synth uevent: /devices/vio/4004: failed to send uevent
[    2.513296] vio 4004: uevent: failed to send synthetic uevent: -19
kth5 commented 12 months ago

From what it looks like your boot already is inside the initramfs as indicated by [ 1.610118] Run /init as init process. It is probably trying to probe hardware here and fails. I've seen this stage hang for up to 20s on a DP G5 before any life would be visible again on screen/serial.

I couldn't ask for access to the equipment but it would be highly appreciated.

BushyToaster88 commented 12 months ago

I let it run for a little longer and it just repeats the flags error. Also what did you mean about the last thing you said. Did you want access to the equipment? I just dont understand what you meant sorry lol.

[    1.637106] Run /init as init process
[    2.540232] synth uevent: /devices/vio: failed to send uevent
[    2.540253] vio vio: uevent: failed to send synthetic uevent: -19
[    2.540349] synth uevent: /devices/vio/4000: failed to send uevent
[    2.540358] vio 4000: uevent: failed to send synthetic uevent: -19
[    2.540395] synth uevent: /devices/vio/4001: failed to send uevent
[    2.540403] vio 4001: uevent: failed to send synthetic uevent: -19
[    2.540438] synth uevent: /devices/vio/4002: failed to send uevent
[    2.540445] vio 4002: uevent: failed to send synthetic uevent: -19
[    2.540479] synth uevent: /devices/vio/4004: failed to send uevent
[    2.540487] vio 4004: uevent: failed to send synthetic uevent: -19
[   33.072593] genirq: Flags mismatch irq 16. 00000001 (hvc_console) vs. 00000001 (hvsi)
[   33.072613] hvc_open: request_irq failed with rc -16.
[   63.576169] genirq: Flags mismatch irq 16. 00000001 (hvc_console) vs. 00000001 (hvsi)
[   63.576183] hvc_open: request_irq failed with rc -16.
[   94.079685] genirq: Flags mismatch irq 16. 00000001 (hvc_console) vs. 00000001 (hvsi)
[   94.079699] hvc_open: request_irq failed with rc -16.
[  124.583254] genirq: Flags mismatch irq 16. 00000001 (hvc_console) vs. 00000001 (hvsi)
[  124.583268] hvc_open: request_irq failed with rc -16.
[  155.086759] genirq: Flags mismatch irq 16. 00000001 (hvc_console) vs. 00000001 (hvsi)
[  155.086773] hvc_open: request_irq failed with rc -16.
[  185.590301] genirq: Flags mismatch irq 16. 00000001 (hvc_console) vs. 00000001 (hvsi)
[  185.590316] hvc_open: request_irq failed with rc -16.
[  216.093795] genirq: Flags mismatch irq 16. 00000001 (hvc_console) vs. 00000001 (hvsi)
[  216.093810] hvc_open: request_irq failed with rc -16.
kth5 commented 12 months ago

Yes, temporary access would be nice. I'm not sure when exacly I can find the time for a session though since I have not yet worked with the equipment before and thus would probably need a bit of a intro here on how you operate things.

I'm in TZ=Europe/Berlin, perhaps we could find a slot we both are available?

You can reach me at alex.bldck@gmail.com.

BushyToaster88 commented 12 months ago

Im in Melbourne Australia so AEDT. I'll email you with the access details and how to navigate the server.

kth5 commented 12 months ago

Fixed in linux-ppc64-6.6.4.arch1-3 which is in [testing] already now. ISOs for powerpc64 will follow.

kth5 commented 12 months ago

We have a IBM S824 all set up now.

image

kth5 commented 11 months ago

The problem was caused by the following kernel option: CONFIG_HVC_OLD_HVSI

kth5 commented 11 months ago

New ISO:

https://archlinuxpower.org/iso/stable/archpower-2023.12.07-powerpc64.iso https://archlinuxpower.org/iso/stable/archpower-2023.12.07-powerpc64.iso.sig

Will prepare a new full release shortly.

kth5 commented 11 months ago

Went through testing the new ISO and kernel on Discord with @BushyToaster88. Changes are confirmed working well.