HAOS Install Fails on Odroid N2

CodePhase commented 1 year ago

Describe the issue you are experiencing

I have been trying to install HAOS on my Odroid N2 (not the plus) 4 gig SBC for some time now without success. I have tried multiple versions (9.3, 9.2, 8.5, 6.0, 5.13) all with the same issue. I have followed the install documentation using Etcher on https://www.home-assistant.io/installation/odroid for every attempt. I have also tried using 'dd' to copy the image file after extracting it from xz format.

I have tried ruling out my SBC as the issue by:

trying two different Odroid brand power supplies
trying different electrical outlets
trying different network cables as suggested in another issue here
trying different network switches (one uses STP so delays the link; the other does not)
trying the official odroid ubuntu OS's (both the mate and minimal latest releases work fine)
trying both installing to eMMC and SD card; same result with each

The full log for the 9.3 attempt is in the host log section below

What operating system image do you use?

odroid-n2 (Hardkernel ODROID-N2/N2+)

What version of Home Assistant Operating System is installed?

9.3

Did you upgrade the Operating System.

No

Steps to reproduce the issue

Download the latest HAOS image from https://github.com/home-assistant/operating-system/releases/download/9.3/haos_odroid-n2-9.3.img.xz
Extract the image with xz (xz -d <path to haos.img.xz)
Write image to eMMC (dd if= of=/dev/sdb bs=2M status=progress)
Or, use Etcher as described in odroid install page
Install eMMC into Odroid N2
Attach network cable
Attach power and attempt to boot

Anything in the Supervisor logs that might be useful for us?

N/A

Anything in the Host logs that might be useful for us?

G12B:BL:6e7c85:7898ac;FEAT:E0F83180:402000;POC:F;RCY:0;EMMC:0;READ:0;0.
bl2_stage_init 0x01
bl2_stage_init 0x81
hw id: 0x0000 - pwm id 0x01
bl2_stage_init 0xc1
bl2_stage_init 0x02

L0:00000000
L1:00000703
L2:0000c067
L3:14000020
B2:00402000
B1:e0f83180

TE: 303086

BL2 Built : 06:17:13, Jun 28 2019. g12b gf0505d7-dirty - qi.duan@droid13

Board ID = 4
Set A53 clk to 24M
Set A73 clk to 24M
Set clk81 to 24M
A53 clk: 1200 MHz
A73 clk: 1200 MHz
CLK81: 166.6M
smccc: 0004e821
eMMC boot @ 0
sw8 s
DDR driver_vesion: LPDDR4_PHY_V_0_1_14 build time: Jun 28 2019 06:17:09
board id: 4
Load FIP HDR from eMMC, src: 0x00010200, des: 0xfffd0000, size: 0x00004000, part: 0
fw parse done
Load ddrfw from eMMC, src: 0x00054200, des: 0xfffd0000, size: 0x0000c000, part: 0
Load ddrfw from eMMC, src: 0x0002c200, des: 0xfffd0000, size: 0x00004000, part: 0
PIEI prepare done
fastboot data load
00000000
emmc switch 1 ok
00000000
emmc switch 2 ok
fastboot data verify
verify result: 255
Cfg max: 2, cur: 1. Board id: 255. Force loop cfg
DDR4 probe
ddr clk to 1320MHz
Load ddrfw from eMMC, src: 0x00014200, des: 0xfffd0000, size: 0x0000c000, part: 0
00000000
emmc switch 0 ok
Check phy result
INFO : End of initialization
INFO : End of read enable training
INFO : End of fine write leveling
INFO : End of read dq deskew training
INFO : End of MPR read delay center optimization
INFO : End of Write leveling coarse delay
INFO : End of write delay center optimization
INFO : End of read delay center optimization
INFO : End of max read latency training
INFO : Training has run successfully!
1D training succeed
Load ddrfw from eMMC, src: 0x00020200, des: 0xfffd0000, size: 0x0000c000, part: 0
Check phy result
INFO : End of initialization
INFO : End of 2D read delay Voltage center optimization
INFO : End of 2D write delay Voltage center optimization
INFO : Training has run successfully!

R0_RxClkDly_Margin==82 ps 7
R0_TxDqDly_Margi==94 ps 8

R1_RxClkDly_Margin==0 ps 0
R1_TxDqDly_Margi==0 ps 0

 dwc_ddrphy_apb_wr((0<<20)|(2<<16)|(0<<12)|(0xb0):0001 
2D training succeed
auto size-- 65535DDR cs0 size: 2048MB
DDR cs1 size: 2048MB
DMC_DDR_CTRL: 00600024DDR size: 3928MB
cs0 DataBus test pass
cs1 DataBus test pass
cs0 AddrBus test pass
cs1 AddrBus test pass
 pre test  bdlr_100_average==445 bdlr_100_min==445 bdlr_100_max==445 bdlr_100_cur==445
 aft test  bdlr_100_average==445 bdlr_100_min==445 bdlr_100_max==445 bdlr_100_cur==445
non-sec scramble use zero key
ddr scramble enabled

100bdlr_step_size ps== 445
result report
boot times 0Enable ddr reg access
00000000
emmc switch 3 ok
Authentication key not yet programmed
get rpmb counter error 0x00000007
00000000
emmc switch 0 ok
Load FIP HDR from eMMC, src: 0x00010200, des: 0x01700000, size: 0x00004000, part: 0
Load BL3X from eMMC, src: 0x00060200, des: 0x01750000, size: 0x0008a000, part: 0
0.0;M3 CHK:0;cm4_sp_mode 0
E30HDR
MVN_1=0x00000000
MVN_2=0x00000000
[Image: g12b_v1.1.3375-8f9c8a7 2019-01-24 10:44:46 guotai.shen@droid11-sz]
OPS=0x40
ring efuse init
chipver efuse init
29 0a 40 00 01 0e 0e 00 00 0e 30 32 54 52 4d 50 
[0.019859 Inits done]
secure task start!
high task start!
low task start!
run into bl31
NOTICE:  BL31: v1.3(release):ab8811b
NOTICE:  BL31: Built : 15:03:31, Feb 12 2019
NOTICE:  BL31: G12A normal boot!
NOTICE:  BL31: BL33 decompress pass
ERROR:   Error initializing runtime service opteed_fast

U-Boot 2022.01 (Oct 20 2022 - 23:00:53 +0000) odroid-n2/n2-plus

Model: Hardkernel ODROID-N2
SoC:   Amlogic Meson G12B (S922X) Revision 29:a (40:2)
DRAM:  3.8 GiB
MMC:   sd@ffe05000: 0, mmc@ffe07000: 1
Loading Environment from nowhere... OK
In:    serial
Out:   serial
Err:   serial
Board variant: n2
Net:   eth0: ethernet@ff3f0000
Card did not respond to voltage select! : -110
switch to partitions #0, OK
mmc1(part 0) is current device
Scanning mmc 1:1...
Found U-Boot script /boot.scr
3387 bytes read in 2 ms (1.6 MiB/s)
## Executing script at 08000000
switch to partitions #0, OK
mmc1(part 0) is current device
loading env...

MMC read: dev # 1, block # 1222656, count 16 ... 16 blocks read: OK
## Error: bad CRC, import failed
91 bytes read in 1 ms (88.9 KiB/s)
38 bytes read in 0 ms
Loading standard device tree meson-g12b-odroid-n2.dtb
77164 bytes read in 4 ms (18.4 MiB/s)
Trying to boot slot A, 2 attempts remaining. Loading kernel ...
22850048 bytes read in 703 ms (31 MiB/s)
storing env...

MMC write: dev # 1, block # 1222656, count 16 ... 16 blocks written: OK
bootargs=zram.enabled=1 zram.num_devices=3 apparmor=1 security=apparmor systemd.machine_id= fsck.repair=yes root=PARTUUID=48617373-06 rootfstype=squashfs ro rootwait rauc.slot=A console=tty0 console=ttyAML0,115200n8
Starting kernel
Moving Image from 0x8080000 to 0x8200000, end=9850000
## Flattened Device Tree blob at 08008000
   Booting using the fdt blob at 0x8008000
   Loading Device Tree to 000000003ff84000, end 000000003fffffff ... OK

Starting kernel ...

[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034]
[    0.000000] Linux version 5.15.74 (builder@c147762d7f0f) (aarch64-buildroot-linux-gnu-gcc.br_real (Buildroot -g48c0c35f09) 9.4.0, GNU ld (GNU Binutils) 2.36.1) #1 SMP PREEMPT Thu Oct 20 22:58:53 UTC 2022
[    0.000000] Machine model: Hardkernel ODROID-N2
[    0.000000] efi: UEFI not found.
[    0.000000] OF: fdt: Reserved memory: failed to reserve memory for node 'secmon@5000000': base 0x0000000005000000, size 3 MiB
[    0.000000] Reserved memory: created CMA memory pool at 0x00000000e4c00000, size 256 MiB
[    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
[    0.000000] NUMA: No NUMA configuration found
[    0.000000] NUMA: Faking a node at [mem 0x0000000000000000-0x00000000f4e5afff]
[    0.000000] NUMA: NODE_DATA [mem 0xe4652100-0xe4653fff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000000000-0x00000000f4e5afff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x00000000052fffff]
[    0.000000]   node   0: [mem 0x0000000005300000-0x00000000072fffff]
[    0.000000]   node   0: [mem 0x0000000007300000-0x00000000f4e5afff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x00000000f4e5afff]
[    0.000000] On node 0, zone DMA: 12709 pages in unavailable ranges
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.0 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: MIGRATE_INFO_TYPE not supported.
[    0.000000] psci: SMC Calling Convention v1.1
[    0.000000] percpu: Embedded 20 pages/cpu s43160 r8192 d30568 u81920
[    0.000000] Detected VIPT I-cache on CPU0
[    0.000000] CPU features: detected: ARM erratum 845719
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 987425
[    0.000000] Policy zone: DMA
[    0.000000] Kernel command line: zram.enabled=1 zram.num_devices=3 apparmor=1 security=apparmor systemd.machine_id= fsck.repair=yes root=PARTUUID=48617373-06 rootfstype=squashfs ro rootwait rauc.slot=A console=tty0 console=ttyAML0,115200n8
[    0.000000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[    0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] Memory: 3613152K/4012396K available (13824K kernel code, 1450K rwdata, 4304K rodata, 2624K init, 459K bss, 137100K reserved, 262144K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=6, Nodes=1
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=6.
[    0.000000]  Trampoline variant of Tasks RCU enabled.
[    0.000000]  Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=6
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] Root IRQ handler: gic_handle_irq
[    0.000000] GIC: Using split EOI/Deactivate mode
[    0.000000] irq_meson_gpio: 100 to 8 gpio interrupt mux initialized
[    0.000000] arch_timer: cp15 timer(s) running at 24.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x588fe9dc0, max_idle_ns: 440795202592 ns
[    0.000000] sched_clock: 56 bits at 24MHz, resolution 41ns, wraps every 4398046511097ns
[    0.000216] Console: colour dummy device 80x25
[    0.000597] printk: console [tty0] enabled
[    0.000684] Calibrating delay loop (skipped), value calculated using timer frequency.. 48.00 BogoMIPS (lpj=96000)
[    0.000708] pid_max: default: 32768 minimum: 301
[    0.000780] LSM: Security Framework initializing
[    0.000873] AppArmor: AppArmor initialized
[    0.000973] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.001005] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.003035] rcu: Hierarchical SRCU implementation.
[    0.005027] EFI services will not be available.
[    0.005486] smp: Bringing up secondary CPUs ...
[    0.006166] Detected VIPT I-cache on CPU1
[    0.006230] CPU1: Booted secondary processor 0x0000000001 [0x410fd034]
[    0.007448] CPU features: detected: Spectre-v2
[    0.007460] CPU features: detected: Spectre-v4
[    0.007465] CPU features: detected: Spectre-BHB
[    0.007469] CPU features: detected: ARM erratum 858921
[    0.007474] Detected VIPT I-cache on CPU2
[    0.007503] arch_timer: Enabling local workaround for ARM erratum 858921
[    0.007518] arch_timer: CPU2: Trapping CNTVCT access
[    0.007528] CPU2: Booted secondary processor 0x0000000100 [0x410fd092]
[    0.008218] Detected VIPT I-cache on CPU3
[    0.008238] arch_timer: Enabling local workaround for ARM erratum 858921
[    0.008246] arch_timer: CPU3: Trapping CNTVCT access
[    0.008252] CPU3: Booted secondary processor 0x0000000101 [0x410fd092]
[    0.008877] Detected VIPT I-cache on CPU4
[    0.008896] arch_timer: Enabling local workaround for ARM erratum 858921
[    0.008904] arch_timer: CPU4: Trapping CNTVCT access
[    0.008909] CPU4: Booted secondary processor 0x0000000102 [0x410fd092]
[    0.009543] Detected VIPT I-cache on CPU5
[    0.009563] arch_timer: Enabling local workaround for ARM erratum 858921
[    0.009570] arch_timer: CPU5: Trapping CNTVCT access
[    0.009577] CPU5: Booted secondary processor 0x0000000103 [0x410fd092]
[    0.009652] smp: Brought up 1 node, 6 CPUs
[    0.009823] SMP: Total of 6 processors activated.
[    0.009835] CPU features: detected: 32-bit EL0 Support
[    0.009845] CPU features: detected: 32-bit EL1 Support
[    0.009858] CPU features: detected: CRC32 instructions
[    0.019443] CPU: All CPU(s) started at EL2
[    0.019528] alternatives: patching kernel code
[    0.021391] devtmpfs: initialized
[    0.027493] Registered cp15_barrier emulation handler
[    0.027525] Registered setend emulation handler
[    0.027537] KASLR disabled due to lack of seed
[    0.027673] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.027696] futex hash table entries: 2048 (order: 5, 131072 bytes, linear)
[    0.031384] pinctrl core: initialized pinctrl subsystem
[    0.031713] DMI not present or invalid.
[    0.032186] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.033523] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations
[    0.033781] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.034045] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.034065] audit: initializing netlink subsys (disabled)
[    0.034175] audit: type=2000 audit(0.032:1): state=initialized audit_enabled=0 res=1
[    0.034440] thermal_sys: Registered thermal governor 'bang_bang'
[    0.034445] thermal_sys: Registered thermal governor 'step_wise'
[    0.034794] cpuidle: using governor menu
[    0.035034] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.035138] ASID allocator initialised with 65536 entries
[    0.035971] Serial: AMBA PL011 UART driver
[    0.048866] platform ff900000.vpu: Fixing up cyclic dependency with ff600000.hdmi-tx
[    0.054896] platform hdmi-connector: Fixing up cyclic dependency with ff600000.hdmi-tx
[    0.061067] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    0.061091] HugeTLB registered 32.0 MiB page size, pre-allocated 0 pages
[    0.061102] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.061112] HugeTLB registered 64.0 KiB page size, pre-allocated 0 pages
[    0.061966] cryptd: max_cpu_qlen set to 1000
[    0.063631] ACPI: Interpreter disabled.
[    0.064064] 5V: supplied by 12V
[    0.064222] VDDAO_3V3: supplied by 12V
[    0.064477] iommu: Default domain type: Translated 
[    0.064489] iommu: DMA domain TLB invalidation policy: strict mode 
[    0.064607] vgaarb: loaded
[    0.064782] SCSI subsystem initialized
[    0.064990] usbcore: registered new interface driver usbfs
[    0.065021] usbcore: registered new interface driver hub
[    0.065044] usbcore: registered new device driver usb
[    0.065248] mc: Linux media interface: v0.10
[    0.065269] videodev: Linux video capture interface: v2.00
[    0.065292] pps_core: LinuxPPS API ver. 1 registered
[    0.065300] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.065316] PTP clock support registered
[    0.065423] EDAC MC: Ver: 3.0.0
[    0.065827] FPGA manager framework
[    0.065876] Advanced Linux Sound Architecture Driver Initialized.
[    0.066553] clocksource: Switched to clocksource arch_sys_counter
[    0.066663] VFS: Disk quotas dquot_6.6.0
[    0.066702] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.067020] AppArmor: AppArmor Filesystem Enabled
[    0.067047] pnp: PnP ACPI: disabled
[    0.070316] NET: Registered PF_INET protocol family
[    0.070508] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.072553] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear)
[    0.072591] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.072608] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    0.072757] TCP bind hash table entries: 32768 (order: 7, 524288 bytes, linear)
[    0.072953] TCP: Hash tables configured (established 32768 bind 32768)
[    0.073043] UDP hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    0.073090] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    0.073232] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.073266] PCI: CLS 0 bytes, default 64
[    0.074035] kvm [1]: IPA Size Limit: 40 bits
[    0.074696] kvm [1]: vgic interrupt IRQ9
[    0.074822] kvm [1]: Hyp mode initialized successfully
[    0.077086] Initialise system trusted keyrings
[    0.077184] workingset: timestamp_bits=44 max_order=20 bucket_order=0
[    0.080724] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.080927] 9p: Installing v9fs 9p2000 file system support
[    0.109530] Key type asymmetric registered
[    0.109543] Asymmetric key parser 'x509' registered
[    0.109588] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245)
[    0.109676] io scheduler mq-deadline registered
[    0.109686] io scheduler kyber registered
[    0.112648] gpio-447 (usb-hub-reset): hogged as output/high
[    0.120897] soc soc0: Amlogic Meson G12B (S922X) Revision 29:a (40:2) Detected
[    0.121921] VDDCPU_A: supplied by 12V
[    0.122077] VDDCPU_B: supplied by 12V
[    0.124022] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    0.125317] ff803000.serial: ttyAML0 at MMIO 0xff803000 (irq = 25, base_baud = 1500000) is a meson_uart
[    1.091723] printk: console [ttyAML0] enabled
[    1.096361] ffd24000.serial: ttyAML1 at MMIO 0xffd24000 (irq = 33, base_baud = 1500000) is a meson_uart
[    1.109062] loop: module loaded
[    1.109364] zram: Added device: zram0
[    1.112278] zram: Added device: zram1
[    1.115891] zram: Added device: zram2
[    1.122046] tun: Universal TUN/TAP device driver, 1.6
[    1.124892] thunder_xcv, ver 1.0
[    1.127532] thunder_bgx, ver 1.0
[    1.130714] nicpf, ver 1.0
[    1.133735] hclge is initializing
[    1.136680] hns3: Hisilicon Ethernet Network Driver for Hip08 Family - version
[    1.143814] hns3: Copyright (c) 2017 Huawei Corporation.
[    1.149095] e1000e: Intel(R) PRO/1000 Network Driver
[    1.153985] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[    1.159871] igb: Intel(R) Gigabit Ethernet Network Driver
[    1.165196] igb: Copyright (c) 2007-2014 Intel Corporation.
[    1.170745] igbvf: Intel(R) Gigabit Virtual Function Network Driver
[    1.176927] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
[    1.182893] sky2: driver version 1.30
[    1.186675] VFIO - User Level meta-driver version: 0.3
[    1.192691] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.197981] ehci-pci: EHCI PCI platform driver
[    1.202394] ehci-platform: EHCI generic platform driver
[    1.207654] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    1.213672] ohci-pci: OHCI PCI platform driver
[    1.218091] ohci-platform: OHCI generic platform driver
[    1.223699] usbcore: registered new interface driver uas
[    1.228544] usbcore: registered new interface driver usb-storage
[    1.234506] usbcore: registered new interface driver usbserial_generic
[    1.240940] usbserial: USB Serial support registered for generic
[    1.248199] input: gpio-keys-polled as /devices/platform/gpio-keys-polled/input/input0
[    1.255281] i2c_dev: i2c /dev entries driver
[    1.261381] rtc-pcf8563 0-0051: low voltage detected, date/time is not reliable.
[    1.266478] rtc-pcf8563 0-0051: registered as rtc0
[    1.272179] rtc-pcf8563 0-0051: low voltage detected, date/time is not reliable.
[    1.278363] rtc-pcf8563 0-0051: hctosys: unable to read the hardware clock
[    1.286651] Driver for 1-wire Dallas network protocol.
[    1.290978] gpio-fan gpio-fan: GPIO fan initialized
[    1.297705] cpufreq: cpufreq_online: CPU2: Running at unlisted initial frequency: 999999 KHz, changing to: 1000000 KHz
[    1.306720] sdhci: Secure Digital Host Controller Interface driver
[    1.311820] sdhci: Copyright(c) Pierre Ossman
[    1.316204] Synopsys Designware Multimedia Card Interface Driver
[    1.322380] sdhci-pltfm: SDHCI platform and OF driver helper
[    1.328269] ledtrig-cpu: registered to indicate activity on CPUs
[    1.333856] meson-sm: secure-monitor enabled
[    1.337973] hid: raw HID events driver (C) Jiri Kosina
[    1.343134] usbcore: registered new interface driver usbhid
[    1.348474] usbhid: USB HID core driver
[    1.354607] IPVS: Registered protocols ()
[    1.356252] IPVS: Connection hash table configured (size=4096, memory=32Kbytes)
[    1.363541] IPVS: ipvs loaded.
[    1.366497] IPVS: [rr] scheduler registered.
[    1.370910] NET: Registered PF_INET6 protocol family
[    1.376072] Segment Routing with IPv6
[    1.379284] In-situ OAM (IOAM) with IPv6
[    1.383207] NET: Registered PF_PACKET protocol family
[    1.388186] Bridge firewalling registered
[    1.392145] 9pnet: Installing 9P2000 support
[    1.396375] Key type dns_resolver registered
[    1.400779] registered taskstats version 1
[    1.404628] Loading compiled-in X.509 certificates
[    1.409549] AppArmor: AppArmor sha1 policy hashing enabled
[    1.415042] VCC_3V3: supplied by VDDAO_3V3
[    1.418969] HUB_5V: supplied by 5V
[    1.422291] USB_PWR_EN: supplied by 5V
[    1.425981] VDDAO_1V8: supplied by VDDAO_3V3
[    1.476065] dwc3-meson-g12a ffe09000.usb: USB2 ports: 2
[    1.476096] dwc3-meson-g12a ffe09000.usb: USB3 ports: 1
[    1.483415] dwc2 ff400000.usb: supply vusb_d not found, using dummy regulator
[    1.487932] dwc2 ff400000.usb: supply vusb_a not found, using dummy regulator
[    1.495054] dwc2 ff400000.usb: EPs: 7, dedicated fifos, 712 entries in SPRAM
[    1.502302] xhci-hcd xhci-hcd.1.auto: xHCI Host Controller
[    1.507406] xhci-hcd xhci-hcd.1.auto: new USB bus registered, assigned bus number 1
[    1.515062] xhci-hcd xhci-hcd.1.auto: hcc params 0x0228fe6c hci version 0x110 quirks 0x0000002000010010
[    1.524314] xhci-hcd xhci-hcd.1.auto: irq 41, io mem 0xff500000
[    1.530173] xhci-hcd xhci-hcd.1.auto: xHCI Host Controller
[    1.535604] xhci-hcd xhci-hcd.1.auto: new USB bus registered, assigned bus number 2
[    1.543197] xhci-hcd xhci-hcd.1.auto: Host supports USB 3.0 SuperSpeed
[    1.549900] hub 1-0:1.0: USB hub found
[    1.553386] hub 1-0:1.0: 2 ports detected
[    1.557466] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    1.565503] hub 2-0:1.0: USB hub found
[    1.569086] hub 2-0:1.0: 1 port detected
[    1.573165] dwc3-meson-g12a ffe09000.usb: switching to Device Mode
[    1.580309] meson-gx-mmc ffe05000.sd: Got CD GPIO
[    1.583492] FLASH_1V8: supplied by VCC_3V3
[    1.587938] VCC_1V8: supplied by VCC_3V3
[    1.592626] meson-gx-mmc ffe07000.mmc: allocated mmc-pwrseq
[    1.597212] printk: console [netcon0] enabled
[    1.601504] netconsole: network logging started
[    1.606772] ALSA device list:
[    1.608913]   No soundcards found.
[    1.632013] Waiting for root device PARTUUID=48617373-06...
[    1.770865] mmc1: new HS200 MMC card at address 0001
[    1.771214] mmcblk1: mmc1:0001 AJTD4R 14.6 GiB 
[    1.776322]  mmcblk1: p1 p2 < p5 p6 p7 p8 p9 > p3 p4
[    1.780138] mmcblk1boot0: mmc1:0001 AJTD4R 4.00 MiB 
[    1.785064] mmcblk1boot1: mmc1:0001 AJTD4R 4.00 MiB 
[    1.789839] mmcblk1rpmb: mmc1:0001 AJTD4R 4.00 MiB, chardev (241:0)
[    1.807970] VFS: Mounted root (squashfs filesystem) readonly on device 179:6.
[    1.810433] devtmpfs: mounted
[    1.810568] usb 1-1: new high-speed USB device number 2 using xhci-hcd
[    1.812880] Freeing unused kernel memory: 2624K
[    1.830590] Run /sbin/init as init process
[    1.898106] systemd[1]: System time before build time, advancing clock.
[    1.924012] systemd[1]: MachineID '' is not valid, ignoring: Invalid argument
[    1.938602] systemd[1]: systemd 250 running in system mode (+PAM -AUDIT -SELINUX +APPARMOR -IMA -SMACK -SECCOMP -GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL -ELFUTILS -FIDO2 -IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE -BZIP2 -LZ4 -XZ +ZLIB -ZSTD -BPF_FRAMEWORK -XKBCOMMON -UTMP -SYSVINIT default-hierarchy=unified)
[    1.964121] systemd[1]: Detected architecture arm64.

Welcome to Home Assistant OS 9.3!

[    1.983721] systemd[1]: Hostname set to <homeassistant>.
[    1.984510] systemd[1]: Initializing machine ID from random generator.
[    1.989950] systemd[1]: Installed transient /etc/machine-id file.
[    2.029952] hub 1-1:1.0: USB hub found
[    2.030198] hub 1-1:1.0: 4 ports detected
[    2.098688] usb 2-1: new SuperSpeed USB device number 2 using xhci-hcd
[    2.141896] hub 2-1:1.0: USB hub found
[    2.142204] hub 2-1:1.0: 4 ports detected
[    2.146592] systemd[1]: Queued start job for default target Multi-User System.
[    2.167820] systemd[1]: Created slice Slice /system/ha-cli.
[  OK  ] Created slice Slice /system/ha-cli.
[    2.187407] systemd[1]: Created slice Slice /system/modprobe.
[  OK  ] Created slice Slice /system/modprobe.
[    2.211424] systemd[1]: Created slice Slice /system/serial-getty.
[  OK  ] Created slice Slice /system/serial-getty.
[    2.235328] systemd[1]: Created slice Slice /system/systemd-fsck.
[  OK  ] Created slice Slice /system/systemd-fsck.
[    2.255358] systemd[1]: Created slice Slice /system/systemd-growfs.
[  OK  ] Created slice Slice /system/systemd-growfs.
[    2.275140] systemd[1]: Created slice User and Session Slice.
[  OK  ] Created slice User and Session Slice.
[    2.298733] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[  OK  ] Started Dispatch Password âts to Console Directory Watch.
[    2.318658] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[  OK  ] Started Forward Password Râuests to Wall Directory Watch.
[    2.338710] systemd[1]: Reached target Local Encrypted Volumes.
[  OK  ] Reached target Local Encrypted Volumes.
[    2.358614] systemd[1]: Reached target HassOS hardware targets.
[  OK  ] Reached target HassOS hardware targets.
[    2.378609] systemd[1]: Reached target HassOS zram targets.
[  OK  ] Reached target HassOS zram targets.
[    2.398595] systemd[1]: Reached target Local Integrity Protected Volumes.
[  OK  ] Reached target Local Integrity Protected Volumes.
[    2.418658] systemd[1]: Reached target Path Units.
[  OK  ] Reached target Path Units.
[    2.434609] systemd[1]: Reached target Remote Encrypted Volumes.
[  OK  ] Reached target Remote Encrypted Volumes.
[    2.454594] systemd[1]: Reached target Remote File Systems.
[  OK  ] Reached target Remote File Systems.
[    2.474591] systemd[1]: Reached target Remote Verity Protected Volumes.
[  OK  ] Reached target Remote Verity Protected Volumes.
[    2.494592] systemd[1]: Reached target Slice Units.
[  OK  ] Reached target Slice Units.
[    2.510637] systemd[1]: Reached target Local Verity Protected Volumes.
[  OK  ] Reached target Local Verity Protected Volumes.
[    2.531351] systemd[1]: Listening on D-Bus System Message Bus Socket.
[  OK  ] Listening on D-Bus System Message Bus Socket.
[    2.552959] systemd[1]: Listening on Process Core Dump Socket.
[  OK  ] Listening on Process Core Dump Socket.
[    2.570861] systemd[1]: Listening on Journal Audit Socket.
[  OK  ] Listening on Journal Audit Socket.
[    2.590770] systemd[1]: Listening on Journal Socket (/dev/log).
[  OK  ] Listening on Journal Socket (/dev/log).
[    2.610782] systemd[1]: Listening on Journal Socket.
[  OK  ] Listening on Journal Socket.
[    2.627256] systemd[1]: Listening on udev Control Socket.
[  OK  ] Listening on udev Control Socket.
[    2.646762] systemd[1]: Listening on udev Kernel Socket.
[  OK  ] Listening on udev Kernel Socket.
[    2.679691] systemd[1]: Mounting Huge Pages File System...
         Mounting Huge Pages File System...
[    2.696201] systemd[1]: Mounting POSIX Message Queue File System...
         Mounting POSIX Message Queue File System...
[    2.714941] systemd[1]: Kernel Debug File System was skipped because of a failed condition check (ConditionPathExists=/sys/kernel/debug).
[    2.721767] systemd[1]: Kernel Trace File System was skipped because of a failed condition check (ConditionPathExists=/sys/kernel/tracing).
[    2.736009] systemd[1]: Starting Home Assistant OS Agent...
         Starting Home Assistant OS Agent...
[    2.758609] systemd[1]: Starting Create List of Static Device Nodes...
         Starting Create List of Static Device Nodes...
[    2.780618] systemd[1]: Starting Load Kernel Module configfs...
         Starting Load Kernel Module configfs...
[    2.796282] systemd[1]: Starting Load Kernel Module drm...
         Starting Load Kernel Module drm...
[    2.812354] systemd[1]: Starting Load Kernel Module fuse...
         Starting Load Kernel Module fuse...
[    2.818288] fuse: init (API version 7.34)
[    2.841352] systemd[1]: Starting Journal Service...
         Starting Journal Service...
[    2.860382] systemd[1]: Starting Generate network units from Kernel command line...
         Starting Generate network âts from Kernel command line...
[    2.884347] systemd[1]: Starting Remount Root and Kernel File Systems...
         Starting Remount Root and Kernel File Systems...
[    2.904545] systemd[1]: Starting Wait Until Kernel Time Synchronized...
         Starting Wait Until Kernel Time Synchronized...
[    2.959850] systemd[1]: Starting Coldplug All udev Devices...
         Starting Coldplug All udev Devices...
[    2.976529] systemd[1]: Starting Disk Manager...
         Starting Disk Manager...
[    2.992750] systemd[1]: Starting HassOS ZRAM swap...
         Starting HassOS ZRAM swap...
[    3.009006] systemd[1]: Starting HassOS ZRAM tmp...
         Starting HassOS ZRAM tmp...
[    3.017568] zram2: detected capacity change from 0 to 32768
[    3.018322] zram0: detected capacity change from 0 to 1938960
[    3.044389] systemd[1]: Starting HassOS ZRAM var...
         Starting HassOS ZRAM var[    3.047475] zram1: detected capacity change from 0 to 65536
...
[    3.071774] systemd[1]: Started Journal Service.
[  OK  ] Started Journal Service.
[  OK  ] Mounted Huge Pages File System.
[  OK  ] Mounted POSIX Message Queue File System.
[  OK  ] Finished Create List of Static Device Nodes.
[  OK  ] Finished Load Kernel Module configfs.
[  OK  ] Finished Load Kernel Module drm.
[  OK  ] Finished Load Kernel Module fuse.
[  OK  ] Finished Generate network units from Kernel command line.
[  OK  ] Finished Remount Root and Kernel File Systems.
[  OK  ] Reached target Preparation for Network.
         Mounting FUSE Control File System...
         Mounting Kernel Configuration File System...
         Starting D-Bus System Message Bus...
         Starting Create Static Device Nodes in /dev...
[    3.344031] random: dbus-broker-lau: uninitialized urandom read (8 bytes read)
[    3.347894] random: dbus-broker-lau: uninitialized urandom read (8 bytes read)
[    3.353718] random: dbus-broker-lau: uninitialized urandom read (8 bytes read)
[  OK  ] Started D-Bus System Message Bus.
[  OK  ] Finished Coldplug All udev Devices.
[  OK  ] Mounted FUSE Control File System.
[  OK  ] Started Home Assistant OS Agent.
[  OK  ] Mounted Kernel Configuration File System.
[  OK  ] Finished Create Static Device Nodes in /dev.
[  OK  ] Reached target Preparation for Local File Systems.
[    3.548702] audit: type=1334 audit(1654193355.648:2): prog-id=6 op=LOAD
[    3.549721] audit: type=1334 audit(1654193355.648:3): prog-id=7 op=LOAD
[    3.556284] audit: type=1334 audit(1654193355.656:4): prog-id=8 op=LOAD
         Starting Rule-based Manageâfor Device Events and Files...
[  OK  ] Started Rule-based Manager for Device Events and Files.
[    3.662239] audit: type=1701 audit(1654193355.760:5): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=unconfined pid=217 comm="systemd-udevd" exe="/usr/bin/udevadm" sig=6 res=1
[    3.688235] audit: type=1701 audit(1654193355.788:6): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=unconfined pid=209 comm="systemd-udevd" exe="/usr/bin/udevadm" sig=11 res=1
[  OK  ] Stopped Rule-based Manager for Device Events and Files.
[    3.746919] audit: type=1334 audit(1654193355.848:7): prog-id=0 op=UNLOAD
[    3.748764] audit: type=1334 audit(1654193355.848:8): prog-id=9 op=LOAD
[    3.754685] audit: type=1334 audit(1654193355.856:9): prog-id=10 op=LOAD
[    3.761293] audit: type=1334 audit(1654193355.860:10): prog-id=11 op=LOAD
         Starting Rule-based Manageâfor Device Events and Files...
[  OK  ] Started Rule-based Manager for Device Events and Files.
[    3.884453] meson-drm ff900000.vpu: Queued 2 outputs on vpu
[    3.891245] meson-drm ff900000.vpu: CVBS Output connector not available
[    3.892022] meson8b-dwmac ff3f0000.ethernet: IRQ eth_wake_irq not found
[    3.898870] meson8b-dwmac ff3f0000.ethernet: IRQ eth_lpi not found
[    3.900114] Registered IR keymap rc-cec
[    3.905128] meson8b-dwmac ff3f0000.ethernet: PTP uses main clock
[    3.909658] rc rc0: meson_g12a_ao_cec as /devices/platform/soc/ff800000.bus/ff800280.cec/rc/rc0
[    3.915449] meson8b-dwmac ff3f0000.ethernet: User ID: 0x11, Synopsys ID: 0x37
[    3.924269] meson-vrtc ff8000a8.rtc: registered as rtc1
[    3.926669] meson-dw-hdmi ff600000.hdmi-tx: Detected HDMI TX controller v2.01a with HDCP (meson_dw_hdmi_phy)
[    3.930495] meson8b-dwmac ff3f0000.ethernet:     DWMAC1000
[    3.931581] meson-dw-hdmi ff600000.hdmi-tx: registered DesignWare HDMI I2C bus driver
[    3.931766] meson-drm ff900000.vpu: bound ff600000.hdmi-tx (ops meson_dw_hdmi_platform_driver_exit [meson_dw_hdmi])
[    3.932007] [drm] Initialized meson 1.0.0 20161109 for ff900000.vpu on minor 0
[    3.933299] input: meson_g12a_ao_cec as /devices/platform/soc/ff800000.bus/ff800280.cec/rc/rc0/input1
[    3.958622] Registered IR keymap rc-odroid
[    3.958827] panfrost ffe40000.gpu: clock rate = 24000000
[    3.958872] panfrost ffe40000.gpu: dev_pm_opp_set_regulators: no regulator (mali) found: -19
[    3.959051] panfrost ffe40000.gpu: [drm:panfrost_devfreq_init [panfrost]] Failed to register cooling device
[    3.959232] panfrost ffe40000.gpu: mali-g52 id 0x7212 major 0x0 minor 0x0 status 0x0
[    3.959238] panfrost ffe40000.gpu: features: 00000000,13de77ff, issues: 00000000,00000400
[    3.959243] panfrost ffe40000.gpu: Features: L2:0x07110206 Shader:0x00000000 Tiler:0x00000809 Mem:0x1 MMU:0x00002830 AS:0xff JS:0x7
[    3.959248] panfrost ffe40000.gpu: shader_present=0x3 l2_present=0x1
[    3.965798] [drm] Initialized panfrost 1.2.0 20180908 for ffe40000.gpu on minor 1
[    3.970148] meson8b-dwmac ff3f0000.ethernet: DMA HW capability register supported
[    4.011768] rc_core: Loaded IR protocol module ir-nec-decoder, but protocol nec still not available
[    4.013056] meson8b-dwmac ff3f0000.ethernet: RX Checksum Offload Engine supported
[    4.024494] rc rc1: meson-ir as /devices/platform/soc/ff800000.bus/ff808000.ir/rc/rc1
[    4.028301] meson8b-dwmac ff3f0000.ethernet: COE Type 2
[    4.040651] input: meson-ir as /devices/platform/soc/ff800000.bus/ff808000.ir/rc/rc1/input2
[    4.046059] meson8b-dwmac ff3f0000.ethernet: TX Checksum insertion supported
[    4.078918] meson-ir ff808000.ir: receiver initialized
[    4.085094] meson8b-dwmac ff3f0000.ethernet: Wake-Up On Lan supported
[  OK  ] Found device /dev/ttyAML0.
[    4.116980] meson8b-dwmac ff3f0000.ethernet: Normal descriptors
[    4.116987] meson8b-dwmac ff3f0000.ethernet: Ring mode enabled
[    4.116990] meson8b-dwmac ff3f0000.ethernet: Enable RX Mitigation via HW Watchdog Timer
[    4.299901] Console: switching to colour frame buffer device 128x48
[    4.335597] meson-drm ff900000.vpu: [drm] fb0: mesondrmfb frame buffer device
[  OK  ] Found device /dev/zram1.
[  OK  ] Found device /dev/zram2.
[  OK  ] Found device /dev/zram0.
[  OK  ] Found device /dev/disk/by-label/hassos-boot.
[  OK  ] Found device /dev/disk/by-label/hassos-overlay.
[  OK  ] Found device /dev/disk/by-label/hassos-data.
[  OK  ] Reached target Sound Card.
[  OK  ] Reached target Hardware activated USB gadget.
         Starting File System Checkâv/disk/by-label/hassos-boot...
         Starting File System Checkâv/disk/by-label/hassos-data...
         Starting File System CheckâŠisk/by-label/hassos-overlay...
[  OK  ] Finished File System Checkâdev/disk/by-label/hassos-boot.
         Mounting HassOS boot partition...
[  OK  ] Finished File System Checkâdev/disk/by-label/hassos-data.
[  OK  ] Finished File System Checkâ/disk/by-label/hassos-overlay.
[  OK  ] Mounted HassOS boot partition.
         Mounting HassOS overlay partition...
[    4.719964] EXT4-fs (mmcblk1p3): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none.
[  OK  ] Mounted HassOS overlay partition.
         Mounting Dropbear persistent keys...
         Mounting Kernel persistent modprobe.d...
         Mounting Kernel persistent modules-load.d...
         Mounting Udev persistent rules.d...
         Mounting Docker persistent user...
         Mounting Dropbear persistent user...
         Starting HassOS data resizing...
         Starting HassOS overlay setup...
[  OK  ] Mounted Dropbear persistent keys.
[  OK  ] Mounted Kernel persistent modprobe.d.
[  OK  ] Mounted Kernel persistent modules-load.d.
[  OK  ] Mounted Udev persistent rules.d.
[  OK  ] Mounted Docker persistent user.
[  OK  ] Mounted Dropbear persistent user.
[  OK  ] Finished HassOS overlay setup.
         Mounting NetworkManager persistent system connections...
         Mounting Hostname persistent configuration...
         Mounting Hosts persistent configuration...
         Mounting Timesyncd persistent configuration...
         Starting Retrigger udev rules after user rules mounted...
[  OK  ] Stopped File System Check âdev/disk/by-label/hassos-data.
         Starting Apply Kernel Variables...
[  OK  ] Mounted NetworkManager persistent system connections.
[  OK  ] Mounted Hostname persistent configuration.
[  OK  ] Mounted Hosts persistent configuration.
[  OK  ] Mounted Timesyncd persistent configuration.
[  OK  ] Finished Apply Kernel Variables.
[  OK  ] Finished HassOS data resizing.
         Mounting HassOS data partition...
[  OK  ] Mounted HassOS data partition.
         Starting Grow File System on /mnt/data...
[  OK  ] Finished Retrigger udev rules after [    5.445139] kernel BUG at arch/arm64/kernel/traps.c:498!
[    5.448553] Internal error: Oops - BUG: 0 [#1] PREEMPT SMP
[    5.453976] Modules linked in: realtek dwmac_generic dw_hdmi_i2s_audio panfrost crct10dif_ce gpu_sched rc_odroid meson_ir ao_cec_g12a rtc_meson_vrtc dwmac_meson8b stmmac_platform meson_drm meson_dw_hdmi dw_hdmi stmmac cec pcs_xpcs rc_core display_connector snd_soc_simple_amplifier fuse
[    5.479229] CPU: 3 PID: 367 Comm: systemd-udevd Not tainted 5.15.74 #1
[    5.485546] Hardware name: Hardkernel ODROID-N2 (DT)
[    5.490450] pstate: 00000005 (nzcv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[    5.497363] pc : do_undefinstr+0x2c0/0x2e0
[    5.499644] EXT4-fs (mmcblk1p4): resized filesystem to 3636992
[    5.501395] lr : do_undefinstr+0x160/0x2e0
[    5.511231] sp : ffff80000a393860
[    5.514499] x29: ffff80000a393860 x28: ffff00000c52aac0 x27: ffff00000c52aac0
[    5.521600] x26: ffff80000946b000 x25: ffff000007a81400 x24: ffff0000e4652100
[    5.528674] x23: 0000000040000005 x22: ffff8000095d10e0 x21: 00000000d538d080
[    5.535747] x20: ffff00000c52aac0 x19: ffff80000a3938f0 x18: 0000000000000000
[    5.542819] x17: 0000000000000000 x16: 0000000000000000 x15: 0000000000000000
[    5.549902] x14: 0000000000000000 x13: 0000000000000000 x12: fefefefefefefeff
[    5.558926] x11: ffff00000c52aac0 x10: 0000aaaaf87bfb30 x9 : 0000000000000000
[    5.565985] x8 : ffff000007a81400 x7 : 0000000000000000 x6 : 000000000000001f
[    5.573020] x5 : 0000000000000000 x4 : ffff800009478150 x3 : 0000000000000005
[    5.580064] x2 : 0000000000000000 x1 : ffff00000c52aac0 x0 : 0000000040000005
[    5.587100] Call trace:
[    5.589232]  do_undefinstr+0x2c0/0x2e0
[    5.592963]  el1_undef+0x30/0x50
[    5.596331]  el1h_64_sync_handler+0x80/0xd0
[    5.600441]  el1h_64_sync+0x78/0x7c
[    5.603789]  mod_objcg_state+0x64/0x380
[    5.607632]  kmem_cache_alloc+0x280/0x4d0
[    5.611512]  __alloc_file+0x2c/0xf0
[    5.614949]  alloc_empty_file+0x60/0x100
[    5.618857]  path_openat+0x4c/0xfb0
[    5.622273]  do_filp_open+0x84/0x110
[    5.625790]  do_sys_openat2+0x214/0x2e0
[    5.629556]  do_sys_open+0x58/0xb0
[    5.632814]  __arm64_sys_openat+0x24/0x30
[    5.636834]  invoke_syscall+0x44/0x110
[    5.640537]  el0_svc_common.constprop.0+0xcc/0xf0
[    5.645176]  do_el0_svc+0x24/0x90
[    5.648424]  el0_svc+0x20/0x60
[    5.651382]  el0t_64_sync_handler+0xb0/0xc0
[    5.655546]  el0t_64_sync+0x1a0/0x1a4
[    5.659158] Code: 17ffff8d f9401bf7 17ffffca f9001bf7 (d4210000) 
[    5.665267] ---[ end trace d3ac3d64f6ae0e08 ]---
[    5.669823] note: systemd-udevd[367] exited with preempt_count 2
user rules mounted.
[    5.679212] kauditd_printk_skb: 3 callbacks suppressed
[    5.679222] audit: type=1701 audit(1654193357.780:14): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=unconfined pid=357 comm="systemd-udevd" exe="/usr/bin/udevadm" sig=11 res=1
[    5.715630] ------------[ cut here ]------------
[    5.716987] WARNING: CPU: 3 PID: 0 at kernel/rcu/tree.c:613 rcu_eqs_enter.isra.0+0x7c/0x90
[    5.724103] Modules linked in: realtek dwmac_generic dw_hdmi_i2s_audio panfrost crct10dif_ce gpu_sched rc_odroid meson_ir ao_cec_g12a rtc_meson_vrtc dwmac_meson8b stmmac_platform meson_drm meson_dw_hdmi dw_hdmi stmmac cec pcs_xpcs rc_core display_connector snd_soc_simple_amplifier fuse
[    5.751775] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G      D           5.15.74 #1
[    5.756541] Hardware name: Hardkernel ODROID-N2 (DT)
[    5.761450] pstate: 200000c5 (nzCv daIF -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[    5.768349] pc : rcu_eqs_enter.isra.0+0x7c/0x90
[    5.772822] lr : rcu_idle_enter+0x10/0x20
[    5.776774] sp : ffff800009703dc0
[    5.780058] x29: ffff800009703dc0 x28: 0000000000000000 x27: ffff000000190e40
[    5.787159] x26: 0000000000000000 x25: 0000000000000000 x24: ffff80000946b350
[    5.794215] x23: ffff000000190e40 x22: ffff800009288238 x21: ffff80000946b228
[    5.801300] x20: ffff80000946b320 x19: ffff0000e07ce2c0 x18: 0000000000000000
[    5.808361] x17: 0000000000000000 x16: 0000000000000500 x15: 0000000000000003
[    5.815432] x14: 0000000000000000 x13: 0000000000000000 x12: 0000000000000000
[    5.822498] x11: 0000000000000006 x10: 0000000000000a00 x9 : ffff800009703d50
[    5.829557] x8 : ffff0000001918a0 x7 : 0000000000000000 x6 : 000000000bc35ecb
[    5.836645] x5 : 00ffffffffffffff x4 : 0000000000000a50 x3 : ffff8000d7544000
[    5.843709] x2 : 0000000000000000 x1 : 4000000000000002 x0 : 4000000000000000
[    5.850809] Call trace:
[    5.853177]  rcu_eqs_enter.isra.0+0x7c/0x90
[    5.857331]  rcu_idle_enter+0x10/0x20
[    5.860952]  default_idle_call+0x1c/0x68
[    5.864833]  do_idle+0x214/0x260
[    5.868033]  cpu_startup_entry+0x28/0x70
[    5.871916]  secondary_start_kernel+0x160/0x170
[    5.876393]  __secondary_switched+0x90/0x94
[    5.880535] ---[ end trace d3ac3d64f6ae0e09 ]---
[  OK  ] Finished Grow File System on /mnt/data.
[  OK  ] Created slice Slice /system/systemd-coredump.
[  OK  ] Finished HassOS ZRAM swap.
         Activating swap HassOS ZRAM swap...
[    6.300984] Adding 969476k swap on /dev/zram0.  Priority:-2 extents:1 across:969476k SS
[  OK  ] Activated swap HassOS ZRAM swap.
[  OK  ] Reached target Swaps.
[  OK  ] Started Disk Manager.
[  OK  ] Finished HassOS ZRAM tmp.
         Mounting Temporary Directory /tmp...
[    7.103271] EXT4-fs (zram2): mounted filesystem without journal. Opts: nobarrier. Quota mode: none.
[  OK  ] Finished HassOS ZRAM var.
[  OK  ] Mounted Temporary Directory /tmp.
         Mounting HassOS ZRAM var...
[    7.195430] EXT4-fs (zram1): mounted filesystem without journal. Opts: nobarrier. Quota mode: none.
[  OK  ] Mounted HassOS ZRAM var.
         Mounting NetworkManager persistent data...
         Mounting Bluetooth persistent state...
         Mounting Docker persistent data...
         Mounting Systemd persistent state...
         Mounting Systemd persistent logging...
[  OK  ] Mounted NetworkManager persistent data.
[  OK  ] Mounted Bluetooth persistent state.
[  OK  ] Mounted Docker persistent data.
[  OK  ] Mounted Systemd persistent state.
[  OK  ] Mounted Systemd persistent logging.
[  OK  ] Reached target HassOS overlay targets.
[  OK  ] Reached target Local File Systems.
         Starting Flush Journal to Persistent Storage...
[    7.450161] systemd-journald[178]: Received client request to flush runtime journal.
         Starting Load/Save Random Seed...
[  OK  ] Finished Flush Journal to Persistent Storage.
         Starting Create Volatile Files and Directories...
[  OK  ] Finished Create Volatile Files and Directories.
[  OK  ] Reached target System Initialization.
[  OK  ] Started Daily Cleanup of Temporary Directories.
         Starting Docker Socket for the API...
[  OK  ] Listening on Journal Gateway Service Socket.
[    7.796564] audit: type=1334 audit(1654193359.896:15): prog-id=12 op=LOAD
         Starting Network Name Resolution...
[    7.819973] audit: type=1334 audit(1654193359.920:16): prog-id=13 op=LOAD
[    7.822541] audit: type=1334 audit(1654193359.920:17): prog-id=14 op=LOAD
[    7.829228] audit: type=1334 audit(1654193359.928:18): prog-id=15 op=LOAD
[  OK  ] Started Process Core Dump (PID 386/UID 0).
[  OK  ] Listening on Docker Socket for the API.
[  OK  ] Reached target Socket Units.
[  OK  ] Reached target Basic System.
         Starting Network Manager...
         Starting HassOS persists data on bootstate...
         Starting Rauc Update Service...
[  OK  ] Started Hardware RNG Entropy Gatherer Daemon.
[    7.983971] audit: type=1334 audit(1654193360.084:19): prog-id=16 op=LOAD
[    7.986659] audit: type=1334 audit(1654193360.084:20): prog-id=17 op=LOAD
[    7.993312] audit: type=1334 audit(1654193360.092:21): prog-id=18 op=LOAD
         Starting User Login Management...
         Starting WPA supplicant...
[  OK  ] Finished HassOS persists data on bootstate.
[    8.042321] random: wpa_supplicant: uninitialized urandom read (4096 bytes read)
[  OK  ] Started Rauc Update Service.
[  OK  ] Started WPA supplicant.
[  OK  ] Started Network Manager.
[    8.085117] random: NetworkManager: uninitialized urandom read (16 bytes read)
[  OK  ] Started User Login Management.
[    8.144146] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[    8.152883] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
         Starting Network Manager Wait Online...
[    8.181592] audit: type=1334 audit(1654193360.280:22): prog-id=19 op=LOAD
[    8.184220] audit: type=1334 audit(1654193360.280:23): prog-id=0 op=UNLOAD
         Starting Hostname Service[    8.195830] random: nm-online: uninitialized urandom read (16 bytes read)
...
[  OK  ] Started Process Core Dump (PID 472/UID 0).
[  OK  ] Started Hostname Service.
         Starting Network Manager Script Dispatcher Service...
[  OK  ] Started Network Manager Script Dispatcher Service.
[    8.510576] meson8b-dwmac ff3f0000.ethernet eth0: PHY [0.0:00] driver [RTL8211F Gigabit Ethernet] (irq=42)
[    8.518391] meson8b-dwmac ff3f0000.ethernet eth0: Register MEM_TYPE_PAGE_POOL RxQ-0
[    8.535040] meson8b-dwmac ff3f0000.ethernet eth0: No Safety Features support found
[    8.538984] meson8b-dwmac ff3f0000.ethernet eth0: PTP not supported by HW
[    8.545983] meson8b-dwmac ff3f0000.ethernet eth0: configuring for phy/rgmii link mode
[*     ] (1 of 4) A start job is running forâd/Save Random Seed (8s / 10min 5s)
[   11.022557] random: crng init done
[   11.023902] random: 14 urandom warning(s) missed due to ratelimiting
[  OK  ] Finished Load/Save Random Seed.
[  OK  ] Started Network Name Resolution.
[  OK  ] Reached target Network.
[  OK  ] Reached target Host and Network Name Lookups.
         Starting HassOS Configuration Manager...
         Starting Permit User Sessions...
[  OK  ] Finished Permit User Sessions.
[  OK  ] Finished HassOS Configuration Manager.
[   11.596687] meson8b-dwmac ff3f0000.ethernet eth0: Link is Up - 1Gbps/Full - flow control rx/tx
[   11.601639] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[**    ] (1 of 2) A start job is running forâTime Synchronized (11s / 1min 30s)
[***   ] (1 of 2) A start job is running forâTime Synchronized (11s / 1min 30s)
[ ***  ] (2 of 2) A start job is running forânager Wait Online (12s / no limit)
[  *** ] (2 of 2) A start job is running forânager Wait Online (13s / no limit)
[   ***] (2 of 2) A start job is running forânager Wait Online (13s / no limit)
[    **] (1 of 2) A start job is running forâTime Synchronized (14s / 1min 30s)
[     *] (1 of 2) A start job is running forâTime Synchronized (14s / 1min 30s)
[    **] (1 of 2) A start job is running forâTime Synchronized (15s / 1min 30s)
[   ***] (2 of 2) A start job is running forânager Wait Online (15s / no limit)
[  *** ] (2 of 2) A start job is running forânager Wait Online (16s / no limit)
[ ***  ] (2 of 2) A start job is running forânager Wait Online (17s / no limit)
[***   ] (1 of 2) A start job is running forâTime Synchronized (17s / 1min 30s)
[**    ] (1 of 2) A start job is running forâTime Synchronized (18s / 1min 30s)
[*     ] (1 of 2) A start job is running forâTime Synchronized (18s / 1min 30s)
[**    ] (2 of 2) A start job is running forânager Wait Online (19s / no limit)
[***   ] (2 of 2) A start job is running forânager Wait Online (20s / no limit)
[ ***  ] (2 of 2) A start job is running forânager Wait Online (20s / no limit)
[  *** ] (1 of 2) A start job is running forâTime Synchronized (21s / 1min 30s)
[   ***] (1 of 2) A start job is running forâTime Synchronized (21s / 1min 30s)
[    **] (1 of 2) A start job is running forâTime Synchronized (22s / 1min 30s)
[     *] (2 of 2) A start job is running forânager Wait Online (22s / no limit)
[    **] (2 of 2) A start job is running forânager Wait Online (23s / no limit)
[   ***] (2 of 2) A start job is running forânager Wait Online (24s / no limit)
[  *** ] (1 of 2) A start job is running forâTime Synchronized (24s / 1min 30s)
[ ***  ] (1 of 2) A start job is running forâTime Synchronized (25s / 1min 30s)
[***   ] (1 of 2) A start job is running forâTime Synchronized (25s / 1min 30s)
[**    ] (2 of 2) A start job is running forânager Wait Online (26s / no limit)
[*     ] (2 of 2) A start job is running forânager Wait Online (27s / no limit)
[**    ] (2 of 2) A start job is running forânager Wait Online (27s / no limit)
[***   ] (1 of 2) A start job is running forâTime Synchronized (28s / 1min 30s)
[ ***  ] (1 of 2) A start job is running forâTime Synchronized (28s / 1min 30s)
[  *** ] (1 of 2) A start job is running forâTime Synchronized (29s / 1min 30s)
[   31.710566] TF_IO: disabling
[   ***] (2 of 2) A start job is running forânager Wait Online (29s / no limit)
[    **] (2 of 2) A start job is running forânager Wait Online (30s / no limit)
[     *] (2 of 2) A start job is running forânager Wait Online (31s / no limit)
[    **] (1 of 2) A start job is running forâTime Synchronized (31s / 1min 30s)
[   ***] (1 of 2) A start job is running forâTime Synchronized (32s / 1min 30s)
[  *** ] (1 of 2) A start job is running forâTime Synchronized (32s / 1min 30s)
[ ***  ] (2 of 2) A start job is running forânager Wait Online (33s / no limit)
[***   ] (2 of 2) A start job is running forânager Wait Online (34s / no limit)
[**    ] (2 of 2) A start job is running forânager Wait Online (34s / no limit)
[*     ] (1 of 2) A start job is running forâTime Synchronized (35s / 1min 30s)
[**    ] (1 of 2) A start job is running forâTime Synchronized (35s / 1min 30s)
[***   ] (1 of 2) A start job is running forâTime Synchronized (36s / 1min 30s)
[   38.450651] kauditd_printk_skb: 11 callbacks suppressed
[   38.450662] audit: type=1334 audit(1654193390.552:35): prog-id=0 op=UNLOAD
[   38.459095] audit: type=1334 audit(1654193390.552:36): prog-id=0 op=UNLOAD
[   38.465896] audit: type=1334 audit(1654193390.552:37): prog-id=0 op=UNLOAD
[ ***  ] (2 of 2) A start job is running forânager Wait Online (36s / no limit)
[  *** ] (2 of 2) A start job is running forânager Wait Online (37s / no limit)
[   ***] (2 of 2) A start job is running forânager Wait Online (37s / no limit)
[    **] (1 of 2) A start job is running forâTime Synchronized (38s / 1min 30s)
[     *] (1 of 2) A start job is running forâTime Synchronized (38s / 1min 30s)
[    **] (1 of 2) A start job is running forâTime Synchronized (39s / 1min 30s)
[   ***] (2 of 2) A start job is running forânager Wait Online (39s / no limit)
[  *** ] (2 of 2) A start job is running forânager Wait Online (40s / no limit)
[ ***  ] (2 of 2) A start job is running forânager Wait Online (40s / no limit)
[***   ] (1 of 2) A start job is running forâTime Synchronized (41s / 1min 30s)
[**    ] (1 of 2) A start job is running forâTime Synchronized (41s / 1min 30s)
[*     ] (1 of 2) A start job is running forâTime Synchronized (42s / 1min 30s)
[**    ] (2 of 2) A start job is running forânager Wait Online (42s / no limit)
[***   ] (2 of 2) A start job is running forânager Wait Online (43s / no limit)
         Starting Network Manager Script Dispatcher Service...
[  OK  ] Started Network Manager Script Dispatcher Service.
[  OK  ] Finished Network Manager Wait Online.
[  OK  ] Reached target Network is Online.
[   45.635761] audit: type=1334 audit(1654193397.736:38): prog-id=25 op=LOAD
         Starting Network Time Synchronization...
[  OK  ] Stopped Network Time Synchronization.
[   45.706828] audit: type=1334 audit(1654193397.808:39): prog-id=0 op=UNLOAD
[   45.710085] audit: type=1334 audit(1654193397.808:40): prog-id=26 op=LOAD
         Starting Network Time Synchronization...
[  OK  ] Started Network Time Synchronization[   45.845892] systemd-journald[178]: Oldest entry in /var/log/journal/417b64c3f25f4e3986540d50137706aa/system.journal is older than the configured file retention duration (1month), suggesting rotation.
.
[   45.865103] systemd-journald[178]: /var/log/journal/417b64c3f25f4e3986540d50137706aa/system.journal: Journal header limits reached or header out-of-date, rotating.
[  OK  ] Finished Wait Until Kernel Time Synchronized.
[  OK  ] Reached target System Time Set.
[  OK  ] Reached target System Time Synchronized.
[  OK  ] Started Discard unused blocks once a week.
[  OK  ] Reached target Timer Units.
         Starting HassOS AppArmor...
[   46.233097] audit: type=1400 audit(1667221459.166:41): apparmor="STATUS" operation="profile_load" profile="unconfined" name="hassio-supervisor" pid=511 comm="apparmor_parser"
[   46.247691] audit: type=1300 audit(1667221459.166:41): arch=c00000b7 syscall=64 success=yes exit=15265 a0=6 a1=aaab1831fc50 a2=3ba1 a3=ffffba645fa0 items=0 ppid=510 pid=511 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="apparmor_parser" exe="/usr/sbin/apparmor_parser" subj=unconfined key=(null)
[  OK  ] Finished HassOS AppArmor.
[   46.281416] audit: type=1327 audit(1667221459.166:41): proctitle=61707061726D6F725F706172736572002D72002D57002D4C002F6D6E742F646174612F73757065727669736F722F61707061726D6F722F6361636865002F6D6E742F646174612F73757065727669736F722F61707061726D6F722F68617373696F2D73757065727669736F72
[   46.311882] audit: type=1400 audit(1667221459.166:42): apparmor="STATUS" operation="profile_load" profile="unconfined" name="hassio-supervisor///usr/bin/gdbus" pid=511 comm="apparmor_parser"
[   46.328906] audit: type=1300 audit(1667221459.166:42): arch=c00000b7 syscall=64 success=yes exit=11249 a0=6 a1=aaab183728d0 a2=2bf1 a3=ffffba645fa0 items=0 ppid=510 pid=511 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="apparmor_parser" exe="/usr/sbin/apparmor_parser" subj=unconfined key=(null)
[   46.360268] audit: type=1327 audit(1667221459.166:42): proctitle=61707061726D6F725F706172736572002D72002D57002D4C002F6D6E742F646174612F73757065727669736F722F61707061726D6F722F6361636865002F6D6E742F646174612F73757065727669736F722F61707061726D6F722F68617373696F2D73757065727669736F72
[   46.386549] audit: type=1400 audit(1667221459.166:43): apparmor="STATUS" operation="profile_load" profile="unconfined" name="hassio-supervisor///usr/bin/git" pid=511 comm="apparmor_parser"
         Starting Docker Application Container Engine...
[   47.627328] Initializing XFRM netlink socket
[  OK  ] Started Docker Application Container Engine.
         Starting HassOS supervisor...
[  OK  ] Started HassOS supervisor.
[  OK  ] Started Home Assistant CLI.
[  OK  ] Started Serial Getty on ttyAML0.
[  OK  ] Reached target Login Prompts.
[  OK  ] Reached target Multi-User System.
[   48.553700] docker0: port 1(veth3511f19) entered blocking state
[   48.554028] docker0: port 1(veth3511f19) entered disabled state
[   48.560128] device veth3511f19 entered promiscuous mode
[   48.565386] docker0: port 1(veth3511f19) entered blocking state
[   48.570951] docker0: port 1(veth3511f19) entered forwarding state
[   48.577213] docker0: port 1(veth3511f19) entered disabled state
[   49.007610] eth0: renamed from vetha2ad2b8
[   49.023459] IPv6: ADDRCONF(NETDEV_CHANGE): veth3511f19: link becomes ready
[   49.024860] docker0: port 1(veth3511f19) entered blocking state
[   49.030661] docker0: port 1(veth3511f19) entered forwarding state
[   49.036913] IPv6: ADDRCONF(NETDEV_CHANGE): docker0: link becomes ready
[   49.222564] Unable to handle kernel NULL pointer dereference at virtual address 0000000000000050
[   49.225758] Mem abort info:
[   49.228475]   ESR = 0x96000006
[   49.231497]   EC = 0x25: DABT (current EL), IL = 32 bits
[   49.236772]   SET = 0, FnV = 0
[   49.239776]   EA = 0, S1PTW = 0
[   49.242882]   FSC = 0x06: level 2 translation fault
[   49.247724] Data abort info:
[   49.250556]   ISV = 0, ISS = 0x00000006
[   49.254357]   CM = 0, WnR = 0
[   49.257284] user pgtable: 4k pages, 48-bit VAs, pgdp=000000001bc54000
[   49.263689] [0000000000000050] pgd=080000000e2ff003, p4d=080000000e2ff003, pud=0800000014e19003, pmd=0000000000000000
[   49.274240] Internal error: Oops: 96000006 [#2] PREEMPT SMP
[   49.279727] Modules linked in: nfnetlink xfrm_user xfrm_algo cfg80211 rfkill realtek dwmac_generic dw_hdmi_i2s_audio panfrost crct10dif_ce gpu_sched rc_odroid meson_ir ao_cec_g12a rtc_meson_vrtc dwmac_meson8b stmmac_platform meson_drm meson_dw_hdmi dw_hdmi stmmac cec pcs_xpcs rc_core display_connector snd_soc_simple_amplifier fuse
[   49.308954] CPU: 3 PID: 889 Comm: s6-rc-init Tainted: G      D W         5.15.74 #1
[   49.316396] Hardware name: Hardkernel ODROID-N2 (DT)
[   49.321297] pstate: 600000c5 (nZCv daIF -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[   49.328209] pc : task_tick_fair+0x42c/0x690
[   49.332331] lr : task_tick_fair+0x3f4/0x690
[   49.336470] sp : ffff800009663d30
[   49.339742] x29: ffff800009663d30 x28: ffff800008128a60 x27: 0000000b727f47fa
[   49.346839] x26: 0000000000000000 x25: ffff8000095db000 x24: ffff80000946e000
[   49.353913] x23: ffff800009282968 x22: ffff000014c18000 x21: 0000000000000000
[   49.360984] x20: ffff00000d34d200 x19: ffff00000122ac00 x18: 0000000000000000
[   49.368057] x17: ffff8000d7544000 x16: ffff800009664000 x15: 0000a99f86e80ece
[   49.375129] x14: 00000000000003d1 x13: 0000000000000001 x12: 0000000000000003
[   49.382201] x11: ffff800009484cc0 x10: ffff000014c18478 x9 : 0000000000000000
[   49.389273] x8 : 00000000fffffffe x7 : 000000000000016b x6 : 0000000000b48a39
[   49.396346] x5 : 00000000ffffffdf x4 : 0000000000000000 x3 : fffffffffffffff0
[   49.403419] x2 : 00000001cd5e7fe9 x1 : 0000000000000000 x0 : 000000000112a87d
[   49.410492] Call trace:
[   49.412876]  task_tick_fair+0x42c/0x690
[   49.416685]  scheduler_tick+0xa8/0x120
[   49.420390]  update_process_times+0xcc/0xf0
[   49.425889]  tick_sched_handle.isra.0+0x34/0x60
[   49.430361]  tick_sched_timer+0x4c/0xb0
[   49.434150]  __hrtimer_run_queues+0x114/0x1c0
[   49.438450]  hrtimer_interrupt+0xe8/0x250
[   49.442409]  arch_timer_handler_phys+0x34/0x50
[   49.446843]  handle_percpu_devid_irq+0x84/0x140
[   49.451303]  handle_domain_irq+0x60/0x90
[   49.455163]  gic_handle_irq+0xa4/0xe0
[   49.458755]  call_on_irq_stack+0x28/0x58
[   49.462622]  do_interrupt_handler+0x54/0x60
[   49.466771]  el1_interrupt+0x30/0x80
[   49.470294]  el1h_64_irq_handler+0x18/0x30
[   49.474311]  el1h_64_irq+0x78/0x7c
[   49.477648]  touch_atime+0x1b0/0x250
[   49.481179]  ovl_file_accessed.part.0+0x4c/0x90
[   49.485676]  ovl_read_iter+0x178/0x250
[   49.489367]  new_sync_read+0xe8/0x190
[   49.492997]  vfs_read+0x148/0x1e0
[   49.496266]  ksys_read+0x6c/0x100
[   49.499532]  __arm64_sys_read+0x1c/0x30
[   49.503330]  invoke_syscall+0x44/0x110
[   49.507034]  el0_svc_common.constprop.0+0xcc/0xf0
[   49.511695]  do_el0_svc+0x24/0x90
[   49.514923]  el0_svc+0x20/0x60
[   49.517896]  el0t_64_sync_handler+0xb0/0xc0
[   49.521999]  el0t_64_sync+0x1a0/0x1a4
[   49.525574] Code: f9402a82 f100003f d1004023 9a811061 (f9402821) 
[   49.531596] ---[ end trace d3ac3d64f6ae0e0a ]---
[   49.536141] Kernel panic - not syncing: Oops: Fatal exception in interrupt
[   49.542965] SMP: stopping secondary CPUs
[   49.546834] Kernel Offset: disabled
[   49.550253] CPU features: 0x000060d1,00000846
[   49.554594] Memory Limit: none
[   49.557601] Rebooting in 5 seconds..
bl31 reboot reason: 0xd
bl31 reboot reason: 0x0
system cmd  1.

System information

No response

Additional information

No response

agners commented 1 year ago

Are the errors on all OS versions similar looking?

The error above looks like some type of hardware error, possible memory issue.

trying the official odroid ubuntu OS's (both the mate and minimal latest releases work fine)

Did you also try to stress those systems a bit? HAOS creates quite some stress as it downloads the latest version of Home Assistant Core on first boot (which leads to 1GB+ downloads, extraction and lots of writes to the eMMC).

agners commented 1 year ago

How old is that device? What is the board revision?

CodePhase commented 1 year ago

I tried the stress-ng suite for CPU and memory and didn't see anything unusual. If there's some output that would be particularly helpful let me know and I can run and post the results. As far as errors on the other OS versions, I'd say they are similar but not identical. For example, here is an excerpt from an attempt with 8.5:

[    3.827019] ------------[ cut here ]------------
[    3.832381] meson8b-dwmac ff3f0000.ethernet: Ring mode enabled
[    3.839351] WARNING: CPU: 2 PID: 270 at kernel/rcu/tree_plugin.h:725 rcu_sched_clock_irq+0x664/0xd80
[    3.839368] Modules linked in: crct10dif_ce panfrost gpu_sched meson_dw_hdmi(+) dw_hdmi rc_odroid cec dwmac_meson8b(+) meson_drm meson_ir rtc_meson_vrtc stmmac_platform rc_core stmmac pcs_xpcs snd_soc_simple_amplifier fuse
[    3.839398] CPU: 2 PID: 270 Comm: systemd-udevd Not tainted 5.15.60 #1
[    3.839404] Hardware name: Hardkernel ODROID-N2 (DT)
[    3.839407] pstate: 400000c5 (nZcv daIF -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[    3.845415] meson8b-dwmac ff3f0000.ethernet: Enable RX Mitigation via HW Watchdog Timer
[    3.850817] pc : rcu_sched_clock_irq+0x664/0xd80
[    3.850827] lr : rcu_sched_clock_irq+0x464/0xd80
[    3.850830] sp : ffff80000966bce0
[    3.850832] x29: ffff80000966bce0 x28: ffff800008129ad0 x27: ffff0000e07b52c0
[    3.850839] x26: 0000000000000000 x25: 0000000000000001 x24: 00000000000000c0
[    3.850844] x23: 00000000e3edac47 x22: ffff0000e07b5320 x21: ffff0000078d3a00
[    3.850848] x20: 0000000000000001 x19: ffff80000929b2c0 x18: 0000000000000000
[    3.850852] x17: ffff8000d751f000 x16: ffff80000966c000 x15: 0000000000004000
[    3.850856] x14: 0000000000000000 x13: 0000000000000000 x12: 0000000000000000
[0;32m  OK  ] Found device /dev/ttyAML0.
[    3.850860] x11: 0000000000000000 x10: 0000000000000000 x9 : 0000000000000000
[    3.976751] x8 : 0000000000000000 x7 : 0000000000000000 x6 : ffff800009495170
[    3.976755] x5 : ffff0000078d3a00 x4 : ffff80000966bce0 x3 : ffff0000078d3a00
[    3.976760] x2 : ffff0000078d3a00 x1 : 0000000000000000 x0 : 00000000ffffffff
[    3.976764] Call trace:
[    3.976768]  rcu_sched_clock_irq+0x664/0xd80
[    3.976774]  update_process_times+0x98/0xf0
[    3.976779]  tick_sched_handle.isra.0+0x34/0x60
[    3.976784]  tick_sched_timer+0x4c/0xb0
[    3.976787]  __hrtimer_run_queues+0x114/0x1c0
[    3.976790]  hrtimer_interrupt+0xe8/0x250
[    3.976793]  arch_timer_handler_phys+0x34/0x50
[    3.976799]  handle_percpu_devid_irq+0x84/0x140
[    3.976804]  handle_domain_irq+0x60/0x90
[    3.976807]  gic_handle_irq+0xa4/0xe0
[    3.976812]  call_on_irq_stack+0x28/0x58
[    3.976817]  do_interrupt_handler+0x54/0x60
[    3.976821]  el0_interrupt+0x34/0xc0
[    3.976825]  __el0_irq_handler_common+0x18/0x30
[    3.976829]  el0t_64_irq_handler+0x10/0x20
[    3.976831]  el0t_64_irq+0x1a0/0x1a4
[    3.976835] ---[ end trace 5afd489c0731d9d8 ]---

and

[    5.298724] Unable to handle kernel execute from non-executable memory at virtual address ffff0000e07d2f48
[    5.303941] Mem abort info:
[    5.303945]   ESR = 0x8600000f
[[    5.303948]   EC = 0x21: IABT (current EL), IL = 32 bits
[    5.314993]   SET = 0, FnV = 0
[    5.317971]   EA = 0, S1PTW = 0
[    5.321040]   FSC = 0x0f: level 3 permission fault
[    5.325795] swapper pgtable: 4k pages, 48-bit VAs, pgdp=00000000093dd000
[    5.332437] [ffff0000e07d2f48] pgd=18000000f4e52003, p4d=18000000f4e52003, pud=18000000e4864003, pmd=18000000e4760003, pte=00680000e07d2707
[    5.346016] Internal error: Oops: 8600000f [#1] PREEMPT SMP

The board is a couple of years old, 2019 I think. The revision is 0.4 20190327. Thank you for having a look!

agners commented 1 year ago

Hm, that error looks quite a bit different again. The problem reminds me of #1471.

These type of errors are usually caused by memory problems. Now since it works on a different OS, it seems to suggest that we use different memory settings than they are using. The memory timings are set by the bootloader, and last time I checked the official ODROID image and ours was using the exact same firmware there.

What official release did you test? Can you share the image link?

Did you boot the offical image and HAOS image from the same boot media?

CodePhase commented 1 year ago

Just for good measure, here's some stress-ng results:

stress-ng --brk 2 --stack 2 --bigheap 2 -t 2m

stress-ng: info:  [3304] setting to a 120 second (2 mins, 0.00 secs) run per stressor
stress-ng: info:  [3304] dispatching hogs: 2 brk, 2 stack, 2 bigheap
stress-ng: info:  [3304] successful run completed in 120.20s (2 mins, 0.20 secs)

stress-ng --matrix 0 -t 2m --times

stress-ng: info:  [3347] setting to a 120 second (2 mins, 0.00 secs) run per stressor
stress-ng: info:  [3347] dispatching hogs: 6 matrix
stress-ng: info:  [3347] successful run completed in 120.00s (2 mins, 0.00 secs)
stress-ng: info:  [3347] for a 120.00s run time:
stress-ng: info:  [3347]     720.02s available CPU time
stress-ng: info:  [3347]     719.40s user time   ( 99.91%)
stress-ng: info:  [3347]       0.05s system time (  0.01%)
stress-ng: info:  [3347]     719.45s total time  ( 99.92%)
stress-ng: info:  [3347] load average: 5.85 3.39 1.51

stress-ng --class memory --all 1 -t 2m

stress-ng: info:  [3356] setting to a 120 second (2 mins, 0.00 secs) run per stressor
stress-ng: info:  [3356] dispatching hogs: 1 atomic, 1 bad-altstack, 1 bsearch, 1 context, 1 full, 1 heapsort, 1 hsearch, 1 judy, 1 list, 1 lockbus, 1 lsearch, 1 malloc, 1 matrix, 1 matrix-3d, 1 mcontend, 1 membarrier, 1 memcpy, 1 memfd, 1 memrate, 1 memthrash, 1 mergesort, 1 mincore, 1 misaligned, 1 null, 1 numa, 1 pipe, 1 pipeherd, 1 prefetch, 1 qsort, 1 radixsort, 1 randlist, 1 remap, 1 resources, 1 rmap, 1 shellsort, 1 skiplist, 1 sparsematrix, 1 stack, 1 stackmmap, 1 str, 1 stream, 1 tlb-shootdown, 1 tmpfs, 1 tree, 1 tsearch, 1 vm, 1 vm-addr, 1 vm-rw, 1 vm-segv, 1 wcs, 1 zero, 1 zlib
stress-ng: info:  [3378] stress-ng-memthrash: starting 6 threads on each of the 1 stressors on a 6 CPU system
stress-ng: info:  [3381] stress-ng-misaligned: skipping method int16atomic, misaligned operations tripped signal 7 'SIGBUS'
stress-ng: info:  [3387] stress-ng-prefetch: using built-in defaults as no suitable cache found
stress-ng: info:  [3381] stress-ng-misaligned: skipping method int32atomic, misaligned operations tripped signal 7 'SIGBUS'
stress-ng: info:  [3383] stress-ng-numa: system has 1 of a maximum 4 memory NUMA nodes
stress-ng: info:  [3381] stress-ng-misaligned: skipping method int64atomic, misaligned operations tripped signal 7 'SIGBUS'
stress-ng: info:  [3411] stress-ng-sparsematrix: 5000 items in 500 x 500 sparse matrix (2.00% full)
stress-ng: info:  [3424] stress-ng-stream: using built-in defaults as no suitable cache found
stress-ng: info:  [3424] stress-ng-stream: stressor loosely based on a variant of the STREAM benchmark code
stress-ng: info:  [3424] stress-ng-stream: do NOT submit any of these results to the STREAM benchmark results
stress-ng: info:  [3424] stress-ng-stream: Using CPU cache size of 2048K
stress-ng: info:  [3381] stress-ng-misaligned: skipping method int128tomic, misaligned operations tripped signal 7 'SIGBUS'
stress-ng: info:  [3381] stress-ng-misaligned: exercised int16rd int16wr int16inc int32rd int32wr int32inc int64rd int64wr int64inc int128rd int128wr int128inc
stress-ng: info:  [3411] stress-ng-sparsematrix: hash     161.4K       280708.79 Get/s       134882.43 Put/s
stress-ng: info:  [3411] stress-ng-sparsematrix: judy      85.6K       210287.73 Get/s        70618.53 Put/s
stress-ng: info:  [3411] stress-ng-sparsematrix: list     174.6K        11763.04 Get/s         8481.36 Put/s
stress-ng: info:  [3411] stress-ng-sparsematrix: mmap       1.9M       161663.47 Get/s        39406.55 Put/s
stress-ng: info:  [3411] stress-ng-sparsematrix: qhash    162.4K       462007.66 Get/s       232900.91 Put/s
stress-ng: info:  [3411] stress-ng-sparsematrix: rb       232.7K       109434.05 Get/s        50993.22 Put/s
stress-ng: info:  [3424] stress-ng-stream: memory rate: 95.28 MB/sec, 38.11 Mflop/sec (instance 0)
stress-ng: info:  [3377] stress-ng-memrate:  write1024:        88.10 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:   write512:        80.99 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:   write256:        81.33 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:   write128:        79.87 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:    write64:        91.02 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:    write32:        84.02 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:    write16:        67.07 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:     write8:        42.75 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:   read64pf:       123.98 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:   read1024:       101.65 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:    read512:       138.15 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:    read256:       138.58 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:    read128:       130.77 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:     read64:       107.59 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:     read32:       109.55 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:     read16:       103.49 MB/sec
stress-ng: info:  [3377] stress-ng-memrate:      read8:        66.54 MB/sec
stress-ng: info:  [3480] stress-ng-zlib: instance 0: compression ratio: 60.92% (0.03 MB/sec)
stress-ng: info:  [3387] stress-ng-prefetch: using a 4096 KB L3 cache, 1408 benchmark rounds
stress-ng: info:  [3387] stress-ng-prefetch: non-prefetch read rate @ 0.26 GB/s
stress-ng: info:  [3387] stress-ng-prefetch: best prefetch read rate @ 4.66 GB/s at offset 6976 (~1394.77 nanoseconds)
stress-ng: info:  [3386] stress-ng-pipeherd: 3.10 context switches per bogo operation (123442.60 per second)
stress-ng: info:  [3356] successful run completed in 121.25s (2 mins, 1.25 secs)

stress-ng --mq 0 -t 2m --times --perf

stress-ng: info:  [23948] setting to a 120 second (2 mins, 0.00 secs) run per stressor
stress-ng: info:  [23948] dispatching hogs: 6 mq
stress-ng: info:  [23948] successful run completed in 120.01s (2 mins, 0.01 secs)
stress-ng: info:  [23948] Cannot read perf counters, do not have CAP_SYS_ADMIN capability or /proc/sys/kernel/perf_event_paranoid is set too high (3)
stress-ng: info:  [23948] for a 120.01s run time:
stress-ng: info:  [23948]     720.04s available CPU time
stress-ng: info:  [23948]     135.47s user time   ( 18.81%)
stress-ng: info:  [23948]     548.77s system time ( 76.21%)
stress-ng: info:  [23948]     684.24s total time  ( 95.03%)
stress-ng: info:  [23948] load average: 30.89 49.90 24.32

CodePhase commented 1 year ago

Hm, that error looks quite a bit different again. The problem reminds me of #1471.

These type of errors are usually caused by memory problems. Now since it works on a different OS, it seems to suggest that we use different memory settings than they are using. The memory timings are set by the bootloader, and last time I checked the official ODROID image and ours was using the exact same firmware there.

What official release did you test? Can you share the image link?

Did you boot the offical image and HAOS image from the same boot media?

Yeah, I saw that issue and tried different network cables and even different switches just in case. I tried two Odroid images, minimal version 20220622 and mate version 20220629

I can check the checksums of the firmware you mentioned in both official Odroid images and the HAOS if you think that would help. Do you know the locations of the files?

agners commented 1 year ago

I can check the checksums of the firmware you mentioned in both official Odroid images and the HAOS if you think that would help. Do you know the locations of the files?

Unfortunately it is not that easy: These firmware files are bundled at build time and part of the U-Boot boot loader. Since we build our own version of U-Boot, these things won't match up. You basically have to figure out how the images are being built. Unfortunately these things are not well documented (or I am unable to find the documentation).

Things are better documented/clearer for Armbian, they get the firmware files from https://github.com/LibreELEC/amlogic-boot-fip. I was considering switching to those anyways.

Can you try Armbian on that particular board (along with stressing a bit)? https://www.armbian.com/odroid-n2/

agners commented 1 year ago

From the explanations in this slide deck, it seems that acs.bin is the responsible file for memory/DDR timings.

At least Armbian seems to use the very same timings as we are using, so if that is the problem, Armbian should fail on your platform as well.

CodePhase commented 1 year ago

Interesting. I do get similar errors from Armbian version 22.08:

[    6.356893] Unable to handle kernel NULL pointer dereference at virtual address 0000000000000019                                                     
[    6.365645] Mem abort info:                                                                                                                                       
[    6.365650]   ESR = 0x0000000096000044                                                                                                                            
[    6.365652]   EC = 0x25: DABT (current EL), IL = 32 bits                                                                                                          
[    6.365654]   SET = 0, FnV = 0                                                                                                                                    
[    6.365656]   EA = 0, S1PTW = 0                                                                                                                                   
[    6.365657]   FSC = 0x04: level 0 translation fault                                                                                                               
[    6.365659] Data abort info:                                                                                                                                      
[    6.365660]   ISV = 0, ISS = 0x00000044                                                                                                                           
[    6.365661]   CM = 0, WnR = 1                                                                                                                                     
[    6.365663] user pgtable: 4k pages, 48-bit VAs, pgdp=00000000081ec000                                                                                             
[    6.365666] [0000000000000019] pgd=0000000000000000, p4d=0000000000000000                                                                                         
[    6.365671] Internal error: Oops: 96000044 [#1] PREEMPT SMP                                                                                                       
[    6.365675] Modules linked in: sch_fq_codel ramoops reed_solomon pstore_blk pstore_zone efi_pstore ip_tables x_tables autofs4 meson_gxl panfrost gpu_sched rtc_pcb
[    6.365704] CPU: 3 PID: 868 Comm: loadkeys Tainted: G        W         5.19.17-meson64 #22.08.7                                                                   
[    6.365708] Hardware name: Hardkernel ODROID-N2 (DT)                                                                                                              
[    6.365710] pstate: 40000005 (nZcv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)                                                                                       
[    6.365714] pc : _raw_spin_unlock_irqrestore+0x10/0x50                                                                                                            
[    6.365725] lr : __stack_depot_save+0x300/0x4e0                                                                                                                   
[    6.424588] systemd[1]: Finished Coldplug All udev Devices.                                                                                                       
[    6.443074] sp : ffff80000acebbc0                                                                                                                                 
[    6.443075] x29: ffff80000acebbc0 x28: ffff00003f35d880 x27: 0000000000000000                                                                                     
[    6.443081] x26: 0000000000000001 x25: ffff00000000c400 x24: ffff00000000c400                                                                                     
[    6.443085] x23: 0000000000000001 x22: 0000000000004b47 x21: 0000000000000000                                                                                     
[    6.496035] x20: ffff80000945ecb8 x19: 0000ffffe5750328 x18: 0000000000000000                                                                                     
[    6.496040] x17: 0000000000000000 x16: 0000000000000000 x15: 0000000000000000                                                                                     
[    6.496044] x14: 0000000000000000 x13: 0000000000000000 x12: 0000000000000000                                                                                     
[    6.517252] x11: 0000000000000000 x10: 0000000000000000 x9 : 0000000000000000                                                                                     
[    6.520367] systemd[1]: Starting Helper to synchronize boot up for ifupdown...                                                                                    
[    6.524320]                                                                                                                                                       
[    6.524322] x8 : 0000000000000000 x7 : 0000000000000000 x6 : 0000000000000000                                                                                     
[    6.524326] x5 : 0000000000400100 x4 : ffff00003f35d880 x3 : 0000000000000000                                                                                     
[    6.524330] x2 : 0000000000000000 x1 : ffff80000945ecb8 x0 : 0000000000000019                                                                                     
[    6.524334] Call trace:                                                                                                                                           
ting Restore / save the[    6.563654]  _raw_spin_unlock_irqrestore+0x10/0x50                                                                                         
[    6.563664]  __stack_depot_save+0x300/0x4e0                                                                                                                       
[    6.563669]  vt_ioctl+0x7d0/0x14f0                                                                                                                                
[    6.563674]  tty_ioctl+0x2bc/0xc30                                                                                                                                
[    6.563677]  __arm64_sys_ioctl+0xa8/0xe8                                                                                                                          
[    6.563681]  invoke_syscall+0x44/0x108                                                                                                                            
[    6.563687]  el0_svc_common.constprop.3+0x94/0xf8                                                                                                                 
[    6.563691]  do_el0_svc+0x2c/0xb8                                                                                                                                 
[    6.563694]  el0_svc+0x20/0x50                                                                                                                                    
[    6.563698]  el0t_64_sync_handler+0x98/0xc0                                                                                                                       
[    6.563701]  el0t_64_sync+0x170/0x174                                                                                                                             
[    6.563706] Code: d503233f a9bf7bfd 52800002 910003fd (089ffc02)                                                                                                  
[    6.563710] ---[ end trace 0000000000000000 ]---

[    6.951242] Unable to handle kernel read from unreadable memory at virtual address fffffbfffdcec9de                      
[    6.959628] Mem abort info:                                                                                                                                       
[    6.962385]   ESR = 0x000000009600000e                                                                                                                            
[    6.966094]   EC = 0x25: DABT (current EL), IL = 32 bits                                                                                                          
[    6.971354]   SET = 0, FnV = 0                                                                                                                                    
[    6.974373]   EA = 0, S1PTW = 0                                                                                                                                   
[    6.977478]   FSC = 0x0e: level 2 permission fault                                                                                                                
[    6.982222] Data abort info:                                                                                                                                      
[    6.985068]   ISV = 0, ISS = 0x0000000e                                                                                                                           
[    6.988863]   CM = 0, WnR = 0                                                                                                                                     
[    6.991796] swapper pgtable: 4k pages, 48-bit VAs, pgdp=000000003552f000                                                                                          
[    6.998437] [fffffbfffdcec9de] pgd=00000000359d7003, p4d=00000000359d7003, pud=00000000359d8003, pmd=006000003e800781                                             
[    7.008961] Internal error: Oops: 9600000e [#2] PREEMPT SMP                                                                                                       
[    7.014481] Modules linked in: snd_soc_meson_axg_frddr(+) snd_soc_meson_axg_tdmout videobuf2_dma_contig(+) meson_ir(+) v4l2_mem2mem snd_soc_meson_axg_toddr rc_cob
[    7.080722] CPU: 3 PID: 924 Comm: systemd-udevd Tainted: G      D W         5.19.17-meson64 #22.08.7                                                              
[    7.089776] Hardware name: Hardkernel ODROID-N2 (DT)                                                                                                              
[    7.094693] pstate: 400000c5 (nZcv daIF -PAN -UAO -TCO -DIT -SSBS BTYPE=--)                                                                                       
[    7.101592] pc : __pi_strcmp+0xe4/0x140                                                                                                                           
[    7.105387] lr : __of_find_property+0x40/0x88                                                                                                                     
[    7.109699] sp : ffff80000ad9b8f0                                                                                                                                 
[    7.112977] x29: ffff80000ad9b8f0 x28: 0000000000000000 x27: 0000000000000000                                                                                     
[    7.120049] x26: ffff80000ad9bce0 x25: ffff0000e48593e0 x24: ffff000009b5d968                                                                                     
[    7.127122] x23: ffff800001212120 x22: ffff800001212140 x21: 0000000000000000                                                                                     
[    7.134194] x20: ffff8000093c1e58 x19: ffff0000e48594c8 x18: 0000000000000000                                                                                     
[    7.141267] x17: 0000000000000000 x16: 0000000000000000 x15: 6143296c6c756e28                                                                                     
[    7.148339] x14: 0000000000000040 x13: 0000000000000228 x12: 0000000000000000                                                                                     
[    7.155412] x11: 0000000000000000 x10: ffff84000b6d5524 x9 : 0003ffffb61f0d20                                                                                     
[    7.162484] x8 : 0101010101010101 x7 : 000000000000656c x6 : 7f7f7f7f7f7f7f7f                                                                                     
[    7.169557] x5 : ffff84000b6d5528 x4 : 0000000000000000 x3 : 0000000000000070                                                                                     
[    7.176629] x2 : 0000000000000070 x1 : ffff8000093c1e60 x0 : fffffbfffdcec938                                                                                     
[    7.183703] Call trace:                                                                                                                                           
[    7.186117]  __pi_strcmp+0xe4/0x140                                                                                                                               
[    7.189568]  __of_device_is_compatible+0x84/0x150                                                                                                                 
[    7.194224]  __of_match_node.part.6+0x2c/0x80                                                                                                                     
[    7.198537]  of_match_node+0x40/0x70                                                                                                                              
[    7.202073]  of_match_device+0x28/0x40                                                                                                                            
[    7.205782]  platform_match+0x4c/0xe8                                                                                                                             
[    7.209404]  __driver_attach+0x2c/0x1d8                                                                                                                           
[    7.213199]  bus_for_each_dev+0x74/0xc8                                                                                                                           
[    7.216994]  driver_attach+0x24/0x30                                                                                                                              
[    7.220531]  bus_add_driver+0x19c/0x240                                                                                                                           
[    7.224325]  driver_register+0x64/0x120                                                                                                                           
[    7.228121]  __platform_driver_register+0x28/0x38                                                                                                                 
[    7.232778]  axg_frddr_pdrv_init+0x20/0x1000 [snd_soc_meson_axg_frddr]                                                                                            
[    7.239247]  do_one_initcall+0x74/0x1e8                                                                                                                           
[    7.243042]  do_init_module+0x44/0x1e0                                                                                                                            
[    7.246751]  load_module+0x1950/0x1c48                                                                                                                            
[    7.250459]  __do_sys_init_module+0x1dc/0x250                                                                                                                     
[    7.254772]  __arm64_sys_init_module+0x1c/0x28                                                                                                                    
[    7.259171]  invoke_syscall+0x44/0x108                                                                                                                            
[    7.262879]  el0_svc_common.constprop.3+0x84/0xf8                                                                                                                 
[    7.267537]  do_el0_svc+0x2c/0xb8                                                                                                                                 
[    7.270814]  el0_svc+0x20/0x50                                                                                                                                    
[    7.273833]  el0t_64_sync_handler+0x98/0xc0                                                                                                                       
[    7.277973]  el0t_64_sync+0x170/0x174                                                                                                                             
[    7.281599] Code: 540001e1 cb000025 d503201f f8656807 (f86a6803)                                                                                                  
[    7.287635] ---[ end trace 0000000000000000 ]---                                                                                                                  
[    7.292205] note: systemd-udevd[924] exited with preempt_count 1

[   67.303848] rcu: INFO: rcu_preempt self-detected stall on CPU
[   67.304498] rcu:     2-....: (15000 ticks this GP) idle=bb3/1/0x4000000000000000 softirq=1321/1323 fqs=7488                                                       
[   67.313986]  (t=15002 jiffies g=-91 q=470 ncpus=6)                                                                                                                
[   67.318729] Task dump for CPU 0:                                                                                                                                  
[   67.321920] task:systemd-udevd   state:R  running task     stack:    0 pid:  892 ppid:     1 flags:0x00000802                                                     
[   67.331753] Call trace:                                                                                                                                           
[   67.334167]  __switch_to+0xfc/0x1b8                                                                                                                               
[   67.337617]  0xe20031668b4ee000                                                                                                                                   
[   67.340723] Task dump for CPU 2:                                                                                                                                  
[   67.343913] task:systemd-udevd   state:R  running task     stack:    0 pid:  927 ppid:   892 flags:0x0000080a                                                     
[   67.353746] Call trace:                                                                                                                                           
[   67.356161]  dump_backtrace+0x12c/0x138                                                                                                                           
[   67.359956]  show_stack+0x18/0x50                                                                                                                                 
[   67.363233]  sched_show_task+0x160/0x1a0                                                                                                                          
[   67.367114]  dump_cpu_task+0x44/0x54                                                                                                                              
[   67.370651]  rcu_dump_cpu_stacks+0xf0/0x134                                                                                                                       
[   67.374791]  rcu_sched_clock_irq+0xa14/0xe10                                                                                                                      
[   67.379017]  update_process_times+0x68/0xb0                                                                                                                       
[   67.383157]  tick_sched_handle.isra.21+0x40/0x58                                                                                                                  
[   67.387728]  tick_sched_timer+0x4c/0xa8                                                                                                                           
[   67.391523]  __hrtimer_run_queues+0x11c/0x1b0                                                                                                                     
[   67.395836]  hrtimer_interrupt+0xe8/0x240                                                                                                                         
[   67.399803]  arch_timer_handler_phys+0x30/0x40                                                                                                                    
[   67.404202]  handle_percpu_devid_irq+0x84/0x138                                                                                                                   
[   67.408687]  generic_handle_domain_irq+0x2c/0x48                                                                                                                  
[   67.413258]  gic_handle_irq+0x98/0xd0                                                                                                                             
[   67.416881]  call_on_irq_stack+0x2c/0x58                                                                                                                          
[   67.420762]  do_interrupt_handler+0x84/0x88                                                                                                                       
[   67.424902]  el1_interrupt+0x38/0x70                                                                                                                              
[   67.428438]  el1h_64_irq_handler+0x18/0x28                                                                                                                        
[   67.432492]  el1h_64_irq+0x64/0x68                                                                                                                                
[   67.435856]  smp_call_function_many_cond+0x174/0x390                                                                                                              
[   67.440772]  smp_call_function+0x40/0x78                                                                                                                          
[   67.444653]  kick_all_cpus_sync+0x24/0x30                                                                                                                         
[   67.448621]  load_module+0x15a8/0x1c48                                                                                                                            
[   67.452329]  __do_sys_init_module+0x1dc/0x250                                                                                                                     
[   67.456642]  __arm64_sys_init_module+0x1c/0x28                                                                                                                    
[   67.461041]  invoke_syscall+0x44/0x108                                                                                                                            
[   67.464749]  el0_svc_common.constprop.3+0x84/0xf8                                                                                                                 
[   67.469407]  do_el0_svc+0x2c/0xb8                                                                                                                                 
[   67.472684]  el0_svc+0x20/0x50                                                                                                                                    
[   67.475703]  el0t_64_sync_handler+0x98/0xc0                                                                                                                       
[   67.479843]  el0t_64_sync+0x170/0x174                                                                                                                             
[   67.483466] Task dump for CPU 3:                                                                                                                                  
[   67.486657] task:systemd-udevd   state:R  running task     stack:    0 pid:  941 ppid:   892 flags:0x00000802                                                     
[   67.496490] Call trace:                                                                                                                                           
[   67.498905]  __switch_to+0xfc/0x1b8                                                                                                                               
[   67.502354]  0xe20031668b4ee000                                                                                                                                   
[   67.505460] Task dump for CPU 4:                                                                                                                                  
[   67.508651] task:systemd-udevd   state:R  running task     stack:    0 pid:  960 ppid:   892 flags:0x00000802                                                     
[   67.518483] Call trace:                                                                                                                                           
[   67.520898]  __switch_to+0xfc/0x1b8                                                                                                                               
[   67.524348]  0xffff0000087d0245

I can't get far enough to run the stress test because the system crashes at startup.

agners commented 1 year ago

Hm interesting indeed, so probably something with the new kernel.

Can you try a 5.10.x based build from their archive, e.g. https://imola.armbian.com/archive/odroidn2/archive/Armbian_21.05.4_Odroidn2_buster_current_5.10.43.img.xz

We did had issues at one point with frequency scaling, but currently we HAOS uses the performance scaling governor, which keeps the CPU clock on a high frequency.

rpardini commented 1 year ago

I've not heard similar on the N2+ yet... I'm currently running 6.0.5 on the N2+. sbc-bench results: http://ix.io/4eQP Today's testing images: https://github.com/rpardini/armbian-release/releases/download/20221103a/Armbian_20221103a-rpardini_Odroidn2_kinetic_edge_6.0.6.img.xz

CodePhase commented 1 year ago

using the Armbian 21.05.4 image I still get errors at startup and a failed boot. I attached the log.

odroidN2-armbian21_05-emmc-2.log

Seems to be a similar error

CodePhase commented 1 year ago

trying the 6.0.6 Armbian image also gives me virtual memory errors.

odroidN2-armbian6_0_6-emmc-2.log

I think I'll try the Odroid image again and see if there's some other way to do another memory test. I'll report back afterwards.

CodePhase commented 1 year ago

I ran the stress-ng tests again as well as the sbc-bench (thanks @rpardini I didn't know about this). I can't see any issues with memory in any of the test results. Here's the link to the sbc-bench results: http://ix.io/4eSN. Here's a complete log with the bootup, testing, dmesg, and complete journal in case anyone is interested:

odroidN2-ubuntu20220622_minimal-1-emmc.log

rpardini commented 1 year ago

Yeah, I'm stumped. I've not the original N2, and my N2+ works with the 6.0.6 image. Looking around, there's a lot of similar stuff, https://github.com/home-assistant/operating-system/issues/1096 and https://github.com/home-assistant/operating-system/issues/1471 at least...

The fact vendor kernel 4.9 works doesn't help much; did you ever get a 5.10+ kernel working?

rpardini commented 1 year ago

That 21.05.4's logs indicate a vendor u-boot trying and failing to boot a kernel... it's an unrelated error. That image might have been messed up 🤦 or maybe you've used an uboot in SPI?

@CodePhase Maybe try Armbian_22.08.1_Odroidn2_jammy_current_5.10.139? (make sure switch is in eMMC position)

CodePhase commented 1 year ago

Thanks @rpardini but that image doesn't work either. I can confirm that I have the boot selector switch to the 'MMC' option on the board. Looks like the uboot on the image has the same issue where it can't boot the kernel. To answer your previous question, no I have never gotten a 5.10+ kernel to boot. I usually only use the Odroid Ubuntu images. Maybe I'll try a simple one like CoreElec or something.

odroidN2-armbian22_08_1-k5_10_139-emmc.log

CodePhase commented 1 year ago

The latest build of CoreElec works (https://github.com/CoreELEC/CoreELEC/releases/download/20.0-Nexus_alpha3/CoreELEC-Amlogic-ng.arm-20.0-Nexus_alpha3-Odroid_N2.img.gz) however it is running kernel 4.9.269:

uname -r 4.9.269

I suppose there is some issue with kernels in the 5.x and above series for N2 (non-plus) boards?

odroidN2-coreelec-20_0Nexus_alpha3-emmc.log

CodePhase commented 1 year ago

I wonder if it's just time to give up on getting this to work and just install HomeAssistant on the Odroid Ubuntu Minimal image. I am also stumped that I seem to be the only person having this issue. Surely others have attempted to install this on a non-plus N2 board. Do either of you (@agners or @rpardini) see any value in continuing to troubleshoot this or is it time to throw in the towel?

rpardini commented 1 year ago

Thanks for testing @CodePhase. Maybe some Manjaro kernels? I'm out of ideas, sorry.

agners commented 1 year ago

There are definitely other non-N2+ installations out there, I think @pvizeli is running one. But it seems that your particular device is very special 😰. Without having a failing HW here, it's hard to debug. If using their Odroid image works for you, probably the best way forward, I am sorry.

pvizeli commented 1 year ago

Yes, my Parents have an N2. I think it should be one of the latest HW revisions because it was the Prototype for the Blue and Hardkernel switch 2 months later over to N2+

What I can say, is it seems to work stable, but I can take a look after my parents are back

github-actions[bot] commented 1 year ago

There hasn't been any activity on this issue recently. To keep our backlog manageable we have to clean old issues, as many of them have already been resolved with the latest updates. Please make sure to update to the latest Home Assistant OS version and check if that solves the issue. Let us know if that works for you by adding a comment 👍 This issue has now been marked as stale and will be closed if no further activity occurs. Thank you for your contributions.

home-assistant / operating-system