high iowait with 5.15.50

[freemangordon]

after upgrade from 5.15.21 to 5.15.50 I see extremely high iowait % when doing intensive load (like compiling). See iostat sample:

avg-cpu: %user %nice %system %iowait %steal %idle 6.27 0.00 2.01 91.23 0.00 0.50

The same load on 5.15.21 results in 2% - 3% iowait.

Any hints what to look for?

[freemangordon]

@rafael2k

[rafael2k]

Good question. There should be not much difference between 5.15.21 and 5.15.50. Did you have any storage changes in between the use of the 5.15.21 and this 5.15.50 tests? I can only think of storage issues, file filesystem fragmentation or storage near-failure signs. Otherwise, it could be some pinephone storage driver related issue too.

[freemangordon]

the thing is, that if I downgrade, the issue is no more. And it re-appears as soon as I upgrade to .50

[freemangordon]

dmesg log, in case it can help:

[ 0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034] [ 0.000000] Linux version 5.15.50 (pbuilder@devuan-arm64) (gcc (Debian 8.3.0-6) 8.3.0, GNU ld (GNU Binutils for Debian) 2.31.1) #1 SMP Mon Jul 4 07:51:00 UTC 2022 [ 0.000000] Machine model: Pine64 PinePhone Braveheart (1.1) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000040000000-0x00000000bfffffff] [ 0.000000] DMA32 empty [ 0.000000] Normal empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000040000000-0x00000000bfffffff] [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000000bfffffff] [ 0.000000] cma: Reserved 256 MiB at 0x00000000ad800000 [ 0.000000] psci: probing for conduit method from DT. [ 0.000000] psci: PSCIv1.1 detected in firmware. [ 0.000000] psci: Using standard PSCI v0.2 function IDs [ 0.000000] psci: MIGRATE_INFO_TYPE not supported. [ 0.000000] psci: SMC Calling Convention v1.2 [ 0.000000] percpu: Embedded 29 pages/cpu s80472 r8192 d30120 u118784 [ 0.000000] pcpu-alloc: s80472 r8192 d30120 u118784 alloc=29*4096 [ 0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 [ 0.000000] Detected VIPT I-cache on CPU0 [ 0.000000] CPU features: kernel page table isolation disabled by kernel configuration [ 0.000000] CPU features: detected: ARM erratum 843419 [ 0.000000] CPU features: detected: ARM erratum 845719 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 516096 [ 0.000000] Kernel command line: console=tty0 console=ttyS0,115200 root=/dev/mmcblk0p2 rw rootwait rootfstype=ext4 fbcon=rotate:1 [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) [ 0.000000] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.000000] Memory: 109640K/2097152K available (11200K kernel code, 1934K rwdata, 3488K rodata, 4224K init, 524K bss, 62236K reserved, 262144K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] ftrace: allocating 37866 entries in 148 pages [ 0.000000] ftrace: allocated 148 pages with 3 groups [ 0.000000] trace event string verifier disabled [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8 to nr_cpu_ids=4. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 [ 0.000000] Root IRQ handler: gic_handle_irq [ 0.000000] GIC: Using split EOI/Deactivate mode [ 0.000000] arch_timer: Enabling global workaround for Allwinner erratum UNKNOWN1 [ 0.000000] arch_timer: CPU0: Trapping CNTVCT access [ 0.000000] arch_timer: cp15 timer(s) running at 24.00MHz (phys). [ 0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x588fe9dc0, max_idle_ns: 440795202592 ns [ 0.000001] sched_clock: 56 bits at 24MHz, resolution 41ns, wraps every 4398046511097ns [ 0.000243] clocksource: timer: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635851949 ns [ 0.000772] Console: colour dummy device 80x25 [ 0.001221] printk: console [tty0] enabled [ 0.001282] Calibrating delay loop (skipped), value calculated using timer frequency.. 48.00 BogoMIPS (lpj=96000) [ 0.001311] pid_max: default: 32768 minimum: 301 [ 0.001610] LSM: Security Framework initializing [ 0.001702] Yama: becoming mindful. [ 0.001888] AppArmor: AppArmor initialized [ 0.001910] TOMOYO Linux initialized [ 0.002135] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) [ 0.002173] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) [ 0.005066] rcu: Hierarchical SRCU implementation. [ 0.007023] smp: Bringing up secondary CPUs ... [ 0.009130] Detected VIPT I-cache on CPU1 [ 0.009199] arch_timer: CPU1: Trapping CNTVCT access [ 0.009215] CPU1: Booted secondary processor 0x0000000001 [0x410fd034] [ 0.010515] Detected VIPT I-cache on CPU2 [ 0.010552] arch_timer: CPU2: Trapping CNTVCT access [ 0.010563] CPU2: Booted secondary processor 0x0000000002 [0x410fd034] [ 0.011741] Detected VIPT I-cache on CPU3 [ 0.011774] arch_timer: CPU3: Trapping CNTVCT access [ 0.011785] CPU3: Booted secondary processor 0x0000000003 [0x410fd034] [ 0.011877] smp: Brought up 1 node, 4 CPUs [ 0.011981] SMP: Total of 4 processors activated. [ 0.011995] CPU features: detected: 32-bit EL0 Support [ 0.012008] CPU features: detected: 32-bit EL1 Support [ 0.012022] CPU features: detected: CRC32 instructions [ 0.012110] CPU features: emulated: Privileged Access Never (PAN) using TTBR0_EL1 switching [ 0.012438] CPU: All CPU(s) started at EL2 [ 0.012533] alternatives: patching kernel code [ 0.089373] node 0 deferred pages initialised in 76ms [ 0.090932] devtmpfs: initialized [ 0.103264] Registered cp15_barrier emulation handler [ 0.103341] KASLR disabled due to lack of seed [ 0.103662] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 0.103723] futex hash table entries: 1024 (order: 4, 65536 bytes, linear) [ 0.115388] pinctrl core: initialized pinctrl subsystem [ 0.117332] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 0.120719] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations [ 0.120971] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.121323] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.121406] audit: initializing netlink subsys (disabled) [ 0.121659] audit: type=2000 audit(0.120:1): state=initialized audit_enabled=0 res=1 [ 0.122383] thermal_sys: Registered thermal governor 'fair_share' [ 0.122391] thermal_sys: Registered thermal governor 'bang_bang' [ 0.122409] thermal_sys: Registered thermal governor 'step_wise' [ 0.122424] thermal_sys: Registered thermal governor 'user_space' [ 0.122438] thermal_sys: Registered thermal governor 'power_allocator' [ 0.123007] cpuidle: using governor ladder [ 0.123053] cpuidle: using governor menu [ 0.123229] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers. [ 0.123376] ASID allocator initialised with 65536 entries [ 0.142324] platform 1ca0000.dsi: Fixing up cyclic dependency with 1c0c000.lcd-controller [ 0.143543] platform 1ee0000.hdmi: Fixing up cyclic dependency with 1c0d000.lcd-controller [ 0.146603] platform hdmi-connector: Fixing up cyclic dependency with 1ee0000.hdmi [ 0.157304] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.157348] HugeTLB registered 32.0 MiB page size, pre-allocated 0 pages [ 0.157366] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.157383] HugeTLB registered 64.0 KiB page size, pre-allocated 0 pages [ 1.014251] fbcon: Taking over console [ 1.016043] iommu: Default domain type: Translated [ 1.016075] iommu: DMA domain TLB invalidation policy: strict mode [ 1.016675] usbcore: registered new interface driver usbfs [ 1.016736] usbcore: registered new interface driver hub [ 1.016785] usbcore: registered new device driver usb [ 1.016992] power_supply_init_attrs: Property 37 skipped because it is missing from power_supply_attrs [ 1.018479] NetLabel: Initializing [ 1.018498] NetLabel: domain hash size = 128 [ 1.018512] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.018605] NetLabel: unlabeled traffic allowed by default [ 1.019247] clocksource: Switched to clocksource arch_sys_counter [ 1.079750] VFS: Disk quotas dquot_6.6.0 [ 1.079907] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.080905] AppArmor: AppArmor Filesystem Enabled [ 1.090674] NET: Registered PF_INET protocol family [ 1.090940] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) [ 1.092655] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) [ 1.092812] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.092889] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) [ 1.093153] TCP bind hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.093549] TCP: Hash tables configured (established 16384 bind 16384) [ 1.093906] MPTCP token hash table entries: 2048 (order: 3, 49152 bytes, linear) [ 1.094070] UDP hash table entries: 1024 (order: 3, 32768 bytes, linear) [ 1.094156] UDP-Lite hash table entries: 1024 (order: 3, 32768 bytes, linear) [ 1.094474] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.094517] NET: Registered PF_XDP protocol family [ 1.119922] hw perfevents: enabled with armv8_cortex_a53 PMU driver, 7 counters available [ 1.120593] kvm [1]: IPA Size Limit: 40 bits [ 1.121566] kvm [1]: vgic interrupt IRQ9 [ 1.121759] kvm [1]: Hyp mode initialized successfully [ 1.128280] Initialise system trusted keyrings [ 1.128392] Key type blacklist registered [ 1.128603] workingset: timestamp_bits=46 max_order=19 bucket_order=0 [ 1.136293] zbud: loaded [ 1.138716] integrity: Platform Keyring initialized [ 1.138743] Key type asymmetric registered [ 1.138760] Asymmetric key parser 'x509' registered [ 1.138860] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.139185] io scheduler mq-deadline registered [ 1.145002] sun50i-a64-r-pinctrl 1f02c00.pinctrl: initialized sunXi PIO driver [ 1.146226] sun50i-a64-r-pinctrl 1f02c00.pinctrl: supply vcc-pl not found, using dummy regulator [ 1.156402] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.161693] Error: Driver 'sun8i-hdmi-phy' is already registered, aborting... [ 1.167019] lima 1c40000.gpu: gp - mali400 version major 1 minor 1 [ 1.167106] lima 1c40000.gpu: pp0 - mali400 version major 1 minor 1 [ 1.167178] lima 1c40000.gpu: pp1 - mali400 version major 1 minor 1 [ 1.167228] lima 1c40000.gpu: l2 cache 64K, 4-way, 64byte cache line, 64bit external bus [ 1.167871] lima 1c40000.gpu: bus rate = 200000000 [ 1.167894] lima 1c40000.gpu: mod rate = 500000000 [ 1.168345] [drm] Initialized lima 1.1.0 20191231 for 1c40000.gpu on minor 0 [ 1.170648] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 1.170684] ehci-platform: EHCI generic platform driver [ 1.170900] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 1.170975] ohci-platform: OHCI generic platform driver [ 1.171593] mousedev: PS/2 mouse device common for all mice [ 1.172550] sun6i-rtc 1f00000.rtc: registered as rtc0 [ 1.172587] sun6i-rtc 1f00000.rtc: setting system clock to 2022-09-13T11:03:25 UTC (1663067005) [ 1.172618] sun6i-rtc 1f00000.rtc: RTC enabled [ 1.174224] sunxi-wdt 1c20ca0.watchdog: Watchdog enabled (timeout=16 sec, nowayout=0) [ 1.175929] Synopsys Designware Multimedia Card Interface Driver [ 1.176717] ledtrig-cpu: registered to indicate activity on CPUs [ 1.176905] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping .... [ 1.176971] hid: raw HID events driver (C) Jiri Kosina [ 1.177471] usbcore: registered new interface driver usbhid [ 1.177489] usbhid: USB HID core driver [ 1.177870] ashmem: initialized [ 1.181935] NET: Registered PF_INET6 protocol family [ 1.189452] Segment Routing with IPv6 [ 1.189565] In-situ OAM (IOAM) with IPv6 [ 1.189666] mip6: Mobile IPv6 [ 1.189685] NET: Registered PF_PACKET protocol family [ 1.189898] mpls_gso: MPLS GSO support [ 1.190835] registered taskstats version 1 [ 1.190864] Loading compiled-in X.509 certificates [ 1.192522] zswap: loaded using pool lz4hc/z3fold [ 1.193424] Key type ._fscrypt registered [ 1.193443] Key type .fscrypt registered [ 1.193456] Key type fscrypt-provisioning registered [ 1.193739] AppArmor: AppArmor sha1 policy hashing enabled [ 1.193782] ima: No TPM chip found, activating TPM-bypass! [ 1.193815] ima: Allocated hash algorithm: sha256 [ 1.193887] ima: No architecture policies found [ 1.210469] platform 1100000.mixer: Fixing up cyclic dependency with 1c0d000.lcd-controller [ 1.210585] platform 1100000.mixer: Fixing up cyclic dependency with 1c0c000.lcd-controller [ 1.211651] platform 1200000.mixer: Fixing up cyclic dependency with 1c0d000.lcd-controller [ 1.211763] platform 1200000.mixer: Fixing up cyclic dependency with 1c0c000.lcd-controller [ 1.212753] sunxi-rsb 1f03400.rsb: RSB running at 4000000 Hz [ 1.213232] axp20x-rsb sunxi-rsb-3a3: AXP20x variant AXP803 found [ 1.215763] axp20x-gpio axp20x-gpio: DMA mask not set [ 1.216416] axp20x-gpio axp20x-gpio: AXP209 pinctrl and GPIO driver loaded [ 1.218068] vcc-3v3: supplied by regulator-dummy [ 1.218655] vdd-cpux: supplied by regulator-dummy [ 1.219542] dcdc4: supplied by regulator-dummy [ 1.219761] vcc-dram: supplied by regulator-dummy [ 1.220344] vdd-sys: supplied by regulator-dummy [ 1.221039] dc1sw: supplied by regulator-dummy [ 1.221215] dovdd-csi: Bringing 3300000uV into 1800000-1800000uV [ 1.221666] dovdd-csi: supplied by regulator-dummy [ 1.221927] vcc-pl: supplied by regulator-dummy [ 1.222451] vcc-pll-avcc: supplied by regulator-dummy [ 1.223267] vcc-dsi-sensor: supplied by regulator-dummy [ 1.223739] vcc-mipi-io: supplied by regulator-dummy [ 1.224206] avdd-csi: supplied by regulator-dummy [ 1.224710] vcc-wifi-io: supplied by regulator-dummy [ 1.224958] vcc-lpddr: supplied by regulator-dummy [ 1.225722] eldo2: supplied by regulator-dummy [ 1.225959] dvdd-1v8-csi: Bringing 700000uV into 1800000-1800000uV [ 1.226457] dvdd-1v8-csi: supplied by regulator-dummy [ 1.226941] vcc-1v2-hsic: supplied by regulator-dummy [ 1.227183] vdd-cpus: supplied by regulator-dummy [ 1.227767] vcc-rtc: supplied by regulator-dummy [ 1.228311] vcc-lcd-ctp-stk: supplied by regulator-dummy [ 1.228547] vcc-1v8-typec: Bringing 3300000uV into 1800000-1800000uV [ 1.229054] vcc-1v8-typec: supplied by regulator-dummy [ 1.229209] axp20x-regulator axp20x-regulator: drivevbus has vin [ 1.229591] axp20x-rsb sunxi-rsb-3a3: AXP20X driver loaded [ 1.234895] sun50i-a64-pinctrl 1c20800.pinctrl: initialized sunXi PIO driver [ 1.237029] printk: console [ttyS0] disabled [ 1.257244] 1c28000.serial: ttyS0 at MMIO 0x1c28000 (irq = 43, base_baud = 1500000) is a U6_16550A [ 2.553242] printk: console [ttyS0] enabled [ 2.579230] 1c28400.serial: ttyS1 at MMIO 0x1c28400 (irq = 44, base_baud = 1500000) is a U6_16550A [ 2.588408] serial serial0: tty port ttyS1 registered [ 2.614697] 1c28c00.serial: ttyS2 at MMIO 0x1c28c00 (irq = 45, base_baud = 1500000) is a U6_16550A [ 2.626460] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 2.637846] i2c 0-0028: Fixing up cyclic dependency with 1c19400.phy [ 2.659150] sunxi-mmc 1c0f000.mmc: Got CD GPIO [ 2.659427] drivevbus: supplied by vcc5v0 [ 2.667791] usb0-vbus: supplied by drivevbus [ 2.673410] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 2.682988] phy id_det change to device [ 2.689126] sunxi-mmc 1c0f000.mmc: initialized, max. request size: 16384 KB, uses new timings mode [ 2.689358] sunxi-mmc 1c10000.mmc: initialized, max. request size: 16384 KB, uses new timings mode [ 2.690052] sunxi-mmc 1c11000.mmc: initialized, max. request size: 2048 KB, uses new timings mode [ 2.742046] mmc1: new high speed SDIO card at address 0001 [ 2.756715] mmc0: new high speed SDXC card at address 0001 [ 2.765061] mmcblk0: mmc0:0001 00000 59.6 GiB [ 2.776217] mmcblk0: p1 p2 [ 2.825384] mmc2: new DDR MMC card at address 0001 [ 2.831827] mmcblk2: mmc2:0001 14.7 GiB [ 2.842419] mmcblk2: p1 p2 [ 2.846710] mmcblk2boot0: mmc2:0001 4.00 MiB [ 2.857082] mmcblk2boot1: mmc2:0001 4.00 MiB [ 3.715402] phy phy-1c19400.phy.1: Changing dr_mode to 1 [ 3.720827] phy id_det change to host [ 3.935400] ehci-platform 1c1a000.usb: EHCI Host Controller [ 3.944702] ehci-platform 1c1a000.usb: new USB bus registered, assigned bus number 1 [ 3.956083] ehci-platform 1c1a000.usb: irq 29, io mem 0x01c1a000 [ 3.978309] ehci-platform 1c1a000.usb: USB 2.0 started, EHCI 1.00 [ 3.984865] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.993157] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.000401] usb usb1: Product: EHCI Host Controller [ 4.005297] usb usb1: Manufacturer: Linux 5.15.50 ehci_hcd [ 4.010820] usb usb1: SerialNumber: 1c1a000.usb [ 4.016010] hub 1-0:1.0: USB hub found [ 4.019817] hub 1-0:1.0: 1 port detected [ 4.027965] ehci-platform 1c1b000.usb: EHCI Host Controller [ 4.033821] ehci-platform 1c1b000.usb: new USB bus registered, assigned bus number 2 [ 4.045556] ehci-platform 1c1b000.usb: irq 31, io mem 0x01c1b000 [ 4.067269] ehci-platform 1c1b000.usb: USB 2.0 started, EHCI 1.00 [ 4.073626] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.081918] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.089180] usb usb2: Product: EHCI Host Controller [ 4.094075] usb usb2: Manufacturer: Linux 5.15.50 ehci_hcd [ 4.099575] usb usb2: SerialNumber: 1c1b000.usb [ 4.111323] hub 2-0:1.0: USB hub found [ 4.118172] hub 2-0:1.0: 1 port detected [ 4.123218] phy id_det change to host [ 4.331344] ohci-platform 1c1a400.usb: Generic Platform OHCI controller [ 4.342139] ohci-platform 1c1a400.usb: new USB bus registered, assigned bus number 3 [ 4.353564] ohci-platform 1c1a400.usb: irq 30, io mem 0x01c1a400 [ 4.426800] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 5.15 [ 4.435109] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.442368] usb usb3: Product: Generic Platform OHCI controller [ 4.448314] usb usb3: Manufacturer: Linux 5.15.50 ohci_hcd [ 4.453826] usb usb3: SerialNumber: 1c1a400.usb [ 4.459097] hub 3-0:1.0: USB hub found [ 4.462925] hub 3-0:1.0: 1 port detected [ 4.468163] ohci-platform 1c1b400.usb: Generic Platform OHCI controller [ 4.475158] ohci-platform 1c1b400.usb: new USB bus registered, assigned bus number 4 [ 4.483127] ohci-platform 1c1b400.usb: irq 32, io mem 0x01c1b400 [ 4.551571] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 5.15 [ 4.559879] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.567132] usb usb4: Product: Generic Platform OHCI controller [ 4.573078] usb usb4: Manufacturer: Linux 5.15.50 ohci_hcd [ 4.578588] usb usb4: SerialNumber: 1c1b400.usb [ 4.583894] hub 4-0:1.0: USB hub found [ 4.587719] hub 4-0:1.0: 1 port detected [ 4.592929] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 4.607195] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 4.619516] input: gpio-keys as /devices/platform/gpio-keys/input/input0 [ 4.627033] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 4.747731] EXT4-fs (mmcblk0p2): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. [ 4.757659] VFS: Mounted root (ext4 filesystem) on device 179:2. [ 4.773333] Freeing unused kernel memory: 4224K [ 4.778116] Run /sbin/init as init process [ 4.782245] with arguments: [ 4.782255] /sbin/init [ 4.782262] with environment: [ 4.782268] HOME=/ [ 4.782275] TERM=linux [ 4.797034] Not activating Mandatory Access Control as /sbin/tomoyo-init does not exist. [ 8.915698] udevd[585]: starting version 3.2.9 [ 8.969745] random: udevd: uninitialized urandom read (16 bytes read) [ 8.981674] random: udevd: uninitialized urandom read (16 bytes read) [ 8.990294] random: udevd: uninitialized urandom read (16 bytes read) [ 9.175858] udevd[586]: starting eudev-3.2.9 [ 9.457232] soundcore: module verification failed: signature and/or required key missing - tainting kernel [ 9.477938] i2c 3-003c: Fixing up cyclic dependency with 1cb0000.csi [ 9.511563] mc: Linux media interface: v0.10 [ 9.527850] i2c 3-004c: Fixing up cyclic dependency with 1cb0000.csi [ 9.566042] videodev: Linux video capture interface: v2.00 [ 9.571844] i2c-gpio i2c-csi: using lines 141 (SDA) and 140 (SCL) [ 9.578549] scpi_protocol scpi: SCP Protocol 1.2 Firmware 0.5.0 version [ 9.582586] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 9.595974] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 9.657081] sun8i-ce 1c15000.crypto: Set mod clock to 300000000 (300 Mhz) from 24000000 (24 Mhz) [ 9.668475] sun8i-ce 1c15000.crypto: will run requests pump with realtime priority [ 9.672451] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 9.676667] sun8i-ce 1c15000.crypto: will run requests pump with realtime priority [ 9.693083] sun8i-ce 1c15000.crypto: will run requests pump with realtime priority [ 9.701299] sun8i-ce 1c15000.crypto: will run requests pump with realtime priority [ 9.709317] sun8i-ce 1c15000.crypto: Register cbc(aes) [ 9.879476] cryptd: max_cpu_qlen set to 1000 [ 9.897016] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 9.928520] input: 1c21800.lradc as /devices/platform/soc/1c21800.lradc/input/input1 [ 9.937697] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 9.994345] musb-sunxi 1c19000.usb: Disabling musb host side code due to re-routed phy [ 10.003445] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 10.003562] sun8i-rotate 1020000.rotate: Device registered as /dev/video0 [ 10.019673] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 10.026360] usb_phy_generic usb_phy_generic.1.auto: supply vcc not found, using dummy regulator [ 10.044327] usb_phy_generic usb_phy_generic.1.auto: dummy supplies not allowed for exclusive requests [ 10.046822] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 10.073818] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 10.083412] alg: No test for fips(ansi_cprng) (fips_ansi_cprng) [ 10.092512] sunxi_cedrus: module is from the staging directory, the quality is unknown, you have been warned. [ 10.121786] cedrus 1c0e000.video-codec: Device registered as /dev/video1 [ 10.132208] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 10.171605] pinephone-keyboard 2-0015: error -ENXIO: Failed to read device ID [ 10.203779] bt-sco bt-sco-codec: ASoC: sink widget Capture overwritten [ 10.211457] bt-sco bt-sco-codec: ASoC: source widget Playback overwritten [ 10.219323] Goodix-TS 0-005d: ID 917S, version: 0200 [ 10.224918] simple-amplifier audio-amplifier: supply VCC not found, using dummy regulator [ 10.241660] debugfs: File 'AIF3 Playback' in directory 'dapm' already present! [ 10.253771] Goodix-TS 0-005d: Direct firmware load for goodix_917S_cfg.bin failed with error -2 [ 10.255419] debugfs: File 'AIF3 Capture' in directory 'dapm' already present! [ 10.270297] input: Goodix Capacitive TouchScreen as /devices/platform/soc/1c2ac00.i2c/i2c-0/0-005d/input/input3 [ 10.274084] debugfs: File 'Playback' in directory 'dapm' already present! [ 10.280536] af8133j 1-001c: Error reading product code [ 10.287304] debugfs: File 'Capture' in directory 'dapm' already present! [ 10.295832] cfg80211: Loading compiled-in X.509 certificates for regulatory database [ 10.300381] input: PinePhone Headset Jack as /devices/platform/sound/sound/card0/input2 [ 10.317554] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 10.318179] axp20x-adc axp813-adc: DMA mask not set [ 10.329395] axp20x-battery-power-supply axp20x-battery-power-supply: DMA mask not set [ 10.339813] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 10.341145] axp20x-usb-power-supply axp20x-usb-power-supply: DMA mask not set [ 10.349245] input: axp20x-pek as /devices/platform/soc/1f03400.rsb/sunxi-rsb-3a3/axp221-pek/input/input5 [ 10.362259] input: gpio-vibrator as /devices/platform/vibrator/input/input4 [ 10.374914] axp20x-usb-power-supply axp20x-usb-power-supply: Increasing Vbus hold voltage to 4.5V [ 10.385396] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 10.405795] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 10.421360] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 10.483350] anx7688 0-0028: power enabled [ 10.483656] anx7688 0-0028: Vendor id 0x1f29 [ 10.503367] anx7688 0-0028: power disabled [ 10.503631] anx7688 0-0028: enabling USB BC 1.2 detection [ 10.503830] anx7688 0-0028: plug irq (cd=1) [ 10.508585] panel-sitronix-st7703 1ca0000.dsi.0: mipi_dsi_attach failed (-517). Is host ready? [ 10.519354] anx7688 0-0028: cable inserted [ 10.544382] sun4i-drm display-engine: bound 1100000.mixer (ops 0xffffffc008be5728) [ 10.553533] sun4i-drm display-engine: bound 1200000.mixer (ops 0xffffffc008be5728) [ 10.559331] anx7688 0-0028: power enabled [ 10.562013] sun4i-drm display-engine: No panel or bridge found... RGB output disabled [ 10.565455] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' [ 10.570035] sun4i-drm display-engine: bound 1c0c000.lcd-controller (ops 0xffffffc008be0e38) [ 10.577023] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2 [ 10.585546] sun4i-drm display-engine: bound 1c0d000.lcd-controller (ops 0xffffffc008be0e38) [ 10.593853] cfg80211: failed to load regulatory.db [ 10.602151] sun4i-drm display-engine: bound 1ca0000.dsi (ops 0xffffffc008be4588) [ 10.617863] sun8i-dw-hdmi 1ee0000.hdmi: Detected HDMI TX controller v1.32a with HDCP (sun8i_dw_hdmi_phy) [ 10.635789] sun8i-dw-hdmi 1ee0000.hdmi: registered DesignWare HDMI I2C bus driver [ 10.647186] sun4i-drm display-engine: bound 1ee0000.hdmi (ops 0xffffffc008be4a60) [ 10.659944] [drm] Initialized sun4i-drm 1.0.0 20150629 for display-engine on minor 1 [ 10.671421] sun4i-drm display-engine: [drm] Cannot find any crtc or sizes [ 10.720825] Bluetooth: Core ver 2.22 [ 10.720966] NET: Registered PF_BLUETOOTH protocol family [ 10.720970] Bluetooth: HCI device and connection manager initialized [ 10.720990] Bluetooth: HCI socket layer initialized [ 10.721016] Bluetooth: L2CAP socket layer initialized [ 10.721033] Bluetooth: SCO socket layer initialized [ 10.759020] Bluetooth: HCI UART driver ver 2.3 [ 10.759052] Bluetooth: HCI UART protocol H4 registered [ 10.760184] sun8i-ce 1c15000.crypto: Fallback for cbc-aes-sun8i-ce is cbc-aes-ce [ 10.761311] Bluetooth: HCI UART protocol Three-wire (H5) registered [ 10.762005] Bluetooth: HCI UART protocol Broadcom registered [ 10.763139] sun8i-ce 1c15000.crypto: Register ecb(aes) [ 10.764040] sun8i-ce 1c15000.crypto: Fallback for ecb-aes-sun8i-ce is ecb-aes-ce [ 10.766023] sun8i-ce 1c15000.crypto: Register cbc(des3_ede) [ 10.829163] sun6i-csi 1cb0000.csi: creating gc2145 3-003c:0 -> sun6i-csi:0 link [ 10.829194] sun6i-csi 1cb0000.csi: creating ov5640 3-004c:0 -> sun6i-csi:0 link [ 10.902164] Console: switching to colour frame buffer device 180x45 [ 10.940022] 8723cs: module is from the staging directory, the quality is unknown, you have been warned. [ 10.944860] sun4i-drm display-engine: [drm] fb0: sun4i-drmdrmfb frame buffer device [ 10.991269] gc2145 3-003c: [wr fe] <= 00 [ 11.055147] gc2145 3-003c: bank switch: 0x00 [ 11.060237] gc2145 3-003c: [rd f0] => 21 45 [ 11.060259] gc2145 3-003c: device id: 0x2145 [ 11.070098] gc2145 3-003c: [wr fe] <= f0 [ 11.070558] gc2145 3-003c: [wr fc] <= 06 [ 11.070963] gc2145 3-003c: [wr f7] <= 1d [ 11.071391] gc2145 3-003c: [wr f8] <= 84 [ 11.071796] gc2145 3-003c: [wr fa] <= 00 [ 11.072198] gc2145 3-003c: [wr f9] <= fe [ 11.072599] gc2145 3-003c: [wr f2] <= 00 [ 11.073003] gc2145 3-003c: [wr 19] <= 0c [ 11.073408] gc2145 3-003c: [wr 20] <= 01 [ 11.073813] gc2145 3-003c: [wr 80] <= 0b [ 11.074217] gc2145 3-003c: [wr 86] <= 00 [ 11.074752] sun6i-csi 1cb0000.csi: Direct firmware load for gc2145-init.bin failed with error -2 [ 11.089216] gc2145 3-003c: Failed to read firmware gc2145-init.bin, continuing anyway... [ 11.089249] gc2145 3-003c: [wr fd] <= 00 [ 11.089699] gc2145 3-003c: [wr 18] <= 0a [ 11.103347] gc2145 3-003c: [wr 09] <= 00 00 [ 11.103883] gc2145 3-003c: [wr 0b] <= 00 00 [ 11.104409] gc2145 3-003c: [wr 0d] <= 04 d0 [ 11.104934] gc2145 3-003c: [wr 0f] <= 06 50 [ 11.105459] gc2145 3-003c: [wr 05] <= 01 f1 [ 11.105983] gc2145 3-003c: [wr 07] <= 00 08 [ 11.106508] gc2145 3-003c: [wr 11] <= 00 1e [ 11.107033] gc2145 3-003c: [wr 13] <= 02 [ 11.107480] gc2145 3-003c: [wr 14] <= 02 [ 11.107892] gc2145 3-003c: [wr f7] <= 11 [ 11.108293] gc2145 3-003c: [wr f8] <= 84 [ 11.108704] gc2145 3-003c: [wr fa] <= 10 [ 11.109628] gc2145 3-003c: [rd 82] => 00 [ 11.109635] gc2145 3-003c: [wr 82] <= 00 [ 11.110038] gc2145 3-003c: [wr b3] <= 40 [ 11.110440] gc2145 3-003c: [wr b4] <= 40 [ 11.110841] gc2145 3-003c: [wr b5] <= 40 [ 11.111277] sun6i-mipi-dsi 1ca0000.dsi: Attached device xbd599 [ 11.111280] gc2145 3-003c: [wr fe] <= 01 [ 11.111685] gc2145 3-003c: bank switch: 0x01 [ 11.122863] panel-sitronix-st7703 1ca0000.dsi.0: 720x1440@60 24bpp dsi 4dl - ready [ 11.132547] gc2145 3-003c: [wr ec] <= 04 [ 11.134041] random: crng init done [ 11.134045] random: 9 urandom warning(s) missed due to ratelimiting [ 11.166770] gc2145 3-003c: [wr ed] <= 04 [ 11.167190] gc2145 3-003c: [wr ee] <= c0 [ 11.167621] gc2145 3-003c: [wr ef] <= 8e [ 11.168028] gc2145 3-003c: [wr fe] <= 00 [ 11.168442] gc2145 3-003c: bank switch: 0x00 [ 11.169003] gc2145 3-003c: [rd 82] => 00 [ 11.169016] gc2145 3-003c: [wr 82] <= 02 [ 11.169456] gc2145 3-003c: [wr b6] <= 00 [ 11.169899] gc2145 3-003c: [wr 03] <= 04 b0 [ 11.170432] gc2145 3-003c: [wr b1] <= 20 [ 11.170833] gc2145 3-003c: [wr b2] <= e0 [ 11.171277] gc2145 3-003c: [wr fe] <= 01 [ 11.171688] gc2145 3-003c: bank switch: 0x01 [ 11.171694] gc2145 3-003c: [wr 01] <= 04 [ 11.172099] gc2145 3-003c: [wr 02] <= c0 [ 11.172505] gc2145 3-003c: [wr 03] <= 04 [ 11.172916] gc2145 3-003c: [wr 04] <= 8e [ 11.173321] gc2145 3-003c: [wr 05] <= 08 [ 11.173725] gc2145 3-003c: [wr 06] <= b8 [ 11.174127] gc2145 3-003c: [wr 07] <= 08 [ 11.174530] gc2145 3-003c: [wr 08] <= 86 [ 11.174931] gc2145 3-003c: [wr fe] <= 00 [ 11.175370] gc2145 3-003c: bank switch: 0x00 [ 11.175380] gc2145 3-003c: [wr b6] <= 01 [ 11.175786] gc2145 3-003c: [wr fe] <= 01 [ 11.176186] gc2145 3-003c: bank switch: 0x01 [ 11.176191] gc2145 3-003c: [wr 27] <= 01 36 [ 11.176715] gc2145 3-003c: [wr 35] <= 50 [ 11.177116] gc2145 3-003c: [wr 29] <= 02 6c [ 11.177642] gc2145 3-003c: [wr 36] <= 50 [ 11.178043] gc2145 3-003c: [wr 2b] <= 03 a2 [ 11.178566] gc2145 3-003c: [wr 37] <= 50 [ 11.178967] gc2145 3-003c: [wr 2d] <= 04 d8 [ 11.179502] gc2145 3-003c: [wr 38] <= 50 [ 11.179904] gc2145 3-003c: [wr 2f] <= 06 0e [ 11.180428] gc2145 3-003c: [wr 39] <= 50 [ 11.180828] gc2145 3-003c: [wr 31] <= 07 44 [ 11.181351] gc2145 3-003c: [wr 3a] <= 50 [ 11.181751] gc2145 3-003c: [wr 33] <= 08 7a [ 11.182274] gc2145 3-003c: [wr 3b] <= 50 [ 11.182674] gc2145 3-003c: [wr 1f] <= 50 [ 11.183074] gc2145 3-003c: [wr 20] <= e0 [ 11.183486] gc2145 3-003c: [wr fe] <= 00 [ 11.183887] gc2145 3-003c: bank switch: 0x00 [ 11.183892] gc2145 3-003c: [wr 84] <= 00 [ 11.184811] gc2145 3-003c: [rd 80] => 0b [ 11.184818] gc2145 3-003c: [wr 80] <= 4b [ 11.185737] gc2145 3-003c: [rd 80] => 0b [ 11.231988] gc2145 3-003c: [wr 80] <= 0b [ 11.232469] gc2145 3-003c: [wr 24] <= ff [ 11.232892] gc2145 3-003c: [wr b6] <= 01 [ 11.233301] gc2145 3-003c: [wr fe] <= 01 [ 11.233707] gc2145 3-003c: bank switch: 0x01 [ 11.242859] gc2145 3-003c: [wr 13] <= 7b [ 11.243422] gc2145 3-003c: [wr fe] <= 00 [ 11.243836] gc2145 3-003c: bank switch: 0x00 [ 11.253426] gc2145 3-003c: [rd 17] => 00 [ 11.253452] gc2145 3-003c: [wr 17] <= 00 [ 11.254384] gc2145 3-003c: [rd 17] => 00 [ 11.254394] gc2145 3-003c: [wr 17] <= 00 [ 11.254799] gc2145 3-003c: [wr 8c] <= 00 [ 11.255202] gc2145 3-003c: [wr 8d] <= 01 [ 11.320692] sun8i-ce 1c15000.crypto: Fallback for cbc-des3-sun8i-ce is cbc(des3_ede-generic) [ 11.350452] sun8i-ce 1c15000.crypto: Register ecb(des3_ede) [ 11.386964] sun8i-ce 1c15000.crypto: Fallback for ecb-des3-sun8i-ce is ecb(des3_ede-generic) [ 11.406254] sun8i-ce 1c15000.crypto: Register md5 [ 11.418191] sun8i-ce 1c15000.crypto: Fallback for md5-sun8i-ce is md5-generic [ 11.423454] Bluetooth: hci0: RTL: examining hci_ver=07 hci_rev=000b lmp_ver=07 lmp_subver=8703 [ 11.448534] Bluetooth: hci0: RTL: chip_type status=0 type=5 [ 11.463713] Bluetooth: hci0: RTL: rom_version status=0 version=1 [ 11.465119] sun8i-ce 1c15000.crypto: Register sha1 [ 11.474579] Bluetooth: hci0: RTL: loading rtl_bt/rtl8723cs_xx_fw.bin [ 11.484387] sun8i-ce 1c15000.crypto: Fallback for sha1-sun8i-ce is sha1-ce [ 11.495427] bluetooth hci0: Direct firmware load for rtl_bt/rtl8723cs_xx_fw.bin failed with error -2 [ 11.520796] Bluetooth: hci0: RTL: firmware file rtl_bt/rtl8723cs_xx_fw.bin not found [ 11.525654] sun8i-ce 1c15000.crypto: Register sha224 [ 11.525968] sun8i-ce 1c15000.crypto: Fallback for sha224-sun8i-ce is sha224-ce [ 11.569518] sun8i-ce 1c15000.crypto: Register sha256 [ 11.572247] sun8i-ce 1c15000.crypto: Fallback for sha256-sun8i-ce is sha256-ce [ 11.643067] sun8i-ce 1c15000.crypto: DEBUG: Algo of sha384 not supported [ 11.654990] sun8i-ce 1c15000.crypto: DEBUG: Algo of sha512 not supported [ 11.655006] sun8i-ce 1c15000.crypto: Register stdrng [ 11.655813] alg: No test for stdrng (sun8i-ce-prng) [ 11.655906] sun8i-ce 1c15000.crypto: TRNG not supported [ 11.655915] sun8i-ce 1c15000.crypto: CryptoEngine Die ID 0 [ 12.324846] anx7688 0-0028: boot firmware load failed (you may need to flash FW to anx7688 first) [ 12.358436] anx7688 0-0028: power disabled [ 12.358462] anx7688 0-0028: OCM configuration failed [ 12.374356] anx7688 0-0028: spurious status irq [ 12.415306] i2c i2c-1: mv64xxx: I2C bus locked, block: 1, time_left: 0 [ 12.432792] iio iio:device2: failed to read Who-Am-I register. [ 12.449126] st-magn-i2c: probe of 1-001e failed with error -110 [ 12.487335] SPI driver st-magn-spi has no spi_device_id for st,lis3mdl-magn [ 12.502241] SPI driver st-magn-spi has no spi_device_id for st,lsm303agr-magn [ 12.517201] SPI driver st-magn-spi has no spi_device_id for st,lsm9ds1-magn [ 12.729556] i2c i2c-1: Added multiplexed i2c bus 5 [ 14.368106] EXT4-fs (mmcblk0p2): re-mounted. Opts: (null). Quota mode: none. [ 16.484921] EXT4-fs (mmcblk0p1): mounting ext2 file system using the ext4 subsystem [ 16.524268] EXT4-fs (mmcblk0p1): mounted filesystem without journal. Opts: (null). Quota mode: none. [ 16.540798] ext2 filesystem being mounted at /boot supports timestamps until 2038 (0x7fffffff) [ 21.889286] zram: Added device: zram0 [ 21.904301] zram: Added device: zram1 [ 21.913890] zram: Added device: zram2 [ 21.923841] zram: Added device: zram3 [ 22.025851] zram0: detected capacity change from 0 to 131072 [ 22.080772] Adding 65532k swap on /dev/zram0. Priority:100 extents:1 across:65532k SSFS [ 22.103691] zram1: detected capacity change from 0 to 131072 [ 22.148035] Adding 65532k swap on /dev/zram1. Priority:100 extents:1 across:65532k SSFS [ 22.171111] zram2: detected capacity change from 0 to 131072 [ 22.216784] Adding 65532k swap on /dev/zram2. Priority:100 extents:1 across:65532k SSFS [ 22.243676] zram3: detected capacity change from 0 to 131072 [ 22.294075] Adding 65532k swap on /dev/zram3. Priority:100 extents:1 across:65532k SSFS [ 30.543782] hdmi-audio-codec hdmi-audio-codec.5.auto: Only one simultaneous stream supported! [ 30.564842] hdmi-audio-codec hdmi-audio-codec.5.auto: ASoC: error at snd_soc_dai_startup on i2s-hifi: -22 [ 30.583805] 1c22800.i2s-i2s-hifi: soc_pcm_open() failed (-22) [ 30.584962] hdmi-audio-codec hdmi-audio-codec.5.auto: Only one simultaneous stream supported! [ 30.617041] hdmi-audio-codec hdmi-audio-codec.5.auto: ASoC: error at snd_soc_dai_startup on i2s-hifi: -22 [ 30.617123] 1c22800.i2s-i2s-hifi: soc_pcm_open() failed (-22) [ 30.654355] hdmi-audio-codec hdmi-audio-codec.5.auto: Only one simultaneous stream supported! [ 30.672997] hdmi-audio-codec hdmi-audio-codec.5.auto: ASoC: error at snd_soc_dai_startup on i2s-hifi: -22 [ 30.692657] 1c22800.i2s-i2s-hifi: soc_pcm_open() failed (-22) [ 30.709541] hdmi-audio-codec hdmi-audio-codec.5.auto: Only one simultaneous stream supported! [ 30.728121] hdmi-audio-codec hdmi-audio-codec.5.auto: ASoC: error at snd_soc_dai_startup on i2s-hifi: -22 [ 30.747610] 1c22800.i2s-i2s-hifi: soc_pcm_open() failed (-22) [ 35.637692] broken atomic modeset userspace detected, disabling atomic [ 35.807321] ps: disabling [ 35.810185] dc1sw: disabling [ 35.816671] vcc-1v2-hsic: disabling [ 46.512583] defender (2457): /proc/2456/oom_adj is deprecated, please use /proc/2456/oom_score_adj instead. [ 57.083319] usb 2-1: new high-speed USB device number 2 using ehci-platform [ 57.265537] usb 2-1: New USB device found, idVendor=2c7c, idProduct=0125, bcdDevice= 3.18 [ 57.273920] usb 2-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 57.281270] usb 2-1: Product: EG25-G [ 57.285027] usb 2-1: Manufacturer: Quectel [ 57.424213] usbcore: registered new interface driver usbserial_generic [ 57.431346] usbserial: USB Serial support registered for generic [ 57.491009] usbcore: registered new interface driver option [ 57.501185] usbserial: USB Serial support registered for GSM modem (1-port) [ 57.503471] usbcore: registered new interface driver cdc_wdm [ 57.521193] option 2-1:1.0: GSM modem (1-port) converter detected [ 57.528267] usb 2-1: GSM modem (1-port) converter now attached to ttyUSB0 [ 57.535729] option 2-1:1.1: GSM modem (1-port) converter detected [ 57.543068] usb 2-1: GSM modem (1-port) converter now attached to ttyUSB1 [ 57.550541] option 2-1:1.2: GSM modem (1-port) converter detected [ 57.557754] usb 2-1: GSM modem (1-port) converter now attached to ttyUSB2 [ 57.565347] option 2-1:1.3: GSM modem (1-port) converter detected [ 57.572288] usb 2-1: GSM modem (1-port) converter now attached to ttyUSB3 [ 57.581344] qmi_wwan 2-1:1.4: cdc-wdm0: USB WDM device [ 57.588778] qmi_wwan 2-1:1.4 wwan0: register 'qmi_wwan' at usb-1c1b000.usb-1, WWAN/QMI device, 22:b4:2e:e9:c9:3e [ 57.600975] usbcore: registered new interface driver qmi_wwan [ 80.772392] gc2145 3-003c: [rd f0] => 21 45 [ 80.772439] gc2145 3-003c: device id: 0x2145 [ 80.776799] gc2145 3-003c: [wr fe] <= f0 [ 80.777471] gc2145 3-003c: [wr fc] <= 06 [ 80.778136] gc2145 3-003c: [wr f7] <= 1d [ 80.778796] gc2145 3-003c: [wr f8] <= 84 [ 80.779524] gc2145 3-003c: [wr fa] <= 00 [ 80.780198] gc2145 3-003c: [wr f9] <= fe [ 80.780862] gc2145 3-003c: [wr f2] <= 00 [ 80.781529] gc2145 3-003c: [wr 19] <= 0c [ 80.782195] gc2145 3-003c: [wr 20] <= 01 [ 80.782861] gc2145 3-003c: [wr 80] <= 0b [ 80.783576] gc2145 3-003c: [wr 86] <= 00 [ 80.784575] sun6i-csi 1cb0000.csi: Direct firmware load for gc2145-init.bin failed with error -2 [ 80.793433] gc2145 3-003c: Failed to read firmware gc2145-init.bin, continuing anyway... [ 80.801562] gc2145 3-003c: [wr fd] <= 00 [ 80.802243] gc2145 3-003c: [wr 18] <= 0a [ 80.802912] gc2145 3-003c: [wr 09] <= 00 00 [ 80.803832] gc2145 3-003c: [wr 0b] <= 00 00 [ 80.804702] gc2145 3-003c: [wr 0d] <= 04 d0 [ 80.805567] gc2145 3-003c: [wr 0f] <= 06 50 [ 80.806431] gc2145 3-003c: [wr 05] <= 01 f1 [ 80.807342] gc2145 3-003c: [wr 07] <= 00 08 [ 80.808213] gc2145 3-003c: [wr 11] <= 00 1e [ 80.809081] gc2145 3-003c: [wr 13] <= 02 [ 80.809745] gc2145 3-003c: [wr 14] <= 02 [ 80.810416] gc2145 3-003c: [wr f7] <= 11 [ 80.811077] gc2145 3-003c: [wr f8] <= 84 [ 80.811784] gc2145 3-003c: [wr fa] <= 10 [ 80.813290] gc2145 3-003c: [rd 82] => 00 [ 80.813308] gc2145 3-003c: [wr 82] <= 00 [ 80.813970] gc2145 3-003c: [wr b3] <= 40 [ 80.814632] gc2145 3-003c: [wr b4] <= 40 [ 80.815342] gc2145 3-003c: [wr b5] <= 40 [ 80.816010] gc2145 3-003c: [wr fe] <= 01 [ 80.816673] gc2145 3-003c: bank switch: 0x01 [ 80.820993] gc2145 3-003c: [wr ec] <= 04 [ 80.821666] gc2145 3-003c: [wr ed] <= 04 [ 80.822328] gc2145 3-003c: [wr ee] <= c0 [ 80.822986] gc2145 3-003c: [wr ef] <= 8e [ 80.823689] gc2145 3-003c: [wr fe] <= 00 [ 80.824351] gc2145 3-003c: bank switch: 0x00 [ 80.829505] gc2145 3-003c: [rd 82] => 00 [ 80.829525] gc2145 3-003c: [wr 82] <= 02 [ 80.830189] gc2145 3-003c: [wr b6] <= 00 [ 80.830851] gc2145 3-003c: [wr 03] <= 04 b0 [ 80.831827] gc2145 3-003c: [wr b1] <= 20 [ 80.832493] gc2145 3-003c: [wr b2] <= e0 [ 80.833153] gc2145 3-003c: [wr fe] <= 01 [ 80.833810] gc2145 3-003c: bank switch: 0x01 [ 80.838133] gc2145 3-003c: [wr 01] <= 04 [ 80.838806] gc2145 3-003c: [wr 02] <= c0 [ 80.839508] gc2145 3-003c: [wr 03] <= 04 [ 80.840174] gc2145 3-003c: [wr 04] <= 8e [ 80.840835] gc2145 3-003c: [wr 05] <= 08 [ 80.841497] gc2145 3-003c: [wr 06] <= b8 [ 80.842157] gc2145 3-003c: [wr 07] <= 08 [ 80.842818] gc2145 3-003c: [wr 08] <= 86 [ 80.843522] gc2145 3-003c: [wr fe] <= 00 [ 80.844182] gc2145 3-003c: bank switch: 0x00 [ 80.848501] gc2145 3-003c: [wr b6] <= 01 [ 80.849175] gc2145 3-003c: [wr fe] <= 01 [ 80.849872] gc2145 3-003c: bank switch: 0x01 [ 80.854203] gc2145 3-003c: [wr 27] <= 01 36 [ 80.855075] gc2145 3-003c: [wr 35] <= 50 [ 80.855781] gc2145 3-003c: [wr 29] <= 02 6c [ 80.856683] gc2145 3-003c: [wr 36] <= 50 [ 80.857344] gc2145 3-003c: [wr 2b] <= 03 a2 [ 80.858205] gc2145 3-003c: [wr 37] <= 50 [ 80.858865] gc2145 3-003c: [wr 2d] <= 04 d8 [ 80.859779] gc2145 3-003c: [wr 38] <= 50 [ 80.860446] gc2145 3-003c: [wr 2f] <= 06 0e [ 80.861308] gc2145 3-003c: [wr 39] <= 50 [ 80.861968] gc2145 3-003c: [wr 31] <= 07 44 [ 80.862832] gc2145 3-003c: [wr 3a] <= 50 [ 80.863540] gc2145 3-003c: [wr 33] <= 08 7a [ 80.864411] gc2145 3-003c: [wr 3b] <= 50 [ 80.865072] gc2145 3-003c: [wr 1f] <= 50 [ 80.865731] gc2145 3-003c: [wr 20] <= e0 [ 80.866393] gc2145 3-003c: [wr fe] <= 00 [ 80.867051] gc2145 3-003c: bank switch: 0x00 [ 80.871372] gc2145 3-003c: [wr 84] <= 00 [ 80.872874] gc2145 3-003c: [rd 80] => 0b [ 80.872892] gc2145 3-003c: [wr 80] <= 4b [ 80.874384] gc2145 3-003c: [rd 80] => 0b [ 80.874401] gc2145 3-003c: [wr 80] <= 0b [ 80.875062] gc2145 3-003c: [wr 24] <= ff [ 80.875794] gc2145 3-003c: [wr b6] <= 01 [ 80.876462] gc2145 3-003c: [wr fe] <= 01 [ 80.877121] gc2145 3-003c: bank switch: 0x01 [ 80.881444] gc2145 3-003c: [wr 13] <= 7b [ 80.882111] gc2145 3-003c: [wr fe] <= 00 [ 80.882772] gc2145 3-003c: bank switch: 0x00 [ 80.887952] gc2145 3-003c: [rd 17] => 00 [ 80.887972] gc2145 3-003c: [wr 17] <= 00 [ 80.889471] gc2145 3-003c: [rd 17] => 00 [ 80.889489] gc2145 3-003c: [wr 17] <= 00 [ 80.890155] gc2145 3-003c: [wr 8c] <= 00 [ 80.890819] gc2145 3-003c: [wr 8d] <= 01 [ 92.137938] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready

[rafael2k]

How much difference you get in the kernel compile time (or any other software compile time), just out of curiosity? (bacause I did kernel compile on this kernel)

[freemangordon]

Hard to say, as it never finishes, but kernel downgrade:

sudo apt-get install linux-image-pine64=5.15.21-1+2m7.1

takes maybe 3 minutes

[freemangordon]

Seems I underestimated :)

root@devuan-pinephone:~# uname -a Linux devuan-pinephone 5.15.50 #1 SMP Mon Jul 4 07:51:00 UTC 2022 aarch64 GNU/Linux root@devuan-pinephone:~# time apt-get install linux-image-pine64=5.15.21-1+2m7.1 Reading package lists... Done Building dependency tree
Reading state information... Done The following packages will be DOWNGRADED: linux-image-pine64 0 upgraded, 0 newly installed, 1 downgraded, 0 to remove and 0 not upgraded. Need to get 0 B/33.3 MB of archives. After this operation, 39.9 kB disk space will be freed. Do you want to continue? [Y/n] y dpkg: warning: downgrading linux-image-pine64 from 5.15.50-1+2m7 to 5.15.21-1+2m7.1 (Reading database ... 81069 files and directories currently installed.) Preparing to unpack .../linux-image-pine64_5.15.21-1+2m7.1_arm64.deb ... Unpacking linux-image-pine64 (5.15.21-1+2m7.1) over (5.15.50-1+2m7) ... Setting up linux-image-pine64 (5.15.21-1+2m7.1) ...

real 5m17.079s user 0m33.079s sys 0m8.933s

Most of the time iowait was between 45%-70%, at the end it jumped to > 96% for maybe 10 seconds

[rafael2k]

Right. No idea what to do, apart of choosing another upstream kernel not from Mobian.

[rafael2k]

Should we jump to kernel 6.0? May be from Megi's fork: https://github.com/megous/linux/commits/pp-6.0

edit: plus manjaro patches: https://gitlab.manjaro.org/manjaro-arm/packages/core/linux-pinephone/-/tree/6.0-megi

[rafael2k]

For the record: https://gitlab.com/mobian1/devices/sunxi64-linux/-/commit/9d95f9b3990734dcfa55c1eee4aa3ff876e083c8 https://gitlab.com/mobian1/devices/sunxi64-linux/-/commit/dbe7bf9b6fc8fefbbbc207c1a07fe890605fe07c https://lore.kernel.org/all/20220115121447.641524-1-andrej.skvortzov@gmail.com/

We might try upgrading to mobian 5.15.59 and see if the issue is gone.

[freemangordon]

right. if you provide repo with the upgrade I can try to build and test the kernel here (never build aarch64 kernel before, but I doubt it is rocket science)

[rafael2k]

https://gitlab.com/mobian1/devices/sunxi64-linux/ branch mobian-5.15

[freemangordon]

root@devuan-pinephone:~# time apt-get install linux-image-pine64=5.15.21-1+2m7.1 Reading package lists... Done Building dependency tree
Reading state information... Done The following packages will be DOWNGRADED: linux-image-pine64 0 upgraded, 0 newly installed, 1 downgraded, 0 to remove and 0 not upgraded. Need to get 0 B/33.3 MB of archives. After this operation, 46.1 kB disk space will be freed. Do you want to continue? [Y/n] y dpkg: warning: downgrading linux-image-pine64 from 5.15.68-1+2m7 to 5.15.21-1+2m7.1 (Reading database ... 81050 files and directories currently installed.) Preparing to unpack .../linux-image-pine64_5.15.21-1+2m7.1_arm64.deb ... Unpacking linux-image-pine64 (5.15.21-1+2m7.1) over (5.15.68-1+2m7) ... Setting up linux-image-pine64 (5.15.21-1+2m7.1) ...

real 3m41.460s user 0m44.475s sys 0m9.500s

[freemangordon]

For reference, the opposite:

root@devuan-pinephone:~# time apt-get install linux-image-pine64 Reading package lists... Done Building dependency tree
Reading state information... Done The following packages will be upgraded: linux-image-pine64 1 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. Need to get 0 B/33.3 MB of archives. After this operation, 46.1 kB of additional disk space will be used. (Reading database ... 81070 files and directories currently installed.) Preparing to unpack .../linux-image-pine64_5.15.68-1+2m7_arm64.deb ... Unpacking linux-image-pine64 (5.15.68-1+2m7) over (5.15.21-1+2m7.1) ... Setting up linux-image-pine64 (5.15.68-1+2m7) ...

real 1m6.768s user 0m44.343s sys 0m9.824s

[rafael2k]

As I don't have this pre-production version of the PinePhone @freemangordon has, and the problem mentioned here does not appear for no one else, not even in Mobian (which is the same kernel of ours), and the author of the issue can not bisect the supposed bug this ticket should be closed.

[freemangordon]

will try to bisect soon

[rafael2k]

Try 6.1.2 first... see if the problem is gone. If you want I have it packaged.

[rafael2k]

Here the packages: http://abradig.org.br/maemo-crazyness/kernel/ The PR associated with this package: https://github.com/maemo-leste/pine64-kernel/pulls

[freemangordon]

will try tho one in chimaera first, then, if it is not fixed, your debs (if they differ). If I still have issues, will consider if I want to waste more time chasing bug that appears only on my HW.

[rafael2k]

The one in Chimaera right now is the same of Beowulf-devel one.