openwrt / mt76

mac80211 driver for MediaTek MT76x0e, MT76x2e, MT7603, MT7615, MT7628 and MT7688
745 stars 342 forks source link

802.11s MESH BROKEN MT7915E (RT3200) #622

Open lynxthecat opened 2 years ago

lynxthecat commented 2 years ago

Presumably the recent mt76 feature updates are responsible for the reports surfacing of mesh having been broken in recent snapshots.

To elaborate, I have x3 RT3200's setup in an 802.11s mesh. For months it has been 100% stable, but now recently either one of my two extension nodes becomes inaccessible even though the other stations list the inaccessible node as still connected. Rebooting my main router restores connectivity, but then eventually one of the two extensions nodes will again become inaccessible. By inaccessible I mean I cannot access the web interface or ping the affected node.

I believe this issue has surfaced as a result of a change reflected in a fairly recent snapshot.

The receive and send packets seem to increase during the period of inaccessibility (which I don't understand)? See the first station (presently inaccessible) rx/tx packets increase:

root@OpenWrt:~# iw dev wlan1 station dump |grep -i packets -A 2 -B 2
        inactive time:  50 ms
        rx bytes:       11694224
        rx packets:     98735
        tx bytes:       115203
        tx packets:     921
        tx retries:     0
        tx failed:      0
--
        inactive time:  10 ms
        rx bytes:       39163475
        rx packets:     184596
        tx bytes:       107933315
        tx packets:     100696
        tx retries:     0
        tx failed:      0
root@OpenWrt:~# iw dev wlan1 station dump |grep -i packets -A 2 -B 2
        inactive time:  90 ms
        rx bytes:       11698067
        rx packets:     98769
        tx bytes:       115203
        tx packets:     921
        tx retries:     0
        tx failed:      0
--
        inactive time:  0 ms
        rx bytes:       39168194
        rx packets:     184638
        tx bytes:       107934713
        tx packets:     100703
        tx retries:     0
        tx failed:      0

Dmesg output:

BusyBox v1.34.1 (2021-11-16 09:48:45 UTC) built-in shell (ash)

  _______                     ________        __
 |       |.-----.-----.-----.|  |  |  |.----.|  |_
 |   -   ||  _  |  -__|     ||  |  |  ||   _||   _|
 |_______||   __|_____|__|__||________||__|  |____|
          |__| W I R E L E S S   F R E E D O M
 -----------------------------------------------------
 OpenWrt SNAPSHOT, r18107-db34b93331
 -----------------------------------------------------
root@OpenWrt:~# dmesg
[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034]
[    0.000000] Linux version 5.10.79 (builder@buildhost) (aarch64-openwrt-linux-musl-gcc (OpenWrt GCC 11.2.0 r18107-db34b93331) 11.2.0, GNU ld (GNU Binutils) 2.37) #0 SMP Tue Nov 16 21:02:45 2021
[    0.000000] Machine model: Linksys E8450 (UBI)
[    0.000000] earlycon: uart8250 at MMIO32 0x0000000011002000 (options '')
[    0.000000] printk: bootconsole [uart8250] enabled
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000040000000-0x000000005fffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000040000000-0x0000000042ffffff]
[    0.000000]   node   0: [mem 0x0000000043000000-0x000000004302ffff]
[    0.000000]   node   0: [mem 0x0000000043030000-0x000000005fffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000005fffffff]
[    0.000000] On node 0 totalpages: 131072
[    0.000000]   DMA zone: 2048 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 131072 pages, LIFO batch:31
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: MIGRATE_INFO_TYPE not supported.
[    0.000000] psci: SMC Calling Convention v1.2
[    0.000000] percpu: Embedded 20 pages/cpu s43864 r8192 d29864 u81920
[    0.000000] pcpu-alloc: s43864 r8192 d29864 u81920 alloc=20*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1
[    0.000000] Detected VIPT I-cache on CPU0
[    0.000000] CPU features: detected: ARM erratum 845719
[    0.000000] CPU features: kernel page table isolation disabled by kernel configuration
[    0.000000] CPU features: detected: ARM erratum 843419
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 129024
[    0.000000] Kernel command line: earlycon=uart8250,mmio32,0x11002000 console=ttyS0,115200n1 swiotlb=512
[    0.000000] Dentry cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.000000] Inode-cache hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] Memory: 493488K/524288K available (8126K kernel code, 876K rwdata, 2220K rodata, 448K init, 302K bss, 30800K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
[    0.000000] rcu: Hierarchical RCU implementation.
[    0.000000]  Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GIC: GICv2 detected, but range too small and irqchip.gicv2_force_probe not set
[    0.000000] random: get_random_bytes called from start_kernel+0x340/0x484 with crng_init=0
[    0.000000] arch_timer: cp15 timer(s) running at 12.50MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x2e2049cda, max_idle_ns: 440795202628 ns
[    0.000003] sched_clock: 56 bits at 12MHz, resolution 80ns, wraps every 4398046511080ns
[    0.008492] Calibrating delay loop (skipped), value calculated using timer frequency.. 25.00 BogoMIPS (lpj=125000)
[    0.019222] pid_max: default: 32768 minimum: 301
[    0.024078] Mount-cache hash table entries: 1024 (order: 1, 8192 bytes, linear)
[    0.031656] Mountpoint-cache hash table entries: 1024 (order: 1, 8192 bytes, linear)
[    0.040653] rcu: Hierarchical SRCU implementation.
[    0.045742] dyndbg: Ignore empty _ddebug table in a CONFIG_DYNAMIC_DEBUG_CORE build
[    0.053968] smp: Bringing up secondary CPUs ...
[    0.058984] Detected VIPT I-cache on CPU1
[    0.058991] CPU features: SANITY CHECK: Unexpected variation in SYS_CNTFRQ_EL0. Boot CPU: 0x00000000bebc20, CPU1: 0x00000000000000
[    0.059006] CPU features: Unsupported CPU feature variation detected.
[    0.059037] CPU1: Booted secondary processor 0x0000000001 [0x410fd034]
[    0.059106] smp: Brought up 1 node, 2 CPUs
[    0.093091] SMP: Total of 2 processors activated.
[    0.097959] CPU features: detected: 32-bit EL0 Support
[    0.103281] CPU features: detected: CRC32 instructions
[    0.108705] CPU: All CPU(s) started at EL2
[    0.112948] alternatives: patching kernel code
[    0.120913] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.131132] futex hash table entries: 512 (order: 3, 32768 bytes, linear)
[    0.138249] pinctrl core: initialized pinctrl subsystem
[    0.144760] NET: Registered protocol family 16
[    0.149778] DMA: preallocated 128 KiB GFP_KERNEL pool for atomic allocations
[    0.157131] DMA: preallocated 128 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.165167] DMA: preallocated 128 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.173731] thermal_sys: Registered thermal governor 'fair_share'
[    0.173736] thermal_sys: Registered thermal governor 'bang_bang'
[    0.180049] thermal_sys: Registered thermal governor 'step_wise'
[    0.186299] thermal_sys: Registered thermal governor 'user_space'
[    0.192798] ASID allocator initialised with 65536 entries
[    0.205235] pstore: Registered ramoops as persistent store backend
[    0.211672] ramoops: using 0x10000@0x42ff0000, ecc: 0
[    0.248329] SCSI subsystem initialized
[    0.252521] libata version 3.00 loaded.
[    0.256647] usbcore: registered new interface driver usbfs
[    0.262447] usbcore: registered new interface driver hub
[    0.267991] usbcore: registered new device driver usb
[    0.275430] clocksource: Switched to clocksource arch_sys_counter
[    0.282406] NET: Registered protocol family 2
[    0.287075] IP idents hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.295003] tcp_listen_portaddr_hash hash table entries: 256 (order: 0, 4096 bytes, linear)
[    0.303698] TCP established hash table entries: 4096 (order: 3, 32768 bytes, linear)
[    0.311767] TCP bind hash table entries: 4096 (order: 4, 65536 bytes, linear)
[    0.319208] TCP: Hash tables configured (established 4096 bind 4096)
[    0.325876] UDP hash table entries: 256 (order: 1, 8192 bytes, linear)
[    0.332648] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes, linear)
[    0.339979] NET: Registered protocol family 1
[    0.344505] PCI: CLS 0 bytes, default 64
[    0.349704] workingset: timestamp_bits=46 max_order=17 bucket_order=0
[    0.359011] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.365058] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME) (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
[    0.408125] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)[    0.416328] mtk-tphy 1a0c4000.usb-phy: failed to get ref_clk(id-1)
[    0.428262] mt-pmic-pwrap 10001000.pwrap: unexpected interrupt int=0x1
[    0.443158] Serial: 8250/16550 driver, 16 ports, IRQ sharing enabled
[    0.451825] printk: console [ttyS0] disabled
[    0.456347] 11002000.serial: ttyS0 at MMIO 0x11002000 (irq = 22, base_baud = 1562500) is a 16550A
[    0.465573] printk: console [ttyS0] enabled
[    0.473937] printk: bootconsole [uart8250] disabled
[    0.484359] 11004000.serial: ttyS1 at MMIO 0x11004000 (irq = 23, base_baud = 1562500) is a 16550A
[    0.494094] 1100c000.serial: ttyS2 at MMIO 0x1100c000 (irq = 27, base_baud = 17499995) is a MediaTek BTIF
[    0.503818] serial serial0: tty port ttyS2 registered
[    0.509586] mtk_rng 1020f000.rng: registered RNG driver
[    0.509598] hwrng: no data available
[    0.518563] cacheinfo: Unable to detect cache hierarchy for CPU 0
[    0.527783] loop: module loaded
[    0.530929] Loading iSCSI transport class v2.0-870.
[    0.537593] mtk-snand 1100d000.snfi: chip is FM35Q1GA, size 128MB, page size 2048, oob size 64
[    0.546436] 4 fixed-partitions partitions found on MTD device 1100d000.snfi
[    0.553395] Creating 4 MTD partitions on "1100d000.snfi":
[    0.558838] 0x000000000000-0x000000080000 : "bl2"
[    0.564461] 0x000000080000-0x0000001c0000 : "fip"
[    0.570818] 0x0000001c0000-0x0000002c0000 : "factory"
[    0.577308] 0x000000300000-0x000008000000 : "ubi"
[    0.610809] random: fast init done
[    0.717891] libphy: Fixed MDIO Bus: probed
[    0.745960] libphy: mdio: probed
[    0.750484] mtk_soc_eth 1b100000.ethernet eth0: mediatek frame engine at 0xffffffc011b60000, irq 35
[    0.761116] i2c /dev entries driver
[    0.765871] mtk-wdt 10212000.watchdog: Watchdog enabled (timeout=31 sec, nowayout=0)
[    0.777321] NET: Registered protocol family 10
[    0.782574] Segment Routing with IPv6
[    0.786314] NET: Registered protocol family 17
[    0.790806] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[    0.803903] 8021q: 802.1Q VLAN Support v1.8
[    0.809256] pstore: Using crash dump compression: deflate
[    0.824575] mtk-pcie 1a143000.pcie: host bridge /pcie@1a143000 ranges:
[    0.831140] mtk-pcie 1a143000.pcie: Parsing ranges property...
[    0.836988] mtk-pcie 1a143000.pcie:      MEM 0x0020000000..0x0027ffffff -> 0x0020000000
[    0.861550] mtk-pcie 1a143000.pcie: PCI host bridge to bus 0000:00
[    0.867756] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.873235] pci_bus 0000:00: root bus resource [mem 0x20000000-0x27ffffff]
[    0.880107] pci_bus 0000:00: scanning bus
[    0.884153] pci 0000:00:00.0: [14c3:3258] type 01 class 0x060400
[    0.890183] pci 0000:00:00.0: reg 0x10: [mem 0x00000000-0x1ffffffff 64bit pref]
[    0.899119] pci_bus 0000:00: fixups for bus
[    0.903309] pci 0000:00:00.0: scanning [bus 00-00] behind bridge, pass 0
[    0.910015] pci 0000:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    0.918032] pci 0000:00:00.0: scanning [bus 00-00] behind bridge, pass 1
[    0.924861] pci_bus 0000:01: scanning bus
[    0.929093] pci 0000:01:00.0: [14c3:7915] type 00 class 0x000280
[    0.935273] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x000fffff 64bit pref]
[    0.942597] pci 0000:01:00.0: reg 0x18: [mem 0x00000000-0x00003fff 64bit pref]
[    0.949920] pci 0000:01:00.0: reg 0x20: [mem 0x00000000-0x00000fff 64bit pref]
[    0.957884] pci 0000:01:00.0: supports D1 D2
[    0.962146] pci 0000:01:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.968779] pci 0000:01:00.0: PME# disabled
[    0.973259] pci 0000:01:00.0: 2.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x1 link at 0000:00:00.0 (capable of 4.000 Gb/s with 5.0 GT/s PCIe x1 link)
[    1.016795] pci_bus 0000:01: fixups for bus
[    1.020982] pci_bus 0000:01: bus scan returning with max=01
[    1.026569] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
[    1.033180] pci_bus 0000:00: bus scan returning with max=01
[    1.038767] pci 0000:00:00.0: BAR 0: no space for [mem size 0x200000000 64bit pref]
[    1.046419] pci 0000:00:00.0: BAR 0: failed to assign [mem size 0x200000000 64bit pref]
[    1.054415] pci 0000:00:00.0: BAR 8: assigned [mem 0x20000000-0x201fffff]
[    1.061201] pci 0000:01:00.0: BAR 0: assigned [mem 0x20000000-0x200fffff 64bit pref]
[    1.069025] pci 0000:01:00.0: BAR 2: assigned [mem 0x20100000-0x20103fff 64bit pref]
[    1.076851] pci 0000:01:00.0: BAR 4: assigned [mem 0x20104000-0x20104fff 64bit pref]
[    1.084667] pci 0000:00:00.0: PCI bridge to [bus 01]
[    1.089632] pci 0000:00:00.0:   bridge window [mem 0x20000000-0x201fffff]
[    1.096516] pcieport 0000:00:00.0: of_irq_parse_pci: failed with rc=-22
[    1.103121] pcieport 0000:00:00.0: assign IRQ: got 0
[    1.108094] pcieport 0000:00:00.0: enabling device (0000 -> 0002)
[    1.114198] pcieport 0000:00:00.0: enabling bus mastering
[    1.120118] mtk-pcie 1a145000.pcie: host bridge /pcie@1a145000 ranges:
[    1.126668] mtk-pcie 1a145000.pcie: Parsing ranges property...
[    1.132501] mtk-pcie 1a145000.pcie:      MEM 0x0028000000..0x002fffffff -> 0x0028000000
[    1.240711] mtk-pcie 1a145000.pcie: Port1 link down
[    1.245728] mtk-pcie 1a145000.pcie: PCI host bridge to bus 0001:00
[    1.251906] pci_bus 0001:00: root bus resource [bus 00-ff]
[    1.257399] pci_bus 0001:00: root bus resource [mem 0x28000000-0x2fffffff]
[    1.264265] pci_bus 0001:00: scanning bus
[    1.269470] pci_bus 0001:00: fixups for bus
[    1.273647] pci_bus 0001:00: bus scan returning with max=00
[    1.279562] mtk_hsdma 1b007000.dma-controller: Using 3 as missing dma-requests property
[    1.287837] mtk_hsdma 1b007000.dma-controller: MediaTek HSDMA driver registered
[    1.332390] libphy: dsa slave smi: probed
[    1.337346] mt7530 mdio-bus:00 lan1 (uninitialized): PHY [dsa-0.0:00] driver [Generic PHY] (irq=POLL)
[    1.347999] mt7530 mdio-bus:00 lan2 (uninitialized): PHY [dsa-0.0:01] driver [Generic PHY] (irq=POLL)
[    1.358651] mt7530 mdio-bus:00 lan3 (uninitialized): PHY [dsa-0.0:02] driver [Generic PHY] (irq=POLL)
[    1.369288] mt7530 mdio-bus:00 lan4 (uninitialized): PHY [dsa-0.0:03] driver [Generic PHY] (irq=POLL)
[    1.380107] mt7530 mdio-bus:00 wan (uninitialized): PHY [dsa-0.0:04] driver [Generic PHY] (irq=POLL)
[    1.391009] mt7530 mdio-bus:00: configuring for fixed/2500base-x link mode
[    1.398145] DSA: tree 0 setup
[    1.398276] mt7530 mdio-bus:00: Link is Up - 2.5Gbps/Full - flow control rx/tx
[    1.401905] xhci-mtk 1a0c0000.usb: xHCI Host Controller
[    1.413607] xhci-mtk 1a0c0000.usb: new USB bus registered, assigned bus number 1[    1.422707] xhci-mtk 1a0c0000.usb: hcc params 0x01403198 hci version 0x96 quirks 0x0000000000210010
[    1.431801] xhci-mtk 1a0c0000.usb: irq 31, io mem 0x1a0c0000
[    1.437938] hub 1-0:1.0: USB hub found
[    1.441710] hub 1-0:1.0: 2 ports detected
[    1.446016] xhci-mtk 1a0c0000.usb: xHCI Host Controller
[    1.451247] xhci-mtk 1a0c0000.usb: new USB bus registered, assigned bus number 2[    1.458659] xhci-mtk 1a0c0000.usb: Host supports USB 3.0 SuperSpeed
[    1.464969] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    1.473376] hub 2-0:1.0: USB hub found
[    1.477167] hub 2-0:1.0: 1 port detected
[    1.482167] UBI: auto-attach mtd3
[    1.485522] ubi0: attaching mtd3
[    1.872109] ubi0: scanning is finished
[    1.880063] ubi0: attached mtd3 (name "ubi", size 125 MiB)
[    1.885579] ubi0: PEB size: 131072 bytes (128 KiB), LEB size: 126976 bytes
[    1.892448] ubi0: min./max. I/O unit sizes: 2048/2048, sub-page size 2048
[    1.899232] ubi0: VID header offset: 2048 (aligned 2048), data offset: 4096
[    1.906188] ubi0: good PEBs: 1000, bad PEBs: 0, corrupted PEBs: 0
[    1.912271] ubi0: user volume: 6, internal volumes: 1, max. volumes count: 128
[    1.919487] ubi0: max/mean erase counter: 4/2, WL threshold: 4096, image sequence number: 2093620861
[    1.928612] ubi0: available PEBs: 0, total reserved PEBs: 1000, PEBs reserved for bad PEB handling: 20
[    1.937925] ubi0: background thread "ubi_bgt0d" started, PID 797
[    1.938955] FIT: Default configuration: "config-1" (OpenWrt linksys_e8450-ubi)
[    1.951171] FIT:           kernel sub-image 0x00001000..0x0050df5e "kernel-1" (ARM64 OpenWrt Linux-5.10.79)
[    1.961008] FIT:          flat_dt sub-image 0x0050e000..0x00515328 "fdt-1" (ARM64 OpenWrt linksys_e8450-ubi device tree blob)
[    1.972403] FIT:       filesystem sub-image 0x00516000..0x00acefff "rootfs-1" (ARM64 OpenWrt linksys_e8450-ubi rootfs)
[    1.983181] FIT: selecting configured loadable "rootfs-1" to be root filesystem
[    1.990486]  ubiblock0_4: p1(rootfs-1)
[    1.990782] block ubiblock0_4: created from ubi0:4(fit)
[    2.003681] VFS: Mounted root (squashfs filesystem) readonly on device 259:1.
[    2.011025] Freeing unused kernel memory: 448K
[    2.055479] Run /sbin/init as init process
[    2.059568]   with arguments:
[    2.062525]     /sbin/init
[    2.065221]   with environment:
[    2.068365]     HOME=/
[    2.070715]     TERM=linux
[    2.248158] init: Console is alive
[    2.251711] init: - watchdog -
[    2.558852] kmodloader: loading kernel modules from /etc/modules-boot.d/*
[    2.580824] usbcore: registered new interface driver usb-storage
[    2.587800] usbcore: registered new interface driver uas
[    2.593330] kmodloader: done loading kernel modules from /etc/modules-boot.d/*
[    2.608029] init: - preinit -
[    2.869898] mtk_soc_eth 1b100000.ethernet eth0: configuring for fixed/2500base-x link mode
[    2.878276] mtk_soc_eth 1b100000.ethernet eth0: Link is Up - 2.5Gbps/Full - flow control rx/tx
[    2.893844] mt7530 mdio-bus:00 lan1: configuring for phy/gmii link mode
[    2.901148] 8021q: adding VLAN 0 to HW filter on device lan1
[    2.914693] random: procd: uninitialized urandom read (4 bytes read)
[    6.977512] mount_root: loading kmods from internal overlay
[    6.989786] kmodloader: loading kernel modules from //etc/modules-boot.d/*
[    6.997554] kmodloader: done loading kernel modules from //etc/modules-boot.d/*
[    7.164425] UBIFS (ubi0:5): Mounting in unauthenticated mode
[    7.170244] UBIFS (ubi0:5): background thread "ubifs_bgt0_5" started, PID 889
[    7.193607] UBIFS (ubi0:5): recovery needed
[    7.243356] UBIFS (ubi0:5): recovery completed
[    7.247898] UBIFS (ubi0:5): UBIFS: mounted UBI device 0, volume 5, name "rootfs_data"
[    7.255732] UBIFS (ubi0:5): LEB size: 126976 bytes (124 KiB), min./max. I/O unit sizes: 2048 bytes/2048 bytes
[    7.265648] UBIFS (ubi0:5): FS size: 91168768 bytes (86 MiB, 718 LEBs), journal size 4571136 bytes (4 MiB, 36 LEBs)
[    7.276078] UBIFS (ubi0:5): reserved for root: 4306125 bytes (4205 KiB)
[    7.282685] UBIFS (ubi0:5): media format: w5/r0 (latest is w5/r0), UUID D1EC4C7A-F87C-414E-BE66-E55D618D6712, small LPT model
[    7.294864] block: attempting to load /tmp/ubifs_cfg/upper/etc/config/fstab
[    7.304555] block: extroot: not configured
[    7.308816] UBIFS (ubi0:5): un-mount UBI device 0
[    7.313526] UBIFS (ubi0:5): background thread "ubifs_bgt0_5" stops
[    7.322223] UBIFS (ubi0:5): Mounting in unauthenticated mode
[    7.328005] UBIFS (ubi0:5): background thread "ubifs_bgt0_5" started, PID 892
[    7.365810] UBIFS (ubi0:5): UBIFS: mounted UBI device 0, volume 5, name "rootfs_data"
[    7.373642] UBIFS (ubi0:5): LEB size: 126976 bytes (124 KiB), min./max. I/O unit sizes: 2048 bytes/2048 bytes
[    7.383570] UBIFS (ubi0:5): FS size: 91168768 bytes (86 MiB, 718 LEBs), journal size 4571136 bytes (4 MiB, 36 LEBs)
[    7.394000] UBIFS (ubi0:5): reserved for root: 4306125 bytes (4205 KiB)
[    7.400612] UBIFS (ubi0:5): media format: w5/r0 (latest is w5/r0), UUID D1EC4C7A-F87C-414E-BE66-E55D618D6712, small LPT model
[    7.524525] block: attempting to load /tmp/ubifs_cfg/upper/etc/config/fstab
[    7.533867] block: extroot: not configured
[    7.539342] mount_root: switching to ubifs overlay
[    7.547138] overlayfs: "xino" feature enabled using 2 upper inode bits.
[    7.556470] urandom-seed: Seeding with /etc/urandom.seed
[    7.606543] procd: - early -
[    7.609504] procd: - watchdog -
[    8.153919] procd: - watchdog -
[    8.158247] procd: - ubus -
[    8.186817] random: ubusd: uninitialized urandom read (4 bytes read)
[    8.211092] random: ubusd: uninitialized urandom read (4 bytes read)
[    8.217676] random: ubusd: uninitialized urandom read (4 bytes read)
[    8.225290] procd: - init -
[    8.512341] urngd: v1.0.2 started.
[    8.544364] random: crng init done
[    8.547823] random: 6 urandom warning(s) missed due to ratelimiting
[    8.570420] kmodloader: loading kernel modules from /etc/modules.d/*
[    8.615137] Loading modules backported from Linux version v5.15-rc6-0-g519d81956ee2
[    8.622838] Backport generated by backports.git v5.15-rc6-1-0-gd44432d6
[    8.653806] xt_time: kernel timezone is -0000
[    8.717736] ieee80211 phy0: Selected rate control algorithm 'minstrel_ht'
[    8.730898] mt7915e 0000:01:00.0: assign IRQ: got 143
[    8.736078] pci 0000:00:00.0: enabling bus mastering
[    8.741069] mt7915e 0000:01:00.0: enabling device (0000 -> 0002)
[    8.747187] mt7915e 0000:01:00.0: enabling bus mastering
[    8.781893] mt7622-wmac 18000000.wmac: HW/SW Version: 0x8a108a10, Build Time: 20190801210006a
[    8.781893]
[    8.812319] mt7915e 0000:01:00.0: HW/SW Version: 0x8a108a10, Build Time: 20201105222230a
[    8.812319]
[    8.875121] mt7622-wmac 18000000.wmac: N9 Firmware Version: 2.0, Build Time: 20200131180931
[    8.946401] mt7915e 0000:01:00.0: WM Firmware Version: ____000000, Build Time: 20201105222304
[    8.970744] mt7915e 0000:01:00.0: WA Firmware Version: DEV_000000, Build Time: 20201105222323
[    9.094344] PPP generic driver version 2.4.2
[    9.099742] NET: Registered protocol family 24
[    9.111748] kmodloader: done loading kernel modules from /etc/modules.d/*
[   11.830067] mtk_soc_eth 1b100000.ethernet eth0: Link is Down
[   11.842116] mtk_soc_eth 1b100000.ethernet eth0: configuring for fixed/2500base-x link mode
[   11.850746] mtk_soc_eth 1b100000.ethernet eth0: Link is Up - 2.5Gbps/Full - flow control rx/tx
[   11.856047] mt7530 mdio-bus:00 lan1: configuring for phy/gmii link mode
[   11.872975] 8021q: adding VLAN 0 to HW filter on device lan1
[   11.886175] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   11.892720] br-lan: port 1(lan1) entered blocking state
[   11.898033] br-lan: port 1(lan1) entered disabled state
[   11.908032] device lan1 entered promiscuous mode
[   11.912661] device eth0 entered promiscuous mode
[   11.928508] mt7530 mdio-bus:00 lan2: configuring for phy/gmii link mode
[   11.936166] 8021q: adding VLAN 0 to HW filter on device lan2
[   11.949126] br-lan: port 2(lan2) entered blocking state
[   11.954358] br-lan: port 2(lan2) entered disabled state
[   11.967273] device lan2 entered promiscuous mode
[   11.979843] mt7530 mdio-bus:00 lan3: configuring for phy/gmii link mode
[   11.989048] 8021q: adding VLAN 0 to HW filter on device lan3
[   11.999354] br-lan: port 3(lan3) entered blocking state
[   12.004591] br-lan: port 3(lan3) entered disabled state
[   12.011600] device lan3 entered promiscuous mode
[   12.022597] mt7530 mdio-bus:00 lan4: configuring for phy/gmii link mode
[   12.030416] 8021q: adding VLAN 0 to HW filter on device lan4
[   12.043146] br-lan: port 4(lan4) entered blocking state
[   12.048458] br-lan: port 4(lan4) entered disabled state
[   12.054673] device lan4 entered promiscuous mode
[   12.066398] mt7530 mdio-bus:00 wan: configuring for phy/gmii link mode
[   12.073583] 8021q: adding VLAN 0 to HW filter on device wan
[   14.748638] br-lan: port 5(wlan1-1) entered blocking state
[   14.754167] br-lan: port 5(wlan1-1) entered disabled state
[   14.759882] device wlan1-1 entered promiscuous mode
[   15.027441] IPv6: ADDRCONF(NETDEV_CHANGE): wlan1-1: link becomes ready
[   15.034139] br-lan: port 5(wlan1-1) entered blocking state
[   15.039716] br-lan: port 5(wlan1-1) entered forwarding state
[   15.045660] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
[   15.144559] br-lan: port 6(wlan0) entered blocking state
[   15.149938] br-lan: port 6(wlan0) entered disabled state
[   15.155543] device wlan0 entered promiscuous mode
[   15.160393] br-lan: port 6(wlan0) entered blocking state
[   15.165753] br-lan: port 6(wlan0) entered forwarding state
[   15.193262] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
[   16.513625] br-lan: port 7(wlan1) entered blocking state
[   16.518965] br-lan: port 7(wlan1) entered disabled state
[   16.524466] device wlan1 entered promiscuous mode
[   17.245519] br-lan: port 5(wlan1-1) entered disabled state
[   19.912652] IPv6: ADDRCONF(NETDEV_CHANGE): wlan1: link becomes ready
[   19.919165] br-lan: port 7(wlan1) entered blocking state
[   19.924476] br-lan: port 7(wlan1) entered forwarding state
[   20.036977] br-lan: port 5(wlan1-1) entered blocking state
[   20.042469] br-lan: port 5(wlan1-1) entered forwarding state
[   20.132656] ------------[ cut here ]------------
[   20.137290] WARNING: CPU: 0 PID: 1154 at __skb_flow_dissect+0x1a0/0x13dc
[   20.143980] Modules linked in: pppoe ppp_async iptable_nat xt_state xt_nat xt_conntrack xt_REDIRECT xt_MASQUERADE xt_FLOWOFFLOAD xt_CT pppox ppp_generic nf_nat nf_flow_table nf_conntrack mt7915e mt7615e mt7615_common mt76_connac_lib mt76 mac80211 ipt_REJECT cfg80211 xt_time xt_tcpudp xt_multiport xt_mark xt_mac xt_limit xt_comment xt_TCPMSS xt_LOG slhc nf_reject_ipv4 nf_log_ipv4 nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_filter ip_tables hwmon crc_ccitt compat nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 vfat fat autofs4 nls_utf8 nls_iso8859_1 nls_cp437 seqiv uas usb_storage leds_gpio xhci_plat_hcd gpio_button_hotplug exfat
[   20.205400] CPU: 0 PID: 1154 Comm: napi/phy1-7 Tainted: G S                5.10.79 #0
[   20.213219] Hardware name: Linksys E8450 (UBI) (DT)
[   20.218089] pstate: 00000005 (nzcv daif -PAN -UAO -TCO BTYPE=--)
[   20.224086] pc : __skb_flow_dissect+0x1a0/0x13dc
[   20.228695] lr : __skb_get_hash+0x6c/0x130
[   20.232780] sp : ffffffc010e8b9a0
[   20.236085] x29: ffffffc010e8b9a0 x28: 0000000000000000
[   20.241389] x27: 0000000000000000 x26: 0000000000000008
[   20.246693] x25: 0000000000000000 x24: ffffff80019d3418
[   20.251997] x23: 000000000000004a x22: ffffffc010e8bb10
[   20.257302] x21: 000000000000ffba x20: ffffffc010a99580
[   20.262605] x19: ffffff800286a200 x18: 0000000000290000
[   20.267909] x17: 0000000000d20000 x16: 000000000000037e
[   20.273213] x15: 0000000000000001 x14: 0000000000000070
[   20.278517] x13: 0000000000000080 x12: ffffffc010878040
[   20.283821] x11: 0000000000000001 x10: 0000000000000001
[   20.289124] x9 : ffffffc010e8b5f8 x8 : ffffff8000863700
[   20.294428] x7 : 0000000000000000 x6 : 0000000000000000
[   20.299731] x5 : 0000000000000000 x4 : 0000000000000000
[   20.305034] x3 : ffffffc010e8bb10 x2 : 0000000000000000
[   20.310339] x1 : 0000000000000000 x0 : 0000000000000000
[   20.315642] Call trace:
[   20.318083]  __skb_flow_dissect+0x1a0/0x13dc
[   20.322345]  __skb_get_hash+0x6c/0x130
[   20.326110]  ieee80211_schedule_txq+0x784/0x9dc [mac80211]
[   20.331597]  ieee80211_schedule_txq+0x974/0x9dc [mac80211]
[   20.337083]  ieee80211_tx_pending+0xe0/0x24c [mac80211]
[   20.342301]  tasklet_action_common.constprop.0+0x134/0x17c
[   20.347777]  tasklet_action+0x24/0x30
[   20.351430]  _stext+0x124/0x28c
[   20.354563]  do_softirq+0x74/0x80
[   20.357869]  __local_bh_enable_ip+0x88/0x90
[   20.362045]  napi_threaded_poll+0x94/0xf0
[   20.366048]  kthread+0x120/0x124
[   20.369267]  ret_from_fork+0x10/0x18
[   20.372833] ---[ end trace d98c09f8ca4ebf83 ]---
root@OpenWrt:~#
lynxthecat commented 2 years ago

It seems that one of the extension nodes (i.e. nodes which connect to my main router acting as gateway) becomes inaccessible following a period of inactivity. Could this therefore be some kind of power saving or something?

I checked and whilst a node is inaccessible its AP SSID and mesh hidden SSID still show up on a WiFi analyzer.

The 'tx bytes' from a good node relating to the first inaccessible node shows very slow increase - does this help?

root@OpenWrt:~# iw dev wlan1 station dump |grep -i bytes
        rx bytes:       24222245
        tx bytes:       147301
        rx bytes:       626904121
        tx bytes:       372754833
root@OpenWrt:~# iw dev wlan1 station dump |grep -i bytes
        rx bytes:       24224452
        tx bytes:       147301
        rx bytes:       626906328
        tx bytes:       372754833
root@OpenWrt:~# iw dev wlan1 station dump |grep -i bytes
        rx bytes:       24225989
        tx bytes:       147301
        rx bytes:       626908137
        tx bytes:       372754919
root@OpenWrt:~# iw dev wlan1 station dump |grep -i bytes
        rx bytes:       24372908
        tx bytes:       147479
        rx bytes:       627143495
        tx bytes:       372823476
root@OpenWrt:~# iw dev wlan1 station dump |grep -i bytes
        rx bytes:       24379516
        tx bytes:       147538
        rx bytes:       627150666
        tx bytes:       372823844
d3adme4t commented 2 years ago

Hello, Looks like the related patch was published for the mainline kernel.

Pls see: https://patchwork.kernel.org/project/linux-mediatek/patch/20211123033123.2684-1-xing.song@mediatek.com/

lynxthecat commented 2 years ago

The patch addresses the crash trace? That was always there, even when the mesh functionality worked well. But what is new is that nodes on the mesh become inaccessible. I presume that is not something that has been addressed by the patch? Or perhaps it might address both?

nbd168 commented 2 years ago

There was another patch that should improve mesh mode stability (allowing auth frames in blocked state). Please test the latest version