openwrt / openwrt

This repository is a mirror of https://git.openwrt.org/openwrt/openwrt.git It is for reference only and is not active for check-ins. We will continue to accept Pull Requests here. They will be merged via staging trees then into openwrt.git.
Other
20.25k stars 10.48k forks source link

ramips/mt7621: kernel panic under networking load #9561

Open Vladdrako opened 2 years ago

Vladdrako commented 2 years ago

Device: Xiaomi Mi Router 3 Pro While huge networking load I get kernel panic. Possibly after commit https://github.com/openwrt/openwrt/commit/fdbb468c5998d9adb1819751ffaf38013768a8eb

<4>[ 6377.998611] CPU: 0 PID: 700 Comm: napi/mtk_eth-6 Tainted: G           O      5.10.108 #0
<4>[ 6378.006669] $ 0   : 00000000 00000001 0000005c 0000006a
<4>[ 6378.011905] $ 4   : 0067a000 00000a20 80673dc8 00000000
<4>[ 6378.017131] $ 8   : 00000100 00000040 00000039 ffffffff
<4>[ 6378.022361] $12   : 00000681 80b18f2c 80b18f3c 80b18ebc
<4>[ 6378.027593] $16   : 81412a00 00000a20 80a7b464 00000000
<4>[ 6378.032821] $20   : 80673dc8 80a80000 00000001 003fddc0
<4>[ 6378.038050] $24   : 00002039 00000000                  
<4>[ 6378.043277] $28   : 82344000 82345d40 c5ee0000 80673dc8
<4>[ 6378.048507] Hi    : 00000000
<4>[ 6378.051375] Lo    : 00000041
<4>[ 6378.054248] epc   : 801a7f8c 0x801a7f8c
<4>[ 6378.058074] ra    : 80673dc8 0x80673dc8
<4>[ 6378.061893] Status: 11008403  KERNEL EXL IE 
<4>[ 6378.066077] Cause : 40800010 (ExcCode 04)
<4>[ 6378.070072] BadVA : 0000006a
<4>[ 6378.072942] PrId  : 0001992f (MIPS 1004Kc)
<4>[ 6378.077019] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
<4>[ 6378.077529]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake ntfs3(O) nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect
<4>[ 6378.164923]  ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsd bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
<4>[ 6378.252380]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
<4>[ 6378.390058] Process napi/mtk_eth-6 (pid: 700, threadinfo=9f22e92d, task=04795bee, tls=00000000)
<4>[ 6378.398728] Stack : 83634900 0000f800 00000001 816ee750 80c60000 80c60000 0000000e 0000081e
<4>[ 6378.407093]         a35a8d00 844fda80 844fda80 00000960 86ce2be0 844fda80 00003b4c 0000000a
<4>[ 6378.415455]         816ee080 80673dc8 83634900 000005ee 00003b4c 00000009 844fda80 00000960
<4>[ 6378.423818]         a35a8d00 80673e38 816ee7d4 00000001 06ce2be0 816ee5ec 000000d0 816ee5ec
<4>[ 6378.432182]         000000d0 805bd91c 00000000 00000001 40000000 ff7cc630 00000000 00000000
<4>[ 6378.440544]         ...
<4>[ 6378.442989] Call Trace:
<4>[ 6378.443288] [<80673dc8>] 0x80673dc8
<4>[ 6378.449260] [<80673e38>] 0x80673e38
<4>[ 6378.452813] [<805bd91c>] 0x805bd91c
<4>[ 6378.456291] [<80697488>] 0x80697488
<4>[ 6378.459907] [<805bfc84>] 0x805bfc84
<4>[ 6378.463410] [<80697230>] 0x80697230
<4>[ 6378.466984] [<80697078>] 0x80697078
<4>[ 6378.470495] [<8003a328>] 0x8003a328
<4>[ 6378.473998] [<80697230>] 0x80697230
<4>[ 6378.477480] [<8069724c>] 0x8069724c
<4>[ 6378.480989] [<80056420>] 0x80056420
<4>[ 6378.484490] [<808d5588>] 0x808d5588
<4>[ 6378.487980] [<80697198>] 0x80697198
<4>[ 6378.491546] [<80697198>] 0x80697198
<4>[ 6378.495021] [<80056998>] 0x80056998
<4>[ 6378.498504] [<80056820>] 0x80056820
<4>[ 6378.502018] [<80063e0c>] 0x80063e0c
<4>[ 6378.505498] [<80056820>] 0x80056820
<4>[ 6378.509079] [<80056820>] 0x80056820
<4>[ 6378.512563] [<8000376c>] 0x8000376c
<4>[ 6378.516055] 
<4>[ 6378.517542] Code: 02803025  8e02001c  00621821 <8c660000> 41656000  30a50001  000000c0  8f84000c  8e020000 
<4>[ 6378.527308] 
<4>[ 6378.528891] ---[ end trace 74c9bb18e30ca9e6 ]---
<4>[ 6378.571925] ------------[ cut here ]------------
<4>[ 6378.576569] WARNING: CPU: 2 PID: 18888 at lib/refcount.c:28 0x80674bf4
<4>[ 6378.583117] refcount_t: underflow; use-after-free.
<4>[ 6378.587994] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
<4>[ 6378.588516]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake ntfs3(O) nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect
<4>[ 6378.676072]  ebt_pkttype
<0>[ 6378.676146] Kernel panic - not syncing: Fatal exception in interrupt

After reverting commit fdbb468 I have another issue

<4>[ 1084.209431] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G           O      5.10.108 #0
<4>[ 1084.216876] $ 0   : 00000000 00000001 0000005c 0000006a
<4>[ 1084.222092] $ 4   : 0067a000 00000a20 80673d90 00000000
<4>[ 1084.227302] $ 8   : 00000100 00000040 00000039 ffffffff
<4>[ 1084.232519] $12   : 0000011c 80b18f2c 80b18f3c 80b18ebc
<4>[ 1084.237733] $16   : 81412a00 00000a20 80a7b464 00000000
<4>[ 1084.242947] $20   : 80673d90 80a80000 00000001 0270be54
<4>[ 1084.248159] $24   : 000020b9 00000000                  
<4>[ 1084.253373] $28   : 80a68000 8140bd80 c5ee0000 80673d90
<4>[ 1084.258586] Hi    : 00000000
<4>[ 1084.261463] Lo    : 00000041
<4>[ 1084.264336] epc   : 801a7f8c 0x801a7f8c
<4>[ 1084.268149] ra    : 80673d90 0x80673d90
<4>[ 1084.271965] Status: 11008403  KERNEL EXL IE 
<4>[ 1084.276139] Cause : 40800010 (ExcCode 04)
<4>[ 1084.280128] BadVA : 0000006a
<4>[ 1084.282993] PrId  : 0001992f (MIPS 1004Kc)
<4>[ 1084.287064] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
<4>[ 1084.287378]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake ntfs3(O) nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect
<4>[ 1084.374597]  ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsd bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
<4>[ 1084.461854]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
<4>[ 1084.599392] Process swapper/0 (pid: 0, threadinfo=3374cc3f, task=94a660db, tls=00000000)
<4>[ 1084.607449] Stack : 86c84180 0000f800 00000001 817e9750 80c60000 80c60000 0000000e 0000081e
<4>[ 1084.615793]         a97b3790 89103e60 89103e60 00000960 84648fc0 89103e60 00005304 0000000e
<4>[ 1084.624135]         817e9080 80673d90 86c84180 000005ee 00005304 0000000d 89103e60 00000960
<4>[ 1084.632478]         a97b3790 80673e00 00000000 ff7cc6b4 04648fc0 817e95ec 00000179 817e95ec
<4>[ 1084.640820]         00000179 805bd8e4 80a80000 80a6c040 80b4e2b8 80696598 00000000 00000000
<4>[ 1084.649156]         ...
<4>[ 1084.651596] Call Trace:
<4>[ 1084.651815] [<80673d90>] 0x80673d90
<4>[ 1084.657752] [<80673e00>] 0x80673e00
<4>[ 1084.661228] [<805bd8e4>] 0x805bd8e4
<4>[ 1084.664698] [<80696598>] 0x80696598
<4>[ 1084.668166] [<807bd720>] 0x807bd720
<4>[ 1084.671724] [<805bfc4c>] 0x805bfc4c
<4>[ 1084.675199] [<806e70e8>] 0x806e70e8
<4>[ 1084.678668] [<80697040>] 0x80697040
<4>[ 1084.682149] [<8069736c>] 0x8069736c
<4>[ 1084.685630] [<80092e04>] 0x80092e04
<4>[ 1084.689104] [<808d9fa4>] 0x808d9fa4
<4>[ 1084.692580] [<804133b8>] 0x804133b8
<4>[ 1084.696056] [<8003a4b8>] 0x8003a4b8
<4>[ 1084.699530] [<80412c2c>] 0x80412c2c
<4>[ 1084.703002] [<80003c68>] 0x80003c68
<4>[ 1084.706469] 
<4>[ 1084.707948] Code: 02803025  8e02001c  00621821 <8c660000> 41656000  30a50001  000000c0  8f84000c  8e020000 
<4>[ 1084.717696] 
<4>[ 1084.719314] ---[ end trace f6917992ee262c12 ]---
<0>[ 1084.877925] Kernel panic - not syncing: Fatal exception in interrupt
<4>[ 1084.884287] ------------[ cut here ]------------
<4>[ 1084.888888] WARNING: CPU: 0 PID: 0 at kernel/smp.c:633 0x800caf14
<4>[ 1084.894953] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
<4>[ 1084.895273]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake ntfs3(O) nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect
<4>[ 1084.982511]  ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsd bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
<4>[ 1085.069812]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
<4>[ 1085.207365] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G      D    O      5.10.108 #0
<4>[ 1085.214822] Stack : 00000000 00000000 80c80000 00000000 00000000 00000000 00000000 00000000
<4>[ 1085.223169]         00000000 00000000 00000000 00000000 00000000 00000001 8140ba50 80ae956c
<4>[ 1085.231513]         8140bae8 00000000 00000000 8140b910 00000038 804111e4 ffffffea 00000000
<4>[ 1085.239854]         8140b900 0000083f 80a85560 ffffffff 8140ba30 808f36d4 00000000 808f0000
<4>[ 1085.248191]         00000009 80a80000 00000001 00000000 00000000 804ac6e8 000fd757 000fd797
<4>[ 1085.256529]         ...
<4>[ 1085.258968] Call Trace:
<4>[ 1085.258985] [<804111e4>] 0x804111e4
<4>[ 1085.264888] [<804ac6e8>] 0x804ac6e8
<4>[ 1085.268357] [<8000a284>] 0x8000a284
<4>[ 1085.271835] [<8000a28c>] 0x8000a28c
<4>[ 1085.275305] [<803f5314>] 0x803f5314
<4>[ 1085.278773] [<800caf14>] 0x800caf14
<4>[ 1085.282246] [<80087560>] 0x80087560
<4>[ 1085.285717] [<8008b154>] 0x8008b154
<4>[ 1085.289186] [<800caf14>] 0x800caf14
<4>[ 1085.292663] [<800356ac>] 0x800356ac
<4>[ 1085.296136] [<800caf14>] 0x800caf14
<4>[ 1085.299611] [<80035774>] 0x80035774
<4>[ 1085.303084] [<800caf14>] 0x800caf14
<4>[ 1085.306553] [<80015630>] 0x80015630
<4>[ 1085.310040] [<80673d90>] 0x80673d90
<4>[ 1085.313516] [<800caf80>] 0x800caf80
<4>[ 1085.316985] [<80035104>] 0x80035104
<4>[ 1085.320462] [<80673d90>] 0x80673d90
<4>[ 1085.323932] [<8000a570>] 0x8000a570
<4>[ 1085.327401] [<801a7f8c>] 0x801a7f8c
<4>[ 1085.330877] [<8000cca8>] 0x8000cca8
<4>[ 1085.334347] [<80895554>] 0x80895554
<4>[ 1085.337944] [<8041310c>] 0x8041310c
<4>[ 1085.341421] [<80673d90>] 0x80673d90
<4>[ 1085.344891] [<8000d24c>] 0x8000d24c
<4>[ 1085.348359] [<80413474>] 0x80413474
<4>[ 1085.351835] [<800040f4>] 0x800040f4
<4>[ 1085.355305] [<80695acc>] 0x80695acc
<4>[ 1085.358773] [<8018eed8>] 0x8018eed8
<4>[ 1085.362280] [<80673d90>] 0x80673d90
<4>[ 1085.365753] [<80673d90>] 0x80673d90
<4>[ 1085.369221] [<80673d90>] 0x80673d90
<4>[ 1085.372696] [<80673d90>] 0x80673d90
<4>[ 1085.376166] [<801a7f8c>] 0x801a7f8c
<4>[ 1085.379758] [<80673d90>] 0x80673d90
<4>[ 1085.383270] [<80673e00>] 0x80673e00
<4>[ 1085.386741] [<805bd8e4>] 0x805bd8e4
<4>[ 1085.390220] [<80696598>] 0x80696598
<4>[ 1085.393691] [<807bd720>] 0x807bd720
<4>[ 1085.397210] [<805bfc4c>] 0x805bfc4c
<4>[ 1085.400686] [<806e70e8>] 0x806e70e8
<4>[ 1085.404159] [<80697040>] 0x80697040
<4>[ 1085.407629] [<8069736c>] 0x8069736c
<4>[ 1085.411106] [<80092e04>] 0x80092e04
<4>[ 1085.414580] [<808d9fa4>] 0x808d9fa4
<4>[ 1085.418048] [<804133b8>] 0x804133b8
<4>[ 1085.421525] [<8003a4b8>] 0x8003a4b8
<4>[ 1085.425011] [<80412c2c>] 0x80412c2c
<4>[ 1085.428501] [<80003c68>] 0x80003c68
<4>[ 1085.431977] 
<4>[ 1085.433461] ---[ end trace f6917992ee262c13 ]---

My build is custom a bit. I applied e53bc43de4a83a205aaccb5d1954860085c6b55b b0734bd0f3794332b01a077e9bf38c1d792abc88 and https://git.openwrt.org/?p=openwrt/staging/nbd.git;a=commit;h=df9f06e8182d10e2786de2b83de99034eea92258 for testing purposes.

nbd168 commented 2 years ago

Please build with KALLSYMS enabled and show me traces that contain proper function names

Vladdrako commented 2 years ago

Please build with KALLSYMS enabled and show me traces that contain proper function names

With KALLSYMS. Logs collected by pstore.

<1>[33425.731740] CPU 2 Unable to handle kernel paging request at virtual address 0400064c, epc == 8072b128, ra == 807234ac
<4>[33425.742402] Oops[#1]:
<4>[33425.744672] CPU: 2 PID: 24661 Comm: kworker/2:2 Tainted: G           O      5.10.108 #0
<4>[33425.752647] Workqueue: events_power_efficient 0x80723988
<4>[33425.757938] $ 0   : 00000000 00000001 040005fc 8358a080
<4>[33425.763151] $ 4   : 8a368700 00000000 80b10860 00000000
<4>[33425.768363] $ 8   : 00000001 80b18e20 80b18e20 0011fc26
<4>[33425.773575] $12   : 00000000 00000400 00000000 00000000
<4>[33425.778787] $16   : 8a946680 8a368700 80a80000 80a80000
<4>[33425.783999] $20   : fffffff0 80b10860 8a368700 000016ef
<4>[33425.789213] $24   : 00000002 ff970c00                  
<4>[33425.794425] $28   : 84acc000 84acdd80 0041eb00 807234ac
<4>[33425.799637] Hi    : 000015e4
<4>[33425.802499] Lo    : 8d65c000
<4>[33425.805362] epc   : 8072b128 0x8072b128
<4>[33425.809178] ra    : 807234ac 0x807234ac
<4>[33425.812992] Status: 1100fc03  KERNEL EXL IE 
<4>[33425.817164] Cause : 40800008 (ExcCode 02)
<4>[33425.821156] BadVA : 0400064c
<4>[33425.824022] PrId  : 0001992f (MIPS 1004Kc)
<4>[33425.828092] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
<4>[33425.828409]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake ntfs3(O) nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect
<4>[33425.915641]  ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsd bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
<4>[33426.002987]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
<4>[33426.140522] Process kworker/2:2 (pid: 24661, threadinfo=e3a0f1ad, task=010bad09, tls=00000000)
<4>[33426.149096] Stack : 80e144d8 80722ed4 80a7b464 00000001 0000a2a2 8a368700 8a368740 807234ac
<4>[33426.157433]         8a1060e0 8a1060f0 00000001 80722ed4 00000001 80722ec4 8a368700 8a368740
<4>[33426.165770]         80a80000 80a80000 fffffff0 00000000 00002000 000016ef 0041eb00 80723774
<4>[33426.174108]         8a1060e0 8072365c 811ecba0 811ecb60 8a368700 80723914 8a1060f0 8071db50
<4>[33426.182447]         1100fc03 00000377 00000001 811ecb60 8a368700 80723c58 8358a0e0 811ecba0
<4>[33426.190785]         ...
<4>[33426.193222] Call Trace:
<4>[33426.193234] [<80722ed4>] 0x80722ed4
<4>[33426.199269] [<807234ac>] 0x807234ac
<4>[33426.202781] [<80722ed4>] 0x80722ed4
<4>[33426.206249] [<80722ec4>] 0x80722ec4
<4>[33426.209764] [<80723774>] 0x80723774
<4>[33426.213254] [<8072365c>] 0x8072365c
<4>[33426.216745] [<80723914>] 0x80723914
<4>[33426.220279] [<8071db50>] 0x8071db50
<4>[33426.223773] [<80723c58>] 0x80723c58
<4>[33426.227280] [<80072160>] 0x80072160
<4>[33426.230777] [<8004f6a8>] 0x8004f6a8
<4>[33426.234325] [<8004fa84>] 0x8004fa84
<4>[33426.237814] [<8004f904>] 0x8004f904
<4>[33426.241348] [<8004f904>] 0x8004f904
<4>[33426.244839] [<80056998>] 0x80056998
<4>[33426.248308] [<80056820>] 0x80056820
<4>[33426.251802] [<80063e0c>] 0x80063e0c
<4>[33426.255271] [<80056820>] 0x80056820
<4>[33426.258761] [<80056820>] 0x80056820
<4>[33426.262233] [<8000376c>] 0x8000376c
<4>[33426.265711] 
<4>[33426.267191] Code: 8e020000  10400007  8fbf001c <8c420050> 10400004  00000000  0040f809  02202025  8fbf001c 
<4>[33426.276920] 
<4>[33426.279037] ---[ end trace 781f86db5cf39004 ]---
<6>[40178.305921] mt7530 mdio-bus:1f lan1: Link is Up - 100Mbps/Full - flow control off
<6>[40178.313448] br-lan: port 1(lan1) entered blocking state
<6>[40178.318679] br-lan: port 1(lan1) entered forwarding state
<6>[40181.103009] mt7530 mdio-bus:1f lan1: Link is Down
<6>[40181.107901] br-lan: port 1(lan1) entered disabled state
<6>[40183.420908] mt7530 mdio-bus:1f lan1: Link is Up - 100Mbps/Full - flow control off
<6>[40183.428470] br-lan: port 1(lan1) entered blocking state
<6>[40183.433683] br-lan: port 1(lan1) entered forwarding state
<6>[40196.942338] mt7530 mdio-bus:1f lan1: Link is Down
<6>[40196.947335] br-lan: port 1(lan1) entered disabled state
<6>[40206.775677] mt7530 mdio-bus:1f lan1: Link is Up - 1Gbps/Full - flow control rx/tx
<6>[40206.783202] br-lan: port 1(lan1) entered blocking state
<6>[40206.788444] br-lan: port 1(lan1) entered forwarding state
<1>[40682.935601] CPU 1 Unable to handle kernel paging request at virtual address 00000070, epc == 801a7f8c, ra == 80673dc8
<4>[40682.946253] Oops[#2]:
<4>[40682.948526] CPU: 1 PID: 699 Comm: napi/mtk_eth-6 Tainted: G      D    O      5.10.108 #0
<4>[40682.956574] $ 0   : 00000000 00000001 0000005c 00000070
<4>[40682.961790] $ 4   : 00689000 00000a20 80673dc8 00000000
<4>[40682.967000] $ 8   : 00000100 00000040 00000039 ffffffff
<4>[40682.972211] $12   : 00002853 00000000 00000001 00000001
<4>[40682.977421] $16   : 81412a00 00000a20 80a7b464 00000000
<4>[40682.982631] $20   : 80673dc8 80a80000 00000001 00812e49
<4>[40682.987842] $24   : 00000000 800158c0                  
<4>[40682.993052] $28   : 823a2000 823a3d40 c5240000 80673dc8
<4>[40682.998263] Hi    : 00000000
<4>[40683.001124] Lo    : 00000041
<4>[40683.003990] epc   : 801a7f8c 0x801a7f8c
<4>[40683.007804] ra    : 80673dc8 0x80673dc8
<4>[40683.011616] Status: 1100fc03  KERNEL EXL IE 
<4>[40683.015787] Cause : 40800008 (ExcCode 02)
<4>[40683.019771] BadVA : 00000070
<4>[40683.022633] PrId  : 0001992f (MIPS 1004Kc)
<4>[40683.026704] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
<4>[40683.027017]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake ntfs3(O) nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect
<4>[40683.114255]  ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsd bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
<4>[40683.201525]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
<4>[40683.339577] Process napi/mtk_eth-6 (pid: 699, threadinfo=3b324142, task=1d62ee46, tls=00000000)
<4>[40683.348239] Stack : 83551800 00000000 00000000 80b10860 80c60000 80c60000 00000014 0000081e
<4>[40683.356579]         a9910d80 845d6d40 845d6d40 00000960 84593ea0 845d6d40 00000000 00000000
<4>[40683.364916]         8162b080 80673dc8 00000000 80698070 8a89d6c0 806e7120 845d6d40 00000960
<4>[40683.373251]         a9910d80 80673e38 00000040 823a3e08 04593ea0 8162b5ec 000000d8 8162b5ec
<4>[40683.381587]         000000d8 805bd91c 811ddb60 8a89d000 6c825260 811de4b0 00000000 00000000
<4>[40683.389926]         ...
<4>[40683.392362] Call Trace:
<4>[40683.392601] [<80673dc8>] 0x80673dc8
<4>[40683.398499] [<80698070>] 0x80698070
<4>[40683.401967] [<806e7120>] 0x806e7120
<4>[40683.405462] [<80673e38>] 0x80673e38
<4>[40683.408987] [<805bd91c>] 0x805bd91c
<4>[40683.412457] [<80697488>] 0x80697488
<4>[40683.416026] [<805bfc84>] 0x805bfc84
<4>[40683.419516] [<80697230>] 0x80697230
<4>[40683.423072] [<80697078>] 0x80697078
<4>[40683.426570] [<8003a328>] 0x8003a328
<4>[40683.430060] [<80697230>] 0x80697230
<4>[40683.433529] [<8069724c>] 0x8069724c
<4>[40683.437024] [<80056420>] 0x80056420
<4>[40683.440513] [<808d5588>] 0x808d5588
<4>[40683.443982] [<80697198>] 0x80697198
<4>[40683.447494] [<80697198>] 0x80697198
<4>[40683.450963] [<80056998>] 0x80056998
<4>[40683.454448] [<80056820>] 0x80056820
<4>[40683.457962] [<80063e0c>] 0x80063e0c
<4>[40683.461430] [<80056820>] 0x80056820
<4>[40683.464924] [<80056820>] 0x80056820
<4>[40683.468393] [<8000376c>] 0x8000376c
<4>[40683.471872] 
<4>[40683.473352] Code: 02803025  8e02001c  00621821 <8c660000> 41656000  30a50001  000000c0  8f84000c  8e020000 
<4>[40683.483080] 
<4>[40683.484674] ---[ end trace 781f86db5cf39005 ]---

Now I'm building 5.15 :)

Vladdrako commented 2 years ago

I did a clean build and now looks like kallsyms work now(?). But kernel panics are caused by software. nlbwmon

[  340.021902] CPU 0 Unable to handle kernel paging request at virtual address 00000304, epc == 806c909c, ra == 806c9114
[  340.032607] Oops[#1]:
[  340.034903] CPU: 0 PID: 5623 Comm: nlbwmon Tainted: G           O      5.10.109 #0
[  340.042445] $ 0   : 00000000 00000001 00000000 00000008
[  340.047671] $ 4   : 00000000 897abaa0 00000000 897abab0
[  340.052913] $ 8   : 000022f6 00000b86 00000b86 00000000
[  340.058146] $12   : 00000000 80c0322c 80c0323c 80c031bc
[  340.063369] $16   : 8986b800 00000000 80bfaa60 8973c258
[  340.068589] $20   : 00000000 00000000 00000000 83417540
[  340.073810] $24   : 00000000 00000000                  
[  340.079026] $28   : 897aa000 897abae0 0000009f 806c9114
[  340.084255] Hi    : 00000000
[  340.087124] Lo    : 00000000
[  340.090016] epc   : 806c909c neigh_dump_info+0x39c/0x5fc
[  340.095309] ra    : 806c9114 neigh_dump_info+0x414/0x5fc
[  340.100598] Status: 11008403 KERNEL EXL IE 
[  340.104774] Cause : 40800008 (ExcCode 02)
[  340.108758] BadVA : 00000304
[  340.111627] PrId  : 0001992f (MIPS 1004Kc)
[  340.115700] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
[  340.116019]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype
[  340.203265]  ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsd nfs nfs_ssc bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
[  340.290833]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
[  340.428886] Process nlbwmon (pid: 5623, threadinfo=896d3798, task=fbc30fbf, tls=77eb2dcc)
[  340.437040] Stack : 00000001 81412a80 80bfaa60 00000000 0000001c 00000002 897abba0 80b60000
[  340.445387]         00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  340.453728]         00000000 00000000 00000000 00000000 00000000 00000000 00000000 000128c0
[  340.462070]         00000002 00000001 835ad000 80b668ac 00000000 00000000 0000000a 00000000
[  340.470411]         806c9120 00000000 8973c000 83417540 00004000 8973c258 00004000 8973c258
[  340.478748]         ...
[  340.481190] Call Trace:
[  340.483661] [<806c909c>] neigh_dump_info+0x39c/0x5fc
[  340.488612] [<8072be34>] netlink_dump+0x108/0x3c8
[  340.493318] [<8072d5b0>] __netlink_dump_start+0x1f4/0x2e8
[  340.498700] [<806d060c>] rtnetlink_rcv_msg+0x2b8/0x404
[  340.503841] [<8072ece8>] netlink_rcv_skb+0xa4/0x140
[  340.508700] [<8072e2f0>] netlink_unicast+0x250/0x358
[  340.513649] [<8072e75c>] netlink_sendmsg+0x364/0x494
[  340.518600] [<8068cfa8>] ____sys_sendmsg+0xb8/0x25c
[  340.523467] [<8068ecd8>] ___sys_sendmsg+0x78/0xd4
[  340.528151] [<8068eecc>] sys_sendmsg+0x4c/0x94
[  340.532604] [<80019578>] syscall_common+0x34/0x58
[  340.537295] 
[  340.538774] Code: 1440fffb  00000000  8e040124 <8c820304> 1452fff7  00000000  12a00058  00000000  1080fff3 
[  340.548506] 
[  340.550187] ---[ end trace 0342f76ff6cc7c95 ]---
[  340.736300] Kernel panic - not syncing: Fatal exception in interrupt
[  340.958139] Rebooting in 3 seconds..

vsftpd

[ 3569.333527] CPU 1 Unable to handle kernel paging request at virtual address f8c04110, epc == 801a955c, ra == 801a93d4
[ 3569.344246] Oops[#1]:
[ 3569.346546] CPU: 1 PID: 24666 Comm: vsftpd Tainted: G           O      5.10.109 #0
[ 3569.354096] $ 0   : 00000000 00000001 00000400 f8c04110
[ 3569.359341] $ 4   : 0067f000 00082a20 806a3108 00000001
[ 3569.364572] $ 8   : 862b63c0 8486bef4 4e25ca27 a3158dcf
[ 3569.369795] $12   : be4cf4a8 2942895d 70838781 00000000
[ 3569.375018] $16   : 81402d00 00082a20 80b6540c 00000000
[ 3569.380233] $20   : 806a3108 80b60000 00000001 001ae4a9
[ 3569.385443] $24   : 00000000 803a1580                  
[ 3569.390662] $28   : 860a0000 8140d9b8 0000e456 801a93d4
[ 3569.395911] Hi    : 00000002
[ 3569.398787] Lo    : 00000001
[ 3569.401677] epc   : 801a955c __kmalloc_track_caller+0x1e8/0x438
[ 3569.407587] ra    : 801a93d4 __kmalloc_track_caller+0x60/0x438
[ 3569.413393] Status: 1100fc03 KERNEL EXL IE 
[ 3569.417569] Cause : 40800008 (ExcCode 02)
[ 3569.421554] BadVA : f8c04110
[ 3569.424417] PrId  : 0001992f (MIPS 1004Kc)
[ 3569.428502] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
[ 3569.428927]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype
[ 3569.516179]  ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsd nfs nfs_ssc bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
[ 3569.603726]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
[ 3569.741807] Process vsftpd (pid: 24666, threadinfo=edacca9d, task=106e9f41, tls=77ecedcc)
[ 3569.749953] Stack : 877b0b40 8720e238 8720e238 00000140 8140d9d0 80b65418 f8c03d10 00000000
[ 3569.758305]         00000000 862b63c0 00000800 00000a20 806a3108 00000000 81412a80 8985a328
[ 3569.766653]         00000000 80699d64 0000000e 80d40000 80ae2264 00000003 862b6cc0 862b6cc0
[ 3569.774990]         000005b4 871183b8 00000140 00000036 862b6cc0 8985a328 00000000 806a3108
[ 3569.783329]         871183b8 0000dea2 8486b940 00000000 898fd0a4 84ad0d70 8983590e 00000080
[ 3569.791670]         ...
[ 3569.794110] Call Trace:
[ 3569.796570] [<801a955c>] __kmalloc_track_caller+0x1e8/0x438
[ 3569.802138] [<80699d64>] __alloc_skb+0x90/0x1fc
[ 3569.806666] [<806a3108>] skb_segment+0x228/0xcf0
[ 3569.811304] [<807cd0c4>] tcp_gso_segment+0x118/0x5a0
[ 3569.816270] [<807e5048>] inet_gso_segment+0x174/0x3cc
[ 3569.821375] [<806bba64>] skb_mac_gso_segment+0xb4/0x130
[ 3569.826684] [<806bbb60>] __skb_gso_segment+0x80/0x1b8
[ 3569.831782] [<806bc0cc>] validate_xmit_skb+0x90/0x248
[ 3569.836833] [<806bcc34>] __dev_queue_xmit+0x340/0x574
[ 3569.841892] [<808be7ac>] br_dev_queue_push_xmit+0x160/0x1e0
[ 3569.847451] [<808bac38>] br_dev_xmit+0x31c/0x4cc
[ 3569.852055] [<806bc70c>] dev_hard_start_xmit+0x10c/0x1e8
[ 3569.857354] [<806bcdf0>] __dev_queue_xmit+0x4fc/0x574
[ 3569.862391] [<8079528c>] ip_finish_output2+0x1e4/0x574
[ 3569.867519] [<80797690>] __ip_queue_xmit+0x1a0/0x4a4
[ 3569.872476] [<807bb430>] __tcp_transmit_skb+0x448/0x8a0
[ 3569.877689] [<807bcedc>] tcp_write_xmit+0x434/0x8bc
[ 3569.882552] [<807be524>] tcp_tsq_write.part.0+0x70/0xc4
[ 3569.887764] [<807be790>] tcp_tsq_handler+0x4c/0xd4
[ 3569.892540] [<807be928>] tcp_pace_kick+0x20/0xa8
[ 3569.897173] [<800ae9c4>] __hrtimer_run_queues+0x15c/0x234
[ 3569.902556] [<800aeba8>] hrtimer_run_softirq+0xa0/0x12c
[ 3569.907777] [<80902acc>] __do_softirq+0x164/0x368
[ 3569.912478] [<8003a524>] irq_exit+0xcc/0x12c
[ 3569.916751] [<8043a4ec>] plat_irq_dispatch+0x68/0xf0
[ 3569.921707] [<80003d08>] except_vec_vi_end+0xb8/0xc4
[ 3569.926660] [<80365e4c>] blk_bio_segment_split+0x1b0/0x308
[ 3569.932128] [<80366348>] __blk_queue_split+0x168/0x170
[ 3569.937267] [<8036dd0c>] blk_mq_submit_bio+0x80/0x43c
[ 3569.942315] [<8035f744>] submit_bio_noacct+0x150/0x1d0
[ 3569.947824] [<82c78ca8>] btrfs_map_bio+0x1fc/0x4c8 [btrfs]
[ 3569.953533] [<82c37d10>] btrfs_submit_data_bio+0xa8/0x240 [btrfs]
[ 3569.959851] [<82c5fcc0>] submit_one_bio+0x50/0x534 [btrfs]
[ 3569.965550] [<82c66498>] btrfs_bio_alloc+0x178/0x968 [btrfs]
[ 3569.971304] 
[ 3569.972791] Code: 02803025  8e02001c  00621821 <8c660000> 41656000  30a50001  000000c0  8f84000c  8e020000 
[ 3569.982552] 
[ 3569.984141] ---[ end trace a6cc23d5c0427159 ]---
[ 3570.162444] Kernel panic - not syncing: Fatal exception in interrupt
[ 3570.168815] ------------[ cut here ]------------
[ 3570.173455] WARNING: CPU: 1 PID: 24666 at kernel/smp.c:633 smp_call_function_many_cond+0x438/0x454
[ 3570.182386] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
[ 3570.182718]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype
[ 3570.269991]  ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsd nfs nfs_ssc bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
[ 3570.357735]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
[ 3570.495903] CPU: 1 PID: 24666 Comm: vsftpd Tainted: G      D    O      5.10.109 #0
[ 3570.503444] Stack : 80d60000 00000000 0000e456 8008b3d8 80a80000 80a85be0 80be0000 80a85ba8
[ 3570.511809]         8140d704 80d40000 809ddab8 89e1c4f0 80b697a7 00000001 8140d6a8 80bd33ec
[ 3570.520174]         00000000 00000000 809ddab8 8140d560 ffffefff 00000000 ffffffea 00000000
[ 3570.528536]         8140d550 000007b6 80b6f3e0 ffffffff 80000000 00000000 00000000 809e0000
[ 3570.536897]         00000009 89e1c100 89ccf400 00000000 00000001 804d4010 000fd757 000fd797
[ 3570.545257]         ...
[ 3570.547707] Call Trace:
[ 3570.550180] [<8000a8c8>] show_stack+0x30/0x100
[ 3570.554616] [<8041cb94>] dump_stack+0x9c/0xcc
[ 3570.558966] [<800356e8>] __warn+0xc0/0x12c
[ 3570.563051] [<800357b0>] warn_slowpath_fmt+0x5c/0xac
[ 3570.568023] [<800cb3b8>] smp_call_function_many_cond+0x438/0x454
[ 3570.574009] [<800cb424>] smp_call_function+0x30/0x64
[ 3570.578961] [<80035154>] panic+0x12c/0x334
[ 3570.583048] [<8000ab9c>] die+0x120/0x128
[ 3570.586979] [<8001d798>] __do_page_fault+0x4ac/0x4bc
[ 3570.591935] [<80022ca8>] tlb_do_page_fault_0+0x118/0x120
[ 3570.597254] [<801a93d4>] __kmalloc_track_caller+0x60/0x438
[ 3570.602731] [<80699d64>] __alloc_skb+0x90/0x1fc
[ 3570.607261] [<806a3108>] skb_segment+0x228/0xcf0
[ 3570.611892] [<807cd0c4>] tcp_gso_segment+0x118/0x5a0
[ 3570.616867] [<807e5048>] inet_gso_segment+0x174/0x3cc
[ 3570.621910] [<806bba64>] skb_mac_gso_segment+0xb4/0x130
[ 3570.627122] [<806bbb60>] __skb_gso_segment+0x80/0x1b8
[ 3570.632158] [<806bc0cc>] validate_xmit_skb+0x90/0x248
[ 3570.637196] [<806bcc34>] __dev_queue_xmit+0x340/0x574
[ 3570.642260] [<808be7ac>] br_dev_queue_push_xmit+0x160/0x1e0
[ 3570.647819] [<808bac38>] br_dev_xmit+0x31c/0x4cc
[ 3570.652422] [<806bc70c>] dev_hard_start_xmit+0x10c/0x1e8
[ 3570.657719] [<806bcdf0>] __dev_queue_xmit+0x4fc/0x574
[ 3570.662755] [<8079528c>] ip_finish_output2+0x1e4/0x574
[ 3570.667881] [<80797690>] __ip_queue_xmit+0x1a0/0x4a4
[ 3570.672831] [<807bb430>] __tcp_transmit_skb+0x448/0x8a0
[ 3570.678042] [<807bcedc>] tcp_write_xmit+0x434/0x8bc
[ 3570.682906] [<807be524>] tcp_tsq_write.part.0+0x70/0xc4
[ 3570.688118] [<807be790>] tcp_tsq_handler+0x4c/0xd4
[ 3570.692894] [<807be928>] tcp_pace_kick+0x20/0xa8
[ 3570.697527] [<800ae9c4>] __hrtimer_run_queues+0x15c/0x234
[ 3570.702911] [<800aeba8>] hrtimer_run_softirq+0xa0/0x12c
[ 3570.708132] [<80902acc>] __do_softirq+0x164/0x368
[ 3570.712829] [<8003a524>] irq_exit+0xcc/0x12c
[ 3570.717102] [<8043a4ec>] plat_irq_dispatch+0x68/0xf0
[ 3570.722053] [<80003d08>] except_vec_vi_end+0xb8/0xc4
[ 3570.727007] [<80365e4c>] blk_bio_segment_split+0x1b0/0x308
[ 3570.732475] [<80366348>] __blk_queue_split+0x168/0x170
[ 3570.737614] [<8036dd0c>] blk_mq_submit_bio+0x80/0x43c
[ 3570.742661] [<8035f744>] submit_bio_noacct+0x150/0x1d0
[ 3570.748153] [<82c78ca8>] btrfs_map_bio+0x1fc/0x4c8 [btrfs]
[ 3570.753864] [<82c37d10>] btrfs_submit_data_bio+0xa8/0x240 [btrfs]
[ 3570.760173] [<82c5fcc0>] submit_one_bio+0x50/0x534 [btrfs]
[ 3570.765870] [<82c66498>] btrfs_bio_alloc+0x178/0x968 [btrfs]
[ 3570.771614] 
[ 3570.773104] ---[ end trace a6cc23d5c042715a ]---
[ 3571.170563] Rebooting in 3 seconds..

Maybe it helps somehow...

Vladdrako commented 2 years ago

Hmm, maybe good idea to add this ba1f8c93 https://www.spinics.net/lists/netdev/msg727603.html

Vladdrako commented 2 years ago

@nbd168 Finally I caught napi/mtk_eth crash

[  370.109000] Unhandled kernel unaligned access[#1]:
[  370.113827] CPU: 1 PID: 699 Comm: napi/mtk_eth-6 Tainted: G           O      5.10.109 #0
[  370.121884] $ 0   : 00000000 00000001 0000005c 0000006a
[  370.127120] $ 4   : 0067f000 00000a20 8069b8e0 00000000
[  370.132352] $ 8   : 00000100 00000040 00000039 0000000b
[  370.137594] $12   : 00000000 80c0322c 80c0323c 80c031bc
[  370.142831] $16   : 81412a80 00000a20 80b6540c 00000000
[  370.148067] $20   : 8069b8e0 80b60000 00000001 0030f251
[  370.153301] $24   : 00001870 00000000                  
[  370.158528] $28   : 82378000 82379d40 c5ee0000 8069b8e0
[  370.163755] Hi    : 00000000
[  370.166621] Lo    : 00000041
[  370.169518] epc   : 801a9db0 kmem_cache_alloc+0x1cc/0x3f8
[  370.174912] ra    : 8069b8e0 __build_skb+0x2c/0x80
[  370.179682] Status: 1100fc03 KERNEL EXL IE 
[  370.183869] Cause : 40800010 (ExcCode 04)
[  370.187860] BadVA : 0000006a
[  370.190728] PrId  : 0001992f (MIPS 1004Kc)
[  370.194806] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
[  370.195302]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype
[  370.282689]  ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsd nfs nfs_ssc bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
[  370.370411]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
[  370.508584] Process napi/mtk_eth-6 (pid: 699, threadinfo=2d768a5a, task=5a243e36, tls=00000000)
[  370.517246] Stack : 000d2a20 00000000 00000001 000110c4 80d40000 80d40000 0000000e 0000081e
[  370.525608]         a972d460 887eaba0 887eaba0 00000960 865476e0 887eaba0 000110c4 0000002e
[  370.533968]         81776080 8069b8e0 812bd2b0 812bd2b0 80e6dd00 00000960 887eaba0 00000960
[  370.542328]         a972d460 8069b950 c5ee0000 805e52c4 065476e0 817765ec 00000146 817765ec
[  370.550693]         00000146 805e5184 816f61e0 812bdb20 28ffb2d0 ff7db5d0 00000000 00000000
[  370.559056]         ...
[  370.561501] Call Trace:
[  370.563966] [<801a9db0>] kmem_cache_alloc+0x1cc/0x3f8
[  370.569018] [<8069b8e0>] __build_skb+0x2c/0x80
[  370.573452] [<8069b950>] build_skb+0x1c/0xa4
[  370.577720] [<805e5184>] mtk_poll_rx+0x29c/0x63c
[  370.582323] [<805e74fc>] mtk_napi_rx+0xa0/0x190
[  370.586851] [<806bedd0>] __napi_poll+0x3c/0x15c
[  370.591368] [<806befa4>] napi_threaded_poll+0xb4/0x11c
[  370.596511] [<80056a2c>] kthread+0x178/0x180
[  370.600775] [<8000380c>] ret_from_kernel_thread+0x14/0x1c
[  370.606159] 
[  370.607644] Code: 02803025  8e02001c  00621821 <8c660000> 41656000  30a50001  000000c0  8f84000c  8e020000 
[  370.617399] 
[  370.618967] ---[ end trace b3632d52b3fa0fc2 ]---
[  370.898808] Kernel panic - not syncing: Fatal exception in interrupt
[  371.123500] Rebooting in 3 seconds..

EDIT: more logs

[ 3736.763361] CPU 1 Unable to handle kernel paging request at virtual address fad33bb8, epc == 801a955c, ra == 801a93d4
[ 3736.773995] Oops[#1]:
[ 3736.776267] CPU: 1 PID: 699 Comm: napi/mtk_eth-6 Tainted: G           O      5.10.109 #0
[ 3736.784314] $ 0   : 00000000 00000001 00000400 fad33bb8
[ 3736.789530] $ 4   : 0067f000 00082a20 806a3108 00000001
[ 3736.794740] $ 8   : 84cd4300 000004d8 00000001 ffffffff
[ 3736.799949] $12   : 0000023f 84af8e44 00000001 00000001
[ 3736.805158] $16   : 81402d00 00082a20 80b6540c 00000000
[ 3736.810367] $20   : 806a3108 80b60000 00000001 000ae4f5
[ 3736.815577] $24   : 00000000 803a1580                  
[ 3736.820788] $28   : 82388000 82389858 00000036 801a93d4
[ 3736.825997] Hi    : 00000002
[ 3736.828859] Lo    : 00000001
[ 3736.831746] epc   : 801a955c __kmalloc_track_caller+0x1e8/0x438
[ 3736.837636] ra    : 801a93d4 __kmalloc_track_caller+0x60/0x438
[ 3736.843436] Status: 1100fc03 KERNEL EXL IE 
[ 3736.847607] Cause : 40800008 (ExcCode 02)
[ 3736.851591] BadVA : fad33bb8
[ 3736.854454] PrId  : 0001992f (MIPS 1004Kc)
[ 3736.858525] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
[ 3736.858842]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype
[ 3736.946089]  ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsd nfs nfs_ssc bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
[ 3737.033652]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
[ 3737.171716] Process napi/mtk_eth-6 (pid: 699, threadinfo=f2e1764c, task=f8f7507a, tls=00000000)
[ 3737.180374] Stack : 8172b5bc 000005be 8a8576e2 805e64f4 82389870 80d42570 fad337b8 84cdfb40
[ 3737.188711]         80b65418 84cd4300 00000660 00000a20 806a3108 00000000 81412a80 8a8eec68
[ 3737.197044]         00000000 80699d64 00000002 8169d880 00000000 fffffff5 82389928 00000100
[ 3737.205377]         000004d8 84cd4d80 0000007c 00000036 00000000 8a8eec68 00000000 806a3108
[ 3737.213710]         00000000 0000050e 84cd4240 84af8cc0 84cd4240 84af8cc0 834a30a4 84af8d70
[ 3737.222043]         ...
[ 3737.224479] Call Trace:
[ 3737.226936] [<801a955c>] __kmalloc_track_caller+0x1e8/0x438
[ 3737.232494] [<80699d64>] __alloc_skb+0x90/0x1fc
[ 3737.237010] [<806a3108>] skb_segment+0x228/0xcf0
[ 3737.241628] [<807cd0c4>] tcp_gso_segment+0x118/0x5a0
[ 3737.246587] [<807e5048>] inet_gso_segment+0x174/0x3cc
[ 3737.251620] [<806bbb9c>] skb_mac_gso_segment+0xb4/0x130
[ 3737.256819] [<806bbc98>] __skb_gso_segment+0x80/0x1b8
[ 3737.261846] [<806bc204>] validate_xmit_skb+0x90/0x248
[ 3737.266873] [<806bcd6c>] __dev_queue_xmit+0x340/0x574
[ 3737.271918] [<808be7ac>] br_dev_queue_push_xmit+0x160/0x1e0
[ 3737.277462] [<808bac38>] br_dev_xmit+0x31c/0x4cc
[ 3737.282057] [<806bc844>] dev_hard_start_xmit+0x10c/0x1e8
[ 3737.287343] [<806bcf28>] __dev_queue_xmit+0x4fc/0x574
[ 3737.292370] [<8079528c>] ip_finish_output2+0x1e4/0x574
[ 3737.297502] [<8078f698>] ip_sublist_rcv_finish+0x4c/0x70
[ 3737.302788] [<8078fe54>] ip_sublist_rcv+0x114/0x1a4
[ 3737.307677] [<80790e68>] ip_list_rcv+0xfc/0x128
[ 3737.312257] [<806be068>] __netif_receive_skb_list_core+0x17c/0x220
[ 3737.318450] [<806be328>] netif_receive_skb_list_internal+0x21c/0x318
[ 3737.324802] [<806bebac>] napi_complete_done+0x7c/0x264
[ 3737.329937] [<8070edb8>] gro_cell_poll+0x8c/0xb4
[ 3737.334542] [<806bedd0>] __napi_poll+0x3c/0x15c
[ 3737.339053] [<806bf0fc>] net_rx_action+0xf0/0x21c
[ 3737.343765] [<80902acc>] __do_softirq+0x164/0x368
[ 3737.348460] [<8003a2b0>] do_softirq+0x9c/0xa4
[ 3737.352801] [<8003a390>] __local_bh_enable_ip+0xd8/0xfc
[ 3737.358005] [<806befb8>] napi_threaded_poll+0xc8/0x11c
[ 3737.363137] [<80056a2c>] kthread+0x178/0x180
[ 3737.367392] [<8000380c>] ret_from_kernel_thread+0x14/0x1c
[ 3737.372772] 
[ 3737.374258] Code: 02803025  8e02001c  00621821 <8c660000> 41656000  30a50001  000000c0  8f84000c  8e020000 
[ 3737.383994] 
[ 3737.385551] ---[ end trace cabf77edb26237ad ]---
[ 3737.530206] Kernel panic - not syncing: Fatal exception in interrupt
[ 3737.536568] ------------[ cut here ]------------
[ 3737.541199] WARNING: CPU: 1 PID: 699 at kernel/smp.c:633 smp_call_function_many_cond+0x438/0x454
[ 3737.549944] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
[ 3737.550269]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype
[ 3737.637578]  ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsd nfs nfs_ssc bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
[ 3737.725209]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
[ 3737.863387] CPU: 1 PID: 699 Comm: napi/mtk_eth-6 Tainted: G      D    O      5.10.109 #0
[ 3737.871459] Stack : 80d60000 00000000 00000036 8008b3d8 80a80000 80a85be0 80be0000 80a85ba8
[ 3737.879813]         823895a4 80d40000 809ddab8 816a0c10 80b697a7 00000001 82389548 80bd33ec
[ 3737.888163]         00000000 00000000 809ddab8 82389400 ffffefff 00000000 ffffffea 00000000
[ 3737.896506]         823893f0 000007a9 80b6f3e0 ffffffff 00000000 00000000 00000000 809e0000
[ 3737.904857]         00000009 816a0820 00000000 00000000 00000002 804d4010 000fd757 000fd797
[ 3737.913213]         ...
[ 3737.915661] Call Trace:
[ 3737.918139] [<8000a8c8>] show_stack+0x30/0x100
[ 3737.922586] [<8041cb94>] dump_stack+0x9c/0xcc
[ 3737.926940] [<800356e8>] __warn+0xc0/0x12c
[ 3737.931034] [<800357b0>] warn_slowpath_fmt+0x5c/0xac
[ 3737.936013] [<800cb3b8>] smp_call_function_many_cond+0x438/0x454
[ 3737.942022] [<800cb424>] smp_call_function+0x30/0x64
[ 3737.946982] [<80035154>] panic+0x12c/0x334
[ 3737.951078] [<8000ab9c>] die+0x120/0x128
[ 3737.955018] [<8001d798>] __do_page_fault+0x4ac/0x4bc
[ 3737.959974] [<80022ca8>] tlb_do_page_fault_0+0x118/0x120
[ 3737.965296] [<801a93d4>] __kmalloc_track_caller+0x60/0x438
[ 3737.970781] [<80699d64>] __alloc_skb+0x90/0x1fc
[ 3737.975308] [<806a3108>] skb_segment+0x228/0xcf0
[ 3737.979944] [<807cd0c4>] tcp_gso_segment+0x118/0x5a0
[ 3737.984920] [<807e5048>] inet_gso_segment+0x174/0x3cc
[ 3737.989964] [<806bbb9c>] skb_mac_gso_segment+0xb4/0x130
[ 3737.995181] [<806bbc98>] __skb_gso_segment+0x80/0x1b8
[ 3738.000255] [<806bc204>] validate_xmit_skb+0x90/0x248
[ 3738.005315] [<806bcd6c>] __dev_queue_xmit+0x340/0x574
[ 3738.010373] [<808be7ac>] br_dev_queue_push_xmit+0x160/0x1e0
[ 3738.015940] [<808bac38>] br_dev_xmit+0x31c/0x4cc
[ 3738.020552] [<806bc844>] dev_hard_start_xmit+0x10c/0x1e8
[ 3738.025858] [<806bcf28>] __dev_queue_xmit+0x4fc/0x574
[ 3738.030898] [<8079528c>] ip_finish_output2+0x1e4/0x574
[ 3738.036048] [<8078f698>] ip_sublist_rcv_finish+0x4c/0x70
[ 3738.041363] [<8078fe54>] ip_sublist_rcv+0x114/0x1a4
[ 3738.046242] [<80790e68>] ip_list_rcv+0xfc/0x128
[ 3738.050763] [<806be068>] __netif_receive_skb_list_core+0x17c/0x220
[ 3738.056939] [<806be328>] netif_receive_skb_list_internal+0x21c/0x318
[ 3738.063284] [<806bebac>] napi_complete_done+0x7c/0x264
[ 3738.068437] [<8070edb8>] gro_cell_poll+0x8c/0xb4
[ 3738.073056] [<806bedd0>] __napi_poll+0x3c/0x15c
[ 3738.077575] [<806bf0fc>] net_rx_action+0xf0/0x21c
[ 3738.082289] [<80902acc>] __do_softirq+0x164/0x368
[ 3738.086989] [<8003a2b0>] do_softirq+0x9c/0xa4
[ 3738.091344] [<8003a390>] __local_bh_enable_ip+0xd8/0xfc
[ 3738.096567] [<806befb8>] napi_threaded_poll+0xc8/0x11c
[ 3738.101714] [<80056a2c>] kthread+0x178/0x180
[ 3738.105987] [<8000380c>] ret_from_kernel_thread+0x14/0x1c
[ 3738.111374] 
[ 3738.112865] ---[ end trace cabf77edb26237ae ]---
[ 3738.511592] Rebooting in 3 seconds..
xabolcs commented 2 years ago

Logs collected by pstore.

Do you have some manual / how-to somewhere?

When I read about it on the ML for mt7622, I tought it would be nice to add to other (sub)targets!

nbd168 commented 2 years ago

So if I understand what you wrote correctly, you get crashes even without the commit that enables threaded NAPI, right? From what I read in the crash dumps, it happens during memory allocation of new skbs. Based on that, the problem is likely somewhere else entirely in that it might be a skb double-free, or free of an invalid pointer. Can you show me some KALLSYMS-enabled crashes without threaded NAPI to see if they're related?

Vladdrako commented 2 years ago

So if I understand what you wrote correctly, you get crashes even without the commit that enables threaded NAPI, right?

Yes, but caused not by napi.

Can you show me some KALLSYMS-enabled crashes without threaded NAPI to see if they're related?

Ofc, will rebuild kernel as soon as possible.

Vladdrako commented 2 years ago

Do you have some manual / how-to somewhere?

I enabled next symbols in kernel config:

CONFIG_PSTORE=y
CONFIG_PSTORE_COMPRESS=y
CONFIG_PSTORE_COMPRESS_DEFAULT="zstd"
CONFIG_PSTORE_CONSOLE=y
CONFIG_PSTORE_PMSG=y
CONFIG_PSTORE_RAM=y
CONFIG_PSTORE_ZSTD_COMPRESS=y
CONFIG_PSTORE_ZSTD_COMPRESS_DEFAULT=y

Logs located in /sys/fs/pstore folder.

Vladdrako commented 2 years ago

@nbd168 Done. A quick test by copying a huge file from PC to USB-HDD connected to the router.

[  553.722987] Unhandled kernel unaligned access[#1]:
[  553.727812] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G           O      5.10.109 #0
[  553.735290] $ 0   : 00000000 00000001 0000005c 0000006a
[  553.740549] $ 4   : 00670000 00000a20 8069b8a0 00000000
[  553.745789] $ 8   : 00000100 00000040 00000039 ffffffff
[  553.751042] $12   : 00000092 80c0322c 80c0323c 80c031bc
[  553.756268] $16   : 81412a80 00000a20 80b6540c 00000000
[  553.761488] $20   : 8069b8a0 80b60000 00000001 026fac10
[  553.766704] $24   : 00001e6e 00000000                  
[  553.771920] $28   : 80b52000 8140bd80 c5ee0000 8069b8a0
[  553.777132] Hi    : 00000000
[  553.779995] Lo    : 00000041
[  553.782894] epc   : 801a9db0 kmem_cache_alloc+0x1cc/0x3f8
[  553.788278] ra    : 8069b8a0 __build_skb+0x2c/0x80
[  553.793045] Status: 11008403 KERNEL EXL IE 
[  553.797217] Cause : 40800010 (ExcCode 04)
[  553.801207] BadVA : 0000006a
[  553.804071] PrId  : 0001992f (MIPS 1004Kc)
[  553.808141] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
[  553.808461]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype
[  553.895703]  ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsd nfs nfs_ssc bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
[  553.983272]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
[  554.121328] Process swapper/0 (pid: 0, threadinfo=8bceb636, task=28b04905, tls=00000000)
[  554.129382] Stack : 8908bcc0 0000f800 00000006 816f2750 80d40000 80d40000 0000000e 0000081e
[  554.137727]         a2ed6130 89ebb500 89ebb500 00000960 87170660 89ebb500 00014622 00000037
[  554.146070]         816f2080 8069b8a0 8908bcc0 000005ee 00014622 00000036 89ebb500 00000960
[  554.154411]         a2ed6130 8069b910 c5ee0000 805e5138 07170660 816f25ec 00000013 816f25ec
[  554.162752]         00000013 805e5144 8917dad4 83abac00 ff7cc638 ff7cc618 00000000 00000000
[  554.171099]         ...
[  554.173542] Call Trace:
[  554.175999] [<801a9db0>] kmem_cache_alloc+0x1cc/0x3f8
[  554.181047] [<8069b8a0>] __build_skb+0x2c/0x80
[  554.185471] [<8069b910>] build_skb+0x1c/0xa4
[  554.189727] [<805e5144>] mtk_poll_rx+0x29c/0x63c
[  554.194328] [<805e74bc>] mtk_napi_rx+0xa0/0x190
[  554.198846] [<806bec58>] __napi_poll+0x3c/0x15c
[  554.203361] [<806bef84>] net_rx_action+0xf0/0x21c
[  554.208052] [<80902a8c>] __do_softirq+0x164/0x368
[  554.212748] [<8003a524>] irq_exit+0xcc/0x12c
[  554.217011] [<8043a4ec>] plat_irq_dispatch+0x68/0xf0
[  554.221963] [<80003d08>] except_vec_vi_end+0xb8/0xc4
[  554.226905] [<80901e80>] r4k_wait_irqoff+0x1c/0x24
[  554.231698] [<800675c8>] do_idle+0xf0/0x190
[  554.235864] [<800678f4>] cpu_startup_entry+0x24/0x34
[  554.240816] [<80c04c8c>] start_kernel+0x410/0x42c
[  554.245500] 
[  554.246979] Code: 02803025  8e02001c  00621821 <8c660000> 41656000  30a50001  000000c0  8f84000c  8e020000 
[  554.256708] 
[  554.258287] ---[ end trace d6b8fb6b580c7785 ]---
[  554.406351] Kernel panic - not syncing: Fatal exception in interrupt
[  554.412715] ------------[ cut here ]------------
[  554.417341] WARNING: CPU: 0 PID: 0 at kernel/smp.c:633 smp_call_function_many_cond+0x438/0x454
[  554.425909] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
[  554.426235]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype
[  554.513470]  ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsd nfs nfs_ssc bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
[  554.601010]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
[  554.739045] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G      D    O      5.10.109 #0
[  554.746504] Stack : 80d60000 00000000 c5ee0000 8008b3d8 80a80000 80a85be0 80be0000 80a85ba8
[  554.754848]         8140bab4 80d40000 809ddab8 80b69cb0 80b697a7 00000001 8140ba58 80bd33ec
[  554.763188]         00000000 00000000 809ddab8 8140b910 ffffefff 00000000 ffffffea 00000000
[  554.771528]         8140b900 0000079c 80b6f3e0 ffffffff 00000000 00000000 00000000 809e0000
[  554.779863]         00000009 80b60000 00000001 00000000 00000000 804d4010 000fd757 000fd797
[  554.788206]         ...
[  554.790653] Call Trace:
[  554.793115] [<8000a8c8>] show_stack+0x30/0x100
[  554.797543] [<8041cb94>] dump_stack+0x9c/0xcc
[  554.801889] [<800356e8>] __warn+0xc0/0x12c
[  554.805966] [<800357b0>] warn_slowpath_fmt+0x5c/0xac
[  554.810926] [<800cb3b8>] smp_call_function_many_cond+0x438/0x454
[  554.816905] [<800cb424>] smp_call_function+0x30/0x64
[  554.821850] [<80035154>] panic+0x12c/0x334
[  554.825929] [<8000ab9c>] die+0x120/0x128
[  554.829833] [<8000d2dc>] emulate_load_store_insn+0x294/0x7b0
[  554.835470] [<8000d880>] do_ade+0x88/0x1b0
[  554.839550] [<80004194>] handle_adel_int+0x30/0x3c
[  554.844341] [<8069b8a0>] __build_skb+0x2c/0x80
[  554.848766] 
[  554.850252] ---[ end trace d6b8fb6b580c7786 ]---
[  555.247841] Rebooting in 3 seconds..

EDIT: Same test, different log.

[  501.691918] Unhandled kernel unaligned access[#1]:
[  501.696733] CPU: 0 PID: 11 Comm: ksoftirqd/0 Tainted: G           O      5.10.109 #0
[  501.704444] $ 0   : 00000000 00000001 0000005c 0000006a
[  501.709663] $ 4   : 00670000 00000a20 8069b8a0 00000000
[  501.714872] $ 8   : 00000100 00000040 00000039 ffffffff
[  501.720095] $12   : 00000085 80c0322c 80c0323c 80c031bc
[  501.725323] $16   : 81412a80 00000a20 80b6540c 00000000
[  501.730538] $20   : 8069b8a0 80b60000 00000001 00e3f5cc
[  501.735747] $24   : 00002074 00000000                  
[  501.740958] $28   : 81460000 81461c88 c5ee0000 8069b8a0
[  501.746168] Hi    : 00000000
[  501.749028] Lo    : 00000041
[  501.751918] epc   : 801a9db0 kmem_cache_alloc+0x1cc/0x3f8
[  501.757300] ra    : 8069b8a0 __build_skb+0x2c/0x80
[  501.762062] Status: 11008403 KERNEL EXL IE 
[  501.766231] Cause : 40800410 (ExcCode 04)
[  501.770216] BadVA : 0000006a
[  501.773078] PrId  : 0001992f (MIPS 1004Kc)
[  501.777149] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
[  501.777468]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype
[  501.864714]  ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsd nfs nfs_ssc bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
[  501.952276]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
[  502.090336] Process ksoftirqd/0 (pid: 11, threadinfo=835223d5, task=25496dd3, tls=00000000)
[  502.098661] Stack : 82d80f00 0000f800 00000004 817d7750 80d40000 80d40000 0000000e 0000081e
[  502.107026]         a9868160 87173500 87173500 00000960 86800660 87173500 00004728 0000000c
[  502.115389]         817d7080 8069b8a0 82d80f00 000005ee 00004728 0000000b 87173500 00000960
[  502.123752]         a9868160 8069b910 c5ee0000 805e50a4 06800660 817d75ec 00000016 817d75ec
[  502.132117]         00000016 805e5144 89df3554 870fdcc0 ff7cc620 870fd840 00000000 00000000
[  502.140478]         ...
[  502.142926] Call Trace:
[  502.145397] [<801a9db0>] kmem_cache_alloc+0x1cc/0x3f8
[  502.150448] [<8069b8a0>] __build_skb+0x2c/0x80
[  502.154883] [<8069b910>] build_skb+0x1c/0xa4
[  502.159152] [<805e5144>] mtk_poll_rx+0x29c/0x63c
[  502.163760] [<805e74bc>] mtk_napi_rx+0xa0/0x190
[  502.168286] [<806bec58>] __napi_poll+0x3c/0x15c
[  502.172806] [<806bef84>] net_rx_action+0xf0/0x21c
[  502.177504] [<80902a8c>] __do_softirq+0x164/0x368
[  502.182207] [<8003a200>] run_ksoftirqd+0x5c/0x70
[  502.186826] [<8005ca98>] smpboot_thread_fn+0x12c/0x2dc
[  502.191966] [<80056a2c>] kthread+0x178/0x180
[  502.196230] [<8000380c>] ret_from_kernel_thread+0x14/0x1c
[  502.201614] 
[  502.203099] Code: 02803025  8e02001c  00621821 <8c660000> 41656000  30a50001  000000c0  8f84000c  8e020000 
[  502.212853] 
[  502.214474] ---[ end trace 7c005e2e6e53680c ]---
[  502.329501] ------------[ cut here ]------------
[  502.334233] WARNING: CPU: 3 PID: 16516 at lib/refcount.c:28 skb_release_data+0xe0/0x1d0
[  502.342223] refcount_t: underflow; use-after-free.
[  502.347034] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
[  502.347372]  ums_alauda
[  502.368065] Kernel panic - not syncing: Fatal exception in interrupt
[  502.434394]  ts_kmp
[  502.436804] ------------[ cut here ]------------
[  502.443204]  ts_fsm
[  502.445244] WARNING: CPU: 0 PID: 11 at kernel/smp.c:633 smp_call_function_many_cond+0x438/0x454
[  502.449804]  ts_bm
[  502.451881] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio
[  502.460561]  snd_usbmidi_lib
[  502.462553]  rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O)
[  502.471400]  sch_cake
[  502.474254]  mt76(O)
[  502.480740]  nft_tproxy
[  502.482994]  mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat
[  502.485180]  nft_socket
[  502.487605]  ebtable_filter
[  502.493412]  nft_reject_ipv6
[  502.495832]  ebtable_broute
[  502.498605]  nft_reject_ipv4
[  502.501463]  cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss
[  502.504253]  nft_reject_inet
[  502.507111]  xt_string
[  502.512918]  nft_reject_bridge
[  502.515769]  xt_statistic
[  502.518109]  nft_reject
[  502.521140]  xt_state
[  502.523749]  nft_redir
[  502.526170]  xt_socket
[  502.528423]  nft_quota
[  502.530762]  xt_recent
[  502.533113]  nft_queue
[  502.535447]  xt_quota
[  502.537787]  nft_objref
[  502.540127]  xt_pkttype
[  502.542392]  nft_numgen
[  502.544815]  xt_physdev
[  502.547245]  nft_nat
[  502.549669]  xt_owner
[  502.552110]  nft_meta_bridge
[  502.554266]  xt_nat
[  502.556545]  nft_masq
[  502.559381]  xt_multiport
[  502.561478]  nft_log
[  502.563722]  xt_mark
[  502.566321]  nft_limit
[  502.568486]  xt_mac
[  502.570652]  nft_hash
[  502.572992]  xt_limit xt_length2(O) xt_length xt_ipv4options(O)
[  502.575089]  nft_fwd_netdev
[  502.577342]  xt_iprange
[  502.583236]  nft_fib_inet
[  502.586001]  xt_iface(O)
[  502.588426]  nft_dup_netdev
[  502.591025]  xt_hl
[  502.593564]  nft_ct
[  502.596311]  xt_helper xt_hashlimit
[  502.598344]  nft_counter
[  502.600413]  xt_geoip(O) xt_ecn
[  502.603955]  nft_compat
[  502.606417]  xt_dscp xt_conntrack
[  502.609564]  nft_chain_nat
[  502.611988]  xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS
[  502.615330]  nfnetlink_queue
[  502.618015]  xt_REDIRECT
[  502.628753]  nfnetlink_log
[  502.631599]  xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE
[  502.634134]  nf_tproxy_ipv6
[  502.636820]  xt_LUA(O)
[  502.643150]  nf_tproxy_ipv4
[  502.645914]  xt_LOGMARK(O)
[  502.648255]  nf_socket_ipv6
[  502.651027]  xt_LOG
[  502.653727]  nf_socket_ipv4
[  502.656492]  xt_IPMARK(O)
[  502.658575]  nf_reject_ipv4
[  502.661345]  xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT
[  502.663967]  nf_nat_tftp
[  502.666739]  xt_CLASSIFY
[  502.672377]  nf_nat_snmp_basic
[  502.674883]  xt_CHECKSUM
[  502.677398]  nf_nat_sip
[  502.680429]  vhci_hcd
[  502.682957]  nf_nat_pptp
[  502.685377]  usbnet
[  502.687632]  nf_nat_irc
[  502.690145]  usbip_host
[  502.692240]  nf_nat_h323
[  502.694660]  usbip_core
[  502.697087]  nf_log_ipv4
[  502.699600]  usbhid
[  502.702041]  nf_dup_netdev
[  502.704547]  ums_usbat
[  502.706630]  nf_conntrack_tftp
[  502.709315]  ums_sddr55
[  502.711669]  nf_conntrack_snmp
[  502.714694]  ums_sddr09
[  502.717123]  nf_conntrack_sip
[  502.720154]  ums_karma
[  502.722595]  nf_conntrack_pptp
[  502.725534]  ums_jumpshot
[  502.727875]  nf_conntrack_netlink
[  502.730906]  ums_isd200
[  502.733520]  nf_conntrack_irc
[  502.736803]  ums_freecom
[  502.739231]  nf_conntrack_h323
[  502.742174]  ums_datafab ums_cypress ums_alauda ts_kmp ts_fsm
[  502.744709]  nf_conntrack_broadcast
[  502.747741]  ts_bm
[  502.753465]  nf_conntrack_bridge
[  502.756921]  snd_usbmidi_lib
[  502.758918]  nf_conncount
[  502.762120]  sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4
[  502.764999]  lz4_decompress
[  502.767599]  nft_reject_inet
[  502.774533]  lz4_compress
[  502.777298]  nft_reject_bridge
[  502.780158]  libchacha20poly1305
[  502.782755]  nft_reject nft_redir nft_quota nft_queue nft_objref
[  502.785809]  libblake2s_generic
[  502.789013]  nft_numgen
[  502.794996]  iptable_raw
[  502.798107]  nft_nat
[  502.800536]  iptable_nat
[  502.803047]  nft_meta_bridge nft_masq nft_log nft_limit nft_hash
[  502.805236]  iptable_mangle
[  502.807749]  nft_fwd_netdev
[  502.813733]  iptable_filter
[  502.816499]  nft_fib_inet
[  502.819273]  ipt_rpfilter
[  502.822043]  nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat
[  502.824664]  ipt_ECN
[  502.827264]  nfnetlink_queue
[  502.833852]  ip6table_raw
[  502.836013]  nfnetlink_log
[  502.838873]  ip6t_rpfilter
[  502.841471]  nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4
[  502.844178]  ip_tables
[  502.846864]  nf_nat_tftp
[  502.854834]  hwmon
[  502.857168]  nf_nat_snmp_basic
[  502.859683]  hid_generic
[  502.861675]  nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev
[  502.864730]  ebtables
[  502.867244]  nf_conntrack_tftp
[  502.874955]  ebt_vlan
[  502.877203]  nf_conntrack_snmp
[  502.880236]  ebt_stp
[  502.882488]  nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323
[  502.885542]  ebt_redirect
[  502.887710]  nf_conntrack_broadcast
[  502.897062]  ebt_pkttype
[  502.899655]  nf_conntrack_bridge
[  502.903131]  ebt_mark_m
[  502.905638]  nf_conncount
[  502.908844]  ebt_mark
[  502.911268]  lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw
[  502.913889]  ebt_limit
[  502.916144]  iptable_nat
[  502.924461]  ebt_among
[  502.926795]  iptable_mangle
[  502.929309]  ebt_802_3
[  502.931648]  iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables
[  502.934442]  crc_ccitt
[  502.936783]  hwmon
[  502.944582]  compat_xtables(O)
[  502.946914]  hid_generic
[  502.948911]  compat(O)
[  502.951940]  ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype ebt_mark_m
[  502.954476]  br_netfilter
[  502.956817]  ebt_mark
[  502.963665]  arptable_filter
[  502.966256]  ebt_limit
[  502.968512]  arpt_mangle
[  502.971369]  ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O)
[  502.973730]  arp_tables
[  502.976243]  br_netfilter
[  502.982744]  fuse
[  502.985164]  arptable_filter
[  502.987765]  cls_bpf
[  502.989673]  arpt_mangle
[  502.992546]  act_bpf
[  502.994707]  arp_tables
[  502.997222]  sch_tbf
[  502.999389]  fuse
[  503.001830]  sch_ingress
[  503.003989]  cls_bpf
[  503.005900]  sch_htb
[  503.008412]  act_bpf
[  503.010581]  sch_hfsc
[  503.012747]  sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32
[  503.014936]  em_u32
[  503.017191]  cls_tcindex
[  503.023189]  cls_u32
[  503.025249]  cls_route
[  503.027764]  cls_tcindex
[  503.029930]  cls_matchall
[  503.032285]  cls_route
[  503.034791]  cls_fw
[  503.037392]  cls_matchall
[  503.039732]  cls_flow
[  503.041828]  cls_fw
[  503.044420]  cls_basic
[  503.046675]  cls_flow
[  503.048757]  act_skbedit
[  503.051098]  cls_basic
[  503.053350]  act_mirred act_gact sg hid evdev
[  503.055885]  act_skbedit
[  503.058225]  ledtrig_gpio
[  503.062567]  act_mirred
[  503.065073]  cryptodev(O)
[  503.067675]  act_gact
[  503.070102]  xt_set
[  503.072715]  sg
[  503.074962]  ip_set_list_set
[  503.077044]  hid
[  503.078780]  ip_set_hash_netportnet
[  503.081653]  evdev
[  503.083468]  ip_set_hash_netport
[  503.086933]  ledtrig_gpio
[  503.088927]  ip_set_hash_netnet
[  503.092146]  cryptodev(O)
[  503.094739]  ip_set_hash_netiface
[  503.097859]  xt_set
[  503.100458]  ip_set_hash_net
[  503.103763]  ip_set_list_set
[  503.105836]  ip_set_hash_mac
[  503.108696]  ip_set_hash_netportnet
[  503.111554]  ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip
[  503.114434]  ip_set_hash_netport
[  503.117898]  ip_set_bitmap_port
[  503.127684]  ip_set_hash_netnet
[  503.130882]  ip_set_bitmap_ipmac
[  503.134014]  ip_set_hash_netiface
[  503.137125]  ip_set_bitmap_ip
[  503.140331]  ip_set_hash_net
[  503.143619]  ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh
[  503.146586]  ip_set_hash_mac
[  503.149445]  ip6t_ipv6header
[  503.154824]  ip_set_hash_ipportnet
[  503.157675]  ip6t_hbh
[  503.160535]  ip_set_hash_ipportip
[  503.163910]  ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common
[  503.166185]  ip_set_hash_ipport
[  503.169476]  ip6table_mangle
[  503.175718]  ip_set_hash_ipmark
[  503.178829]  ip6table_filter
[  503.181700]  ip_set_hash_ip
[  503.184812]  ip6_tables
[  503.187671]  ip_set_bitmap_port
[  503.190444]  ip6t_REJECT
[  503.192886]  ip_set_bitmap_ipmac
[  503.195996]  x_tables
[  503.198512]  ip_set_bitmap_ip
[  503.201714]  nf_reject_ipv6 nfsv4 nfsd nfs nfs_ssc
[  503.203988]  ip_set
[  503.206932]  bonding
[  503.211707]  ip6table_nat
[  503.213780]  ip6_gre
[  503.215948]  ip6t_NPT
[  503.218544]  ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel
[  503.220766]  ip6t_rt
[  503.223025]  tunnel6 tunnel4 rpcsec_gss_krb5
[  503.232570]  ip6t_mh
[  503.234736]  auth_rpcgss
[  503.238978]  ip6t_ipv6header
[  503.241147]  oid_registry
[  503.243673]  ip6t_hbh
[  503.246529]  tun
[  503.249131]  ip6t_frag
[  503.251385]  snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss
[  503.253229]  ip6t_eui64
[  503.255571]  snd_hwdep
[  503.261639]  ip6t_ah
[  503.264064]  snd_compress
[  503.266406]  nf_log_ipv6
[  503.268575]  snd_pcm
[  503.271178]  nf_log_common
[  503.273697]  snd_timer
[  503.275868]  ip6table_mangle
[  503.278556]  snd
[  503.280898]  ip6table_filter
[  503.283756]  soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp
[  503.285602]  ip6_tables
[  503.288462]  af_key
[  503.293755]  ip6t_REJECT
[  503.296181]  lockd
[  503.298264]  x_tables
[  503.300779]  sunrpc
[  503.302787]  nf_reject_ipv6
[  503.305037]  grace
[  503.307121]  nfsv4
[  503.309894]  isofs
[  503.311903]  nfsd
[  503.313896]  hfsplus
[  503.315893]  nfs
[  503.317803]  hfs
[  503.319972]  nfs_ssc
[  503.321795]  cdrom autofs4 dm_mirror dm_region_hash
[  503.323639]  bonding
[  503.325809]  dm_log
[  503.330655]  ip6_gre
[  503.332824]  dm_crypt dm_mod dax nls_utf8
[  503.334928]  ip_gre
[  503.337098]  nls_koi8_r
[  503.341081]  gre
[  503.343164]  nls_cp866 nls_cp1251 zram algif_skcipher
[  503.345614]  ifb
[  503.347438]  algif_rng
[  503.352470]  nat46(O)
[  503.354288]  algif_hash
[  503.356630]  sit
[  503.358885]  algif_aead
[  503.361325]  ipcomp6
[  503.363144]  af_alg
[  503.365572]  xfrm6_tunnel
[  503.367741]  arc4
[  503.369824]  esp6
[  503.372424]  leds_gpio xhci_plat_hcd xhci_pci xhci_mtk
[  503.374356]  ah6
[  503.376267]  xhci_hcd
[  503.381385]  xfrm4_tunnel
[  503.383203]  ahci
[  503.385459]  ipcomp
[  503.388061]  libahci
[  503.389971]  ah4
[  503.392053]  libata gpio_button_hotplug(O) xfs f2fs
[  503.394244]  ip6_tunnel
[  503.396069]  ext4
[  503.400916]  tunnel6
[  503.403344]  mbcache jbd2 btrfs xor
[  503.405275]  tunnel4
[  503.407444]  raid6_pq
[  503.410909]  rpcsec_gss_krb5
[  503.413077]  mii tpm rng_core crc32_generic
[  503.415354]  auth_rpcgss
[  503.418214] 
[  503.422383]  oid_registry
[  503.424901] CPU: 0 PID: 11 Comm: ksoftirqd/0 Tainted: G      D    O      5.10.109 #0
[  503.426372]  tun
[  503.428976] Stack :
[  503.436687]  snd_rawmidi
[  503.438506]  80d60000
[  503.440589]  snd_seq_device
[  503.443102]  00000000 c5ee0000 8008b3d8 80a80000 80a85be0 80be0000 80a85ba8
[  503.445392]  snd_pcm_oss
[  503.448165] 
[  503.455098]  snd_mixer_oss
[  503.457608]        
[  503.459087]  snd_hwdep
[  503.461773]  814619bc 80d40000 809ddab8 8143d530
[  503.463877]  snd_compress
[  503.466219]  80b697a7
[  503.470807]  snd_pcm
[  503.473407]  00000001 81461960 80bd33ec
[  503.475683]  snd_timer
[  503.477851]        
[  503.481675]  snd
[  503.484012]  00000000
[  503.486095]  soundcore
[  503.487919]  00000000
[  503.490175]  ovpn_dco(O)
[  503.492516]  809ddab8 00000001 0a000000 c0064fd1
[  503.494792]  xfrm_user
[  503.497308]  00000018
[  503.501907]  xfrm_ipcomp
[  503.504245]  20205d33
[  503.506500]  af_key
[  503.509015] 
[  503.511282]  lockd
[  503.513359]        
[  503.514839]  sunrpc
[  503.516836]  00000085
[  503.518918]  grace
[  503.521001]  81461835
[  503.523268]  isofs
[  503.525261]  ffffffff
[  503.527516]  hfsplus
[  503.529513]  ffffffff
[  503.531780]  hfs
[  503.533945]  00000000
[  503.536200]  cdrom
[  503.538023]  00000000
[  503.540278]  autofs4
[  503.542273]  00000000 809e0000
[  503.542288]        
[  503.544548]  dm_mirror
[  503.546716]  00000009
[  503.549749]  dm_region_hash
[  503.551830]  80b60000 00000001 00000000 00000008
[  503.554192]  dm_log
[  503.556447]  804d4010
[  503.559222]  dm_crypt
[  503.563809]  000fd7d7 00000001
[  503.563825]        
[  503.565912]  dm_mod
[  503.568166]  ...
[  503.570422]  dax
[  503.573453] 
[  503.573460] Call Trace:
[  503.573499] [<8000a8c8>] show_stack+0x30/0x100
[  503.573517] [<8041cb94>] dump_stack+0x9c/0xcc
[  503.575596]  nls_utf8
[  503.577686] [<800356e8>] __warn+0xc0/0x12c
[  503.579501]  nls_koi8_r
[  503.581333] [<800357b0>] warn_slowpath_fmt+0x5c/0xac
[  503.581365] [<800cb3b8>] smp_call_function_many_cond+0x438/0x454
[  503.582824]  nls_cp866
[  503.585258] [<800cb424>] smp_call_function+0x30/0x64
[  503.589668]  nls_cp1251
[  503.594005] [<80035154>] panic+0x12c/0x334
[  503.594021] [<8000ab9c>] die+0x120/0x128
[  503.596273]  zram
[  503.600349] [<8000d2dc>] emulate_load_store_insn+0x294/0x7b0
[  503.602783]  algif_skcipher
[  503.607720] [<8000d880>] do_ade+0x88/0x1b0
[  503.613698]  algif_rng
[  503.616042] [<80004194>] handle_adel_int+0x30/0x3c
[  503.620969]  algif_hash
[  503.623419] [<8069b8a0>] __build_skb+0x2c/0x80
[  503.623429] 
[  503.627503]  algif_aead
[  503.631402] ---[ end trace 7c005e2e6e53680d ]---
[  503.927859] Rebooting in 3 seconds..

EDIT2: Panic without huge networking load. Caused by wireguard server. It's the first time I see such an error.

[ 1558.661040] CPU 1 Unable to handle kernel paging request at virtual address 00000000, epc == 84ea095c, ra == 84ea1e3c
[ 1558.671661] Oops[#1]:
[ 1558.673931] CPU: 1 PID: 699 Comm: kworker/1:2 Tainted: G           O      5.10.109 #0
[ 1558.681769] Workqueue: wg-kex-wg0 wg_packet_handshake_receive_worker [wireguard]
[ 1558.689141] $ 0   : 00000000 00000001 00000000 00000001
[ 1558.694361] $ 4   : 84d6c000 84d6c000 00000000 f136e533
[ 1558.699597] $ 8   : 00000020 80438abc 534c3e6e 36f408da
[ 1558.704820] $12   : c45ac27a efb10c35 00000000 3c6cb16a
[ 1558.710030] $16   : 84d6c000 846d9000 89a1045c 89a105bc
[ 1558.715240] $20   : 89a10468 84d6c000 846d9050 846d9018
[ 1558.720450] $24   : 00000000 147e3192                  
[ 1558.725661] $28   : 822e6000 822e7da0 89a1058c 84ea1e3c
[ 1558.730892] Hi    : 22af8bfe
[ 1558.733770] Lo    : 4d58272d
[ 1558.736664] epc   : 84ea095c wg_noise_keypair_put+0xa4/0xc0 [wireguard]
[ 1558.743255] ra    : 84ea1e3c wg_noise_handshake_begin_session+0x1dc/0xedc [wireguard]
[ 1558.751049] Status: 1100fc03 KERNEL EXL IE 
[ 1558.755224] Cause : 40800008 (ExcCode 02)
[ 1558.759211] BadVA : 00000000
[ 1558.762075] PrId  : 0001992f (MIPS 1004Kc)
[ 1558.766146] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
[ 1558.766465]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype
[ 1558.853721]  ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsd nfs nfs_ssc bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
[ 1558.941298]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
[ 1559.079386] Process kworker/1:2 (pid: 699, threadinfo=04d072d2, task=51744774, tls=00000000)
[ 1559.087787] Stack : 846d9000 89a1045c 89a105bc 00000001 89a104a8 84ea1e3c 89a10410 89a10410
[ 1559.096133]         00000000 84ea7f10 00000020 00000020 00000000 00000000 89a1058c 653e7ac1
[ 1559.104472]         0000016a 00000000 81537cc0 89a10410 00000000 3b9a0000 00000020 00000000
[ 1559.112811]         00000040 89572ef0 84eb0000 84ea5ef0 812bdb20 812bdae0 80b070c0 fffffffe
[ 1559.121149]         89572e00 81537cc0 89572e28 89572ce0 00000020 00000000 00000040 fffffffe
[ 1559.129487]         ...
[ 1559.131930] Call Trace:
[ 1559.134391] [<84ea095c>] wg_noise_keypair_put+0xa4/0xc0 [wireguard]
[ 1559.140662] [<84ea1e3c>] wg_noise_handshake_begin_session+0x1dc/0xedc [wireguard]
[ 1559.148134] [<84ea5ef0>] wg_packet_send_keepalive+0xc30/0x1538 [wireguard]
[ 1559.155133] 
[ 1559.156630] Code: 27bd0018  8c820000  00802825 <8c420000> 0d3aa24a  8c440294  1000ffdb  26040498  03e00008 
[ 1559.166392] 
[ 1559.168041] ---[ end trace 5931e2babba7e005 ]---
[ 1559.311829] Kernel panic - not syncing: Fatal exception in interrupt
[ 1559.533089] Rebooting in 3 seconds..

EDIT3: I watched a movie via torrent on smartphone.

[ 6735.968701] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G           O      5.10.109 #0
[ 6735.976159] $ 0   : 00000000 00000001 0000005c 0000006a
[ 6735.981390] $ 4   : 00670000 00000a20 80699cf0 ffffffff
[ 6735.986608] $ 8   : 1e24fbf3 8c67c628 ef98e9b9 4e85e652
[ 6735.991820] $12   : 62bb56f1 4b8f26b4 748df442 00000000
[ 6735.997037] $16   : 81412a80 00000a20 80b6540c 00000000
[ 6736.002250] $20   : 80699cf0 80b60000 00000001 0107af44
[ 6736.007460] $24   : 00000000 803a1580                  
[ 6736.012672] $28   : 80b52000 8140b970 00000b8e 80699cf0
[ 6736.017883] Hi    : 00000002
[ 6736.020745] Lo    : 00000001
[ 6736.023637] epc   : 801a9db0 kmem_cache_alloc+0x1cc/0x3f8
[ 6736.029049] ra    : 80699cf0 __alloc_skb+0x5c/0x1fc
[ 6736.033916] Status: 11008403 KERNEL EXL IE 
[ 6736.038104] Cause : 40800010 (ExcCode 04)
[ 6736.042091] BadVA : 0000006a
[ 6736.044954] PrId  : 0001992f (MIPS 1004Kc)
[ 6736.049028] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
[ 6736.049351]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype
[ 6736.136599]  ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsd nfs nfs_ssc bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
[ 6736.224159]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
[ 6736.362235] Process swapper/0 (pid: 0, threadinfo=8ef7e1c1, task=b00a4071, tls=00000000)
[ 6736.370301] Stack : 80d80000 8008df64 00000001 80d80000 8140b988 80d42570 0000000e 80902914
[ 6736.378650]         80b65414 8c3eaa80 00000628 00000a20 806a30c8 00000000 81412a80 8b6c6308
[ 6736.386992]         00000000 80699cf0 00000000 80d40000 80ae2264 8c3ea6c0 8c3eaa80 8c3eaa80
[ 6736.395328]         000005ac 8c3ea6c0 0000007c 00000036 8c3eaa80 8b6c6308 00000000 806a30c8
[ 6736.403665]         8c3ea6c0 000005e2 8c67c07c 00000000 00000160 00000160 8c3ea6c0 8b6c62e0
[ 6736.412004]         ...
[ 6736.414443] Call Trace:
[ 6736.416908] [<801a9db0>] kmem_cache_alloc+0x1cc/0x3f8
[ 6736.421952] [<80699cf0>] __alloc_skb+0x5c/0x1fc
[ 6736.426489] [<806a30c8>] skb_segment+0x228/0xcf0
[ 6736.431115] [<807cd084>] tcp_gso_segment+0x118/0x5a0
[ 6736.436124] [<807e5008>] inet_gso_segment+0x174/0x3cc
[ 6736.441174] [<806bba24>] skb_mac_gso_segment+0xb4/0x130
[ 6736.446391] [<806bbb20>] __skb_gso_segment+0x80/0x1b8
[ 6736.451430] [<806bc08c>] validate_xmit_skb+0x90/0x248
[ 6736.456470] [<806bcbf4>] __dev_queue_xmit+0x340/0x574
[ 6736.461527] [<808be76c>] br_dev_queue_push_xmit+0x160/0x1e0
[ 6736.467085] [<808babf8>] br_dev_xmit+0x31c/0x4cc
[ 6736.471694] [<806bc6cc>] dev_hard_start_xmit+0x10c/0x1e8
[ 6736.477009] [<806bcdb0>] __dev_queue_xmit+0x4fc/0x574
[ 6736.482050] [<8079524c>] ip_finish_output2+0x1e4/0x574
[ 6736.487200] [<8078f658>] ip_sublist_rcv_finish+0x4c/0x70
[ 6736.492496] [<8078fe14>] ip_sublist_rcv+0x114/0x1a4
[ 6736.497363] [<80790e28>] ip_list_rcv+0xfc/0x128
[ 6736.501882] [<806bdef0>] __netif_receive_skb_list_core+0x17c/0x220
[ 6736.508045] [<806be1b0>] netif_receive_skb_list_internal+0x21c/0x318
[ 6736.514379] [<806bea34>] napi_complete_done+0x7c/0x264
[ 6736.519531] [<8070ed78>] gro_cell_poll+0x8c/0xb4
[ 6736.524136] [<806bec58>] __napi_poll+0x3c/0x15c
[ 6736.528662] [<806bef84>] net_rx_action+0xf0/0x21c
[ 6736.533364] [<80902a8c>] __do_softirq+0x164/0x368
[ 6736.538073] [<8003a524>] irq_exit+0xcc/0x12c
[ 6736.542344] [<8043a4ec>] plat_irq_dispatch+0x68/0xf0
[ 6736.547309] [<80003d08>] except_vec_vi_end+0xb8/0xc4
[ 6736.552261] [<80901e80>] r4k_wait_irqoff+0x1c/0x24
[ 6736.557055] [<800675c8>] do_idle+0xf0/0x190
[ 6736.561227] [<800678fc>] cpu_startup_entry+0x2c/0x34
[ 6736.566186] [<80c04c8c>] start_kernel+0x410/0x42c
[ 6736.570878] 
[ 6736.572361] Code: 02803025  8e02001c  00621821 <8c660000> 41656000  30a50001  000000c0  8f84000c  8e020000 
[ 6736.582125] 
[ 6736.583748] ---[ end trace 57164e69fc1b1eea ]---
[ 6736.727345] Kernel panic - not syncing: Fatal exception in interrupt
[ 6736.733710] ------------[ cut here ]------------
[ 6736.738341] WARNING: CPU: 0 PID: 0 at kernel/smp.c:633 smp_call_function_many_cond+0x438/0x454
[ 6736.746913] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda wireguard snd_usb_audio rndis_host mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length2(O) xt_length xt_ipv4options(O) xt_iprange xt_iface(O) xt_hl xt_helper xt_hashlimit xt_geoip(O) xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_bpf xt_addrtype xt_TRACE xt_TPROXY xt_TCPMSS xt_REDIRECT xt_PROTO(O) xt_NFQUEUE xt_NFLOG xt_NETMAP xt_MASQUERADE xt_LUA(O) xt_LOGMARK(O) xt_LOG xt_IPMARK(O) xt_HL xt_DSCP xt_DNETMAP(O) xt_DHCPMAC(O) xt_CT xt_CLASSIFY xt_CHECKSUM vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress
[ 6736.747242]  ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_ipv4 nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ECN ip6table_raw ip6t_rpfilter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype
[ 6736.834472]  ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables(O) compat(O) br_netfilter arptable_filter arpt_mangle arp_tables fuse cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_nat ip6t_NPT ip6t_rt ip6t_mh ip6t_ipv6header ip6t_hbh ip6t_frag ip6t_eui64 ip6t_ah nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsd nfs nfs_ssc bonding ip6_gre ip_gre gre ifb nat46(O) sit ipcomp6 xfrm6_tunnel esp6 ah6 xfrm4_tunnel ipcomp ah4 ip6_tunnel tunnel6 tunnel4
[ 6736.922008]  rpcsec_gss_krb5 auth_rpcgss oid_registry tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) xfrm_user xfrm_ipcomp af_key lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd ahci libahci libata gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 btrfs xor raid6_pq mii tpm rng_core crc32_generic
[ 6737.060056] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G      D    O      5.10.109 #0
[ 6737.067513] Stack : 80d60000 00000000 00000b8e 8008b3d8 80a80000 80a85be0 80be0000 80a85ba8
[ 6737.075856]         8140b6a4 80d40000 809ddab8 80b69cb0 80b697a7 00000001 8140b648 80bd33ec
[ 6737.084192]         00000000 00000000 809ddab8 8140b500 ffffefff 00000000 ffffffea 00000000
[ 6737.092534]         8140b4f0 00000799 80b6f3e0 2047203a 00000000 00000000 00000000 809e0000
[ 6737.100886]         00000009 80b60000 00000001 00000000 00000008 804d4010 000fd757 000fd797
[ 6737.109233]         ...
[ 6737.111673] Call Trace:
[ 6737.114135] [<8000a8c8>] show_stack+0x30/0x100
[ 6737.118571] [<8041cb94>] dump_stack+0x9c/0xcc
[ 6737.122911] [<800356e8>] __warn+0xc0/0x12c
[ 6737.126992] [<800357b0>] warn_slowpath_fmt+0x5c/0xac
[ 6737.131946] [<800cb3b8>] smp_call_function_many_cond+0x438/0x454
[ 6737.137931] [<800cb424>] smp_call_function+0x30/0x64
[ 6737.142873] [<80035154>] panic+0x12c/0x334
[ 6737.146964] [<8000ab9c>] die+0x120/0x128
[ 6737.150871] [<8000d2dc>] emulate_load_store_insn+0x294/0x7b0
[ 6737.156507] [<8000d880>] do_ade+0x88/0x1b0
[ 6737.160584] [<80004194>] handle_adel_int+0x30/0x3c
[ 6737.165362] [<80699cf0>] __alloc_skb+0x5c/0x1fc
[ 6737.169874] 
[ 6737.171359] ---[ end trace 57164e69fc1b1eeb ]---
[ 6737.568588] Rebooting in 3 seconds..
nbd168 commented 2 years ago

Which OpenWrt version are you using. Does your build include the openwrt commit 5e34b316c5b3bf06a1d748cb5569d28b8334820f?

Vladdrako commented 2 years ago

Which OpenWrt version are you using. Does your build include the openwrt commit 5e34b316c5b3bf06a1d748cb5569d28b8334820f?

Own build with all the latest changes. Yes, the latest version of mt76.

Vladdrako commented 2 years ago

On kernel 5.15 same.

[ 4397.715963] Unhandled kernel unaligned access[#1]:
[ 4397.720803] CPU: 0 PID: 1685 Comm: napi/phy1-9 Tainted: G           O      5.15.34 #0
[ 4397.728622] $ 0   : 00000000 00000001 0000006a 00670000
[ 4397.733873] $ 4   : 81412e00 00000a20 00000001 00000000
[ 4397.739115] $ 8   : 003fb088 84f986f4 3041277c 8962d8e2
[ 4397.744360] $12   : 7c9b3bb5 1f938c86 17d4419c 00000000
[ 4397.749605] $16   : 00000a20 80d60000 81412e00 00000000
[ 4397.754849] $20   : 0000000e 80b5d434 8067cfa0 80b60000
[ 4397.760097] $24   : 00000000 8039e768                  
[ 4397.765376] $28   : 839cc000 839cd518 89531f28 801b5774
[ 4397.770621] Hi    : 00000002
[ 4397.773498] Lo    : 00000001
[ 4397.776367] epc   : 801b5814 kmem_cache_alloc+0xe8/0x5c8
[ 4397.781710] ra    : 801b5774 kmem_cache_alloc+0x48/0x5c8
[ 4397.787023] Status: 11000403 KERNEL EXL IE 
[ 4397.791220] Cause : 40800010 (ExcCode 04)
[ 4397.795220] BadVA : 0000006a
[ 4397.798093] PrId  : 0001992f (MIPS 1004Kc)
[ 4397.802180] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda pppoe ppp_async wireguard snd_usb_audio rndis_host pptp pppox ppp_mppe ppp_generic mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_quota xt_pkttype xt_owner xt_multiport xt_mark xt_mac xt_limit xt_comment xt_cgroup xt_addrtype xt_TCPMSS xt_LOG vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib slhc sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6
[ 4397.802924]  nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_syslog nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_mangle iptable_filter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat(O) cls_flower arptable_filter arpt_mangle arp_tables act_vlan fuse ntfs3 cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsd nfs bonding ip6_gre ip_gre gre ifb nat46(O) sit
[ 4397.890374]  ip6_tunnel tunnel6 tunnel4 udp_diag raw_diag rpcsec_gss_krb5 auth_rpcgss tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio ohci_platform ohci_hcd ahci libahci libata fsl_mph_dr_of ehci_platform ehci_fsl ehci_hcd gpio_button_hotplug(O) xfs f2fs ext4 mbcache jbd2 exfat btrfs xor raid6_pq dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax mii tpm rng_core
[ 4398.030827] Process napi/phy1-9 (pid: 1685, threadinfo=47a22270, task=e16e555e, tls=00000000)
[ 4398.039363] Stack : 00000002 00000001 816c8e40 8067b680 80c2b540 816c8e40 000006f4 00000a20
[ 4398.047757]         80687784 00000000 81412e00 00000000 0000c7d2 8067cfa0 0000000d 80d30000
[ 4398.056144]         80ad6f18 80d60000 816c8e40 816c8e40 838298b8 00000140 000005b4 00000036
[ 4398.064534]         816c8e40 00000000 0000c7d2 80687784 838298b8 0000c21e 84f98140 00000000
[ 4398.072932]         80b60000 84586af4 00000000 00000110 00000036 000005b4 0000010a 00000011
[ 4398.081320]         ...
[ 4398.083771] Call Trace:
[ 4398.086208] [<801b5814>] kmem_cache_alloc+0xe8/0x5c8
[ 4398.091203] [<8067cfa0>] __alloc_skb+0x15c/0x1fc
[ 4398.095833] [<80687784>] skb_segment+0x1e8/0xd18
[ 4398.100465] [<807c07d0>] tcp_gso_segment+0x118/0x5a0
[ 4398.105461] [<807d911c>] inet_gso_segment+0x174/0x3cc
[ 4398.110526] [<8069f1b8>] skb_mac_gso_segment+0xb4/0x130
[ 4398.115780] [<8069f2b4>] __skb_gso_segment+0x80/0x1b8
[ 4398.120832] [<8069f920>] validate_xmit_skb.constprop.0+0x13c/0x334
[ 4398.127010] [<806a0618>] __dev_queue_xmit+0x4ac/0xd04
[ 4398.132058] [<808b0590>] br_dev_queue_push_xmit+0x7c/0x198
[ 4398.137568] [<808acae0>] br_dev_xmit+0x304/0x50c
[ 4398.142187] [<8069ff84>] dev_hard_start_xmit+0x10c/0x1e8
[ 4398.147500] [<806a0cc8>] __dev_queue_xmit+0xb5c/0xd04
[ 4398.152546] [<807871d4>] ip_finish_output2+0x2bc/0x67c
[ 4398.157708] [<807896bc>] __ip_queue_xmit+0x1a8/0x4b0
[ 4398.162675] [<807ad3dc>] __tcp_transmit_skb+0x578/0xd6c
[ 4398.167894] [<807af21c>] tcp_write_xmit+0x3f8/0x11dc
[ 4398.172855] [<807b0044>] __tcp_push_pending_frames+0x44/0x110
[ 4398.178594] [<807a8b8c>] tcp_rcv_established+0x30c/0x7f8
[ 4398.183927] [<807b6ab8>] tcp_v4_do_rcv+0x1f0/0x2b4
[ 4398.188717] [<807b9f38>] tcp_v4_rcv+0xd44/0xe58
[ 4398.193247] [<80782718>] ip_protocol_deliver_rcu+0x4c/0x3cc
[ 4398.198818] [<80782b00>] ip_local_deliver_finish+0x68/0x88
[ 4398.204301] [<806a45e4>] __netif_receive_skb_one_core+0x44/0x54
[ 4398.210213] [<806a467c>] netif_receive_skb+0x4c/0x12c
[ 4398.215260] [<808b2e7c>] br_handle_frame_finish+0x1a0/0x51c
[ 4398.220835] [<808b36c8>] br_handle_frame+0x4d0/0x554
[ 4398.225801] [<806a1928>] __netif_receive_skb_core.constprop.0+0x2ac/0xfb0
[ 4398.232577] [<806a2714>] __netif_receive_skb_list_core+0xe8/0x220
[ 4398.238666] [<806a2a0c>] netif_receive_skb_list_internal+0x1c0/0x2e0
[ 4398.245011] [<806a3f80>] napi_gro_receive+0xb8/0x1ec
[ 4398.249982] [<844c4e44>] mt76_rx_complete+0x218/0x28c [mt76]
[ 4398.255681] [<844c51c8>] mt76_rx_poll_complete+0x310/0x5fc [mt76]
[ 4398.261792] [<844c1af4>] mt76_dma_rx_poll+0x3b4/0x7b8 [mt76]
[ 4398.267472] [<8416c8e4>] mt7615_unregister_device+0x270/0x328 [mt7615e]
[ 4398.274211] 
[ 4398.275700] Code: 00000000  8e42001c  02821021 <8c470000> 41656000  30a50001  000000c0  8f84000c  8e420000 
[ 4398.285501] 
[ 4398.287663] ---[ end trace 6f2662d58ee782bd ]---
[ 4398.320199] Kernel panic - not syncing: Fatal exception in interrupt
[ 4398.350776] Rebooting in 3 seconds..
Toon2 commented 2 years ago

Same Issues here. Cudy WR2100 I think the crashes started with OpenWRT 21.02.2 Reboots under heavy load, but sometimes by idle conditions. Apr 11 17:44:07 OpenWrt kernel: [1960419.761219] BUG: Bad page state in process swapper/0 pfn:0723b Today updated to 21.02.3 - after 4 hours crash and reboot - but nothing in logs.

Vladdrako commented 2 years ago
[11288.958900] CPU 3 Unable to handle kernel paging request at virtual address 00000104, epc == 801bc350, ra == 801bc078
[11288.969533] Oops[#1]:
[11288.971815] CPU: 3 PID: 346 Comm: napi/mtk_eth-6 Tainted: G           O      5.15.36 #0
[11288.979800] $ 0   : 00000000 00000001 00000122 00000100
[11288.985046] $ 4   : fffffffe 00000000 806a5438 812f0ba0
[11288.990288] $ 8   : 00f436fb 00000040 00000039 00227432
[11288.995529] $12   : 81524120 84548e44 4f357d0d 00000000
[11289.000770] $16   : 80e29ed4 00000000 812f0ba0 81413e00
[11289.006011] $20   : 80150015 00150015 81412e00 00000001
[11289.011252] $24   : 00000010 803a6a94                  
[11289.016491] $28   : 8163e000 8163fcf8 80d90000 801bc078
[11289.021733] Hi    : 00000000
[11289.024603] Lo    : 00000041
[11289.027473] epc   : 801bc350 ___slab_alloc.constprop.0+0x4f4/0x6d8
[11289.033678] ra    : 801bc078 ___slab_alloc.constprop.0+0x21c/0x6d8
[11289.039849] Status: 1100fc02 KERNEL EXL 
[11289.043775] Cause : 4080000c (ExcCode 03)
[11289.047771] BadVA : 00000104
[11289.050641] PrId  : 0001992f (MIPS 1004Kc)
[11289.054723] Modules linked in: ksmbd(O) nf_nat_amanda nf_conntrack_amanda pppoe ppp_async wireguard snd_usb_audio rndis_host pptp pppox ppp_mppe ppp_generic mt7615e(O) mt7615_common(O) mt76_connac_lib(O) mt76(O) mac80211(O) lz4 libblake2s ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211(O) cdc_ether xt_time xt_tcpudp xt_state xt_socket xt_recent xt_quota xt_pkttype xt_owner xt_nat xt_multiport xt_mark xt_mac xt_limit xt_iprange xt_helper xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_cgroup xt_addrtype xt_TPROXY xt_TCPMSS xt_REDIRECT xt_MASQUERADE xt_LOG xt_CT vhci_hcd usbnet usbip_host usbip_core usbhid ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress ums_alauda ts_kmp ts_fsm ts_bm snd_usbmidi_lib slhc sch_cake nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log
[11289.055470]  nft_limit nft_hash nft_fwd_netdev nft_fib_inet nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_log_syslog nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_broadcast nf_conntrack_bridge nf_conncount mdio_netlink(O) lz4_decompress lz4_compress libchacha20poly1305 libblake2s_generic iptable_raw iptable_nat iptable_mangle iptable_filter ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat(O) cls_flower arptable_filter arpt_mangle arp_tables act_vlan fuse ntfs3 cls_bpf act_bpf sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic
[11289.142745]  act_skbedit act_mirred act_gact sg hid evdev ledtrig_gpio cryptodev(O) xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 nfsv4 nfsd nfs bonding ip6_gre ip_gre gre ifb nat46(O) sit ip6_tunnel tunnel6 tunnel4 udp_diag raw_diag rpcsec_gss_krb5 auth_rpcgss tun snd_rawmidi snd_seq_device snd_pcm_oss snd_mixer_oss snd_hwdep snd_compress snd_pcm snd_timer snd soundcore ovpn_dco(O) lockd sunrpc grace isofs hfsplus hfs cdrom autofs4 nls_utf8 nls_koi8_r nls_cp866 nls_cp1251 zram algif_skcipher algif_rng algif_hash algif_aead af_alg arc4 leds_gpio ohci_platform ohci_hcd ahci libahci libata fsl_mph_dr_of ehci_platform ehci_fsl gpio_button_hotplug(O) xfs f2fs ext4
[11289.229943]  mbcache jbd2 exfat btrfs xor raid6_pq dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax mii tpm rng_core
[11289.327498] Process napi/mtk_eth-6 (pid: 346, threadinfo=d2a64ece, task=7ca34ad7, tls=00000000)
[11289.336187] Stack : 892ac400 892ac48c 0000000e 00000010 00000000 808646d0 837db000 00000000
[11289.344574]         80da0000 80150015 812eceac 89d6b780 80d9fa80 80867644 80b87438 80a04360
[11289.352961]         00000a20 80d90000 81412e00 00000000 00000000 80b87438 806a5438 80b80000
[11289.361347]         0000015b 801bc570 80c572e8 00000a20 806a5438 806c95b8 00000a20 801bd690
[11289.369733]         80d90000 00000040 81524010 0000081e 0c8be420 8612e3e0 8612e3e0 00000960
[11289.378119]         ...
[11289.380568] Call Trace:
[11289.383004] [<801bc350>] ___slab_alloc.constprop.0+0x4f4/0x6d8
[11289.388855] [<801bc570>] __slab_alloc.constprop.0+0x3c/0x90
[11289.394424] [<801bd690>] kmem_cache_alloc+0x4cc/0x5c8
[11289.399468] [<806a5438>] __build_skb+0x2c/0x70
[11289.403911] [<806a5498>] build_skb+0x1c/0xb4
[11289.408178] [<805e5c14>] mtk_napi_rx+0x380/0x7f4
[11289.412819] [<806c861c>] __napi_poll+0x3c/0x19c
[11289.417372] [<806c8830>] napi_threaded_poll+0xb4/0x114
[11289.422508] [<80059b0c>] kthread+0x17c/0x1a0
[11289.426788] [<8000378c>] ret_from_kernel_thread+0x14/0x1c
[11289.432189] 
[11289.433677] Code: af820010  8e020008  8e030004  ac430000  24020100  ae020004  24020122  ae020008 
[11289.443470] 
[11289.445346] ---[ end trace b8bd054b852d3bdb ]---
[11289.476671] Kernel panic - not syncing: Fatal exception in interrupt
[11289.507175] Rebooting in 3 seconds..
ryderlee1110 commented 2 years ago

@Vladdrako Can you enable CONFIG_KASAN and paste the output here?

mgkiller7 commented 2 years ago

i also account the similar kernel fault in openwrt 21.02 with mt7621 when doing iperf3 through ipsec ethernet.

Kernel Fault Type 1、BUG: Bad page state do_softirq-> net_rx_action->napi_poll->mtk_napi_rx->page_frag_alloc->...->get_page_from_freelist 2、CPU 2 Unable to handle kernel paging request do_softirq-> net_rx_action->napi_poll->gro_cell_poll->napi_complete_done-> ... ->kmem_cache_alloc 3、CPU 2 Unable to handle kernel paging request do_softirq-> net_rx_action->__napi_poll->gro_cell_poll->napi_gro_receive-> ... ->kmalloc 4、CPU 2 Unable to handle kernel paging request do_softirq-> net_rx_action->__napi_poll->gro_cell_poll->napi_complete_done-> ... ->kmalloc 5、CPU 2 Unable to handle kernel paging request mtk_irq_clear->mtk_aead_handle_result->mtk_unmap_dma 6、CPU 0 Unable to handle kernel paging request gro_normal_list->gro_normal_one 7、CPU 0 Unable to handle kernel paging request __do_softirq->net_rx_action->__napi_poll->mtk_napi_tx->gro_normal_one

Detail info of each kernel fault:

[ 1353.863451] BUG: Bad page state in process ksoftirqd/0 pfn:00b38 [ 1353.869543] page:80f893e0 refcount:-3 mapcount:0 mapping:00000000 index:0x0 [ 1353.876471] flags: 0x0() [ 1353.879003] raw: 00000000 00000100 00000122 00000000 00000000 00000000 ffffffff fffffffd [ 1353.887053] raw: 00000000 [ 1353.889657] page dumped because: nonzero _refcount [ 1353.894420] Modules linked in: crypto_user pcrypt crypto_hw_eip93 mt76x2e mt76x2_common mt76x02_lib mt7603e mt76 mac80211 cfg80211 compat xt_CT iptable_raw [last unloaded: crypto_user] [ 1353.910805] CPU: 0 PID: 9 Comm: ksoftirqd/0 Not tainted 5.4.179 #20 [ 1353.917038] Stack : 00000000 00000000 00000195 80068d98 00000000 80650000 80600000 8058dfcc [ 1353.925362] 8060715c 8fc5db24 80f60000 00000000 80650000 00000001 8fc5dab8 06d760c7 [ 1353.933685] 00000000 00000000 80f70000 80650000 00000000 00000000 00000196 00000000 [ 1353.942005] 00000000 3649c879 80f60000 666f736b 80650000 00000000 00000000 8059f79c [ 1353.950327] 00000201 8fc5dca8 80f893e0 00000001 00000002 802ab940 00000000 80f30000 [ 1353.958648] ... [ 1353.961082] Call Trace: [ 1353.963537] [<8000b0d8>] show_stack+0x6c/0x12c [ 1353.967978] [<80500d30>] dump_stack+0xa0/0xcc [ 1353.972322] [<8011cafc>] bad_page+0x114/0x144 [ 1353.976667] [<8011f9d0>] get_page_from_freelist+0x7c0/0xa44 [ 1353.982218] [<80120afc>] alloc_pages_nodemask+0x9f4/0xb4c [ 1353.987767] [<80120d84>] page_frag_alloc+0x48/0x170 [ 1353.992639] [<803050bc>] mtk_napi_rx+0x1f4/0x600 [ 1353.997244] [<803a94f8>] napi_poll+0x40/0x130 [ 1354.001756] [<803a9830>] net_rx_action+0x10c/0x254 [ 1354.006537] [<8051d99c>] __do_softirq+0x15c/0x2f0 [ 1354.011225] [<80027b6c>] run_ksoftirqd+0x44/0x60 [ 1354.015837] [<8004497c>] smpboot_thread_fn+0x1b8/0x1e8 [ 1354.020967] [<800410f8>] kthread+0x118/0x120 [ 1354.025221] [<80005f98>] ret_from_kernel_thread+0x14/0x1c [ 1354.030598] Disabling lock debugging due to kernel taint [ 1354.036390] CPU 0 Unable to handle kernel paging request at virtual address 00000000, epc == 803a8658, ra == 803a8edc [ 1354.047016] Oops[#1]: [ 1354.049291] CPU: 0 PID: 9 Comm: ksoftirqd/0 Tainted: G B 5.4.179 #20 [ 1354.056910] $ 0 : 00000000 00000001 00000000 00000000 [ 1354.062117] $ 4 : 8ffc56d0 8ffc5750 00000001 8ffc5750 [ 1354.067321] $ 8 : 0000c95c 00006617 8fdbfa10 0000061e [ 1354.072525] $12 : 00000024 ffffff7f 80f60000 80f60000 [ 1354.077729] $16 : 8ffc5750 00000003 8ffc56d0 a0ab28d0 [ 1354.082934] $20 : 00000003 8fc34000 00000040 080abfff [ 1354.088137] $24 : 00000003 8001c930
[ 1354.093341] $28 : 8fc5c000 8fc5dd18 8ffc5750 803a8edc [ 1354.098546] Hi : 00000000 [ 1354.101408] Lo : 00000000 [ 1354.104288] epc : 803a8658 gro_normal_one+0x14/0x48 [ 1354.109318] ra : 803a8edc napi_gro_receive+0x74/0xd4 [ 1354.114513] Status: 11008403 KERNEL EXL IE [ 1354.118679] Cause : 4080000c (ExcCode 03) [ 1354.122663] BadVA : 00000000 [ 1354.125526] PrId : 0001992f (MIPS 1004Kc) [ 1354.129598] Modules linked in: crypto_user pcrypt crypto_hw_eip93 mt76x2e mt76x2_common mt76x02_lib mt7603e mt76 mac80211 cfg80211 compat xt_CT iptable_raw [last unloaded: crypto_user] [ 1354.145986] Process ksoftirqd/0 (pid: 9, threadinfo=bf8c27fa, task=4e7db4c9, tls=00000000) [ 1354.154205] Stack : 8ffc508c 80303c44 8149a970 06d760c7 8ffc56d0 8ffc556c 8ffc5080 80305284 [ 1354.162529] 8ffc5080 06d760c7 00000000 8fce3100 00000000 8fe213c0 806553b4 00000001 [ 1354.170851] 80b7f8a0 0000008d 000017a8 c5ea0000 00000234 000005ea 00b7f8e0 90430855 [ 1354.179172] deadbef3 00000000 8ffc55ee 805d8a74 00000000 00000000 00000000 00000000 [ 1354.187494] 00000000 00000000 8ffc56d0 00000040 00000000 8fc5de03 80650000 80650000 [ 1354.195816] ... [ 1354.198249] Call Trace: [ 1354.200684] [<803a8658>] gro_normal_one+0x14/0x48 [ 1354.205369] Code: ac850084 aca70000 aca20004 8c820088 00c23021 3c028065 ac860088 8c425970 [ 1354.215082] [ 1354.216965] ---[ end trace f5a278cc9d00b6e1 ]--- [ 1354.221620] Kernel panic - not syncing: Fatal exception in interrupt

[ 2971.049112] CPU 2 Unable to handle kernel paging request at virtual address 00000070, epc == 803a653c, ra == 803a6848 [ 2971.049221] Unhandled kernel unaligned access[#1]: [ 2971.064457] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.4.179 #20 [ 2971.070518] $ 0 : 00000000 00000001 71540081 806553b4 [ 2971.075723] $ 4 : 8fce3300 00000a20 00664000 80650000 [ 2971.080928] $ 8 : 8fe8e480 004005b8 000005b8 00bca200 [ 2971.086132] $12 : 0f0a00a8 0000000c 00000000 8ed02400 [ 2971.091335] $16 : 71540081 8fce3300 00000a20 00000000 [ 2971.096539] $20 : 814971e0 806553b4 000000a4 fffffffe [ 2971.101743] $24 : 00000000 8001cbb4
[ 2971.106946] $28 : 80642000 8fc0dba8 8fc0dd7c 80126824 [ 2971.112154] Hi : 00000000 [ 2971.115015] Lo : 0000002f [ 2971.117907] epc : 80126820 kmem_cache_alloc+0x164/0x1c4 [ 2971.123282] ra : 80126824 kmem_cache_alloc+0x168/0x1c4 [ 2971.128649] Status: 11008403 KERNEL EXL IE [ 2971.132815] Cause : c0800010 (ExcCode 04) [ 2971.136800] BadVA : 71540081 [ 2971.139662] PrId : 0001992f (MIPS 1004Kc) [ 2971.143733] Modules linked in: crypto_user pcrypt crypto_hw_eip93 mt76x2e mt76x2_common mt76x02_lib mt7603e mt76 mac80211 cfg80211 compat xt_CT iptable_raw [ 2971.157615] Process swapper/0 (pid: 0, threadinfo=d2b9bd1b, task=ac9a591f, tls=00000000) [ 2971.165662] Stack : 00000010 8ef44400 fffffffc 8038d984 806786bc 00000000 8fe8e480 00000002 [ 2971.173985] 00000000 80673d80 8fe8e480 8038e94c 80f6ce6c 804ac994 00000000 00000000 [ 2971.182306] 8fe8e600 806786bc 00000000 00000000 00000002 00000000 80673d80 804bcc44 [ 2971.190627] 640d10ac 8f632b80 8fc0dc98 4f3d2f36 00000003 806786bc 00000032 804bd050 [ 2971.198948] 8f632b80 8fc0dc98 00000001 8040de78 8fc0dc98 00000001 80673d80 80650000 [ 2971.207271] ... [ 2971.209705] Call Trace: [ 2971.212142] [<80126820>] kmem_cache_alloc+0x164/0x1c4 [ 2971.217188] [<8038e94c>] skb_ext_add+0x100/0x170 [ 2971.221793] [<804bcc44>] secpath_set+0x20/0x60 [ 2971.226218] [<804bd050>] xfrm_input+0x184/0xeec [ 2971.230738] [<804b0d78>] xfrm4_esp_rcv+0x38/0x78 [ 2971.235340] [<8044184c>] ip_protocol_deliver_rcu+0xe8/0x288 [ 2971.240888] [<80441a3c>] ip_local_deliver_finish+0x50/0x60 [ 2971.246350] [<80440f14>] ip_sublist_rcv_finish+0x58/0x7c [ 2971.251639] [<804410c8>] ip_sublist_rcv+0x190/0x1d4 [ 2971.256496] [<80441c8c>] ip_list_rcv+0xec/0x12c [ 2971.261014] [<803a833c>] netif_receive_skb_list_core+0xf0/0x12c [ 2971.267082] [<803a858c>] netif_receive_skb_list_internal+0x214/0x260 [ 2971.273408] [<803a8620>] gro_normal_list+0x2c/0x50 [ 2971.278180] [<803a91a4>] napi_complete_done+0x88/0x170 [ 2971.283315] [<803e70e0>] gro_cell_poll+0x90/0xb0 [ 2971.287914] [<803a94f8>] napi_poll+0x40/0x130 [ 2971.292426] [<803a9830>] net_rx_action+0x10c/0x254 [ 2971.297208] [<8051d99c>] __do_softirq+0x15c/0x2f0 [ 2971.301896] [<80027de0>] irq_exit+0x88/0xa4 [ 2971.306065] [<80255e60>] plat_irq_dispatch+0x68/0xcc [ 2971.311014] [<800064a8>] except_vec_vi_end+0xb8/0xc4 [ 2971.315968] [<8004c480>] do_idle+0xe4/0x174 [ 2971.320136] [<8004c748>] cpu_startup_entry+0x24/0x2c [ 2971.325084] [<8067bd64>] start_kernel+0x580/0x5c4 [ 2971.329768] Code: 8e220014 02021021 0c048dbf <8c540000> 8f86000c 8e230000 00063080 00d53021 00602821 [ 2971.339483] [ 2971.340965] Oops[#2]:

[ 131.873270] CPU 0 Unable to handle kernel paging request at virtual address 2a837fc4, epc == 80126d64, ra == 80126d6c [ 131.873300] CPU 2 Unable to handle kernel paging request at virtual address 00000000, epc == 8f3d19a4, ra == 8f3d1998 [ 131.883903] Oops[#1]: [ 131.896692] CPU: 0 PID: 9 Comm: ksoftirqd/0 Not tainted 5.4.179 #20 [ 131.902928] $ 0 : 00000000 00000001 2a837fc4 806553b4 [ 131.908133] $ 4 : 8fc02b00 00000a20 00664000 80650000 [ 131.913337] $ 8 : 027af41e 00000002 80ac3e04 f21fadc3 [ 131.918541] $12 : 00000032 80673d80 00000000 8083e400 [ 131.923745] $16 : 2a837fc4 8fc02b00 00000a20 00000000 [ 131.928949] $20 : 814958b0 806553b4 0000f273 00000000 [ 131.934152] $24 : 00000000 8001cbb4
[ 131.939356] $28 : 8fc5c000 8fc5dac8 8ec4c240 80126d6c [ 131.944561] Hi : 00000000 [ 131.947422] Lo : 0000002f [ 131.950313] epc : 80126d64 kmalloc+0x1bc/0x224 [ 131.955083] ra : 80126d6c kmalloc+0x1c4/0x224 [ 131.959846] Status: 11008403 KERNEL EXL IE [ 131.964011] Cause : c0800008 (ExcCode 02) [ 131.967996] BadVA : 2a837fc4 [ 131.970858] PrId : 0001992f (MIPS 1004Kc) [ 131.974929] Modules linked in: crypto_user pcrypt crypto_hw_eip93 mt76x2e mt76x2_common mt76x02_lib mt7603e mt76 mac80211 cfg80211 compat xt_CT iptable_raw [ 131.988810] Process ksoftirqd/0 (pid: 9, threadinfo=b57944ff, task=0d29e7b3, tls=00000000) [ 131.997029] Stack : 00000010 8ec07400 fffffffc 8038d984 8f6da180 8f7d4000 00000001 000005bc [ 132.005351] 8ec4c220 80650000 00000010 804a8a60 80f6ce6c 804ac994 00000000 00000003 [ 132.013673] 8f6da240 000005ac 00000008 80650000 00000007 21a90207 8ec4c220 00000032 [ 132.021994] 00000000 00000002 00000000 00000000 8f6da180 00000000 8ec4c240 804bd2d8 [ 132.030316] 8f66fb80 8fc5dbb8 00000001 8040de78 00000032 00000002 80673d80 80650000 [ 132.038636] ... [ 132.041071] Call Trace: [ 132.043507] [<80126d64>] kmalloc+0x1bc/0x224 [ 132.047954] [<804a8a60>] esp_input+0x144/0x30c [ 132.052386] [<804bd2d8>] xfrm_input+0x40c/0xeec [ 132.056906] [<804b0d78>] xfrm4_esp_rcv+0x38/0x78 [ 132.061509] [<8044184c>] ip_protocol_deliver_rcu+0xe8/0x288 [ 132.067059] [<80441a3c>] ip_local_deliver_finish+0x50/0x60 [ 132.072521] [<80440f14>] ip_sublist_rcv_finish+0x58/0x7c [ 132.077811] [<804410c8>] ip_sublist_rcv+0x190/0x1d4 [ 132.082669] [<80441c8c>] ip_list_rcv+0xec/0x12c [ 132.087188] [<803a833c>] netif_receive_skb_list_core+0xf0/0x12c [ 132.093257] [<803a858c>] netif_receive_skb_list_internal+0x214/0x260 [ 132.099583] [<803a8620>] gro_normal_list+0x2c/0x50 [ 132.104355] [<803a8edc>] napi_gro_receive+0x74/0xd4 [ 132.109232] [<803e70c0>] gro_cell_poll+0x70/0xb0 [ 132.113831] [<803a94f8>] napi_poll+0x40/0x130 [ 132.118344] [<803a9830>] net_rx_action+0x10c/0x254 [ 132.123128] [<8051d99c>] do_softirq+0x15c/0x2f0 [ 132.127818] [<80027b6c>] run_ksoftirqd+0x44/0x60 [ 132.132431] [<8004497c>] smpboot_thread_fn+0x1b8/0x1e8 [ 132.137562] [<800410f8>] kthread+0x118/0x120 [ 132.141819] [<80005f98>] ret_from_kernel_thread+0x14/0x1c [ 132.147193] Code: 00000000 8e220014 02021021 <0c048dbf> 8c540000 8f86000c 8e230000 00063080 00d53021

[ 1049.449978] CM_ERROR=2056b480 COH_RD_ERR <CCA=5 TR=mmio MCmd=Coherent Read Share STag=0 SPort=0 [ 1049.449978] > [ 1049.449993] CPU 2 Unable to handle kernel paging request at virtual address 00000000, epc == 80a119a4, ra == 80a11998 [ 1049.450009] Oops[#1]: [ 1049.460218] CM_ADDR =1f0a10a8 [ 1049.470772] CPU: 2 PID: 0 Comm: swapper/2 Not tainted 5.4.179 #20 [ 1049.473019] CM_OTHER=00000004 COH_RD_ERR [ 1049.475963] $ 0 : 00000000 00000001 00000001 00000002 [ 1049.482019] Data bus error, epc == 8000d064, ra == 8000d058 [ 1049.485910] $ 4 : fffffffc 00000000 00000001 00000000 [ 1049.501827] $ 8 : 00000020 8051911c 00000001 bf0704a7 [ 1049.507030] $12 : c994aadf 00000000 00000000 b1becea7 [ 1049.512234] $16 : 8ecc0180 000005b8 00000000 8ecc0280 [ 1049.517438] $20 : 00000000 00000001 00000000 8ecc0100 [ 1049.522641] $24 : 00000000 804a812c
[ 1049.527845] $28 : 8fc64000 8fc11e78 00000000 80a11998 [ 1049.533050] Hi : 00000004 [ 1049.535911] Lo : 00000000 [ 1049.538789] epc : 80a119a4 mtk_unmap_dma+0x130/0x1ac [crypto_hw_eip93] [ 1049.545461] ra : 80a11998 mtk_unmap_dma+0x124/0x1ac [crypto_hw_eip93] [ 1049.552126] Status: 11007c03 KERNEL EXL IE [ 1049.556291] Cause : 40800008 (ExcCode 02) [ 1049.560275] BadVA : 00000000 [ 1049.563138] PrId : 0001992f (MIPS 1004Kc) [ 1049.567210] Modules linked in: crypto_user pcrypt crypto_hw_eip93 mt76x2e mt76x2_common mt76x02_lib mt7603e mt76 mac80211 cfg80211 compat xt_CT iptable_raw [ 1049.581090] Process swapper/2 (pid: 0, threadinfo=600b5280, task=edcdbe7a, tls=00000000) [ 1049.589137] Stack : 00000000 8ecc0100 00000000 00000000 8ecc0100 00000000 80b63680 8ecc0180 [ 1049.597458] 40000000 00000001 00000000 80a126c4 00000001 80a10ce4 ffffff80 02000000 [ 1049.605780] 40000000 80b63680 00000001 ffffff80 02000000 80a10310 00000000 6abbfce1 [ 1049.614103] 00000000 80647d20 00000000 80a13150 0000000a 008005b8 80b63b84 814a9250 [ 1049.622426] 00000006 00000000 80646040 00000007 0000000a 00000040 80646058 80027fb0 [ 1049.630751] ... [ 1049.633187] Call Trace: [ 1049.635628] [<80a119a4>] mtk_unmap_dma+0x130/0x1ac [crypto_hw_eip93] [ 1049.641964] [<80a126c4>] mtk_aead_handle_result+0x40/0x80c [crypto_hw_eip93] [ 1049.648985] [<80a10310>] mtk_irq_clear+0x23c/0x9e4 [crypto_hw_eip93] [ 1049.655309] Code: 8e140030 0040a821 2404fffc <8e820000> 0c042404 00822024 8e860004 02323821 02a02821 [ 1049.665024]

[ 441.929346] Unhandled kernel unaligned access[#1]: [ 441.929360] CPU 2 Unable to handle kernel paging request at virtual address 00000000, epc == 8ec399a4, ra == 8ec39998 [ 441.944696] CPU: 0 PID: 9 Comm: ksoftirqd/0 Not tainted 5.4.179 #20 [ 441.950931] $ 0 : 00000000 00000001 13a1d456 806553b4 [ 441.956137] $ 4 : 8fc02b00 00000a20 00664000 80650000 [ 441.961341] $ 8 : 0d3792c0 00000002 80a6d424 3515d8c8 [ 441.966545] $12 : 00000032 80673d80 00000000 8f3c1d80 [ 441.971749] $16 : 13a1d456 8fc02b00 00000a20 00000000 [ 441.976952] $20 : 814958b0 806553b4 0002c8a5 00000000 [ 441.982156] $24 : 00000000 8001cbb4
[ 441.987360] $28 : 8fc5c000 8fc5dac8 8ec90680 80126d6c [ 441.992565] Hi : 00000000 [ 441.995427] Lo : 0000002f [ 441.998317] epc : 80126d68 kmalloc+0x1c0/0x224 [ 442.003086] ra : 80126d6c kmalloc+0x1c4/0x224 [ 442.007849] Status: 11008403 KERNEL EXL IE [ 442.012015] Cause : c0800010 (ExcCode 04) [ 442.016000] BadVA : 13a1d456 [ 442.018863] PrId : 0001992f (MIPS 1004Kc) [ 442.022934] Modules linked in: crypto_user pcrypt crypto_hw_eip93 mt76x2e mt76x2_common mt76x02_lib mt7603e mt76 mac80211 cfg80211 compat xt_CT iptable_raw [ 442.036815] Process ksoftirqd/0 (pid: 9, threadinfo=2e46b398, task=01835497, tls=00000000) [ 442.045034] Stack : 00000010 80b05800 fffffffc 8038d984 8f278000 8fd94c00 00000001 000005bc [ 442.053356] 8ec90660 80650000 00000010 804a8a60 80f6ce6c 804ac994 00000000 00000004 [ 442.061679] 8f6a8000 000005ac 00000008 80650000 00000007 a3d2e799 8ec90660 00000032 [ 442.070001] 00000000 00000002 00000000 00000000 8f278000 00000000 8ec90680 804bd2d8 [ 442.078322] 8fe28b80 8fc5dbb8 00000001 8040de78 00000032 00000002 80673d80 80650000 [ 442.086643] ... [ 442.089077] Call Trace: [ 442.091513] [<80126d68>] kmalloc+0x1c0/0x224 [ 442.095960] [<804a8a60>] esp_input+0x144/0x30c [ 442.100393] [<804bd2d8>] xfrm_input+0x40c/0xeec [ 442.104913] [<804b0d78>] xfrm4_esp_rcv+0x38/0x78 [ 442.109516] [<8044184c>] ip_protocol_deliver_rcu+0xe8/0x288 [ 442.115064] [<80441a3c>] ip_local_deliver_finish+0x50/0x60 [ 442.120526] [<80440f14>] ip_sublist_rcv_finish+0x58/0x7c [ 442.125816] [<804410c8>] ip_sublist_rcv+0x190/0x1d4 [ 442.130673] [<80441c8c>] ip_list_rcv+0xec/0x12c [ 442.135193] [<803a833c>] netif_receive_skb_list_core+0xf0/0x12c [ 442.141261] [<803a858c>] netif_receive_skb_list_internal+0x214/0x260 [ 442.147587] [<803a8620>] gro_normal_list+0x2c/0x50 [ 442.152359] [<803a8edc>] napi_gro_receive+0x74/0xd4 [ 442.157236] [<803e70c0>] gro_cell_poll+0x70/0xb0 [ 442.161835] [<803a94f8>] napi_poll+0x40/0x130 [ 442.166347] [<803a9830>] net_rx_action+0x10c/0x254 [ 442.171129] [<8051d99c>] do_softirq+0x15c/0x2f0 [ 442.175818] [<80027b6c>] run_ksoftirqd+0x44/0x60 [ 442.180437] [<8004497c>] smpboot_thread_fn+0x1b8/0x1e8 [ 442.185568] [<800410f8>] kthread+0x118/0x120 [ 442.189825] [<80005f98>] ret_from_kernel_thread+0x14/0x1c [ 442.195199] Code: 8e220014 02021021 0c048dbf <8c540000> 8f86000c 8e230000 00063080 00d53021 00602821

[ 648.998785] CPU 0 Unable to handle kernel paging request at virtual address 00000000, epc == 803a8658, ra == 803a8edc [ 649.009403] Oops[#1]: [ 649.011672] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.4.179 #20 [ 649.017734] $ 0 : 00000000 00000001 00000000 00000000 [ 649.022939] $ 4 : 8fe386d0 8fe38750 00000001 8fe38750 [ 649.028143] $ 8 : 000044d3 00001467 8fdb7a10 0000061e [ 649.033347] $12 : 11000000 0000000c 00000000 8ec6d100 [ 649.038551] $16 : 8fe38750 00000003 8fe386d0 af7c3a10 [ 649.043754] $20 : 00000002 8fc34000 00000040 080abfff [ 649.048958] $24 : 00000000 8001c930
[ 649.054163] $28 : 80642000 8fc0de18 8fe38750 803a8edc [ 649.059370] Hi : 00000000 [ 649.062232] Lo : 00000000 [ 649.065114] epc : 803a8658 gro_normal_one+0x14/0x48 [ 649.070143] ra : 803a8edc napi_gro_receive+0x74/0xd4 [ 649.075338] Status: 11008403 KERNEL EXL IE [ 649.079505] Cause : 4080000c (ExcCode 03) [ 649.083489] BadVA : 00000000 [ 649.086353] PrId : 0001992f (MIPS 1004Kc) [ 649.090424] Modules linked in: crypto_user pcrypt crypto_hw_eip93 mt76x2e mt76x2_common mt76x02_lib mt7603e mt76 mac80211 cfg80211 compat xt_CT iptable_raw [ 649.104305] Process swapper/0 (pid: 0, threadinfo=95185010, task=91308b9b, tls=00000000) [ 649.112352] Stack : 8fe3808c cd7145a5 8149a970 cd7145a5 8fe386d0 8fe3856c 8fe38080 80305284 [ 649.120677] 000154c1 803a8620 16ea66bd 00000097 8149a988 8fe38080 00000017 80302804 [ 649.129000] 80afa780 000001a1 000011a2 c5ea0000 00000684 000005ea 00afa7c0 90430855 [ 649.137321] deadbef3 00000000 8fe385ee 805d8a74 00000000 00000000 00000000 00000000 [ 649.145643] 00000000 00000000 8fe386d0 00000040 00000000 8fc0df03 80650000 80650000 [ 649.153964] ... [ 649.156399] Call Trace: [ 649.158835] [<803a8658>] gro_normal_one+0x14/0x48 [ 649.163525] [<803a8620>] gro_normal_list+0x2c/0x50 [ 649.168293] Code: ac850084 aca70000 aca20004 8c820088 00c23021 3c028065 ac860088 8c425970 [ 649.178006] [ 649.179747] ---[ end trace 47b72b000fdd401d ]--- [ 649.184380] Kernel panic - not syncing: Fatal exception in interrupt

[ 895.508632] CPU 0 Unable to handle kernel paging request at virtual address 00000000, epc == 803a8658, ra == 803a8edc [ 895.519274] Oops[#1]: [ 895.521541] CPU: 0 PID: 9 Comm: ksoftirqd/0 Not tainted 5.4.179 #20 [ 895.527778] $ 0 : 00000000 00000001 00000000 00000000 [ 895.532985] $ 4 : 8f42b6d0 8f42b750 00000001 8f42b750 [ 895.538189] $ 8 : 0000dcb1 00002604 8fdb7a10 0000061e [ 895.543393] $12 : 0ed40000 0000000c 00000000 8edfb880 [ 895.548596] $16 : 8f42b750 00000003 8f42b6d0 a08ed4f0 [ 895.553800] $20 : 00000004 8ff52800 00000040 080abfff [ 895.559004] $24 : 00000000 8001c930
[ 895.564208] $28 : 8fc5c000 8fc5dd18 8f42b750 803a8edc [ 895.569413] Hi : 00000000 [ 895.572275] Lo : 00000000 [ 895.575159] epc : 803a8658 gro_normal_one+0x14/0x48 [ 895.580189] ra : 803a8edc napi_gro_receive+0x74/0xd4 [ 895.585384] Status: 11008403 KERNEL EXL IE [ 895.589550] Cause : 4080000c (ExcCode 03) [ 895.593535] BadVA : 00000000 [ 895.596398] PrId : 0001992f (MIPS 1004Kc) [ 895.600469] Modules linked in: crypto_user pcrypt crypto_hw_eip93 xt_CT iptable_raw [last unloaded: crypto_user] [ 895.610620] Process ksoftirqd/0 (pid: 9, threadinfo=2923d4c0, task=f916853a, tls=00000000) [ 895.618840] Stack : 8f42b08c 840e383c 8149aab0 840e383c 8f42b6d0 8f42b56c 8f42b080 80305284 [ 895.627164] 0002457b 803a8620 8149a970 8149a9f0 8149a970 8149a960 80650000 8149aab0 [ 895.635487] 8eea0a00 0000014f 00001d92 c5ea0000 0000053c 000005ea 0eea0a40 90430855 [ 895.643810] deadbef3 00000000 8f42b5ee 805d8a74 00000000 00000000 00000000 00000000 [ 895.652131] 00000000 00000000 8f42b6d0 00000040 00000000 8fc5de03 80650000 80650000 [ 895.660453] ... [ 895.662887] Call Trace: [ 895.665322] [<803a8658>] gro_normal_one+0x14/0x48 [ 895.670012] [<803a8620>] gro_normal_list+0x2c/0x50 [ 895.674780] Code: ac850084 aca70000 aca20004 8c820088 00c23021 3c028065 ac860088 8c425970 [ 895.684494] [ 895.686386] ---[ end trace 725cc3c1f8de7e39 ]--- [ 895.691056] Kernel panic - not syncing: Fatal exception in interrupt [ 895.697397] ------------[ cut here ]------------ [ 895.702008] WARNING: CPU: 0 PID: 9 at kernel/smp.c:433 smp_call_function_many+0xe8/0x3cc [ 895.710056] Modules linked in: crypto_user pcrypt crypto_hw_eip93 xt_CT iptable_raw [last unloaded: crypto_user] [ 895.720202] CPU: 0 PID: 9 Comm: ksoftirqd/0 Tainted: G D 5.4.179 #20 [ 895.727818] Stack : 00000000 00000000 00000226 80068d98 00000000 80650000 80600000 8058dfc0 [ 895.736140] 8060715c 8fc5da6c 80f60000 00000000 80650000 00000001 8fc5da00 840e383c [ 895.744461] 00000000 00000000 80f70000 80650000 00000000 00000000 00000227 00000000 [ 895.752781] 00000000 2aed6985 80f60000 20202020 80650000 00000000 00000000 00000009 [ 895.761103] 00000000 00000000 8000fc68 00000000 00000002 802ab940 00000000 80f30000 [ 895.769424] ... [ 895.771858] Call Trace: [ 895.774306] [<8000b0d8>] show_stack+0x6c/0x12c [ 895.778743] [<80500d30>] dump_stack+0xa0/0xcc [ 895.783096] [<80023e10>] warn+0xcc/0xf0 [ 895.787091] [<80023eb8>] warn_slowpath_fmt+0x84/0xb8 [ 895.792036] [<80096f08>] smp_call_function_many+0xe8/0x3cc [ 895.797498] [<8009720c>] smp_call_function+0x20/0x2c [ 895.802443] [<80023994>] panic+0x12c/0x300 [ 895.806524] [<8000b394>] die+0x104/0x10c [ 895.810442] [<800161ec>] do_page_fault+0x374/0x4c0 [ 895.815218] [<80019d68>] tlb_do_page_fault_1+0x118/0x120 [ 895.820515] [<803a8edc>] napi_gro_receive+0x74/0xd4 [ 895.825387] [<80305284>] mtk_napi_rx+0x3bc/0x600 [ 895.829986] [<803a94f8>] __napi_poll+0x40/0x130 [ 895.834499] [<803a9830>] net_rx_action+0x10c/0x254 [ 895.839281] [<8051d99c>] do_softirq+0x15c/0x2f0 [ 895.843968] [<80027b6c>] run_ksoftirqd+0x44/0x60 [ 895.848580] [<8004497c>] smpboot_thread_fn+0x1b8/0x1e8 [ 895.853710] [<800410f8>] kthread+0x118/0x120 [ 895.857964] [<80005f98>] ret_from_kernel_thread+0x14/0x1c [ 895.863343] ---[ end trace 725cc3c1f8de7e3a ]--- [ 895.867966] Rebooting in 5 seconds..

[ 256.738184] CPU 2 Unable to handle kernel paging request at virtual address 00000000, epc == 8ecf99a4, ra == 8ecf9998 [ 256.738196] Unhandled kernel unaligned access[#1]: [ 256.738215] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.4.179 #20 [ 256.759581] $ 0 : 00000000 00000001 eababee1 806553b4 [ 256.764786] $ 4 : 8fc02b00 00000a20 00664000 80650000 [ 256.769990] $ 8 : 0861fc1c 80519124 00000000 00000000 [ 256.775194] $12 : 8fc0d8d8 8f6ceb9c 00000000 ac100d64 [ 256.780397] $16 : eababee1 8fc02b00 00000a20 00000000 [ 256.785601] $20 : 814958b0 806553b4 00022e52 80883b40 [ 256.790806] $24 : 00000000 804b06b4
[ 256.796009] $28 : 80642000 8fc0d9c0 8ed98460 80126d6c [ 256.801215] Hi : 00000004 [ 256.804076] Lo : 00000000 [ 256.806967] epc : 80126d68 kmalloc+0x1c0/0x224 [ 256.811737] ra : 80126d6c kmalloc+0x1c4/0x224 [ 256.816500] Status: 11008403 KERNEL EXL IE [ 256.820665] Cause : c0800010 (ExcCode 04) [ 256.824650] BadVA : eababee1 [ 256.827513] PrId : 0001992f (MIPS 1004Kc) [ 256.831584] Modules linked in: crypto_user pcrypt crypto_hw_eip93 xt_CT iptable_raw [ 256.839227] Process swapper/0 (pid: 0, threadinfo=1b400c83, task=bba40864, tls=00000000) [ 256.847273] Stack : 00000000 80673d80 ffffd5ad 804b1954 8ed98440 8fc0da58 8fd4a000 00000000 [ 256.855596] 0000000c 8fd4a000 804be9d0 804a8cac 8fc0da58 00000001 00000018 804a86fc [ 256.863919] 00000000 00000010 8f757000 00000008 0000000c ffffffff 80883b40 8cb316bd [ 256.872239] 80883b40 80650000 8ed98440 00000000 0000000c 8fd4a000 804be9d0 80680000 [ 256.880560] 8ed98460 804a91a0 8fc0db00 80650000 00000002 00000001 8ee23ddc 804b7724 [ 256.888883] ... [ 256.891318] Call Trace: [ 256.893754] [<80126d68>] kmalloc+0x1c0/0x224 [ 256.898201] [<804a8cac>] esp_output_tail+0x84/0x3fc [ 256.903059] [<804a91a0>] esp_output+0x17c/0x1b4 [ 256.907578] [<804be848>] xfrm_output_resume+0x9ac/0xb34 [ 256.912788] [<804b03d8>] __xfrm4_output+0x6c/0x94 [ 256.917472] [<804b0700>] xfrm4_output+0x4c/0xec [ 256.921989] [<80443428>] ip_forward+0x444/0x648 [ 256.926508] [<803a7f50>] netif_receive_skb_one_core+0x50/0x78 [ 256.932403] [<803a80ac>] netif_receive_skb+0xa8/0xd0 [ 256.937354] [<804de37c>] NF_HOOK.constprop.4+0x94/0xc4 [ 256.942471] [<804de4e4>] br_pass_frame_up+0x138/0x158 [ 256.947502] [<804de804>] br_handle_frame_finish+0x300/0x370 [ 256.953051] [<804dec70>] br_handle_frame+0x308/0x434 [ 256.957995] [<803a7d14>] netif_receive_skb_core+0x388/0x574 [ 256.963718] [<803a82c4>] netif_receive_skb_list_core+0x78/0x12c [ 256.969786] [<803a858c>] netif_receive_skb_list_internal+0x214/0x260 [ 256.976112] [<803a8620>] gro_normal_list+0x2c/0x50 [ 256.980884] [<803a91a4>] napi_complete_done+0x88/0x170 [ 256.986020] [<803e70e0>] gro_cell_poll+0x90/0xb0 [ 256.990618] [<803a94f8>] napi_poll+0x40/0x130 [ 256.995130] [<803a9830>] net_rx_action+0x10c/0x254 [ 256.999911] [<8051d99c>] do_softirq+0x15c/0x2f0 [ 257.004599] [<80027de0>] irq_exit+0x88/0xa4 [ 257.008768] [<80255e60>] plat_irq_dispatch+0x68/0xcc [ 257.013717] [<800064a8>] except_vec_vi_end+0xb8/0xc4 [ 257.018671] [<8004c480>] do_idle+0xe4/0x174 [ 257.022837] [<8004c748>] cpu_startup_entry+0x24/0x2c [ 257.027785] [<8067bd64>] start_kernel+0x580/0x5c4 [ 257.032469] Code: 8e220014 02021021 0c048dbf <8c540000> 8f86000c 8e230000 00063080 00d53021 00602821

[ 493.688770] CPU 2 Unable to handle kernel paging request at virtual address 00000000, epc == 80109024, ra == 8ede88c0 [ 493.690029] BUG: Bad page state in process ksoftirqd/0 pfn:00af0 [ 493.699366] Oops[#1]: [ 493.705413] page:80f889c0 refcount:-4 mapcount:0 mapping:00000000 index:0x0 [ 493.707665] CPU: 2 PID: 0 Comm: swapper/2 Not tainted 5.4.179 #23 [ 493.714582] flags: 0x0() [ 493.720633] $ 0 : 00000000 00000001 00000000 8fdb7610 [ 493.723157] raw: 00000000 00000100 00000122 00000000 00000000 00000000 ffffffff fffffffc [ 493.728336] $ 4 : 00000000 80afb9ac 00000001 00000001 [ 493.736378] raw: 00000000 [ 493.741568] $ 8 : 00000020 8051911c 00000001 6b55e098 [ 493.744167] page dumped because: nonzero _refcount [ 493.749357] $12 : 997849a4 00000006 00000000 e0cb2682 [ 493.754115] Modules linked in: crypto_user pcrypt crypto_hw_eip93 xt_CT iptable_raw [last unloaded: crypto_user] [ 493.759307] $16 : 80afb9ac 000005c4 80aee580 80afba80 [ 493.769427] CPU: 0 PID: 9 Comm: ksoftirqd/0 Not tainted 5.4.179 #23 [ 493.774613] $20 : 20002194 8f71ec80 80afba80 80afb900 [ 493.780842] Stack : 00000000 00000000 00000135 80068d98 00000000 80650000 80600000 8058dfcc [ 493.786033] $24 : 00000000 804a812c
[ 493.794333] 8060715c 8fc5db24 80f60000 00000000 80650000 00000001 8fc5dab8 77135f1f [ 493.799525] $28 : 8fc64000 8fc11e38 00000000 8ede88c0 [ 493.807826] 00000000 00000000 80f70000 80650000 00000033 746e6961 35206465 312e342e [ 493.813019] Hi : 00000004 [ 493.821318] bff4ffd7 2ddc872e 80f60000 666f736b 80650000 00000000 00000000 8059f79c [ 493.824178] Lo : 00000000 [ 493.832477] 00000201 8fc5dca8 80f889c0 00000001 00000002 802ab940 88042018 00000010 [ 493.835364] epc : 80109024 page_address+0x14/0x10c [ 493.843639] ... [ 493.848589] ra : 8ede88c0 mtk_irq_clear+0x7ec/0x9e4 [crypto_hw_eip93] [ 493.850998] Call Trace: [ 493.857659] Status: 11007c03 KERNEL EXL IE [ 493.860104] [<8000b0d8>] show_stack+0x6c/0x12c [ 493.864240] Cause : 40800008 (ExcCode 02) [ 493.868671] [<80500d30>] dump_stack+0xa0/0xcc [ 493.872632] BadVA : 00000000 [ 493.876969] [<8011cafc>] bad_page+0x114/0x144 [ 493.879818] PrId : 0001992f (MIPS 1004Kc) [ 493.884154] [<8011f9d0>] get_page_from_freelist+0x7c0/0xa44 [ 493.888211] Modules linked in: crypto_user pcrypt crypto_hw_eip93 xt_CT iptable_raw [last unloaded: crypto_user] [ 493.893756] [<80120afc>] alloc_pages_nodemask+0x9f4/0xb4c [ 493.903877] Process swapper/2 (pid: 0, threadinfo=f3f17509, task=fa1bb1f5, tls=00000000) [ 493.909406] [<80120d84>] page_frag_alloc+0x48/0x170 [ 493.917440] Stack : 00000001 8ed24427 00000000 8ec17d80 80afb9ac 000005c4 80aee580 8ede88c0 [ 493.922307] [<803050bc>] mtk_napi_rx+0x1f4/0x600 [ 493.930585] 00000000 00000002 00000000 00000001 80afb980 000005b8 0000000c 8ede98fc [ 493.935185] [<803a94f8>] napi_poll+0x40/0x130 [ 493.943472] 00000000 80afb900 00000000 00000000 80afb900 00000000 8f71ec80 80afb980 [ 493.947979] [<803a9830>] net_rx_action+0x10c/0x254 [ 493.956272] 40000000 00000001 00000000 8edea6c4 00000001 8ede8ce4 ffffff80 02000000 [ 493.961049] [<8051d99c>] __do_softirq+0x15c/0x2f0 [ 493.969332] 40000000 8f71ec80 00000001 ffffff80 02000000 8ede8310 00000000 77135f1f [ 493.974015] [<80027b6c>] run_ksoftirqd+0x44/0x60 [ 493.982305] ... [ 493.986912] [<8004497c>] smpboot_thread_fn+0x1b8/0x1e8 [ 493.989317] Call Trace: [ 493.994442] [<800410f8>] kthread+0x118/0x120 [ 493.996856] [<80109024>] page_address+0x14/0x10c [ 494.001095] [<80005f98>] ret_from_kernel_thread+0x14/0x1c [ 494.005685] [<8ede88c0>] mtk_irq_clear+0x7ec/0x9e4 [crypto_hw_eip93] [ 494.017375] Code: afb20018 afb10014 afb00010 <8c820000> 24030001 00021782 10430023 24050002 14450017 [ 494.027100] [ 494.028913] ---[ end trace 357a79408677be15 ]--- [ 494.033552] Kernel panic - not syncing: Fatal exception in interrupt

[ 142.743939] CPU 0 Unable to handle kernel paging request at virtual address 00000000, epc == 803a8658, ra == 803a8edc [ 142.754559] Oops[#1]: [ 142.756828] CPU: 0 PID: 9 Comm: ksoftirqd/0 Not tainted 5.4.179 #20 [ 142.763062] $ 0 : 00000000 00000001 00000000 00000000 [ 142.768267] $ 4 : 8fc2e6d0 8fc2e750 00000001 8fc2e750 [ 142.773471] $ 8 : 00000c9f 0000bba2 8fdb7a10 0000061e [ 142.778675] $12 : 0b56d799 00000000 00000000 c80d10ac [ 142.783878] $16 : 8fc2e750 00000003 8fc2e6d0 a080b260 [ 142.789082] $20 : 00000003 8fc34800 00000040 080abfff [ 142.794286] $24 : 00000000 8001c930
[ 142.799490] $28 : 8fc5c000 8fc5dd18 8fc2e750 803a8edc [ 142.804695] Hi : 00000000 [ 142.807556] Lo : 00000000 [ 142.810439] epc : 803a8658 gro_normal_one+0x14/0x48 [ 142.815468] ra : 803a8edc napi_gro_receive+0x74/0xd4 [ 142.820663] Status: 11008403 KERNEL EXL IE [ 142.824828] Cause : 4080000c (ExcCode 03) [ 142.828813] BadVA : 00000000 [ 142.831676] PrId : 0001992f (MIPS 1004Kc) [ 142.835747] Modules linked in: crypto_user pcrypt crypto_hw_eip93 mt76x2e mt76x2_common mt76x02_lib mt7603e mt76 mac80211 cfg80211 compat xt_CT iptable_raw [ 142.849628] Process ksoftirqd/0 (pid: 9, threadinfo=0da20add, task=244beed1, tls=00000000) [ 142.857848] Stack : 8fc2e080 803013c4 8149abf0 017ac49d 8fc2e6d0 8fc2e56c 8fc2e080 80305284 [ 142.866173] 00000b81 80305858 8149a970 8149a9f0 37f43c7b 00000021 0000c137 0b574aad [ 142.874495] 8ec3a780 00000126 000017a8 c5ea0000 00000498 000005ea 0ec3a7c0 90430855 [ 142.882818] deadbef3 00000000 8fc2e5ee 805d8a74 00000000 00000000 00000000 00000000 [ 142.891138] 00000000 00000000 8fc2e6d0 00000040 00000000 8fc5de03 80650000 80650000 [ 142.899459] ... [ 142.901893] Call Trace: [ 142.904329] [<803a8658>] gro_normal_one+0x14/0x48 [ 142.909035] [<80305858>] mtk_napi_tx+0x390/0x4f0 [ 142.913635] [<803a94f8>] __napi_poll+0x40/0x130 [ 142.918148] [<803a9830>] net_rx_action+0x10c/0x254 [ 142.922931] [<8051d99c>] __do_softirq+0x15c/0x2f0 [ 142.927620] [<80027b6c>] run_ksoftirqd+0x44/0x60 [ 142.932233] [<8004497c>] smpboot_thread_fn+0x1b8/0x1e8 [ 142.937363] [<800410f8>] kthread+0x118/0x120 [ 142.941620] [<80005f98>] ret_from_kernel_thread+0x14/0x1c [ 142.946994] Code: ac850084 aca70000 aca20004 8c820088 00c23021 3c028065 ac860088 8c425970 [ 142.956708]

nledovskikh commented 2 years ago

It's seems that I have the same issue using ath9k with AMSDU support enabled on mt7621. The same problems with memory corruption under iperf bi-directional load running tcp mode. So the problem can be caused by AMSDU or mediatek ethernet driver.

sweroam-mibr commented 2 years ago

Same issue with unielec u7621-01-ax hardware, so no ath9k. i suspect the mediatek ethernet driver. i will solder a rs232 to catch the crash.

Rexadev commented 1 year ago

Problem on 22.03.2 not 2.03.1 - TL-WR850N v2

nledovskikh commented 1 year ago

Could you please test with testing kernel enabled (5.15)? It's seems that the problem is resolved there.

Rexadev commented 1 year ago

Could you please test with testing kernel enabled (5.15)? It's seems that the problem is resolved there.

How to do that? Please tell.

nledovskikh commented 1 year ago

Could you please test with testing kernel enabled (5.15)? It's seems that the problem is resolved there.

How to do that? Please tell.

For openwrt 22.03, run 'make menuconfig' and choose 'Global build settings -> Use testing kernel version' (KERNEL_TESTING_PATCHVER variable set to 5.15 in target/linux/ramips/Makefile)

Rexadev commented 1 year ago

Can I do it in https://firmware-selector.openwrt.org/ @nledovskikh

nledovskikh commented 1 year ago

Can I do it in https://firmware-selector.openwrt.org/ @nledovskikh

No, you can't. You need to compile it from scratch.

sweroam-mibr commented 1 year ago

Have noticed that just before the router hangs, some commands stop working, like ip, wg show etc... also found allot of processes nf_ft_offload_stats.. wg.txt

Vladdrako commented 1 year ago

Watched a video from USB-HDD through rclone. ramips/mi-r3pro/5.15

<1>[ 4507.509208] CPU 1 Unable to handle kernel paging request at virtual address 00000000, epc == 804ade48, ra == 807d6d74
<4>[ 4507.519899] Oops[#1]:
<4>[ 4507.522191] CPU: 1 PID: 1564 Comm: napi/phy1-10 Not tainted 5.15.86 #0
<4>[ 4507.528716] $ 0   : 00000000 00000001 876ca600 876cb381
<4>[ 4507.533974] $ 4   : 00000000 87f3cc04 876cb380 00000000
<4>[ 4507.539229] $ 8   : 0c800000 00000219 04264e84 4089550c
<4>[ 4507.544478] $12   : 0c49b8c3 00000243 d4f0370b 00000219
<4>[ 4507.549734] $16   : 876ca900 87f3cb00 2279c4f1 2279c4f1
<4>[ 4507.554993] $20   : 00000004 0000001d 876ca900 876cb380
<4>[ 4507.560260] $24   : 00000000 807b28dc                  
<4>[ 4507.565539] $28   : 8437a000 8437ba00 0000001d 807d6d74
<4>[ 4507.570805] Hi    : 00000219
<4>[ 4507.573687] Lo    : 168728bf
<4>[ 4507.576566] epc   : 804ade48 0x804ade48
<4>[ 4507.580401] ra    : 807d6d74 0x807d6d74
<4>[ 4507.584235] Status: 1100fc03  KERNEL EXL IE 
<4>[ 4507.588438] Cause : 4080000c (ExcCode 03)
<4>[ 4507.592441] BadVA : 00000000
<4>[ 4507.595320] PrId  : 0001992f (MIPS 1004Kc)
<4>[ 4507.599408] Modules linked in: nf_nat_amanda nf_conntrack_amanda pppoe ppp_async wireguard sch_fq_pie rndis_host pptp pppox ppp_mppe ppp_generic nft_fib_inet nf_flow_table_ipv6 nf_flow_table_ipv4 nf_flow_table_inet mt7615e mt7615_common mt76_connac_lib mt76 mac80211 libchacha20poly1305 ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211 cdc_ncm cdc_ether xt_time xt_tcpudp xt_tcpmss xt_statistic xt_state xt_recent xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_helper xt_geoip xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_TCPMSS xt_LOG xt_HL xt_DSCP xt_CT xt_CLASSIFY vhci_hcd usbnet usblp usbip_host usbip_core usbhid ts_kmp ts_fsm ts_bm slhc sch_red sch_prio sch_pie sch_mqprio sch_drr poly1305_mips nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_flow_offload
<4>[ 4507.600205]  nft_fib_ipv6 nft_fib_ipv4 nft_fib nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_tables nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_nat_ftp nf_nat nf_log_syslog nf_flow_table nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_ftp nf_conntrack_broadcast nf_conntrack_bridge nf_conncount mdio_netlink libcurve25519_generic iptable_raw iptable_mangle iptable_filter ipt_ECN ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_itu_t crc_ccitt compat cls_flower cdc_wdm arptable_filter arpt_mangle arp_tables act_vlan fuse ntfs3 cls_bpf act_bpf sch_tbf sch_ingress sch_htb em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_basic act_skbedit
<4>[ 4507.687935]  act_mirred act_gact sg hid evdev ledtrig_usbport ledtrig_gpio cryptodev xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ipmac ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set nfnetlink jool_siit jool jool_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 msdos bonding ip6_gre ip_gre gre ifb nat46 sit ip6_tunnel netlink_diag tunnel6 tunnel4 veth tun ovpn_dco nbd minix isofs hfsplus hfs cdrom cifs cifs_md4 cifs_arc4 autofs4 dns_resolver nls_koi8_r nls_iso8859_6 nls_iso8859_2 nls_iso8859_15 nls_iso8859_13 nls_iso8859_1 nls_cp936 nls_cp866 nls_cp864 nls_cp862 nls_cp852 nls_cp850 nls_cp775 nls_cp437 nls_cp1251 nls_cp1250 zram zsmalloc algif_skcipher algif_rng algif_hash algif_aead af_alg des_generic arc4 leds_gpio xhci_plat_hcd
<4>[ 4507.775454]  xhci_pci xhci_mtk_hcd xhci_hcd ahci libahci libata loop gpio_button_hotplug xfs vfat fat jfs f2fs ext4 mbcache jbd2 exfat btrfs xor raid6_pq dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax mii mq_deadline kyber_iosched bfq crc32_generic
<4>[ 4507.884374] Process napi/phy1-10 (pid: 1564, threadinfo=ff92fdb4, task=10fc4733, tls=00000000)
<4>[ 4507.893025] Stack : 865ffe78 865ffed8 842ad1d0 842a8484 0cab8840 00000001 0cab8804 00000000
<4>[ 4507.901457]         00000000 0000162d 00000000 0000013b 00000000 00000000 00000000 0000376c
<4>[ 4507.909848]         00000000 00000000 00000000 00000000 00000000 000000fe 227a68f9 00000000
<4>[ 4507.918249]         00000000 842ad190 842ad2e0 8a186100 8437bbd8 842ad190 842ad2e0 84280418
<4>[ 4507.926652]         00007530 807976f0 000005a8 87f3cb00 00000000 00000000 84d63074 85f35180
<4>[ 4507.935052]         ...
<4>[ 4507.937511] Call Trace:
<4>[ 4507.937595] [<842a8484>] 0x842a8484 [nf_tables@24b7d93c+0x2eb50]
<4>[ 4507.946257] [<84280418>] 0x84280418 [nf_tables@24b7d93c+0x2eb50]
<4>[ 4507.952299] [<807976f0>] 0x807976f0
<4>[ 4507.955800] [<807e0a48>] 0x807e0a48
<4>[ 4507.959355] [<807da8c8>] 0x807da8c8
<4>[ 4507.962856] [<807e87f4>] 0x807e87f4
<4>[ 4507.966360] [<807ebeb4>] 0x807ebeb4
<4>[ 4507.970006] [<807a643c>] 0x807a643c
<4>[ 4507.973551] [<807a27a4>] 0x807a27a4
<4>[ 4507.977050] [<808f4618>] 0x808f4618
<4>[ 4507.980577] [<807b2630>] 0x807b2630
<4>[ 4507.984070] [<807b1598>] 0x807b1598
<4>[ 4507.987650] [<807b29ec>] 0x807b29ec
<4>[ 4507.991138] [<801c5100>] 0x801c5100
<4>[ 4507.994678] [<807b2874>] 0x807b2874
<4>[ 4507.998212] [<806e39dc>] 0x806e39dc
<4>[ 4508.001780] [<808f44a4>] 0x808f44a4
<4>[ 4508.005363] [<800aa0cc>] 0x800aa0cc
<4>[ 4508.008972] [<808f4b2c>] 0x808f4b2c
<4>[ 4508.012464] [<80015230>] 0x80015230
<4>[ 4508.016119] [<808f4618>] 0x808f4618
<4>[ 4508.019608] [<806e1204>] 0x806e1204
<4>[ 4508.023220] [<800b81bc>] 0x800b81bc
<4>[ 4508.026798] [<806e3b44>] 0x806e3b44
<4>[ 4508.030481] [<806e3318>] 0x806e3318
<4>[ 4508.034186] [<8093cb7c>] 0x8093cb7c
<4>[ 4508.037728] [<806e371c>] 0x806e371c
<4>[ 4508.041307] [<806e371c>] 0x806e371c
<4>[ 4508.044893] [<800391dc>] 0x800391dc
<4>[ 4508.048434] [<843746b4>] 0x843746b4 [mt7615e@05a12c55+0x2500]
<4>[ 4508.054242] [<800392f0>] 0x800392f0
<4>[ 4508.057778] [<806e371c>] 0x806e371c
<4>[ 4508.061266] [<806e3728>] 0x806e3728
<4>[ 4508.064879] [<806e3538>] 0x806e3538
<4>[ 4508.068452] [<800593d4>] 0x800593d4
<4>[ 4508.071942] [<80059210>] 0x80059210
<4>[ 4508.075515] [<80059210>] 0x80059210
<4>[ 4508.079054] [<80003518>] 0x80003518
<4>[ 4508.082582] 
<4>[ 4508.084086] Code: 8c440008  acc40004  ac460008  8cc30000  2c670004  ac430000  14e0000c  acc20000 
<4>[ 4508.093842] 
<4>[ 4508.095403] ---[ end trace 0b6348fc395fb147 ]---
<0>[ 4508.114106] Kernel panic - not syncing: Fatal exception in interrupt
<4>[ 4508.120483] ------------[ cut here ]------------
<4>[ 4508.125079] WARNING: CPU: 1 PID: 1564 at kernel/smp.c:894 0x800daeb4
<4>[ 4508.131418] Modules linked in: nf_nat_amanda nf_conntrack_amanda pppoe ppp_async wireguard sch_fq_pie rndis_host pptp pppox ppp_mppe ppp_generic nft_fib_inet nf_flow_table_ipv6 nf_flow_table_ipv4 nf_flow_table_inet mt7615e mt7615_common mt76_connac_lib mt76 mac80211 libchacha20poly1305 ipt_REJECT ebtable_nat ebtable_filter ebtable_broute cfg80211 cdc_ncm cdc_ether xt_time xt_tcpudp xt_tcpmss xt_statistic xt_state xt_recent xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_helper xt_geoip xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_TCPMSS xt_LOG xt_HL xt_DSCP xt_CT xt_CLASSIFY vhci_hcd usbnet usblp usbip_host usbip_core usbhid ts_kmp ts_fsm ts_bm slhc sch_red sch_prio sch_pie sch_mqprio sch_drr poly1305_mips nft_tproxy nft_socket nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject_bridge nft_reject nft_redir nft_quota nft_queue nft_objref nft_numgen nft_nat nft_meta_bridge nft_masq nft_log nft_limit nft_hash nft_fwd_netdev nft_flow_offload
<4>[ 4508.131888]  nft_fib_ipv6 nft_fib_ipv4 nft_fib nft_dup_netdev nft_ct nft_counter nft_compat nft_chain_nat nfnetlink_queue nfnetlink_log nf_tproxy_ipv6 nf_tproxy_ipv4 nf_tables nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_pptp nf_nat_irc nf_nat_h323 nf_nat_ftp nf_nat nf_log_syslog nf_flow_table nf_dup_netdev nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_pptp nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_ftp nf_conntrack_broadcast nf_conntrack_bridge nf_conncount mdio_netlink libcurve25519_generic iptable_raw iptable_mangle iptable_filter ipt_ECN ip_tables hwmon hid_generic ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_itu_t crc_ccitt compat cls_flower cdc_wdm arptable_filter arpt_mangle arp_tables act_vlan fuse ntfs3 cls_bpf act_bpf sch_tbf sch_ingress sch_htb em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_basic act_skbedit
<4>[ 4508.219276]  act_mirred act_gact sg hid evdev ledtrig_usbport ledtrig_gpio cryptodev xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark ip_set_hash_ipmac ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set nfnetlink jool_siit jool jool_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 msdos bonding ip6_gre ip_gre gre ifb nat46 sit ip6_tunnel netlink_diag tunnel6 tunnel4 veth tun ovpn_dco nbd minix isofs hfsplus hfs cdrom cifs cifs_md4 cifs_arc4 autofs4 dns_resolver nls_koi8_r nls_iso8859_6 nls_iso8859_2 nls_iso8859_15 nls_iso8859_13 nls_iso8859_1 nls_cp936 nls_cp866 nls_cp864 nls_cp862 nls_cp852 nls_cp850 nls_cp775 nls_cp437 nls_cp1251 nls_cp1250 zram zsmalloc algif_skcipher algif_rng algif_hash algif_aead af_alg des_generic arc4 leds_gpio xhci_plat_hcd
<4>[ 4508.306431]  xhci_pci xhci_mtk_hcd xhci_hcd ahci libahci libata loop gpio_button_hotplug xfs vfat fat jfs f2fs ext4 mbcache jbd2 exfat btrfs xor raid6_pq dm_mirror dm_region_hash dm_log dm_crypt dm_mod dax mii mq_deadline kyber_iosched bfq crc32_generic
<4>[ 4508.415192] CPU: 1 PID: 1564 Comm: napi/phy1-10 Tainted: G      D           5.15.86 #0
<4>[ 4508.423095] Stack : 80cc0000 00000000 0000004a 80a08094 00000000 00000000 00000000 00000000
<4>[ 4508.431456]         00000000 00000000 00000000 00000000 00000000 00000001 8437b700 8149a200
<4>[ 4508.439809]         8437b6e0 00000000 00000000 8437b5b4 00000038 804c28a4 00000245 00000003
<4>[ 4508.448175]         00000001 80ad0800 ffffffff 746e6961 80956858 80956858 00000000 00000000
<4>[ 4508.456535]         00000000 83741980 00000001 80ac0000 00000010 8055d038 000fd697 000fd6d7
<4>[ 4508.464897]         ...
<4>[ 4508.467342] Call Trace:
<4>[ 4508.467554] [<804c28a4>] 0x804c28a4
<4>[ 4508.473496] [<8055d038>] 0x8055d038
<4>[ 4508.477024] [<80009ae8>] 0x80009ae8
<4>[ 4508.480500] [<80009af4>] 0x80009af4
<4>[ 4508.483977] [<804a33e4>] 0x804a33e4
<4>[ 4508.487457] [<80033dfc>] 0x80033dfc
<4>[ 4508.490929] [<800daeb4>] 0x800daeb4
<4>[ 4508.494407] [<800daeb4>] 0x800daeb4
<4>[ 4508.497890] [<800daeb4>] 0x800daeb4
<4>[ 4508.501362] [<80033eb4>] 0x80033eb4
<4>[ 4508.504841] [<800daeb4>] 0x800daeb4
<4>[ 4508.508378] [<8009a0cc>] 0x8009a0cc
<4>[ 4508.511878] [<800db270>] 0x800db270
<4>[ 4508.515355] [<80015160>] 0x80015160
<4>[ 4508.518866] [<80033884>] 0x80033884
<4>[ 4508.522439] [<8000a338>] 0x8000a338
<4>[ 4508.525944] [<8001c868>] 0x8001c868
<4>[ 4508.529418] [<804ade48>] 0x804ade48
<4>[ 4508.532896] [<807d6d74>] 0x807d6d74
<4>[ 4508.536384] [<80021e58>] 0x80021e58
<4>[ 4508.539869] [<806ba6cc>] 0x806ba6cc
<4>[ 4508.543357] [<807b28dc>] 0x807b28dc
<4>[ 4508.546951] [<807d6d74>] 0x807d6d74
<4>[ 4508.550426] [<804ade48>] 0x804ade48
<4>[ 4508.553920] [<842a8484>] 0x842a8484 [nf_tables@24b7d93c+0x2eb50]
<4>[ 4508.560008] [<84280418>] 0x84280418 [nf_tables@24b7d93c+0x2eb50]
<4>[ 4508.566025] [<807976f0>] 0x807976f0
<4>[ 4508.569523] [<807e0a48>] 0x807e0a48
<4>[ 4508.573094] [<807da8c8>] 0x807da8c8
<4>[ 4508.576577] [<807e87f4>] 0x807e87f4
<4>[ 4508.580052] [<807ebeb4>] 0x807ebeb4
<4>[ 4508.583585] [<807a643c>] 0x807a643c
<4>[ 4508.587093] [<807a27a4>] 0x807a27a4
<4>[ 4508.590568] [<808f4618>] 0x808f4618
<4>[ 4508.594109] [<807b2630>] 0x807b2630
<4>[ 4508.597606] [<807b1598>] 0x807b1598
<4>[ 4508.601146] [<807b29ec>] 0x807b29ec
<4>[ 4508.604632] [<801c5100>] 0x801c5100
<4>[ 4508.608142] [<807b2874>] 0x807b2874
<4>[ 4508.611637] [<806e39dc>] 0x806e39dc
<4>[ 4508.615164] [<808f44a4>] 0x808f44a4
<4>[ 4508.618692] [<800aa0cc>] 0x800aa0cc
<4>[ 4508.622240] [<808f4b2c>] 0x808f4b2c
<4>[ 4508.625722] [<80015230>] 0x80015230
<4>[ 4508.629283] [<808f4618>] 0x808f4618
<4>[ 4508.632759] [<806e1204>] 0x806e1204
<4>[ 4508.636310] [<800b81bc>] 0x800b81bc
<4>[ 4508.639832] [<806e3b44>] 0x806e3b44
<4>[ 4508.643427] [<806e3318>] 0x806e3318
<4>[ 4508.647021] [<8093cb7c>] 0x8093cb7c
<4>[ 4508.650518] [<806e371c>] 0x806e371c
<4>[ 4508.654078] [<806e371c>] 0x806e371c
<4>[ 4508.657624] [<800391dc>] 0x800391dc
<4>[ 4508.661131] [<843746b4>] 0x843746b4 [mt7615e@05a12c55+0x2500]
<4>[ 4508.666899] [<800392f0>] 0x800392f0
<4>[ 4508.670406] [<806e371c>] 0x806e371c
<4>[ 4508.673891] [<806e3728>] 0x806e3728
<4>[ 4508.677489] [<806e3538>] 0x806e3538
<4>[ 4508.681013] [<800593d4>] 0x800593d4
<4>[ 4508.684493] [<80059210>] 0x80059210
<4>[ 4508.688024] [<80059210>] 0x80059210
<4>[ 4508.691522] [<80003518>] 0x80003518
<4>[ 4508.695016] 
<4>[ 4508.696504] ---[ end trace 0b6348fc395fb148 ]---
nledovskikh commented 1 year ago

Is there any progress or still panic?

rany2 commented 1 year ago

@nledovskikh panic remains on SNAPSHOT still...

nledovskikh commented 1 year ago

It seems that the issue may be related to software cache coherency problems on this cpu.

rany2 commented 1 year ago

@nledovskikh If it helps, i can't trigger this anymore on SNAPSHOT. Perhaps the recent changes inadvertently fixed it or (more likely) made this harder to trigger.

nledovskikh commented 1 year ago

@nledovskikh If it helps, i can't trigger this anymore on SNAPSHOT. Perhaps the recent changes inadvertently fixed it or (more likely) made this harder to trigger.

Still happens, as before. And many interrupt's errors (spurious interrupts) in /proc/interrupts. But the same modified code of ath9k on other systems work fine. Tested on x86-64 and arm64 (bpi-r64, bpi-r3) that have hard dma coherency, not soft.

dvn0 commented 8 months ago

I'm experiencing this as well, with a gnubee2 device, and what's odd is that it just seemed to crop up one day, and now it happens frequently. Network usage patterns didn't change... Just crashes under moderate sustained network load now.

I upgraded to latest SNAPSHOT hoping it would go away, but it hasn't helped.