sudomesh / sudowrt-firmware

Scripts to build the sudo mesh OpenWRT firmware.
Other
73 stars 19 forks source link

ath: phy0: Failed to stop TX DMA, queues=0x002! #93

Closed Juul closed 8 years ago

Juul commented 8 years ago

The node 100.64.2.1 is no longer allowing clients to associate. SSIDs are broadcast normally but I cannot associate on 2.4 GHz (haven't tried on 5 GHz) and dmesg was full of lines like:

[  295.360000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[  340.520000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[  342.980000] ath: phy1: Failed to stop TX DMA, queues=0x102!
[  344.310000] ath: phy1: Failed to stop TX DMA, queues=0x102!
[  351.170000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[  354.760000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[  372.750000] ath: phy1: Failed to stop TX DMA, queues=0x00a!
[  376.050000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[  393.660000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[  397.350000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[  435.970000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[  439.540000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[  440.750000] ath: phy1: Failed to stop TX DMA, queues=0x00a!
[  441.590000] ath: phy1: Failed to stop TX DMA, queues=0x102!
[  455.600000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[  457.380000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[  461.250000] ath: phy1: Failed to stop TX DMA, queues=0x102!
[  478.220000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[  481.750000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[  504.750000] ath: phy1: Failed to stop TX DMA, queues=0x00a!
[  508.660000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[  515.820000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[ 3860.090000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[ 3983.070000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[ 4843.330000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[ 5826.470000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[ 8898.970000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[12339.700000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[12462.680000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[13200.060000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[13691.680000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[16272.360000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[18115.650000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[21802.140000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[22048.000000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[22539.620000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[29789.610000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[55226.070000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[56577.850000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[61861.770000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[63705.060000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[63723.330000] ath: phy0: Failed to stop TX DMA, queues=0x002!
[63749.760000] ath: phy0: Failed to stop TX DMA, queues=0x002!
[63751.590000] ath: phy0: Failed to stop TX DMA, queues=0x002!
[63774.150000] ath: phy0: Failed to stop TX DMA, queues=0x100!
[64442.540000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[64611.450000] ath: phy0: Failed to stop TX DMA, queues=0x002!
[65671.210000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[66543.630000] ath: phy0: Failed to stop TX DMA, queues=0x002!
[72184.260000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[82998.060000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[88159.200000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[88773.700000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[89228.100000] ath: phy0: Failed to stop TX DMA, queues=0x008!
[90125.480000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[91600.140000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[92091.760000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[92681.330000] ath: phy0: Failed to stop TX DMA, queues=0x002!
[92695.160000] ath: phy0: Failed to stop TX DMA, queues=0x002!
[95163.850000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[96269.860000] ath: phy1: Failed to stop TX DMA, queues=0x002!
[96392.850000] ath: phy1: Failed to stop TX DMA, queues=0x102!
[96575.400000] ath: phy0: Failed to stop TX DMA, queues=0x002!
[97114.240000] ath: phy0: Failed to stop TX DMA, queues=0x00a!

Ethernet connectivity is working correctly and I am in fact online via this node. There is now a bunch of eeprom read failures in the dmesg log but those are an artefact of my debugging attempts.

Juul commented 8 years ago

Wifi seems to be working again though I did nothing to fix it. It looks like the adhoc connection to the nearest node 100.64.24.129 is stable and the internet is flowing through that node.

When connected via ethernet to 100.64.2.1 the internet is stable and the packets flow through 100.64.24.129. When connected to 100.64.2.1 via wifi I am getting frequent and unpredictable outages every few minutes usually lasting less than 2 minutes (often 30-50 seconds). I was also noticing these before the complete wifi failure. I am not getting any more "Failed to stop TX DMA" messages. This may be a different problem entirely. During these outages the client can ping 100.64.2.1 and 100.64.2.1 can ping 8.8.8.8 but the client cannot ping 8.8.8.8. This has been tested with multiple different clients (os x and linux). I verified with traceroute from 100.64.2.1 to 8.8.8.8 that the packets are still going through 100.64.24.129 during the outages.

Juul commented 8 years ago

After a soft reboot of 100.64.2.1 the intermittent connectivity problems started reoccurring. Tried powering off the router for 30 seconds and powering it back on. Will report back.

Juul commented 8 years ago

The hard reboot seems to have fixed the issue.

Juul commented 8 years ago

This is fixed by newest OpenWRT version and we have since upgraded to this version.