helium / router

router combines a LoRaWAN Network Server with an API for console, and provides a proxy to the Helium blockchain
Apache License 2.0
70 stars 31 forks source link

Unable to Join. Devices do not recognize the Join Accept messages #477

Closed Max-Plastix closed 2 years ago

Max-Plastix commented 2 years ago

Beginning on 2021-10-27, my devices that were functional on the Helium network have become unable to Join at all.

The Console shows the Join Request received, and Join Accept is sent as expected. The device does not recognize the Join Accept message, and retries the Join Request again. Both the Join Request and Join Accept messages appear correctly-formed and without error in Helium Console Debug.

Join Accept Join Request Join Accept Join Request ... repeating every few seconds.

This behavior is identical across diverse device implementations (Victor Trap, Heltec CubeCell, Dragino devices, etc). The nearest hotspot is a RAK MNTD Gold 2.0, but physically travelling to a different hotspot showed the same failing behavior. The hotspots are functioning fine otherwise, fully sync'd and online, witnessing fine.

This has been persistent for about 48 hours, with thousands of Join Request/Accept pairs logged and no uplink/downlink packets sent from any device.

Max-Plastix commented 2 years ago

Additional information:

One device (Dragino LHT65) that previously Joined successfully (last week) on the same Hotspot continue to send Uplink packets as expected. It has not attempted Join recently.

The last successful Join Accept I can find is Oct 26, 2021 11:27:27.870 AM PDT.

mfalkvidd commented 2 years ago

We've also seen similar behavior, with an Axioma water meter.

Max-Plastix commented 2 years ago

Same results on Staging Console.

Max-Plastix commented 2 years ago

Addressed through Miner fix here https://github.com/helium/miner/pull/1148

slavendam commented 2 years ago

After fix, it happens that we get repeated Uplink if Multiple packets are turned on. So repeated Uplink is from different hotspot instead it is grouped together. @jdgemm

image

Max-Plastix commented 2 years ago

For this observed Miner issue, I can confirm that I saw it in RAKwireless v2021.10.27.0, and it is fully resolved here with 2021.10.29.0 now. I'm going to close this one out.

Thanks devs for the quick analysis and turnaround!