Zigbee entities become unavailable when HA does not have access to the Internet

mihaitaiosub commented 4 months ago

The problem

Hello guys, I want to report a strange problem regarding the zigbee integration. Yesterday, at my home, the internet was unavailable. There were some works on the fiber optic network in the neighborhood. Although the local network at my house was functional and HA it worked ok and could be accessed, all the entities (sensors, switches, etc.) related to the zigbee integration, became unavailable at regular time intervals, 2-3 minutes. They remained unavailable for approx. 30 seconds, after which they returned to the state before becoming unavailable.And this cycle was repeated continuously until access to the Internet returned, that is, after about 7 hours. It seemed as if the zigbee integration restarted at regular intervals.After the internet access returned to normal, everything was ok, the integration worked ok. I use a zigbee bridge from Sonoff with firmware from Tasmota. Anyway, these symptoms are relatively new, because in the past it happened that I didn't have internet, but I didn't have these problems.

What version of Home Assistant Core has the issue?

2024.6.4

What was the last working version of Home Assistant Core?

2024.6.0

What type of installation are you running?

Home Assistant OS

Integration causing the issue

Zigbee Home Automation

Link to integration documentation on our website

https://www.home-assistant.io/integrations/zha/

Diagnostics information

No response

Example YAML snippet

No response

Anything in the logs that might be useful for us?

No response

Additional information

No response

home-assistant[bot] commented 4 months ago

zigbee documentation zigbee source

mihaitaiosub commented 3 months ago

Screenshot_20240725_082658_Home Assistant Hello guys, yesterday it happened to me again. At my house, I had no internet connection for several hours and all the zigbee entities went into that cycle that I talked about above. Has no one really noticed this symptom?

home-assistant[bot] commented 3 months ago

Hey there @dmulcahey, @adminiuga, @puddly, @thejulianjes, mind taking a look at this issue as it has been labeled with an integration (zha) you are listed as a code owner for? Thanks!

Code owner commands

Code owners of `zha` can trigger bot actions by commenting: - `@home-assistant close` Closes the issue. - `@home-assistant rename Awesome new title` Renames the issue. - `@home-assistant reopen` Reopen the issue. - `@home-assistant unassign zha` Removes the current integration label and assignees on the issue, add the integration domain after the command. - `@home-assistant add-label needs-more-information` Add a label (needs-more-information, problem in dependency, problem in custom component) to the issue. - `@home-assistant remove-label needs-more-information` Remove a label (needs-more-information, problem in dependency, problem in custom component) on the issue.

_{^{(message by CodeOwnersMention)}}

zha documentation zha source _{^{(message by IssueLinks)}}

mihaitaiosub commented 3 months ago

I'm not very expert in these discussions, but shouldn't we find this problem in the topic about Zigbee Home Automation? You mean here? https://github.com/home-assistant/core/issues?q=is%3Aissue+is%3Aopen+label%3A%22integration%3A+zha%22

joostlek commented 3 months ago

Zha = ZigBee Home Automation

dmulcahey commented 3 months ago

Put zha in debug mode when this happens again and attach the debug log here. Chances are your stick is crashing or failing to communicate and ZHA is reloading as a result.

mihaitaiosub commented 3 months ago

OK, but why does it only happen when my house doesn't have internet access?

dmulcahey commented 3 months ago

Chances are you had several integrations failing without internet access causing the event loop to stutter a bit. ZHA / Zigbee is very latency sensitive and if it couldn’t communicate the way it normally does (because of the potential stuttering) it will reload. The debug log is needed to confirm. Without the logs there is no reason to speculate further. Get the logs and we can attempt to diagnose what happened.

mihaitaiosub commented 3 months ago

Ok, thank you. Now I'm away from home, I'll be back next week. I'll interrupt the internet connection and put ZHA in debug mode to have the necessary data.

mihaitaiosub commented 3 months ago

Hello, today I arrived home, I came back from vacation and I managed to simulate the lack of internet, appearing again the symptoms I talked about in this topic. I am attaching below the file obtained when I activated the debuglog in the zigbee integration. I interrupted the access to the internet around 11:19. home-assistant_zha_2024-08-02T08-41-50.461Z.log

mihaitaiosub commented 3 months ago

And this is a zigbee sensor for the entire time that the internet was not available. Screenshot_20240802_122127_Home Assistant

puddly commented 3 months ago

According to the log the coordinator stops responding. Disable your custom integrations (midea_ac, etc.) and see if it keeps happening.

mihaitaiosub commented 3 months ago

So you say that the coordinator stops working at regular intervals, as can be seen from the print screen above?

puddly commented 3 months ago

ZHA continuously communicates with your coordinator, about once every 10 seconds. From the perspective of ZHA, the coordinator stops responding for about three of these periods and then finally sends a reset indication that it has reset due to no reply from the host.

This means that either your network drops constantly or that a custom integration is stalling the event loop and preventing ZHA from communicating in a timely manner with the coordinator.

As @dmulcahey mentioned above, it's likely due to a custom (or built-in!) integration not handling network problems well. Disable your custom ones first and see if it goes away.

mihaitaiosub commented 3 months ago

But why doesn't this also happen when the internet access is ok? Why does this happen only when there is no internet access? And why only this integration (zha) has this problem? The rest works without any problem.

puddly commented 3 months ago

ZHA is timing sensitive. If some other integration doesn't behave well when internet is disconnected, it'll break ZHA.

mihaitaiosub commented 3 months ago

In the end, I think I understand what you want to say. It is about the internal Wi-Fi network of the house, which is supported by a Netgear X10 router, which I think is quite performant, but which can move more difficult when not there is internet access. The zigbee bridge that is causing problems is connected via wifi to this router. In the settings of the Netgear router you can say what kind of device each connected device is, and I said about the zigbee bridge that it would be a router .Of course, it has a fixed IP, which never changes. I simulated the interruption of the Internet once more and the problem did not appear again. I think that maybe now the zigbee bridge is named as a router in the settings of the main router, it will have priority in front of the other devices. I will follow in the future what will happen.

mihaitaiosub commented 3 months ago

Today I tried once more to simulate the problem, and the results were the same. That is, the integration continues to restart at regular intervals. So the changes I made in the home router were of no use. I ask you if that number 8888 that appears after the internal IP of the zigbee bridge is a port, and if so, shouldn't it be activated in the settings of the wifi router that holds the internal network of the house and to which this zigbee bridge is also connected? 20240804_123843

mihaitaiosub commented 2 months ago

A few days ago I replaced the old Sonoff wireless bridge with firmware from Tasmota, which I used for zigbee devices, with a SkyConnect stick.I simulated the lack of internet for HA several times, and I no longer noticed the problem for which I opened this ticket. I will follow what happens for a few more days and I will come back with news.

home-assistant / core