search

home-assistant / core

:house_with_garden: Open source home automation that puts local control and privacy first.
https://www.home-assistant.io
Apache License 2.0
72.13k stars 30.18k forks source link

Watchdog failure zigpy.application #115899

Closed liamlain closed 1 month ago

liamlain commented 5 months ago

The problem

Not sure what causing this problem,when this error happen ,my zha integration will start initializing

Logger: zigpy.application Source: /usr/local/lib/python3.12/site-packages/zigpy/application.py:675 First occurred: April 20, 2024 at 11:00:01 PM (4 occurrences) Last logged: 12:24:41 AM

Watchdog failure Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1059, in request response = await response_future ^^^^^^^^^^^^^^^^^^^^^ asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 673, in _watchdog_loop await self.watchdog_feed() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 655, in watchdog_feed await self._watchdog_feed() File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 628, in _watchdog_feed await self._znp.request(c.SYS.Ping.Req()) File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1055, in request async with async_timeout.timeout( File "/usr/local/lib/python3.12/site-packages/async_timeout/init.py", line 141, in aexit self._do_exit(exc_type) File "/usr/local/lib/python3.12/site-packages/async_timeout/init.py", line 228, in _do_exit raise asyncio.TimeoutError TimeoutError

What version of Home Assistant Core has the issue?

2024.4.3

What was the last working version of Home Assistant Core?

No response

What type of installation are you running?

Home Assistant OS

Integration causing the issue

zha

Link to integration documentation on our website

No response

Diagnostics information

No response

Example YAML snippet

No response

Anything in the logs that might be useful for us?

Logger: zigpy.application
Source: /usr/local/lib/python3.12/site-packages/zigpy/application.py:675
First occurred: 7:05:44 PM (2 occurrences)
Last logged: 7:11:18 PM

Watchdog failure
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1059, in request
    response = await response_future
               ^^^^^^^^^^^^^^^^^^^^^
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 673, in _watchdog_loop
    await self.watchdog_feed()
  File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 655, in watchdog_feed
    await self._watchdog_feed()
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 628, in _watchdog_feed
    await self._znp.request(c.SYS.Ping.Req())
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1055, in request
    async with async_timeout.timeout(
  File "/usr/local/lib/python3.12/site-packages/async_timeout/__init__.py", line 141, in __aexit__
    self._do_exit(exc_type)
  File "/usr/local/lib/python3.12/site-packages/async_timeout/__init__.py", line 228, in _do_exit
    raise asyncio.TimeoutError
TimeoutError

Additional information

Logger: homeassistant
Source: /usr/src/homeassistant/homeassistant/runner.py:146
First occurred: April 20, 2024 at 10:59:46 PM (32 occurrences)
Last logged: 12:24:41 AM

Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1059, in request
    response = await response_future
               ^^^^^^^^^^^^^^^^^^^^^
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp
    await self.request(request, timeout=timeout, **response_params)
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1055, in request
    async with async_timeout.timeout(
  File "/usr/local/lib/python3.12/site-packages/async_timeout/__init__.py", line 141, in __aexit__
    self._do_exit(exc_type)
  File "/usr/local/lib/python3.12/site-packages/async_timeout/__init__.py", line 228, in _do_exit
    raise asyncio.TimeoutError
TimeoutError
Logger: homeassistant
Source: /usr/src/homeassistant/homeassistant/runner.py:146
First occurred: April 20, 2024 at 11:00:01 PM (38 occurrences)
Last logged: 12:24:41 AM

Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp
    await self.request(request, timeout=timeout, **response_params)
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1052, in request
    self._uart.send(frame)
    ^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'send'
Logger: zigpy.zcl
Source: runner.py:189
First occurred: April 20, 2024 at 11:00:01 PM (8 occurrences)
Last logged: 12:24:41 AM

[0x3896:1:0xef00] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/quirks/__init__.py", line 228, in command return await self.request( ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 377, in request return await self._endpoint.request( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 253, in request return await self.device.request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 339, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 841, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 959, in send_packet await self._send_request_raw( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 850, in _send_request_raw response = await asyncio.shield( ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp await self.request(request, timeout=timeout, **response_params) File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1052, in request self._uart.send(frame) ^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'send'
[0x7DED:1:0x0000] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 415, in reply return await self._endpoint.reply( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 278, in reply return await self.device.reply( ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 508, in reply return await self.request( ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 334, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 841, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 959, in send_packet await self._send_request_raw( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 850, in _send_request_raw response = await asyncio.shield( ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp await self.request(request, timeout=timeout, **response_params) File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1052, in request self._uart.send(frame) ^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'send'
[0x985E:1:0x0000] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 415, in reply return await self._endpoint.reply( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 278, in reply return await self.device.reply( ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 508, in reply return await self.request( ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 334, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 841, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 959, in send_packet await self._send_request_raw( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 850, in _send_request_raw response = await asyncio.shield( ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp await self.request(request, timeout=timeout, **response_params) File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1052, in request self._uart.send(frame) ^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'send'
[0x44C1:1:0x0500] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 415, in reply return await self._endpoint.reply( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 278, in reply return await self.device.reply( ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 508, in reply return await self.request( ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 334, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 841, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 959, in send_packet await self._send_request_raw( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 850, in _send_request_raw response = await asyncio.shield( ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp await self.request(request, timeout=timeout, **response_params) File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1052, in request self._uart.send(frame) ^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'send'
[0xE6C8:1:0x0000] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 415, in reply return await self._endpoint.reply( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 278, in reply return await self.device.reply( ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 508, in reply return await self.request( ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 334, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 841, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 959, in send_packet await self._send_request_raw( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 850, in _send_request_raw response = await asyncio.shield( ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp await self.request(request, timeout=timeout, **response_params) File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1052, in request self._uart.send(frame) ^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'send'
Logger: homeassistant
Source: components/zha/core/cluster_handlers/__init__.py:514
First occurred: April 20, 2024 at 11:00:01 PM (13 occurrences)
Last logged: 12:24:42 AM

Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/zha/sensor.py", line 272, in _refresh
    await self.async_update()
  File "/usr/src/homeassistant/homeassistant/components/zha/entity.py", line 259, in async_update
    await asyncio.gather(*tasks)
  File "/usr/src/homeassistant/homeassistant/components/zha/core/cluster_handlers/smartenergy.py", line 325, in async_update
    result = await self.get_attributes(attrs, from_cache=False, only_cache=False)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/zha/core/cluster_handlers/__init__.py", line 514, in _get_attributes
    read, _ = await self.cluster.read_attributes(
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 528, in read_attributes
    result = await self.read_attributes_raw(to_read, manufacturer=manufacturer)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/quirks/__init__.py", line 289, in read_attributes_raw
    results = await super().read_attributes_raw(
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/quirks/__init__.py", line 334, in _read_attributes
    return await super()._read_attributes(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 377, in request
    return await self._endpoint.request(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 253, in request
    return await self.device.request(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 339, in request
    await send_request()
  File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 841, in request
    await self.send_packet(
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 959, in send_packet
    await self._send_request_raw(
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 850, in _send_request_raw
    response = await asyncio.shield(
               ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp
    await self.request(request, timeout=timeout, **response_params)
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1052, in request
    self._uart.send(frame)
    ^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'send'

No response

home-assistant[bot] commented 5 months ago

Hey there @dmulcahey, @adminiuga, @puddly, @thejulianjes, mind taking a look at this issue as it has been labeled with an integration (zha) you are listed as a code owner for? Thanks!

Code owner commands Code owners of `zha` can trigger bot actions by commenting: - `@home-assistant close` Closes the issue. - `@home-assistant rename Awesome new title` Renames the issue. - `@home-assistant reopen` Reopen the issue. - `@home-assistant unassign zha` Removes the current integration label and assignees on the issue, add the integration domain after the command. - `@home-assistant add-label needs-more-information` Add a label (needs-more-information, problem in dependency, problem in custom component) to the issue. - `@home-assistant remove-label needs-more-information` Remove a label (needs-more-information, problem in dependency, problem in custom component) on the issue.

(message by CodeOwnersMention)

zha documentation zha source (message by IssueLinks)

HomeAssistantPim commented 5 months ago

got the same issue, is there for the time required to fix this, a way to automatically restore ZHA when this happens?

puddly commented 5 months ago

Does restarting Core (not rebooting!) fix it?

ZHA will automatically reconnect if this happens. If it cannot, this means your adapter is not in a responsive state and must be physically reset.

liamlain commented 5 months ago

Does restarting Core (not rebooting!) fix it?

ZHA will automatically reconnect if this happens. If it cannot, this means your adapter is not in a responsive state and must be physically reset.

not fix after restart core.zha sometime still will initializing randomly ,after that checking log, the 1st log is showing Watchdog failure. After initializing all the devices become available/online automatic.

the problem occur quite random.i cant track what causing this problem

benisdev-py commented 5 months ago

Does restarting Core (not rebooting!) fix it? ZHA will automatically reconnect if this happens. If it cannot, this means your adapter is not in a responsive state and must be physically reset.

not fix after restart core.zha sometime still will initializing randomly ,after that checking log, the 1st log is showing Watchdog failure. After initializing all the devices become available/online automatic.

the problem occur quite random.i cant track what causing this problem

Same error for me

imist commented 5 months ago

Same for me too. Seems related to #115927. It happens when devices become unavailable as per #115927. Not sure which one causes the initial problem. Both were ok in 2024.3

benisdev-py commented 5 months ago

for me it helped to Upgrade to 2024.3 as well and I updated the Firmware of my skyconnector to the newest beta

a421046 commented 5 months ago

Yes, this was not a problem up to and including 2024.3. It started with 2024.4.

liamlain commented 5 months ago

Found out when Watchdog failure error message show,the ZHA will restart (initializing),after that these device show in log. but the devices i track is random according the previous log .

log01

Logger: homeassistant
Source: /usr/src/homeassistant/homeassistant/runner.py:146
First occurred: 7:49:43 PM (41 occurrences)
Last logged: 9:37:24 PM

Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp
    await self.request(request, timeout=timeout, **response_params)
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1059, in request
    response = await response_future
               ^^^^^^^^^^^^^^^^^^^^^
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1097, in request_callback_rsp
    async with async_timeout.timeout(timeout):
  File "/usr/local/lib/python3.12/site-packages/async_timeout/__init__.py", line 141, in __aexit__
    self._do_exit(exc_type)
  File "/usr/local/lib/python3.12/site-packages/async_timeout/__init__.py", line 228, in _do_exit
    raise asyncio.TimeoutError
TimeoutError
Logger: zigpy.application
Source: /usr/local/lib/python3.12/site-packages/zigpy/application.py:675
First occurred: 7:49:58 PM (4 occurrences)
Last logged: 9:37:25 PM

Watchdog failure
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1059, in request
    response = await response_future
               ^^^^^^^^^^^^^^^^^^^^^
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 673, in _watchdog_loop
    await self.watchdog_feed()
  File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 655, in watchdog_feed
    await self._watchdog_feed()
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 628, in _watchdog_feed
    await self._znp.request(c.SYS.Ping.Req())
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1055, in request
    async with async_timeout.timeout(
  File "/usr/local/lib/python3.12/site-packages/async_timeout/__init__.py", line 141, in __aexit__
    self._do_exit(exc_type)
  File "/usr/local/lib/python3.12/site-packages/async_timeout/__init__.py", line 228, in _do_exit
    raise asyncio.TimeoutError
TimeoutError
Logger: zigpy.zcl
Source: runner.py:189
First occurred: 7:49:59 PM (13 occurrences)
Last logged: 9:37:25 PM

[0x2292:1:0x0019] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/clusters/general.py", line 2189, in _handle_query_next_image await self.query_next_image_response( File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 415, in reply return await self._endpoint.reply( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 278, in reply return await self.device.reply( ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 508, in reply return await self.request( ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 334, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 841, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 959, in send_packet await self._send_request_raw( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 850, in _send_request_raw response = await asyncio.shield( ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp await self.request(request, timeout=timeout, **response_params) File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1052, in request self._uart.send(frame) ^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'send'
[0x3BD8:1:0x0006] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 415, in reply return await self._endpoint.reply( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 278, in reply return await self.device.reply( ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 508, in reply return await self.request( ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 334, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 841, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 959, in send_packet await self._send_request_raw( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 850, in _send_request_raw response = await asyncio.shield( ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp await self.request(request, timeout=timeout, **response_params) File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1052, in request self._uart.send(frame) ^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'send'
[0x3B75:1:0x0702] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 415, in reply return await self._endpoint.reply( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 278, in reply return await self.device.reply( ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 508, in reply return await self.request( ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 334, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 841, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 959, in send_packet await self._send_request_raw( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 850, in _send_request_raw response = await asyncio.shield( ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp await self.request(request, timeout=timeout, **response_params) File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1052, in request self._uart.send(frame) ^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'send'
[0xE22A:1:0x0000] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 415, in reply return await self._endpoint.reply( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 278, in reply return await self.device.reply( ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 508, in reply return await self.request( ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 334, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 841, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 959, in send_packet await self._send_request_raw( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 850, in _send_request_raw response = await asyncio.shield( ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp await self.request(request, timeout=timeout, **response_params) File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1052, in request self._uart.send(frame) ^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'send'
[0xEB0B:1:0x0000] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 415, in reply return await self._endpoint.reply( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 278, in reply return await self.device.reply( ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 508, in reply return await self.request( ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 334, in request await send_request() File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 841, in request await self.send_packet( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 959, in send_packet await self._send_request_raw( File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 850, in _send_request_raw response = await asyncio.shield( ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp await self.request(request, timeout=timeout, **response_params) File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1052, in request self._uart.send(frame) ^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'send'
Logger: homeassistant
Source: /usr/src/homeassistant/homeassistant/runner.py:146
First occurred: 7:49:58 PM (44 occurrences)
Last logged: 9:37:25 PM

Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp
    await self.request(request, timeout=timeout, **response_params)
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1052, in request
    self._uart.send(frame)
    ^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'send'
Logger: homeassistant
Source: components/zha/core/cluster_handlers/__init__.py:514
First occurred: 7:49:59 PM (8 occurrences)
Last logged: 9:37:25 PM

Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/zha/sensor.py", line 272, in _refresh
    await self.async_update()
  File "/usr/src/homeassistant/homeassistant/components/zha/entity.py", line 259, in async_update
    await asyncio.gather(*tasks)
  File "/usr/src/homeassistant/homeassistant/components/zha/core/cluster_handlers/smartenergy.py", line 325, in async_update
    result = await self.get_attributes(attrs, from_cache=False, only_cache=False)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/zha/core/cluster_handlers/__init__.py", line 514, in _get_attributes
    read, _ = await self.cluster.read_attributes(
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 528, in read_attributes
    result = await self.read_attributes_raw(to_read, manufacturer=manufacturer)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/quirks/__init__.py", line 289, in read_attributes_raw
    results = await super().read_attributes_raw(
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/quirks/__init__.py", line 334, in _read_attributes
    return await super()._read_attributes(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/zcl/__init__.py", line 377, in request
    return await self._endpoint.request(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/endpoint.py", line 253, in request
    return await self.device.request(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy/device.py", line 339, in request
    await send_request()
  File "/usr/local/lib/python3.12/site-packages/zigpy/application.py", line 841, in request
    await self.send_packet(
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 959, in send_packet
    await self._send_request_raw(
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/zigbee/application.py", line 850, in _send_request_raw
    response = await asyncio.shield(
               ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1098, in request_callback_rsp
    await self.request(request, timeout=timeout, **response_params)
  File "/usr/local/lib/python3.12/site-packages/zigpy_znp/api.py", line 1052, in request
    self._uart.send(frame)
    ^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'send'
TheJulianJES commented 5 months ago

I'm also seeing similar issues after some hours when testing on a TI platform. I wonder if the OTA broadcasts are causing the firmware to crash. Can you try to add the following to your configuration.yaml, restart HA, and then see if the issue still reproduces?

zha:
  zigpy_config:
    ota:
      broadcast_enabled: false
liamlain commented 5 months ago

home-assistant_zha_2024-04-28T15-32-10.969Z.zip i enable debug logging for zha ,here is the debug logging after i checking the log and showing watchdog failure again.im sorry the file size is over 25mb ,so i hv to zip it

liamlain commented 5 months ago

I'm also seeing similar issues after some hours when testing on a TI platform. I wonder if the OTA broadcasts are causing the firmware to crash. Can you try to add the following to your configuration.yaml, restart HA, and then see if the issue still reproduces?

zha:
  zigpy_config:
    ota:
      broadcast_enabled: false

ok,will try it

liamlain commented 5 months ago

I'm also seeing similar issues after some hours when testing on a TI platform. I wonder if the OTA broadcasts are causing the firmware to crash. Can you try to add the following to your configuration.yaml, restart HA, and then see if the issue still reproduces?

zha:
  zigpy_config:
    ota:
      broadcast_enabled: false

ok,will try it

just for update, before add broadcast_enable :false ,here is my yml code:

  zigpy_config:
    ota:
      ikea_provider: false # Auto update Trådfri devices
      ledvance_provider: false # Auto update LEDVANCE/OSRAM devices
      salus_provider: false # Auto update SALUS/Computime devices
      inovelli_provider: false # Auto update INOVELLI devices
      thirdreality_provider: false
liamlain commented 5 months ago

updated after adding the ymal code.look stable until now

erkr commented 5 months ago

Can you try to add the following to your configuration.yaml, restart HA, and then see if the issue still reproduces?

zha:
  zigpy_config:
    ota:
      broadcast_enabled: false

Great! Although I didn't see watchdog timeouts very often, I tried this suggestion. To my surprise All ZHA errors and warnings disappeared. I normally had several unexpected transmit result warnings per hour. My log is clean for 20h now. Just wanted to report that back 👍

Update after 2 days. ZHA Errors/warnings still sometimes occur. It's a few times per day, instead of several per hour

issue-triage-workflows[bot] commented 2 months ago

There hasn't been any activity on this issue recently. Due to the high number of incoming GitHub notifications, we have to clean some of the old issues, as many of them have already been resolved with the latest updates. Please make sure to update to the latest Home Assistant version and check if that solves the issue. Let us know if that works for you by adding a comment 👍 This issue has now been marked as stale and will be closed if no further activity occurs. Thank you for your contributions.