search

home-assistant / core

:house_with_garden: Open source home automation that puts local control and privacy first.
https://www.home-assistant.io
Apache License 2.0
72.09k stars 30.18k forks source link

MQTT stopped working with Aqara curtain motors #110455

Closed segelmange closed 7 months ago

segelmange commented 7 months ago

The problem

Hi,

I have four Aqara curtain motors set up in Home Assistant that I control via Philips Hue remotes set up in Hubitat which in turn communicates with Home Assistant using a Hubitat integration and MQTT. This has worked well for a long time but a week or so ago HA stopped communicating.

The curtain motors seemingly work fine in Home Assitant and I can open and close them using HA. The Philips Hue remotes also works fine in Hubitat and there does not seem to be anything wrong with the Hubitat integration, so I am guessing the issue has to be with MQTT in HA.

Has there been any change recently in HA that could have caused this issue? Anyone have any suggestions for how to persue this issue and try to find a solution?

Many thanks

What version of Home Assistant Core has the issue?

2024.2.1

What was the last working version of Home Assistant Core?

2023.?

What type of installation are you running?

Home Assistant OS

Integration causing the issue

MQTT

Link to integration documentation on our website

No response

Diagnostics information

config_entry-mqtt-1dd33a1f7a0f7e457f94cd78fb00d9f1_2.json

Example YAML snippet

No response

Anything in the logs that might be useful for us?

2024-02-13 09:08:23Received Zigbee message from 'Magnus sovrum gardinmotor höger', type 'attributeReport', cluster 'manuSpecificLumi', data '{"247":{"data":[1,33,184,11,3,40,21,5,33,14,0,10,33,0,0,12,32,1,13,35,27,27,0,0,100,32,2,101,32,144,102,32,131,103,32,10,104,33,27,1,105,32,1,106,32,0,107,32,0],"type":"Buffer"}}' from endpoint 1 with groupID null 2024-02-13 09:08:23ZNCLBL01LM: Processed buffer into data {"1":3000,"3":21,"5":14,"10":0,"12":1,"13":6939,"100":2,"101":144,"102":131,"103":10,"104":283,"105":1,"106":0,"107":0} 2024-02-13 09:08:23ZNCLBL01LM: unknown key 104 with value 283 2024-02-13 09:08:23ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":21,"power_outage_count":13,"battery":72,"position":100,"state":"CLOSE"} 2024-02-13 09:08:23ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":21,"power_outage_count":13,"battery":72,"position":100,"state":"CLOSE"} 2024-02-13 09:08:45Received Zigbee message from 'Magnus sovrum gardinmotor vänster', type 'read', cluster 'genTime', data '["time","timeZone"]' from endpoint 1 with groupID null 2024-02-13 09:09:33Saving state to file /config/zigbee2mqtt/state.json 2024-02-13 09:11:42Received Zigbee message from 'Hedvigs rum gardinmotor höger', type 'attributeReport', cluster 'manuSpecificLumi', data '{"247":{"data":[1,33,184,11,3,40,24,5,33,8,0,10,33,0,0,12,32,1,13,35,24,25,0,0,100,32,2,101,32,144,102,32,131,103,32,8,104,33,25,1,105,32,1,106,32,0,107,32,100],"type":"Buffer"}}' from endpoint 1 with groupID null 2024-02-13 09:11:42ZNCLBL01LM: Processed buffer into data {"1":3000,"3":24,"5":8,"10":0,"12":1,"13":6424,"100":2,"101":144,"102":131,"103":8,"104":281,"105":1,"106":0,"107":100} 2024-02-13 09:11:42ZNCLBL01LM: unknown key 104 with value 281 2024-02-13 09:11:42ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":24,"power_outage_count":7,"battery":72,"position":0,"state":"OPEN"} 2024-02-13 09:11:42ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":24,"power_outage_count":7,"battery":72,"position":0,"state":"OPEN"} 2024-02-13 09:12:40Received Zigbee message from 'Magnus sovrum gardinmotor vänster', type 'attributeReport', cluster 'manuSpecificLumi', data '{"247":{"data":[1,33,184,11,3,40,21,5,33,48,0,10,33,0,0,12,32,1,13,35,27,27,0,0,100,32,3,101,32,150,102,32,131,103,32,6,104,33,27,1,105,32,1,106,32,0,107,32,12],"type":"Buffer"}}' from endpoint 1 with groupID null 2024-02-13 09:12:40ZNCLBL01LM: Processed buffer into data {"1":3000,"3":21,"5":48,"10":0,"12":1,"13":6939,"100":3,"101":150,"102":131,"103":6,"104":283,"105":1,"106":0,"107":12} 2024-02-13 09:12:40ZNCLBL01LM: unknown key 104 with value 283 2024-02-13 09:12:40ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":21,"power_outage_count":47,"battery":75,"position":88,"state":"CLOSE"} 2024-02-13 09:12:40ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":21,"power_outage_count":47,"battery":75,"position":88,"state":"CLOSE"} 2024-02-13 09:13:38Received MQTT message on 'zigbee2mqtt/bridge/request/device/ota_update/update' with data '{"id": "0x54ef441000676abe"}' 2024-02-13 09:13:39Received Zigbee message from 'Magnus sovrum gardinmotor vänster', type 'readResponse', cluster 'genBasic', data '{"dateCode":"May 31 2022","swBuildId":"0.0.0_0027"}' from endpoint 1 with groupID null 2024-02-13 09:13:39OTA: Updating to latest '0x54ef441000676abe' (lumi.curtain.agl001) 2024-02-13 09:13:39OTA: Using endpoint '1' 2024-02-13 09:13:40Received Zigbee message from 'Magnus sovrum gardinmotor vänster', type 'commandQueryNextImageRequest', cluster 'genOta', data '{"fieldControl":0,"fileVersion":27,"imageType":4105,"manufacturerCode":4447}' from endpoint 1 with groupID null 2024-02-13 09:13:40OTA: Got request '{"fieldControl":0,"manufacturerCode":4447,"imageType":4105,"fileVersion":27}' 2024-02-13 09:13:40ZigbeeOTA: Getting image metadata for 'lumi.curtain.agl001' 2024-02-13 09:13:40ZigbeeOTA: Downloaded main index 2024-02-13 09:13:40OTA: Getting new image for '0x54ef441000676abe' (lumi.curtain.agl001), latest meta {"fileVersion":6168,"fileSize":288213,"url":"https://github.com/Koenkk/zigbee-OTA/raw/master/images/Lumi/20220506181329_lumi.curtain.agl001_Multi_JN5189_FMSH_0.0.0_2424_20220422_1aa302.ota","sha512":"0d1bae25759420898d381b98e97858d2e47f48cd3495abd8754661d0e1957eb5b570a2ae7435acc435d5a18665409e07148abae6f1f4a190c9af786d94ec725d"} 2024-02-13 09:13:40OTA: Downloading firmware image from 'https://github.com/Koenkk/zigbee-OTA/raw/master/images/Lumi/20220506181329_lumi.curtain.agl001_Multi_JN5189_FMSH_0.0.0_2424_20220422_1aa302.ota' using the zigbeeOTA custom CA certificates 2024-02-13 09:13:41OTA: Update checksum validation succeeded for '0x54ef441000676abe' (lumi.curtain.agl001) 2024-02-13 09:13:41OTA: Get new image for '0x54ef441000676abe' (lumi.curtain.agl001), image header {"otaUpgradeFileIdentifier":{"type":"Buffer","data":[30,241,238,11]},"otaHeaderVersion":256,"otaHeaderLength":56,"otaHeaderFieldControl":0,"manufacturerCode":4447,"imageType":4105,"fileVersion":6168,"zigbeeStackVersion":2,"otaHeaderString":"CURTAIN-OCC-JN5189---ENCRYPTED00","totalImageSize":288213} 2024-02-13 09:13:41OTA: Got new image for '0x54ef441000676abe' (lumi.curtain.agl001) 2024-02-13 09:13:41OTA: Starting upgrade 2024-02-13 09:13:42Received Zigbee message from 'Magnus sovrum gardinmotor vänster', type 'commandQueryNextImageRequest', cluster 'genOta', data '{"fieldControl":0,"fileVersion":27,"imageType":4105,"manufacturerCode":4447}' from endpoint 1 with groupID null 2024-02-13 09:13:54Received Zigbee message from 'Hedvigs rum gardinmotor vänster', type 'attributeReport', cluster 'manuSpecificLumi', data '{"247":{"data":[1,33,184,11,3,40,24,5,33,1,0,10,33,0,0,12,32,1,13,35,24,25,0,0,100,32,2,101,32,144,102,32,131,103,32,8,104,33,25,1,105,32,1,106,32,0,107,32,0],"type":"Buffer"}}' from endpoint 1 with groupID null 2024-02-13 09:13:54ZNCLBL01LM: Processed buffer into data {"1":3000,"3":24,"5":1,"10":0,"12":1,"13":6424,"100":2,"101":144,"102":131,"103":8,"104":281,"105":1,"106":0,"107":0} 2024-02-13 09:13:54ZNCLBL01LM: unknown key 104 with value 281 2024-02-13 09:13:54ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":24,"power_outage_count":0,"battery":72,"position":0,"state":"CLOSE"} 2024-02-13 09:13:54ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":24,"power_outage_count":0,"battery":72,"position":0,"state":"CLOSE"} 2024-02-13 09:14:31Received Zigbee message from 'Magnus sovrum gardinmotor höger', type 'attributeReport', cluster 'manuSpecificLumi', data '{"247":{"data":[1,33,184,11,3,40,21,5,33,14,0,10,33,0,0,12,32,1,13,35,27,27,0,0,100,32,2,101,32,144,102,32,131,103,32,10,104,33,27,1,105,32,1,106,32,0,107,32,0],"type":"Buffer"}}' from endpoint 1 with groupID null 2024-02-13 09:14:31ZNCLBL01LM: Processed buffer into data {"1":3000,"3":21,"5":14,"10":0,"12":1,"13":6939,"100":2,"101":144,"102":131,"103":10,"104":283,"105":1,"106":0,"107":0} 2024-02-13 09:14:31ZNCLBL01LM: unknown key 104 with value 283 2024-02-13 09:14:31ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":21,"power_outage_count":13,"battery":72,"position":100,"state":"CLOSE"} 2024-02-13 09:14:31ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":21,"power_outage_count":13,"battery":72,"position":100,"state":"CLOSE"} 2024-02-13 09:14:33Saving state to file /config/zigbee2mqtt/state.json 2024-02-13 09:16:11Update of 'Magnus sovrum gardinmotor vänster' failed (Error: OTA: Timeout, device did not request any image blocks) 2024-02-13 09:16:11Error: OTA: Timeout, device did not request any image blocks at /app/node_modules/zigbee-herdsman-converters/src/lib/ota/common.ts:518:28 at runNextTicks (node:internal/process/task_queues:60:5) at listOnTimeout (node:internal/timers:538:9) at processTimers (node:internal/timers:512:7) 2024-02-13 09:17:57Received Zigbee message from 'Hedvigs rum gardinmotor höger', type 'attributeReport', cluster 'manuSpecificLumi', data '{"247":{"data":[1,33,184,11,3,40,24,5,33,8,0,10,33,0,0,12,32,1,13,35,24,25,0,0,100,32,2,101,32,144,102,32,131,103,32,8,104,33,25,1,105,32,1,106,32,0,107,32,100],"type":"Buffer"}}' from endpoint 1 with groupID null 2024-02-13 09:17:57ZNCLBL01LM: Processed buffer into data {"1":3000,"3":24,"5":8,"10":0,"12":1,"13":6424,"100":2,"101":144,"102":131,"103":8,"104":281,"105":1,"106":0,"107":100} 2024-02-13 09:17:57ZNCLBL01LM: unknown key 104 with value 281 2024-02-13 09:17:57ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":24,"power_outage_count":7,"battery":72,"position":0,"state":"OPEN"} 2024-02-13 09:17:57ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":24,"power_outage_count":7,"battery":72,"position":0,"state":"OPEN"} 2024-02-13 09:18:50Received Zigbee message from 'Magnus sovrum gardinmotor vänster', type 'attributeReport', cluster 'manuSpecificLumi', data '{"247":{"data":[1,33,184,11,3,40,21,5,33,48,0,10,33,0,0,12,32,1,13,35,27,27,0,0,100,32,3,101,32,150,102,32,131,103,32,6,104,33,27,1,105,32,1,106,32,0,107,32,12],"type":"Buffer"}}' from endpoint 1 with groupID null 2024-02-13 09:18:50ZNCLBL01LM: Processed buffer into data {"1":3000,"3":21,"5":48,"10":0,"12":1,"13":6939,"100":3,"101":150,"102":131,"103":6,"104":283,"105":1,"106":0,"107":12} 2024-02-13 09:18:50ZNCLBL01LM: unknown key 104 with value 283 2024-02-13 09:18:50ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":21,"power_outage_count":47,"battery":75,"position":88,"state":"CLOSE"} 2024-02-13 09:18:50ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":21,"power_outage_count":47,"battery":75,"position":88,"state":"CLOSE"} 2024-02-13 09:19:33Saving state to file /config/zigbee2mqtt/state.json 2024-02-13 09:20:08Received Zigbee message from 'Hedvigs rum gardinmotor vänster', type 'attributeReport', cluster 'manuSpecificLumi', data '{"247":{"data":[1,33,184,11,3,40,24,5,33,1,0,10,33,0,0,12,32,1,13,35,24,25,0,0,100,32,2,101,32,144,102,32,131,103,32,8,104,33,25,1,105,32,1,106,32,0,107,32,0],"type":"Buffer"}}' from endpoint 1 with groupID null 2024-02-13 09:20:08ZNCLBL01LM: Processed buffer into data {"1":3000,"3":24,"5":1,"10":0,"12":1,"13":6424,"100":2,"101":144,"102":131,"103":8,"104":281,"105":1,"106":0,"107":0} 2024-02-13 09:20:08ZNCLBL01LM: unknown key 104 with value 281 2024-02-13 09:20:08ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":24,"power_outage_count":0,"battery":72,"position":0,"state":"CLOSE"} 2024-02-13 09:20:08ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":24,"power_outage_count":0,"battery":72,"position":0,"state":"CLOSE"} 2024-02-13 09:20:12Received Zigbee message from 'Hedvigs rum gardinmotor höger', type 'read', cluster 'genTime', data '["time","timeZone"]' from endpoint 1 with groupID null 2024-02-13 09:20:59Received Zigbee message from 'Magnus sovrum gardinmotor höger', type 'attributeReport', cluster 'manuSpecificLumi', data '{"247":{"data":[1,33,184,11,3,40,21,5,33,14,0,10,33,0,0,12,32,1,13,35,27,27,0,0,100,32,2,101,32,144,102,32,131,103,32,10,104,33,27,1,105,32,1,106,32,0,107,32,0],"type":"Buffer"}}' from endpoint 1 with groupID null 2024-02-13 09:20:59ZNCLBL01LM: Processed buffer into data {"1":3000,"3":21,"5":14,"10":0,"12":1,"13":6939,"100":2,"101":144,"102":131,"103":10,"104":283,"105":1,"106":0,"107":0} 2024-02-13 09:20:59ZNCLBL01LM: unknown key 104 with value 283 2024-02-13 09:20:59ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":21,"power_outage_count":13,"battery":72,"position":100,"state":"CLOSE"} 2024-02-13 09:20:59ZNCLBL01LM: Processed data into payload {"voltage":3000,"device_temperature":21,"power_outage_count":13,"battery":72,"position":100,"state":"CLOSE"} 2024-02-13 09:21:02Received MQTT message on 'zigbee2mqtt/bridge/request/device/ota_update/update' with data '{"id": "0x54ef441000676abe"}' 2024-02-13 09:21:03Received Zigbee message from 'Magnus sovrum gardinmotor vänster', type 'readResponse', cluster 'genBasic', data '{"dateCode":"May 31 2022","swBuildId":"0.0.0_0027"}' from endpoint 1 with groupID null 2024-02-13 09:21:03OTA: Updating to latest '0x54ef441000676abe' (lumi.curtain.agl001) 2024-02-13 09:21:03OTA: Using endpoint '1' 2024-02-13 09:21:04Received Zigbee message from 'Magnus sovrum gardinmotor vänster', type 'commandQueryNextImageRequest', cluster 'genOta', data '{"fieldControl":0,"fileVersion":27,"imageType":4105,"manufacturerCode":4447}' from endpoint 1 with groupID null 2024-02-13 09:21:04OTA: Got request '{"fieldControl":0,"manufacturerCode":4447,"imageType":4105,"fileVersion":27}' 2024-02-13 09:21:04ZigbeeOTA: Getting image metadata for 'lumi.curtain.agl001' 2024-02-13 09:21:04ZigbeeOTA: Downloaded main index 2024-02-13 09:21:04OTA: Getting new image for '0x54ef441000676abe' (lumi.curtain.agl001), latest meta {"fileVersion":6168,"fileSize":288213,"url":"https://github.com/Koenkk/zigbee-OTA/raw/master/images/Lumi/20220506181329_lumi.curtain.agl001_Multi_JN5189_FMSH_0.0.0_2424_20220422_1aa302.ota","sha512":"0d1bae25759420898d381b98e97858d2e47f48cd3495abd8754661d0e1957eb5b570a2ae7435acc435d5a18665409e07148abae6f1f4a190c9af786d94ec725d"} 2024-02-13 09:21:04OTA: Downloading firmware image from 'https://github.com/Koenkk/zigbee-OTA/raw/master/images/Lumi/20220506181329_lumi.curtain.agl001_Multi_JN5189_FMSH_0.0.0_2424_20220422_1aa302.ota' using the zigbeeOTA custom CA certificates 2024-02-13 09:21:05OTA: Update checksum validation succeeded for '0x54ef441000676abe' (lumi.curtain.agl001) 2024-02-13 09:21:05OTA: Get new image for '0x54ef441000676abe' (lumi.curtain.agl001), image header {"otaUpgradeFileIdentifier":{"type":"Buffer","data":[30,241,238,11]},"otaHeaderVersion":256,"otaHeaderLength":56,"otaHeaderFieldControl":0,"manufacturerCode":4447,"imageType":4105,"fileVersion":6168,"zigbeeStackVersion":2,"otaHeaderString":"CURTAIN-OCC-JN5189---ENCRYPTED00","totalImageSize":288213} 2024-02-13 09:21:05OTA: Got new image for '0x54ef441000676abe' (lumi.curtain.agl001) 2024-02-13 09:21:05OTA: Starting upgrade 2024-02-13 09:21:05Received Zigbee message from 'Magnus sovrum gardinmotor vänster', type 'commandQueryNextImageRequest', cluster 'genOta', data '{"fieldControl":0,"fileVersion":27,"imageType":4105,"manufacturerCode":4447}' from endpoint 1 with groupID null 2024-02-13 09:22:15Received Zigbee message from 'Magnus sovrum gardinmotor höger', type 'read', cluster 'genTime', data '["time","timeZone"]' from endpoint 1 with groupID null

Additional information

No response

home-assistant[bot] commented 7 months ago

Hey there @emontnemery, @jbouwh, mind taking a look at this issue as it has been labeled with an integration (mqtt) you are listed as a code owner for? Thanks!

Code owner commands Code owners of `mqtt` can trigger bot actions by commenting: - `@home-assistant close` Closes the issue. - `@home-assistant rename Awesome new title` Renames the issue. - `@home-assistant reopen` Reopen the issue. - `@home-assistant unassign mqtt` Removes the current integration label and assignees on the issue, add the integration domain after the command. - `@home-assistant add-label needs-more-information` Add a label (needs-more-information, problem in dependency, problem in custom component) to the issue. - `@home-assistant remove-label needs-more-information` Remove a label (needs-more-information, problem in dependency, problem in custom component) on the issue.

(message by CodeOwnersMention)

mqtt documentation mqtt source (message by IssueLinks)

jbouwh commented 7 months ago

This is not a place for Zigbee2MQTT support. If there is an issue with MQTT make sure to supply a config (discovery payload) a related state payload or action that causes the error, and logging (HA Core logging). If needed turn on debug logging.

pooh22 commented 7 months ago

I'm also having a problem with MQTT integration, I've yet to find out where the problem lies, but the moment I updated to 2024.2 (using the web interface, I have a docker installation on a VM) my energy usage data disappeared from the energy board. Interestingly, my solar power input remains, but I forget how it gets from the rpi running sbfspot to the HASS installation. (I think it also uses mqtt).

When I try to listen for the MQTT messages using the web interface for the integration, the messages don't show up.

The energy (electricity) usage information is a home made script in python which is still working, as it also sends information to my older icinga monitoring. Strangely, this rpi is running two independent monitoring scripts, both sending information using the paho.mqtt.client library. The heating information is still getting through, the electricity usage is not.

So to summarize: After the update to 2024.2.x my electricity information disappeared from the board, solar generation from sbfspot and heating usage is still getting through. as far as I know all are using MQTT as the means to send the information to HA. The listen option of the integration is not seeing the messages sent with "energy" or "sfbspot" labels.

jbouwh commented 7 months ago

I'm also having a problem with MQTT integration, I've yet to find out where the problem lies, but the moment I updated to 2024.2 (using the web interface, I have a docker installation on a VM) my energy usage data disappeared from the energy board. Interestingly, my solar power input remains, but I forget how it gets from the rpi running sbfspot to the HASS installation. (I think it also uses mqtt).

When I try to listen for the MQTT messages using the web interface for the integration, the messages don't show up.

The energy (electricity) usage information is a home made script in python which is still working, as it also sends information to my older icinga monitoring. Strangely, this rpi is running two independent monitoring scripts, both sending information using the paho.mqtt.client library. The heating information is still getting through, the electricity usage is not.

So to summarize: After the update to 2024.2.x my electricity information disappeared from the board, solar generation from sbfspot and heating usage is still getting through. as far as I know all are using MQTT as the means to send the information to HA. The listen option of the integration is not seeing the messages sent with "energy" or "sfbspot" labels.

@pooh22 Seems this is not related. Note that an issue should address an issue in HA Core. If that is the case please open a new issue and include related HA Core logs, MQTT entity YAML config (or discovery payload).

jbouwh commented 7 months ago

@segelmange Can you supply the requested info, else I need to close this issue.

jbouwh commented 7 months ago

Closing as I assume this is not an issue with HA core.