dresden-elektronik / deconz-rest-plugin

deCONZ REST-API plugin to control ZigBee devices
BSD 3-Clause "New" or "Revised" License
1.9k stars 498 forks source link

Devices keep dropping #7425

Closed easybeat closed 8 months ago

easybeat commented 10 months ago

Does the issue really belong here?

Is there already an existing issue for this?

Describe the bug

As in another handful bugs described here:

https://github.com/dresden-elektronik/deconz-rest-plugin/issues/2710 https://github.com/dresden-elektronik/deconz-rest-plugin/issues/6201

I'm facing the same problem since I'm using Deconz for YEARS

Connections 2023-12-10 161622 5 Mins. after restart

Connections 2023-12-10 162436 15 Mins. after restart

As @dawiinci mentioned here: https://github.com/dresden-elektronik/deconz-rest-plugin/issues/6201 is this a bug in the firmware?

Steps to reproduce the behavior

  1. start deconz-gui
  2. wait 5 Mins. and check connections
  3. wait 15 Mins. and check connections again

Expected behavior

No connections should be dropped

Screenshots

No response

Environment

deCONZ Logs

No response

Additional context

No response

easybeat commented 10 months ago

Here my log files deconz log droping lights.txt

Mimiix commented 10 months ago

The discussion about closing issues is not going to be held here. If you want to have that, open a post on the forums.

For the latter, others are more suitable to answer it.

manup commented 10 months ago

Does this happen with the latest release too? There were quite a bunch of fixes in regards to poll and keep devices alive.

easybeat commented 10 months ago

Yes it also happens with 2.24.2 ...did an update yesterday on the proxmox machine but was exactly the same....and it continues to lose more and more lamps!!

Very very anoying!

easybeat commented 10 months ago

@manup And just to make clear I have 2 different systems which I have the same symptoms...just one gone completely by now. And this was running since about 3 years but always had this symptoms but whenever I power cycled the lights they came back on. But not now! Powercycle doesn't help.

I have a backup back from June which I try to restore now because there everything was ok.

manup commented 10 months ago

Currently I wouldn't recommend to switch between versions, but get to the cause where it fails. Can you please check if DDFs are enabled via Menu -> Panels -> Control, should look like:

image

The logs above don't show hard networks errors as most/all commands get confirmed but there also appears to be mostly legacy traffic.

With DEV and DDF logging enabled in Help -> Debug view we should see more. It would be helpful to then pick one device which goes unreachable and check what happens there.

easybeat commented 10 months ago

Yes DDF is on image

DDF error log.txt here the ddf log

Mimiix commented 10 months ago

Yes DDF is on image

DDF error log.txt here the ddf log

Are you sure the DEV log is enabled on that log ?

easybeat commented 10 months ago

sorry missed dev DDF error log.txt

manup commented 10 months ago

14:08:44:311 DEV Poll Busy /devices/0x00178801011445B8 ZCL response seq: 59, status: 0x86, cluster: 0x0008

Now this looks interesting, which modelid does the 0x00178801011445B8 have – can be seen in the Node Info Panel (it's a Philips / Signify device)? The 0x86 means Unsupported Attribute, perhaps the DDF tries to read attributes which are only available in newer lights firmware, have to check with the other devs.

easybeat commented 10 months ago

image It is a Hue GO

easybeat commented 10 months ago

and it shows all ok with it image

manup commented 10 months ago

And this Hue Go does drop off after a while as well? When you power-cycle a light which has dropped off does it come back and can be controlled?

easybeat commented 10 months ago

No the Hue GO always works it's the lights WAND image

or now even some IKEA Range Extenders image

all different manufactorers failing now

manup commented 10 months ago

Also can you please provide the firmware version for the Hue Go as shown in the Basic Cluster: When you double click on the node and then double click on Basic (first item in the list)

Then press "read" in the attributes table:

image

manup commented 10 months ago

No the Hue GO always works it's the lights WAND image

or now even some IKEA Range Extenders image

all different manufactorers failing now

Hmm can't see these in the logs (perhaps too short), but this is still the old deCONZ version? It would be really helpful to make the tests with the recent version.

easybeat commented 10 months ago

image

easybeat commented 10 months ago

No the Hue GO always works it's the lights WAND image or now even some IKEA Range Extenders image all different manufactorers failing now

Hmm can't see these in the logs (perhaps too short), but this is still the old deCONZ version? It would be really helpful to make the tests with the recent version.

well I can do the update to 2.24.2 if you want me too

easybeat commented 10 months ago

which logs do you want from 2.24.2? DDF and DEV? on startup?

manup commented 10 months ago

Ideally DDF + DEV APS, ZDP and INFO over 10-20 minutes. That's quite noisy but should show more what's going on

easybeat commented 10 months ago

ok...tell me how to get a 20 mins. log from Deconz-GUI...it seems only to copy 3 minutes

easybeat commented 10 months ago

image on 2.24.2 looks the same after a few minutes they seem to connect

image but if I go into Phoscon the lights show all greyed out

easybeat commented 10 months ago

Deconz log 1504-1507.txt first 3 minutes

manup commented 10 months ago

Oh sorry I forgot the UI is too limited here. Longer logs can be done via command line, for example start deCONZ via:

deCONZ --http-port=80 --dbg-aps=1 --dbg-info=1 --dbg-zdp=1 --dbg-dev=1 --dbg-ddf=1 | tee log.txt
easybeat commented 10 months ago

Deconz log 1504-1510.txt somehow it seems to work

easybeat commented 10 months ago

Deconz log 1507-1513.txt 6 Mins. steps I can do...hope that's ok

easybeat commented 10 months ago

Deconz log 1513-1519.txt another 6 Mins.

easybeat commented 10 months ago

image and by the way the Ikea Range Extenders have not been recognized anymore

easybeat commented 10 months ago

Deconz log 1519-1525.txt that's 21 Mins. do you need more?

manup commented 10 months ago

Hmm interesting I'm looking after the 0x00158D0000B1EF40 (Wand04 ?) This one is seen by many devices but no attempt yet to contact it (.. Deconz.log.1507-1513.txt).

This one doesn't have a DDF yet nor the Paul Neuhaus lights, so there seems to be something off with the legacy code :thinking:

The Ikea repeaters however should work once they are queried (this may take a bit the first time they are used via DDF).

easybeat commented 10 months ago

the wand lights are all paul neuhaus lights...

but should this allow to crash the whole system?

easybeat commented 10 months ago

Deconz log 1525-1531.txt I think in this 6 minutes light wand 03 lost the green line image

easybeat commented 10 months ago

Hmm interesting I'm looking after the 0x00158D0000B1EF40 (Wand04 ?) This one is seen by many devices but no attempt yet to contact it (.. Deconz.log.1507-1513.txt).

This one doesn't have a DDF yet nor the Paul Neuhaus lights, so there seems to be something off with the legacy code 🤔

The Ikea repeaters however should work once they are queried (this may take a bit the first time they are used via DDF).

Any more ideas how to get this system back to work...my friends are not very happy that they can't operate their lights :-(

easybeat commented 10 months ago

image also the Ikea Range Extender are still not recognized

easybeat commented 10 months ago

@manup Any more help today?

manup commented 10 months ago

I'd propose we make a live session perhaps with Teamviewer tomorrow or Wednesday? In addition if you can send me the zll.db file (or a backup) to support@dresden-elektronik.de I can try to make DDFs for the missing devices to check if that solves the issue.

easybeat commented 10 months ago

Thanks Manu.

yes live session tomorrow would be helpful. I'm available from 08.00 - 11.00 GMT+1

I expect you are in Germany? I'm from Switzerland...so we can then also change to German...

I've sent the backup files to you support e-mail.

manup commented 10 months ago

Thanks for the backup that helped to debug where the loading stopped.

Unfortunately I can't manage to be available before 14/15.00. However I've compiled a test version which loads the Ikea repeater directly (there was also another related fix that's scheduled for v2.25.0) and also added a DDF for the CREEBLE JZ-RGBW-Z01 light. Can you please try if these two are working better and don't fall off the network.

If they work I'd like to create DDFs for the remaining devices, should max. 2-3 devices. There is still an open issue with the legacy code handling, but moving the old device integrations to DDF is good in any case. deconz_2.24.2-debian_armhf.zip (test version)

easybeat commented 10 months ago

Thank you for the new version. But how do I have to install this?

I run it on an Ubuntu 20.04 desktop and get this error message: image

easybeat commented 10 months ago

Unfortunately I can't manage to be available before 14/15.00.

And yes I could also do these times...let me know

manup commented 10 months ago

Thank you for the new version. But how do I have to install this? I run it on an Ubuntu 20.04 desktop and get this error message:

Oh damn my bad, thought you're running on a Raspberry Pi. Here is the version for Desktop AMD64

deconz_2.24.2-debian_amd64.zip

easybeat commented 10 months ago

np...I'll try to install now

easybeat commented 10 months ago

image It says now that a never version is already installed...should I try it on the machine with the 2.22.0 version?

manup commented 10 months ago

I guess that's the Ubuntu UI installer thing.. Better make this on the command line:

sudo dpkg -i deconz_2.24.2-debian_amd64.deb

easybeat commented 10 months ago

ok installed it from command line over the 2.22.0 installation...can also try on the box with 2.24.2 already installed

It looks not much different to me image

image in phoscon still all greyed out

here is the log from first 6 Mins. Deconz log 20231212 1455-1501.txt

easybeat commented 10 months ago

Deconz log 20231212 1501-1505.txt next 5 Mins.

manup commented 10 months ago

Cool thanks, the Ikea range extender and Greeble lights are loaded via DDF now (for Ikea repeater the actual name is shown which wasn't before so it did pick up the code changes here). I think next it makes sense to let it run for a while to see if it settles on these devices, I'll check the logs

easybeat commented 10 months ago

image I don't think it works as it has lost a lot of green lines already to Ikea and Wand-Lights

easybeat commented 10 months ago

Deconz log 20231212 1508-1511.txt

easybeat commented 10 months ago

[Uploading Deconz log 20231212 1512-1515.txt…]()