Closed VivantSenior closed 4 years ago
@VivantSenior thanks for opening this, I was just logging in to open this issue myself.
I can confirm this issue. My config:
Logs: 2019-12-20 12:23:51 ERROR (MainThread) [homeassistant.components.deconz] Error connecting to deCONZ gateway at x.x.x.x 2019-12-20 12:24:04 ERROR (MainThread) [homeassistant.core] Error doing job: Unclosed connection
Same here. I've only got the VNC port left to configure.
Same here... Devices are found on Phoscon GW web page, but entities are missing from HA.
How to revert to previous version?
Reinstalling the addon did not help, but I fixed it by simple removing the Integration and adding it back in. Solved the issues for me.
Same here...
Conbee 2, VM running debian buster, Hass.io 0.103.2, deCONZ add-on 4.1.
Devices are still in the Phoscon GW but no entities in HA.
Error connecting to deCONZ gateway at 192.168.0.31 14:04 components/deconz/gateway.py (ERROR) - Meddelandet inträffade först 13:56 och har hänt 10 gånger Config entry for deconz not ready yet. Retrying in 40 seconds. 13:57 config_entries.py (WARNING)
Changed password and readded integration, entities are now back... but various device names are changed. For some reason, some Xiaomi multi sensors now have temperature and humidity values swapped.
@VivantSenior @jan-dewit The add-on sends a reconfiguration discovery notification to Home Assistant to adjust the settings. However, if in the past a manual configuration flow was used, that probably won't work in that case. The only solution at that point is by removing the integration -> restart Home Assistant -> restart the add-on. After that, a integration should be discovered and visible on the integration screen.
@pboschi @roaringbits, you guys already did the above 👍 @pboschi The naming of devices is something the integration handles and is not in control for the add-on. If that is a reproducible issue, please be sure to raise an issue on the Home Assistant repository, so the maintainer of the integration can look into it.
@hellcry37 The add-on is now available over Ingress and does not use ports anymore. This makes the add-on available from the Home Assistant frontend, no matter how or where you log into it. For example, when using a remote UI, the add-on can be used, without any port forwarding. Most add-ons do this already, this one is now following.
@frenck The add-on sends a reconfiguration discovery notification to Home Assistant to adjust the settings. However, if in the past a manual configuration flow was used, that probably won't work in that case. The only solution at that point is by removing the integration -> restart Home Assistant -> restart the add-on. After that, a integration should be discovered and visible on the integration screen.
Thanks for the workaround! But I'm a little worried that I would need to rename all entities again if I remove and re-add the integration. Or will the naming be preserved?
To my understanding, the issue is only with the Xiaomi multi-sensors and is due to the fact that they get named sensor.[name], sensor.[name]_2 and sensor.[name]_3, to report the three values of pressure, humidity and temperature. Every time you re-integrate Deconz (which is necessary after the 4.1 update), the order changes, so their entire history turn into garbage.
@newlund That is, unfortunately, likely to happen indeed. There is a workaround for that (but requires to be a bit of a hero, by editing the storage manually so the integration uses core-deconz
as the hostname to connect to instead). But honestly, if you run into this, the integration isn't really set up correctly. Personally I would bite that bullet once, so in future changes, Home Assistant will be able to pick up automatically.
@pboschi The good news is that the add-on now ensures that it uses a mechanism that allows for automatic updates of settings in the future. So re-adding the integration should not be needed anymore.
@frenck Yes, I will do it as soon as I have time. Thanks!
As a temporary solution, should I change the "host" parameter to "core-deconz" in /usr/share/hassio/homeassistant/.storage/core.config_entries and restart HA?
{ "connection_class": "local_push", "data": { "api_key": "xxxxxxxxxx", "bridgeid": "00212EFFFF0406F2", "host": "192.168.0.31", "port": 40850, "uuid": "9ab523fd-7ec8-4d61-a992-9614eb7a6754" }, "domain": "deconz", "entry_id": "b2d089ec8ef94a239551f94a1430005f", "options": { "allow_clip_sensor": false, "allow_deconz_groups": true, "master": true }, "source": "user", "system_options": { "disable_new_entities": false }, "title": "deCONZ-00212EFFFF0406F2", "version": 1 },
@newlund Yes, that might work, however, you've just published your deCONZ api_key
(just so you know).
@frenck Ooops... :) However, my instance is not available from the internet (only via nabu casa remote ui). Should not pose any risk. Right?
I guess you are fine in that case :wink:
Do I have to reinstall the deconz addon in order to change the API key?
Yep, however, with the 4.x add-on, it is no longer possible to reach the API from the outside world. I would not worry to much about it.
@frenck Ok, thank you very much! 🙂
Hello,
deCONZ 4.1 is missing webport 40850 as docker . Can't do anymore api's
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2f1cc87615f1 homeassistant/armhf-addon-deconz:4.1 "/run.sh" 11 minutes ago Up 11 minutes addon_core_deconz 37ac9e5d2e51 hassioaddons/mqtt:1.1.0 "/init" 22 hours ago Up 22 hours 0.0.0.0:1883-1884->1883-1884/tcp, 0.0.0.0:4883-4884->4883-4884/tcp addon_a0d7b954_mqtt 928e38084d62 homeassistant/armv7-addon-configurator:4.1 "/run.sh" 30 hours ago Up 30 hours addon_core_configurator 541424ca1f3c homeassistant/armv7-hassio-dns:1 "coredns -conf /conf…" 36 hours ago Up 36 hours hassio_dns 68593b65105e homeassistant/armv7-hassio-supervisor "/bin/entry.sh pytho…" 36 hours ago Up 36 hours hassos_supervisor 87b6f67a0ab6 homeassistant/armv7-addon-ssh:7.1 "/run.sh" 6 days ago Up 6 days 0.0.0.0:22->22/tcp addon_core_ssh db02b37dc5e7 hassioaddons/grafana-armv7:3.0.2 "/init" 2 weeks ago Up 2 weeks addon_a0d7b954_grafana 64307b482bb5 hassioaddons/influxdb-armv7:3.4.1 "/init" 2 weeks ago Up 2 weeks 0.0.0.0:8086->8086/tcp addon_a0d7b954_influxdb c6ab762fd625 homeassistant/raspberrypi3-homeassistant:0.101.3 "/bin/entry.sh pytho…" 4 weeks ago Up 18 minutes homeassistant
Do I have to reinstall the deconz addon in order to change the API key?
Do I have to reinstall the deconz addon in order to change the API key?
You can remove the api :D check the link below https://dresden-elektronik.github.io/deconz-rest-doc/configuration/#aquireapikey
@intelroman It is not missing, is has been removed. Please read up a bit on this issue, as it has been mentioned before. Ingress support has been added.
@intelroman It is not missing, is has been removed. Please read up a bit on this issue, as it has been mentioned before. Ingress support has been added.
Yes Frank is ok .. but i need for external app to do API .. do you recommend another way to do API ?
I'm trying to investigate now a Smart plug that the system see as light .. and i need api to get the power meter .
@intelroman Home Assistant reads up the data from deCONZ, you might be able to use the Home Assistant API's for that?
I'm not sure ..i don't see the data in the HASSIO .. trying to do the manual the DNAT but is still not working :D ... is funny . The ports are still open in the container: root@core-deconz:/# ss -l Netid State Recv-Q Send-Q Local Address:Port Peer Address:Port u_seq LISTEN 0 0 /run/udev/control 8628395 0 tcp LISTEN 0 128 :8099 : tcp LISTEN 0 50 :8081 : tcp LISTEN 0 50 :40850 : tcp LISTEN 0 128 127.0.0.11:34427 :
i killing me why DNAT is not working iptables -nvL -t nat Chain PREROUTING (policy ACCEPT 1051 packets, 245K bytes) pkts bytes target prot opt in out source destination 327K 107M DOCKER all -- 0.0.0.0/0 0.0.0.0/0 ADDRTYPE match dst-type LOCAL
Chain INPUT (policy ACCEPT 747 packets, 227K bytes) pkts bytes target prot opt in out source destination
Chain OUTPUT (policy ACCEPT 2019 packets, 165K bytes) pkts bytes target prot opt in out source destination 13606 816K DOCKER all -- 0.0.0.0/0 !127.0.0.0/8 ADDRTYPE match dst-type LOCAL
Chain POSTROUTING (policy ACCEPT 2061 packets, 167K bytes) pkts bytes target prot opt in out source destination 3125 190K MASQUERADE all -- !docker0 172.17.0.0/16 0.0.0.0/0 146K 8778K MASQUERADE all -- !hassio 172.30.32.0/23 0.0.0.0/0 0 0 MASQUERADE tcp -- 172.30.33.2 172.30.33.2 tcp dpt:8086 0 0 MASQUERADE tcp -- 172.30.33.1 172.30.33.1 tcp dpt:22 0 0 MASQUERADE tcp -- 172.30.33.4 172.30.33.4 tcp dpt:4884 0 0 MASQUERADE tcp -- 172.30.33.4 172.30.33.4 tcp dpt:4883 0 0 MASQUERADE tcp -- 172.30.33.4 172.30.33.4 tcp dpt:1884 0 0 MASQUERADE tcp -- 172.30.33.4 172.30.33.4 tcp dpt:1883
Chain DOCKER (2 references) pkts bytes target prot opt in out source destination 2 120 RETURN all -- docker0 0.0.0.0/0 0.0.0.0/0 1631 98220 RETURN all -- hassio 0.0.0.0/0 0.0.0.0/0 14300 858K DNAT tcp -- !hassio 0.0.0.0/0 0.0.0.0/0 tcp dpt:8086 to:172.30.33.2:8086 2 104 DNAT tcp -- !hassio 0.0.0.0/0 0.0.0.0/0 tcp dpt:22 to:172.30.33.1:22 0 0 DNAT tcp -- !hassio 0.0.0.0/0 0.0.0.0/0 tcp dpt:4884 to:172.30.33.4:4884 0 0 DNAT tcp -- !hassio 0.0.0.0/0 0.0.0.0/0 tcp dpt:4883 to:172.30.33.4:4883 2 104 DNAT tcp -- !hassio 0.0.0.0/0 0.0.0.0/0 tcp dpt:1884 to:172.30.33.4:1884 65 3284 DNAT tcp -- !hassio 0.0.0.0/0 0.0.0.0/0 tcp dpt:1883 to:172.30.33.4:1883 0 0 DNAT tcp -- !hassio * 0.0.0.0/0 0.0.0.0/0 tcp dpt:40850 to:172.30.33.5:40850
I'm using Deconz with Node-Red, I have about 70 automations in Node-Red, after updating to 4.1 ports are not exposed anymore and I had to revert to 3.9. Is it possible to expose the ports on the docker just leave them with no default mapping value (same as for the VNC port) so that it will still be possible to map them? I only use some of the entities in HA, most of them are only in Node-Red and converting them to use HA entities will be a huge mess.
I love your work, and like the ingress support, Please think of allowing backward compatibility with older systems which use the Deconz via API directly (I use "node-red-contrib-deconz") Thanks.
@intelroman Not sure what you are trying to achieve, but that is definitely not supported.
@thecode If you use the Hass.io Node-RED add-on, that add-on is still able to use it, you have to change the hostname to connect to. It used to be localhost
or 127.0.0.1
. If you change that to core-deconz
as the host to connect to in Node-RED will be able to connect.
Oh, you could have asked instead of jumping into conclusions 😉
@intelroman Not sure what you are trying to achieve, but that is definitely not supported.
It is simple i use deCONZ api to gather some data like: https://github.com/intelroman/hassio_scripts/
Thanks, but right now I'm too afraid to test that, was real mess when I upgraded this morning. All house stopped working. I usually do that verty carefully but I didn't think something will break. I will try that later, but I still recommend finding a way for having direct access also. For example I access data from motion Eye on another machine (not from the HA machine) in motionEye there is an option to map the port (with a text written that it is not necessary for ingress support).
I apologize if it looked like I jumped into conclusions, I've asked on few places and no one know the answer....
@intelroman As I already wrote, it is not possible to access the API externally. It is available from within the Hass.io ecosystem on the hostname core-deconz
, however, if the code is run inside Hass.io (e.g., using an SSH add-on, or things like AppDaemon). Other than that is not supported at this point and is not something we can help you with.
@thecode Not all add-ons are able to support both. deCONZ can't support it, because it breaks Ingress. There is no option for a choice there. The fact you are scared to try is not something I can do anything about I'm afraid. Besides recommending a snapshot and just try, if it fails for you, you can always fall back onto the snapshot created.
Well I can't do anything about it, but for me having ingress support and losing external access to Deconz is a drawback. If I had to choose I will prefer external access over ingress support. I have 2 machines for home automation and had plans to move some of the automations to another machine, without having them being able to access one another this is something brakes my plans.
@thecode I'm sorry to hear that, but at the same time, I'm afraid it is an impossible task to make everybody happy. For your case, there is a solution, which I already gave in a previous comment/response directed at you.
Well this only helps for one machine for now. I hope you change your mind in the future and then I'm sure a solution can be found, maybe asking Deconz team to add support for it in some way (like another ports or something) or maybe even have an option to configure the hassio addon to disable/enable ingress or use port access.
Merry christmas and I hope new year will bring new stuff :-)
I keep getting these:
2019-12-20 23:04:18 WARNING (MainThread) [homeassistant.components.websocket_api.http.connection.1803347888] Disconnected: Did not receive auth message within 10 seconds
2019-12-20 23:04:18 WARNING (MainThread) [homeassistant.components.websocket_api.http.connection.1787666608] Disconnected: Did not receive auth message within 10 seconds
2019-12-20 23:04:33 WARNING (MainThread) [homeassistant.components.websocket_api.http.connection.1817278832] Disconnected: Did not receive auth message within 10 seconds
2019-12-20 23:04:33 WARNING (MainThread) [homeassistant.components.websocket_api.http.connection.1791389968] Disconnected: Did not receive auth message within 10 seconds
2019-12-20 23:04:33 WARNING (MainThread) [homeassistant.components.websocket_api.http.connection.1786928336] Disconnected: Did not receive auth message within 10 seconds
I can read the deconz log, and it seems to work perfectly fine, yet I get no devices in the integration. Also, I cannot open the gateway settings page via ingress.
How do I fix this?
I've removed integration and add-on, rebooted, added add-on, rebooted, added integration. I get the standard daylight sensor and the gateway itself. I still can't access the gateway settings page. I can't control any lights in the house, and thermostat functions no longer work since all my temp sensors are offline.
An oddity is that from one browser, I get all my lights, switches and sensors in the deconz interface. If I open a different browser, it appears as if the GW has been reset. What is going on? I have more than 50 devices paired, and re-pairing them would be a major pain.
Why can't the API be available from an external port as an option? HomePanel lets me access it from both external port and ingress, so this seems like a completely arbitrary limitation.
Ok. To continue from my previous. Accessing deconz api is now disabled for any given reason. I am, (and I can see I'am not only one), not happy but.., whatever. The access is possible through other solution, however I cannot find it. It might be good idea to put it as standalone topic and with relevant keywords. It might help. Also, I'd be more than happy if I could have link to this sollutions frenck
@repvik: If I open a different browser, it appears as if the GW has been reset.
That sounds like a browser caching issue? From my experience with deCONZ, is leaving the browser open on the device list page (just before login), it will rediscover and find out by itself things changed.
@repvik: Why can't the API be available from an external port as an option?
This question has now be answered in this issue a couple of times now. I would appreciate reading before asking, it saves us all quite some time.
@branitelj91: Accessing deconz api is now disabled for any given reason
The reasoning for this has been provided a couple of times now.
@branitelj91: The access is possible through other solution, however I cannot find it
You didn't describe your use case, so I'm not sure how to answer or help you with that.
I have a Pi4 with my ConBee plugged and the DeConz addon running (currently back to 3.9). I then have a VM on the same network that handles all the heavy lifting and automations that links to the DeConz via the integrations page.
With this new update does that mean that this now won’t work?
@daanvb That indeed won't work. dresden electronics offer SD card images for those purposes: https://phoscon.de/en/conbee/sdcard.
@frenck so I guess I can’t then run Hassio as well as this Phoscon image?
I have a Zwave stick and BT tracking on the Pi as well so I need hassio.
This will completely destroy my system if this can’t be done...
@daanvb It sounds like you are mixing up multiple Hass.io ecosystems. While that works in some cases, it is not something that is supported.
I have modified (soldered) some of my Xiaomi motion sensors to reset after 5 seconds, and used API to change their configs accordingly
curl -H 'Content-Type: application/json' -X PUT -d '{"duration": 5}' http://hassio_ip:deconz_addon_api_port/api/api_key_here/sensors/motion_sensor_id_here/config
So I fully agree with the question
Why can't the API be available from an external port as an option?
I think user should have an option to use the API
As another example, I have solved the problem when both Aqara cube sensors was with the same identifier - set another name to one of the sensors
This is a really useful feature
https://github.com/home-assistant/hassio-addons/blob/master/deconz/README.md
Added sections:
Also, the Known issues and limitations has been extended to cover all current ones.
@fantomnotabene You can still use curl against the API to change settings. Using:
curl -H 'Content-Type: application/json' -X PUT -d '{"duration": 5}' http://core-deconz:40850/api/api_key_here/sensors/motion_sensor_id_here/config
As long as the command is issued from within the Hass.io ecosystem (e.g., using the SSH add-on). For more information see: Using the deCONZ/Phoscon API with another add-on
I think user should have an option to use the API
That has been explained a couple of times on why it is not an option. It is also listed in the "known issues and limitations" section of the add-on documentation.
This question has now be answered in this issue a couple of times now. I would appreciate reading before asking, it saves us all quite some time.
No, it hasn't been answered. Here's what you've said:
The add-on is now available over Ingress and does not use ports anymore.
Yep, however, with the 4.x add-on, it is no longer possible to reach the API from the outside world. I would not worry to much about it.
As I already wrote, it is not possible to access the API externally. [...] Other than that is not supported at this point and is not something we can help you with.
Not all add-ons are able to support both. deCONZ can't support it, because it breaks Ingress.
"Why can't it be added as an option when other addons support both" isn't answered by the first three. The fourth was added after I asked my question, and doesn't really answer it either.
My question is why does it break ingress for deCONZ while other add-ons have no problems combining them? Is this something that can be fixed, or is this permanent?
@repvik Sorry for that, I have been write answers in many locations yesterday, I was under the impression it was in this location as well.
If the port is opened up, the frontend will discover the same device on multiple addresses, causing it to pick up the last address discovered, which is not accessible for Ingress. Losing access to your device altogether.
This is permanent at this moment.
@frenck Aha. Makes sense.
@frenck Sorry for not providing enough info. So here is explanation: I have made HASSIO testing platform on one RPI3 board to check how to migrate to Home Assistant from other platform, (Hubitat elevation, as this is closed platform to the degree and I experienced significant lag in activating certain dimmers and lights). So, platform consists of three lights, (2 philips, and one sylvania), with three remotes, (Ikea tradfri 5 button puck, osram lightify 4 buttons square remote and lately added Sunricher remote with 8 scenes and 4 groups). Here is some of my toughts,
Regarding to it, I have need of connecting domoticz to Hassio or deCONZ to be able to learn further.
What, I am asking now, is, how to connect those two again. I know there is at least one workarround, and that is also one solution as well. The example would be a different RPI with Deconz on as standallone, while HA will run in the other box, and Domoticz will be third one. But, that looks bit clumsy, and I am striving to reduce it to two boxes.
And as addition to it, I would be more than happy if I could operate deCONZ entities directly in Node-Red instead their instances in HA.
I hope, I've cleared out little bit background of my idea.
Thank You for any assistance
@branitelj91 I can see how in a learning/orientation phase this is confusing and problematic.
For the Node-RED part, the Hass.io Add-on for Node-RED is able to connect and this is now documented in the documentation of the deCONZ add-on as well.
As stated before, external connections to deCONZ cannot be made anymore. So you will not be able to hook it up with Domoticz or OpenHAB. dresden eletroniks offers an SD card image for these purposes: https://www.phoscon.de/en/conbee2/sdcard
Hello ,
I didn't try yet .. but is the Nginx ssl proxy .. can be configured as proxy for deconz 😁😂
On Sat 21 Dec 2019, 12:51 Franck Nijhof, notifications@github.com wrote:
@branitelj91 https://github.com/branitelj91 I can see how in a learning/orientation phase this is confusing and problematic.
For the Node-RED part, the Hass.io Add-on for Node-RED is able to connect and this is now documented in the documentation of the deCONZ add-on as well.
As stated before, external connections to deCONZ cannot be made anymore. So you will not be able to hook it up with Domoticz or OpenHAB. dresden eletroniks offers an SD card image for these purposes: https://www.phoscon.de/en/conbee2/sdcard
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/home-assistant/hassio-addons/issues/928?email_source=notifications&email_token=ABDO54KSDQMPKV7R3YCHPMTQZYGNVA5CNFSM4J54PZHKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEHO3SHA#issuecomment-568178972, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABDO54MXRVI6GVAI2LW6INLQZYGNVANCNFSM4J54PZHA .
@intelroman Yes that might work, but might cause major issues as well. It is definitely not supported.
I think people it will try to learn . So they need ways to work around it. Like me ... i'm thinking for solutions to learn more .. and do stuff . If it will be a payed app i will understand that i need to comply with the security concerns .
On Sat 21 Dec 2019, 12:56 Franck Nijhof, notifications@github.com wrote:
@intelroman https://github.com/intelroman Yes that might work, but cause major issues as well. It is definitely not supported.
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/home-assistant/hassio-addons/issues/928?email_source=notifications&email_token=ABDO54LO4U6ZPLX5MZ35YL3QZYHAVA5CNFSM4J54PZHKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEHO3UXI#issuecomment-568179293, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABDO54PCRLABP7DHX6K2PEDQZYHAVANCNFSM4J54PZHA .
Hi,
my config is:
I noticed that after upgrading to deCONZ 4.0 my entities are missing. The same issue is present in 4.1.
Logs:
WORKAROUND by @frenck: