[hueemulation] Some Alexa devices do not discover all tags

5iver commented 5 years ago

I updated from 1415 to 1445, excited to test #4216, and lost control of most of my items. None of my Items tagged as Switchable are being discovered. Sorry if this is not enough information, but I'm guessing this should be easily reproducible. If any more detail is required, please let me know. I am in the US and use 2nd gen Dots. This is also being reported outside the US.

community discussion

gdgeist commented 5 years ago

build 1446 and same experience. Items tagged with "Switchable" not discovered. "ColorLight" discovered as a light but Alexa marks it as a Color Capabilities = None. All items show up in API.

Example of the color light from API:

{"state":{"hue":8373,"sat":139,"xy":[0.0,0.0],"alert":"none","effect":"none","transitiontime":0,"colormode":"ct","bri":254,"ct":500,"on":true,"reachable":true},"type":"Extended color light","modelid":"LCT010","uniqueid":"8790e48e-7152-4795-9b5b-39ec9620fdc8-66","manufacturername":"Philips","swversion":"1.15.2_r19181","swconfigid":"F921C859","productid":"Philips-LCT010-1-A19ECLv4","friendsOfHue":true,"colorGamut":"C","hascolor":true,"name":"Kitchen Desk Lamp Color"}

Example Switchable Item:

{"state":{"on":true,"reachable":true},"type":"On/Off plug-in unit","modelid":"Plug 01","uniqueid":"8790e48e-7152-4795-9b5b-39ec9620fdc8-52","manufacturername":"OSRAM","swversion":"66012040","friendsOfHue":true,"hascolor":false,"name":"Kitchen Sink Lamp"}

Also Null pointer exceptions for items that are not reachable during Alexa discovery (Hue bulbs exposed through the hue emulation) Example: 2018-11-30 06:09:14.626 [WARN ] [org.eclipse.jetty.server.HttpChannel] - /api/ji2WsId63e9X33ub4QqCgguJZkxSUVDMDa2N1LVA/lights/33

java.lang.NullPointerException: nullNo tagged groups

davidgraeff commented 5 years ago

Alexa marks it as a Color Capabilities = None

Alexa does not natively (within the local network) support coloured hue bulbs. This is only possible via skills unfortunately. Try with hue compatible apps and it should be presented as a coloured bulb.

Switchable Item

It works with my alexa (German firmware, which usually lacks behind the US version). It may help to fake another device and not the OSRAM plug for a broader compatibility.

Null pointer exceptions

That should not happen. What do you mean by "item that is not reachable"? An item does not have a reachable state. Did I miss something?

gdgeist commented 5 years ago

Thanks. The null pointer exceptions are for real world hue bulbs things that are "unreachable" i.e. hue bulb switched off by a hard wired light switch.

dainosan commented 5 years ago

BUILD 1446 I have similar issues. reduced to 1 THING, 1 ITEM and still not being discoverable by the 3rd Gen echo Dot.

ITEM: Switch Luce_disimpegno_bagno "Disimpegno Bagno" (gLivingRoom) ["Lighing"] { channel="openwebnet:bus_on_off_switch:mybridge:Luce_disimpegno_bagno:switch" }

rest API : [{"link":"http://192.168.1.22/rest/items/Luce_disimpegno_bagno","state":"OFF","editable":false,"type":"Switch","name":"Luce_disimpegno_bagno","label":"Disimpegno Bagno","category":"light","tags":["Lighing"],"groupNames":["gLivingRoom"]}]

dainosan commented 5 years ago

this could help (or not)but i noticed that every time i change the configuration in paperUI the config file

/var/lib/openhab2/config/org/openhab/hueemulation.config

contains a "B" in the string

pairingEnabled=B"true"

davidgraeff commented 5 years ago

That is correct behaviour @dainosan. If you enable pairing mode a "boolean" value "true" is stored in the configuration and about 60 seconds later this is overwritten with a "false" value again.

dainosan commented 5 years ago

thanks. whatever it is the discovery is not working. i am trying to debug but i cannot see anything that could be going wrong but when the discovery completes there are no devices

davidgraeff commented 5 years ago

You can use a REST addon for your favourite browser and verify that the xmls generated by the hue emulation are correct. Alexa is also picky about the port nowadays, openhab should be running on port 80, or a reverse proxy forwards traffic from :80 to :8080.

With the rest plugin in your browser you do a GET request on http://your-openhab:80/api/config as a start and http://your-openhab:80/description.xml while discovery is enabled.

dainosan commented 5 years ago

aware of the port forwarding and that is in place. 80 to 8080 via Iptables.

i get data back from both : http://192.168.1.22/api/config AND http://192.168.1.22/api/description.xml

gdgeist commented 5 years ago

BUILD 1446 I have similar issues. reduced to 1 THING, 1 ITEM and still not being discoverable by the 3rd Gen echo Dot.

ITEM: Switch Luce_disimpegno_bagno "Disimpegno Bagno" (gLivingRoom) ["Lighing"] { channel="openwebnet:bus_on_off_switch:mybridge:Luce_disimpegno_bagno:switch" }

rest API : [{"link":"http://192.168.1.22/rest/items/Luce_disimpegno_bagno","state":"OFF","editable":false,"type":"Switch","name":"Luce_disimpegno_bagno","label":"Disimpegno Bagno","category":"light","tags":["Lighing"],"groupNames":["gLivingRoom"]}]

@dainosan Lighting is mispelled.

dainosan commented 5 years ago

no that was probably one of the latest copy and paste. this is how the item appears in rest API

[{"link":"http://192.168.1.22/rest/items/Luce_disimpegno_bagno","state":"NULL","editable":false,"type":"Switch","name":"Luce_disimpegno_bagno","label":"Disimpegno Bagno","tags":["Lighting"],"groupNames":["gLivingRoom"]}]

gdgeist commented 5 years ago

@dainosan I was hoping it was an easy fix for you ;)

gdgeist commented 5 years ago

Alexa marks it as a Color Capabilities = None

Alexa does not natively (within the local network) support coloured hue bulbs. This is only possible via skills unfortunately. Try with hue compatible apps and it should be presented as a coloured bulb.

@davidgraeff This one stumps me as I have a Hue hub and have never used the Hue cloud account i.e. Alexa/Echo has only ever been connected locally and before I deleted the pairing in order to use the hue emulation the color bulb worked just fine i.e. the only way Alexa would have discovered my color bulb was local discovery....

davidgraeff commented 5 years ago

@gdgeist Maybe in non European firmware versions? I read about non color support in various forums and that Amazon is never intending to add support to the local hue support. The hue emulation is emulating a A14 extended color bulb from 2014, I think. My alexa is not recognising it as color bulb (eg "change color to red"). If anybody knows what to emulate to make this work, I'd happy to make the necessary changes.

davidgraeff commented 5 years ago

no that was probably one of the latest copy and paste. this is how the item appears in rest API

It doesn't help to post the OH rest response. Alexa is using the hue emulation rest API under /api. You need to generate an api-key and then post the contents of /api/[api-key]/lights. I have no time to explain the details, please google that up, please.

dainosan commented 5 years ago

we can figure this out.

here is the long output of the /api/[api-key]/lights

api key is created but nothing is returned to alexa

ScottKinSF commented 5 years ago

I too have existing rules and items that use group items to control dimmer items in the same area. As noted by @5iver, the updated version of Hue Emulation breaks that functionality.

I have also noted that the commands ON and OFF when issued from Alexa to my dimmer items, no longer function the way they did before this update. The devices now receive a '1' or a '0' respectively, which my devices see as 1% and 0%, which is certainly not the desired behavior. Setting these dimmer items to a percentage value from 0 to 100% does work. <-- I determined that this behavior is unrelated to the HueEmulation binding.

davidgraeff commented 5 years ago

Please everyone test if switchables work for you with #4312 and #4313 applied. Please also perform the test with different Alexas (voice command in English might be something like: Alexa, discover new devices). I have the strong feeling that different Echo types support different sets of hue devices.

gdgeist commented 5 years ago

2.4.0.201812042313 │ Hue Emulation Service

No devices discoverable at all. I cleared the discovered devices in Alexa. Cleared cache, upgraded, device pairing mode multiple times.

Ran out of time tonight. Will see if anything useful can come from the logs

davidgraeff commented 5 years ago

One of the commits made the main api endpoint (/api/user-name/lights) a 404. Therefore the hue emulation development version does not work. I'm on this right now.

davidgraeff commented 5 years ago

I have created PR #4324 to fix this and added a test bundle as well for catching breaking commits next time.

For Alexas that are not able to identify an OSRAM plug as a switchable, I have this workaround:

Go to the service configuration on Paper UI and change the tag for white lights to "Lighting, Switchable". This emulates all switchables as white lights, like the former code did.

davidgraeff commented 5 years ago

bildschirmfoto vom 2018-12-08 20-34-29

This is a screenshot from the Alexa app. You see devices appear two times. The echo dot finds them as "Royal Philips Electronics intelligentes Gerät" including switches. The echo finds them as as "Dimmable Light" and "Color Light" without switches. Summing this up: The local hue support is a mess, somehow.

5iver commented 5 years ago

@davidgraeff , Alexa still cannot discover any Switchable tagged Items with S1459 (hueemulation 2.4.0.201812100737) using a 2nd gen Echo Dot in the US. The API shows them as OSRAM:

state
on	true
reachable	true
mode	"homeautomation"
alert	"none"
type	"On/Off plug-in unit"
modelid	"Plug 01"
uniqueid	"105f4eff-156d-4535-a5c6-2511a57e494d-2"
manufacturername	"OSRAM"
productname	"On/Off plug"
swversion	"V1.04.12"
hascolor	false
name	"Family Room TV"
config
archetype	"classicbulb"
function	"functional"
direction	"omnidirectional"
capabilities
certified	false
streaming
renderer	false
proxy	false
control	{}

Could someone reopen this issue? Or should I create another? On a positive note, Lighting tagged groups are now discovered!

davidgraeff commented 5 years ago

Reopening this will not change anything. This particular issue is of category "cannot fix" for US citizens. Apparently Osram is branded differently over there. As a workaround you can tag your switches as lights.

You can help by finding out if any ZigBee plugs work with US Alexa firmware in a local network environment. Depending on the local different plugs could be emulated.

5iver commented 5 years ago

This particular issue is of category "cannot fix" for US citizens.

OK... thank you for the info. I've tried adding Switchable to the 'White item tags', but they were still not discoverable. I'll change all of my Switchable to LIghting for now. ColorLighting did also show up.

You can help by finding out if any ZigBee plugs work with US Alexa firmware in a local network environment. Depending on the local different plugs could be emulated.

I'll help in any way I can! I have a Zigbee plug, but I suspect you are asking me to pair it with an Echo Plus, which I do not own. Did I read you right? I could also setup ha-bridge again (used this before OH hueemulation), if it would have anything that would help. Or maybe there is something in their code that could help? Although, I do not recall how they were being identified by Alexa... they may have all been dimmable lights.

davidgraeff commented 5 years ago

Did your plug work with ha-bridge? Then we only need to find out what device is emulated.

Although, I do not recall how they were being identified by Alexa... they may have all been dimmable lights.

Ok ok. That wouldn't help then.

I suspect you are asking me to pair it with an Echo Plus

Even worse. I'd ask you to pair it with an original Hue Bridge and find out if the plug is recognised by Alexa.

5iver commented 5 years ago

Did your plug work with ha-bridge? Then we only need to find out what device is emulated.

Everything I have with the tag Switchable worked prior to your changes, but IIRC, they all showed up as Dimmable Light in the Alexa app.

Even worse. I'd ask you to pair it with an original Hue Bridge and find out if the plug is recognised by Alexa.

Nope... no hub here. Do you have a list of possible devices? I looked on the Hue developer site, but didn't spot one. If you have one, I can build the bundle and try them out... maybe we can find one that works. For now I have everything set to Lighting, which seems to be working... except 3 of 84 devices didn't show up... just not sure which ones.

davidgraeff commented 5 years ago

I only own the Osram Plugs. Soon there will be IKEA wall plugs available as well in Germany, but I doubt that newer devices are of any help here.

Everything I have with the tag Switchable worked prior to your changes, but IIRC, they all showed up as Dimmable Light in the Alexa app.

Yes of course that was the only device that the old hue code could emulate, which resulted in Alexa thinking that she could turn a wall plug to 50% brightness.

There must be a Zigbee wall plug from around 2015 or so on the American market that was Alexa compatible at that time until Amazon stopped the development of the local Hue bridge support.

5iver commented 5 years ago

The old SmartThings plug (actually Centalite 4257050-RZHAC) fits that description. I have one too.

Here's another possibility, but not that old and Osram is Sylvania... https://developers.meethue.com/forum/t/hue-outlet-control/4224/8?u=5iver

davidgraeff commented 5 years ago

I do not have a Philips developer/forum account and not too keen on getting one. Could you copy the important parts over if possible?

Osram <> Sylvania? Who came up with this. The smart things plug sounds like a good idea. I need the hue rest API response for this device. If it works in Europe too I replace the Osram device entirely.

5iver commented 5 years ago

From the forum...

miguel.innit
Oct '17

There's one outlet that I know of that is:

a. available in the US

b. shows up in the Hue app and is able to be turned on/off.

That outlet is Sylvania Smart+ Indoor Plug

https://www.amazon.com/SYLVANIA-Smart-Required-Certified-72922/dp/B01M6UM8QD/

If you read the amazon reviews its verified working in Hue app.

Does anyone know of outlets available in Canada that can be modified by Hue? I need an outlet to be controlled by a Hue Dimmer switch.

This seems to be the most comprehensive list of devices in regards to Hue compatibility that I can find -- http://iconnecthue.com/supported-devices/ .

How do you read the API docs without an account?!

Osram <> Sylvania? Who came up with this.

https://en.m.wikipedia.org/wiki/Osram_Sylvania

I need the hue rest API response for this device.

That requires the hub?

davidgraeff commented 5 years ago

How do you read the API docs without an account?!

Simple. I don't read them on the Philips site. Google cache has most of the pages. If I stumble over an issue that can only be solved with the API docs I will register, but why bother if it works without.

That requires the hub?

Yes I'm afraid so. Alternatively it can be found on the internet

gdgeist commented 5 years ago

I have a HUE developer account but you wont find the Sylvania response - you need someone with an actual Sylvania outlet tied to a hue hub for that. Ikea Tradfri Outlets.....just skip and buy SONOFF/WEMO. @openhab-5iver You said your color bulb comes up color now - mine doesnt - my category description shows up as Color Light but no color capabilities in the Alexa app. As usual @davidgraeff -Thanks!

ScottKinSF commented 5 years ago

I don't know if it helps, but the following PDF provides the current information on Hue supported devices. Philips Hue Supported Devices.pdf

davidgraeff commented 5 years ago

Interesting document. Unfortunately no example for an On/Off device.

ngrodum commented 5 years ago

@kaikreuzer Why is this issue closed? For me this is still an issue (in the 2.4 release version).

kaikreuzer commented 5 years ago

It was auto-closed because https://github.com/openhab/openhab2-addons/pull/4339 claimed that it fixed it.

davidgraeff commented 5 years ago

The title need to be changed and be more specific. The issue is about Alexas understanding Hue exposed devices. (Because Apps work all over the world with this implementation).

What makes this harder so resolve: Alexa devices recognise Switchables with the European firmware, which is not true for the US firmware variant. It is untestable and not reproducible for non-US developers.

5iver commented 5 years ago

@davidgraeff , is the title better for you? If you'd like it more specific, please let me know what you suggest.

davidgraeff commented 5 years ago

@openhab-5iver Thanks. Could you reopen the issue?

ScottKinSF commented 5 years ago

Last week I ordered a used SYLVANIA SMART+ ZigBee Indoor Smart Plug, which, although there are many reports that the newer version will not pair with a Hue hub, I thought I would try based on a handful of reports that, with the right procedure, pairing can be successful.

I found a relatively cheap one on ebay that I should receive this week. I'll let you know what I find.

xsnrg commented 5 years ago

This is still broken in the release version 2.4.0, which I believe we all know. If I might summarize where we are, hue emulation used to work for people in the US because a defect (in the eyes of the dev team) allowed it to work. This defect was fixed, along with some new code that allowed better handling of color lights. In fixing this defect, the US based(1) Alexa devices no longer recognise the hue emulator hub and therefore do not find any exposed devices.

1) above - is this generally accepted? Hue emulation works with non-US Alexa devices for everyone that has tried it?

If the above is the case, and we understand the defect that was changed, would it be possible to introduce code that is no longer considered a defect that allows the US devices to work again? I am not asking to have the same defect re-introduced to the code, but I am asking if what we know about the defect that was fixed can be used to allow US devices to again do device discovery in some way?

Thank you for all the time and effort that has gone in to making this better, but my family wants Alexa back.

Jim

5iver commented 5 years ago

As a workaround, change your tags to Lighting, or in the Hue Emulation config, add Switchable to the White item tags. This will provide the exact same functionality as before, since all Items were added as DimmableLight. More info in the forum discussion.

davidgraeff commented 5 years ago

Could someone add this workaround and a little description of the current situation to the binding readme?

Jim: I guess you cross read related topics and confused some subjects here. The hue emulation itself works for US citizens, too. It just differentiates exposed device types. And one of the emulated types, the wall plug, happen to not exist in the US so Alexa does not recognise it.

5iver commented 5 years ago

Could someone add this workaround and a little description of the current situation to the binding readme?

I'll add this to the readme, but do you think it would be best to wait until @ScottKinSF reports back his findings, on the chance we find a device type that works in the US?

ScottKinSF commented 5 years ago

I've done some more research and came across this and this, neither of which sounds very promising. The device is used, so it's possible I'll luck out and get the earlier version, we shall see.

xsnrg commented 5 years ago

Jim: I guess you cross read related topics and confused some subjects here. The hue emulation itself works for US citizens, too. It just differentiates exposed device types. And one of the emulated types, the wall plug, happen to not exist in the US so Alexa does not recognise it.

While it is true, I seem to have read nearly everything nearly everywhere, and have tried most of the workarounds, I only this evening seem to have stumbled across a combination that allowed the insteon devices to be discovered. My items file contains "Switchable", switch item tags "Lighting", and White item tags "Switchable". They all appear as "Dimmable Light" now, but they work.

cee-dee commented 5 years ago

Just for the record: I live in Germany, but I had to configure White item tags to "Lighting,Switchable" as well, because my Alexa did not discover my OSRAM plugs.

davidgraeff commented 5 years ago

@cee-dee Which makes it super confusing now. Does your Alexa enabled device (you did not specify which one you have) support colors?

cee-dee commented 5 years ago

I use several Alexa enabled devices, I think most of them are from the early batches shipped to Germany, since I pre-ordered them as soon as possible. One of them is a fully-fledged Echo devices (without Hue hub), the remaining ones are Echo Dots. I discovered my devices using alexa.amazon.com -- I don't know if this anyhow relates to the actual devices, I rather suspect it's somehow tied to the account.

Regarding your question: How can I find out if my device supports colors? On alexa.amazon.com I see that there a Brightness-, Color-, Extended color light and Color temperature light-items discovered. Does you question refer to this?

openhab / openhab-addons

[hueemulation] Some Alexa devices do not discover all tags #4293