HYYP App go Offline - Githubissues

Pieterjvr commented 3 months ago

Hi All

Is it only my homeassistant cause the HYYP app to go offline and then HA also show it is offline.

Everytime I integrate HYYP with HA it work maybe for the first 30-60min then all hell break loose :)

My HYYP on my mobile phone show offline as well as HYYP in HA.

Regards, Pieter

hawky358 commented 3 months ago

Hello

When did this start?
Did it work before?
If you remove the integration from HASS does it fix the app?
Which version of the integration are you using?
Do you use IDS HYYP or ADT?
Do you use the GSM module?

There's not much to go on. Reproducing this may be quite difficult since it doesn't sound like anything locally.

Pieterjvr commented 3 months ago

Hello

I notice this issue earlier this year and because I am not at home and could not leave the wife to struggle, I complete removed it.

First time I added it, was last year December and all work fine till yearly this year.

As soon as I remove or disable the HYYP integration, it takes about 45min for the HYYP app to be back online on my iPhone.

Currently running IDS 1.6.1. I update everything last night and reconfigured the up. Again, after about 45-60min all went offline again and was required to disable the integration in HA to get the mobile app to work.

I use IDS HYYP with an IDS x16 806 Series.

I have the GSM module on my panel.

Kind Regards, Pieter

From: hawky358 @.> Sent: Monday, June 24, 2024 6:22 PM To: hawky358/hass_ids_hyyp @.> Cc: Pieter Janse van Rensburg @.>; Author @.> Subject: Re: [hawky358/hass_ids_hyyp] HYYP App go Offline (Issue #26)

Hello

When did this start?
Did it work before?
If you remove the integration from HASS does it fix the app?
Which version of the integration are you using?
Do you use IDS HYYP or ADT?
Do you use the GSM module?

There's not much to go on. Reproducing this may be quite difficult since it doesn't sound like anything locally.

— Reply to this email directly, view it on GitHubhttps://github.com/hawky358/hass_ids_hyyp/issues/26#issuecomment-2186953965, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AI2JQ6OM53ZFYOP4BZAPSRTZJBBTNAVCNFSM6AAAAABJ2B5QDCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCOBWHE2TGOJWGU. You are receiving this because you authored the thread.Message ID: @.**@.>>

hawky358 commented 3 months ago

I have the GSM module on my panel.

I believe this is the issue. There was another user who also had a GSM module (Link to discussion). I didn't know these modules existed.

In short the GSM module seems to be limited to 50MB per month. From what you're saying there may be an hourly limit as well.

The integration currently polls every 30 seconds, which is not a problem for the "LAN" HYYP modules. But these small data packets add up when you have VERY limited data.

You can give version 1.7.0-b1 a try. I've added a "GSM Module Low data mode" to the integration.

The low data mode only polls once every 30 minutes, thus significantly reducing the data usage (change log states 15, but I made it 30)
The system still "instantly" refreshes if you do something like arm, disarm, bypass, etc.
In order to support "anytime" refreshes I've added a button button.[site_name]_refresh_button which queues an immediate update. So you'll just have to make a "Refresh" button or something along those lines.
- I know it "works" in the sense that it only polls every 30 minutes, but since I don't have a GSM module I can't test the issue of HYYP going offline.

See the screenshot in the changelog, which shows where to activate this. (It's where you enter your codes) Changelog for 1.7.0-b1

hawky358 commented 3 months ago

1.7.0-b1 is on the beta branch

Pieterjvr commented 3 months ago

Thanks for this. I will give it ago over the weekend as I also need to try and setup my nspanel pro that I ordered.

I might have a spare hyyp with gsm that I can maybe borrow to you if you need to do test. PM me then we can try arranging something.

Kind Regards, Pieter

From: hawky358 @.> Sent: Monday, June 24, 2024 7:56 PM To: hawky358/hass_ids_hyyp @.> Cc: Pieter Janse van Rensburg @.>; Author @.> Subject: Re: [hawky358/hass_ids_hyyp] HYYP App go Offline (Issue #26)

I have the GSM module on my panel.

I believe this is the issue. There was another user who also had a GSM module (Link to discussionhttps://github.com/hawky358/hass_ids_hyyp/discussions/24). I didn't know these modules existed.

In short the GSM module seems to be limited to 50MB per month. From what you're saying there may be an hourly limit as well.

The integration currently polls every 30 seconds, which is not a problem for the "LAN" HYYP modules. But these small data packets add up when you have VERY limited data.

You can give version 1.7.0-b1 a try. I've added a "GSM Module Low data mode" to the integration.

The low data mode only polls once every 30 minutes, thus significantly reducing the data usage (change log states 15, but I made it 30)
The system still "instantly" refreshes if you do something like arm, disarm, bypass, etc.
In order to support "anytime" refreshes I've added a button button.[site_name]_refresh_button which queues an immediate update. So you'll just have to make a "Refresh" button or something along those lines.
I know it "works" in the sense that it only polls every 30 minutes, but since I don't have a GSM module I can't test the issue of HYYP going offline.

See the screenshot in the changelog, which shows where to activate this. (It's where you enter your codes) Changelog for 1.7.0-b1https://github.com/hawky358/hass_ids_hyyp/tree/1.7.0-b1#changelog

— Reply to this email directly, view it on GitHubhttps://github.com/hawky358/hass_ids_hyyp/issues/26#issuecomment-2187110221, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AI2JQ6LPUVTJ66K7EBOHAD3ZJBMR7AVCNFSM6AAAAABJ2B5QDCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCOBXGEYTAMRSGE. You are receiving this because you authored the thread.Message ID: @.**@.>>

kimfr commented 3 months ago

Hi there,

I'm "the other user" - I actually had to increase the time to 60 minutes. I gave up dealing with ADT and actually phoned IDs directly to confirm the 50MB - even with 30 min. refresh I manage to run out sometimes. This might be because we exclusively use the phone app as well and have made it a habit (good or bad) to always refresh before doing anything with our Alarm........

Would it be possible to have the GSM update interval as a variable/pick list? Alternatively, I guess that I can just change the below line in const.py to: GSM_MODE_POLL_TIME = 60*60 #60 Minutes

With the added feature of "Refresh" - I should be able to work around a much higher "poll time" - Thanks for adding this feature.

Thanks Kim

hawky358 commented 3 months ago

Thanks for the feedback. When initially implementing it, I was actually thinking about a field so that you can choose a poll time. Since this is still a test version I just hard coded it for now.

I'll take a look tonight to add an option where you can select the poll time when using the GSM Low data mode.

Due to the way it works, I don't like the idea of text field since you don't need that resolution in any event. I was thinking a dropdown, with several options say "30mins, 60mins, 90mins, 120mins, Never/Manual".

That being said, what's the difference between say, 30 mins, 60 mins and "never" from a user perspective really? If it's already that long, you're probably not going to rely on it for automations etc. anyway. The IDS App is in fact "Never" i.e. only manual.

So maybe just a 120mins and "Manual only". "Manual Only" will probably really mean something like once a day or longer.

It still refreshes immediately when you arm, disarm, bypass etc. from the integration. You also have a "Refresh" button, and you get "Cell phone" notifications to HASS which can automate a refresh.

I personally am not going to use this feature, so what are your thoughts? Then I can see what I can implement.

kimfr commented 3 months ago

Yeah, I suspect I would also just run it as “Manual” as my plan was to refresh on various “events” together with using HA to arm/disarm instead of Phone AppSo, a timed option and the “Manual Only” as a predefined selection is probably best. I would probably suggest 120 min. as with 60 min. I think you might be running to close to the “GSM Data limit” in some cases. ThanksKimSent from my iPhoneOn 01 Jul 2024, at 13:41, hawky358 @.***> wrote: Thanks for the feedback. When initially implementing it, I was actually thinking about a field so that you can choose a poll time. Since this is still a test version I just hard coded it for now. I'll take a look tonight to add an option where you can select the poll time when using the GSM Low data mode. Due to the way it works I don't like the idea of text field, since you don't need that resolution in any event, so I was thinking a dropdown, with several options say 30mins, 60mins, 90mins, 120mins, Never/Manual. That being said, what's the difference between say, 30 mins, 60 mins and "never" from a user perspective really? If it's already that long, you're probably not going to rely on it for automations etc. anyway. The IDS App is in fact "Never" i.e. only manual. So maybe just a 120mins and "Manual only". "Manual Only" will probably really mean something like once a day or longer. It still refreshes immediately on arm, disarm, bypass etc. and you have a "Refresh" button and you get "Cell phone" notifications to HASS which can automate a refresh. I personally am not going to use this feature, so what are your thoughts? Then I can see what I can implement.

—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you commented.Message ID: @.***>

hawky358 commented 3 months ago

I've published 1.7.0-b2. I've replaced the tick box with a dropdown where you can select the polling times. Currrently 30secs, 120min and Never* (Never is currently once a day)

gsmmode_poll

hawky358 commented 2 months ago

Were you able to see anything with this update or is it too short to be able to tell? i.e. you need around a month to see?

I've released 1.7.0-b4. Just some minor changes (24 hour option and Never = 1 week)

kimfr commented 2 months ago

Sorry, haven't had much time for HA. I have updated to 1.7.0-b4 and changed the interval to "Never". Previously, I was running 60 min. and I was fine on the monthly basis. Will have to see at the end of the month.

Thanks for adding the refresh option, I will change how all the automation works as you added the "Refresh" - good for those cases where the alarm status is changed outside of HA (no names mentioned as to who might do that ;-) ).

hawky358 commented 2 months ago

No worries, no rush. This is "your" feature after all.

I'm going to leave it as is for the next month or so. Let's see what happens.

Pieterjvr commented 2 months ago

Hi Hawky

Finally had some time today, but I can not get the beta switch in HACS. Am I doing something wrong?

Regards. Pieter

From: hawky358 @.> Sent: Tuesday, July 9, 2024 9:51 PM To: hawky358/hass_ids_hyyp @.> Cc: Pieter Janse van Rensburg @.>; Author @.> Subject: Re: [hawky358/hass_ids_hyyp] HYYP App go Offline (Issue #26)

No worries, no rush. This is "your" feature after all.

I'm going to leave it as is for the next month or so. Let's see what happens.

— Reply to this email directly, view it on GitHubhttps://github.com/hawky358/hass_ids_hyyp/issues/26#issuecomment-2218551893, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AI2JQ6JZR7NTS75ZFDZIHG3ZLQ5JLAVCNFSM6AAAAABJ2B5QDCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMJYGU2TCOBZGM. You are receiving this because you authored the thread.Message ID: @.**@.>>

hawky358 commented 2 months ago

Should be as simple as going to redownload and ticking the show beta option. I can't recall that HACS had any settings that you could change on this.

https://github.com/user-attachments/assets/46e98665-d2bf-405b-82d0-b3e3a7c5a043

Pieterjvr commented 2 months ago

Hi Hawky

I was running the new HACS Experimental version which did not gave me the beta option. I manage to install the beta, I set mine to 24hour and never but the the HYYP went offline again on my iphone.

Kind Regards, Pieter

From: hawky358 @.> Sent: Sunday, July 14, 2024 12:50 PM To: hawky358/hass_ids_hyyp @.> Cc: Pieter Janse van Rensburg @.>; Author @.> Subject: Re: [hawky358/hass_ids_hyyp] HYYP App go Offline (Issue #26)

Should be as simple as going to redownload and ticking the show beta option. I can't recall that HACS had any settings that you could change on this.

https://github.com/user-attachments/assets/46e98665-d2bf-405b-82d0-b3e3a7c5a043

— Reply to this email directly, view it on GitHubhttps://github.com/hawky358/hass_ids_hyyp/issues/26#issuecomment-2227300652, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AI2JQ6PIFBNVU2RNPITYWLDZMJJVNAVCNFSM6AAAAABJ2B5QDCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMRXGMYDANRVGI. You are receiving this because you authored the thread.Message ID: @.**@.>>

hawky358 commented 2 months ago

Hmm, I don't think this has anything to do with that then. It happens too quickly I think, since the integration isn't really doing anything.

Are you logged into multiple phones via the app? Can you try that if not and see whether something happens? Wondering whether you have some sort of limitation on that.

Pieterjvr commented 2 months ago

It happens on my wife’s phone as well. I think there is a limitation on HYYP GSM side, but cannot confirm this

From: hawky358 @.> Sent: Monday, July 15, 2024 1:45 PM To: hawky358/hass_ids_hyyp @.> Cc: Pieter Janse van Rensburg @.>; Author @.> Subject: Re: [hawky358/hass_ids_hyyp] HYYP App go Offline (Issue #26)

Hmm, I don't think this has anything to do with that then. It happens too quickly I think, since the integration isn't really doing anything.

Are you logged into multiple phones via the app? Can you try that if not and see whether something happens? Wondering whether you have done sort of limitation on that.

— Reply to this email directly, view it on GitHubhttps://github.com/hawky358/hass_ids_hyyp/issues/26#issuecomment-2228306510, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AI2JQ6M4SGBYJOOK5UI7XOLZMOY5HAVCNFSM6AAAAABJ2B5QDCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMRYGMYDMNJRGA. You are receiving this because you authored the thread.Message ID: @.**@.>>

Pieterjvr commented 2 months ago

Hi Hawky

I gave it another go, but this time on the integration I did not select 24hour Polling first and changed it afterward to Never. It seems Like HA might keep some cache.

Currently 24hours later and the integration is set to Never Polling and both my HA and mobile app still online. Crossing fingers.

Do you perhaps have the visual code for the stay profile card for the dashboard. For some reason I cannot find it.

Kind Regards, Pieter

From: Pieter Janse van Rensburg Sent: Monday, July 15, 2024 2:00 PM To: hawky358/hass_ids_hyyp @.>; hawky358/hass_ids_hyyp @.> Cc: Author @.***> Subject: RE: [hawky358/hass_ids_hyyp] HYYP App go Offline (Issue #26)

It happens on my wife’s phone as well. I think there is a limitation on HYYP GSM side, but cannot confirm this

From: hawky358 @.**@.>> Sent: Monday, July 15, 2024 1:45 PM To: hawky358/hass_ids_hyyp @.**@.>> Cc: Pieter Janse van Rensburg @.**@.>>; Author @.**@.>> Subject: Re: [hawky358/hass_ids_hyyp] HYYP App go Offline (Issue #26)

Hmm, I don't think this has anything to do with that then. It happens too quickly I think, since the integration isn't really doing anything.

Are you logged into multiple phones via the app? Can you try that if not and see whether something happens? Wondering whether you have done sort of limitation on that.

— Reply to this email directly, view it on GitHubhttps://github.com/hawky358/hass_ids_hyyp/issues/26#issuecomment-2228306510, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AI2JQ6M4SGBYJOOK5UI7XOLZMOY5HAVCNFSM6AAAAABJ2B5QDCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMRYGMYDMNJRGA. You are receiving this because you authored the thread.Message ID: @.**@.>>

hawky358 commented 2 months ago

Ok, it's possible that HA didn't pull in the new value. If the values are different between versions then HA "loses" the previous set time. I'll fix the values once we "complete" the test. I'll also see if I can make a "Current poll interval" sensor. Don't know how feasible it is, but I'll take a look. Just for information/verification.

Here's the link to my cards I previously posted. Again, a bit messy, but I haven't felt obligated to refactor 😄 . Obviously all my entities are still in there, so you'll have to go through and check

https://github.com/hawky358/hass_ids_hyyp/discussions/14#discussioncomment-6376684

hawky358 commented 2 months ago

Let me know your results please. I hope we can get this working for you.

Pieterjvr commented 2 months ago

Hi Hawky

So I have been testing the beta last week the whole week and so far so good. What I notice was that the status did not update of when the alarm were on or off and I created a automation that refresh every hour the status. After implementing the automation my iPhone app went offline once, but I think it was due to me triggering the automation a few times but it came back online again. Since then automation runs every hour and the status update without any app or integration go offline.

Here is my automation:

alias: Hourly Refresh Alarm Status
description: Hourly Refresh Alarm Status
trigger:
  - platform: time_pattern
    hours: "*"
condition: []
action:
  - service: button.press
    metadata: {}
    data: {}
    target:
      entity_id: <entity of your refresh button>
mode: single

hawky358 commented 2 months ago

Hello,

Yes, it won't update when something changes as it's not polling. It will update if you arm, disarm, etc. from the integration as these immediately queue an update.

The way I recommend you set up your automation is to refresh when there's an update of the notification entity sensor.[site]_ids_push_notifications This is the entity that receives the "push notifications" similar to your cell phone notifications from IDS. This way any time something "happens" it will update the integration.

Creating an automation to refresh every hour is the same as changing the polling time to an hour. The refresh just polls the server.

Unfortunately it seems that you are very limited in how much you can poll.

Pieterjvr commented 2 months ago

Thanks for this. I will give it a go and do some more testing this week and give feedback agin

hawky358 commented 2 months ago

What you can do for your tests is to also add a push notification to that automation in home assistant which sends you a notification to your cell phone whenever sensor.[site]_ids_push_notifications changes. This way you can confirm that sensor is working and you can go check whether the alarm updated.

I personally don't use the IDS HYYP app at all, even the notifications (i.e. cell phone push notifications) are sent via home assistant using that sensor's values.

hawky358 commented 1 month ago

Hello,

From our discussions above it seems like we've identified that the issue seems to be a polling limit on IDS's side on the GSM module. I've implemented a "fix" for this by means of selectable polling times and a refresh button which can be used in conjunction with the push notification sensor for example. It's not ideal, but we can't change how IDS systems work.

I've released 1.7.0 as a test release and will shortly move it over to the official release. Please let me know if there are any other issues specifically related to this issue #26, otherwise I will close the issue as resolved.

Pieterjvr commented 1 month ago

Hi Hawky

For some reason my push notification show unknown and I could not setup the automation up as per your suggestion. Even with the automation I did to press refresh refresh every hour worked well, but I also notice it twice where everything was unknown and I was required to reload the integration to get status back from the IDS.

What I have done to mitigate this was to setup a new automation to reload the integration every 4hours and disable the press refresh every hours. I only notice it as well once that the mobile app show online but could not arm nor disarm my IDS, but this could have been something on IDS site. still testing and give some new feedback say in a week time.

hawky358 commented 1 month ago

Thanks for the feedback.

I wonder why your notifications is showing Unknown. Normally it will show unknown until you receive the first notification (e.g. arm/bypass/etc.)

Can you try to re-add the integration as see if there are any warnings in the HASS logs?

hawky358 / hass_ids_hyyp

HYYP App go Offline #26