Integration connects but all sensors immediately go to "unavailable"

mike4001 commented 1 week ago

Before submitting a new issue

[x] I redownloaded the latest release and restarted Home Assistant
[x] I've checked known issues
[ ] I've enabled debug logs and attached the relevant logs to this ticket

Problem description

Since today the integration does not show any data.

If I reload the integration it works but a couple of minutes later all sensors go to unavailable again.

Logs show Quota exceeded ?

Honzik1234 commented 1 week ago

the same error

mike4001 commented 1 week ago

After the 10800 seconds (= 3 hours) the integration comes back.

Works for about an hour and now it´s the same error that the integration has to wait 10800 seconds

Screenshot 2024-10-24 152107

Honzik1234 commented 1 week ago

Logger: custom_components.mypyllant.coordinator Zdroj: helpers/update_coordinator.py:386 integrace: myVAILLANT (dokumentace, problémy) První výskyt: 12:46:29 (18 výskyty) Naposledy logováno: 15:02:02

mike4001 commented 1 week ago

Yes, the server responds with Quota exceeded, which I don't understand because I did not change anything.

And the second question is why does the integration wait 3 house before trying to reconnect.

dietersiebs commented 1 week ago

Same here - last few days more or less working, last week I had the same problem. App isn't working correctly, too...

lklimt commented 1 week ago

try to connect your integration or app from another external IP /public IP/ and you will see magic .... Valillant is baning IPs with "too many" requests...

dietersiebs commented 1 week ago

try to connect your integration or app from another external IP /public IP/ and you will see magic .... Valillant is baning IPs with "too many" requests...

OK, when I access with my phone via mobile network, I get the data.

But why banned? I close and stopped the app on my phone directly before I reactivated the integration. And I increase the time-interval for refresh from 60 to 120 seconds. Nevertheless the integration get "Quota exceeded" after severaly hours. Don't know why...

lklimt commented 1 week ago

try to connect your integration or app from another external IP /public IP/ and you will see magic .... Valillant is baning IPs with "too many" requests...

OK, when I access with my phone via mobile network, I get the data.

But why banned? I close and stopped the app on my phone directly before I reactivated the integration. And I increase the time-interval for refresh from 60 to 120 seconds. Nevertheless the integration get "Quota exceeded" after severaly hours. Don't know why...

IMO there should be some kind of request counter from specific IP on Vaillant server. Itś counting requests for a certain period of time. After the quota of thics counter exceeds some value some kind of ban is started. I get experience, that after some time - more days - the counter resets and you can again normal acces the service via this IP. But the parameter of this game I don´t know - I can only tell you that I get ban for refresh interval 180 sec.. Now I´m testing 300 sec. I dom´t know where I canget more specific informations what is allowed and what not. To get more details about the API you need to be registred on Vaillant as developer and this I´m not... and wan´t to be....

dietersiebs commented 1 week ago

Ah, OK. Maybe the problem is not the interval itself. If the integration collects all data at a nearly similar time -> many request in a short time, more you can trigger on a phone in that short time, and that maybe result the problem - don't know, if it's the problem, but if you have the problem with 180 secs, too...

I asked Vaillaint, why there is no possibility to get the data from the gateway f.e., it should store for some time to send it to vaillant. So why not get the data from there - I get no answer still now :(

I'm slowly getting fed up - I ordered the Ebus adapter a few days ago. This situation with the cloud is very, very unsatisfactory and confirms my opinion that working with cloud applications is not the best for all applications

mike4001 commented 1 week ago

But the thing is.

You can just reload the integration and it starks working immediately.

So this "Quota Exceeded" probably only "bans" you for a couple of minutes but the integration waits 3 hours for automatically reconnecting.

But anyway: I restarted my router to get a new IP Adress. Let´s see if it really was this one.

mike4001 commented 1 week ago

I also just saw that folks in https://github.com/signalkraft/mypyllant-component/issues/216 might have the same issue as we have.

One user deleted the integration, added it again and the problem this not occur again.

https://github.com/signalkraft/mypyllant-component/issues/218 as well with the Quota Exceeded message

dietersiebs commented 1 week ago

You can just reload the integration and it starks working immediately.

That's right, really strange

But if I restart the integration,f.e. the heating_energy_efficiency is often "not available" after restart, a few minutes later all other entities will be "not available", too. Will the integration try, to get an update before the intervall is expired, and so it will be banned again? If it will not updated by the integration at the cloud before the intervall is expired, the last value should shown until an update will started.

dietersiebs commented 1 week ago

Hmm, I deleted the integration, restart, add it again, restart

After restart, I noticed, that my credentials and so on are still configured. Where is it stored? The "myphyllant" directory was gone after first restart.

And after short time all entities where not available again :(

dietersiebs commented 1 week ago

Aah, the user has not deleted the integration but deleted his hub (his account settings).

But it doesn't work for me - same situation after short time

dietersiebs commented 1 week ago

I'll try to remove the hub now and configure it new tomorrow again. So the integration will not generate any new update tries.

bartmarchand1 commented 1 week ago

Same here. Last week there as also a problem with requesting power statistics in the Migo app. This is solved, but not for this integration

mike4001 commented 1 week ago

So after changing my IP Address I did not get the Quota exceeded message for about 12 hours now.

But something has to be adressed here. The wait time of 3 hours is just far too long.

misberner commented 1 week ago

The same error started happening for me. I have not been able to get it to work since this morning. It stopped around ~10:20, and restarting the component or even HA didn't allow a single sensor update to complete. Haven't tried a router restart to get a new IP though, but since I'm using a DSLite tunnel, not sure if that would even work.

Either way, I know it's not the fault of the integration, but in general the internet features of my heatpump are near unusable - even the official app is acting up countless times.

lklimt commented 1 week ago

Now I have blocked my both IPs - on Wednesday the first, after I switched the integration to second and now - today stop the second providing the datas to App /the consumptions data/ and to integration too. And the first is still blocked too. Last time I observed that the ban takes over some day. Now I need to wait. IMO it's over with this integration. Vaillant don´t like us - their attitude to the users is horrible. No reaction on emails, ticket etc. And the hotline in CZ full unprofessional in terms of digital conection. The only one way I see to switch to eebus adapter https://adapter.ebusd.eu/v5/ and start to be independent from any server of Vaillant. As this integration I realy like, it's using only wrong way how to get datas, question to the author of this app - can you pls. develop the option to read the datas from eebusd ?

bartmarchand1 commented 1 week ago

Now I have blocked my both IPs - on Wednesday the first, after I switched the integration to second and now - today stop the second providing the datas to App /the consumptions data/ and to integration too. And the first is still blocked too. Last time I observed that the ban takes over some day. Now I need to wait. IMO it's over with this integration. Vaillant don´t like us - their attitude to the users is horrible. No reaction on emails, ticket etc. And the hotline in CZ full unprofessional in terms of digital conection. The only one way I see to switch to eebus adapter https://adapter.ebusd.eu/v5/ and start to be independent from any server of Vaillant. As this integration I realy like, it's using only wrong way how to get datas, question to the author of this app - can you pls. develop the option to read the datas from eebusd ?

I have that adapter with the ebusd integration. Very hard, almost impossible to control the heat pump

Krzysztonek commented 1 week ago

This is ridiculous.. I increasingly regret buying Vaillant... 😢 I would also draw a veil over Vaillant Customer Care approach..

darkearth56 commented 1 week ago

I am seeing the same issue (Error fetching myVAILLANT data: Quota Exceeded on https). But this has coincided with the myVAILLANT app not giving the Energy information data. It is just stating that its collecting consumption data.

TobiasPf commented 1 week ago

Hi all, I seem to be having the same issue. When I'm connected to the same home IP through my smartphone I get "unavailable". Even in MyVaillant app the history data doesn't work. When I get a new IP through cell network the MyVaillant app shows me history data. Home Assistant still has the same IP through my router and the sensors stays unavailable of course.

willenic commented 6 days ago

the same error

Also have the same issue, only noticed it after last core update but could be coincidence.

mike4001 commented 6 days ago

So after changing my IP Address I did not get the Quota exceeded message for about 12 hours now.

But something has to be adressed here. The wait time of 3 hours is just far too long.

With the new IP Address (after router Reboot) it is working flawlessly for 36h now.

Maybe it really is an app bug that the app spams their server and it then blocks the IP which also affects home assistant?

MagunRa commented 6 days ago

For now I route HA through a VPN. At the moment HA and the App are happy.

willenic commented 6 days ago

With the new IP Address (after router Reboot) it is working flawlessly for 36h now.

Just confirming.... Your ISP router? Not the vaillant internet gateway?

kluner commented 6 days ago

it is theoretically possible that something changed in the underlying interface that causes more requests. Thus going over quota. We all updated after the recent change in the API that broke things. It is also possible that Vaillant is having problems (the app is not working well either, even when I go to mobile).

Off course, the quota could be tied to account and not app, but from what I am reading this not the case. I think this is @ Vaillant, because during the night it suddenly worked perfectly, until this morning.

I’m disabling mine for now. Then reconnecting and setting the interval at 300s.

jstott1070 commented 6 days ago

Noticing this morning that the app is currently not showing data that I could see yesterday so I’m assuming their own app is suffering with this IP ban nonsense.

As soon as I drop off my WiFi the data returns so 100% an IP ban.

BuhJuhWuh commented 6 days ago

Same problem here. HA gets some data on restart, but then very quickly reverts to 'unavailable', same "quota exceeded" issue as others have reported. Can't send control signals either, so DHW cycles triggers are getting missed. myVaillant app also missing data except when accessing via mobile data.

rgallo67 commented 6 days ago

Hi,

I've applied the following workaround:

~/HomeAssistant/custom_components/mypyllant` $ diff __init__.BAK __init__.py 
126,131c126,131
<     daily_data_coordinator = DailyDataCoordinator(
<         hass, api, entry, timedelta(seconds=update_interval_daily)
<     )
<     _LOGGER.debug("Refreshing DailyDataCoordinator")
<     await daily_data_coordinator.async_refresh()
<     hass.data[DOMAIN][entry.entry_id]["daily_data_coordinator"] = daily_data_coordinator
---
> #    daily_data_coordinator = DailyDataCoordinator(
> #        hass, api, entry, timedelta(seconds=update_interval_daily)
> #    )
> #    _LOGGER.debug("Refreshing DailyDataCoordinator")
> #    await daily_data_coordinator.async_refresh()
> #    hass.data[DOMAIN][entry.entry_id]["daily_data_coordinator"] = daily_data_coordinator

~/HomeAssistant/custom_components/mypyllant $ diff sensor.BAK sensor.py 
259c259
<     async_add_entities(await create_daily_data_sensors(hass, config))  # type: ignore
---
> #    async_add_entities(await create_daily_data_sensors(hass, config))  # type: ignore

The problem with this workaround: you can't get energy data...

pnm1977 commented 6 days ago

Same issue with my setup. Issue started at 22:20 last night. The data came back every few hours but only lasted an hour before going unavailable again. Every time I disable/enable the integration it comes back but only lasts between 6min-1hour before stopping. Currently playing around with intervals for updates to see where the limit is but not had any luck so far. Have raised a ticket through the myVaillant app because the energy info is missing there as well. So far only reply I've had is "Our service team is now taking care of the further processing and will contact you if necessary". Don't expect a good response from them based on previous experience but you never know. Would recommend that others also raise a ticket with myVaillant to add weight to the issue.

mike4001 commented 6 days ago

With the new IP Address (after router Reboot) it is working flawlessly for 36h now.

Just confirming.... Your ISP router? Not the vaillant internet gateway?

Yes, my ISP router.

jstott1070 commented 6 days ago

Same issue with my setup. Issue started at 22:20 last night. The data came back every few hours but only lasted an hour before going unavailable again. Every time I disable/enable the integration it comes back but only lasts between 6min-1hour before stopping. Currently playing around with intervals for updates to see where the limit is but not had any luck so far. Have raised a ticket through the myVaillant app because the energy info is missing there as well. So far only reply I've had is "Our service team is now taking care of the further processing and will contact you if necessary". Don't expect a good response from them based on previous experience but you never know. Would recommend that others also raise a ticket with myVaillant to add weight to the issue.

I have also raised a support ticket via the app and will replay if and when they respond.

dietersiebs commented 6 days ago

My support-ticket ist open since more than one week. It was supposed to go to the technical unit friday last week (18.) - no further feedback since that...

rholighaus commented 6 days ago

I only got these error message ("quota exceeded") after upgrading Home Assistant to 2024.10.4 - wonder if it's got anything to do with that?

I can still login via the App, however.

pnm1977 commented 6 days ago

I only got these error message ("quota exceeded") after upgrading Home Assistant to 2024.10.4 - wonder if it's got anything to do with that?

I can still login via the App, however.

I'm still on 2024.10.3 and have the issue.

dietersiebs commented 6 days ago

2024.10.3 here, too - with "Quota exceeded"

Motz636 commented 6 days ago

Even non Homeassistant Users have the Problem in Vaillant app not to see the heating energy efficient. Switch to mobile data and its working. So i think they have Quota exceed ban too. Maybe a Problem with the Vaillant App update on mobile phone?

willenic commented 6 days ago

I rolled back to previous HA Core version and still got the quota exceeded errors. Rebooting my router has helped though.

Flori1007 commented 6 days ago

Even non Homeassistant Users have the Problem in Vaillant app not to see the heating energy efficient. Switch to mobile data and its working. So i think they have Quota exceed ban too. Maybe a Problem with the Vaillant App update on mobile phone?

I started to test when the quota exceeded failure starts... I ended up in the HA integration for sensor updates to 40 seconds. Then the HA Sensors worked and also the vaillant app too.

Important: If the quota exceeded ban starts, then the vaillant integration was completely not available the whole day. There was a sign by starting the app "cant connect" and nothing worked in the app itself. I guess they change smt in the background and now we all got these Problems....

pnm1977 commented 5 days ago

Managed to get the data back by playing around with the update options. I deliberately went too far at first and will now try and speed them up again to find a point that works without exceeding the quota.

Below are my current settings which unfortunately means there's no energy data. After applying these settings I restarted the integration. The data came back for a few minutes, then went off for 3 hours, then came back on its own and has been available since yesterday afternoon.

Update settings

Further options

BuhJuhWuh commented 5 days ago

Mine ran straight through from 1400 yesterday to 0700 today with most data available (no CoP figures for some reason, and no history data in the app), but has now become unavailable again. My settings were much more frequent than yours, at 300s and 3600s respectively (and until a few days ago it had been perfectly happy with 60s/3600s). These don't seem like unreasonable intervals for a heating app...

pnm1977 commented 5 days ago

Managed to get the data back by playing around with the update options. I deliberately went too far at first and will now try and speed them up again to find a point that works without exceeding the quota.

Below are my current settings which unfortunately means there's no energy data. After applying these settings I restarted the integration. The data came back for a few minutes, then went off for 3 hours, then came back on its own and has been available since yesterday afternoon.

Only lasted 20 hours with these settings and is now unavailable again.

matejsalamon commented 5 days ago

The same issue here.

lklimt commented 4 days ago

today on both my IPs APP start to regulary run, all datas are avaible. now the question if to start agai the integration...

pnm1977 commented 4 days ago

today on both my IPs APP start to regulary run, all datas are avaible. now the question if to start agai the integration...

Interesting. I'll put my updates back to what they were last week to see if it works.

Peaters commented 4 days ago

Screenshot_20241028_111047_Home Assistant My integration communicates with gaps, sometimes more, sometimes less.

zaziki23 commented 4 days ago

i disabled the app on my phone two days ago but still get quota issues on home assistant

lanthi63 commented 4 days ago

Hi, Since 10h15 I get all datas refreshed: temp + energy. BUT, this wk I've changed some config by encreasing time period between request to Vaillant server. 2024-10-28_17-54-54 2024-10-28_17-57-07 So no explanaition from me, just to share.

signalkraft / mypyllant-component

Integration connects but all sensors immediately go to "unavailable" #226

Before submitting a new issue

Problem description