Data retrieval failure immediately after 00:00 daily

System Health details

System Information

version	core-2024.11.2
installation_type	Home Assistant OS
dev	false
hassio	true
docker	true
user	root
virtualenv	false
python_version	3.12.4
os_name	Linux
os_version	6.6.54-haos
arch	aarch64
timezone	Asia/Jerusalem
config_dir	/config

Home Assistant Community Store

Home Assistant Cloud

Home Assistant Supervisor

Dashboards

Recorder

Spotify

api_endpoint_reachable | ok -- | --

Checklist

[X] I have enabled debug logging for my installation.
[X] I have filled out the issue template to the best of my ability.
[X] This issue only contains 1 issue (if you have multiple issues, open one issue for each issue).
[X] This issue is not a duplicate issue of any previous issues..

Describe the issue

The integration consistently fails to import data immediately after 00:00 every day. Last night it failed at 00:01, 00:11, 00:21 and 00:31 It succeeded at 00:41 and all subsequent API calls today

Reproduction steps

This occurs daily when the integration is active, requiring no additional action

Debug logs

Full log from 2024-11-21 22:50 until 2024-11-22 07:30
https://drive.google.com/file/d/1nRAKcOe_1wcJJUb0wo-CKcOgeZK05Xlq/view?usp=sharing

Section of the log from 2024-11-21 23:40 until 2024-11-22 01:30
https://drive.google.com/file/d/1nS-gnueT7KTG--G9v4IYbOr5t5uh8Sin/view?usp=sharing

Diagnostics dump

See above

at 00:11 - this is the response from IMS:

{
    "stationId": 45,
    "data": [
        {
            "datetime": "2024-11-21T23:40:00+02:00",
            "channels": [
                {
                    "id": 1,
                    "name": "Rain",
                    "alias": null,
                    "value": 0.0,
                    "status": 1,
                    "valid": true,
                    "description": null
                },
                {
                    "id": 2,
                    "name": "WSmax",
                    "alias": null,
                    "value": 2.1,
                    "status": 1,
                    "valid": true,
                    "description": null
                },
                {
                    "id": 3,
                    "name": "WDmax",
                    "alias": null,
                    "value": 113.0,
                    "status": 1,
                    "valid": true,
                    "description": null
                },
                {
                    "id": 4,
                    "name": "WS",
                    "alias": null,
                    "value": 1.4,
                    "status": 1,
                    "valid": true,
                    "description": null
                },
                {
                    "id": 5,
                    "name": "WD",
                    "alias": null,
                    "value": 106.0,
                    "status": 1,
                    "valid": true,
                    "description": null
                },
                {
                    "id": 6,
                    "name": "STDwd",
                    "alias": null,
                    "value": 11.6,
                    "status": 1,
                    "valid": true,
                    "description": null
                },
                {
                    "id": 7,
                    "name": "RH",
                    "alias": null,
                    "value": 78.0,
                    "status": 1,
                    "valid": true,
                    "description": null
                },
                {
                    "id": 8,
                    "name": "TD",
                    "alias": null,
                    "value": 17.3,
                    "status": 1,
                    "valid": true,
                    "description": null
                },
                {
                    "id": 10,
                    "name": "TDmax",
                    "alias": null,
                    "value": 17.5,
                    "status": 1,
                    "valid": true,
                    "description": null
                },
                {
                    "id": 11,
                    "name": "TDmin",
                    "alias": null,
                    "value": 17.1,
                    "status": 1,
                    "valid": true,
                    "description": null
                },
                {
                    "id": 13,
                    "name": "WS1mm",
                    "alias": null,
                    "value": 1.7,
                    "status": 1,
                    "valid": true,
                    "description": null
                },
                {
                    "id": 14,
                    "name": "Ws10mm",
                    "alias": null,
                    "value": 1.4,
                    "status": 1,
                    "valid": true,
                    "description": null
                },
                {
                    "id": 15,
                    "name": "Time",
                    "alias": null,
                    "value": 2339.0,
                    "status": 1,
                    "valid": true,
                    "description": null
                },
                {
                    "id": 18,
                    "name": "TW",
                    "alias": null,
                    "value": -9999.0,
                    "status": 2,
                    "valid": false,
                    "description": null
                }
            ]
        }
    ]
}

So it's a success (also - note the latest report timestamp - 23:40, instead of 00:00 or 00:10, but that's another IMS issues). In the logs:

2024-11-22 00:11:32.882 DEBUG (MainThread) [custom_components.ims_envista] Station 45 latest data: StationID: 45, Date: 2024-11-21 23:40:00+02:00, Readings: [(TD: 17.3°C), (TDmax: 17.5°C), (TDmin: 17.1°C), (TG: None), (RH: 78.0%), (Rain: None), (WS: 1.4m/s), (WSmax: 2.1m/s), (WD: 106.0deg), (WDmax: 113.0deg), (STDwd: 11.6deg), (WS1mm: 1.7m/s), (WS10mm: 1.4m/s), (Time: 23:39hhmm)]
2024-11-22 00:11:32.882 DEBUG (MainThread) [ims_envista.commons] Sending GET from https://api.ims.gov.il/v1/envista/stations/45/data/daily
2024-11-22 00:11:32.922 DEBUG (MainThread) [custom_components.ims_envista] Finished fetching ims_envista data in 5.368 seconds (success: False)

I've added a PR (#25) for disabling the Daily fetch (as it's redundant at this point), and perhaps that'll improve this. Please update to the next version

2024-11-22 00:11:32.922 DEBUG (MainThread) [custom_components.ims_envista] Finished fetching ims_envista data in 5.368 seconds (success: False)

At the end of the third line of the log that you entered is "success: False"

I think you have found the issue - the disconnect between the actual date 2024-11-22 and the timestamp in the response. In the 00:31 data it is still 23:58 of 2024-11-21. In the 00:41 data it is already 00:17, and it loads correctly.

Anyway, I have redownloaded and restarted HA. Now we wait until tomorrow...

Shabbat shalom and thanks again! Paul

Your update seems to have resolved the issue. The integration retrieved data successfully without interruption at 00:00, 00:20, 00:30, 00:40 etc. The entities were never "Unavailable"

GuyKh / ims-envista-custom-component