philbert
commented
2 months ago Same issue occurred again this evening. Now I have set up an automation for HA to send me a push notification when it starts so I can investigate the system shortly afterward and restart the supervisor.
[32m2024-08-19 17:53:23.498 INFO (MainThread) [supervisor.resolution.check] Starting system checks with state running[0m
[32m2024-08-19 17:53:23.498 INFO (MainThread) [supervisor.resolution.checks.base] Run check for ipv4_connection_problem/system[0m
[32m2024-08-19 17:53:23.498 INFO (MainThread) [supervisor.resolution.checks.base] Run check for multiple_data_disks/system[0m
[32m2024-08-19 17:53:23.498 INFO (MainThread) [supervisor.resolution.checks.base] Run check for security/core[0m
[32m2024-08-19 17:53:23.499 INFO (MainThread) [supervisor.resolution.checks.base] Run check for disabled_data_disk/system[0m
[32m2024-08-19 17:53:23.499 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_ipv6_error/dns_server[0m
[32m2024-08-19 17:53:23.550 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_failed/dns_server[0m
[32m2024-08-19 17:53:23.551 INFO (MainThread) [supervisor.resolution.checks.base] Run check for no_current_backup/system[0m
[32m2024-08-19 17:53:23.551 INFO (MainThread) [supervisor.resolution.checks.base] Run check for pwned/addon[0m
[32m2024-08-19 17:53:23.551 INFO (MainThread) [supervisor.resolution.checks.base] Run check for trust/supervisor[0m
[32m2024-08-19 17:53:23.558 INFO (MainThread) [supervisor.resolution.checks.base] Run check for free_space/system[0m
[32m2024-08-19 17:53:23.558 INFO (MainThread) [supervisor.resolution.checks.base] Run check for docker_config/system[0m
[32m2024-08-19 17:53:23.558 INFO (MainThread) [supervisor.resolution.check] System checks complete[0m
[32m2024-08-19 17:53:23.558 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state running[0m
[32m2024-08-19 17:53:23.619 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete[0m
[32m2024-08-19 17:53:23.620 INFO (MainThread) [supervisor.resolution.fixup] Starting system autofix at state running[0m
[32m2024-08-19 17:53:23.620 INFO (MainThread) [supervisor.resolution.fixup] System autofix complete[0m
[32m2024-08-19 17:54:40.786 INFO (MainThread) [supervisor.updater] Fetching update data from https://version.home-assistant.io/stable.json[0m
[32m2024-08-19 17:55:08.604 INFO (MainThread) [supervisor.homeassistant.api] Updated Home Assistant API token[0m
[31m2024-08-19 17:55:31.205 ERROR (MainThread) [aiohttp.server] Error handling request
Traceback (most recent call last):
File "/usr/local/lib/python3.12/site-packages/aiohttp/web_protocol.py", line 452, in _handle_request
resp = await request_handler(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/aiohttp/web_app.py", line 543, in _handle
resp = await handler(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/aiohttp/web_middlewares.py", line 114, in impl
return await handler(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/supervisor/supervisor/api/middleware/security.py", line 189, in block_bad_requests
return await handler(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/supervisor/supervisor/api/middleware/security.py", line 205, in system_validation
return await handler(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/supervisor/supervisor/api/middleware/security.py", line 224, in token_validation
return await handler(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/supervisor/supervisor/api/middleware/security.py", line 283, in core_proxy
return await handler(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/supervisor/supervisor/api/ingress.py", line 161, in handler
return await self._handle_websocket(request, addon, path, session_data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/supervisor/supervisor/api/ingress.py", line 190, in _handle_websocket
await ws_server.prepare(request)
File "/usr/local/lib/python3.12/site-packages/aiohttp/web_ws.py", line 152, in prepare
payload_writer = await super().prepare(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/aiohttp/web_response.py", line 417, in prepare
return await self._start(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/aiohttp/web_response.py", line 425, in _start
await self._write_headers()
File "/usr/local/lib/python3.12/site-packages/aiohttp/web_response.py", line 505, in _write_headers
await writer.write_headers(status_line, self._headers)
File "/usr/local/lib/python3.12/site-packages/aiohttp/http_writer.py", line 130, in write_headers
self._write(buf)
File "/usr/local/lib/python3.12/site-packages/aiohttp/http_writer.py", line 75, in _write
raise ConnectionResetError("Cannot write to closing transport")
ConnectionResetError: Cannot write to closing transport[0m
bdraco
github-actions[bot]
Describe the issue you are experiencing
For a very long time on my setup (maybe 1 year+) ingress has been dying 2-3 times per month. The problem has migrated with my setup from a RPI4 4GB with SD card, to RPI4 4GB with SSD, to an Intel N100 with 16GB.
After ingress from the supervisor dies, HA still appears to run correctly, but all add-ons become unavailable. The only way to resolve the problem is to ssh to the host and run
ha supervisor restartor to restart the host OS from the GUI.The problem seems to begin with the supervisor encountering
ConnectionResetError: Cannot write to closing transport. This error occurs 22 times in the log file, and then HA is restarted. However when HA comes up again the supervisor seems to fail to establish contact with it as the supervisor log continually repeats the errorTimeout on call http://172.30.32.1:8123/api/core/statesupervisor-2024-08-14.log
From what I can tell in the HA log, everything appears ok except for one odd thing that I can't explain which is that this message from HA:
s6-rc: info: service legacy-services: stoppingat18:48:58.033occurs before the supervisor log message:[supervisor.docker.manager] Restarting homeassistantat18:49:35.445. This oddity is quite a bit after the initial problems that the supervisor encountered, so I'm inclined not to read too much into it.ha-2024-08-14.log
What type of installation are you running?
Home Assistant OS
Which operating system are you running on?
Home Assistant Operating System
Steps to reproduce the issue
Anything in the Supervisor logs that might be useful for us?
System Health information
There are currently no repairs availableSupervisor diagnostics
config_entry-hassio-a7a964f4381b8f813b47cd58b792c395.json
Additional information
No response