search

home-assistant / operating-system

:beginner: Home Assistant Operating System
Apache License 2.0
4.6k stars 941 forks source link

HAOS freeze randomly #3323

Open axlFThn opened 3 months ago

axlFThn commented 3 months ago

Describe the issue you are experiencing

Every now and then, HAOS freezes, with HA not responding. After a hard reset, the system is as normal again, though history graphs lack data for a certain amount of time (assumable since the system got frozen). Access through developer SSH not possible (refused connection). Same problem existed on older installation with raspbian+dockers; SSD did not reveal any issue (hdparm)

What operating system image do you use?

rpi4-64 (Raspberry Pi 4/400 64-bit OS)

What version of Home Assistant Operating System is installed?

6.1.73-haos-raspi

Did you upgrade the Operating System.

Yes

Steps to reproduce the issue

  1. Normal operation
  2. HA mobile app lacks some data, browser interface cannot update dashboards and functions
  3. Power reset Pi
  4. System functions normally, but history graph misses data

Anything in the Supervisor logs that might be useful for us?

2024-04-23 07:02:47.576 INFO (MainThread) [supervisor.store.git] Loading add-on /data/addons/git/45df7312 repository
2024-04-23 07:02:47.581 INFO (MainThread) [supervisor.store.git] Loading add-on /data/addons/core repository
2024-04-23 07:02:48.319 INFO (MainThread) [supervisor.store] Loading add-ons from store: 81 all - 81 new - 0 remove
2024-04-23 07:02:48.417 INFO (MainThread) [supervisor.addons.manager] Found 8 installed add-ons
2024-04-23 07:02:48.451 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/hassio-addons/vscode/aarch64 with version 5.15.0
2024-04-23 07:02:48.453 INFO (MainThread) [supervisor.docker.interface] Attaching to homeassistant/aarch64-addon-mosquitto with version 6.4.0
2024-04-23 07:02:48.466 INFO (MainThread) [supervisor.docker.interface] Attaching to zigbee2mqtt/zigbee2mqtt-aarch64 with version 1.36.1-1
2024-04-23 07:02:48.468 INFO (MainThread) [supervisor.docker.interface] Attaching to homeassistant/aarch64-addon-duckdns with version 1.16.0
2024-04-23 07:02:48.475 INFO (MainThread) [supervisor.docker.interface] Attaching to homeassistant/aarch64-addon-nginx_proxy with version 3.9.0
2024-04-23 07:02:48.484 INFO (MainThread) [supervisor.docker.interface] Attaching to dac3d81b/aarch64-addon-hdd_tools with version 1.1.0
2024-04-23 07:02:48.485 INFO (MainThread) [supervisor.docker.interface] Attaching to homeassistant/aarch64-addon-ssh with version 9.13.0
2024-04-23 07:02:48.486 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/esphome/esphome-hassio with version 2024.4.0
2024-04-23 07:02:48.540 INFO (MainThread) [supervisor.backups.manager] Found 7 backup files
2024-04-23 07:02:48.559 INFO (MainThread) [supervisor.discovery] Loaded 2 messages
2024-04-23 07:02:48.559 INFO (MainThread) [supervisor.ingress] Loaded 1 ingress sessions
2024-04-23 07:02:48.559 INFO (MainThread) [supervisor.resolution.check] Starting system checks with state setup
2024-04-23 07:02:48.560 INFO (MainThread) [supervisor.resolution.check] System checks complete
2024-04-23 07:02:48.560 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state setup
2024-04-23 07:02:48.561 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-04-23 07:02:48.561 INFO (MainThread) [supervisor.jobs] 'ResolutionFixup.run_autofix' blocked from execution, system is not running - setup
2024-04-23 07:02:48.567 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state setup
2024-04-23 07:02:48.567 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-04-23 07:02:48.569 INFO (MainThread) [__main__] Running Supervisor
2024-04-23 07:02:48.582 INFO (MainThread) [supervisor.os.manager] Rauc: B - marked slot kernel.1 as good
2024-04-23 07:02:48.605 INFO (MainThread) [supervisor.addons.manager] Phase 'initialize' starting 0 add-ons
2024-04-23 07:02:48.618 INFO (MainThread) [supervisor.addons.manager] Phase 'system' starting 1 add-ons
2024-04-23 07:02:48.673 INFO (SyncWorker_4) [supervisor.docker.manager] Cleaning addon_core_mosquitto application
2024-04-23 07:02:49.515 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on homeassistant/aarch64-addon-mosquitto with version 6.4.0
2024-04-23 07:02:54.521 INFO (MainThread) [supervisor.addons.manager] Phase 'services' starting 4 add-ons
2024-04-23 07:02:54.581 INFO (SyncWorker_7) [supervisor.docker.manager] Cleaning addon_5c53de3b_esphome application
2024-04-23 07:02:54.994 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on ghcr.io/esphome/esphome-hassio with version 2024.4.0
2024-04-23 07:02:55.053 INFO (SyncWorker_5) [supervisor.docker.manager] Cleaning addon_a0d7b954_vscode application
2024-04-23 07:02:56.015 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on ghcr.io/hassio-addons/vscode/aarch64 with version 5.15.0
2024-04-23 07:02:56.122 INFO (SyncWorker_6) [supervisor.docker.manager] Cleaning addon_core_ssh application
2024-04-23 07:02:57.709 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on homeassistant/aarch64-addon-ssh with version 9.13.0
2024-04-23 07:02:57.828 INFO (SyncWorker_1) [supervisor.docker.manager] Cleaning addon_core_duckdns application
2024-04-23 07:02:59.622 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on homeassistant/aarch64-addon-duckdns with version 1.16.0
2024-04-23 07:03:04.019 INFO (MainThread) [supervisor.services.modules.mqtt] Set core_mosquitto as service provider for mqtt
2024-04-23 07:03:26.163 INFO (MainThread) [supervisor.core] Start Home Assistant Core
2024-04-23 07:03:26.203 INFO (SyncWorker_5) [supervisor.docker.manager] Starting homeassistant
2024-04-23 07:03:26.463 INFO (MainThread) [supervisor.homeassistant.core] Wait until Home Assistant is ready
2024-04-23 07:03:33.298 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state startup
2024-04-23 07:03:33.298 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-04-23 07:03:36.496 INFO (MainThread) [supervisor.homeassistant.api] Updated Home Assistant API token
2024-04-23 07:03:36.505 INFO (MainThread) [supervisor.homeassistant.core] Home Assistant Core state changed to NOT_RUNNING
2024-04-23 07:03:46.553 INFO (MainThread) [supervisor.homeassistant.core] Home Assistant Core state changed to RUNNING
2024-04-23 07:03:46.553 INFO (MainThread) [supervisor.homeassistant.core] Detect a running Home Assistant instance
2024-04-23 07:03:46.554 INFO (MainThread) [supervisor.addons.manager] Phase 'application' starting 3 add-ons
2024-04-23 07:03:46.616 INFO (SyncWorker_5) [supervisor.docker.manager] Cleaning addon_core_nginx_proxy application
2024-04-23 07:03:47.407 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on homeassistant/aarch64-addon-nginx_proxy with version 3.9.0
2024-04-23 07:03:47.502 INFO (SyncWorker_6) [supervisor.docker.manager] Cleaning addon_45df7312_zigbee2mqtt application
2024-04-23 07:03:48.079 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from core_nginx_proxy
2024-04-23 07:03:48.474 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on zigbee2mqtt/zigbee2mqtt-aarch64 with version 1.36.1-1
2024-04-23 07:03:48.526 WARNING (MainThread) [supervisor.docker.addon] HDD Tools running with disabled protected mode!
2024-04-23 07:03:48.528 ERROR (MainThread) [supervisor.docker.addon] Add-on HDD Tools try to access to blocked device sda!
2024-04-23 07:03:48.548 INFO (SyncWorker_1) [supervisor.docker.manager] Cleaning addon_dac3d81b_hdd_tools application
2024-04-23 07:03:49.463 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on dac3d81b/aarch64-addon-hdd_tools with version 1.1.0
2024-04-23 07:03:54.479 INFO (MainThread) [supervisor.misc.tasks] All core tasks are scheduled
2024-04-23 07:03:54.482 INFO (MainThread) [supervisor.core] Supervisor is up and running
2024-04-23 07:03:54.482 INFO (MainThread) [supervisor.host.info] Updating local host information
2024-04-23 07:03:54.494 INFO (MainThread) [supervisor.updater] Fetching update data from https://version.home-assistant.io/stable.json
2024-04-23 07:03:54.496 INFO (MainThread) [supervisor.resolution.check] Starting system checks with state running
2024-04-23 07:03:54.496 INFO (MainThread) [supervisor.resolution.checks.base] Run check for pwned/addon
2024-04-23 07:03:55.116 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_ipv6_error/dns_server
2024-04-23 07:03:55.126 INFO (MainThread) [supervisor.resolution.checks.base] Run check for ipv4_connection_problem/system
2024-04-23 07:03:55.127 INFO (MainThread) [supervisor.resolution.checks.base] Run check for trust/supervisor
2024-04-23 07:03:55.145 INFO (MainThread) [supervisor.resolution.checks.base] Run check for free_space/system
2024-04-23 07:03:55.146 INFO (MainThread) [supervisor.resolution.checks.base] Run check for docker_config/system
2024-04-23 07:03:55.147 INFO (MainThread) [supervisor.resolution.checks.base] Run check for no_current_backup/system
2024-04-23 07:03:55.148 INFO (MainThread) [supervisor.resolution.module] Create new suggestion create_full_backup - system / None
2024-04-23 07:03:55.149 INFO (MainThread) [supervisor.resolution.module] Create new issue no_current_backup - system / None
2024-04-23 07:03:55.149 INFO (MainThread) [supervisor.resolution.checks.base] Run check for multiple_data_disks/system
2024-04-23 07:03:55.150 INFO (MainThread) [supervisor.resolution.checks.base] Run check for security/core
2024-04-23 07:03:55.151 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_failed/dns_server
2024-04-23 07:03:55.167 INFO (MainThread) [supervisor.resolution.check] System checks complete
2024-04-23 07:03:55.168 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state running
2024-04-23 07:03:55.918 INFO (MainThread) [supervisor.host.services] Updating service information
2024-04-23 07:03:55.950 INFO (MainThread) [supervisor.host.network] Updating local network information
2024-04-23 07:03:56.997 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-04-23 07:03:56.999 INFO (MainThread) [supervisor.resolution.fixup] Starting system autofix at state running
2024-04-23 07:03:56.000 INFO (MainThread) [supervisor.resolution.fixup] System autofix complete
2024-04-23 07:03:56.582 INFO (MainThread) [supervisor.host.sound] Updating PulseAudio information
2024-04-23 07:03:56.613 INFO (MainThread) [supervisor.host.manager] Host information reload completed
2024-04-23 07:33:54.795 INFO (MainThread) [supervisor.homeassistant.api] Updated Home Assistant API token
2024-04-23 08:02:48.572 INFO (MainThread) [supervisor.resolution.check] Starting system checks with state running
2024-04-23 08:02:48.573 INFO (MainThread) [supervisor.resolution.checks.base] Run check for pwned/addon
2024-04-23 08:02:48.667 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_ipv6_error/dns_server
2024-04-23 08:02:48.669 INFO (MainThread) [supervisor.resolution.checks.base] Run check for ipv4_connection_problem/system
2024-04-23 08:02:48.669 INFO (MainThread) [supervisor.resolution.checks.base] Run check for trust/supervisor
2024-04-23 08:02:48.686 INFO (MainThread) [supervisor.resolution.checks.base] Run check for free_space/system
2024-04-23 08:02:48.687 INFO (MainThread) [supervisor.resolution.checks.base] Run check for docker_config/system
2024-04-23 08:02:48.688 INFO (MainThread) [supervisor.resolution.checks.base] Run check for multiple_data_disks/system
2024-04-23 08:02:48.688 INFO (MainThread) [supervisor.resolution.checks.base] Run check for security/core
2024-04-23 08:02:48.689 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_failed/dns_server
2024-04-23 08:02:48.690 INFO (MainThread) [supervisor.resolution.check] System checks complete
2024-04-23 08:02:48.690 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state running
2024-04-23 08:02:48.901 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-04-23 08:02:48.902 INFO (MainThread) [supervisor.resolution.fixup] Starting system autofix at state running
2024-04-23 08:02:48.902 INFO (MainThread) [supervisor.resolution.fixup] System autofix complete
2024-04-23 08:03:55.127 INFO (MainThread) [supervisor.homeassistant.api] Updated Home Assistant API token

Anything in the Host logs that might be useful for us?

2024-04-23 05:03:47.694 gertrud kernel: hassio: port 11(veth9ea8869) entered blocking state
2024-04-23 05:03:47.694 gertrud kernel: hassio: port 11(veth9ea8869) entered forwarding state
2024-04-23 05:03:47.695 gertrud NetworkManager[510]: <info>  [1713848627.6952] manager: (veth9ea8869): new Veth device (/org/freedesktop/NetworkManager/Devices/30)
2024-04-23 05:03:47.836 gertrud kernel: hassio: port 11(veth9ea8869) entered disabled state
2024-04-23 05:03:48.002 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-b33a2009155a2b7bbc46378cfc4be02a0701d16a753f3d65f621fc47f31a4ad1-runc.2JKtgL.mount: Deactivated successfully.
2024-04-23 05:03:48.038 gertrud systemd[1]: Started libcontainer container b33a2009155a2b7bbc46378cfc4be02a0701d16a753f3d65f621fc47f31a4ad1.
2024-04-23 05:03:48.401 gertrud kernel: eth0: renamed from vethdce9720
2024-04-23 05:03:48.416 gertrud kernel: IPv6: ADDRCONF(NETDEV_CHANGE): veth9ea8869: link becomes ready
2024-04-23 05:03:48.416 gertrud kernel: hassio: port 11(veth9ea8869) entered blocking state
2024-04-23 05:03:48.416 gertrud kernel: hassio: port 11(veth9ea8869) entered forwarding state
2024-04-23 05:03:48.418 gertrud NetworkManager[510]: <info>  [1713848628.4183] device (veth9ea8869): carrier: link connected
2024-04-23 05:03:48.747 gertrud systemd[1]: var-lib-docker-overlay2-2cc56bcd8d72b47d9c3ca86797bcab58ffe99b47399d911aa2f987a6aa12f9b6\x2dinit-merged.mount: Deactivated successfully.
2024-04-23 05:03:48.748 gertrud systemd[1]: mnt-data-docker-overlay2-2cc56bcd8d72b47d9c3ca86797bcab58ffe99b47399d911aa2f987a6aa12f9b6\x2dinit-merged.mount: Deactivated successfully.
2024-04-23 05:03:48.806 gertrud kernel: hassio: port 12(vethe2d55c8) entered blocking state
2024-04-23 05:03:48.806 gertrud kernel: hassio: port 12(vethe2d55c8) entered disabled state
2024-04-23 05:03:48.806 gertrud kernel: device vethe2d55c8 entered promiscuous mode
2024-04-23 05:03:48.806 gertrud kernel: hassio: port 12(vethe2d55c8) entered blocking state
2024-04-23 05:03:48.806 gertrud kernel: hassio: port 12(vethe2d55c8) entered forwarding state
2024-04-23 05:03:48.807 gertrud NetworkManager[510]: <info>  [1713848628.8069] manager: (veth0ea7c2c): new Veth device (/org/freedesktop/NetworkManager/Devices/31)
2024-04-23 05:03:48.814 gertrud NetworkManager[510]: <info>  [1713848628.8144] manager: (vethe2d55c8): new Veth device (/org/freedesktop/NetworkManager/Devices/32)
2024-04-23 05:03:48.857 gertrud kernel: hassio: port 12(vethe2d55c8) entered disabled state
2024-04-23 05:03:49.030 gertrud systemd[1]: Started libcontainer container 33a27a0cba912d94c17cda5ae4494d18055601799a4278ce6ed5b499e1d17744.
2024-04-23 05:03:49.370 gertrud kernel: eth0: renamed from veth0ea7c2c
2024-04-23 05:03:49.389 gertrud kernel: IPv6: ADDRCONF(NETDEV_CHANGE): vethe2d55c8: link becomes ready
2024-04-23 05:03:49.390 gertrud kernel: hassio: port 12(vethe2d55c8) entered blocking state
2024-04-23 05:03:49.390 gertrud kernel: hassio: port 12(vethe2d55c8) entered forwarding state
2024-04-23 05:03:49.391 gertrud NetworkManager[510]: <info>  [1713848629.3915] device (vethe2d55c8): carrier: link connected
2024-04-23 05:03:54.505 gertrud kernel: kauditd_printk_skb: 124 callbacks suppressed
2024-04-23 05:03:54.506 gertrud kernel: audit: type=1334 audit(1713848634.499:350): prog-id=76 op=LOAD
2024-04-23 05:03:54.506 gertrud kernel: audit: type=1334 audit(1713848634.499:351): prog-id=77 op=LOAD
2024-04-23 05:03:54.506 gertrud kernel: audit: type=1334 audit(1713848634.499:352): prog-id=78 op=LOAD
2024-04-23 05:03:54.531 gertrud systemd[1]: Starting Hostname Service...
2024-04-23 05:03:55.072 gertrud systemd[1]: Started Hostname Service.
2024-04-23 05:03:55.101 gertrud kernel: audit: type=1334 audit(1713848635.095:353): prog-id=79 op=LOAD
2024-04-23 05:03:55.102 gertrud kernel: audit: type=1334 audit(1713848635.095:354): prog-id=80 op=LOAD
2024-04-23 05:03:55.102 gertrud kernel: audit: type=1334 audit(1713848635.099:355): prog-id=81 op=LOAD
2024-04-23 05:03:55.135 gertrud systemd[1]: Starting Time & Date Service...
2024-04-23 05:03:55.823 gertrud systemd[1]: Started Time & Date Service.
2024-04-23 05:04:25.109 gertrud systemd[1]: systemd-hostnamed.service: Deactivated successfully.
2024-04-23 05:04:25.201 gertrud kernel: audit: type=1334 audit(1713848665.194:356): prog-id=78 op=UNLOAD
2024-04-23 05:04:25.202 gertrud kernel: audit: type=1334 audit(1713848665.194:357): prog-id=77 op=UNLOAD
2024-04-23 05:04:25.202 gertrud kernel: audit: type=1334 audit(1713848665.194:358): prog-id=76 op=UNLOAD
2024-04-23 05:04:25.866 gertrud systemd[1]: systemd-timedated.service: Deactivated successfully.
2024-04-23 05:04:25.893 gertrud kernel: audit: type=1334 audit(1713848665.886:359): prog-id=81 op=UNLOAD
2024-04-23 05:04:25.894 gertrud kernel: audit: type=1334 audit(1713848665.886:360): prog-id=80 op=UNLOAD
2024-04-23 05:04:25.894 gertrud kernel: audit: type=1334 audit(1713848665.886:361): prog-id=79 op=UNLOAD
2024-04-23 05:05:56.764 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.mjgV0e.mount: Deactivated successfully.
2024-04-23 05:06:56.955 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.bUMpVb.mount: Deactivated successfully.
2024-04-23 05:08:57.355 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.ZWjp4Q.mount: Deactivated successfully.
2024-04-23 05:09:57.592 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.a9LzXo.mount: Deactivated successfully.
2024-04-23 05:10:27.693 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.YWT0AV.mount: Deactivated successfully.
2024-04-23 05:10:57.791 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.00Ji1u.mount: Deactivated successfully.
2024-04-23 05:11:27.911 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.ImTEIb.mount: Deactivated successfully.
2024-04-23 05:11:58.024 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.7z6urz.mount: Deactivated successfully.
2024-04-23 05:12:58.212 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.16GkYI.mount: Deactivated successfully.
2024-04-23 05:16:59.097 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.MNiXrH.mount: Deactivated successfully.
2024-04-23 05:17:28.568 gertrud systemd[1]: Starting Cleanup of Temporary Directories...
2024-04-23 05:17:28.611 gertrud systemd[1]: systemd-tmpfiles-clean.service: Deactivated successfully.
2024-04-23 05:17:28.611 gertrud systemd[1]: Finished Cleanup of Temporary Directories.
2024-04-23 05:17:59.294 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.dlkqUV.mount: Deactivated successfully.
2024-04-23 05:19:59.698 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.65mq2l.mount: Deactivated successfully.
2024-04-23 05:23:00.322 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.dgKgPg.mount: Deactivated successfully.
2024-04-23 05:23:30.428 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.DEYxZZ.mount: Deactivated successfully.
2024-04-23 05:24:30.637 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.MCUaZa.mount: Deactivated successfully.
2024-04-23 05:25:00.760 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.CJFzhH.mount: Deactivated successfully.
2024-04-23 05:26:31.099 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.iG7H3z.mount: Deactivated successfully.
2024-04-23 05:34:32.685 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.3XT8Ro.mount: Deactivated successfully.
2024-04-23 05:38:33.516 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.wOSiCP.mount: Deactivated successfully.
2024-04-23 05:39:33.757 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.KTi5sq.mount: Deactivated successfully.
2024-04-23 05:40:03.858 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.z8TX6Y.mount: Deactivated successfully.
2024-04-23 05:42:04.284 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.RicUPC.mount: Deactivated successfully.
2024-04-23 05:45:04.900 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.b5dhJi.mount: Deactivated successfully.
2024-04-23 05:45:35.015 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.9entxq.mount: Deactivated successfully.
2024-04-23 05:46:35.212 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.kbBuWq.mount: Deactivated successfully.
2024-04-23 05:47:05.311 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.e1qqj7.mount: Deactivated successfully.
2024-04-23 05:49:05.706 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.jsEIj3.mount: Deactivated successfully.
2024-04-23 05:50:35.986 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.jgPD1n.mount: Deactivated successfully.
2024-04-23 05:51:06.089 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.aQRtdB.mount: Deactivated successfully.
2024-04-23 05:54:36.820 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.RL7x7h.mount: Deactivated successfully.
2024-04-23 05:55:06.932 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.fdHPLP.mount: Deactivated successfully.
2024-04-23 05:56:07.160 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.Isl3ro.mount: Deactivated successfully.
2024-04-23 05:57:07.355 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.GshFE6.mount: Deactivated successfully.
2024-04-23 05:57:37.455 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.OLqggM.mount: Deactivated successfully.
2024-04-23 06:02:08.344 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.o77Zm3.mount: Deactivated successfully.
2024-04-23 06:03:38.635 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.8dPh28.mount: Deactivated successfully.
2024-04-23 06:05:08.952 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.EQS6VQ.mount: Deactivated successfully.
2024-04-23 06:05:39.042 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.0cK5UB.mount: Deactivated successfully.
2024-04-23 06:06:09.153 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.KCMW1i.mount: Deactivated successfully.
2024-04-23 06:07:09.369 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.1tQGD1.mount: Deactivated successfully.
2024-04-23 06:08:09.564 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.V2F4E9.mount: Deactivated successfully.
2024-04-23 06:08:39.669 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.D6VYCR.mount: Deactivated successfully.
2024-04-23 06:11:40.303 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.IYZ6VV.mount: Deactivated successfully.
2024-04-23 06:13:10.626 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.wP64EA.mount: Deactivated successfully.
2024-04-23 06:21:12.176 gertrud systemd[1]: run-docker-runtime\x2drunc-moby-531de2a2b698aef85c32e7626077c26bd10c41946109d5ff6706f16ffa47cd6c-runc.w7b8sA.mount: Deactivated successfully.
2024-04-23 06:21:44.638 gertrud dockerd[612]: 2024/04/23 06:21:44 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
2024-04-23 06:21:44.806 gertrud dockerd[612]: 2024/04/23 06:21:44 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
2024-04-23 06:22:11.851 gertrud dockerd[612]: 2024/04/23 06:22:11 http: superfluous response.WriteHeader call from go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp.(*respWriterWrapper).WriteHeader (wrap.go:98)
2024-04-23 06:22:32.953 gertrud kernel: audit: type=1334 audit(1713853352.947:362): prog-id=82 op=LOAD
2024-04-23 06:22:32.955 gertrud systemd-timesyncd[599]: Network configuration changed, trying to establish connection.
2024-04-23 06:22:32.979 gertrud systemd-timesyncd[599]: Contacted time server 162.159.200.123:123 (time.cloudflare.com).
2024-04-23 06:22:32.979 gertrud systemd[1]: Started Journal Gateway Service.

System information

System Information

version core-2024.4.3
installation_type Home Assistant OS
dev false
hassio true
docker true
user root
virtualenv false
python_version 3.12.2
os_name Linux
os_version 6.1.73-haos-raspi
arch aarch64
timezone Europe/Stockholm
config_dir /config
Home Assistant Community Store GitHub API | ok -- | -- GitHub Content | ok GitHub Web | ok GitHub API Calls Remaining | 5000 Installed Version | 1.34.0 Stage | running Available Repositories | 1400 Downloaded Repositories | 6
Home Assistant Cloud logged_in | false -- | -- can_reach_cert_server | ok can_reach_cloud_auth | ok can_reach_cloud | ok
Home Assistant Supervisor host_os | Home Assistant OS 12.2 -- | -- update_channel | stable supervisor_version | supervisor-2024.04.0 agent_version | 1.6.0 docker_version | 25.0.5 disk_total | 116.7 GB disk_used | 9.5 GB healthy | true supported | true board | rpi4-64 supervisor_api | ok version_api | ok installed_addons | Mosquitto broker (6.4.0), ESPHome (2024.4.0), Studio Code Server (5.15.0), Terminal & SSH (9.13.0), NGINX Home Assistant SSL proxy (3.9.0), Duck DNS (1.16.0), Zigbee2MQTT (1.36.1-1), HDD Tools (1.1.0)
Dashboards dashboards | 3 -- | -- resources | 3 views | 4 mode | storage
Recorder oldest_recorder_run | 12 april 2024 kl. 18:35 -- | -- current_recorder_run | 23 april 2024 kl. 07:03 estimated_db_size | 52.67 MiB database_engine | sqlite database_version | 3.44.2

Additional information

No response

agners commented 3 months ago

Hm, that does sound like a hardware related issue, it might be the SSD/controller/USB bus locking up.

What is the state of the LED when the system locks up?

What power supply do you use?

If you have a different USB SSD, I'd try that.

axlFThn commented 3 months ago

The LED for the SSD is blinking like under normal read/write access, but in a more stringent/repetitive way. Power supply is the official Pi-power-supply. I have to purchase another SSD if nothing else helps. I hoped that hdparm would give some information. Is there any way the system logging could be made more verbose to analyse this issue further?

agners commented 3 months ago

What you can try is connecting a screen and wait for the crash to happen, it might have some indication.

I doubt it is the SSD itself, it is probably more something inbetween, which does not really show up with hdparm.

axlFThn commented 3 months ago

Ok, I gonna check that.

thewookiewon commented 3 months ago

Hello,

I'm encountering this behaviour on my raspberry pi 5 with SSD and either POE+ or official raspberry USB-C power brick for the power source.

axlFThn commented 2 months ago

Tested with another disk (NVMe), together with a usb-hub. But crashes still persist (frequent). Went back to SSD, but changed USB port, which seemed to lower the frequency of crashes. Connected a screen, and finally was able to capture some logs on the CLI.

Question - if it is not the SSD, where else could the fault be coming from? msg602646689-74700

havardthom commented 2 days ago

Might be this issue relating to Zigbee2MQTT: https://github.com/zigbee2mqtt/hassio-zigbee2mqtt/issues/609

You can try disabling the addon to see if it helps