home-assistant / operating-system

:beginner: Home Assistant Operating System
Apache License 2.0
4.78k stars 956 forks source link

HAOS 13.0 RPI4 unstabled/tainted Install #3540

Closed dipseth closed 3 weeks ago

dipseth commented 3 weeks ago

Describe the issue you are experiencing

Since Installing 13.0 on RPI4 the system is completely unstable and is either in state of frozen /restarting. Shortly before the freezing begins this Error message appears:

[ 363.489746] Tainted: G C [ 6.6.31-haos-raspi #1 363.489765] "echo 0> /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[ 363.489973] INFO: task kworker/u10:1:88 blocked for more than 120 seconds. 
[ 363.489994] Tainted: G C 6.6.31-haos-raspi #1 
[ 363.490011] "echo > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[ 363.490265] 363.490244] INFO: task usb-storage: 93 blocked for more than 120 seconds. Tainted: G C 6.6.31-haos-raspi #1 
[ 363.490281] "echo > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[ 363.490519] INFO: task kworker/2:2:95 blocked for more than 120 seconds. Tainted: G 6.6.31-haos-raspi #1 
[ 363.490537] C 
[ 363.490553] "echo > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[ 363.490725] INFO: task kworker/u13:2:266 blocked for more than 120 seconds. 
[ 363.4907471 Tainted: G C 6.6.31-haos-raspi #1 
[ 363.4907641 "echo 0> /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[ 363.491155] INFO: task NetworkManager: 448 blocked for more than 120 seconds. 
[ 363.491175] Tainted: Gc Tainted: G C 6.6.31-haos-raspi #1 
[ 363.491192] " echo 0> /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[ 363.4914001 INFO: task rpcbind: 457 blocked for more than 120 seconds. 
[363.491419 ] 6.6.31-haos-raspi #1 [363.4916681 INFO: task wpa_supplicant: 460 blocked for more than 120 seconds. proc/sys/kernel/hung_task_timeout_secs" disables this message.

What operating system image do you use?

rpi4-64 (Raspberry Pi 4/400 64-bit OS)

What version of Home Assistant Operating System is installed?

13.0

Did the problem occur after upgrading the Operating System?

Yes

Hardware details

Canakit RPi4-64 1GB Ram

Note bug occured on SD card (LEXAR ) and with SSD equipment below:

CanaKit 3.5A Kingston A400 USB 3.1 variant of the StarTech 2.5″ SATA Sabrent powered USB hub

Steps to reproduce the issue

  1. Installed 13.0
  2. Booted up
  3. Experienced unresponsive system ...

Anything in the Supervisor logs that might be useful for us?

Dont believe so

2024-08-17 07:25:39.734 INFO (MainThread) [supervisor.resolution.fixup] System autofix complete
2024-08-17 07:30:27.291 WARNING (MainThread) [supervisor.addons.options] Option 'secrets' does not exist in the schema for AppDaemon (a0d7b954_appdaemon)
2024-08-17 07:35:28.924 WARNING (MainThread) [supervisor.addons.options] Option 'secrets' does not exist in the schema for AppDaemon (a0d7b954_appdaemon)
2024-08-17 07:39:02.759 WARNING (MainThread) [supervisor.addons.options] Option 'secrets' does not exist in the schema for AppDaemon (a0d7b954_appdaemon)
2024-08-17 07:40:30.963 WARNING (MainThread) [supervisor.addons.options] Option 'secrets' does not exist in the schema for AppDaemon (a0d7b954_appdaemon)
2024-08-17 07:44:52.013 INFO (MainThread) [supervisor.homeassistant.api] Updated Home Assistant API token
2024-08-17 07:45:32.960 WARNING (MainThread) [supervisor.addons.options] Option 'secrets' does not exist in the schema for AppDaemon (a0d7b954_appdaemon)
2024-08-17 07:50:35.291 WARNING (MainThread) [supervisor.addons.options] Option 'secrets' does not exist in the schema for AppDaemon (a0d7b954_appdaemon)
2024-08-17 07:55:36.350 WARNING (MainThread) [supervisor.addons.options] Option 'secrets' does not exist in the schema for AppDaemon (a0d7b954_appdaemon)
2024-08-17 08:00:39.083 WARNING (MainThread) [supervisor.addons.options] Option 'secrets' does not exist in the schema for AppDaemon (a0d7b954_appdaemon)
2024-08-17 08:05:40.329 WARNING (MainThread) [supervisor.addons.options] Option 'secrets' does not exist in the schema for AppDaemon (a0d7b954_appdaemon)
2024-08-17 08:08:08.372 INFO (MainThread) [supervisor.backups.manager] Backup 7e953ec1 starting stage addon_repositories
2024-08-17 08:08:08.373 INFO (MainThread) [supervisor.backups.manager] Backup 7e953ec1 starting stage docker_config
2024-08-17 08:08:08.374 INFO (MainThread) [supervisor.backups.manager] Creating new partial backup with slug 7e953ec1
2024-08-17 08:08:08.386 INFO (MainThread) [supervisor.backups.manager] Backup 7e953ec1 starting stage home_assistant
2024-08-17 08:08:08.593 INFO (MainThread) [supervisor.homeassistant.module] Backing up Home Assistant Core config folder
2024-08-17 08:08:18.864 INFO (MainThread) [supervisor.api.middleware.security] /supervisor/info access from cebe7a76_hassio_google_drive_backup
2024-08-17 08:08:18.938 INFO (MainThread) [supervisor.api.middleware.security] /backups access from cebe7a76_hassio_google_drive_backup
2024-08-17 08:10:42.996 WARNING (MainThread) [supervisor.addons.options] Option 'secrets' does not exist in the schema for AppDaemon (a0d7b954_appdaemon)
2024-08-17 08:12:07.535 INFO (MainThread) [supervisor.homeassistant.module] Backup Home Assistant Core config folder done
2024-08-17 08:12:07.614 INFO (MainThread) [supervisor.backups.manager] Backup 7e953ec1 starting stage finishing_file
2024-08-17 08:12:07.665 INFO (MainThread) [supervisor.backups.manager] Creating partial backup with slug 7e953ec1 completed
2024-08-17 08:12:07.670 INFO (MainThread) [supervisor.homeassistant.core] Updating Home Assistant to version 2024.8.2
2024-08-17 08:12:07.677 INFO (MainThread) [supervisor.docker.interface] Updating image ghcr.io/home-assistant/raspberrypi4-64-homeassistant:2024.8.1 to ghcr.io/home-assistant/raspberrypi4-64-homeassistant:2024.8.2
2024-08-17 08:12:07.680 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/raspberrypi4-64-homeassistant with tag 2024.8.2.
2024-08-17 08:12:17.897 INFO (MainThread) [supervisor.api.middleware.security] /supervisor/info access from cebe7a76_hassio_google_drive_backup
2024-08-17 08:12:17.959 INFO (MainThread) [supervisor.api.middleware.security] /backups access from cebe7a76_hassio_google_drive_backup
2024-08-17 08:12:18.170 INFO (MainThread) [supervisor.api.middleware.security] /backups/7e953ec1/info access from cebe7a76_hassio_google_drive_backup
2024-08-17 08:12:18.211 INFO (MainThread) [supervisor.api.middleware.security] /supervisor/info access from cebe7a76_hassio_google_drive_backup
2024-08-17 08:12:18.219 INFO (MainThread) [supervisor.api.middleware.security] /backups access from cebe7a76_hassio_google_drive_backup
2024-08-17 08:14:53.195 INFO (MainThread) [supervisor.homeassistant.api] Updated Home Assistant API token
2024-08-17 08:15:06.736 INFO (SyncWorker_6) [supervisor.docker.manager] Stopping homeassistant application
2024-08-17 08:15:07.663 INFO (MainThread) [supervisor.api.proxy] Home Assistant WebSocket API for a0d7b954_appdaemon closed
2024-08-17 08:15:33.765 INFO (SyncWorker_6) [supervisor.docker.manager] Cleaning homeassistant application
2024-08-17 08:15:34.722 INFO (MainThread) [supervisor.homeassistant.module] Update pulse/client.config: /data/tmp/homeassistant_pulse
2024-08-17 08:15:35.325 INFO (MainThread) [supervisor.docker.homeassistant] Starting Home Assistant ghcr.io/home-assistant/raspberrypi4-64-homeassistant with version 2024.8.2
2024-08-17 08:15:35.326 INFO (MainThread) [supervisor.homeassistant.core] Wait until Home Assistant is ready
2024-08-17 08:15:41.565 INFO (MainThread) [supervisor.hardware.monitor] Detecting remove hardware /dev/ttyACM0 - /dev/serial/by-id/usb-dresden_elektronik_ingenieurtechnik_GmbH_ConBee_II_DE2459072-if00
2024-08-17 08:15:41.577 INFO (MainThread) [supervisor.hardware.monitor] Detecting remove hardware /dev/bus/usb/001/007 - None
2024-08-17 08:15:43.875 INFO (MainThread) [supervisor.hardware.monitor] Detecting add hardware /dev/bus/usb/001/008 - None
2024-08-17 08:15:43.883 INFO (MainThread) [supervisor.hardware.monitor] Detecting add hardware /dev/ttyACM0 - /dev/serial/by-id/usb-dresden_elektronik_ingenieurtechnik_GmbH_ConBee_II_DE2459072-if00
2024-08-17 08:15:45.354 INFO (MainThread) [supervisor.hardware.monitor] Detecting remove hardware /dev/ttyACM0 - /dev/serial/by-id/usb-dresden_elektronik_ingenieurtechnik_GmbH_ConBee_II_DE2459072-if00
2024-08-17 08:15:45.361 INFO (MainThread) [supervisor.hardware.monitor] Detecting remove hardware /dev/bus/usb/001/008 - None
2024-08-17 08:15:47.703 INFO (MainThread) [supervisor.hardware.monitor] Detecting add hardware /dev/bus/usb/001/009 - None
2024-08-17 08:15:47.709 INFO (MainThread) [supervisor.hardware.monitor] Detecting add hardware /dev/ttyACM0 - /dev/serial/by-id/usb-dresden_elektronik_ingenieurtechnik_GmbH_ConBee_II_DE2459072-if00
2024-08-17 08:15:51.302 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state running
2024-08-17 08:15:52.129 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-08-17 08:15:52.329 WARNING (MainThread) [supervisor.addons.options] Option 'secrets' does not exist in the schema for AppDaemon (a0d7b954_appdaemon)
2024-08-17 08:15:55.529 INFO (MainThread) [supervisor.homeassistant.core] Home Assistant Core state changed to APIState(core_state='NOT_RUNNING', offline_db_migration=False)
2024-08-17 08:16:02.448 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/esphome/home-assistant-addon repository
2024-08-17 08:16:02.545 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/hassio-addons/repository repository
2024-08-17 08:16:02.573 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/home-assistant/addons repository
2024-08-17 08:16:02.594 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/music-assistant/home-assistant-addon repository
2024-08-17 08:16:02.729 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/aegjoyce/ha-addons repository
2024-08-17 08:16:02.769 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/blakeblackshear/frigate-hass-addons repository
2024-08-17 08:16:02.814 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/FunkeyFlo/ps5-mqtt repository
2024-08-17 08:16:02.863 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/wez/govee2mqtt repository
2024-08-17 08:16:02.894 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/home-assistant/addons-development repository
2024-08-17 08:16:02.917 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/AlexxIT/hassio-addons repository
2024-08-17 08:16:02.934 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/sabeechen/hassio-google-drive-backup repository
2024-08-17 08:16:02.945 INFO (MainThread) [supervisor.store.git] Update add-on https://github.com/koush/scrypted repository
2024-08-17 08:16:03.920 INFO (MainThread) [supervisor.updater] Fetching update data from https://version.home-assistant.io/stable.json
2024-08-17 08:16:07.693 WARNING (SyncWorker_0) [supervisor.store.data] Can't read /data/addons/git/09e60fb6/external/ring-client-api/packages/homebridge-ring/config.schema.json: Invalid Add-on config!. Got {'pluginAlias': 'Ring', 'pluginType': 'platform', 'singular': True, 'customUi': True, 'customUiPath': './lib/homebridge-ui', 'customUiDevServer': 'http://localhost:3000/api/plugins/settings-ui/homebridge-ring', 'headerDisplay': 'See [the wiki](https://github.com/dgreif/ring/wiki/Refresh-Tokens) for details on generating a refresh token', 'accountLinkingHeader': 'Please supply your Ring credentials.  These will be used to contact the Ring servers and generate a unique access token for your acc...
2024-08-17 08:16:07.858 WARNING (SyncWorker_1) [supervisor.addons.validate] Add-on have full device access, and selective device access in the configuration. Please report this to the maintainer of Frigate (Full Access) Beta
2024-08-17 08:16:07.868 WARNING (SyncWorker_1) [supervisor.addons.validate] Add-on have full device access, and selective device access in the configuration. Please report this to the maintainer of Frigate (Full Access)
2024-08-17 08:16:08.964 WARNING (SyncWorker_4) [supervisor.store.data] Can't read /data/addons/git/09e60fb6/external/ring-client-api/packages/homebridge-ring/config.schema.json: Invalid Add-on config!. Got {'pluginAlias': 'Ring', 'pluginType': 'platform', 'singular': True, 'customUi': True, 'customUiPath': './lib/homebridge-ui', 'customUiDevServer': 'http://localhost:3000/api/plugins/settings-ui/homebridge-ring', 'headerDisplay': 'See [the wiki](https://github.com/dgreif/ring/wiki/Refresh-Tokens) for details on generating a refresh token', 'accountLinkingHeader': 'Please supply your Ring credentials.  These will be used to contact the Ring servers and generate a unique access token for your acc...
2024-08-17 08:16:09.105 WARNING (SyncWorker_7) [supervisor.addons.validate] Add-on have full device access, and selective device access in the configuration. Please report this to the maintainer of Frigate (Full Access) Beta
2024-08-17 08:16:09.116 WARNING (SyncWorker_7) [supervisor.addons.validate] Add-on have full device access, and selective device access in the configuration. Please report this to the maintainer of Frigate (Full Access)
2024-08-17 08:16:09.281 INFO (MainThread) [supervisor.store] Loading add-ons from store: 112 all - 0 new - 0 remove
2024-08-17 08:16:09.282 INFO (MainThread) [supervisor.store] Loading add-ons from store: 112 all - 0 new - 0 remove
2024-08-17 08:16:12.482 WARNING (MainThread) [supervisor.addons.options] Option 'secrets' does not exist in the schema for AppDaemon (a0d7b954_appdaemon)
2024-08-17 08:16:44.348 INFO (MainThread) [supervisor.auth] Auth request from 'core_mosquitto' for 'seth_frigate'
2024-08-17 08:16:44.660 INFO (MainThread) [supervisor.auth] Home Assistant not running, checking cache
2024-08-17 08:19:08.439 INFO (MainThread) [supervisor.homeassistant.core] Home Assistant Core state changed to APIState(core_state='STARTING', offline_db_migration=False)
2024-08-17 08:19:11.323 INFO (MainThread) [supervisor.api.proxy] Home Assistant WebSocket API request initialize
2024-08-17 08:19:11.448 INFO (MainThread) [supervisor.api.proxy] WebSocket access from a0d7b954_appdaemon
2024-08-17 08:19:11.676 INFO (MainThread) [supervisor.api.proxy] Home Assistant WebSocket API request running
2024-08-17 08:19:13.547 INFO (MainThread) [supervisor.homeassistant.core] Home Assistant Core state changed to APIState(core_state='RUNNING', offline_db_migration=False)
2024-08-17 08:19:13.547 INFO (MainThread) [supervisor.homeassistant.core] Detect a running Home Assistant instance
2024-08-17 08:19:13.549 INFO (MainThread) [supervisor.homeassistant.core] Successfully started Home Assistant 2024.8.2
2024-08-17 08:19:13.929 INFO (SyncWorker_4) [supervisor.docker.manager] Cleanup images: ['ghcr.io/home-assistant/raspberrypi4-64-homeassistant:2024.8.1']
2024-08-17 08:21:14.525 WARNING (MainThread) [supervisor.addons.options] Option 'secrets' does not exist in the schema for AppDaemon (a0d7b954_appdaemon)
2024-08-17 08:25:38.852 INFO (MainThread) [supervisor.updater] Fetching update data from https://version.home-assistant.io/stable.json
2024-08-17 08:25:39.742 INFO (MainThread) [supervisor.resolution.check] Starting system checks with state running
2024-08-17 08:25:39.746 INFO (MainThread) [supervisor.resolution.checks.base] Run check for free_space/system
2024-08-17 08:25:39.751 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_failed/dns_server
2024-08-17 08:25:39.754 INFO (MainThread) [supervisor.resolution.checks.base] Run check for docker_config/system
2024-08-17 08:25:39.775 INFO (MainThread) [supervisor.resolution.checks.base] Run check for trust/supervisor
2024-08-17 08:25:40.992 INFO (MainThread) [supervisor.resolution.checks.base] Run check for ipv4_connection_problem/system
2024-08-17 08:25:40.995 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_ipv6_error/dns_server
2024-08-17 08:25:40.998 INFO (MainThread) [supervisor.resolution.checks.base] Run check for disabled_data_disk/system
2024-08-17 08:25:40.000 INFO (MainThread) [supervisor.resolution.checks.base] Run check for no_current_backup/system
2024-08-17 08:25:40.010 INFO (MainThread) [supervisor.resolution.checks.base] Run check for security/core
2024-08-17 08:25:40.012 INFO (MainThread) [supervisor.resolution.checks.base] Run check for multiple_data_disks/system
2024-08-17 08:25:40.015 INFO (MainThread) [supervisor.resolution.checks.base] Run check for pwned/addon
2024-08-17 08:25:40.016 INFO (MainThread) [supervisor.resolution.check] System checks complete
2024-08-17 08:25:40.017 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state running
2024-08-17 08:25:40.664 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-08-17 08:25:40.668 INFO (MainThread) [supervisor.resolution.fixup] Starting system autofix at state running
2024-08-17 08:25:40.675 INFO (MainThread) [supervisor.resolution.fixup] System autofix complete
2024-08-17 08:26:16.967 WARNING (MainThread) [supervisor.addons.options] Option 'secrets' does not exist in the schema for AppDaemon (a0d7b954_appdaemon)

### Anything in the Host logs that might be useful for us?

```txt
[ 363.489746] Tainted: G C [ 6.6.31-haos-raspi #1 363.489765] "echo 0> /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[ 363.489973] INFO: task kworker/u10:1:88 blocked for more than 120 seconds. 
[ 363.489994] Tainted: G C 6.6.31-haos-raspi #1 
[ 363.490011] "echo > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[ 363.490265] 363.490244] INFO: task usb-storage: 93 blocked for more than 120 seconds. Tainted: G C 6.6.31-haos-raspi #1 
[ 363.490281] "echo > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[ 363.490519] INFO: task kworker/2:2:95 blocked for more than 120 seconds. Tainted: G 6.6.31-haos-raspi #1 
[ 363.490537] C 
[ 363.490553] "echo > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[ 363.490725] INFO: task kworker/u13:2:266 blocked for more than 120 seconds. 
[ 363.4907471 Tainted: G C 6.6.31-haos-raspi #1 
[ 363.4907641 "echo 0> /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[ 363.491155] INFO: task NetworkManager: 448 blocked for more than 120 seconds. 
[ 363.491175] Tainted: Gc Tainted: G C 6.6.31-haos-raspi #1 
[ 363.491192] " echo 0> /proc/sys/kernel/hung_task_timeout_secs" disables this message. 
[ 363.4914001 INFO: task rpcbind: 457 blocked for more than 120 seconds. 
[363.491419 ] 6.6.31-haos-raspi #1 [363.4916681 INFO: task wpa_supplicant: 460 blocked for more than 120 seconds. proc/sys/kernel/hung_task_timeout_secs" disables this message.

System information

System Information

version core-2024.8.2
installation_type Home Assistant OS
dev false
hassio true
docker true
user root
virtualenv false
python_version 3.12.4
os_name Linux
os_version 6.6.31-haos-raspi
arch aarch64
timezone America/Chicago
config_dir /config
Home Assistant Community Store GitHub API | ok -- | -- GitHub Content | ok GitHub Web | ok GitHub API Calls Remaining | 4815 Installed Version | 1.34.0 Stage | running Available Repositories | 1464 Downloaded Repositories | 26
Home Assistant Cloud logged_in | true -- | -- subscription_expiration | February 28, 2025 at 6:00 PM relayer_connected | true relayer_region | us-east-1 remote_enabled | true remote_connected | true alexa_enabled | false google_enabled | true remote_server | us-east-1-3.ui.nabu.casa certificate_status | ready instance_id | 9389f3669f4d430a8fe3b119c95fe559 can_reach_cert_server | ok can_reach_cloud_auth | ok can_reach_cloud | ok
Home Assistant Supervisor host_os | Home Assistant OS 12.4 -- | -- update_channel | stable supervisor_version | supervisor-2024.08.0 agent_version | 1.6.0 docker_version | 26.1.4 disk_total | 219.4 GB disk_used | 17.9 GB healthy | true supported | true host_connectivity | true supervisor_connectivity | true ntp_synchronized | true virtualization | board | rpi4-64 supervisor_api | ok version_api | ok installed_addons | Terminal & SSH (9.14.0), File editor (5.8.0), Vaultwarden (Bitwarden) (0.22.0), Git pull (7.14.1), Piper (1.5.2), Whisper (2.1.2), Custom deps deployment (1.3.4), AppDaemon (0.16.6), ESPHome (2024.7.3), Frigate Proxy (1.5), PS5 MQTT (1.4.0), Govee to MQTT Bridge (2024.07.13-82ddc6e9), Glances (0.21.1), Advanced SSH & Web Terminal (18.0.0), go2rtc (1.9.4), openWakeWord (1.10.0), Home Assistant Google Drive Backup (0.112.1), Mosquitto broker (6.4.1)
Dashboards dashboards | 4 -- | -- resources | 18 views | 8 mode | storage
Recorder oldest_recorder_run | August 13, 2024 at 9:27 AM -- | -- current_recorder_run | August 17, 2024 at 8:15 AM estimated_db_size | 116.53 MiB database_engine | sqlite database_version | 3.45.3
Spotify api_endpoint_reachable | ok -- | --

Additional information

No response

Cikkajes commented 3 weeks ago

Had the same issue, especially after updating the Core too to 2024.8.2. HA was freezing and rebooting constantly and I saw this in the logs:

Fatal Python error: Illegal instruction

Now reverted back to 2024.8.2 and it seems a little more stable but still not 100% online and quite frustrating.

sairon commented 3 weeks ago

This is same as #3534, let's follow up there.