search

home-assistant / core

:house_with_garden: Open source home automation that puts local control and privacy first.
https://www.home-assistant.io
Apache License 2.0
71.14k stars 29.81k forks source link

Core Update 2024.2.1 => 2024.2.2 stuck #110787

Closed hb9eue closed 5 months ago

hb9eue commented 6 months ago

The problem

Upgrading to 2024.2.2 is getting stuck on KVM image. I can't find anything in the logs hinting to the cause of the issue. I rebooted and tired from cli ha > core update which also states 'Processing...' and does proceed.

What version of Home Assistant Core has the issue?

core-2024.2.2

What was the last working version of Home Assistant Core?

core-2024.2.1

What type of installation are you running?

Home Assistant OS

Integration causing the issue

Unknown. Last new integration I added is WLED

Link to integration documentation on our website

No response

Diagnostics information

No response

Example YAML snippet

No response

Anything in the logs that might be useful for us?

No response

Additional information

No response

mib1185 commented 6 months ago

please provide some logs (here the supervisor logs might be helpful) or screenshots or something we could analyse.

hb9eue commented 6 months ago

I just deleted the WLED integration, did a reboot and tried again, issue persists...

Supervisor Log:

24-02-17 11:47:45 INFO (MainThread) [supervisor.mounts.mount] Mount PlutoBackup still activating, waiting up to 30 seconds to complete
24-02-17 11:47:55 INFO (MainThread) [supervisor.docker.monitor] Started docker events monitor
24-02-17 11:47:55 INFO (MainThread) [supervisor.updater] Fetching update data from https://version.home-assistant.io/stable.json
24-02-17 11:47:56 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/amd64-hassio-cli with version 2023.11.0
24-02-17 11:47:57 INFO (MainThread) [supervisor.plugins.cli] Starting CLI plugin
24-02-17 11:47:57 INFO (SyncWorker_0) [supervisor.docker.manager] Cleaning hassio_cli application
24-02-17 11:48:03 INFO (MainThread) [supervisor.docker.cli] Starting CLI ghcr.io/home-assistant/amd64-hassio-cli with version 2023.11.0 - 172.30.32.5
24-02-17 11:48:03 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/amd64-hassio-dns with version 2023.06.2
24-02-17 11:48:04 INFO (MainThread) [supervisor.plugins.dns] Starting CoreDNS plugin
24-02-17 11:48:04 INFO (SyncWorker_0) [supervisor.docker.manager] Cleaning hassio_dns application
24-02-17 11:48:12 INFO (MainThread) [supervisor.docker.dns] Starting DNS ghcr.io/home-assistant/amd64-hassio-dns with version 2023.06.2 - 172.30.32.3
24-02-17 11:48:12 INFO (MainThread) [supervisor.plugins.dns] Updated /etc/resolv.conf
24-02-17 11:48:13 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/amd64-hassio-audio with version 2023.12.0
24-02-17 11:48:14 INFO (MainThread) [supervisor.plugins.audio] Starting Audio plugin
24-02-17 11:48:14 INFO (SyncWorker_0) [supervisor.docker.manager] Cleaning hassio_audio application
24-02-17 11:48:16 INFO (MainThread) [supervisor.docker.audio] Starting Audio ghcr.io/home-assistant/amd64-hassio-audio with version 2023.12.0 - 172.30.32.4
24-02-17 11:48:16 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/amd64-hassio-observer with version 2023.06.0
24-02-17 11:48:16 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/amd64-hassio-multicast with version 2023.06.2
24-02-17 11:48:16 INFO (MainThread) [supervisor.plugins.multicast] Starting Multicast plugin
24-02-17 11:48:16 INFO (SyncWorker_1) [supervisor.docker.manager] Cleaning hassio_multicast application
24-02-17 11:48:17 INFO (MainThread) [supervisor.docker.multicast] Starting Multicast ghcr.io/home-assistant/amd64-hassio-multicast with version 2023.06.2 - Host
24-02-17 11:48:17 INFO (MainThread) [supervisor.homeassistant.secrets] Loaded 1 Home Assistant secrets
24-02-17 11:48:17 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/qemux86-64-homeassistant with version 2024.2.1
24-02-17 11:48:17 WARNING (MainThread) [supervisor.homeassistant.core] Watchdog found Home Assistant failed, restarting...
24-02-17 11:48:17 INFO (MainThread) [supervisor.os.manager] Detect Home Assistant Operating System 11.5 / BootSlot A
24-02-17 11:48:17 INFO (SyncWorker_1) [supervisor.docker.manager] Starting homeassistant
24-02-17 11:48:18 INFO (MainThread) [supervisor.homeassistant.core] Wait until Home Assistant is ready
24-02-17 11:48:18 INFO (MainThread) [supervisor.store.git] Loading add-on /data/addons/git/a0d7b954 repository
24-02-17 11:48:18 INFO (MainThread) [supervisor.store.git] Loading add-on /data/addons/core repository
24-02-17 11:48:18 INFO (MainThread) [supervisor.store.git] Loading add-on /data/addons/git/5c53de3b repository
24-02-17 11:48:19 INFO (MainThread) [supervisor.store] Loading add-ons from store: 77 all - 77 new - 0 remove
24-02-17 11:48:19 INFO (MainThread) [supervisor.addons.manager] Found 6 installed add-ons
24-02-17 11:48:19 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/hassio-addons/ssh/amd64 with version 17.1.0
24-02-17 11:48:19 INFO (MainThread) [supervisor.docker.interface] Attaching to homeassistant/amd64-addon-piper with version 1.4.0
24-02-17 11:48:19 INFO (MainThread) [supervisor.docker.interface] Attaching to homeassistant/amd64-addon-letsencrypt with version 5.0.15
24-02-17 11:48:19 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/hassio-addons/vscode/amd64 with version 5.15.0
24-02-17 11:48:19 INFO (MainThread) [supervisor.docker.interface] Attaching to homeassistant/amd64-addon-openwakeword with version 1.8.2
24-02-17 11:48:19 INFO (MainThread) [supervisor.docker.interface] Attaching to homeassistant/amd64-addon-whisper with version 1.0.2
24-02-17 11:48:19 INFO (MainThread) [supervisor.backups.manager] Found 89 backup files
24-02-17 11:48:19 INFO (MainThread) [supervisor.discovery] Loaded 3 messages
24-02-17 11:48:19 INFO (MainThread) [supervisor.ingress] Loaded 0 ingress sessions
24-02-17 11:48:19 INFO (MainThread) [supervisor.resolution.check] Starting system checks with state setup
24-02-17 11:48:19 INFO (MainThread) [supervisor.resolution.check] System checks complete
24-02-17 11:48:19 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state setup
24-02-17 11:48:19 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
24-02-17 11:48:19 INFO (MainThread) [supervisor.jobs] 'ResolutionFixup.run_autofix' blocked from execution, system is not running - setup
24-02-17 11:48:19 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state setup
24-02-17 11:48:19 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
24-02-17 11:48:19 INFO (MainThread) [__main__] Running Supervisor
24-02-17 11:48:19 INFO (MainThread) [supervisor.os.manager] Rauc: A - marked slot kernel.0 as good
24-02-17 11:48:19 INFO (MainThread) [supervisor.addons.manager] Phase 'initialize' starting 0 add-ons
24-02-17 11:48:19 INFO (MainThread) [supervisor.addons.manager] Phase 'system' starting 0 add-ons
24-02-17 11:48:19 INFO (MainThread) [supervisor.addons.manager] Phase 'services' starting 2 add-ons
24-02-17 11:48:19 INFO (SyncWorker_1) [supervisor.docker.manager] Cleaning addon_a0d7b954_vscode application
24-02-17 11:48:20 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on ghcr.io/hassio-addons/vscode/amd64 with version 5.15.0
24-02-17 11:48:20 INFO (SyncWorker_5) [supervisor.docker.manager] Cleaning addon_a0d7b954_ssh application
24-02-17 11:48:21 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on ghcr.io/hassio-addons/ssh/amd64 with version 17.1.0
24-02-17 11:48:29 INFO (MainThread) [supervisor.homeassistant.api] Updated Home Assistant API token
24-02-17 11:48:30 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state startup
24-02-17 11:48:30 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
24-02-17 11:48:30 INFO (MainThread) [supervisor.homeassistant.core] Home Assistant Core state changed to NOT_RUNNING
24-02-17 11:48:51 INFO (MainThread) [supervisor.core] Skipping start of Home Assistant
24-02-17 11:48:51 INFO (MainThread) [supervisor.addons.manager] Phase 'application' starting 3 add-ons
24-02-17 11:48:52 INFO (SyncWorker_4) [supervisor.docker.manager] Cleaning addon_core_whisper application
24-02-17 11:48:56 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on homeassistant/amd64-addon-whisper with version 1.0.2
24-02-17 11:48:56 INFO (SyncWorker_5) [supervisor.docker.manager] Cleaning addon_core_piper application
24-02-17 11:48:57 INFO (MainThread) [supervisor.homeassistant.core] Home Assistant Core state changed to RUNNING
24-02-17 11:48:57 INFO (MainThread) [supervisor.homeassistant.core] Detect a running Home Assistant instance
24-02-17 11:48:57 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on homeassistant/amd64-addon-piper with version 1.4.0
24-02-17 11:48:57 INFO (SyncWorker_5) [supervisor.docker.manager] Cleaning addon_core_openwakeword application
24-02-17 11:48:59 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on homeassistant/amd64-addon-openwakeword with version 1.8.2
24-02-17 11:49:17 INFO (MainThread) [supervisor.homeassistant.core] Updating Home Assistant to version 2024.2.2
24-02-17 11:49:17 INFO (MainThread) [supervisor.docker.interface] Updating image ghcr.io/home-assistant/qemux86-64-homeassistant:2024.2.1 to ghcr.io/home-assistant/qemux86-64-homeassistant:2024.2.2
24-02-17 11:49:17 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/qemux86-64-homeassistant with tag 2024.2.2.
24-02-17 11:49:31 INFO (MainThread) [supervisor.misc.tasks] All core tasks are scheduled
24-02-17 11:49:31 INFO (MainThread) [supervisor.core] Supervisor is up and running
24-02-17 11:49:31 INFO (MainThread) [supervisor.host.info] Updating local host information
24-02-17 11:49:31 INFO (MainThread) [supervisor.updater] Fetching update data from https://version.home-assistant.io/stable.json
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.check] Starting system checks with state running
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_ipv6_error/dns_server
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.checks.base] Run check for security/core
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.checks.base] Run check for docker_config/system
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.checks.base] Run check for free_space/system
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_failed/dns_server
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.checks.base] Run check for multiple_data_disks/system
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.checks.base] Run check for trust/supervisor
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.checks.base] Run check for pwned/addon
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.checks.base] Run check for no_current_backup/system
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.module] Create new suggestion create_full_backup - system / None
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.module] Create new issue no_current_backup - system / None
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.checks.base] Run check for ipv4_connection_problem/system
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.check] System checks complete
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state running
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.fixup] Starting system autofix at state running
24-02-17 11:49:31 INFO (MainThread) [supervisor.resolution.fixup] System autofix complete
24-02-17 11:49:32 INFO (MainThread) [supervisor.host.services] Updating service information
24-02-17 11:49:32 INFO (MainThread) [supervisor.host.network] Updating local network information
24-02-17 11:49:32 INFO (MainThread) [supervisor.host.sound] Updating PulseAudio information
24-02-17 11:49:32 INFO (MainThread) [supervisor.host.manager] Host information reload completed
mib1185 commented 6 months ago

the update starts, but the log ends before we can see any result or error

24-02-17 11:49:17 INFO (MainThread) [supervisor.homeassistant.core] Updating Home Assistant to version 2024.2.2
24-02-17 11:49:17 INFO (MainThread) [supervisor.docker.interface] Updating image ghcr.io/home-assistant/qemux86-64-homeassistant:2024.2.1 to ghcr.io/home-assistant/qemux86-64-homeassistant:2024.2.2
24-02-17 11:49:17 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/qemux86-64-homeassistant with tag 2024.2.2.
hb9eue commented 6 months ago

That's the issue ;-) I'm used to an update being done in a 2 to 3 minutes. Now 12:08 still 'processing' no new entries in the log.

mib1185 commented 6 months ago

ah ok ... this was not such clear right now. Please reboot your HA OS at all, try du update again, wait 5min ... than download and provide the complete logs of supervisor, host and ha core

Note: it is better to drag the log into the comment (which will add it as an attachment) and not copy paste as it is hard to read logs in GitHub.

thx 👍

hb9eue commented 6 months ago

As of 12:50... still processing. New log entries since 11:49:

24-02-17 11:49:32 INFO (MainThread) [supervisor.host.manager] Host information reload completed
24-02-17 12:48:19 INFO (MainThread) [supervisor.resolution.check] Starting system checks with state running
24-02-17 12:48:19 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_ipv6_error/dns_server
24-02-17 12:48:19 INFO (MainThread) [supervisor.resolution.checks.base] Run check for security/core
24-02-17 12:48:19 INFO (MainThread) [supervisor.resolution.checks.base] Run check for docker_config/system
24-02-17 12:48:19 INFO (MainThread) [supervisor.resolution.checks.base] Run check for free_space/system
24-02-17 12:48:19 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_failed/dns_server
24-02-17 12:48:19 INFO (MainThread) [supervisor.resolution.checks.base] Run check for multiple_data_disks/system
24-02-17 12:48:19 INFO (MainThread) [supervisor.resolution.checks.base] Run check for trust/supervisor
24-02-17 12:48:19 INFO (MainThread) [supervisor.resolution.checks.base] Run check for pwned/addon
24-02-17 12:48:19 INFO (MainThread) [supervisor.resolution.checks.base] Run check for ipv4_connection_problem/system
24-02-17 12:48:19 INFO (MainThread) [supervisor.resolution.check] System checks complete
24-02-17 12:48:19 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state running
24-02-17 12:48:20 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
24-02-17 12:48:20 INFO (MainThread) [supervisor.resolution.fixup] Starting system autofix at state running
24-02-17 12:48:20 INFO (MainThread) [supervisor.resolution.fixup] System autofix complete
24-02-17 12:48:20 INFO (MainThread) [supervisor.homeassistant.api] Updated Home Assistant API token

Rebooting and trying again (4th time now)... will attach requested logs.

hb9eue commented 6 months ago

As I was typing, got Processing... Done. on the CLI with:

Post "http://supervisor/core/update": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

I try sniffing the connection. Maybe an issue downloading the immage?

hb9eue commented 6 months ago

https://github.com/orgs/home-assistant/packages/container/package/qemux86-64-homeassistant

=> This page is taking too long to respond - contact github. I think there might be an issue on github?

mib1185 commented 6 months ago

i don't think so - it has already 42k downloads of the 2024.2.2 package within last 18h. do you have any advanced network setup on your environment?

what exactly do you mean be "This page is taking too long to respond" ? did you already fetched the logs?

hb9eue commented 6 months ago

Chrome did show me an angry unicorn and this message coming from github, but I can not reproduce anymore. Page logs fine now and I can also flawlessly download: https://github.com/home-assistant/operating-system/releases/download/11.5/haos_ova-11.5.qcow2.xz so I guess there is no network issue.

I'll reboot once more, but where can I find useful logfiles except the supervisor log?

hb9eue commented 6 months ago

image After reboot

mib1185 commented 6 months ago

but where can I find useful logfiles except the supervisor log?

Settings -> System -> Logs -> "on top right select the scope of the log than use the download buttons"

image

hb9eue commented 6 months ago

dns_2024-02-17T12-17-15.520Z.log host_2024-02-17T12-16-40.049Z.log supervisor_2024-02-17T12-16-19.713Z.log home-assistant_2024-02-17T12-15-53.770Z.log

Looking into the issues found in the dns logfile.

hb9eue commented 6 months ago

image Actual resolv.conf on that the haos kvm machine.

Checking the first DNS Server from another machine in my network:

$ dig +short ANX core-whisper.local.hass.io @157.161.57.1
172.30.32.1

No issue there...

hb9eue commented 6 months ago

Oh wait, this is a private, non routable ip address... weird!

Btw, thank you for taking the time to look into that issue.

mib1185 commented 6 months ago

indeed there is nothing helpful in the logs :( one last idea - run curl -v https://github.com/home-assistant/core/pkgs/container/qemux86-64-homeassistant from a terminal within your HA vm (eq. the terminal addon)

Oh wait, this is a private, non routable ip address... weird!

this is the docker internal network on your HAOS vm

mib1185 commented 6 months ago

image Actual resolv.conf on that the haos kvm machine.

mhhh ... public dns servers and an IPv6, too 🤔 this brings me back to my question "do you have any advanced network setup on your environment?" 😁

hb9eue commented 6 months ago

curl -v https://github.com/home-assistant/core/pkgs/container/qemux86-64-homeassistant 2>&1 | less

To capture the start and end of it.

image

image

I don't see an issue...

hb9eue commented 6 months ago

Well what do you mean by 'advanced network'. :-)

Yes, I might have a more complex home network than others but nothing which caused issues with home assistant in the past. This is the first update which is getting stuck like this.

I have a public routed /27 legacy IP and /48 IPv6 range where I run my DNS, Webserver and some other stuff that is reachable from the internet.

I have a /24 internal NATed Network for my home stuff that does not need to be reachable from the internet.

HA has a public IPv6 and an internal IPv4 address (dhcpv4 and RA (v6) assigned). I do not NAT an external IPv4 address to the internal IPv4 Address of homeassistant. But HA can communicate to the IPv4 internet via NAT of course.

From the Internet, HA is only reachable via IPv6 (who needs legacy IP nowadays... :-) )

HA only needs to be reachable from my LAN and if I need to use the mobile app, there is a VPN to my LAN.

bart40140 commented 6 months ago

hello, sorry for my english

I have the same problem, update running in vain

I tried to create a new HA, it blocks on: [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/aarch64-hassio-supervisor with tag 2024.01.1.

No internet settings for a long time, and i have a classique network

joostlek commented 6 months ago

@bart40140 that's a supervisor issue, please report at the supervisor repository

bart40140 commented 6 months ago

supervisor_2024-02-17T13-19-05.809Z.log

the problem is the same for update a HA addon

Blocking after "Downloading docker image"

Same for the creation of a new Ha

joostlek commented 6 months ago

Please report your issue at the supervisor repository since it's different from this issue.

bart40140 commented 6 months ago

Please report your issue at the supervisor repository since it's different from this issue.

the problem is 100% identical to hb9eue, the 2024.2.2 update does not do this,

I just noticed that the problem is also elsewhere, to see if hb9eue has the same error

joostlek commented 6 months ago

2024.2.2 didn't have any change in the code that has anything to do with this.

Downloading add-ons is a task for the supervisor, not the HA core.

ChrisR2023 commented 6 months ago

Stuck here too. Won't update from 2024.2.1 to 2024.2.2

bart40140 commented 6 months ago

work fine after 4h ..... same on all my systems rpi, nuc, VM ....

hb9eue commented 6 months ago

Same here, about the 6th attempt managed to successfully upgrade, but it took very long.

mcolyer commented 6 months ago

So here's what I'm seeing after running ha core update

24-02-22 07:05:18 INFO (MainThread) [supervisor.homeassistant.core] Updating Home Assistant to version 2024.2.2
24-02-22 07:05:18 INFO (MainThread) [supervisor.docker.interface] Updating image ghcr.io/home-assistant/generic-x86-64-homeassistant:2024.1.2 to ghcr.io/home-assistant/generic-x86-64-homeassistant:2024.2.2
24-02-22 07:05:18 INFO (MainThread) [supervisor.docker.interface] Downloading docker image ghcr.io/home-assistant/generic-x86-64-homeassistant with tag 2024.2.2.
24-02-22 07:06:50 ERROR (MainThread) [supervisor.docker.interface] Can't install ghcr.io/home-assistant/generic-x86-64-homeassistant:2024.2.2: 404 Client Error for http+docker://localhost/v1.43/images/ghcr.io/home-assistant/generic-x86-64-homeassistant:2024.2.2/json: Not Found ("No such image: ghcr.io/home-assistant/generic-x86-64-homeassistant:2024.2.2")
24-02-22 07:06:50 WARNING (MainThread) [supervisor.homeassistant.core] Updating Home Assistant image failed
reini-1 commented 6 months ago

I had/have also problems with updating to 2024.2.4 and 2024.2.5 on a raspberry pi 3b. As a workaround I logged in to homeassistant os (ssh port 22222), manually pulled the docker image. This also stucks at

# docker pull ghcr.io/home-assistant/raspberrypi3-64-homeassistant:2024.2.5
2024.2.5: Pulling from home-assistant/raspberrypi3-64-homeassistant
c30352492317: Already exists
7018ca539421: Already exists
dd15f9420f55: Already exists
c37c044d049a: Already exists
956fba511843: Already exists
1cf3770580c8: Already exists
1314dd749f29: Already exists
4cc8b329a372: Already exists
bedcb08b0c36: Already exists
310fa68be621: Already exists
7ff0948035fd: Already exists
4f4fb700ef54: Already exists
1b8ea4f386bc: Already exists
7c768711c249: Already exists
1f9545c44fbc: Already exists
42f0b8102b58: Already exists
0c3613e56a23: Already exists
9430ddbe5abe: Already exists
1a420b1ff1cf: Already exists
03361230f823: Already exists
45092c9d0306: Pull complete
87f9ac0e84c0: Pull complete
1610cbf28913: Pull complete
c71d10b89403: Pull complete
26df0cd1e851: Extracting [==========>                                        ]  85.79MB/411.4MB
4800d43d567a: Download complete
e08c65f95557: Download complete
475f8623ceed: Download complete
ec2572a86401: Download complete
6c498cf4f996: Download complete
client_loop: send disconnect: Connection reset

So I retried pulling a second time. I think because there where already some parts downloaded in the first run, the second one was successful:

# docker pull ghcr.io/home-assistant/raspberrypi3-64-homeassistant:2024.2.5
2024.2.5: Pulling from home-assistant/raspberrypi3-64-homeassistant
c30352492317: Already exists
7018ca539421: Already exists
dd15f9420f55: Already exists
c37c044d049a: Already exists
956fba511843: Already exists
1cf3770580c8: Already exists
1314dd749f29: Already exists
4cc8b329a372: Already exists
bedcb08b0c36: Already exists
310fa68be621: Already exists
7ff0948035fd: Already exists
4f4fb700ef54: Already exists
1b8ea4f386bc: Already exists
7c768711c249: Already exists
1f9545c44fbc: Already exists
42f0b8102b58: Already exists
0c3613e56a23: Already exists
9430ddbe5abe: Already exists
1a420b1ff1cf: Already exists
03361230f823: Already exists
45092c9d0306: Already exists
87f9ac0e84c0: Already exists
1610cbf28913: Already exists
c71d10b89403: Already exists
26df0cd1e851: Pull complete
4800d43d567a: Pull complete
e08c65f95557: Pull complete
475f8623ceed: Pull complete
ec2572a86401: Pull complete
6c498cf4f996: Pull complete
Digest: sha256:f10723cc307bed7d9fe2fc0e7095dd2923be4c560247b5c9d02bf1b0fdd5fc1f
Status: Downloaded newer image for ghcr.io/home-assistant/raspberrypi3-64-homeassistant:2024.2.5
ghcr.io/home-assistant/raspberrypi3-64-homeassistant:2024.2.5

I think the problem is the big part 26df0cd1e851 with 411.4MB and extracting on the pi needs a long time.

After this I did the update from the command line:

ha core update --log-level debug
time="2024-02-29T18:06:05+01:00" level=debug msg="Adding homedir to searchpath" homedir=/root
time="2024-02-29T18:06:05+01:00" level=info msg="No configfile found"
time="2024-02-29T18:06:05+01:00" level=debug msg="Debug flags" apiToken=77fe05c3c24417eb0b81ea13ea1e648a692e061cd38d1583d61beabb429fb5b2ea61eec9464dd9a40c866129a5dbad58d863fe5b25e57461 cfgFile= endpoint=supervisor logLevel=debug noProgress=false rawJSON=false
time="2024-02-29T18:06:05+01:00" level=debug msg="core update" args="[]"
time="2024-02-29T18:06:05+01:00" level=debug msg="[GenerateURI]" base=supervisor command=update section=core
time="2024-02-29T18:06:05+01:00" level=debug msg="[GenerateURI] Result" uri="http://supervisor/core/update" url="http://supervisor/core/update" url(string)="http://supervisor/core/update"
time="2024-02-29T18:11:35+01:00" level=debug msg=Response body="{\"result\":\"ok\",\"data\":{}}" fields.time=5m29.838193975s headers="map[Content-Length:[25] Content-Type:[application/json; charset=utf-8] Date:[Thu, 29 Feb 2024 17:11:35 GMT] Server:[Python/3.12 aiohttp/3.9.3]]" received-at="2024-02-29 18:11:35.478926338 +0100 CET m=+330.175528585" request="&{POST http://supervisor/core/update HTTP/1.1 1 1 map[Accept:[application/json] Authorization:[Bearer ***] User-Agent:[go-resty/2.9.1 (https://github.com/go-resty/resty)]] <nil> 0x2a9710 0 [] false supervisor map[] map[] <nil> map[]   <nil> <nil> <nil> 0x40000c6040}" status="200 OK" statuscode=200
Command completed successfully.

# ha core info
arch: aarch64
audio_input: null
audio_output: null
backups_exclude_database: false
boot: true
image: ghcr.io/home-assistant/raspberrypi3-64-homeassistant
ip_address: 172.30.32.1
machine: raspberrypi3-64
port: 8123
ssl: false
update_available: false
version: 2024.2.5
version_latest: 2024.2.5
watchdog: true

# docker images
REPOSITORY                                             TAG         IMAGE ID       CREATED        SIZE
ghcr.io/home-assistant/raspberrypi3-64-homeassistant   2024.2.5    6aabff04b0ff   35 hours ago   1.93GB
ghcr.io/home-assistant/aarch64-hassio-supervisor       2024.02.1   0334ae6c2f9b   2 days ago     325MB
ghcr.io/home-assistant/aarch64-hassio-supervisor       latest      0334ae6c2f9b   2 days ago     325MB
homeassistant/aarch64-addon-ssh                        9.9.0       96438d7b0cc8   2 weeks ago    132MB
zigbee2mqtt/zigbee2mqtt-aarch64                        1.35.3-1    122eda6d3598   3 weeks ago    152MB
8f49de54/aarch64-addon-victoria_metrics                1.8.21      411b186d1705   6 weeks ago    92.2MB
ghcr.io/home-assistant/aarch64-base                    latest      5e04d3ab37dd   8 weeks ago    51.7MB
ghcr.io/home-assistant/aarch64-hassio-audio            2023.12.0   06eec6839c57   2 months ago   87.5MB
ghcr.io/home-assistant/aarch64-hassio-cli              2023.11.0   7f39130b9251   3 months ago   129MB
ghcr.io/home-assistant/aarch64-hassio-dns              2023.06.2   9dd40b04adb7   8 months ago   140MB
ghcr.io/home-assistant/aarch64-hassio-multicast        2023.06.2   b06077afe00c   8 months ago   125MB
ghcr.io/home-assistant/aarch64-hassio-observer         2023.06.0   1b4771b44876   8 months ago   7.49MB

This worked for me.

Maybe change the Docker file to have smaller parts that can be better processed with low cpu speed/memory?

BoHome88 commented 6 months ago

I had/have also problems with updating to 2024.2.4 and 2024.2.5 on a raspberry pi 3b. As a workaround I logged in to homeassistant os (ssh port 22222), manually pulled the docker image. This also stucks at

# docker pull ghcr.io/home-assistant/raspberrypi3-64-homeassistant:2024.2.5
2024.2.5: Pulling from home-assistant/raspberrypi3-64-homeassistant
c30352492317: Already exists
7018ca539421: Already exists
dd15f9420f55: Already exists
c37c044d049a: Already exists
956fba511843: Already exists
1cf3770580c8: Already exists
1314dd749f29: Already exists
4cc8b329a372: Already exists
bedcb08b0c36: Already exists
310fa68be621: Already exists
7ff0948035fd: Already exists
4f4fb700ef54: Already exists
1b8ea4f386bc: Already exists
7c768711c249: Already exists
1f9545c44fbc: Already exists
42f0b8102b58: Already exists
0c3613e56a23: Already exists
9430ddbe5abe: Already exists
1a420b1ff1cf: Already exists
03361230f823: Already exists
45092c9d0306: Pull complete
87f9ac0e84c0: Pull complete
1610cbf28913: Pull complete
c71d10b89403: Pull complete
26df0cd1e851: Extracting [==========>                                        ]  85.79MB/411.4MB
4800d43d567a: Download complete
e08c65f95557: Download complete
475f8623ceed: Download complete
ec2572a86401: Download complete
6c498cf4f996: Download complete
client_loop: send disconnect: Connection reset

So I retried pulling a second time. I think because there where already some parts downloaded in the first run, the second one was successful:

# docker pull ghcr.io/home-assistant/raspberrypi3-64-homeassistant:2024.2.5
2024.2.5: Pulling from home-assistant/raspberrypi3-64-homeassistant
c30352492317: Already exists
7018ca539421: Already exists
dd15f9420f55: Already exists
c37c044d049a: Already exists
956fba511843: Already exists
1cf3770580c8: Already exists
1314dd749f29: Already exists
4cc8b329a372: Already exists
bedcb08b0c36: Already exists
310fa68be621: Already exists
7ff0948035fd: Already exists
4f4fb700ef54: Already exists
1b8ea4f386bc: Already exists
7c768711c249: Already exists
1f9545c44fbc: Already exists
42f0b8102b58: Already exists
0c3613e56a23: Already exists
9430ddbe5abe: Already exists
1a420b1ff1cf: Already exists
03361230f823: Already exists
45092c9d0306: Already exists
87f9ac0e84c0: Already exists
1610cbf28913: Already exists
c71d10b89403: Already exists
26df0cd1e851: Pull complete
4800d43d567a: Pull complete
e08c65f95557: Pull complete
475f8623ceed: Pull complete
ec2572a86401: Pull complete
6c498cf4f996: Pull complete
Digest: sha256:f10723cc307bed7d9fe2fc0e7095dd2923be4c560247b5c9d02bf1b0fdd5fc1f
Status: Downloaded newer image for ghcr.io/home-assistant/raspberrypi3-64-homeassistant:2024.2.5
ghcr.io/home-assistant/raspberrypi3-64-homeassistant:2024.2.5

I think the problem is the big part 26df0cd1e851 with 411.4MB and extracting on the pi needs a long time.

After this I did the update from the command line:

ha core update --log-level debug
time="2024-02-29T18:06:05+01:00" level=debug msg="Adding homedir to searchpath" homedir=/root
time="2024-02-29T18:06:05+01:00" level=info msg="No configfile found"
time="2024-02-29T18:06:05+01:00" level=debug msg="Debug flags" apiToken=77fe05c3c24417eb0b81ea13ea1e648a692e061cd38d1583d61beabb429fb5b2ea61eec9464dd9a40c866129a5dbad58d863fe5b25e57461 cfgFile= endpoint=supervisor logLevel=debug noProgress=false rawJSON=false
time="2024-02-29T18:06:05+01:00" level=debug msg="core update" args="[]"
time="2024-02-29T18:06:05+01:00" level=debug msg="[GenerateURI]" base=supervisor command=update section=core
time="2024-02-29T18:06:05+01:00" level=debug msg="[GenerateURI] Result" uri="http://supervisor/core/update" url="http://supervisor/core/update" url(string)="http://supervisor/core/update"
time="2024-02-29T18:11:35+01:00" level=debug msg=Response body="{\"result\":\"ok\",\"data\":{}}" fields.time=5m29.838193975s headers="map[Content-Length:[25] Content-Type:[application/json; charset=utf-8] Date:[Thu, 29 Feb 2024 17:11:35 GMT] Server:[Python/3.12 aiohttp/3.9.3]]" received-at="2024-02-29 18:11:35.478926338 +0100 CET m=+330.175528585" request="&{POST http://supervisor/core/update HTTP/1.1 1 1 map[Accept:[application/json] Authorization:[Bearer ***] User-Agent:[go-resty/2.9.1 (https://github.com/go-resty/resty)]] <nil> 0x2a9710 0 [] false supervisor map[] map[] <nil> map[]   <nil> <nil> <nil> 0x40000c6040}" status="200 OK" statuscode=200
Command completed successfully.

# ha core info
arch: aarch64
audio_input: null
audio_output: null
backups_exclude_database: false
boot: true
image: ghcr.io/home-assistant/raspberrypi3-64-homeassistant
ip_address: 172.30.32.1
machine: raspberrypi3-64
port: 8123
ssl: false
update_available: false
version: 2024.2.5
version_latest: 2024.2.5
watchdog: true

# docker images
REPOSITORY                                             TAG         IMAGE ID       CREATED        SIZE
ghcr.io/home-assistant/raspberrypi3-64-homeassistant   2024.2.5    6aabff04b0ff   35 hours ago   1.93GB
ghcr.io/home-assistant/aarch64-hassio-supervisor       2024.02.1   0334ae6c2f9b   2 days ago     325MB
ghcr.io/home-assistant/aarch64-hassio-supervisor       latest      0334ae6c2f9b   2 days ago     325MB
homeassistant/aarch64-addon-ssh                        9.9.0       96438d7b0cc8   2 weeks ago    132MB
zigbee2mqtt/zigbee2mqtt-aarch64                        1.35.3-1    122eda6d3598   3 weeks ago    152MB
8f49de54/aarch64-addon-victoria_metrics                1.8.21      411b186d1705   6 weeks ago    92.2MB
ghcr.io/home-assistant/aarch64-base                    latest      5e04d3ab37dd   8 weeks ago    51.7MB
ghcr.io/home-assistant/aarch64-hassio-audio            2023.12.0   06eec6839c57   2 months ago   87.5MB
ghcr.io/home-assistant/aarch64-hassio-cli              2023.11.0   7f39130b9251   3 months ago   129MB
ghcr.io/home-assistant/aarch64-hassio-dns              2023.06.2   9dd40b04adb7   8 months ago   140MB
ghcr.io/home-assistant/aarch64-hassio-multicast        2023.06.2   b06077afe00c   8 months ago   125MB
ghcr.io/home-assistant/aarch64-hassio-observer         2023.06.0   1b4771b44876   8 months ago   7.49MB

This worked for me.

Maybe change the Docker file to have smaller parts that can be better processed with low cpu speed/memory?

I’m trying to update from 1.6 to 2.5 on a pi. It’s been nearly 3 hours. I’m still stuck with the blue circle. I wondered if it will eventually fix itself if I leave it long enough. The question is how long shall I leave it till I try to interfere with other methods?

BoHome88 commented 6 months ago

Same here, about the 6th attempt managed to successfully upgrade, but it took very long.

How long did it take to update successfully? Did you just leave it to run by itself?

reini-1 commented 6 months ago

I gave up doing this from the GUI. There I don't have any information, if it stops doing something or is still downloading/extracting/upgrading.

Last time with the GUI, a leave it for hours, but it wasn't updated at the end.

From the commandline, each docker pull needs about 5-15 minutes and also the update needs this amount of time.

Maybe sometime this is fixed with smaller docker layers and works again from the GUI ...

BoHome88 commented 6 months ago

I gave up doing this from the GUI. There I don't have any information, if it stops doing something or is still downloading/extracting/upgrading.

Last time with the GUI, a leave it for hours, but it wasn't updated at the end.

From the commandline, each docker pull needs about 5-15 minutes and also the update needs this amount of time.

Maybe sometime this is fixed with smaller docker layers and works again from the GUI ...

I’ve pulled the plug and decided to skip this update altogether. The new system might be too much for my poor old raspberry pi 😂

issue-triage-workflows[bot] commented 6 months ago

There hasn't been any activity on this issue recently. Due to the high number of incoming GitHub notifications, we have to clean some of the old issues, as many of them have already been resolved with the latest updates. Please make sure to update to the latest Home Assistant version and check if that solves the issue. Let us know if that works for you by adding a comment 👍 This issue has now been marked as stale and will be closed if no further activity occurs. Thank you for your contributions.

slamp commented 5 months ago

Issue is closed but I got the problem with 2024.3.3

When doing a sudo docker compose pull homeassistant, the pull is blocked at step '26df0cd1e851 Download complete', it's when docker should put it as Pull complete image

Hardware: Raspberry PI 4, 8Gib, SSD Samsung 860 EVO I noticed IOwait image

and the process doing the most Disk write is docker image

slamp commented 5 months ago

And finally home assistant started after 1h30 image