search

coreos / rpm-ostree

⚛📦 Hybrid image/package system with atomic upgrades and package layering
https://coreos.github.io/rpm-ostree
Other
871 stars 195 forks source link

[Fedora Silverblue] Rebase from F36 to F37 stops on error and hangs ( _g_dbus_worker_do_read_cb) #4150

Open rscm opened 1 year ago

rscm commented 1 year ago

Host system details Fedora Silverblue 36

$ uname -srvp
Linux 6.0.8-200.fc36.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Nov 11 15:03:58 UTC 2022 x86_64
$ sudo dmidecode -t system
# dmidecode 3.3
Getting SMBIOS data from sysfs.
SMBIOS 3.2.0 present.

Handle 0x0001, DMI type 1, 27 bytes
System Information
    Manufacturer: LENOVO
    Product Name: 82B1
    Version: Lenovo Legion 5 15ARH05H
    Serial Number: PF2V630W
    UUID: 03aa0103-7fdb-11eb-80ec-38f3ab156725
    Wake-up Type: Power Switch
    SKU Number: LENOVO_MT_82B1_BU_idea_FM_Legion 5 15ARH05H
    Family: Legion 5 15ARH05H

Handle 0x0020, DMI type 12, 5 bytes
System Configuration Options
    Option 1: String1 for Type12 Equipment Manufacturer
    Option 2: String2 for Type12 Equipment Manufacturer
    Option 3: String3 for Type12 Equipment Manufacturer
    Option 4: String4 for Type12 Equipment Manufacturer

Handle 0x0030, DMI type 32, 20 bytes
System Boot Information
    Status: No errors detected
$ rpm-ostree status 
State: idle
Deployments:
● fedora:fedora/36/x86_64/silverblue
                  Version: 36.20221115.0 (2022-11-15T00:49:34Z)
               BaseCommit: 93bb655e3744b9e38351a8d50421869897f280e12809ad9891c9390872967100
             GPGSignature: Valid signature by 53DED2CB922D8B8D9E63FD18999F7CBF38AB71F4
      RemovedBasePackages: firefox 106.0.4-1.fc36 gnome-software gnome-software-rpm-ostree 42.4-2.fc36
          LayeredPackages: akmod-nvidia android-tools gnome-tweaks inotify-tools starship steam-devices tailscale terminator xboxdrv xorg-x11-drv-nvidia
            LocalPackages: rpmfusion-free-release-36-1.noarch rpmfusion-nonfree-release-36-1.noarch

  fedora:fedora/36/x86_64/silverblue
                  Version: 36.20221115.0 (2022-11-15T00:49:34Z)
               BaseCommit: 93bb655e3744b9e38351a8d50421869897f280e12809ad9891c9390872967100
             GPGSignature: Valid signature by 53DED2CB922D8B8D9E63FD18999F7CBF38AB71F4
      RemovedBasePackages: firefox 106.0.4-1.fc36 gnome-software gnome-software-rpm-ostree 42.4-2.fc36
          LayeredPackages: akmod-nvidia android-tools gnome-tweaks inotify-tools starship steam-devices tailscale terminator xboxdrv xorg-x11-drv-nvidia
            LocalPackages: rpmfusion-free-release-36-1.noarch rpmfusion-nonfree-release-36-1.noarch teamviewer-15.34.4-0.x86_64

Expected vs actual behavior

$ rpm-ostree rebase fedora:fedora/37/x86_64/silverblue --uninstall rpmfusion-free-release-36-1.noarch --uninstall rpmfusion-nonfree-release-36-1.noarch --install https://mirrors.rpmfusion.org/free/fedora/rpmfusion-free-release-37.noarch.rpm --install https://mirrors.rpmfusion.org/nonfree/fedora/rpmfusion-nonfree-release-37.noarch.rpm
Downloading https://mirrors.rpmfusion.org/free/fedora/rpmfusion-free-release-37.noarch.rpm...done
Downloading https://mirrors.rpmfusion.org/nonfree/fedora/rpmfusion-nonfree-release-37.noarch.rpm...done
⠤ Receiving metadata objects: 1/(estimating) 39 bytes/s 196 bytes                                                                                                                                                                              2 metadata, 0 content objects fetched; 788 B transferred in 7 seconds; 0 bytes content written
Receiving metadata objects: 1/(estimating) 39 bytes/s 196 bytes... done
Checking out tree 2a98f17... done
Enabled rpm-md repositories: fedora-cisco-openh264 rpmfusion-free-updates rpmfusion-free rpmfusion-nonfree-updates rpmfusion-nonfree phracek-PyCharm fedora-modular updates-modular updates fedora google-chrome tailscale-stable copr:copr.fedorainfracloud.org:petrb:xboxdrv copr:copr.fedorainfracloud.org:atim:starship updates-archive
Importing rpm-md... done
rpm-md repo 'fedora-cisco-openh264' (cached); generated: 2022-10-06T11:01:40Z solvables: 4
rpm-md repo 'rpmfusion-free-updates' (cached); generated: 2022-08-11T18:15:25Z solvables: 0
rpm-md repo 'rpmfusion-free' (cached); generated: 2022-11-11T16:54:42Z solvables: 496
rpm-md repo 'rpmfusion-nonfree-updates' (cached); generated: 2022-08-11T18:17:58Z solvables: 0
rpm-md repo 'rpmfusion-nonfree' (cached); generated: 2022-11-11T17:25:12Z solvables: 218
rpm-md repo 'phracek-PyCharm' (cached); generated: 2022-10-16T04:25:30Z solvables: 5
rpm-md repo 'fedora-modular' (cached); generated: 2022-11-10T09:23:24Z solvables: 1454
rpm-md repo 'updates-modular' (cached); generated: 2022-11-10T20:30:33Z solvables: 1454
rpm-md repo 'updates' (cached); generated: 2022-11-15T01:10:34Z solvables: 6944
rpm-md repo 'fedora' (cached); generated: 2022-11-10T09:30:00Z solvables: 66822
rpm-md repo 'google-chrome' (cached); generated: 2022-11-10T21:11:09Z solvables: 3
rpm-md repo 'tailscale-stable' (cached); generated: 2022-11-10T19:10:51Z solvables: 63
rpm-md repo 'copr:copr.fedorainfracloud.org:petrb:xboxdrv' (cached); generated: 2022-05-10T11:53:29Z solvables: 2
rpm-md repo 'copr:copr.fedorainfracloud.org:atim:starship' (cached); generated: 2022-10-16T03:43:22Z solvables: 2
rpm-md repo 'updates-archive' (cached); generated: 2022-11-15T01:30:00Z solvables: 5181
Resolving dependencies... done

(rpm-ostree rebase:26366): GLib-GIO-WARNING **: 13:21:53.241: _g_dbus_worker_do_read_cb: error determining bytes needed: Blob indicates that message exceeds maximum message length (128MiB)
$ journalctl -ft rpm-ostree
nov 15 13:21:36 LEGION rpm-ostree[26161]: Locked sysroot
nov 15 13:21:36 LEGION rpm-ostree[26161]: Initiated txn UpdateDeployment for client(id:cli dbus:1.189 unit:vte-spawn-952a1d49-7fa6-41cf-8b0a-cdc378e96e53.scope uid:1000): /org/projectatomic/rpmostree1/fedora
nov 15 13:21:36 LEGION rpm-ostree[26161]: Process [pid: 26366 uid: 1000 unit: user@1000.service] connected to transaction progress
nov 15 13:21:41 LEGION rpm-ostree[26161]: Receiving metadata objects: 0/(estimating) -/s 0 bytes
nov 15 13:21:44 LEGION rpm-ostree[26161]: libostree pull from 'fedora' for fedora/37/x86_64/silverblue complete
                                          security: GPG: commit 
                                          security: SIGN: disabled http: TLS
                                          non-delta: meta: 2 content: 0
                                          transfer: secs: 7 size: 788 bytes
nov 15 13:21:47 LEGION rpm-ostree[26161]: Librepo version: 1.14.4 with CURL_GLOBAL_ACK_EINTR support (libcurl/7.82.0 OpenSSL/3.0.5 zlib/1.2.11 brotli/1.0.9 libidn2/2.3.4 libpsl/0.21.1 (+libidn2/2.3.2) libssh/0.9.6/openssl/zlib nghttp2/1.46.0 OpenLDAP/2.6.3)
nov 15 13:21:48 LEGION rpm-ostree[26161]: Preparing pkg txn; enabled repos: ['fedora-cisco-openh264', 'rpmfusion-free-updates', 'rpmfusion-free', 'rpmfusion-nonfree-updates', 'rpmfusion-nonfree', 'phracek-PyCharm', 'fedora-modular', 'updates-modular', 'updates', 'fedora', 'google-chrome', 'tailscale-stable', 'copr:copr.fedorainfracloud.org:petrb:xboxdrv', 'copr:copr.fedorainfracloud.org:atim:starship', 'updates-archive'] solvables: 82648
nov 15 13:21:53 LEGION rpm-ostree[26161]: Unlocked sysroot
nov 15 13:22:23 LEGION rpm-ostree[26161]: Forcibly closing transaction due to timeout

to get the terminal prompt back I had to restart the service sudo systemctl restart rpm-ostreed

Expected:

$ rpm-ostree rebase fedora:fedora/37/x86_64/silverblue --uninstall rpmfusion-free-release-36-1.noarch --uninstall rpmfusion-nonfree-release-36-1.noarch --install https://mirrors.rpmfusion.org/free/fedora/rpmfusion-free-release-37.noarch.rpm --install https://mirrors.rpmfusion.org/nonfree/fedora/rpmfusion-nonfree-release-37.noarch.rpm
...
Success! and reboot (systemctl reboot)

Steps to reproduce it

$ rpm-ostree rebase fedora:fedora/37/x86_64/silverblue --uninstall rpmfusion-free-release-36-1.noarch --uninstall rpmfusion-nonfree-release-36-1.noarch --install https://mirrors.rpmfusion.org/free/fedora/rpmfusion-free-release-37.noarch.rpm --install https://mirrors.rpmfusion.org/nonfree/fedora/rpmfusion-nonfree-release-37.noarch.rpm

I have additional packages layered but I tried the same command but removing them all (adding --uninstall one by one) and still happened

I upgraded recently (there was a kernel upgrade) without any issue, just the rebase does not work

Would you like to work on the issue?

The issue should be assigned to someone else.

rscm commented 1 year ago

my workaround was

lucab commented 1 year ago

Thanks for the report. We have seen this error once already in https://github.com/coreos/rpm-ostree/issues/3642 but it was unclear what was the root cause. We suspected some memory corruption, but SELinux was involved too.

If you can reliably reproduce this, it would be interesting to run the rpm-ostreed.service daemon as well as your command-line client with the G_DBUS_DEBUG=transport environment variable set, and see if there are useful details in there.

rscm commented 1 year ago

Thanks for the report. We have seen this error once already in #3642 but it was unclear what was the root cause. We suspected some memory corruption, but SELinux was involved too.

If you can reliably reproduce this, it would be interesting to run the rpm-ostreed.service daemon as well as your command-line client with the G_DBUS_DEBUG=transport environment variable set, and see if there are useful details in there.

I've already moved to 37 (using reset). but because isn't critical to move back for me, I'll do it and I can probably replicate the issue. I'll post an update soon

lucab commented 1 year ago

Thanks, that would be appreciated. Even checking if the same failure can be observed again on the same machine is a good datapoint to have.

rscm commented 1 year ago

Thanks, that would be appreciated. Even checking if the same failure can be observed again on the same machine is a good datapoint to have.

ok

I had to reset again to be able to replicate the issue because just "rebasing" back didn’t shown the error.

If there's anymore you want me to test just ask, If not please tell me that way I can rebase to F37.

A note. If I change the RPM Fusion repos as Layered Packages instead of Local Packages (rpm-ostree upgrade --uninstall rpmfusion-free-release-36-1.noarch --uninstall rpmfusion-nonfree-release-36-1.noarch --install rpmfusion-free-release --install rpmfusion-nonfree-release) the rebase command could be done like it should be rpm-ostree rebase fedora:fedora/37/x86_64/silverblue but the error presented in the first post and also below is the same.

How to replicate?

Error Log

❯ rpm-ostree rebase fedora:fedora/37/x86_64/silverblue --uninstall rpmfusion-free-release-36-1.noarch --uninstall rpmfusion-nonfree-release-36-1.noarch --install https://mirrors.rpmfusion.org/free/fedora/rpmfusion-free-release-37.noarch.rpm --install https://mirrors.rpmfusion.org/nonfree/fedora/rpmfusion-nonfree-release-37.noarch.rpm > debug_rebase.txt
...
(rpm-ostree rebase:4135): GLib-GIO-WARNING **: 15:08:24.026: _g_dbus_worker_do_read_cb: error determining bytes needed: Blob indicates that message exceeds maximum message length (128MiB)

full output log https://www.klgrth.io/paste/wv36o

full debug_rebase.txt file https://www.klgrth.io/paste/9vhtx

Other logs

❯ rpm-ostree status 
State: idle
Deployments:
● fedora:fedora/36/x86_64/silverblue
                  Version: 36.20221116.0 (2022-11-16T02:07:48Z)
               BaseCommit: 72c141b124b0aa045e435d3b4cc8d1746e1a1e8401209e33b74b753e7ff7dde8
             GPGSignature: Valid signature by 53DED2CB922D8B8D9E63FD18999F7CBF38AB71F4
      RemovedBasePackages: firefox 106.0.4-1.fc36 gnome-software gnome-software-rpm-ostree 42.4-2.fc36
          LayeredPackages: akmod-nvidia android-tools gnome-tweaks inotify-tools starship steam-devices tailscale terminator xboxdrv xorg-x11-drv-nvidia
            LocalPackages: rpmfusion-free-release-36-1.noarch rpmfusion-nonfree-release-36-1.noarch

  fedora:fedora/36/x86_64/silverblue
                  Version: 36.20221116.0 (2022-11-16T02:07:48Z)
               BaseCommit: 72c141b124b0aa045e435d3b4cc8d1746e1a1e8401209e33b74b753e7ff7dde8
             GPGSignature: Valid signature by 53DED2CB922D8B8D9E63FD18999F7CBF38AB71F4
      RemovedBasePackages: firefox 106.0.4-1.fc36 gnome-software gnome-software-rpm-ostree 42.4-2.fc36
            LocalPackages: rpmfusion-free-release-36-1.noarch rpmfusion-nonfree-release-36-1.noarch
❯ rpm-ostree rebase fedora:fedora/37/x86_64/silverblue
⠤ Receiving metadata objects: 1/(estimating) 39 bytes/s 196 bytes                                                                                                                                                                              2 metadata, 0 content objects fetched; 788 B transferred in 7 seconds; 0 bytes content written
Receiving metadata objects: 1/(estimating) 39 bytes/s 196 bytes... done
Checking out tree 0eda5e6... done
Enabled rpm-md repositories: fedora-cisco-openh264 rpmfusion-free-updates rpmfusion-free rpmfusion-nonfree-updates rpmfusion-nonfree phracek-PyCharm fedora-modular updates-modular updates fedora google-chrome tailscale-stable copr:copr.fedorainfracloud.org:petrb:xboxdrv copr:copr.fedorainfracloud.org:atim:starship updates-archive
Importing rpm-md... done
rpm-md repo 'fedora-cisco-openh264' (cached); generated: 2022-10-06T11:01:40Z solvables: 4
rpm-md repo 'rpmfusion-free-updates' (cached); generated: 2022-08-11T18:15:25Z solvables: 0
rpm-md repo 'rpmfusion-free' (cached); generated: 2022-11-11T16:54:42Z solvables: 496
rpm-md repo 'rpmfusion-nonfree-updates' (cached); generated: 2022-08-11T18:17:58Z solvables: 0
rpm-md repo 'rpmfusion-nonfree' (cached); generated: 2022-11-11T17:25:12Z solvables: 218
rpm-md repo 'phracek-PyCharm' (cached); generated: 2022-10-16T04:25:30Z solvables: 5
rpm-md repo 'fedora-modular' (cached); generated: 2022-11-10T09:23:24Z solvables: 1454
rpm-md repo 'updates-modular' (cached); generated: 2022-11-10T20:30:33Z solvables: 1454
rpm-md repo 'updates' (cached); generated: 2022-11-16T02:26:55Z solvables: 7054
rpm-md repo 'fedora' (cached); generated: 2022-11-10T09:30:00Z solvables: 66822
rpm-md repo 'google-chrome' (cached); generated: 2022-11-10T21:11:09Z solvables: 3
rpm-md repo 'tailscale-stable' (cached); generated: 2022-11-10T19:10:51Z solvables: 63
rpm-md repo 'copr:copr.fedorainfracloud.org:petrb:xboxdrv' (cached); generated: 2022-05-10T11:53:29Z solvables: 2
rpm-md repo 'copr:copr.fedorainfracloud.org:atim:starship' (cached); generated: 2022-10-16T03:43:22Z solvables: 2
rpm-md repo 'updates-archive' (cached); generated: 2022-11-16T03:05:52Z solvables: 5282
Resolving dependencies... done
error: No se pudo cancelar la transacción; 3 problemas detectados:
 Problema 1: conflicting requests
  - nothing provides system-release(36) needed by rpmfusion-free-release-36-1.noarch
 Problema 2: conflicting requests
  - nothing provides system-release(36) needed by rpmfusion-nonfree-release-36-1.noarch
 Problema 3: package firefox-langpacks-106.0.4-1.fc37.x86_64 requires firefox = 106.0.4-1.fc37, but none of the providers can be installed
  - conflicting requests
❯ rpm-ostree rebase fedora:fedora/37/x86_64/silverblue --uninstall rpmfusion-free-release-36-1.noarch --uninstall rpmfusion-nonfree-release-36-1.noarch --install https://mirrors.rpmfusion.org/free/fedora/rpmfusion-free-release-37.noarch.rpm --install https://mirrors.rpmfusion.org/nonfree/fedora/rpmfusion-nonfree-release-37.noarch.rpm
Downloading https://mirrors.rpmfusion.org/free/fedora/rpmfusion-free-release-37.noarch.rpm...done
Downloading https://mirrors.rpmfusion.org/nonfree/fedora/rpmfusion-nonfree-release-37.noarch.rpm...done
⠴ Receiving metadata objects: 1/(estimating) 49 bytes/s 196 bytes...                                                                                                                                                                           2 metadata, 0 content objects fetched; 788 B transferred in 6 seconds; 0 bytes content written
Receiving metadata objects: 1/(estimating) 49 bytes/s 196 bytes... done
Checking out tree 0eda5e6... done
Enabled rpm-md repositories: fedora-cisco-openh264 rpmfusion-free-updates rpmfusion-free rpmfusion-nonfree-updates rpmfusion-nonfree phracek-PyCharm fedora-modular updates-modular updates fedora google-chrome tailscale-stable copr:copr.fedorainfracloud.org:petrb:xboxdrv copr:copr.fedorainfracloud.org:atim:starship updates-archive
Importing rpm-md... done
rpm-md repo 'fedora-cisco-openh264' (cached); generated: 2022-10-06T11:01:40Z solvables: 4
rpm-md repo 'rpmfusion-free-updates' (cached); generated: 2022-08-11T18:15:25Z solvables: 0
rpm-md repo 'rpmfusion-free' (cached); generated: 2022-11-11T16:54:42Z solvables: 496
rpm-md repo 'rpmfusion-nonfree-updates' (cached); generated: 2022-08-11T18:17:58Z solvables: 0
rpm-md repo 'rpmfusion-nonfree' (cached); generated: 2022-11-11T17:25:12Z solvables: 218
rpm-md repo 'phracek-PyCharm' (cached); generated: 2022-10-16T04:25:30Z solvables: 5
rpm-md repo 'fedora-modular' (cached); generated: 2022-11-10T09:23:24Z solvables: 1454
rpm-md repo 'updates-modular' (cached); generated: 2022-11-10T20:30:33Z solvables: 1454
rpm-md repo 'updates' (cached); generated: 2022-11-16T02:26:55Z solvables: 7054
rpm-md repo 'fedora' (cached); generated: 2022-11-10T09:30:00Z solvables: 66822
rpm-md repo 'google-chrome' (cached); generated: 2022-11-10T21:11:09Z solvables: 3
rpm-md repo 'tailscale-stable' (cached); generated: 2022-11-10T19:10:51Z solvables: 63
rpm-md repo 'copr:copr.fedorainfracloud.org:petrb:xboxdrv' (cached); generated: 2022-05-10T11:53:29Z solvables: 2
rpm-md repo 'copr:copr.fedorainfracloud.org:atim:starship' (cached); generated: 2022-10-16T03:43:22Z solvables: 2
rpm-md repo 'updates-archive' (cached); generated: 2022-11-16T03:05:52Z solvables: 5282
Resolving dependencies... done

(rpm-ostree rebase:3024): GLib-GIO-WARNING **: 14:57:14.616: _g_dbus_worker_do_read_cb: error determining bytes needed: Blob indicates that message exceeds maximum message length (128MiB)

❯ printenv G_DBUS_DEBUG
transport
❯ sudo systemctl status rpm-ostreed
○ rpm-ostreed.service - rpm-ostree System Management Daemon
     Loaded: loaded (/usr/lib/systemd/system/rpm-ostreed.service; static)
     Active: inactive (dead)
       Docs: man:rpm-ostree(1)
❯ journalctl -ft rpm-ostree
nov 16 15:05:01 LEGION rpm-ostree[3181]: Reading config file '/etc/rpm-ostreed.conf'
nov 16 15:05:02 LEGION rpm-ostree[3181]: In idle state; will auto-exit in 61 seconds
nov 16 15:05:02 LEGION rpm-ostree[3181]: Allowing active client :1.124 (uid 1000)
nov 16 15:05:02 LEGION rpm-ostree[3181]: client(id:cli dbus:1.124 unit:vte-spawn-aaec4e1e-2416-46b5-aed4-af2ceec9d1cd.scope uid:1000) added; new total=1
nov 16 15:05:07 LEGION rpm-ostree[3181]: Locked sysroot
nov 16 15:05:07 LEGION rpm-ostree[3181]: Initiated txn UpdateDeployment for client(id:cli dbus:1.124 unit:vte-spawn-aaec4e1e-2416-46b5-aed4-af2ceec9d1cd.scope uid:1000): /org/projectatomic/rpmostree1/fedora
nov 16 15:05:07 LEGION rpm-ostree[3181]: Process [pid: 3171 uid: 1000 unit: user@1000.service] connected to transaction progress
nov 16 15:05:13 LEGION rpm-ostree[3181]: Receiving metadata objects: 0/(estimating) -/s 0 bytes
nov 16 15:05:16 LEGION rpm-ostree[3181]: libostree pull from 'fedora' for fedora/37/x86_64/silverblue complete
                                         security: GPG: commit 
                                         security: SIGN: disabled http: TLS
                                         non-delta: meta: 2 content: 0
                                         transfer: secs: 8 size: 788 bytes
nov 16 15:05:26 LEGION rpm-ostree[3181]: Librepo version: 1.14.4 with CURL_GLOBAL_ACK_EINTR support (libcurl/7.82.0 OpenSSL/3.0.5 zlib/1.2.11 brotli/1.0.9 libidn2/2.3.4 libpsl/0.21.1 (+libidn2/2.3.2) libssh/0.9.6/openssl/zlib nghttp2/1.46.0 OpenLDAP/2.6.3)
nov 16 15:05:27 LEGION rpm-ostree[3181]: Preparing pkg txn; enabled repos: ['fedora-cisco-openh264', 'rpmfusion-free-updates', 'rpmfusion-free', 'rpmfusion-nonfree-updates', 'rpmfusion-nonfree', 'phracek-PyCharm', 'fedora-modular', 'updates-modular', 'updates', 'fedora', 'google-chrome', 'tailscale-stable', 'copr:copr.fedorainfracloud.org:petrb:xboxdrv', 'copr:copr.fedorainfracloud.org:atim:starship', 'updates-archive'] solvables: 82859
nov 16 15:05:35 LEGION rpm-ostree[3181]: Unlocked sysroot
❯ sudo systemctl status rpm-ostreed
● rpm-ostreed.service - rpm-ostree System Management Daemon
     Loaded: loaded (/usr/lib/systemd/system/rpm-ostreed.service; static)
     Active: active (running) since Wed 2022-11-16 15:05:02 -03; 1min 21s ago
       Docs: man:rpm-ostree(1)
   Main PID: 3181 (rpm-ostree)
     Status: "clients=1; idle"
      Tasks: 4 (limit: 18331)
     Memory: 1.7G
        CPU: 15.411s
     CGroup: /system.slice/rpm-ostreed.service
             └─ 3181 rpm-ostree start-daemon

nov 16 15:05:02 LEGION rpm-ostree[3181]: client(id:cli dbus:1.124 unit:vte-spawn-aaec4e1e-2416-46b5-aed4-af2ceec9d1cd.scope uid:1000) added; new total=1
nov 16 15:05:07 LEGION rpm-ostree[3181]: Locked sysroot
nov 16 15:05:07 LEGION rpm-ostree[3181]: Initiated txn UpdateDeployment for client(id:cli dbus:1.124 unit:vte-spawn-aaec4e1e-2416-46b5-aed4-af2ceec9d1cd.scope uid:1000): /org/projectatomic/rpmostree1/fedora
nov 16 15:05:07 LEGION rpm-ostree[3181]: Process [pid: 3171 uid: 1000 unit: user@1000.service] connected to transaction progress
nov 16 15:05:13 LEGION rpm-ostree[3181]: Receiving metadata objects: 0/(estimating) -/s 0 bytes
nov 16 15:05:16 LEGION rpm-ostree[3181]: libostree pull from 'fedora' for fedora/37/x86_64/silverblue complete
                                         security: GPG: commit 
                                         security: SIGN: disabled http: TLS
                                         non-delta: meta: 2 content: 0
                                         transfer: secs: 8 size: 788 bytes
nov 16 15:05:26 LEGION rpm-ostree[3181]: Librepo version: 1.14.4 with CURL_GLOBAL_ACK_EINTR support (libcurl/7.82.0 OpenSSL/3.0.5 zlib/1.2.11 brotli/1.0.9 libidn2/2.3.4 libpsl/0.21.1 (+libidn2/2.3.2) libssh/0.9.6/openssl/zlib nghttp2/1.46>
nov 16 15:05:27 LEGION rpm-ostree[3181]: Preparing pkg txn; enabled repos: ['fedora-cisco-openh264', 'rpmfusion-free-updates', 'rpmfusion-free', 'rpmfusion-nonfree-updates', 'rpmfusion-nonfree', 'phracek-PyCharm', 'fedora-modular', 'updat>
nov 16 15:05:35 LEGION rpm-ostree[3181]: Unlocked sysroot
nov 16 15:06:05 LEGION rpm-ostree[3181]: Forcibly closing transaction due to timeout
lines 1-26/26 (END)
rscm commented 1 year ago

I will upgrade now

adrm commented 1 year ago

In my case, I got that message when trying to rebase and following advice I did a reset, rebase to 37 and then I tried to install everything back again. Everything went fine except for removing the firefox package (I'm using the flatpak so the rpm default one is not needed and confusing), when I got the same error again. I have not been able to remove it with sudo rpm-ostree override remove firefox yet. imagen

cold-distance commented 1 year ago

Hi, I'm a Silverblue user and I tried to update through GNOME Software and the command line for three hours. I thought that the update process was taking an absurd amount of time and, as I thought, the problem is a bug. I would like to update through GNOME Software.

It seems that all the info I could get is already published.

yajo commented 1 year ago

I found the workaround and I can imagine what's the culprit. FWIW the context is that I was trying to test this workaround for another unrelated issue.

To circumvent this issue, I had to do an upgrade before:

rpm-ostree upgrade --reboot
rpm-ostree override replace  --reboot https://kojipkgs.fedoraproject.org//packages/gtk3/3.24.34/2.fc37/x86_64/gtk3-3.24.34-2.fc37.x86_64.rpm https://kojipkgs.fedoraproject.org//packages/gtk3/3.24.34/2.fc37/x86_64/gtk-update-icon-cache-3.24.34-2.fc37.x86_64.rpm

I have external RPM repos added. For example, I have the one from VSCodium. This repo only contains the rpm package for the last VSCodium build. So, if I don't upgrade before other operations, rpm-ostree cannot re-download the VSCodium RPM and reproduce the rest of the deployment. Thus, it hangs. I have no proof that this is the real problem, but it smells like it could be.

If that were the case, the solution could be one (or more) of:

  1. Keep extra RPM files applied to some deployments stored locally in some kind of cache, so they are always available when rebuilding a deployment with those packages and some others.
  2. Give a better error message. Without hanging.
  3. Add an --upgrade flag to the rest of rpm-ostree subcommands, so all this can be done in one shot. FWIW, you can use rpm-ostree upgrade's --install and --uninstall flags to workaround it for those operations. But other operations require an extra upgrade and reboot. Rebooting twice to apply an override is a bad UX.
yajo commented 1 year ago

Correcting myself: my last post must not be true. The workaround isn't working anymore. I can't reset my overrides. 🤷🏼‍♂️

This bug is horrible 🤦🏼‍♂️ . No stable workaround yet?