Open hfiguiere opened 5 months ago
You can try resetting your SELinux policy to the default one with the instructions from: https://docs.fedoraproject.org/en-US/fedora-silverblue/troubleshooting/#_selinux_problems
Yes they were difference, and I did reset as instructed. I get a different boot failure unless I boot with selinux=0
.
This time, I get dbus-broker to also fail (systemd-resolved seem to still fail but no hang the whole boot) :
Jun 26 10:12:42 rocinante systemd[1]: NetworkManager.service: Job NetworkManager.service/start failed with result 'dependency'.
Jun 26 10:12:42 rocinante systemd[1]: NetworkManager-wait-online.service: Job NetworkManager-wait-online.service/start failed with res>
Jun 26 10:12:42 rocinante systemd[1]: Dependency failed for NetworkManager-wait-online.service - Network Manager Wait Online.
Jun 26 10:12:42 rocinante systemd[1]: Dependency failed for NetworkManager.service - Network Manager.
Jun 26 10:12:42 rocinante systemd[1]: Failed to start dbus-broker.service - D-Bus System Message Bus.
Jun 26 10:12:42 rocinante systemd[1]: dbus-broker.service: Failed with result 'exit-code'.
Jun 26 10:12:42 rocinante systemd[1]: dbus-broker.service: Main process exited, code=exited, status=1/FAILURE
Jun 26 10:12:42 rocinante dbus-broker-launch[1066]: Exiting due to fatal error: -131
Jun 26 10:12:42 rocinante dbus-broker-launch[1066]: main @ ../src/launch/main.c +178
Jun 26 10:12:42 rocinante dbus-broker-launch[1066]: ERROR run @ ../src/launch/main.c +152: Return code 1
Jun 26 10:12:42 rocinante dbus-broker-launch[1066]: Access denied in /etc/selinux/targeted/contexts/dbus_contexts +1: /etc/selinux/tar>
Jun 26 10:12:42 rocinante audit[1066]: AVC avc: denied { open } for pid=1066 comm="dbus-broker-lau" path="/etc/selinux/targeted/con>
And then a cascading failure of other services include systemd-logind
gdm.service
, etc.
In the end the last message on screen is about plymouth service stopping. and it hang there.
And I checked there was no selinux policy difference anymore
also the question is WTF changed the selinux policy. I never touch that.
There was an issue a while ago that made it local change even if you hadn't touched it. This should not matter as it gets updated automatically now but just in case.
I wonder if autorelabel=1
interacts well with ostree. I have not tried it. Can you list here the labels of the binaries that fail to start? ls -alZ /sur/bin/..
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 106784 Dec 31 1969 systemd
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 36720 Dec 31 1969 systemd-backlight
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 20280 Dec 31 1969 systemd-battery-check
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 24384 Dec 31 1969 systemd-binfmt
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 32848 Dec 31 1969 systemd-bless-boot
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 16160 Dec 31 1969 systemd-boot-check-no-failures
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 24336 Dec 31 1969 systemd-bsod
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 16096 Dec 31 1969 systemd-cgroups-agent
-rwxr-xr-x. 2 root root system_u:object_r:systemd_coredump_exec_t:s0 98736 Dec 31 1969 systemd-coredump
lrwxrwxrwx. 2 root root system_u:object_r:lib_t:s0 28 May 5 17:13 systemd-cryptsetup -> ../../bin/systemd-cryptsetup
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 160672 Dec 31 1969 systemd-executor
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 45088 Dec 31 1969 systemd-export
-rwxr-xr-x. 2 root root system_u:object_r:fsadm_exec_t:s0 32584 Dec 31 1969 systemd-fsck
-rwxr-xr-x. 2 root root system_u:object_r:fsadm_exec_t:s0 28424 Dec 31 1969 systemd-growfs
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 28688 Dec 31 1969 systemd-hibernate-resume
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 236192 Dec 31 1969 systemd-homed
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 239272 Dec 31 1969 systemd-homework
-rwxr-xr-x. 2 root root system_u:object_r:systemd_hostnamed_exec_t:s0 57808 Dec 31 1969 systemd-hostnamed
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 61616 Dec 31 1969 systemd-import
-rwxr-xr-x. 2 root root system_u:object_r:systemd_importd_exec_t:s0 49288 Dec 31 1969 systemd-importd
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 32616 Dec 31 1969 systemd-import-fs
-rwxr-xr-x. 2 root root system_u:object_r:systemd_initctl_exec_t:s0 24376 Dec 31 1969 systemd-initctl
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 24576 Dec 31 1969 systemd-integritysetup
-rwxr-xr-x. 2 root root system_u:object_r:syslogd_exec_t:s0 209184 Dec 31 1969 systemd-journald
-rwxr-xr-x. 2 root root system_u:object_r:systemd_localed_exec_t:s0 57576 Dec 31 1969 systemd-localed
-rwxr-xr-x. 2 root root system_u:object_r:systemd_logind_exec_t:s0 299344 Dec 31 1969 systemd-logind
-rwxr-xr-x. 2 root root system_u:object_r:systemd_machined_exec_t:s0 140928 Dec 31 1969 systemd-machined
-rwxr-xr-x. 2 root root system_u:object_r:fsadm_exec_t:s0 16112 Dec 31 1969 systemd-makefs
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 53688 Dec 31 1969 systemd-measure
-rwxr-xr-x. 2 root root system_u:object_r:systemd_modules_load_exec_t:s0 24592 Dec 31 1969 systemd-modules-load
-rwxr-xr-x. 2 root root system_u:object_r:systemd_networkd_exec_t:s0 1770712 Dec 31 1969 systemd-networkd
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 41144 Dec 31 1969 systemd-networkd-wait-online
-rwxr-xr-x. 2 root root system_u:object_r:systemd_network_generator_exec_t:s0 45208 Dec 31 1969 systemd-network-generator
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 65920 Dec 31 1969 systemd-oomd
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 28744 Dec 31 1969 systemd-pcrextend
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 161176 Dec 31 1969 systemd-pcrlock
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 123992 Dec 31 1969 systemd-portabled
-rwxr-xr-x. 2 root root system_u:object_r:systemd_pstore_exec_t:s0 24472 Dec 31 1969 systemd-pstore
-rwxr-xr-x. 2 root root system_u:object_r:systemd_importd_exec_t:s0 115696 Dec 31 1969 systemd-pull
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 15952 Dec 31 1969 systemd-quotacheck
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 28448 Dec 31 1969 systemd-random-seed
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 24360 Dec 31 1969 systemd-remount-fs
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 16144 Dec 31 1969 systemd-reply-password
-rwxr-xr-x. 2 root root system_u:object_r:systemd_resolved_exec_t:s0 597968 Dec 31 1969 systemd-resolved
-rwxr-xr-x. 2 root root system_u:object_r:systemd_rfkill_exec_t:s0 28496 Dec 31 1969 systemd-rfkill
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 65608 Dec 31 1969 systemd-shutdown
-rwxr-xr-x. 2 root root system_u:object_r:systemd_sleep_exec_t:s0 53280 Dec 31 1969 systemd-sleep
-rwxr-xr-x. 2 root root system_u:object_r:systemd_socket_proxyd_exec_t:s0 32744 Dec 31 1969 systemd-socket-proxyd
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 57696 Dec 31 1969 systemd-storagetm
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 20280 Dec 31 1969 systemd-sulogin-shell
-rwxr-xr-x. 2 root root system_u:object_r:systemd_sysctl_exec_t:s0 32792 Dec 31 1969 systemd-sysctl
lrwxrwxrwx. 3 root root system_u:object_r:lib_t:s0 41 Apr 24 2023 systemd-sysroot-fstab-check -> system-generators/systemd-fstab-generator
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 140576 Dec 31 1969 systemd-sysupdate
-rwxr-xr-x. 2 root root system_u:object_r:systemd_timedated_exec_t:s0 49256 Dec 31 1969 systemd-timedated
-rwxr-xr-x. 2 root root system_u:object_r:systemd_timedated_exec_t:s0 69968 Dec 31 1969 systemd-timesyncd
-rwxr-xr-x. 2 root root system_u:object_r:systemd_timedated_exec_t:s0 24376 Dec 31 1969 systemd-time-wait-sync
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 28688 Dec 31 1969 systemd-tpm2-setup
lrwxrwxrwx. 3 root root system_u:object_r:lib_t:s0 17 Sep 15 2021 systemd-udevd -> ../../bin/udevadm
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 16136 Dec 31 1969 systemd-update-done
-rwxr-xr-x. 3 root root system_u:object_r:init_exec_t:s0 3853 Dec 31 1969 systemd-update-helper
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 24448 Dec 31 1969 systemd-update-utmp
-rwxr-xr-x. 2 root root system_u:object_r:systemd_userdbd_exec_t:s0 28544 Dec 31 1969 systemd-userdbd
-rwxr-xr-x. 2 root root system_u:object_r:systemd_logind_exec_t:s0 24376 Dec 31 1969 systemd-user-runtime-dir
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 15920 Dec 31 1969 systemd-user-sessions
-rwxr-xr-x. 2 root root system_u:object_r:systemd_userdbd_exec_t:s0 32704 Dec 31 1969 systemd-userwork
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 32600 Dec 31 1969 systemd-vconsole-setup
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 32952 Dec 31 1969 systemd-veritysetup
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 24344 Dec 31 1969 systemd-volatile-root
-rwxr-xr-x. 2 root root system_u:object_r:init_exec_t:s0 16160 Dec 31 1969 systemd-xdg-autostart-condition
-rwxr-xr-x. 2 root root system_u:object_r:dbusd_exec_t:s0 228632 Dec 31 1969 /usr/bin/dbus-broker
-rwxr-xr-x. 2 root root system_u:object_r:dbusd_exec_t:s0 132384 Dec 31 1969 /usr/bin/dbus-broker-launch
Did reboot into F40 with enforce=0 autorelabel=1
and upon reboot as it, one more time, failed to stop at grub, it magically worked.
Checked I'm running F40, and I checked that selinux was enabled and enforcing.
As to why I ended up in that situation I don't know, but there surely should be an easier way to get out of this.
Describe the bug I finally applied the bootloadeer failure workaround (#543) to reboot from SB F39 into F40. The version deployed is
It hangs in the reboot because it can't start systemd-resolved.
If I reboot with
selinux=0
added to the boot line. It does boot to the end. If I reboot withenforce=0
it doesn't. Albeit withenforce=0 autorelabel=1
it did relabel but this didn't solve the issue.To Reproduce Please describe the steps needed to reproduce the bug:
Expected behavior
It boots to the session login and I can login.
Observed
The boot hangs. Pressing ESC show that is hang because it can't start systemd-resolved.
Screenshots
It would be unreadable since it's all written so small (not a SB specific problem, but has been like that since 2017)
OS version:
The F39 deployment works.
Additional context
From journalctl -r: (entries in reverse order)
and then
and
If you need more specific log, please ask.