kairos-io / kairos

:penguin: The immutable Linux meta-distribution for edge Kubernetes.
https://kairos.io
Apache License 2.0
1.11k stars 97 forks source link

Some USB devices cannot be used as install media #2316

Closed Itxaka closed 7 months ago

Itxaka commented 7 months ago

Kairos version:

Master

Under uki some USB devices are not properly detected under initramfs by immucore so they aren't properly mounted under /run/rootfs base which leads to a failure during install as the installer cannot find some expected files.

One the system is booted the devices are available and visible under /dev/disk/by-label with the proper label UKI_ISO_INSTALL so immucore might be missing some required modules

Itxaka commented 7 months ago

Reported in slack

We requested: Immucore logs ls -l /sys/bus/usb/drivers ls -ltra /dev/disk/by-label dmesg | grep driver

As with our test USB we haven't been able to reproduce it

Itxaka commented 7 months ago
# ls -l /sys/bus/usb/drivers
total 0
drwxr-xr-x 2 root root 0 Mar  7 16:42 apple-mfi-fastcharge
drwxr-xr-x 2 root root 0 Mar  7 16:42 hub
drwxr-xr-x 2 root root 0 Mar  7 16:42 uas
drwxr-xr-x 2 root root 0 Mar  7 16:42 usb
drwxr-xr-x 2 root root 0 Mar  7 16:42 usb-storage
drwxr-xr-x 2 root root 0 Mar  7 16:42 usbfs
drwxr-xr-x 2 root root 0 Mar  7 16:42 usbhid
# ls -ltra /dev/disk/by-label
total 0
lrwxrwxrwx 1 root root   9 Mar  7 16:42 UKI_ISO_INSTALL -> ../../sda
drwxr-xr-x 9 root root 180 Mar  7 16:42 ..
lrwxrwxrwx 1 root root  15 Mar  7 16:42 COS_OEM -> ../../nvme0n1p2
lrwxrwxrwx 1 root root  15 Mar  7 16:42 COS_GRUB -> ../../nvme0n1p1
lrwxrwxrwx 1 root root  15 Mar  7 16:43 COS_PERSISTENT -> ../../nvme0n1p3
# dmesg | grep driver
[    0.319991] Performance Events: PEBS fmt3+, Skylake events, 32-deep LBR, full-width counters, Intel PMU driver.
[    0.586649] usbcore: registered new interface driver usbfs
[    0.586649] usbcore: registered new interface driver hub
[    0.586649] usbcore: registered new device driver usb
[    0.694987] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
[    0.706796] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    0.764311] tun: Universal TUN/TAP device driver, 1.6
[    0.765259] PPP generic driver version 2.4.2
[    0.771578] i2c_dev: i2c /dev entries driver
[    0.783325] intel_pstate: Intel P-state driver initializing
[    4.744369] usbcore: registered new interface driver usb-storage
[   12.797074] usbcore: registered new device driver apple-mfi-fastcharge
[   12.797247] usbcore: registered new interface driver uas
[   13.117047] hid: raw HID events driver (C) Jiri Kosina
[   13.136491] usbcore: registered new interface driver usbhid
[   13.136498] usbhid: USB HID core driver
Itxaka commented 7 months ago

They seem to be the same modules we already load on immucore....

immucore log attached immucore.log

Itxaka commented 7 months ago

modules inserted:

2024-03-07T16:42:33Z DBG Detecting needed modules drivers=["button","acpi_pad","video","fjes","wmi","skl_uncore","port","ctrl","serial","pcie_pme","aer","pcieport","intel_pmc_core","tpm_tis","efi-framebuffer","efi_pstore","kgdboc","pcspkr","reg-dummy","serial8250","system","alarmtimer","rtc_cmos","rapl","processor","intel_rapl_common","intel_cstate","virtio","ata_piix","cdrom","ext4","iso9660","usb_storage","ahci","fat","vfat","virtio_blk","virtio_scsi","virtio_net","nvme","overlay","libata","sr_mod","simpledrm","loop"]

modules that failed to be inserted becuase they dont exist (should not be an issue):

2024-03-07T16:42:33Z DBG modprobe error="exit status 1" out="modprobe: ERROR: could not insert 'fjes': No such device\n"
2024-03-07T16:42:33Z DBG modprobe error="exit status 1" out="modprobe: FATAL: Module skl_uncore not found in directory /lib/modules/6.5.0-17-generic\n"
2024-03-07T16:42:33Z DBG modprobe error="exit status 1" out="modprobe: FATAL: Module port not found in directory /lib/modules/6.5.0-17-generic\n"
2024-03-07T16:42:33Z DBG modprobe error="exit status 1" out="modprobe: FATAL: Module ctrl not found in directory /lib/modules/6.5.0-17-generic\n"
2024-03-07T16:42:33Z DBG modprobe error="exit status 1" out="modprobe: FATAL: Module serial not found in directory /lib/modules/6.5.0-17-generic\n"
2024-03-07T16:42:33Z DBG modprobe error="exit status 1" out="modprobe: FATAL: Module pcie_pme not found in directory /lib/modules/6.5.0-17-generic\n"
2024-03-07T16:42:33Z DBG modprobe error="exit status 1" out="modprobe: FATAL: Module aer not found in directory /lib/modules/6.5.0-17-generic\n"
2024-03-07T16:42:33Z DBG modprobe error="exit status 1" out="modprobe: FATAL: Module pcieport not found in directory /lib/modules/6.5.0-17-generic\n"
2024-03-07T16:42:33Z DBG modprobe error="exit status 1" out="modprobe: FATAL: Module efi-framebuffer not found in directory /lib/modules/6.5.0-17-generic\n"
2024-03-07T16:42:33Z DBG modprobe error="exit status 1" out="modprobe: FATAL: Module reg-dummy not found in directory /lib/modules/6.5.0-17-generic\n"
2024-03-07T16:42:33Z DBG modprobe error="exit status 1" out="modprobe: FATAL: Module serial8250 not found in directory /lib/modules/6.5.0-17-generic\n"
2024-03-07T16:42:33Z DBG modprobe error="exit status 1" out="modprobe: FATAL: Module system not found in directory /lib/modules/6.5.0-17-generic\n"
2024-03-07T16:42:33Z DBG modprobe error="exit status 1" out="modprobe: FATAL: Module alarmtimer not found in directory /lib/modules/6.5.0-17-generic\n"
Itxaka commented 7 months ago

From this list Im missing some modules that we explicitly mark to be modprobed.... like the xhci or uas .... what?

Itxaka commented 7 months ago

old immucore version, closing for now.