coreos / coreos-assembler

Tooling container to assemble CoreOS-like systems
https://coreos.github.io/coreos-assembler/
Apache License 2.0
330 stars 165 forks source link

4K UEFI PXE tests failing #3815

Closed yasminvalim closed 1 month ago

yasminvalim commented 1 month ago

We are facing an issue running FCOS pipeline across all streams. The failure happens during the test ISO phase.

You can check this here: stable, testing and next.


[2024-06-03T22:53:15.279Z] Running test: pxe-offline-install.4k.uefi
[2024-06-03T23:03:21.890Z] FAIL: pxe-offline-install.4k.uefi (10m0.005s)
[2024-06-03T23:03:21.890Z]     timed out after 10m0s
[2024-06-03T23:03:21.890Z] Running test: pxe-online-install.bios
[2024-06-03T23:04:43.214Z] PASS: pxe-online-install.bios (1m29.289s)
[2024-06-03T23:04:43.214Z] Running test: pxe-online-install.4k.uefi
[2024-06-03T23:14:49.808Z] FAIL: pxe-online-install.4k.uefi (10m0.001s)
[2024-06-03T23:14:49.808Z]     timed out after 10m0s
[2024-06-03T23:14:49.808Z] Error: harness: test suite failed
[2024-06-03T23:14:49.808Z] 2024-06-03T23:14:43Z cli: harness: test suite failed
[2024-06-03T23:14:49.808Z] failed to execute cmd-kola: exit status 1
Archive JUnit-formatted test results
<1s
[2024-06-03T23:14:53.710Z] Recording test results

Currently, this failures are blocking FCOS Releases.

jlebon commented 1 month ago

You can see the actual error in the logs:

Loading kernel
error: ../../grub-core/net/net.c:1801:timeout reading
`/fedora-coreos-40.20240603.dev.0-live-kernel-x86_64'.

First thing I'd check is whether GRUB was updated recently in cosa and if so, whether reverting to the older GRUB version makes the tests pass.

jlebon commented 1 month ago

Let's keep this open to track the actual fix for this. Yasmin filed https://bugzilla.redhat.com/show_bug.cgi?id=2290441.