coreos / fedora-coreos-tracker

Issue tracker for Fedora CoreOS
https://fedoraproject.org/coreos/
264 stars 59 forks source link

[rawhide][x86_64] kola test multipath.partition failure #1840

Open aaradhak opened 1 day ago

aaradhak commented 1 day ago

Describe the bug

The kola test multipath.partition failed due to timeout in the latest rawhide build.

[2024-11-20T13:21:16.598Z] --- FAIL: multipath.partition (602.85s)
[2024-11-20T13:21:16.598Z]         harness.go:106: TIMEOUT[10m0s]: SSH unsuccessful within allotted timeframe for b781db22-3826-4b8c-81a2-b592050e3dfb.
[2024-11-20T13:21:16.598Z] FAIL, output in /home/jenkins/agent/workspace/build/tmp/kola-pwjOj/kola/rerun
[2024-11-20T13:21:16.598Z] Error: harness: test suite failed
[2024-11-20T13:21:16.598Z] 2024-11-20T13:21:02Z cli: harness: test suite failed
[2024-11-20T13:21:16.598Z] failed to execute cmd-kola: exit status 1

The test failure seems to be occurring after the kernel upgrade from kernel 6.12.0-0.rc7.59.fc42 →> 6.13.0-0.rc0.20241119git158f238aa69d.2. fc42

kernel 6.12.0-0.rc7.59.fc42 →> 6.13.0-0.rc0.20241119git158f238aa69d.2. fc42
kernel-core 6.12.0-0.rc7.59.fc42 -> 6.13.0-0.rc0.20241119git158f238aa69d.2.fc42 
kernel-modules 6.12.0-0.rc7.59.fc42 -> 6.13.0-0.rc0.20241119git158f238aa69d.2.fc42
kernel-modules-core 6.12.0-0.rc7.59.fc42 -> 6.13.0-0.rc0.20241119git158f238aa69d.2.fc42

Reproduction steps

git checkout rawhide in fedora-coreos-config cosa fetch && cosa build kola run multipath.partition

Expected behavior

multipath.partition kola test to PASS

Actual behavior

multipath.partition kola test is failing due to TIMEOUT

System details

[rawhide][x86_64]

Butane or Ignition config

No response

Additional information

Console log:


0;31m**] (3 of 3) Job systemd-vconsole-setup…ice/start running (20s / no limit)

0;31m***] (1 of 3) Job dev-mapper-mpatha.devi…tart running (1min 27s / 1min 30s)

0;31m*** ] (1 of 3) Job dev-mapper-mpatha.devi…tart running (1min 28s / 1min 30s)

 0;31m***  ] (1 of 3) Job dev-mapper-mpatha.devi…tart running (1min 28s / 1min 30s)

0;31m***   ] (2 of 3) Job dev-disk-by\x2dlabel-d…tart running (1min 29s / 1min 30s)

 0;1;31m**    ] (2 of 3) Job dev-disk-by\x2dlabel-d…tart running (1min 29s / 1min 30s)

0;1;31m TIME ] Timed out waiting for device dev-d…/disk/by-label/dm-mpath-containers.

0;1;38:5:185mDEPEND] Dependency failed for var-lib-cont….mount - Mount /vaar/lib/containers.

0;1;31m TIME ] Timed out waiting for device dev-m…mpatha.device - /dev/mapper/mpatha.

[[0;1;38:5:185mDEPEND] Dependency failed for mpath-var-li…p Multipath On /var/lib/containers.

[  OK  ] Reached target local-fs.target - Local File Systems.

[  OK  ] Listening on systemd-bootctl.socket - Boot Entries Service Socket.

[  OK  ] Listening on systemd-sysext.socket… System Extension Image Management.

[  OK  ] Reached target first-boot-complete.target - First Boot Complete.

 Starting systemd-machine-id-commit…ave Transient machine-id to Disk...

  Starting systemd-tmpfiles-setup.se…ate System Files and Directories...

[*     ] (2 of 3) Job systemd-machine-id-com…ce/start running (1min 59s / 3min)


0;1;31m**    ] (3 of 3) Job systemd-vconsole-setup…ice/start running (52s / no limit)

console.txt

aaradhak commented 1 day ago

Override PR - https://github.com/coreos/fedora-coreos-config/pull/3269

dustymabe commented 1 day ago

Override PR - coreos/fedora-coreos-config#3269

A different override PR with a slightly newer (but still working) kernel: https://github.com/coreos/fedora-coreos-config/pull/3270