CCI-MOC / esi

Elastic Secure Infrastructure project
6 stars 12 forks source link

Investigate issue with running update on provisioned nodes #534

Closed tzumainn closed 5 months ago

tzumainn commented 5 months ago

If one runs dnf update on the centos9-stream image or fedora38 image, a reboot will eventually end up with the node hanging and failing to boot.

It's unclear if this happens with other OS's as well. Also testing a whole centos9-stream image, but no updates seem to be necessary there at the moment.

tzumainn commented 5 months ago

centos-image (which is a badly name centos8-stream image) seems to work even after running dnf update and rebooting

tzumainn commented 5 months ago

I think this was only an issue with our centos9-stream image, as it didn't happen with the ubuntu or centos8-stream images.

I isolated the issue to an update to the kernel. Using the centos9-stream-whole (non-partition) image, I was able to provision, downgrade the kernel, and re-upgrade the kernel without issues. I've removed the centos9-stream image and replaced it with the centos9-stream-whole image.