nested virtualization does not work on multiarch

jbtrystram commented 10 months ago

Describe the enhancement

I want to create a VM within a coreOS VM, on aarch64 (s390x and ppc64le as well)

Steps to reproduce the issue :

# Build fedora coreOS as usual

$ cosa run 
 # Now we are in coreOS VM
cd /mnt/workdir 
podman pull quay.io/coreos-assembler/coreos-assembler
 # make sure we import cosa alias
$ cosa run 
+ podman run --rm -ti --security-opt=label=disable --privileged --uidmap=1000:0:1 --uidmap=0:1:1000 --uidmap=1001:1001:64536 -v=/mnt/workdir:/srv/ --device=/dev/kvm --device=/dev/fuse --tmpfs=/tmp -v=/var/tmp:/var/tmp --name=cosa quay.io/coreos-assembler/coreos-assembler:latest run
Could not access KVM kernel module: No such file or directory
qemu-system-aarch64: failed to initialize kvm: No such file or directory

System details

Debug bod from FCOS pipeline on aarch64

Additional information

S390X appears to be the same : Could not access KVM kernel module: No such device qemu-system-s390x: failed to initialize kvm: No such device

Same on ppc64le

jlebon commented 10 months ago

Can you confirm the outer VM is running with -cpu host?

Short-term WDYT about denylisting the test on !x86_64 for now (using this issue as the tracker)?

jbtrystram commented 10 months ago

Can you confirm the outer VM is running with -cpu host?

I will look into that

Short-term WDYT about denylisting the test on !x86_64 for now (using this issue as the tracker)?

I was looking for the proper syntax and it looks like testiso ignore that setting https://github.com/openshift/os/blob/9ec57e837968e55a695ae12af5d90e4ce52e1fdf/kola-denylist.yaml#L57C3-L59C14

dustymabe commented 8 months ago

@jbtrystram can you update this? does this issue need to stay open?

jbtrystram commented 8 months ago

The iscsi test are still not enabled due to this. I haven't put any work on this yet, so this is still an issue

jlebon commented 1 month ago

~Related to this, apparently the iBFT kernel module isn't enabled in the Fedora/RHEL kernel on non-x86_64 currently:~

~Internal request to change that: https://issues.redhat.com/browse/RHEL-62740~

Edit: apparently this is by design; that kernel module isn't used on aarch64 for iBFT.

coreos / fedora-coreos-tracker