kata-containers / runtime

Kata Containers version 1.x runtime (for version 2.x see https://github.com/kata-containers/kata-containers).
https://katacontainers.io/
Apache License 2.0
2.1k stars 376 forks source link

firecracker: kernel log errors #1450

Closed devimc closed 3 years ago

devimc commented 5 years ago

Following kernel errors are logged in firecracker

[    0.060774] ACPI BIOS Error (bug): A valid RSDP was not found (20180810/tbxfroot-210)
[    0.238588] PCI: Fatal: No config space access function found
sboeuf commented 5 years ago

@devimc you need pci=off as part of the kernel command line with Firecracker, since they don't have PCI emulation.

devimc commented 5 years ago

@sboeuf should this kernel parameter be part of kata-runtime? I don't see it in the fc.go file

devimc commented 5 years ago

@sboeuf this param didn't work

cat /proc/cmdline

init=/usr/lib/systemd/systemd systemd.unit=kata-containers.target systemd.mask=systemd-networkd.service systemd.mask=systemd-networkd.socket systemd.mask=systemd-journald.service systemd.mask=systemd-journald.socket systemd.mask=systemd-journal-flush.service systemd.mask=systemd-udevd.service systemd.mask=systemd-udevd.socket systemd.mask=systemd-udev-trigger.service systemd.mask=systemd-timesyncd.service systemd.mask=systemd-update-utmp.service systemd.mask=systemd-tmpfiles-setup.service systemd.mask=systemd-tmpfiles-cleanup.service systemd.mask=systemd-tmpfiles-cleanup.timer systemd.mask=tmp.mount systemd.mask=systemd-random-seed.service pci=off root=/dev/vda1 virtio_mmio.device=4K@0xd0000000:5 virtio_mmio.device=4K@0xd0001000:6 virtio_mmio.device=4K@0xd0002000:7 virtio_mmio.device=4K@0xd0003000:8 virtio_mmio.device=4K@0xd0004000:9 virtio_mmio.device=4K@0xd0005000:10 virtio_mmio.device=4K@0xd0006000:11 virtio_mmio.device=4K@0xd0007000:12 virtio_mmio.device=4K@0xd0008000:13 virtio_mmio.device=4K@0xd0009000:14 virtio_mmio.device=4K@0xd000a000:15

sboeuf commented 5 years ago

@devimc I would have expected this param to be part of fc.go file.

What do you mean this param didn't work? Did you get the exact same error?

devimc commented 5 years ago

@sboeuf yes, same error

sboeuf commented 5 years ago

@devimc could you please post the entire kernel logs? Maybe something happened before those two lines.

Also one thing to note, Firecracker does not support ACPI, so try using acpi=off too, as it might prevent the kernel from failing.

devimc commented 5 years ago

@sboeuf with acpi=off the ACPI error has gone, but the PCI error is still there

[    0.000000] Linux version 4.19.28 (juliomon@test-fc) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC)) #1 SMP Thu Mar 21 20:39:02 UTC 2019
[    0.000000] Command line: init=/usr/lib/systemd/systemd systemd.unit=kata-containers.target systemd.mask=systemd-networkd.service systemd.mask=systemd-networkd.socket systemd.mask=systemd-journald.service systemd.mask=systemd-journald.socket systemd.mask=systemd-journal-flush.service systemd.mask=systemd-udevd.service systemd.mask=systemd-udevd.socket systemd.mask=systemd-udev-trigger.service systemd.mask=systemd-timesyncd.service systemd.mask=systemd-update-utmp.service systemd.mask=systemd-tmpfiles-setup.service systemd.mask=systemd-tmpfiles-cleanup.service systemd.mask=systemd-tmpfiles-cleanup.timer systemd.mask=tmp.mount systemd.mask=systemd-random-seed.service pci=off acpi=off root=/dev/vda1 virtio_mmio.device=4K@0xd0000000:5 virtio_mmio.device=4K@0xd0001000:6 virtio_mmio.device=4K@0xd0002000:7 virtio_mmio.device=4K@0xd0003000:8 virtio_mmio.device=4K@0xd0004000:9 virtio_mmio.device=4K@0xd0005000:10 virtio_mmio.device=4K@0xd0006000:11 virtio_mmio.device=4K@0xd0007000:12 virtio_mmio.
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000007ffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] Hypervisor detected: KVM
[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[    0.062562] kvm-clock: cpu 0, msr 24b6001, primary cpu clock
[    0.062563] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    0.062644] tsc: Detected 2394.472 MHz processor
[    0.064626] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.064628] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.064631] last_pfn = 0x8000 max_arch_pfn = 0x400000000
[    0.065352] MTRR default type: uncachable
[    0.065353] MTRR fixed ranges disabled:
[    0.065355]   00000-FFFFF uncachable
[    0.065355] MTRR variable ranges disabled:
[    0.065356]   0 disabled
[    0.065356]   1 disabled
[    0.065356]   2 disabled
[    0.065356]   3 disabled
[    0.065357]   4 disabled
[    0.065357]   5 disabled
[    0.065357]   6 disabled
[    0.065357]   7 disabled
[    0.065546] Disabled
[    0.065728] CPU MTRRs all blank - virtualized system.
[    0.065760] x86/PAT: Configuration [0-7]: WB  WT  UC- UC  WB  WT  UC- UC  
[    0.065961] found SMP MP-table at [mem 0x0009fc00-0x0009fc0f] mapped at [(____ptrval____)]
[    0.066239] Base memory trampoline at [(____ptrval____)] 99000 size 24576
[    0.066313] Using GB pages for direct mapping
[    0.066437] BRK [0x02600000, 0x02600fff] PGTABLE
[    0.066440] BRK [0x02601000, 0x02601fff] PGTABLE
[    0.066441] BRK [0x02602000, 0x02602fff] PGTABLE
[    0.067069] Zone ranges:
[    0.067139]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.067142]   DMA32    [mem 0x0000000001000000-0x0000000007ffffff]
[    0.067143]   Normal   empty
[    0.067175]   Device   empty
[    0.067177] Movable zone start for each node
[    0.067178] Early memory node ranges
[    0.067179]   node   0: [mem 0x0000000000001000-0x000000000009efff]
[    0.067179]   node   0: [mem 0x0000000000100000-0x0000000007ffffff]
[    0.067288] Reserved but unavailable: 98 pages
[    0.067325] Initmem setup node 0 [mem 0x0000000000001000-0x0000000007ffffff]
[    0.067329] On node 0 totalpages: 32670
[    0.067366]   DMA zone: 64 pages used for memmap
[    0.067367]   DMA zone: 21 pages reserved
[    0.067404]   DMA zone: 3998 pages, LIFO batch:0
[    0.069751]   DMA32 zone: 448 pages used for memmap
[    0.069753]   DMA32 zone: 28672 pages, LIFO batch:7
[    0.095535] Intel MultiProcessor Specification v1.4
[    0.095539] MPTABLE: OEM ID: FC      
[    0.095539] MPTABLE: Product ID: 000000000000
[    0.095540] MPTABLE: APIC at: 0xFEE00000
[    0.095652] Processor #0 (Bootup-CPU)
[    0.095964] IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23
[    0.095968] Processors: 1
[    0.095999] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
[    0.096273] [mem 0x08000000-0xffffffff] available for PCI devices
[    0.096275] Booting paravirtualized kernel on KVM
[    0.096277] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.177901] setup_percpu: NR_CPUS:240 nr_cpumask_bits:240 nr_cpu_ids:1 nr_node_ids:1
[    0.206702] percpu: Embedded 42 pages/cpu @(____ptrval____) s132888 r8192 d30952 u2097152
[    0.206828] pcpu-alloc: s132888 r8192 d30952 u2097152 alloc=1*2097152
[    0.206830] pcpu-alloc: [0] 0 
[    0.206913] KVM setup async PF for cpu 0
[    0.206976] kvm-stealtime: cpu 0, msr 7814e80
[    0.207089] Built 1 zonelists, mobility grouping on.  Total pages: 32137
[    0.207093] Kernel command line: init=/usr/lib/systemd/systemd systemd.unit=kata-containers.target systemd.mask=systemd-networkd.service systemd.mask=systemd-networkd.socket systemd.mask=systemd-journald.service systemd.mask=systemd-journald.socket systemd.mask=systemd-journal-flush.service systemd.mask=systemd-udevd.service systemd.mask=systemd-udevd.socket systemd.mask=systemd-udev-trigger.service systemd.mask=systemd-timesyncd.service systemd.mask=systemd-update-utmp.service systemd.mask=systemd-tmpfiles-setup.service systemd.mask=systemd-tmpfiles-cleanup.service systemd.mask=systemd-tmpfiles-cleanup.timer systemd.mask=tmp.mount systemd.mask=systemd-random-seed.service pci=off acpi=off root=/dev/vda1 virtio_mmio.device=4K@0xd0000000:5 virtio_mmio.device=4K@0xd0001000:6 virtio_mmio.device=4K@0xd0002000:7 virtio_mmio.device=4K@0xd0003000:8 virtio_mmio.device=4K@0xd0004000:9 virtio_mmio.device=4K@0xd0005000:10 virtio_mmio.device=4K@0xd0006000:11 virtio_mmio.device=4K@0xd0007000:12 virti
[    0.209915] Dentry cache hash table entries: 16384 (order: 5, 131072 bytes)
[    0.210564] Inode-cache hash table entries: 8192 (order: 4, 65536 bytes)
[    0.211434] Memory: 105588K/130680K available (10248K kernel code, 630K rwdata, 2892K rodata, 844K init, 1384K bss, 25092K reserved, 0K cma-reserved)
[    0.212011] Kernel/User page tables isolation: enabled
[    0.213136] rcu: Hierarchical RCU implementation.
[    0.213139] rcu:     RCU restricting CPUs from NR_CPUS=240 to nr_cpu_ids=1.
[    0.213142] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1
[    0.213322] NR_IRQS: 15616, nr_irqs: 256, preallocated irqs: 16
[    0.213974] rcu:     Offload RCU callbacks from CPUs: (none).
[    0.214828] Console: colour dummy device 132x25
[    0.214926] console [tty0] enabled
[    0.215144] APIC: Switch to symmetric I/O mode setup
[    0.218765] x2apic enabled
[    0.222353] Switched APIC routing to physical x2apic.
[    0.238134] ..TIMER: vector=0x30 apic1=0 pin1=0 apic2=-1 pin2=-1
[    0.238387] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2283d1a10f2, max_idle_ns: 440795323121 ns
[    0.238393] Calibrating delay loop (skipped) preset value.. 4788.94 BogoMIPS (lpj=2394472)
[    0.238396] pid_max: default: 32768 minimum: 301
[    0.240923] Security Framework initialized
[    0.241083] Mount-cache hash table entries: 512 (order: 0, 4096 bytes)
[    0.241128] Mountpoint-cache hash table entries: 512 (order: 0, 4096 bytes)
[    0.246170] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[    0.246175] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[    0.246274] Spectre V2 : Mitigation: Full generic retpoline
[    0.246277] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.246279] Spectre V2 : Enabling Restricted Speculation for firmware calls
[    0.246282] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    0.246286] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.304091] Freeing SMP alternatives memory: 32K
[    0.308741] TSC deadline timer enabled
[    0.308787] smpboot: CPU0: Intel(R) Xeon(R) Processor @ 2.40GHz (family: 0x6, model: 0x3c, stepping: 0x3)
[    0.310363] Performance Events: unsupported p6 CPU model 60 no PMU driver, software events only.
[    0.311107] rcu: Hierarchical SRCU implementation.
[    0.312483] smp: Bringing up secondary CPUs ...
[    0.312487] smp: Brought up 1 node, 1 CPU
[    0.312489] smpboot: Max logical packages: 1
[    0.312490] smpboot: Total of 1 processors activated (4788.94 BogoMIPS)
[    0.313738] devtmpfs: initialized
[    0.314013] x86/mm: Memory block size: 128MB
[    0.315192] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    0.315198] futex hash table entries: 256 (order: 2, 16384 bytes)
[    0.317156] NET: Registered protocol family 16
[    0.318106] cpuidle: using governor menu
[    0.318273] PCI: Fatal: No config space access function found
[    0.322853] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    0.322857] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.324458] cryptd: max_cpu_qlen set to 1000
[    0.325323] ACPI: Interpreter disabled.
[    0.326059] SCSI subsystem initialized
[    0.326150] pps_core: LinuxPPS API ver. 1 registered
[    0.326153] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.326156] PTP clock support registered
[    0.326157] PCI: System does not support PCI
[    0.327009] clocksource: Switched to clocksource kvm-clock
[    0.327042] pnp: PnP ACPI: disabled
[    0.332772] NET: Registered protocol family 2
[    0.334256] tcp_listen_portaddr_hash hash table entries: 256 (order: 0, 4096 bytes)
[    0.334462] TCP established hash table entries: 1024 (order: 1, 8192 bytes)
[    0.334673] TCP bind hash table entries: 1024 (order: 2, 16384 bytes)
[    0.334943] TCP: Hash tables configured (established 1024 bind 1024)
[    0.336312] UDP hash table entries: 256 (order: 1, 8192 bytes)
[    0.336509] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[    0.336694] NET: Registered protocol family 1
[    0.336768] PCI: CLS 0 bytes, default 64
[    0.337111] virtio-mmio: Registering device virtio-mmio.0 at 0xd0000000-0xd0000fff, IRQ 5.
[    0.337267] virtio-mmio: Registering device virtio-mmio.1 at 0xd0001000-0xd0001fff, IRQ 6.
[    0.337356] virtio-mmio: Registering device virtio-mmio.2 at 0xd0002000-0xd0002fff, IRQ 7.
[    0.337364] virtio-mmio: Registering device virtio-mmio.3 at 0xd0003000-0xd0003fff, IRQ 8.
[    0.337370] virtio-mmio: Registering device virtio-mmio.4 at 0xd0004000-0xd0004fff, IRQ 9.
[    0.337509] virtio-mmio: Registering device virtio-mmio.5 at 0xd0005000-0xd0005fff, IRQ 10.
[    0.337597] virtio-mmio: Registering device virtio-mmio.6 at 0xd0006000-0xd0006fff, IRQ 11.
[    0.337691] virtio-mmio: Registering device virtio-mmio.7 at 0xd0007000-0xd0007fff, IRQ 12.
[    0.337698] virtio-mmio: Registering device virtio-mmio.8 at 0xd0008000-0xd0008fff, IRQ 13.
[    0.337704] virtio-mmio: Registering device virtio-mmio.9 at 0xd0009000-0xd0009fff, IRQ 14.
[    0.337791] virtio-mmio: Registering device virtio-mmio.10 at 0xd000a000-0xd000afff, IRQ 15.
[    0.337980] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2283d1a10f2, max_idle_ns: 440795323121 ns
[    0.337994] platform rtc_cmos: registered platform RTC device (no PNP device found)
[    0.340645] workingset: timestamp_bits=46 max_order=15 bucket_order=0
[    0.341626] SGI XFS with security attributes, no debug enabled
[    0.345656] 9p: Installing v9fs 9p2000 file system support
[    0.350057] NET: Registered protocol family 38
[    0.350073] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249)
[    0.350079] io scheduler noop registered
[    0.350081] io scheduler deadline registered (default)
[    0.350092] io scheduler cfq registered
[    0.350093] io scheduler mq-deadline registered (default)
[    0.350095] io scheduler kyber registered
[    0.350301] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    0.350828] virtio-mmio virtio-mmio.0: Failed to enable 64-bit or 32-bit DMA.  Trying to continue, but this might not work.
[    0.351296] virtio-mmio virtio-mmio.1: Failed to enable 64-bit or 32-bit DMA.  Trying to continue, but this might not work.
[    0.351762] virtio-mmio virtio-mmio.2: Failed to enable 64-bit or 32-bit DMA.  Trying to continue, but this might not work.
[    0.352257] virtio-mmio virtio-mmio.3: Failed to enable 64-bit or 32-bit DMA.  Trying to continue, but this might not work.
[    0.352758] virtio-mmio virtio-mmio.4: Failed to enable 64-bit or 32-bit DMA.  Trying to continue, but this might not work.
[    0.353157] virtio-mmio virtio-mmio.5: Failed to enable 64-bit or 32-bit DMA.  Trying to continue, but this might not work.
[    0.353615] virtio-mmio virtio-mmio.6: Failed to enable 64-bit or 32-bit DMA.  Trying to continue, but this might not work.
[    0.354108] virtio-mmio virtio-mmio.7: Failed to enable 64-bit or 32-bit DMA.  Trying to continue, but this might not work.
[    0.354615] virtio-mmio virtio-mmio.8: Failed to enable 64-bit or 32-bit DMA.  Trying to continue, but this might not work.
[    0.355018] virtio-mmio virtio-mmio.9: Failed to enable 64-bit or 32-bit DMA.  Trying to continue, but this might not work.
[    0.355523] virtio-mmio virtio-mmio.10: Failed to enable 64-bit or 32-bit DMA.  Trying to continue, but this might not work.
[    0.355878] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
[    0.399001] serial8250: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a U6_16550A
[    0.441389] serial8250: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a U6_16550A
[    0.483947] serial8250: ttyS2 at I/O 0x3e8 (irq = 4, base_baud = 115200) is a U6_16550A
[    0.492931] brd: module loaded
[    0.521810] loop: module loaded
[    0.527026] virtio_blk virtio0: [vda] 262144 512-byte logical blocks (134 MB/128 MiB)
[    0.528500]  vda: vda1
[    0.534252] virtio_blk virtio1: [vdb] 0 512-byte logical blocks (0 B/0 B)
[    0.540503] virtio_blk virtio2: [vdc] 0 512-byte logical blocks (0 B/0 B)
[    0.547104] virtio_blk virtio3: [vdd] 0 512-byte logical blocks (0 B/0 B)
[    0.554028] virtio_blk virtio4: [vde] 0 512-byte logical blocks (0 B/0 B)
[    0.560978] virtio_blk virtio5: [vdf] 0 512-byte logical blocks (0 B/0 B)
[    0.566593] virtio_blk virtio6: [vdg] 0 512-byte logical blocks (0 B/0 B)
[    0.571843] virtio_blk virtio7: [vdh] 0 512-byte logical blocks (0 B/0 B)
[    0.577509] virtio_blk virtio8: [vdi] 0 512-byte logical blocks (0 B/0 B)
[    0.579269] tun: Universal TUN/TAP device driver, 1.6
[    0.583790] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k
[    0.583793] ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[    0.584246] ixgbevf: Intel(R) 10 Gigabit PCI Express Virtual Function Network Driver - version 4.1.0-k
[    0.584249] ixgbevf: Copyright (c) 2009 - 2015 Intel Corporation.
[    0.584557] i40e: Intel(R) Ethernet Connection XL710 Network Driver - version 2.3.2-k
[    0.584559] i40e: Copyright (c) 2013 - 2014 Intel Corporation.
[    0.584817] i40evf: Intel(R) 40-10 Gigabit Virtual Function Network Driver - version 3.2.2-k
[    0.584820] Copyright (c) 2013 - 2015 Intel Corporation.
[    0.585463] VFIO - User Level meta-driver version: 0.3
[    0.586312] IR NEC protocol handler initialized
[    0.586315] IR RC5(x/sz) protocol handler initialized
[    0.586316] IR RC6 protocol handler initialized
[    0.586318] IR JVC protocol handler initialized
[    0.586319] IR Sony protocol handler initialized
[    0.586320] IR SANYO protocol handler initialized
[    0.586321] IR Sharp protocol handler initialized
[    0.586322] IR MCE Keyboard/mouse protocol handler initialized
[    0.586323] IR XMP protocol handler initialized
[    0.586454] device-mapper: ioctl: 4.39.0-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[    0.588970] xt_time: kernel timezone is -0000
[    0.589052] IPVS: Registered protocols (TCP, UDP, SCTP, AH, ESP)
[    0.589067] IPVS: Connection hash table configured (size=4096, memory=64Kbytes)
[    0.589911] random: get_random_bytes called from ip_vs_conn_init+0xfa/0x103 with crng_init=0
[    0.590070] IPVS: ipvs loaded.
[    0.590073] IPVS: [rr] scheduler registered.
[    0.590074] IPVS: [wrr] scheduler registered.
[    0.590075] IPVS: [lc] scheduler registered.
[    0.590076] IPVS: [wlc] scheduler registered.
[    0.590078] IPVS: [fo] scheduler registered.
[    0.590079] IPVS: [ovf] scheduler registered.
[    0.590083] IPVS: [lblc] scheduler registered.
[    0.590085] IPVS: [lblcr] scheduler registered.
[    0.590086] IPVS: [dh] scheduler registered.
[    0.590087] IPVS: [sh] scheduler registered.
[    0.590089] IPVS: [sed] scheduler registered.
[    0.590090] IPVS: [nq] scheduler registered.
[    0.590093] IPVS: ftp: loaded support on port[0] = 21
[    0.590094] IPVS: [sip] pe registered.
[    0.590589] ipt_CLUSTERIP: ClusterIP Version 0.8 loaded successfully
[    0.590599] Initializing XFRM netlink socket
[    0.590792] NET: Registered protocol family 10
[    0.592777] Segment Routing with IPv6
[    0.592929] NET: Registered protocol family 17
[    0.593017] 9pnet: Installing 9P2000 support
[    0.597652] NET: Registered protocol family 40
[    0.613522] registered taskstats version 1
[    0.641325] EXT4-fs (vda1): recovery complete
[    0.641948] EXT4-fs (vda1): mounted filesystem with ordered data mode. Opts: (null)
[    0.641961] VFS: Mounted root (ext4 filesystem) on device 254:1.
[    0.643019] devtmpfs: mounted
[    0.647968] Freeing unused kernel image memory: 844K
[    0.649584] Write protecting the kernel read-only data: 16384k
[    0.680527] Freeing unused kernel image memory: 2016K
[    0.698981] Freeing unused kernel image memory: 1204K
[    0.699056] Run /usr/lib/systemd/systemd as init process
[    0.711088] random: fast init done
[    1.068296] systemd[1]: systemd 241 running in system mode. (+PAM -AUDIT -SELINUX +IMA -APPARMOR -SMACK -SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=legacy)
[    1.068392] systemd[1]: Detected virtualization kvm.
[    1.068470] systemd[1]: Detected architecture x86-64.
[    1.670856] systemd[1]: File /usr/lib/systemd/system/systemd-coredump@.service:11 configures an IP firewall (IPAddressDeny=any), but the local system does not support BPF/cgroup based firewalling.
[    1.670867] systemd[1]: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.)
[    1.674111] systemd[1]: Listening on Process Core Dump Socket.
[    1.674363] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[    1.674559] systemd[1]: Condition check resulted in Create list of required static device nodes for the current kernel being skipped.
[    1.674571] systemd[1]: systemd-journald-dev-log.socket: Socket service systemd-journald.service not loaded, refusing.
[    1.674575] systemd[1]: Failed to listen on Journal Socket (/dev/log).
[    1.678915] systemd[76]: systemd-sysctl.service: Failed to connect stdout to the journal socket, ignoring: No such file or directory
[    1.696878] systemd-sysctl[76]: Couldn't write '16' to 'kernel/sysrq', ignoring: No such file or directory
[    2.487553] virtio_blk virtio1: [vdb] new size: 0 512-byte logical blocks (0 B/0 B)
[    2.487898] virtio_blk virtio1: [vdb] new size: 0 512-byte logical blocks (0 B/0 B)
[    2.527136] XFS (vdb): Mounting V4 Filesystem
[    2.635703] XFS (vdb): Ending clean mount
sboeuf commented 5 years ago

The PCI error does not cause any panic, and the kernel boots properly. All the virtio-blk drivers are loaded properly and they get assigned with vda, vdb, ... We can see that vda has one partition vda1 as we expected through the kernel command line by providing root=/dev/vda1, which results in systemd being started as init.

Now I have never really used FC with Kata, and I'm wondering if we're not supposed to use the initramfs image instead of the systemd image in this case, because systemd might be doing some weird things that are not supported by Firecracker

sboeuf commented 5 years ago

We need @egernst and @mcastelino feedback here.

mcastelino commented 5 years ago

@devimc does this impact any runtime functionality? Will look at this as part of the fc rebase.