astro / microvm.nix

NixOS MicroVMs
https://astro.github.io/microvm.nix/
MIT License
1.24k stars 93 forks source link

Systemd Networkd service not starting in VM, exits with file not found #237

Closed Bert-Proesmans closed 4 months ago

Bert-Proesmans commented 4 months ago

Hi, I'm building out a declarative microVM and it turns out there is an issue with some services that do not want to start within the VM. I've been researching symptoms for 8 hours but cannot find the culprit. At this point I'm still testing out what microvm entails, the referenced configuration is for a single hypervisor and a single vm to test the virtualization software and configuration options. The host is an AMD system; AMD Athlon 200GE + 16GB DDR3 + ~10GiB usable storage on ZFS.

The specific error for this topic comes from the systemd-networkd.service journal log inside the vm:

systemd-networkd.service: Failed to execute /nix/store/y6mag03hj8b2hnlcj682xvp2aid7yg7y-systemd-255.4/lib/systemd/systemd-networkd: Operation not supported
systemd-networkd.service: Main process exited, code=exited, status=203/EXEC

This seems to indicate that the binary is not found at the provided path, but other files and binaries appear to exist just fine. For example the debugging service "my-cool-user-service-start" executes just fine. The systemd-networkd binary file is there when I navigate the host filesystem, it's a ~2M binary file.

Since I don't really understand virtiofs I've tried giving the VM a GB more RAM but that did not resolve the issue. There are seemingly no (relevant) errors in the host's journal.

The configuration is derived from the "Declarative MicroVMs" + "A simple network setup" documentation pages, with shares on top of a ZFS pool with the purpose of serving technitium DNS.

full vm boot log ```txt mei 01 20:47:36 buddy systemd[1]: Starting MicroVM 'technitium-debug'... mei 01 20:47:36 buddy systemd[1]: Started MicroVM 'technitium-debug'. mei 01 20:47:36 buddy microvm@technitium-debug[3476]: [73B blob data] mei 01 20:47:36 buddy microvm@technitium-debug[3476]: Booting from ROM... mei 01 20:47:36 buddy microvm@technitium-debug[3476]: PPrroobbiinngg EEDDDD ((eedddd==ooffff ttoo ddiissaabbllee))...... ook mei 01 20:47:36 buddy microvm@technitium-debug[3476]: [39B blob data] mei 01 20:47:36 buddy microvm@technitium-debug[3476]: early console in extract_kernel mei 01 20:47:36 buddy microvm@technitium-debug[3476]: input_data: 0x00000000038ef2c1 mei 01 20:47:36 buddy microvm@technitium-debug[3476]: input_len: 0x0000000000a5a287 mei 01 20:47:36 buddy microvm@technitium-debug[3476]: output: 0x0000000001000000 mei 01 20:47:36 buddy microvm@technitium-debug[3476]: output_len: 0x00000000032f5dd0 mei 01 20:47:36 buddy microvm@technitium-debug[3476]: kernel_total_size: 0x0000000002830000 mei 01 20:47:36 buddy microvm@technitium-debug[3476]: needed_size: 0x0000000003400000 mei 01 20:47:36 buddy microvm@technitium-debug[3476]: trampoline_32bit: 0x0000000000000000 mei 01 20:47:36 buddy microvm@technitium-debug[3476]: Physical KASLR using RDRAND RDTSC... mei 01 20:47:36 buddy microvm@technitium-debug[3476]: Virtual KASLR using RDRAND RDTSC... mei 01 20:47:36 buddy microvm@technitium-debug[3476]: mei 01 20:47:36 buddy microvm@technitium-debug[3476]: Decompressing Linux... No EFI environment detected. mei 01 20:47:37 buddy microvm@technitium-debug[3476]: Parsing ELF... Performing relocations... done. mei 01 20:47:37 buddy microvm@technitium-debug[3476]: Booting the kernel (entry_offset: 0x0000000000000080). mei 01 20:47:37 buddy microvm@technitium-debug[3476]: [ 0.000000] Linux version 6.6.28 (nixbld@localhost) (gcc (GCC) 13.2.0, GNU ld (GNU Binutils) 2.41) #1-NixOS SMP PREEMPT_DYNAMIC Wed Apr 17 09:19:38 UTC 2024 mei 01 20:47:37 buddy microvm@technitium-debug[3476]: [ 0.000000] Command line: earlyprintk=ttyS0 console=ttyS0 reboot=t panic=-1 root=fstab loglevel=4 init=/nix/store/igxa6qsk4716719kmmb6gf3a4b5jv7dx-nixos-system-DNS-24.05pre-git/init regInfo=/nix/store/gnbg9kxs3lry2kgmrdc4x8qlwambrhn8-closure-info/registration mei 01 20:47:37 buddy microvm@technitium-debug[3476]: [ 0.000000] BIOS-provided physical RAM map: mei 01 20:47:37 buddy microvm@technitium-debug[3476]: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable mei 01 20:47:37 buddy microvm@technitium-debug[3476]: [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved mei 01 20:47:37 buddy microvm@technitium-debug[3476]: [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved mei 01 20:47:37 buddy microvm@technitium-debug[3476]: [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003fffefff] usable mei 01 20:47:37 buddy microvm@technitium-debug[3476]: [ 0.000000] BIOS-e820: [mem 0x000000003ffff000-0x000000003fffffff] reserved mei 01 20:47:37 buddy microvm@technitium-debug[3476]: [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved mei 01 20:47:37 buddy microvm@technitium-debug[3476]: [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved mei 01 20:47:37 buddy microvm@technitium-debug[3476]: [ 0.000000] printk: bootconsole [earlyser0] enabled mei 01 20:47:37 buddy microvm@technitium-debug[3476]: Memory KASLR using RDRAND RDTSC... mei 01 20:47:37 buddy microvm@technitium-debug[3476]: Poking KASLR using RDRAND RDTSC... mei 01 20:47:38 buddy microvm@technitium-debug[3476]: [ 1.352941] PM: Unable to read current time from RTC mei 01 20:47:38 buddy microvm@technitium-debug[3476]: [ 1.358931] PCI: Fatal: No config space access function found mei 01 20:47:39 buddy microvm@technitium-debug[3476]: mei 01 20:47:39 buddy microvm@technitium-debug[3476]: Welcome to NixOS 24.05 (Uakari) (Initrd)! mei 01 20:47:39 buddy microvm@technitium-debug[3476]: mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Started Dispatch Password Requests to Console Directory Watch. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Initrd Root Device. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Path Units. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Slice Units. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Swaps. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Timer Units. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Listening on Journal Socket (/dev/log). mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Listening on Journal Socket. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Listening on udev Control Socket. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Listening on udev Kernel Socket. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Socket Units. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: Starting Create List of Static Device Nodes... mei 01 20:47:39 buddy microvm@technitium-debug[3476]: Starting Journal Service... mei 01 20:47:39 buddy microvm@technitium-debug[3476]: Starting Load Kernel Modules... mei 01 20:47:39 buddy microvm@technitium-debug[3476]: Starting Create Static Device Nodes in /dev... mei 01 20:47:39 buddy microvm@technitium-debug[3476]: Starting Coldplug All udev Devices... mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Finished Create List of Static Device Nodes. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Finished Create Static Device Nodes in /dev. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Preparation for Local File Systems. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Local File Systems. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: Mounting /sysroot... mei 01 20:47:39 buddy microvm@technitium-debug[3476]: Starting Rule-based Manager for Device Events and Files... mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Started Journal Service. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: Starting Create Volatile Files and Directories... mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Mounted /sysroot. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Initrd Root File System. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: Starting Mountpoints Configured in the Real Root... mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Finished Create Volatile Files and Directories. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Started Rule-based Manager for Device Events and Files. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Finished Load Kernel Modules. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Finished Coldplug All udev Devices. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: Mounting /sysroot/nix/.ro-store... mei 01 20:47:39 buddy microvm@technitium-debug[3476]: Starting Apply Kernel Variables... mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Mounted /sysroot/nix/.ro-store. mei 01 20:47:39 buddy microvm@technitium-debug[3476]: Mounting /sysroot/nix/store... mei 01 20:47:39 buddy microvm@technitium-debug[3476]: [ OK ] Finished Apply Kernel Variables. mei 01 20:47:41 buddy microvm@technitium-debug[3476]: [ OK ] Reached target System Initialization. mei 01 20:47:41 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Basic System. mei 01 20:47:41 buddy microvm@technitium-debug[3476]: [ OK ] Finished Mountpoints Configured in the Real Root. mei 01 20:47:41 buddy microvm@technitium-debug[3476]: [ OK ] Mounted /sysroot/nix/store. mei 01 20:47:41 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Initrd File Systems. mei 01 20:47:41 buddy microvm@technitium-debug[3476]: Starting NixOS Activation... mei 01 20:47:41 buddy microvm@technitium-debug[3476]: Starting Virtual Console Setup... mei 01 20:47:41 buddy microvm@technitium-debug[3476]: [ OK ] Finished Virtual Console Setup. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Finished NixOS Activation. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Initrd Default Target. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: Starting Cleaning Up and Shutting Down Daemons... mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Finished Cleaning Up and Shutting Down Daemons. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped target Initrd Default Target. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped target Basic System. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped target Initrd Root Device. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped target Path Units. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped target Slice Units. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped target Socket Units. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped target System Initialization. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped target Swaps. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped target Timer Units. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped Create List of Static Device Nodes. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped Apply Kernel Variables. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped Create Volatile Files and Directories. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped target Local File Systems. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped target Preparation for Local File Systems. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped Coldplug All udev Devices. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: Stopping Rule-based Manager for Device Events and Files... mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped Virtual Console Setup. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped Rule-based Manager for Device Events and Files. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Closed udev Control Socket. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Closed udev Kernel Socket. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: Starting Cleanup udev Database... mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Stopped Create Static Device Nodes in /dev. mei 01 20:47:42 buddy microvm@technitium-debug[3476]: [ OK ] Finished Cleanup udev Database. mei 01 20:47:43 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Switch Root. mei 01 20:47:43 buddy microvm@technitium-debug[3476]: Starting Switch Root... mei 01 20:47:43 buddy microvm@technitium-debug[3476]: mei 01 20:47:43 buddy microvm@technitium-debug[3476]: Welcome to NixOS 24.05 (Uakari)! mei 01 20:47:43 buddy microvm@technitium-debug[3476]: mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Stopped initrd-switch-root.service. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Created slice Slice /system/getty. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Created slice Slice /system/modprobe. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Created slice Slice /system/serial-getty. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Created slice User and Session Slice. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Started Dispatch Password Requests to Console Directory Watch. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Started Forward Password Requests to Wall Directory Watch. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: Expecting device /dev/ttyS0... mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Local Encrypted Volumes. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Stopped target initrd-fs.target. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Stopped target initrd-root-fs.target. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Stopped target initrd-switch-root.target. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Containers. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Path Units. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Remote File Systems. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Slice Units. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Swaps. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Listening on Process Core Dump Socket. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Listening on Network Service Netlink Socket. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Listening on Userspace Out-Of-Memory (OOM) Killer Socket. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Listening on udev Control Socket. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: [ OK ] Listening on udev Kernel Socket. mei 01 20:47:44 buddy microvm@technitium-debug[3476]: Mounting Huge Pages File System... mei 01 20:47:44 buddy microvm@technitium-debug[3476]: Mounting POSIX Message Queue File System... mei 01 20:47:44 buddy microvm@technitium-debug[3476]: Mounting Kernel Debug File System... mei 01 20:47:44 buddy microvm@technitium-debug[3476]: Starting Firewall... mei 01 20:47:44 buddy microvm@technitium-debug[3476]: Starting Create List of Static Device Nodes... mei 01 20:47:44 buddy microvm@technitium-debug[3476]: Starting Load Kernel Module configfs... mei 01 20:47:44 buddy microvm@technitium-debug[3476]: Starting Load Kernel Module drm... mei 01 20:47:44 buddy microvm@technitium-debug[3476]: Starting Load Kernel Module efi_pstore... mei 01 20:47:44 buddy microvm@technitium-debug[3476]: Starting Load Kernel Module fuse... mei 01 20:47:44 buddy microvm@technitium-debug[3476]: Starting Create SUID/SGID Wrappers... mei 01 20:47:44 buddy microvm@technitium-debug[3476]: Starting Journal Service... mei 01 20:47:44 buddy microvm@technitium-debug[3476]: Starting Remount Root and Kernel File Systems... mei 01 20:47:44 buddy microvm@technitium-debug[3476]: Starting Apply Kernel Variables... mei 01 20:47:45 buddy microvm@technitium-debug[3476]: Starting Coldplug All udev Devices... mei 01 20:47:45 buddy microvm@technitium-debug[3476]: [ OK ] Mounted Huge Pages File System. mei 01 20:47:45 buddy microvm@technitium-debug[3476]: [ OK ] Mounted POSIX Message Queue File System. mei 01 20:47:45 buddy microvm@technitium-debug[3476]: [ OK ] Mounted Kernel Debug File System. mei 01 20:47:45 buddy microvm@technitium-debug[3476]: [ OK ] Finished Create List of Static Device Nodes. mei 01 20:47:45 buddy microvm@technitium-debug[3476]: [ OK ] Finished Load Kernel Module configfs. mei 01 20:47:45 buddy microvm@technitium-debug[3476]: [ OK ] Finished Load Kernel Module drm. mei 01 20:47:45 buddy microvm@technitium-debug[3476]: [ OK ] Started Journal Service. mei 01 20:47:45 buddy microvm@technitium-debug[3476]: [ OK ] Finished Load Kernel Module efi_pstore. mei 01 20:47:45 buddy microvm@technitium-debug[3476]: [ OK ] Finished Load Kernel Module fuse. mei 01 20:47:45 buddy microvm@technitium-debug[3476]: Mounting FUSE Control File System... mei 01 20:47:45 buddy microvm@technitium-debug[3476]: Mounting Kernel Configuration File System... mei 01 20:47:45 buddy microvm@technitium-debug[3476]: Starting Create Static Device Nodes in /dev gracefully... mei 01 20:47:45 buddy microvm@technitium-debug[3476]: [ OK ] Finished Remount Root and Kernel File Systems. mei 01 20:47:45 buddy microvm@technitium-debug[3476]: [ OK ] Finished Apply Kernel Variables. mei 01 20:47:45 buddy microvm@technitium-debug[3476]: Starting Flush Journal to Persistent Storage... mei 01 20:47:45 buddy microvm@technitium-debug[3476]: Starting Load/Save OS Random Seed... mei 01 20:47:45 buddy microvm@technitium-debug[3476]: [ OK ] Finished Coldplug All udev Devices. mei 01 20:47:45 buddy microvm@technitium-debug[3476]: [ OK ] Mounted FUSE Control File System. mei 01 20:47:46 buddy microvm@technitium-debug[3476]: [ OK ] Mounted Kernel Configuration File System. mei 01 20:47:46 buddy microvm@technitium-debug[3476]: [ OK ] Finished Load/Save OS Random Seed. mei 01 20:47:46 buddy microvm@technitium-debug[3476]: [ OK ] Finished Flush Journal to Persistent Storage. mei 01 20:47:46 buddy microvm@technitium-debug[3476]: [ OK ] Finished Create Static Device Nodes in /dev gracefully. mei 01 20:47:46 buddy microvm@technitium-debug[3476]: Starting Create Static Device Nodes in /dev... mei 01 20:47:46 buddy microvm@technitium-debug[3476]: [ OK ] Finished Create Static Device Nodes in /dev. mei 01 20:47:46 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Preparation for Local File Systems. mei 01 20:47:46 buddy microvm@technitium-debug[3476]: Mounting /var/lib/technitium-dns-server... mei 01 20:47:46 buddy microvm@technitium-debug[3476]: Starting Rule-based Manager for Device Events and Files... mei 01 20:47:46 buddy microvm@technitium-debug[3476]: [ OK ] Mounted /var/lib/technitium-dns-server. mei 01 20:47:46 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Local File Systems. mei 01 20:47:46 buddy microvm@technitium-debug[3476]: Starting Create Volatile Files and Directories... mei 01 20:47:47 buddy microvm@technitium-debug[3476]: [ OK ] Finished Create Volatile Files and Directories. mei 01 20:47:47 buddy microvm@technitium-debug[3476]: Starting Rebuild Journal Catalog... mei 01 20:47:47 buddy microvm@technitium-debug[3476]: Starting Userspace Out-Of-Memory (OOM) Killer... mei 01 20:47:47 buddy microvm@technitium-debug[3476]: Starting Network Name Resolution... mei 01 20:47:47 buddy microvm@technitium-debug[3476]: Starting Network Time Synchronization... mei 01 20:47:47 buddy microvm@technitium-debug[3476]: Starting Record System Boot/Shutdown in UTMP... mei 01 20:47:47 buddy microvm@technitium-debug[3476]: [ OK ] Started Rule-based Manager for Device Events and Files. mei 01 20:47:47 buddy microvm@technitium-debug[3476]: [ OK ] Finished Create SUID/SGID Wrappers. mei 01 20:47:47 buddy microvm@technitium-debug[3476]: Starting Load Kernel Module fuse... mei 01 20:47:47 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Userspace Out-Of-Memory (OOM) Killer. mei 01 20:47:47 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-oomd.service' for details. mei 01 20:47:47 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Name Resolution. mei 01 20:47:47 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-resolved.service' for details. mei 01 20:47:47 buddy microvm@technitium-debug[3476]: Starting Load Kernel Module efi_pstore... mei 01 20:47:48 buddy microvm@technitium-debug[3476]: Starting Create SUID/SGID Wrappers... mei 01 20:47:48 buddy microvm@technitium-debug[3476]: Starting Userspace Out-Of-Memory (OOM) Killer... mei 01 20:47:48 buddy microvm@technitium-debug[3476]: Starting Network Name Resolution... mei 01 20:47:48 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Time Synchronization. mei 01 20:47:48 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-timesyncd.service' for details. mei 01 20:47:48 buddy microvm@technitium-debug[3476]: [ OK ] Finished Load Kernel Module fuse. mei 01 20:47:49 buddy microvm@technitium-debug[3476]: Starting Network Time Synchronization... mei 01 20:47:49 buddy microvm@technitium-debug[3476]: [ OK ] Finished Record System Boot/Shutdown in UTMP. mei 01 20:47:49 buddy microvm@technitium-debug[3476]: [ OK ] Finished Load Kernel Module efi_pstore. mei 01 20:47:50 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Userspace Out-Of-Memory (OOM) Killer. mei 01 20:47:50 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-oomd.service' for details. mei 01 20:47:50 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Time Synchronization. mei 01 20:47:50 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-timesyncd.service' for details. mei 01 20:47:50 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Name Resolution. mei 01 20:47:50 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-resolved.service' for details. mei 01 20:47:50 buddy microvm@technitium-debug[3476]: Starting Load Kernel Module efi_pstore... mei 01 20:47:50 buddy microvm@technitium-debug[3476]: Starting Userspace Out-Of-Memory (OOM) Killer... mei 01 20:47:50 buddy microvm@technitium-debug[3476]: Starting Network Name Resolution... mei 01 20:47:50 buddy microvm@technitium-debug[3476]: Starting Network Time Synchronization... mei 01 20:47:50 buddy microvm@technitium-debug[3476]: Starting Virtual Console Setup... mei 01 20:47:50 buddy microvm@technitium-debug[3476]: [ OK ] Finished Firewall. mei 01 20:47:50 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Preparation for Network. mei 01 20:47:51 buddy microvm@technitium-debug[3476]: Starting Network Configuration... mei 01 20:47:51 buddy microvm@technitium-debug[3476]: [ OK ] Finished Rebuild Journal Catalog. mei 01 20:47:51 buddy microvm@technitium-debug[3476]: [ OK ] Finished Load Kernel Module efi_pstore. mei 01 20:47:51 buddy microvm@technitium-debug[3476]: Starting Update is Completed... mei 01 20:47:51 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Userspace Out-Of-Memory (OOM) Killer. mei 01 20:47:51 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-oomd.service' for details. mei 01 20:47:51 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Name Resolution. mei 01 20:47:51 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-resolved.service' for details. mei 01 20:47:51 buddy microvm@technitium-debug[3476]: Starting Load Kernel Module efi_pstore... mei 01 20:47:51 buddy microvm@technitium-debug[3476]: Starting Userspace Out-Of-Memory (OOM) Killer... mei 01 20:47:51 buddy microvm@technitium-debug[3476]: Starting Network Name Resolution... mei 01 20:47:51 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Time Synchronization. mei 01 20:47:51 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-timesyncd.service' for details. mei 01 20:47:51 buddy microvm@technitium-debug[3476]: Starting Network Time Synchronization... mei 01 20:47:51 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Configuration. mei 01 20:47:51 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-networkd.service' for details. mei 01 20:47:51 buddy microvm@technitium-debug[3476]: [DEPEND] Dependency failed for Extra networking commands.. mei 01 20:47:51 buddy microvm@technitium-debug[3476]: [ OK ] Finished Update is Completed. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: Starting Network Configuration... mei 01 20:47:52 buddy microvm@technitium-debug[3476]: [ OK ] Finished Load Kernel Module efi_pstore. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Userspace Out-Of-Memory (OOM) Killer. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-oomd.service' for details. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Name Resolution. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-resolved.service' for details. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Time Synchronization. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-timesyncd.service' for details. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: Starting Load Kernel Module efi_pstore... mei 01 20:47:52 buddy microvm@technitium-debug[3476]: Starting Userspace Out-Of-Memory (OOM) Killer... mei 01 20:47:52 buddy microvm@technitium-debug[3476]: Starting Network Name Resolution... mei 01 20:47:52 buddy microvm@technitium-debug[3476]: Starting Network Time Synchronization... mei 01 20:47:52 buddy microvm@technitium-debug[3476]: [ OK ] Finished Virtual Console Setup. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Configuration. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-networkd.service' for details. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: [DEPEND] Dependency failed for Extra networking commands.. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: Starting Network Configuration... mei 01 20:47:52 buddy microvm@technitium-debug[3476]: [ OK ] Finished Load Kernel Module efi_pstore. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Userspace Out-Of-Memory (OOM) Killer. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-oomd.service' for details. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Name Resolution. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-resolved.service' for details. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: [ OK ] Finished Create SUID/SGID Wrappers. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Time Synchronization. mei 01 20:47:52 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-timesyncd.service' for details. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: Starting Load Kernel Module efi_pstore... mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Name Resolution. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-resolved.service' for details. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Time Synchronization. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-timesyncd.service' for details. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Userspace Out-Of-Memory (OOM) Killer. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-oomd.service' for details. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Configuration. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-networkd.service' for details. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [DEPEND] Dependency failed for Extra networking commands.. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: Starting Create SUID/SGID Wrappers... mei 01 20:47:53 buddy microvm@technitium-debug[3476]: Starting Network Configuration... mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Time Synchronization. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-timesyncd.service' for details. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [ OK ] Finished Load Kernel Module efi_pstore. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Configuration. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-networkd.service' for details. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [DEPEND] Dependency failed for Extra networking commands.. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: Starting Load Kernel Module efi_pstore... mei 01 20:47:53 buddy microvm@technitium-debug[3476]: Starting Network Configuration... mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Time Synchronization. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-timesyncd.service' for details. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [ OK ] Finished Load Kernel Module efi_pstore. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Configuration. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-networkd.service' for details. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [DEPEND] Dependency failed for Extra networking commands.. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: Starting Load Kernel Module efi_pstore... mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Configuration. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-networkd.service' for details. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [DEPEND] Dependency failed for Extra networking commands.. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Network. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Network is Online. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Network Time Synchronization. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: See 'systemctl status systemd-timesyncd.service' for details. mei 01 20:47:53 buddy microvm@technitium-debug[3476]: [ OK ] Finished Load Kernel Module efi_pstore. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [ OK ] Finished Create SUID/SGID Wrappers. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [ OK ] Reached target System Initialization. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [ OK ] Started logrotate.timer. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [ OK ] Started Daily Cleanup of Temporary Directories. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Timer Units. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [ OK ] Listening on D-Bus System Message Bus Socket. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Socket Units. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Basic System. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: Starting Kernel Auditing... mei 01 20:47:54 buddy microvm@technitium-debug[3476]: Starting Logrotate configuration check... mei 01 20:47:54 buddy microvm@technitium-debug[3476]: Starting Name Service Cache Daemon (nsncd)... mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [ OK ] Started Reset console on configuration changes. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: Starting SSH Daemon... mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [ OK ] Started Technitium DNS Server. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [ OK ] Finished Kernel Auditing. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [ OK ] Finished Logrotate configuration check. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Name Service Cache Daemon (nsncd). mei 01 20:47:54 buddy microvm@technitium-debug[3476]: See 'systemctl status nscd.service' for details. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [DEPEND] Dependency failed for User and Group Name Lookups. mei 01 20:47:54 buddy microvm@technitium-debug[3476]: [DEPEND] Dependency failed for Host and Network Name Lookups. mei 01 20:47:55 buddy microvm@technitium-debug[3476]: Starting Name Service Cache Daemon (nsncd)... mei 01 20:47:55 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Name Service Cache Daemon (nsncd). mei 01 20:47:55 buddy microvm@technitium-debug[3476]: See 'systemctl status nscd.service' for details. mei 01 20:47:55 buddy microvm@technitium-debug[3476]: [DEPEND] Dependency failed for User and Group Name Lookups. mei 01 20:47:55 buddy microvm@technitium-debug[3476]: [DEPEND] Dependency failed for Host and Network Name Lookups. mei 01 20:47:55 buddy microvm@technitium-debug[3476]: Starting Name Service Cache Daemon (nsncd)... mei 01 20:47:55 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Name Service Cache Daemon (nsncd). mei 01 20:47:55 buddy microvm@technitium-debug[3476]: See 'systemctl status nscd.service' for details. mei 01 20:47:55 buddy microvm@technitium-debug[3476]: [DEPEND] Dependency failed for User and Group Name Lookups. mei 01 20:47:55 buddy microvm@technitium-debug[3476]: [DEPEND] Dependency failed for Host and Network Name Lookups. mei 01 20:47:55 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start Name Service Cache Daemon (nsncd). mei 01 20:47:55 buddy microvm@technitium-debug[3476]: See 'systemctl status nscd.service' for details. mei 01 20:47:55 buddy microvm@technitium-debug[3476]: [DEPEND] Dependency failed for User and Group Name Lookups. mei 01 20:47:55 buddy microvm@technitium-debug[3476]: [DEPEND] Dependency failed for Host and Network Name Lookups. mei 01 20:47:55 buddy microvm@technitium-debug[3476]: Starting User Login Management... mei 01 20:47:55 buddy microvm@technitium-debug[3476]: Starting Permit User Sessions... mei 01 20:47:55 buddy microvm@technitium-debug[3476]: [ OK ] Finished Permit User Sessions. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ OK ] Started Getty on tty1. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ OK ] Started My Cool User Service. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ OK ] Started Serial Getty on ttyS0. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Login Prompts. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ OK ] Started User Login Management. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: Starting D-Bus System Message Bus... mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.196160] my-cool-user-service-start[730]: # /etc/systemd/system/systemd-networkd.service mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.208693] my-cool-user-service-start[730]: # SPDX-License-Identifier: LGPL-2.1-or-later mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.217065] my-cool-user-service-start[730]: # mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.218411] my-cool-user-service-start[730]: # This file is part of systemd. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.222872] my-cool-user-service-start[730]: # mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.225186] my-cool-user-service-start[730]: # systemd is free software; you can redistribute it and/or modify it mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.230625] my-cool-user-service-start[730]: # under the terms of the GNU Lesser General Public License as published by mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.239206] my-cool-user-service-start[730]: # the Free Software Foundation; either version 2.1 of the License, or mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ OK ] Started D-Bus System Message Bus. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.245282] my-cool-user-service-start[730]: # (at your option) any later version. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.251185] my-cool-user-service-start[730]: [Unit] mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.253307] my-cool-user-service-start[730]: Description=Network Configuration mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.258175] my-cool-user-service-start[730]: Documentation=man:systemd-networkd.service(8) mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.264184] my-cool-user-service-start[730]: Documentation=man:org.freedesktop.network1(5) mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.269465] my-cool-user-service-start[730]: ConditionCapability=CAP_NET_ADMIN mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.274406] my-cool-user-service-start[730]: DefaultDependencies=no mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.289381] my-cool-user-service-start[730]: # systemd-udevd.service can be dropped once tuntap is moved to netlink mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.298353] my-cool-user-service-start[730]: After=systemd-networkd.socket systemd-udevd.service network-pre.target systemd-sysusers.service systemd-sysctl.service mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.306440] my-cool-user-service-start[730]: Before=network.target multi-user.target shutdown.target initrd-switch-root.target mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.316944] my-cool-user-service-start[730]: Conflicts=shutdown.target initrd-switch-root.target mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.322471] my-cool-user-service-start[730]: Wants=systemd-networkd.socket network.target mei 01 20:47:56 buddy microvm@technitium-debug[3476]: Starting D-Bus System Message Bus... mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.329770] my-cool-user-service-start[730]: [Service] mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.334923] my-cool-user-service-start[730]: AmbientCapabilities=CAP_NET_ADMIN CAP_NET_BIND_SERVICE CAP_NET_BROADCAST CAP_NET_RAW mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.347749] my-cool-user-service-start[730]: BusName=org.freedesktop.network1 mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.353303] my-cool-user-service-start[730]: CapabilityBoundingSet=CAP_NET_ADMIN CAP_NET_BIND_SERVICE CAP_NET_BROADCAST CAP_NET_RAW mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.361300] my-cool-user-service-start[730]: DeviceAllow=char-* rw mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.363587] my-cool-user-service-start[730]: ExecStart=!!/nix/store/y6mag03hj8b2hnlcj682xvp2aid7yg7y-systemd-255.4/lib/systemd/systemd-networkd mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.371282] my-cool-user-service-start[730]: FileDescriptorStoreMax=512 mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.374359] my-cool-user-service-start[730]: LockPersonality=yes mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.377169] my-cool-user-service-start[730]: MemoryDenyWriteExecute=yes mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.384509] my-cool-user-service-start[730]: NoNewPrivileges=yes mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.389529] my-cool-user-service-start[730]: ProtectProc=invisible mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.394642] my-cool-user-service-start[730]: ProtectClock=yes mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.398253] my-cool-user-service-start[730]: ProtectControlGroups=yes mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.401306] my-cool-user-service-start[730]: ProtectHome=yes mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.404257] my-cool-user-service-start[730]: ProtectKernelLogs=yes mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.408116] my-cool-user-service-start[730]: ProtectKernelModules=yes mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.412064] my-cool-user-service-start[730]: ProtectSystem=strict mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.414848] my-cool-user-service-start[730]: Restart=on-failure mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.417358] my-cool-user-service-start[730]: RestartKillSignal=SIGUSR2 mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.423521] my-cool-user-service-start[730]: RestartSec=0 mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.427565] my-cool-user-service-start[730]: RestrictAddressFamilies=AF_UNIX AF_NETLINK AF_INET AF_INET6 AF_PACKET mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.438257] my-cool-user-service-start[730]: RestrictNamespaces=yes mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.439810] my-cool-user-service-start[730]: RestrictRealtime=yes mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.444283] my-cool-user-service-start[730]: RestrictSUIDSGID=yes mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.445718] my-cool-user-service-start[730]: RuntimeDirectory=systemd/netif mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.448301] my-cool-user-service-start[730]: RuntimeDirectoryPreserve=yes mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.453528] my-cool-user-service-start[730]: SystemCallArchitectures=native mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.458263] my-cool-user-service-start[730]: SystemCallErrorNumber=EPERM mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.461651] my-cool-user-service-start[730]: SystemCallFilter=@system-service mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.467305] my-cool-user-service-start[730]: Type=notify-reload mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.469843] my-cool-user-service-start[730]: User=systemd-network mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.476329] my-cool-user-service-start[730]: WatchdogSec=3min mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.478317] my-cool-user-service-start[730]: [Install] mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.481287] my-cool-user-service-start[730]: WantedBy=multi-user.target mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.485423] my-cool-user-service-start[730]: Also=systemd-networkd.socket mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.489813] my-cool-user-service-start[730]: Alias=dbus-org.freedesktop.network1.service mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.497882] my-cool-user-service-start[730]: # The output from this generator is used by udevd and networkd. Enable it by mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.507338] my-cool-user-service-start[730]: # default when enabling systemd-networkd.service. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.512285] my-cool-user-service-start[730]: Also=systemd-network-generator.service mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.517470] my-cool-user-service-start[730]: # We want to enable systemd-networkd-wait-online.service whenever this service mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.525589] my-cool-user-service-start[730]: # is enabled. systemd-networkd-wait-online.service has mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.532481] my-cool-user-service-start[730]: # WantedBy=network-online.target, so enabling it only has an effect if mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.537402] my-cool-user-service-start[730]: # network-online.target itself is enabled or pulled in by some other unit. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.543357] my-cool-user-service-start[730]: Also=systemd-networkd-wait-online.service mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.547379] my-cool-user-service-start[730]: # /nix/store/b8m69702qv0cfa714f0alzdqkcaf0ma6-system-units/systemd-networkd.service.d/overrides.conf mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.556191] my-cool-user-service-start[730]: [Unit] mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.558195] my-cool-user-service-start[730]: X-Reload-Triggers=/nix/store/hh5kw6p9gw6jbns87j72pchxn8mdyz1n-X-Reload-Triggers-systemd-networkd mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.567311] my-cool-user-service-start[730]: X-Restart-Triggers=/nix/store/r4wlndhmknjf4xmmkk224z727dr93215-X-Restart-Triggers-systemd-networkd mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.574870] my-cool-user-service-start[730]: [Service] mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.579242] my-cool-user-service-start[730]: Environment="LOCALE_ARCHIVE=/nix/store/jvl3jfhnq71m8ilxhzhgyj7vdxjnd2z7-glibc-locales-2.39-5/lib/locale/locale-archive" mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.594433] my-cool-user-service-start[730]: Environment="PATH=/nix/store/asqa3kfq3maclk7cqqhrjvp7vriw6ahy-coreutils-9.5/bin:/nix/store/vf8cjkgwmgd4sb3vkxh6x9iar71s1w1c-findutils-4.9.0/bin:/nix/store/gbrv0fn9a07kmdw2rg22iybdymylw4qc-gnugrep-3.11/bin:/nix/store/ard747zf4fkkkqa0pwj3fxp9fhnyfm7p-gnused-4.9/bin:/nix/store/y6mag03hj8b2hnlcj682xvp2aid7yg7y-systemd-255.4/bin:/nix/store/asqa3kfq3maclk7cqqhrjvp7vriw6ahy-coreutils-9.5/sbin:/nix/store/vf8cjkgwmgd4sb3vkxh6x9iar71s1w1c-findutils-4.9.0/sbin:/nix/store/gbrv0fn9a07kmdw2rg22iybdymylw4qc-gnugrep-3.11/sbin:/nix/store/ard747zf4fkkkqa0pwj3fxp9fhnyfm7p-gnused-4.9/sbin:/nix/store/y6mag03hj8b2hnlcj682xvp2aid7yg7y-systemd-255.4/sbin" mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.644396] my-cool-user-service-start[730]: Environment="TZDIR=/nix/store/rqfax1yrvgj9w7dvj4c7smf0nxprc7bf-tzdata-2024a/share/zoneinfo" mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.652621] my-cool-user-service-start[730]: [Install] mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.656258] my-cool-user-service-start[730]: WantedBy=multi-user.target mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.660713] my-cool-user-service-start[733]: May 01 20:47:50 DNS systemd[1]: Starting Network Configuration... mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.668264] my-cool-user-service-start[733]: May 01 20:47:51 DNS (networkd)[501]: systemd-networkd.service: Failed to execute /nix/store/y6mag03hj8b2hnlcj682xvp2aid7yg7y-systemd-255.4/lib/systemd/systemd-networkd: Operation not supported mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.682259] my-cool-user-service-start[733]: May 01 20:47:51 DNS systemd[1]: systemd-networkd.service: Main process exited, code=exited, status=203/EXEC mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.690635] my-cool-user-service-start[733]: May 01 20:47:51 DNS systemd[1]: systemd-networkd.service: Failed with result 'exit-code'. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.698686] my-cool-user-service-start[733]: May 01 20:47:51 DNS systemd[1]: Failed to start Network Configuration. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.704581] my-cool-user-service-start[733]: May 01 20:47:51 DNS systemd[1]: systemd-networkd.service: Scheduled restart job, restart counter is at 1. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.711318] my-cool-user-service-start[733]: May 01 20:47:51 DNS systemd[1]: Starting Network Configuration... mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.716267] my-cool-user-service-start[733]: May 01 20:47:52 DNS (networkd)[557]: systemd-networkd.service: Failed to execute /nix/store/y6mag03hj8b2hnlcj682xvp2aid7yg7y-systemd-255.4/lib/systemd/systemd-networkd: Operation not supported mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.727359] my-cool-user-service-start[733]: May 01 20:47:52 DNS systemd[1]: systemd-networkd.service: Main process exited, code=exited, status=203/EXEC mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.734521] my-cool-user-service-start[733]: May 01 20:47:52 DNS systemd[1]: systemd-networkd.service: Failed with result 'exit-code'. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.749102] my-cool-user-service-start[733]: May 01 20:47:52 DNS systemd[1]: Failed to start Network Configuration. mei 01 20:47:56 buddy microvm@technitium-debug[3476]: [ 19.754241] my-cool-user-service-start[733]: May 01 20:47:52 DNS systemd[1]: systemd-networkd.service: Scheduled restart job, restart counter is at 2. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.762952] my-cool-user-service-start[733]: May 01 20:47:52 DNS systemd[1]: Starting Network Configuration... mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.770072] my-cool-user-service-start[733]: May 01 20:47:53 DNS (networkd)[597]: systemd-networkd.service: Failed to execute /nix/store/y6mag03hj8b2hnlcj682xvp2aid7yg7y-systemd-255.4/lib/systemd/systemd-networkd: Operation not supported mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.780256] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: systemd-networkd.service: Main process exited, code=exited, status=203/EXEC mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.786655] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: systemd-networkd.service: Failed with result 'exit-code'. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.795314] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: Failed to start Network Configuration. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.802288] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: systemd-networkd.service: Scheduled restart job, restart counter is at 3. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.809712] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: Starting Network Configuration... mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.818132] my-cool-user-service-start[733]: May 01 20:47:53 DNS (networkd)[616]: systemd-networkd.service: Failed to execute /nix/store/y6mag03hj8b2hnlcj682xvp2aid7yg7y-systemd-255.4/lib/systemd/systemd-networkd: Operation not supported mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.832828] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: systemd-networkd.service: Main process exited, code=exited, status=203/EXEC mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.843298] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: systemd-networkd.service: Failed with result 'exit-code'. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.852124] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: Failed to start Network Configuration. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.857519] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: systemd-networkd.service: Scheduled restart job, restart counter is at 4. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.866924] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: Starting Network Configuration... mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.874404] my-cool-user-service-start[733]: May 01 20:47:53 DNS (networkd)[624]: systemd-networkd.service: Failed to execute /nix/store/y6mag03hj8b2hnlcj682xvp2aid7yg7y-systemd-255.4/lib/systemd/systemd-networkd: Operation not supported mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.886352] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: systemd-networkd.service: Main process exited, code=exited, status=203/EXEC mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.895272] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: systemd-networkd.service: Failed with result 'exit-code'. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.903406] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: Failed to start Network Configuration. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.910128] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: systemd-networkd.service: Scheduled restart job, restart counter is at 5. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.916362] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: systemd-networkd.service: Start request repeated too quickly. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.924707] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: systemd-networkd.service: Failed with result 'exit-code'. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ 19.934331] my-cool-user-service-start[733]: May 01 20:47:53 DNS systemd[1]: Failed to start Network Configuration. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ OK ] Started D-Bus System Message Bus. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: Starting D-Bus System Message Bus... mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ OK ] Started D-Bus System Message Bus. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: Starting D-Bus System Message Bus... mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ OK ] Started D-Bus System Message Bus. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: Starting D-Bus System Message Bus... mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [ OK ] Started D-Bus System Message Bus. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: [FAILED] Failed to start D-Bus System Message Bus. mei 01 20:47:57 buddy microvm@technitium-debug[3476]: See 'systemctl status dbus-broker.service' for details. mei 01 20:47:58 buddy microvm@technitium-debug[3476]: [ OK ] Started SSH Daemon. mei 01 20:47:58 buddy microvm@technitium-debug[3476]: [ OK ] Reached target Multi-User System. mei 01 20:47:59 buddy microvm@technitium-debug[3476]: mei 01 20:47:59 buddy microvm@technitium-debug[3476]: mei 01 20:47:59 buddy microvm@technitium-debug[3476]: <<< Welcome to NixOS 24.05pre-git (x86_64) - ttyS0 >>> mei 01 20:47:59 buddy microvm@technitium-debug[3476]: mei 01 20:47:59 buddy microvm@technitium-debug[3476]: Run 'nixos-help' for the NixOS manual. mei 01 20:47:59 buddy microvm@technitium-debug[3476]: ```
relevant hypervisor host config ```nix { lib, config, profiles, ... }: { networking.hostName = "buddy"; # Prevent replacing the running kernel w/o reboot security.protectKernelImage = true; # Enables (nested) virtualization through hardware acceleration. # There is no harm in having both modules loaded at the same time, also no real overhead. boot.kernelModules = [ "kvm-amd" ]; hardware.cpu.amd.updateMicrocode = true; networking.hostId = "525346fb"; boot.supportedFilesystems = [ "zfs" ]; boot.kernelPackages = config.boot.zfs.package.latestCompatibleLinuxPackages; # [..] networking.useNetworkd = true; boot.kernel.sysctl = { "net.ipv4.ip_forward" = lib.mkForce "1"; "net.ipv6.conf.all.forwarding" = lib.mkForce "1"; "net.ipv6.conf.default.forwarding" = lib.mkForce "1"; }; systemd.network.networks."31-microvm-interfaces" = { matchConfig.Name = "vm-* tap-*"; networkConfig.Bridge = "bridge0"; }; systemd.network.netdevs."bridge0" = { netdevConfig = { Name = "bridge0"; Kind = "bridge"; MACAddress = lib.facts.buddy.net.management.mac; }; }; systemd.network.networks = { "30-lan" = { matchConfig.MACAddress = [ lib.facts.buddy.net.physical.mac ]; networkConfig = { Bridge = "bridge0"; }; }; "30-lan-bridge" = { matchConfig.Name = "bridge0"; networkConfig = { Address = [ "192.168.100.2/24" ]; # Gateway = "192.168.100.1"; DHCP = "ipv4"; IPv6AcceptRA = false; }; }; }; microvm.host.enable = lib.mkForce true; microvm.vms = { technitium-debug = { autostart = true; specialArgs = { inherit profiles; }; config = { networking.hostName = "DNS"; microvm.hypervisor = lib.mkForce "qemu"; microvm.vcpu = lib.mkDefault 1; #microvm.mem = lib.mkDefault 512; microvm.mem = lib.mkDefault 1512; # Allow the VM to use an additional 512 MB at boot, reclaimed by the host after settling #microvm.balloonMem = 512; microvm.graphics.enable = false; fileSystems."/" = { device = "rootfs"; fsType = "tmpfs"; options = [ "size=10%,mode=0755" ]; neededForBoot = true; }; microvm.interfaces = [{ type = "tap"; id = "tap-technitium"; mac = lib.facts.vm.dns.net.mac; }]; microvm.shares = [{ source = "/vm-state/technitium"; mountPoint = "/var/lib/technitium-dns-server"; tag = "technitium"; proto = "virtiofs"; } { source = "/nix/store"; mountPoint = "/nix/.ro-store"; tag = "ro-store"; proto = "virtiofs"; }]; networking.useNetworkd = true; systemd.network.networks."20-lan" = { matchConfig.Type = "ether"; networkConfig = { Address = [ "192.168.100.3/24" ]; Gateway = "192.168.100.1"; DHCP = "ipv4"; IPv6AcceptRA = false; }; }; services.technitium-dns-server.enable = true; services.technitium-dns-server.openFirewall = true; # DEBUG systemd.services.my-cool-user-service = { enable = true; wantedBy = [ "multi-user.target" ]; after = [ "getty@tty1.service" ]; description = "My Cool User Service"; serviceConfig.StandardOutput = "journal+console"; script = '' systemctl cat systemd-networkd.service journalctl -u systemd-networkd.service ''; }; }; }; }; } ```
ZFS config (disko), if relevant ```nix zpool.zstorage = { type = "zpool"; mode = "raidz"; mountpoint = null; # [..] rootFsOptions = { canmount = "off"; mountpoint = "none"; checksum = "fletcher4"; compression = "zstd-fast-1"; acltype = "posixacl"; xattr = "sa"; dnodesize = "auto"; relatime = "on"; recordsize = "128K"; # NOTE; Compare filenames after normalizing using KC unicode conversion table. This turns characters into # equivalent characters; fullwidth "A" (U+FF21) -> "A" (U+0041) [lossy conversion!!] normalization = "formKC"; logbias = "latency"; # NOTE; Enable record sizes larger than 128KiB "org.open-zfs:large_blocks" = "enabled"; }; datasets = { "local/root" = { type = "zfs_fs"; mountpoint = "/"; # [ .. ] options.mountpoint = "legacy"; # Filesystem at boot required, prevent duplicate mount }; "local/var" = { # Services data, contains state and logs type = "zfs_fs"; mountpoint = "/var"; options.mountpoint = "legacy"; # Filesystem at boot required, prevent duplicate mount }; "safe/persist/vm/state" = { type = "zfs_fs"; options = { mountpoint = "/vm-state"; primarycache = "metadata"; logbias = "throughput"; recordsize = "128K"; acltype = "posixacl"; xattr = "sa"; devices = "off"; setuid = "off"; }; }; # [..] }; }; zpool.zlocal = { type = "zpool"; # ERROR; Intentionally left empty to not create a VDEV. No vdev explicitly creates # a non-redundant pool (aka RAID0)! mode = ""; mountpoint = null; # [ .. ] rootFsOptions = { canmount = "off"; mountpoint = "none"; }; datasets = { #"local" = {}; "local/nix" = { # Nix filestore, contains no state type = "zfs_fs"; mountpoint = "/nix"; options = { acltype = "off"; # nix store is owned by root atime = "off"; # nix store doesn't use access time mountpoint = "legacy"; # Filesystem at boot required, prevent duplicate mount }; }; "local/temporary" = { type = "zfs_fs"; mountpoint = "/tmp"; options = { compression = "lz4"; sync = "disabled"; devices = "off"; setuid = "off"; }; }; }; }; }; # Tune ZFS boot.extraModprobeConfig = '' options zfs zfs_txg_timeout=5 # This is a hypervisor server, and ZFS ARC is sometimes slow with giving back RAM. # It defaults to 50% of total RAM, but we fix it to 8 GiB (bytes) options zfs zfs_arc_max=8589934592 options zfs zfs_immediate_write_sz=1048576 options zfs zfs_prefetch_disable=0 ''; ```
astro commented 4 months ago

Running your host config in a VM doesn't reproduce the issue for me.

Can you double-check that the ZFS datasets have set xattr=sa and acltype=posixacl?

Your tmpfs / might be a tad small at 10%.

I would strace -f the virtiofsd next. There are a few more knobs that are not configurable yet; I recently added microvm.virtiofsd.inodeFileHandles.

Bert-Proesmans commented 4 months ago

😬

mountpoint = "/nix";
options = {
  acltype = "off"; # nix store is owned by root
};

Seems I didn't have the mental power to doublecheck all shared dataset options. And I've read that warning inside the documentation at least 10 times too..
This is embarassing, sorry to waste your time.

Adding acltype = "posixacl"; xattr = "sa"; instead of acltype = "off"; was indeed the solution to my problem!

Bert-Proesmans commented 1 week ago

Hello again, old me! I have made stuff just complex enough to hit this same issue.. but with a twist!

I expected the source of a dataset attribute to not matter. Dataset property inheritence would allow me to cleanly separate and minimize vm configuration into host + glue + guest config.

What actually happened was inconsistent results between bare metal ZFS and emulated ZFS (within a virtual machine). Operations not happening as root user on the share on the guest returns error code "Operation not supported" (for any operation like open_dir, create_file, remove_file, etc).

To fix, set the attributes acltype and xattr explicitly on each and every dataset you share with your vm(s)! This means your attributes source must be set to "local" when querying dataset properties.

[bert-proesmans@buddy:~]$ zfs get xattr,acltype storage/postgres/state/test
NAME                         PROPERTY  VALUE     SOURCE
storage/postgres/state/test  xattr     sa        local # <---
storage/postgres/state/test  acltype   posix     local # <---

No idea why the property locality matters though.

Also, if you optimize multiple shares into a single mount folder; RAMfs doesn't support posix acl. A tempfs with remount read-only is workable.

The problem looks like below;

[bert-proesmans@test:/data]$ namei -l /data
f: /data
drwxr-xr-x root root /
drwxr-xr-x root root data
#^^^^^^^^^----------------- Any user should be able to open and read /data

[bert-proesmans@test:~]$ cd /data
-bash: cd: /data: Operation not supported
ZFS effects on real hardware ```text [bert-proesmans@buddy:~]$ zfs get xattr,acltype storage/postgres/state/test NAME PROPERTY VALUE SOURCE storage/postgres/state/test xattr sa inherited from storage storage/postgres/state/test acltype posix inherited from storage/postgres [bert-proesmans@buddy:~]$ exit [bert-proesmans@development:~/nix]$ ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no test-buddy Warning: Permanently added 'test-buddy' (ED25519) to the list of known hosts. [bert-proesmans@test:~]$ namei -l /data f: /data drwxr-xr-x root root / drwxr-xr-x root root data [bert-proesmans@test:~]$ cd /data -bash: cd: /data: Operation not supported # ^^^^^^^^^^^^^^^^^^^^^^^^ ---- ISSUE [bert-proesmans@test:~]$ exit [bert-proesmans@development:~/nix]$ ssh buddy [bert-proesmans@buddy:~]$ sudo zfs set xattr=sa acltype=posix storage/postgres/state/test [bert-proesmans@buddy:~]$ sudo reboot now Broadcast message from root@buddy on pts/1 (Tue 2024-09-03 11:13:22 UTC): The system will reboot now! [bert-proesmans@development:~/nix]$ ssh buddy Last login: Tue Sep 3 11:12:12 2024 from 192.168.88.245 [bert-proesmans@buddy:~]$ zfs get xattr,acltype storage/postgres/state/test NAME PROPERTY VALUE SOURCE storage/postgres/state/test xattr sa local storage/postgres/state/test acltype posix local [bert-proesmans@buddy:~]$ sudo ls -laa /storage/postgres/state/test total 2 drwxr-xr-x 2 root root 2 3 sep 10:17 . drwxr-xr-x 4 root root 4 3 sep 10:31 .. [bert-proesmans@buddy:~]$ sudo touch /storage/postgres/state/test/testing123.txt [bert-proesmans@buddy:~]$ exit [bert-proesmans@development:~/nix]$ ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no test-buddy Warning: Permanently added 'test-buddy' (ED25519) to the list of known hosts. [bert-proesmans@test:~]$ namei -l /data f: /data drwxr-xr-x root root / drwxr-xr-x root root data [bert-proesmans@test:~]$ cd /data # ^^^^^^^^^^^^^^^^^^^^^^^^ ---- SUCCESS [bert-proesmans@test:/data]$ ls -laa /data total 2 drwxr-xr-x 2 root root 3 Sep 3 11:18 . drwxr-xr-x 18 root root 360 Sep 3 11:14 .. -rw-r--r-- 1 root root 0 Sep 3 11:18 testing123.txt ```
ZFS effects on virtual machine ```text [bert-proesmans@development:~/nix]$ zfs list no datasets available [bert-proesmans@development:~/nix]$ sudo zpool import -d /mnt/zfs pool: storage id: 8732458226258982849 state: ONLINE action: The pool can be imported using its name or numeric identifier. config: storage ONLINE /mnt/zfs/backing.img ONLINE [bert-proesmans@development:~/nix]$ sudo zpool import -d /mnt/zfs storage [bert-proesmans@development:~/nix]$ zfs list NAME USED AVAIL REFER MOUNTPOINT storage 320K 4.36G 24K none storage/postgres 124K 4.36G 24K none storage/postgres/state 99.5K 4.36G 24K /storage/postgres/state storage/postgres/state/immich 75.5K 4.36G 75.5K /storage/postgres/state/immich [bert-proesmans@development:~/nix]$ zfs get xattr,acltype storage/postgres/state/immich NAME PROPERTY VALUE SOURCE storage/postgres/state/immich xattr on default storage/postgres/state/immich acltype posix inherited from storage/postgres [bert-proesmans@development:~/nix]$ sudo systemctl start microvm@test [bert-proesmans@development:~/nix]$ ssh test-development [bert-proesmans@test:~]$ namei -l /data f: /data drwxr-xr-x root root / drwxr-xr-x root root data [bert-proesmans@test:~]$ cd /data # ^^^^^^^^^^^^^^^^^^^^^^^^ ---- SUCCESS [bert-proesmans@test:/data]$ ```