lxc / incus

Powerful system container and virtual machine manager
https://linuxcontainers.org/incus
Apache License 2.0
2.5k stars 203 forks source link

trying to do nixos-rebuild switch inside a fresh nixos container fails with `Failed to start Firewall.` #526

Closed ymolists closed 7 months ago

ymolists commented 7 months ago

Required information

Issue description

once i was able to enter the shell of a container i tried to rebuild the fresh nixos system by doing: nixos-rebuild switch

doing apt update && apt dist-upgrade worked flawlessly in a non nixos (ubuntu 23) guest container. I only tried ubuntu 23 guest container

Steps to reproduce

  1. incus launch images:nixos/23.11 nix00 -c security.nesting=true
  2. once inside run nixos-rebuild switch
  3. incus launch images:ubuntu/23.10 ub00 -c security.nesting=true
  4. apt update && apt dist-upgrade && apt-autoremove
  5. above works inside the ubuntu conainer

Information to attach

[root@nixos:~]#  nixos-rebuild switch 
building Nix...
building the system configuration...
activating the configuration...
setting up /etc...
setting up tmpfiles
Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted
warning: the following units failed: firewall.service

× firewall.service - Firewall
     Loaded: loaded (/etc/systemd/system/firewall.service; enabled; preset: enabled)
    Drop-In: /nix/store/8q3psx2yj9y8092zq8pjlbhkgh7r31gv-system-units/service.d
             └─zzz-lxc-service.conf
     Active: failed (Result: exit-code) since Fri 2024-02-23 21:03:31 UTC; 519ms ago
    Process: 15945 ExecStart=firewall-start (code=exited, status=4)
   Main PID: 15945 (code=exited, status=4)
        CPU: 50ms

Feb 23 21:03:30 nixos systemd[1]: Starting Firewall...
Feb 23 21:03:31 nixos firewall-start[16073]: Warning: Extension icmp revision 0 not supported, missing kernel module?
Feb 23 21:03:31 nixos firewall-start[16073]: iptables v1.8.10 (nf_tables):  RULE_APPEND failed (No such file or directory): rule in chain nixos-fw
Feb 23 21:03:31 nixos systemd[1]: firewall.service: Main process exited, code=exited, status=4/NOPERMISSION
Feb 23 21:03:31 nixos systemd[1]: firewall.service: Failed with result 'exit-code'.
Feb 23 21:03:31 nixos systemd[1]: Failed to start Firewall.
warning: error(s) occurred while switching to the new configuration

I see that it is complaining about firewall so i am linking it to #525 which is what i faced up until now. I had to disable all the iptables firewalls in the host. Again not sure if related

ymolists commented 7 months ago

incus info attached as a comment

config: {}
api_extensions:
- storage_zfs_remove_snapshots
- container_host_shutdown_timeout
- container_stop_priority
- container_syscall_filtering
- auth_pki
- container_last_used_at
- etag
- patch
- usb_devices
- https_allowed_credentials
- image_compression_algorithm
- directory_manipulation
- container_cpu_time
- storage_zfs_use_refquota
- storage_lvm_mount_options
- network
- profile_usedby
- container_push
- container_exec_recording
- certificate_update
- container_exec_signal_handling
- gpu_devices
- container_image_properties
- migration_progress
- id_map
- network_firewall_filtering
- network_routes
- storage
- file_delete
- file_append
- network_dhcp_expiry
- storage_lvm_vg_rename
- storage_lvm_thinpool_rename
- network_vlan
- image_create_aliases
- container_stateless_copy
- container_only_migration
- storage_zfs_clone_copy
- unix_device_rename
- storage_lvm_use_thinpool
- storage_rsync_bwlimit
- network_vxlan_interface
- storage_btrfs_mount_options
- entity_description
- image_force_refresh
- storage_lvm_lv_resizing
- id_map_base
- file_symlinks
- container_push_target
- network_vlan_physical
- storage_images_delete
- container_edit_metadata
- container_snapshot_stateful_migration
- storage_driver_ceph
- storage_ceph_user_name
- resource_limits
- storage_volatile_initial_source
- storage_ceph_force_osd_reuse
- storage_block_filesystem_btrfs
- resources
- kernel_limits
- storage_api_volume_rename
- network_sriov
- console
- restrict_dev_incus
- migration_pre_copy
- infiniband
- dev_incus_events
- proxy
- network_dhcp_gateway
- file_get_symlink
- network_leases
- unix_device_hotplug
- storage_api_local_volume_handling
- operation_description
- clustering
- event_lifecycle
- storage_api_remote_volume_handling
- nvidia_runtime
- container_mount_propagation
- container_backup
- dev_incus_images
- container_local_cross_pool_handling
- proxy_unix
- proxy_udp
- clustering_join
- proxy_tcp_udp_multi_port_handling
- network_state
- proxy_unix_dac_properties
- container_protection_delete
- unix_priv_drop
- pprof_http
- proxy_haproxy_protocol
- network_hwaddr
- proxy_nat
- network_nat_order
- container_full
- backup_compression
- nvidia_runtime_config
- storage_api_volume_snapshots
- storage_unmapped
- projects
- network_vxlan_ttl
- container_incremental_copy
- usb_optional_vendorid
- snapshot_scheduling
- snapshot_schedule_aliases
- container_copy_project
- clustering_server_address
- clustering_image_replication
- container_protection_shift
- snapshot_expiry
- container_backup_override_pool
- snapshot_expiry_creation
- network_leases_location
- resources_cpu_socket
- resources_gpu
- resources_numa
- kernel_features
- id_map_current
- event_location
- storage_api_remote_volume_snapshots
- network_nat_address
- container_nic_routes
- cluster_internal_copy
- seccomp_notify
- lxc_features
- container_nic_ipvlan
- network_vlan_sriov
- storage_cephfs
- container_nic_ipfilter
- resources_v2
- container_exec_user_group_cwd
- container_syscall_intercept
- container_disk_shift
- storage_shifted
- resources_infiniband
- daemon_storage
- instances
- image_types
- resources_disk_sata
- clustering_roles
- images_expiry
- resources_network_firmware
- backup_compression_algorithm
- ceph_data_pool_name
- container_syscall_intercept_mount
- compression_squashfs
- container_raw_mount
- container_nic_routed
- container_syscall_intercept_mount_fuse
- container_disk_ceph
- virtual-machines
- image_profiles
- clustering_architecture
- resources_disk_id
- storage_lvm_stripes
- vm_boot_priority
- unix_hotplug_devices
- api_filtering
- instance_nic_network
- clustering_sizing
- firewall_driver
- projects_limits
- container_syscall_intercept_hugetlbfs
- limits_hugepages
- container_nic_routed_gateway
- projects_restrictions
- custom_volume_snapshot_expiry
- volume_snapshot_scheduling
- trust_ca_certificates
- snapshot_disk_usage
- clustering_edit_roles
- container_nic_routed_host_address
- container_nic_ipvlan_gateway
- resources_usb_pci
- resources_cpu_threads_numa
- resources_cpu_core_die
- api_os
- container_nic_routed_host_table
- container_nic_ipvlan_host_table
- container_nic_ipvlan_mode
- resources_system
- images_push_relay
- network_dns_search
- container_nic_routed_limits
- instance_nic_bridged_vlan
- network_state_bond_bridge
- usedby_consistency
- custom_block_volumes
- clustering_failure_domains
- resources_gpu_mdev
- console_vga_type
- projects_limits_disk
- network_type_macvlan
- network_type_sriov
- container_syscall_intercept_bpf_devices
- network_type_ovn
- projects_networks
- projects_networks_restricted_uplinks
- custom_volume_backup
- backup_override_name
- storage_rsync_compression
- network_type_physical
- network_ovn_external_subnets
- network_ovn_nat
- network_ovn_external_routes_remove
- tpm_device_type
- storage_zfs_clone_copy_rebase
- gpu_mdev
- resources_pci_iommu
- resources_network_usb
- resources_disk_address
- network_physical_ovn_ingress_mode
- network_ovn_dhcp
- network_physical_routes_anycast
- projects_limits_instances
- network_state_vlan
- instance_nic_bridged_port_isolation
- instance_bulk_state_change
- network_gvrp
- instance_pool_move
- gpu_sriov
- pci_device_type
- storage_volume_state
- network_acl
- migration_stateful
- disk_state_quota
- storage_ceph_features
- projects_compression
- projects_images_remote_cache_expiry
- certificate_project
- network_ovn_acl
- projects_images_auto_update
- projects_restricted_cluster_target
- images_default_architecture
- network_ovn_acl_defaults
- gpu_mig
- project_usage
- network_bridge_acl
- warnings
- projects_restricted_backups_and_snapshots
- clustering_join_token
- clustering_description
- server_trusted_proxy
- clustering_update_cert
- storage_api_project
- server_instance_driver_operational
- server_supported_storage_drivers
- event_lifecycle_requestor_address
- resources_gpu_usb
- clustering_evacuation
- network_ovn_nat_address
- network_bgp
- network_forward
- custom_volume_refresh
- network_counters_errors_dropped
- metrics
- image_source_project
- clustering_config
- network_peer
- linux_sysctl
- network_dns
- ovn_nic_acceleration
- certificate_self_renewal
- instance_project_move
- storage_volume_project_move
- cloud_init
- network_dns_nat
- database_leader
- instance_all_projects
- clustering_groups
- ceph_rbd_du
- instance_get_full
- qemu_metrics
- gpu_mig_uuid
- event_project
- clustering_evacuation_live
- instance_allow_inconsistent_copy
- network_state_ovn
- storage_volume_api_filtering
- image_restrictions
- storage_zfs_export
- network_dns_records
- storage_zfs_reserve_space
- network_acl_log
- storage_zfs_blocksize
- metrics_cpu_seconds
- instance_snapshot_never
- certificate_token
- instance_nic_routed_neighbor_probe
- event_hub
- agent_nic_config
- projects_restricted_intercept
- metrics_authentication
- images_target_project
- cluster_migration_inconsistent_copy
- cluster_ovn_chassis
- container_syscall_intercept_sched_setscheduler
- storage_lvm_thinpool_metadata_size
- storage_volume_state_total
- instance_file_head
- instances_nic_host_name
- image_copy_profile
- container_syscall_intercept_sysinfo
- clustering_evacuation_mode
- resources_pci_vpd
- qemu_raw_conf
- storage_cephfs_fscache
- network_load_balancer
- vsock_api
- instance_ready_state
- network_bgp_holdtime
- storage_volumes_all_projects
- metrics_memory_oom_total
- storage_buckets
- storage_buckets_create_credentials
- metrics_cpu_effective_total
- projects_networks_restricted_access
- storage_buckets_local
- loki
- acme
- internal_metrics
- cluster_join_token_expiry
- remote_token_expiry
- init_preseed
- storage_volumes_created_at
- cpu_hotplug
- projects_networks_zones
- network_txqueuelen
- cluster_member_state
- instances_placement_scriptlet
- storage_pool_source_wipe
- zfs_block_mode
- instance_generation_id
- disk_io_cache
- amd_sev
- storage_pool_loop_resize
- migration_vm_live
- ovn_nic_nesting
- oidc
- network_ovn_l3only
- ovn_nic_acceleration_vdpa
- cluster_healing
- instances_state_total
- auth_user
- security_csm
- instances_rebuild
- numa_cpu_placement
- custom_volume_iso
- network_allocations
- zfs_delegate
- storage_api_remote_volume_snapshot_copy
- operations_get_query_all_projects
- metadata_configuration
- syslog_socket
- event_lifecycle_name_and_project
- instances_nic_limits_priority
- disk_initial_volume_configuration
- operation_wait
- image_restriction_privileged
- cluster_internal_custom_volume_copy
- disk_io_bus
- storage_cephfs_create_missing
- instance_move_config
- ovn_ssl_config
- certificate_description
api_status: stable
api_version: "1.0"
auth: trusted
public: false
auth_methods:
- tls
auth_user_name: ymo
auth_user_method: unix
environment:
  addresses: []
  architectures:
  - x86_64
  - i686
  certificate: |
    -----BEGIN CERTIFICATE-----
    MIIB+zCCAYGgAwIBAgIRAKiEeZzJigOFDrJmSKhAXrowCgYIKoZIzj0EAwMwMDEZ
    MBcGA1UEChMQTGludXggQ29udGFpbmVyczETMBEGA1UEAwwKcm9vdEB5bW9kdDAe
    Fw0yNDAyMjIxNDA2NTRaFw0zNDAyMTkxNDA2NTRaMDAxGTAXBgNVBAoTEExpbnV4
    IENvbnRhaW5lcnMxEzARBgNVBAMMCnJvb3RAeW1vZHQwdjAQBgcqhkjOPQIBBgUr
    gQQAIgNiAAQjRWGyQq4BxeVahSQTBj7VTQovjEPgm4+or8A0MqTOub3/V1eEoR0j
    FSr3z4D3+Qs1x9+QzsoaNNXXBXBnRzqmxjjE0Ilo69zdwRr7UgMM24mauvNKS/qM
    rQn6Ykx06AWjXzBdMA4GA1UdDwEB/wQEAwIFoDATBgNVHSUEDDAKBggrBgEFBQcD
    ATAMBgNVHRMBAf8EAjAAMCgGA1UdEQQhMB+CBXltb2R0hwR/AAABhxAAAAAAAAAA
    AAAAAAAAAAABMAoGCCqGSM49BAMDA2gAMGUCMQD2nT2LJZoGxmQjWs3hcjIkncHO
    NsmJhGQtta1IRnADa9NIWexGfN5kGKchtbQmgDkCMFnCKn0tE6cQSOJF+4wxBRNk
    VT72jIRA308JUlvrHe0pA/5lKQuS2ztvMdIFdsqRWA==
    -----END CERTIFICATE-----
  certificate_fingerprint: 66b5acb06587e96bca499b1c08425c41ff30100e499ff81f26f7551cbf76e32d
  driver: lxc | qemu
  driver_version: 4.0.12 | 8.1.5
  firewall: nftables
  kernel: Linux
  kernel_architecture: x86_64
  kernel_features:
    idmapped_mounts: "true"
    netnsid_getifaddrs: "true"
    seccomp_listener: "true"
    seccomp_listener_continue: "true"
    uevent_injection: "true"
    unpriv_fscaps: "true"
  kernel_version: 6.1.77
  lxc_features:
    cgroup2: "true"
    core_scheduling: "true"
    devpts_fd: "true"
    idmapped_mounts_v2: "true"
    mount_injection_file: "true"
    network_gateway_device_route: "true"
    network_ipvlan: "true"
    network_l2proxy: "true"
    network_phys_macvlan_mtu: "true"
    network_veth_router: "true"
    pidfd: "true"
    seccomp_allow_deny_syntax: "true"
    seccomp_notify: "true"
    seccomp_proxy_send_notify_fd: "true"
  os_name: NixOS
  os_version: "23.11"
  project: default
  server: incus
  server_clustered: false
  server_event_mode: full-mesh
  server_name: ymodt
  server_pid: 2294
  server_version: "0.4"
  storage: btrfs
  storage_version: 6.6.2
  storage_supported_drivers:
  - name: lvm
    version: 2.03.22(2) (2023-08-02) / 1.02.196 (2023-08-02) / 4.47.0
    remote: false
  - name: btrfs
    version: 6.6.2
    remote: false
  - name: dir
    version: "1"
    remote: false
ymolists commented 7 months ago

I am trying to see if i can reproduce this on a vm instead of a container

this is what i had to to start the vm incus launch images:nixos/23.11 nix00 --vm -c security.secureboot=false

the line where it says restarting the following units: dhcpcd.service took for ever but at least it did not fail. but for some reason no ipv4 was assigner again

-→ incus list 
+-------+---------+------+-------------------------------------------------+-----------------+-----------+
| NAME  |  STATE  | IPV4 |                      IPV6                       |      TYPE       | SNAPSHOTS |
+-------+---------+------+-------------------------------------------------+-----------------+-----------+
| nix00 | RUNNING |      | fd42:b8d8:ec7c:c832:571:953c:71ff:b456 (enp5s0) | VIRTUAL-MACHINE | 0         |
+-------+---------+------+-------------------------------------------------+-----------------+-----------+

[root@nixos:~]# ifconfig -a
enp5s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fd42:b8d8:ec7c:c832:571:953c:71ff:b456  prefixlen 64  scopeid 0x0<global>
        ether 00:16:3e:be:ad:ab  txqueuelen 1000  (Ethernet)
        RX packets 1162  bytes 1526882 (1.4 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 571  bytes 42759 (41.7 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 80  bytes 6400 (6.2 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 80  bytes 6400 (6.2 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
[root@nixos:~]# nixos-rebuild switch 
building Nix...
building the system configuration...
these 28 derivations will be built:
  /nix/store/q7al5yazr047xcxkp0yy6pcpjkm36x3i-stage-1-init.sh.drv
  /nix/store/7dvpvqr45ww71rcd83pkckir8qy4amqh-initrd-linux-6.1.78.drv
  /nix/store/0h33rwic75f5h3qmh4cp0j730h7v8fbb-boot.json.drv
  /nix/store/p7vng5f323jzgy8zpbhhi01f1iq9818v-configuration.nix.drv
  /nix/store/q32p1j6a456pia1qjizz5zhkjqv7igwb-nixos-23.11.4621.3cb4ae6689d2.drv
  /nix/store/33p5yj47r36byb9rnlwk7g6s961nvxfl-local-cmds.drv
  /nix/store/izc1c9nc7c8wpv9dl3wr4qqdaz6h2xii-etc-sysctl.d-60-nixos.conf.drv
  /nix/store/4kzqbnv071z7n2dmrxijmd3489zbrn61-X-Restart-Triggers-systemd-sysctl.drv
  /nix/store/3diywi7xc0309yrncaliw4pj8jbjwnyb-unit-systemd-sysctl.service.drv
  /nix/store/4nrnvby9a43hyrqykfk1wk46fah5i6br-localhost-hosts.drv
  /nix/store/5ax24a96vszyixw1732k1p6jz04r0s0i-unit-console-getty.service-disabled.drv
  /nix/store/6xa4pvzyq6sqyi6m21976hp4w5fgki6z-dhcpcd.conf.drv
  /nix/store/b9shna17jw7bazci3li56ijwbp6z3b5w-unit-dhcpcd.service.drv
  /nix/store/pm30mkyjp58p12r3vki8kipblfzn0kfb-unit-network-setup.service.drv
  /nix/store/hy2a80qzw9f14k4dnf3rwim0bl0948vc-unit-script-network-addresses-eth0-start.drv
  /nix/store/l1xx7g5nz755r3lfq4xcfkzdy19aqhmf-unit-script-network-addresses-eth0-pre-stop.drv
  /nix/store/qdzlrg56lmbnww2sczkgp51412zjvkll-unit-network-addresses-eth0.service.drv
  /nix/store/bid0zqmdv6kilrgxf7b3cfj2llrnw0si-system-units.drv
  /nix/store/ni4zh8ybv27fdyhsrwg23rwnh4q7za2k-string-hosts.drv
  /nix/store/q20rk6w1d40il7405b27miybmmxpcp74-extra-hosts.drv
  /nix/store/fdbfyj6wvscqgbz9xb8fsxgjxbcmascr-hosts.drv
  /nix/store/p22c2zbcplrgh2aqqc160ina1z0l9g1i-unit-40-eth0.link.drv
  /nix/store/qkkg0dzzi13ybpin0ksjla1gky3iim59-etc-hostname.drv
  /nix/store/vmmy0k0knl78qkpsgh79ny8jnbmqn47l-etc-nix-registry.json.drv
  /nix/store/a94cljq6gz50ibvrjh1hjf3clx8yxm46-etc.drv
  /nix/store/ars9a3179bm15sp88d3hgacxi3r8k4zw-stage-2-init.sh.drv
  /nix/store/gg7xcgqj7hdh01fw6rn1njj5a35y4fn7-ensure-all-wrappers-paths-exist.drv
  /nix/store/wgbff3jdcb9wxrh9qss31ja1mw5l1h5g-nixos-system-nix00-23.11.4621.3cb4ae6689d2.drv
these 13 paths will be fetched (1.36 MiB download, 11.53 MiB unpacked):
  /nix/store/9hnqz9y2b1j0199wzm6x5sc9ndr40g25-acl-2.3.1-dev
  /nix/store/c2277pwiqvhqrl5bjlvqjmmbjvasf7zj-attr-2.5.1-dev
  /nix/store/ix5miq4gfn07pbz9bx9g134ysx7zpqa0-busybox-1.36.1
  /nix/store/pnn6jdc0vk3y519h79kv72phh3p5cwmz-check-sshd-config
  /nix/store/vaxfvjxn5cydk56222dnzi9ka192g9js-file-5.45
  /nix/store/1xy5lmrra4nhd12afsqfid2951k5vd7x-gnu-config-2023-09-19
  /nix/store/rkv8vjbydj8sfd31plfdkfqy5g134glv-gnumake-4.4.1
  /nix/store/hfni297ldr14pb44lwbwxp84v2r65bzj-libarchive-3.7.2-dev
  /nix/store/iby70r19p5bws5wssq7xwbmxispn0j53-link-units
  /nix/store/lw1hcdzh8bdxym09krd4hq4cm6ksl8gx-lndir-1.0.4
  /nix/store/2cwm5mjdq4p3agjqm8k0641xi9s2rxv3-patchelf-0.15.0
  /nix/store/rrisfqxxibsyfkzg77hlbp7wxwhi3myy-stdenv-linux
  /nix/store/lidl4pi3fwjn7b5d2khj4g7wxwpxzjdm-update-autotools-gnu-config-scripts-hook
copying path '/nix/store/pnn6jdc0vk3y519h79kv72phh3p5cwmz-check-sshd-config' from 'https://cache.nixos.org'...
copying path '/nix/store/9hnqz9y2b1j0199wzm6x5sc9ndr40g25-acl-2.3.1-dev' from 'https://cache.nixos.org'...
copying path '/nix/store/c2277pwiqvhqrl5bjlvqjmmbjvasf7zj-attr-2.5.1-dev' from 'https://cache.nixos.org'...
copying path '/nix/store/ix5miq4gfn07pbz9bx9g134ysx7zpqa0-busybox-1.36.1' from 'https://cache.nixos.org'...
copying path '/nix/store/lw1hcdzh8bdxym09krd4hq4cm6ksl8gx-lndir-1.0.4' from 'https://cache.nixos.org'...
copying path '/nix/store/2cwm5mjdq4p3agjqm8k0641xi9s2rxv3-patchelf-0.15.0' from 'https://cache.nixos.org'...
copying path '/nix/store/iby70r19p5bws5wssq7xwbmxispn0j53-link-units' from 'https://cache.nixos.org'...
copying path '/nix/store/rkv8vjbydj8sfd31plfdkfqy5g134glv-gnumake-4.4.1' from 'https://cache.nixos.org'...
copying path '/nix/store/vaxfvjxn5cydk56222dnzi9ka192g9js-file-5.45' from 'https://cache.nixos.org'...
copying path '/nix/store/1xy5lmrra4nhd12afsqfid2951k5vd7x-gnu-config-2023-09-19' from 'https://cache.nixos.org'...
copying path '/nix/store/hfni297ldr14pb44lwbwxp84v2r65bzj-libarchive-3.7.2-dev' from 'https://cache.nixos.org'...
copying path '/nix/store/lidl4pi3fwjn7b5d2khj4g7wxwpxzjdm-update-autotools-gnu-config-scripts-hook' from 'https://cache.nixos.org'...
copying path '/nix/store/rrisfqxxibsyfkzg77hlbp7wxwhi3myy-stdenv-linux' from 'https://cache.nixos.org'...
building '/nix/store/p7vng5f323jzgy8zpbhhi01f1iq9818v-configuration.nix.drv'...
building '/nix/store/6xa4pvzyq6sqyi6m21976hp4w5fgki6z-dhcpcd.conf.drv'...
building '/nix/store/gg7xcgqj7hdh01fw6rn1njj5a35y4fn7-ensure-all-wrappers-paths-exist.drv'...
Checking that Nix store paths of all wrapped programs exist... OK
building '/nix/store/qkkg0dzzi13ybpin0ksjla1gky3iim59-etc-hostname.drv'...
building '/nix/store/izc1c9nc7c8wpv9dl3wr4qqdaz6h2xii-etc-sysctl.d-60-nixos.conf.drv'...
building '/nix/store/q20rk6w1d40il7405b27miybmmxpcp74-extra-hosts.drv'...
building '/nix/store/4kzqbnv071z7n2dmrxijmd3489zbrn61-X-Restart-Triggers-systemd-sysctl.drv'...
building '/nix/store/4nrnvby9a43hyrqykfk1wk46fah5i6br-localhost-hosts.drv'...
building '/nix/store/q32p1j6a456pia1qjizz5zhkjqv7igwb-nixos-23.11.4621.3cb4ae6689d2.drv'...
building '/nix/store/q7al5yazr047xcxkp0yy6pcpjkm36x3i-stage-1-init.sh.drv'...
checking syntax
building '/nix/store/vmmy0k0knl78qkpsgh79ny8jnbmqn47l-etc-nix-registry.json.drv'...
building '/nix/store/7dvpvqr45ww71rcd83pkckir8qy4amqh-initrd-linux-6.1.78.drv'...
building '/nix/store/33p5yj47r36byb9rnlwk7g6s961nvxfl-local-cmds.drv'...
building '/nix/store/0h33rwic75f5h3qmh4cp0j730h7v8fbb-boot.json.drv'...
building '/nix/store/ars9a3179bm15sp88d3hgacxi3r8k4zw-stage-2-init.sh.drv'...
building '/nix/store/ni4zh8ybv27fdyhsrwg23rwnh4q7za2k-string-hosts.drv'...
building '/nix/store/p22c2zbcplrgh2aqqc160ina1z0l9g1i-unit-40-eth0.link.drv'...
building '/nix/store/fdbfyj6wvscqgbz9xb8fsxgjxbcmascr-hosts.drv'...
building '/nix/store/5ax24a96vszyixw1732k1p6jz04r0s0i-unit-console-getty.service-disabled.drv'...
building '/nix/store/b9shna17jw7bazci3li56ijwbp6z3b5w-unit-dhcpcd.service.drv'...
building '/nix/store/pm30mkyjp58p12r3vki8kipblfzn0kfb-unit-network-setup.service.drv'...
building '/nix/store/l1xx7g5nz755r3lfq4xcfkzdy19aqhmf-unit-script-network-addresses-eth0-pre-stop.drv'...
building '/nix/store/hy2a80qzw9f14k4dnf3rwim0bl0948vc-unit-script-network-addresses-eth0-start.drv'...
building '/nix/store/3diywi7xc0309yrncaliw4pj8jbjwnyb-unit-systemd-sysctl.service.drv'...
building '/nix/store/qdzlrg56lmbnww2sczkgp51412zjvkll-unit-network-addresses-eth0.service.drv'...
building '/nix/store/bid0zqmdv6kilrgxf7b3cfj2llrnw0si-system-units.drv'...
building '/nix/store/a94cljq6gz50ibvrjh1hjf3clx8yxm46-etc.drv'...
building '/nix/store/wgbff3jdcb9wxrh9qss31ja1mw5l1h5g-nixos-system-nix00-23.11.4621.3cb4ae6689d2.drv'...
stopping the following units: network-addresses-enp5s0.service, network-setup.service, systemd-sysctl.service
activating the configuration...
setting up /etc...
removing obsolete symlink ‘/etc/systemd/network/40-enp5s0.link’...
setting up tmpfiles
restarting the following units: dhcpcd.service

starting the following units: network-setup.service, systemd-sysctl.service
stgraber commented 7 months ago

For the container, the issue may be some kernel modules that aren't loaded. If you can figure out which ones you need, you can set them through the linux.kernel_modules config key.

In general, the issues you're reporting are likely to either be configuration/environment type issues that can be solved through configuration or an issue with the image itself. The NixOS images are directly built by the Nix project and we just publish them.

I'm closing the issue as I don't think there is anything actionable for us to do in Incus right now, but that's not to say that you can't keep posting your findings here, I'm sure both @adamcstephens and myself will keep helping getting things working for you!

adamcstephens commented 7 months ago

As stgraber mentioned in the other issue, it may be better to post support issues such as this on the forum first. Either the Linux containers forum or the NixOS discourse. Feel free to ping me on either of these for nixos+incus interactions.

ymolists commented 7 months ago

... Feel free to ping me on either of these for nixos+incus interactions.

https://discuss.linuxcontainers.org/t/trying-to-do-nixos-rebuild-switch-inside-a-fresh-nixos-container-fails-with-failed-to-start-firewall/19142

@adamcstephens I just created that issue . .thanks again for offereing