Flags `--property` & `-f` and option `source.wipe` don't work

[just-doks]

Required information

• Distribution: Linux Debian Bookworm
• Distribution version: 12.1
• The output of "lxc info" or if that fails:
  • Kernel version: 6.1.0-12-amd64
  • LXC version: 5.0.2
  • LXD version: 5.0.2-5
  • Storage backend in use: LVM, ext4 under OS, btrfs for storage pool

Issue description/steps to reproduce

Hello. Let me describe, what I did and what I got after that:

0. Reinstalled Debian 12.1; 0.1. during the install:
   • /boot on primary partition;
   • swap and /root on LVM logical volumes;
   • leave free space on volume group;
1. installed lxd package: sudo apt install lxd;
2. installed btrfs package: sudo apt install btrfs-progs;
3. run init command: sudo lxd init;
4. configured managed network (lxdbr0) and btrfs pool using lvm logical volume during init;
5. run launching command: sudo lxc launch images:debian/12 deb-container;
6. stopped instance;

First issue: flag --property doesn't work.

1. I tried to get some basic properties: sudo lxc config get deb-container name --property;
2. received error: Error: unknown flag: --property; I expected to get deb-container.

How to reproduce: just do everything I described above.

Second issue: flag -f & option storage.wipe=true don't work.

1. I tried to create storage pool manually using lvm logical volume, that was used before. 1.1. When I tried to create pool without additional options, I got error: Command: sudo lxc storage create pool2 btrfs source=/dev/vg1/lv1-5gb; Response: Error: Failed to format block device: Failed to run: mkfs.btrfs -L pool2 /dev/vg1/lv1-5gb: exit status 1 (ERROR: /dev/vg1/lv1-5gb appears to contain a partition table (dos) ERROR: use the -f option to force overwrite of /dev/vg1/lv1-5gb); 1.2. Then I tried to set recommended option source.wipe=true but I got another error: Command: sudo lxc storage create pool2 btrfs source=/dev/vg1/lv1-5gb source.wipe=true Response: Error: Invalid option "source.wipe"; 1.3. When I tried to use recommended flag -f I got one more error: Command: sudo lxc storage create pool2 btrfs source=/dev/vg1/lv1-5gb -f; Response: Error: unknown shorthand flag: 'f' in -f; I expected to get a ready to use storage pool.

By running command: sudo wipefs -af /dev/vg1/lv1-5gb - this solves the problem, but the issue is still there.

How to reproduce:

1. Create btrfs storage pool on empty lvm logical volume;
2. Delete that storage pool using lxc commands;
3. Create new storage pool on the same lvm logical volume.

I reported about those issues to debian maintainers, but they think I should report about it here. https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1052318

Information to attach

• The output of "lxc info":

  doks@deb-workstation:~$ sudo lxc info
  config:
  images.auto_update_interval: "0"
  api_extensions:
  - storage_zfs_remove_snapshots
  - container_host_shutdown_timeout
  - container_stop_priority
  - container_syscall_filtering
  - auth_pki
  - container_last_used_at
  - etag
  - patch
  - usb_devices
  - https_allowed_credentials
  - image_compression_algorithm
  - directory_manipulation
  - container_cpu_time
  - storage_zfs_use_refquota
  - storage_lvm_mount_options
  - network
  - profile_usedby
  - container_push
  - container_exec_recording
  - certificate_update
  - container_exec_signal_handling
  - gpu_devices
  - container_image_properties
  - migration_progress
  - id_map
  - network_firewall_filtering
  - network_routes
  - storage
  - file_delete
  - file_append
  - network_dhcp_expiry
  - storage_lvm_vg_rename
  - storage_lvm_thinpool_rename
  - network_vlan
  - image_create_aliases
  - container_stateless_copy
  - container_only_migration
  - storage_zfs_clone_copy
  - unix_device_rename
  - storage_lvm_use_thinpool
  - storage_rsync_bwlimit
  - network_vxlan_interface
  - storage_btrfs_mount_options
  - entity_description
  - image_force_refresh
  - storage_lvm_lv_resizing
  - id_map_base
  - file_symlinks
  - container_push_target
  - network_vlan_physical
  - storage_images_delete
  - container_edit_metadata
  - container_snapshot_stateful_migration
  - storage_driver_ceph
  - storage_ceph_user_name
  - resource_limits
  - storage_volatile_initial_source
  - storage_ceph_force_osd_reuse
  - storage_block_filesystem_btrfs
  - resources
  - kernel_limits
  - storage_api_volume_rename
  - macaroon_authentication
  - network_sriov
  - console
  - restrict_devlxd
  - migration_pre_copy
  - infiniband
  - maas_network
  - devlxd_events
  - proxy
  - network_dhcp_gateway
  - file_get_symlink
  - network_leases
  - unix_device_hotplug
  - storage_api_local_volume_handling
  - operation_description
  - clustering
  - event_lifecycle
  - storage_api_remote_volume_handling
  - nvidia_runtime
  - container_mount_propagation
  - container_backup
  - devlxd_images
  - container_local_cross_pool_handling
  - proxy_unix
  - proxy_udp
  - clustering_join
  - proxy_tcp_udp_multi_port_handling
  - network_state
  - proxy_unix_dac_properties
  - container_protection_delete
  - unix_priv_drop
  - pprof_http
  - proxy_haproxy_protocol
  - network_hwaddr
  - proxy_nat
  - network_nat_order
  - container_full
  - candid_authentication
  - backup_compression
  - candid_config
  - nvidia_runtime_config
  - storage_api_volume_snapshots
  - storage_unmapped
  - projects
  - candid_config_key
  - network_vxlan_ttl
  - container_incremental_copy
  - usb_optional_vendorid
  - snapshot_scheduling
  - snapshot_schedule_aliases
  - container_copy_project
  - clustering_server_address
  - clustering_image_replication
  - container_protection_shift
  - snapshot_expiry
  - container_backup_override_pool
  - snapshot_expiry_creation
  - network_leases_location
  - resources_cpu_socket
  - resources_gpu
  - resources_numa
  - kernel_features
  - id_map_current
  - event_location
  - storage_api_remote_volume_snapshots
  - network_nat_address
  - container_nic_routes
  - rbac
  - cluster_internal_copy
  - seccomp_notify
  - lxc_features
  - container_nic_ipvlan
  - network_vlan_sriov
  - storage_cephfs
  - container_nic_ipfilter
  - resources_v2
  - container_exec_user_group_cwd
  - container_syscall_intercept
  - container_disk_shift
  - storage_shifted
  - resources_infiniband
  - daemon_storage
  - instances
  - image_types
  - resources_disk_sata
  - clustering_roles
  - images_expiry
  - resources_network_firmware
  - backup_compression_algorithm
  - ceph_data_pool_name
  - container_syscall_intercept_mount
  - compression_squashfs
  - container_raw_mount
  - container_nic_routed
  - container_syscall_intercept_mount_fuse
  - container_disk_ceph
  - virtual-machines
  - image_profiles
  - clustering_architecture
  - resources_disk_id
  - storage_lvm_stripes
  - vm_boot_priority
  - unix_hotplug_devices
  - api_filtering
  - instance_nic_network
  - clustering_sizing
  - firewall_driver
  - projects_limits
  - container_syscall_intercept_hugetlbfs
  - limits_hugepages
  - container_nic_routed_gateway
  - projects_restrictions
  - custom_volume_snapshot_expiry
  - volume_snapshot_scheduling
  - trust_ca_certificates
  - snapshot_disk_usage
  - clustering_edit_roles
  - container_nic_routed_host_address
  - container_nic_ipvlan_gateway
  - resources_usb_pci
  - resources_cpu_threads_numa
  - resources_cpu_core_die
  - api_os
  - container_nic_routed_host_table
  - container_nic_ipvlan_host_table
  - container_nic_ipvlan_mode
  - resources_system
  - images_push_relay
  - network_dns_search
  - container_nic_routed_limits
  - instance_nic_bridged_vlan
  - network_state_bond_bridge
  - usedby_consistency
  - custom_block_volumes
  - clustering_failure_domains
  - resources_gpu_mdev
  - console_vga_type
  - projects_limits_disk
  - network_type_macvlan
  - network_type_sriov
  - container_syscall_intercept_bpf_devices
  - network_type_ovn
  - projects_networks
  - projects_networks_restricted_uplinks
  - custom_volume_backup
  - backup_override_name
  - storage_rsync_compression
  - network_type_physical
  - network_ovn_external_subnets
  - network_ovn_nat
  - network_ovn_external_routes_remove
  - tpm_device_type
  - storage_zfs_clone_copy_rebase
  - gpu_mdev
  - resources_pci_iommu
  - resources_network_usb
  - resources_disk_address
  - network_physical_ovn_ingress_mode
  - network_ovn_dhcp
  - network_physical_routes_anycast
  - projects_limits_instances
  - network_state_vlan
  - instance_nic_bridged_port_isolation
  - instance_bulk_state_change
  - network_gvrp
  - instance_pool_move
  - gpu_sriov
  - pci_device_type
  - storage_volume_state
  - network_acl
  - migration_stateful
  - disk_state_quota
  - storage_ceph_features
  - projects_compression
  - projects_images_remote_cache_expiry
  - certificate_project
  - network_ovn_acl
  - projects_images_auto_update
  - projects_restricted_cluster_target
  - images_default_architecture
  - network_ovn_acl_defaults
  - gpu_mig
  - project_usage
  - network_bridge_acl
  - warnings
  - projects_restricted_backups_and_snapshots
  - clustering_join_token
  - clustering_description
  - server_trusted_proxy
  - clustering_update_cert
  - storage_api_project
  - server_instance_driver_operational
  - server_supported_storage_drivers
  - event_lifecycle_requestor_address
  - resources_gpu_usb
  - clustering_evacuation
  - network_ovn_nat_address
  - network_bgp
  - network_forward
  - custom_volume_refresh
  - network_counters_errors_dropped
  - metrics
  - image_source_project
  - clustering_config
  - network_peer
  - linux_sysctl
  - network_dns
  - ovn_nic_acceleration
  - certificate_self_renewal
  - instance_project_move
  - storage_volume_project_move
  - cloud_init
  - network_dns_nat
  - database_leader
  - instance_all_projects
  - clustering_groups
  - ceph_rbd_du
  - instance_get_full
  - qemu_metrics
  - gpu_mig_uuid
  - event_project
  - clustering_evacuation_live
  - instance_allow_inconsistent_copy
  - network_state_ovn
  - storage_volume_api_filtering
  - image_restrictions
  - storage_zfs_export
  - network_dns_records
  - storage_zfs_reserve_space
  - network_acl_log
  - storage_zfs_blocksize
  - metrics_cpu_seconds
  - instance_snapshot_never
  - certificate_token
  - instance_nic_routed_neighbor_probe
  - event_hub
  - agent_nic_config
  - projects_restricted_intercept
  - metrics_authentication
  - images_target_project
  - cluster_migration_inconsistent_copy
  - cluster_ovn_chassis
  - container_syscall_intercept_sched_setscheduler
  - storage_lvm_thinpool_metadata_size
  - storage_volume_state_total
  - instance_file_head
  - resources_pci_vpd
  - qemu_raw_conf
  - storage_cephfs_fscache
  - vsock_api
  - storage_volumes_all_projects
  - projects_networks_restricted_access
  - cluster_join_token_expiry
  - remote_token_expiry
  - init_preseed
  - cpu_hotplug
  api_status: stable
  api_version: "1.0"
  auth: trusted
  public: false
  auth_methods:
  - tls
  environment:
  addresses: []
  architectures:
  - x86_64
  - i686
  certificate: |
  -----BEGIN CERTIFICATE-----
  blah-blah I removed it. - @doks
  -----END CERTIFICATE-----
  certificate_fingerprint: is it sensitive info? idk. Removed. - @doks
  driver: lxc
  driver_version: 5.0.2
  firewall: nftables
  kernel: Linux
  kernel_architecture: x86_64
  kernel_features:
  idmapped_mounts: "true"
  netnsid_getifaddrs: "true"
  seccomp_listener: "true"
  seccomp_listener_continue: "true"
  shiftfs: "false"
  uevent_injection: "true"
  unpriv_fscaps: "true"
  kernel_version: 6.1.0-12-amd64
  lxc_features:
  cgroup2: "true"
  core_scheduling: "true"
  devpts_fd: "true"
  idmapped_mounts_v2: "true"
  mount_injection_file: "true"
  network_gateway_device_route: "true"
  network_ipvlan: "true"
  network_l2proxy: "true"
  network_phys_macvlan_mtu: "true"
  network_veth_router: "true"
  pidfd: "true"
  seccomp_allow_deny_syntax: "true"
  seccomp_notify: "true"
  seccomp_proxy_send_notify_fd: "true"
  os_name: Debian GNU/Linux
  os_version: "12"
  project: default
  server: lxd
  server_clustered: false
  server_event_mode: full-mesh
  server_name: deb-workstation
  server_pid: 12149
  server_version: 5.0.2
  storage: btrfs
  storage_version: "6.2"
  storage_supported_drivers:
  - name: dir
  version: "1"
  remote: false
  - name: lvm
  version: 2.03.16(2) (2022-05-18) / 1.02.185 (2022-05-18) / 4.47.0
  remote: false
  - name: btrfs
  version: "6.2"
  remote: false

• Any relevant kernel output (dmesg) No

• Container log (lxc info NAME --show-log) Nothing

• Container configuration (lxc config show NAME --expanded):

  doks@deb-workstation:~$ sudo lxc config show deb-ca --expanded
  architecture: x86_64
  config:
  image.architecture: amd64
  image.description: Debian bookworm amd64 (20230917_05:24)
  image.os: Debian
  image.release: bookworm
  image.serial: "20230917_05:24"
  image.type: squashfs
  image.variant: default
  volatile.apply_template: rename
  volatile.base_image: 0c76888885052cee2b99f4cfc9ebdf1ad20faea94a20e41109b4695629ac1363
  volatile.cloud-init.instance-id: 2a343c79-59df-447e-9cc2-c35a2bdf95d8
  volatile.eth0.hwaddr: 00:16:3e:5d:37:b3
  volatile.idmap.base: "0"
  volatile.idmap.current: '[{"Isuid":true,"Isgid":false,"Hostid":165536,"Nsid":0,"Maprange":10000001},{"Isuid":false,"Isgid":true,"Hostid":165536,"Nsid":0,"Maprange":10000001}]'
  volatile.idmap.next: '[{"Isuid":true,"Isgid":false,"Hostid":165536,"Nsid":0,"Maprange":10000001},{"Isuid":false,"Isgid":true,"Hostid":165536,"Nsid":0,"Maprange":10000001}]'
  volatile.last_state.idmap: '[]'
  volatile.last_state.power: STOPPED
  volatile.uuid: d55cf719-d53e-49e0-ad6e-ab90ddc56dbc
  devices:
  eth0:
  name: eth0
  network: lxdbr0
  type: nic
  root:
  path: /
  pool: pool1
  type: disk
  ephemeral: false
  profiles:
  - default
  stateful: false
  description: ""

• Main daemon log (at /var/log/lxd/lxd.log or /var/snap/lxd/common/lxd/logs/lxd.log) Attached (at least I did it) lxd.log

  • Output of the client with --debug What?
  • Output of the daemon with --debug (alternatively output of lxc monitor while reproducing the issue) Useless

[tomponline]

@gabrielmougard please can you look into this one when you can, thanks

[tomponline]

@gabrielmougard did you confirm if this is an issue yet or not? Thanks

[MusicDin]

@tomponline Could this be a backport issue to 5.0.2?

---

On lxd 5.0.2 there is no flag --property/-p. Even lxc config get --help does not contain it, however, it is described in docs under 5.0 stable.

On lxd 5.18:

$ lxc config get c1 ephemeral --property
false
$ lxc config set c1 ephemeral=true --property
$ lxc config get c1 ephemeral --property
true

Similar for the source.wipe.

---

For lxc create storage <storange_name> <driver>, I am not aware of -f flag in any of the versions.

[tomponline]

The use the -f option to force part of the error is coming from mkfs.btrfs and isn't coming from LXD.

[tomponline]

The source.wipe option has been backported to stable-5.0 but has not been released yet. It will be in LXD 5.0.3.