search

canonical / lxd

Powerful system container and virtual machine manager
https://canonical.com/lxd
GNU Affero General Public License v3.0
4.35k stars 930 forks source link

vm import fails with no message if the size of the vm is bigger #14256

Open mindtheegab opened 2 days ago

mindtheegab commented 2 days ago

Required information

lxc info
config:
  core.https_address: :8443
api_extensions:
- storage_zfs_remove_snapshots
- container_host_shutdown_timeout
- container_stop_priority
- container_syscall_filtering
- auth_pki
- container_last_used_at
- etag
- patch
- usb_devices
- https_allowed_credentials
- image_compression_algorithm
- directory_manipulation
- container_cpu_time
- storage_zfs_use_refquota
- storage_lvm_mount_options
- network
- profile_usedby
- container_push
- container_exec_recording
- certificate_update
- container_exec_signal_handling
- gpu_devices
- container_image_properties
- migration_progress
- id_map
- network_firewall_filtering
- network_routes
- storage
- file_delete
- file_append
- network_dhcp_expiry
- storage_lvm_vg_rename
- storage_lvm_thinpool_rename
- network_vlan
- image_create_aliases
- container_stateless_copy
- container_only_migration
- storage_zfs_clone_copy
- unix_device_rename
- storage_lvm_use_thinpool
- storage_rsync_bwlimit
- network_vxlan_interface
- storage_btrfs_mount_options
- entity_description
- image_force_refresh
- storage_lvm_lv_resizing
- id_map_base
- file_symlinks
- container_push_target
- network_vlan_physical
- storage_images_delete
- container_edit_metadata
- container_snapshot_stateful_migration
- storage_driver_ceph
- storage_ceph_user_name
- resource_limits
- storage_volatile_initial_source
- storage_ceph_force_osd_reuse
- storage_block_filesystem_btrfs
- resources
- kernel_limits
- storage_api_volume_rename
- network_sriov
- console
- restrict_devlxd
- migration_pre_copy
- infiniband
- maas_network
- devlxd_events
- proxy
- network_dhcp_gateway
- file_get_symlink
- network_leases
- unix_device_hotplug
- storage_api_local_volume_handling
- operation_description
- clustering
- event_lifecycle
- storage_api_remote_volume_handling
- nvidia_runtime
- container_mount_propagation
- container_backup
- devlxd_images
- container_local_cross_pool_handling
- proxy_unix
- proxy_udp
- clustering_join
- proxy_tcp_udp_multi_port_handling
- network_state
- proxy_unix_dac_properties
- container_protection_delete
- unix_priv_drop
- pprof_http
- proxy_haproxy_protocol
- network_hwaddr
- proxy_nat
- network_nat_order
- container_full
- backup_compression
- nvidia_runtime_config
- storage_api_volume_snapshots
- storage_unmapped
- projects
- network_vxlan_ttl
- container_incremental_copy
- usb_optional_vendorid
- snapshot_scheduling
- snapshot_schedule_aliases
- container_copy_project
- clustering_server_address
- clustering_image_replication
- container_protection_shift
- snapshot_expiry
- container_backup_override_pool
- snapshot_expiry_creation
- network_leases_location
- resources_cpu_socket
- resources_gpu
- resources_numa
- kernel_features
- id_map_current
- event_location
- storage_api_remote_volume_snapshots
- network_nat_address
- container_nic_routes
- cluster_internal_copy
- seccomp_notify
- lxc_features
- container_nic_ipvlan
- network_vlan_sriov
- storage_cephfs
- container_nic_ipfilter
- resources_v2
- container_exec_user_group_cwd
- container_syscall_intercept
- container_disk_shift
- storage_shifted
- resources_infiniband
- daemon_storage
- instances
- image_types
- resources_disk_sata
- clustering_roles
- images_expiry
- resources_network_firmware
- backup_compression_algorithm
- ceph_data_pool_name
- container_syscall_intercept_mount
- compression_squashfs
- container_raw_mount
- container_nic_routed
- container_syscall_intercept_mount_fuse
- container_disk_ceph
- virtual-machines
- image_profiles
- clustering_architecture
- resources_disk_id
- storage_lvm_stripes
- vm_boot_priority
- unix_hotplug_devices
- api_filtering
- instance_nic_network
- clustering_sizing
- firewall_driver
- projects_limits
- container_syscall_intercept_hugetlbfs
- limits_hugepages
- container_nic_routed_gateway
- projects_restrictions
- custom_volume_snapshot_expiry
- volume_snapshot_scheduling
- trust_ca_certificates
- snapshot_disk_usage
- clustering_edit_roles
- container_nic_routed_host_address
- container_nic_ipvlan_gateway
- resources_usb_pci
- resources_cpu_threads_numa
- resources_cpu_core_die
- api_os
- container_nic_routed_host_table
- container_nic_ipvlan_host_table
- container_nic_ipvlan_mode
- resources_system
- images_push_relay
- network_dns_search
- container_nic_routed_limits
- instance_nic_bridged_vlan
- network_state_bond_bridge
- usedby_consistency
- custom_block_volumes
- clustering_failure_domains
- resources_gpu_mdev
- console_vga_type
- projects_limits_disk
- network_type_macvlan
- network_type_sriov
- container_syscall_intercept_bpf_devices
- network_type_ovn
- projects_networks
- projects_networks_restricted_uplinks
- custom_volume_backup
- backup_override_name
- storage_rsync_compression
- network_type_physical
- network_ovn_external_subnets
- network_ovn_nat
- network_ovn_external_routes_remove
- tpm_device_type
- storage_zfs_clone_copy_rebase
- gpu_mdev
- resources_pci_iommu
- resources_network_usb
- resources_disk_address
- network_physical_ovn_ingress_mode
- network_ovn_dhcp
- network_physical_routes_anycast
- projects_limits_instances
- network_state_vlan
- instance_nic_bridged_port_isolation
- instance_bulk_state_change
- network_gvrp
- instance_pool_move
- gpu_sriov
- pci_device_type
- storage_volume_state
- network_acl
- migration_stateful
- disk_state_quota
- storage_ceph_features
- projects_compression
- projects_images_remote_cache_expiry
- certificate_project
- network_ovn_acl
- projects_images_auto_update
- projects_restricted_cluster_target
- images_default_architecture
- network_ovn_acl_defaults
- gpu_mig
- project_usage
- network_bridge_acl
- warnings
- projects_restricted_backups_and_snapshots
- clustering_join_token
- clustering_description
- server_trusted_proxy
- clustering_update_cert
- storage_api_project
- server_instance_driver_operational
- server_supported_storage_drivers
- event_lifecycle_requestor_address
- resources_gpu_usb
- clustering_evacuation
- network_ovn_nat_address
- network_bgp
- network_forward
- custom_volume_refresh
- network_counters_errors_dropped
- metrics
- image_source_project
- clustering_config
- network_peer
- linux_sysctl
- network_dns
- ovn_nic_acceleration
- certificate_self_renewal
- instance_project_move
- storage_volume_project_move
- cloud_init
- network_dns_nat
- database_leader
- instance_all_projects
- clustering_groups
- ceph_rbd_du
- instance_get_full
- qemu_metrics
- gpu_mig_uuid
- event_project
- clustering_evacuation_live
- instance_allow_inconsistent_copy
- network_state_ovn
- storage_volume_api_filtering
- image_restrictions
- storage_zfs_export
- network_dns_records
- storage_zfs_reserve_space
- network_acl_log
- storage_zfs_blocksize
- metrics_cpu_seconds
- instance_snapshot_never
- certificate_token
- instance_nic_routed_neighbor_probe
- event_hub
- agent_nic_config
- projects_restricted_intercept
- metrics_authentication
- images_target_project
- cluster_migration_inconsistent_copy
- cluster_ovn_chassis
- container_syscall_intercept_sched_setscheduler
- storage_lvm_thinpool_metadata_size
- storage_volume_state_total
- instance_file_head
- instances_nic_host_name
- image_copy_profile
- container_syscall_intercept_sysinfo
- clustering_evacuation_mode
- resources_pci_vpd
- qemu_raw_conf
- storage_cephfs_fscache
- network_load_balancer
- vsock_api
- instance_ready_state
- network_bgp_holdtime
- storage_volumes_all_projects
- metrics_memory_oom_total
- storage_buckets
- storage_buckets_create_credentials
- metrics_cpu_effective_total
- projects_networks_restricted_access
- storage_buckets_local
- loki
- acme
- internal_metrics
- cluster_join_token_expiry
- remote_token_expiry
- init_preseed
- storage_volumes_created_at
- cpu_hotplug
- projects_networks_zones
- network_txqueuelen
- cluster_member_state
- instances_placement_scriptlet
- storage_pool_source_wipe
- zfs_block_mode
- instance_generation_id
- disk_io_cache
- amd_sev
- storage_pool_loop_resize
- migration_vm_live
- ovn_nic_nesting
- oidc
- network_ovn_l3only
- ovn_nic_acceleration_vdpa
- cluster_healing
- instances_state_total
- auth_user
- security_csm
- instances_rebuild
- numa_cpu_placement
- custom_volume_iso
- network_allocations
- storage_api_remote_volume_snapshot_copy
- zfs_delegate
- operations_get_query_all_projects
- metadata_configuration
- syslog_socket
- event_lifecycle_name_and_project
- instances_nic_limits_priority
- disk_initial_volume_configuration
- operation_wait
- cluster_internal_custom_volume_copy
- disk_io_bus
- storage_cephfs_create_missing
- instance_move_config
- ovn_ssl_config
- init_preseed_storage_volumes
- metrics_instances_count
- server_instance_type_info
- resources_disk_mounted
- server_version_lts
- oidc_groups_claim
- loki_config_instance
- storage_volatile_uuid
- import_instance_devices
- instances_uefi_vars
- instances_migration_stateful
- container_syscall_filtering_allow_deny_syntax
- access_management
- vm_disk_io_limits
- storage_volumes_all
- instances_files_modify_permissions
- image_restriction_nesting
- container_syscall_intercept_finit_module
- device_usb_serial
- network_allocate_external_ips
- explicit_trust_token
api_status: stable
api_version: "1.0"
auth: trusted
public: false
auth_methods:
- tls
auth_user_name: root
auth_user_method: unix
environment:
  addresses:
  - 192.168.10.67:8443
  - '[2a02:908:c20a:1c10:3673:5aff:fec9:f77c]:8443'
  - 10.128.48.1:8443
  - '[fd42:969c:da3c:73a2::1]:8443'
  architectures:
  - x86_64
  - i686
  certificate: |
    -----BEGIN CERTIFICATE-----
    MIIB5zCCAWygAwIBAgIQQLwQTJY9pUaH/ZC37CmKpTAKBggqhkjOPQQDAzAlMQww
    CgYDVQQKEwNMWEQxFTATBgNVBAMMDHJvb3RAbHhkdGVtcDAeFw0yNDEwMDkwOTIx
    MjlaFw0zNDEwMDcwOTIxMjlaMCUxDDAKBgNVBAoTA0xYRDEVMBMGA1UEAwwMcm9v
    dEBseGR0ZW1wMHYwEAYHKoZIzj0CAQYFK4EEACIDYgAEipP0s9ICjvW8IdqE6v71
    X9Xx8CsWjwSHhg2lvJmrbKhQYqCgqD+GNbN/Bs38T5F2SPo2I44+VjQwqIGfP1Qn
    t1you5Qg3fTC3bIF4YN6WfwT1drVcH8JnKt0m3LaSC3yo2EwXzAOBgNVHQ8BAf8E
    BAMCBaAwEwYDVR0lBAwwCgYIKwYBBQUHAwEwDAYDVR0TAQH/BAIwADAqBgNVHREE
    IzAhggdseGR0ZW1whwR/AAABhxAAAAAAAAAAAAAAAAAAAAABMAoGCCqGSM49BAMD
    A2kAMGYCMQDlwz8l6+N2TkeqY8NdFSN3sQjjmDfiNUbGs6hN/+OS4G5X0GKFMfue
    hGGu7UzWMccCMQCRlQuN9D6J+AIgYODZhKr0vMg/vHjild3yucZ8RGnG42AEe0Zu
    LFe1P5KCBpWYaf4=
    -----END CERTIFICATE-----
  certificate_fingerprint: b809c6f8bafc0c67cdda9fcf24360f26b96b5c83052c5b9e136e1066fc35a51a
  driver: lxc | qemu
  driver_version: 6.0.0 | 8.2.1
  instance_types:
  - container
  - virtual-machine
  firewall: nftables
  kernel: Linux
  kernel_architecture: x86_64
  kernel_features:
    idmapped_mounts: "true"
    netnsid_getifaddrs: "true"
    seccomp_listener: "true"
    seccomp_listener_continue: "true"
    uevent_injection: "true"
    unpriv_fscaps: "true"
  kernel_version: 6.8.0-45-generic
  lxc_features:
    cgroup2: "true"
    core_scheduling: "true"
    devpts_fd: "true"
    idmapped_mounts_v2: "true"
    mount_injection_file: "true"
    network_gateway_device_route: "true"
    network_ipvlan: "true"
    network_l2proxy: "true"
    network_phys_macvlan_mtu: "true"
    network_veth_router: "true"
    pidfd: "true"
    seccomp_allow_deny_syntax: "true"
    seccomp_notify: "true"
    seccomp_proxy_send_notify_fd: "true"
  os_name: Ubuntu
  os_version: "24.04"
  project: default
  server: lxd
  server_clustered: false
  server_event_mode: full-mesh
  server_name: lxdtemp
  server_pid: 1329
  server_version: 5.21.2
  server_lts: true
  storage: zfs
  storage_version: 2.2.2-0ubuntu9
  storage_supported_drivers:
  - name: ceph
    version: 17.2.7
    remote: true
  - name: cephfs
    version: 17.2.7
    remote: true
  - name: cephobject
    version: 17.2.7
    remote: true
  - name: dir
    version: "1"
    remote: false
  - name: lvm
    version: 2.03.11(2) (2021-01-08) / 1.02.175 (2021-01-08) / 4.48.0
    remote: false
  - name: powerflex
    version: 1.16 (nvme-cli)
    remote: true
  - name: zfs
    version: 2.2.2-0ubuntu9
    remote: false
  - name: btrfs
    version: 5.16.2
    remote: false

Issue description

the default size of 10gix is not communicated

Steps to reproduce

  1. start importing a vm with Bin.linux.lxd-migrate.x86_64 that is bigger than 10gb
  2. choose defaults settings
  3. watch the crash

Information to attach

Please provide LXD server URL: 192.168.10.67
Certificate fingerprint: b809c6f8bafc0c67cdda9fcf24360f26b96b5c83052c5b9e136e1066fc35a51a
ok (y/n)? y

1) Use a certificate token
2) Use an existing TLS authentication certificate
3) Generate a temporary TLS authentication certificate
Please pick an authentication mechanism above: 3

Your temporary certificate is:
-----BEGIN CERTIFICATE-----
MIIBvTCCAUKgAwIBAgIQKuaZwa5/Up6QOLWHiZClajAKBggqhkjOPQQDAzAmMQww
CgYDVQQKEwNMWEQxFjAUBgNVBAMMDXJvb3RAZGVkdWdyYWYwHhcNMjQxMDEwMDkx
MzUzWhcNMzQxMDA4MDkxMzUzWjAmMQwwCgYDVQQKEwNMWEQxFjAUBgNVBAMMDXJv
b3RAZGVkdWdyYWYwdjAQBgcqhkjOPQIBBgUrgQQAIgNiAARrVtwKs9srd2FlOWvX
+QZkd6hnhIZ70Oip90NI5i8E+wZdzfXm3ouOwkUUBhA5J9lvBs5vf7O1KRJZPb7H
2irWoHFvq+sUar0sfmveRlXp0unwRHYyuVo6lV1ft7s3vNKjNTAzMA4GA1UdDwEB
/wQEAwIFoDATBgNVHSUEDDAKBggrBgEFBQcDAjAMBgNVHRMBAf8EAjAAMAoGCCqG
SM49BAMDA2kAMGYCMQDJLlTyWKXSqn5aRUVtHfdQ+ryQ1r5WQALqnjbgwNFDwKSz
m5weixv4+J8meqx25jUCMQCGpDUe/IWsRJUetRJmcDRj14rkhBfuOcFHe1I5vnkP
K4K7u37EcnPOW3cdJ7C8Y0I=
-----END CERTIFICATE-----

A temporary client certificate was generated, use `lxc config trust add` on the target server.

Press ENTER after the certificate was added to the remote server: 

Remote LXD server:
  Hostname: lxdtemp
  Version: 5.21.2

Would you like to create a container (1) or virtual-machine (2)?: 2
Name of the new instance: dedugraftemp
Please provide the path to a disk, partition, or image file: /dev/sda
Does the VM support UEFI Secure Boot? [default=no]: 

Instance to be created:
  Name: dedugraftemp
  Project: default
  Type: virtual-machine
  Source: /dev/sda
  Config:
    security.secureboot: "false"

Additional overrides can be applied at this stage:
1) Begin the migration with the above configuration
2) Override profile list
3) Set additional configuration options
4) Change instance storage pool or volume size
5) Change instance network

Please pick one of the options above [default=1]: 
Transferring instance: dedugraftemp: 10.71GB (77.64MB/s)Error: Failed sending block volume: write tcp 192.168.10.34:48178->192.168.10.67:8443: write: connection reset by peer`
DEBUG  [2024-10-10T09:09:51Z] Event listener server handler started         id=fde42ee5-7c42-4d77-b7bd-f45a8a2fe3dd local=/var/snap/lxd/common/lxd/unix.socket remote=@
DEBUG  [2024-10-10T09:14:51Z] Allowing untrusted GET                        ip="192.168.10.34:36824" url=/1.0
DEBUG  [2024-10-10T09:14:51Z] Allowing untrusted GET                        ip="192.168.10.34:36828" url=/1.0
INFO   [2024-10-10T09:14:53Z] http: TLS handshake error from 192.168.10.34:35792: EOF 
INFO   [2024-10-10T09:14:53Z] http: TLS handshake error from 192.168.10.34:35806: remote error: tls: bad certificate 
DEBUG  [2024-10-10T09:14:53Z] Allowing untrusted GET                        ip="192.168.10.34:35824" url=/1.0
DEBUG  [2024-10-10T09:14:53Z] Allowing untrusted GET                        ip="192.168.10.34:35840" url=/1.0
DEBUG  [2024-10-10T09:15:26Z] Handling API request                          ip=@ method=GET protocol=unix url=/1.0 username=itsupport
DEBUG  [2024-10-10T09:15:26Z] Handling API request                          ip=@ method=POST protocol=unix url=/1.0/certificates username=itsupport
DEBUG  [2024-10-10T09:15:26Z] Refreshing identity cache                    
INFO   [2024-10-10T09:15:26Z] Action: certificate-created, Source: /1.0/certificates/8b8587ffba4b18c992618f72e2925ae75934ea96bea55343ab08056652e3b7d9, Requestor: unix/itsupport (@) 
DEBUG  [2024-10-10T09:15:28Z] Handling API request                          ip="192.168.10.34:59496" method=GET protocol=tls url=/1.0 username=8b8587ffba4b18c992618f72e2925ae75934ea96be43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:16:00.290839357 +0000 UTC"
a55343ab08056652e3b7d9
DEBUG  [2024-10-10T09:15:28Z] Matched trusted cert                          fingerprint=8b8587ffba4b18c992618f72e2925ae75934ea96bea55343ab08056652e3b7d9 subject="CN=root@dedugraf,O=LXD"
DEBUG  [2024-10-10T09:15:30Z] Matched trusted cert                          fingerprint=8b8587ffba4b18c992618f72e2925ae75934ea96bea55343ab08056652e3b7d9 subject="CN=root@dedugraf,O=LXD"
DEBUG  [2024-10-10T09:15:30Z] Handling API request                          ip="192.168.10.34:59498" method=GET protocol=tls url=/1.0/projects username=8b8587ffba4b18c992618f72e2925ae75934ea96bea55343ab08056652e3b7d9
DEBUG  [2024-10-10T09:15:30Z] Matched trusted cert                          fingerprint=8b8587ffba4b18c992618f72e2925ae75934ea96bea55343ab08056652e3b7d9 subject="CN=root@dedugraf,O=LXD"
DEBUG  [2024-10-10T09:15:30Z] Handling API request                          ip="192.168.10.34:59506" method=GET protocol=tls url="/1.0/instances?" username=8b8587ffba4b18c992618f72e2925ae75934ea96bea55343ab08056652e3b7d9
DEBUG  [2024-10-10T09:15:42Z] Handling API request                          ip="192.168.10.34:48132" method=GET protocol=tls url="/1.0/events?project=default" username=8b8587ffba4b18c992618f72e2925ae75934ea96bea55343ab08056652e3b7d9
fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:37.851700807 +0000 UTC"
DEBUG  [2024-10-10T09:17:38Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:38Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 8.89GB (76.84MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:38.851712673 +0000 UTC"
DEBUG  [2024-10-10T09:17:39Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:39Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 8.90GB (76.23MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:39.876904699 +0000 UTC"
DEBUG  [2024-10-10T09:17:40Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:40Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 8.96GB (76.16MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:40.876917019 +0000 UTC"
DEBUG  [2024-10-10T09:17:41Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:41Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 9.07GB (76.38MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:41.876921854 +0000 UTC"
DEBUG  [2024-10-10T09:17:42Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:42Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 9.14GB (76.33MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:42.876938158 +0000 UTC"
INFO   [2024-10-10T09:17:43Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 9.24GB (76.52MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:43.909797885 +0000 UTC"
DEBUG  [2024-10-10T09:17:43Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:44Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 9.32GB (76.58MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:44.90981167 +0000 UTC"
DEBUG  [2024-10-10T09:17:44Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
DEBUG  [2024-10-10T09:17:46Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:46Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 9.42GB (76.70MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:46.006647282 +0000 UTC"
DEBUG  [2024-10-10T09:17:47Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:47Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 9.50GB (76.69MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:47.010305949 +0000 UTC"
DEBUG  [2024-10-10T09:17:48Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:48Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 9.60GB (76.93MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:48.02361076 +0000 UTC"
DEBUG  [2024-10-10T09:17:49Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:49Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 9.63GB (76.52MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:49.023667728 +0000 UTC"
DEBUG  [2024-10-10T09:17:50Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:50Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 9.69GB (76.35MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:50.025205305 +0000 UTC"
DEBUG  [2024-10-10T09:17:51Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:51Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 9.77GB (76.45MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:51.025266289 +0000 UTC"
DEBUG  [2024-10-10T09:17:52Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:52Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 9.89GB (76.76MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:52.025268224 +0000 UTC"
DEBUG  [2024-10-10T09:17:53Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:53Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 9.99GB (76.92MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:53.02526933 +0000 UTC"
DEBUG  [2024-10-10T09:17:54Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:54Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 10.00GB (76.37MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:54.16713522 +0000 UTC"
DEBUG  [2024-10-10T09:17:55Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:55Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 10.12GB (76.64MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:55.167309265 +0000 UTC"
DEBUG  [2024-10-10T09:17:56Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:56Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 10.23GB (76.94MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:56.167320722 +0000 UTC"
DEBUG  [2024-10-10T09:17:57Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:57Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 10.33GB (77.07MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:57.167342205 +0000 UTC"
DEBUG  [2024-10-10T09:17:58Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:58Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 10.44GB (77.36MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:58.167336665 +0000 UTC"
DEBUG  [2024-10-10T09:17:59Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:17:59Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 10.54GB (77.50MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:17:59.167337952 +0000 UTC"
DEBUG  [2024-10-10T09:18:00Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:18:00Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 10.63GB (77.60MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:18:00.169243836 +0000 UTC"
DEBUG  [2024-10-10T09:18:01Z] Updated metadata for operation                class=websocket description="Creating instance" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:18:01Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err= Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 10.71GB (77.64MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Running StatusCode=Running UpdatedAt="2024-10-10 09:18:01.169340886 +0000 UTC"
DEBUG  [2024-10-10T09:18:01Z] Receiving block volume stopped                driver=zfs path=/dev/zd0 pool=default volName=dedugraftemp
DEBUG  [2024-10-10T09:18:02Z] Unmounted ZFS dataset                         dev=default/virtual-machines/dedugraftemp driver=zfs path=/var/snap/lxd/common/lxd/storage-pools/default/virtual-machines/dedugraftemp pool=default volName=dedugraftemp
DEBUG  [2024-10-10T09:18:03Z] Deactivated ZFS volume                        dev=default/virtual-machines/dedugraftemp.block driver=zfs pool=default volName=dedugraftemp
DEBUG  [2024-10-10T09:18:03Z] Migrate receive control monitor finished      instance=dedugraftemp instanceType=virtual-machine project=default
DEBUG  [2024-10-10T09:18:03Z] CreateInstanceFromMigration finished          args="{IndexHeaderVersion:0 Name:dedugraftemp Description: Config:map[] Snapshots:[] MigrationType:{FSType:BLOCK_AND_RSYNC Features:[]} TrackProgress:true Refresh:false Live:false VolumeSize:0 ContentType: VolumeOnly:false ClusterMoveSourceName:}" driver=zfs instance=dedugraftemp pool=default project=default
DEBUG  [2024-10-10T09:18:03Z] Migrate receive transfer finished             instance=dedugraftemp instanceType=virtual-machine project=default
DEBUG  [2024-10-10T09:18:03Z] Sending migration failure response to source  err="Failed creating instance on target: Error copying from migration connection to \"/dev/zd0\": write /dev/zd0: no space left on device" instance=dedugraftemp instanceType=virtual-machine project=default
INFO   [2024-10-10T09:18:03Z] Migration receive stopped                     instance=dedugraftemp instanceType=virtual-machine project=default
ERROR  [2024-10-10T09:18:03Z] Failed migration on target                    clusterMoveSourceName= err="Failed creating instance on target: Error copying from migration connection to \"/dev/zd0\": write /dev/zd0: no space left on device" instance=dedugraftemp live=false project=default push=true
INFO   [2024-10-10T09:18:03Z] Migration channels disconnected on target     clusterMoveSourceName= instance=dedugraftemp live=false project=default push=true
DEBUG  [2024-10-10T09:18:03Z] Instance operation lock finished              action=create err="Error transferring instance data: Failed migration on target: Failed creating instance on target: Error copying from migration connection to \"/dev/zd0\": write /dev/zd0: no space left on device" instance=dedugraftemp project=default reusable=false
DEBUG  [2024-10-10T09:18:03Z] Removing device                               device=eth0 instance=dedugraftemp instanceType=virtual-machine project=default type=nic
DEBUG  [2024-10-10T09:18:03Z] Removing device                               device=root instance=dedugraftemp instanceType=virtual-machine project=default type=disk
DEBUG  [2024-10-10T09:18:03Z] Failure for operation                         class=websocket description="Creating instance" err="Error transferring instance data: Failed migration on target: Failed creating instance on target: Error copying from migration connection to \"/dev/zd0\": write /dev/zd0: no space left on device" operation=c50c7f7a-20f9-47f2-8dc4-413fd5953ee9 project=default
INFO   [2024-10-10T09:18:03Z] ID: c50c7f7a-20f9-47f2-8dc4-413fd5953ee9, Class: websocket, Description: Creating instance  CreatedAt="2024-10-10 09:15:42.828168175 +0000 UTC" Err="Error transferring instance data: Failed migration on target: Failed creating instance on target: Error copying from migration connection to \"/dev/zd0\": write /dev/zd0: no space left on device" Location=none MayCancel=false Metadata="map[block_progress:dedugraftemp: 10.71GB (77.64MB/s) control:13fb32f60de6e4af7797980cc7ebaac64715acd71d867972ffd84f50535dfacb fs:dd9e4c43bd37829be1719a6d4f376d5bd5fc9bd544626323f1c04be7958de052]" Resources="map[instances:[/1.0/instances/dedugraftemp]]" Status=Failure StatusCode=Failure UpdatedAt="2024-10-10 09:18:01.169340886 +0000 UTC"
DEBUG  [2024-10-10T09:18:03Z] Matched trusted cert                          fingerprint=8b8587ffba4b18c992618f72e2925ae75934ea96bea55343ab08056652e3b7d9 subject="CN=root@dedugraf,O=LXD"
DEBUG  [2024-10-10T09:18:03Z] Handling API request                          ip="192.168.10.34:42888" method=DELETE protocol=tls url="/1.0/instances/dedugraftemp?project=default" username=8b8587ffba4b18c992618f72e2925ae75934ea96bea55343ab08056652e3b7d9
DEBUG  [2024-10-10T09:18:03Z] Handling API request                          ip="192.168.10.34:42896" method=DELETE protocol=tls url="/1.0/certificates/8b8587ffba4b18c992618f72e2925ae75934ea96bea55343ab08056652e3b7d9?project=default" username=8b8587ffba4b18c992618f72e2925ae75934ea96bea55343ab08056652e3b7d9
DEBUG  [2024-10-10T09:18:03Z] Matched trusted cert                          fingerprint=8b8587ffba4b18c992618f72e2925ae75934ea96bea55343ab08056652e3b7d9 subject="CN=root@dedugraf,O=LXD"
DEBUG  [2024-10-10T09:18:03Z] Refreshing identity cache                    
INFO   [2024-10-10T09:18:03Z] Action: certificate-deleted, Source: /1.0/certificates/8b8587ffba4b18c992618f72e2925ae75934ea96bea55343ab08056652e3b7d9, Requestor: tls/8b8587ffba4b18c992618f72e2925ae75934ea96bea55343ab08056652e3b7d9 (192.168.10.34:42896) 
DEBUG  [2024-10-10T09:18:03Z] Event listener server handler stopped         listener=a8b55a99-7ed6-4e98-b9d9-4ebc6615134b local="192.168.10.67:8443" remote="192.168.10.34:48132"`
mindtheegab commented 2 days ago

im sorry the formatting here sucks, the issue is explained also here https://discourse.ubuntu.com/t/bin-linux-lxd-migrate-x86-64-always-fails-at-the-same-point/48637/4