Error processing PCI passthrough device changes post-clone

[rmmr]

Community Guidelines

• [X] I have read and agree to the HashiCorp Community Guidelines .
• [X] Vote on this issue by adding a 👍 reaction to the original issue initial description to help the maintainers prioritize.
• [X] Do not leave "+1" or other comments that do not add relevant information or questions.
• [X] If you are interested in working on this issue or have submitted a pull request, please leave a comment.

Terraform

v1.4.6

Terraform Provider

v2.4.0

VMware vSphere

8.0.0

Description

I'm attempting to create a vsphere_virtual_machine resource from a template. Assigning pci_device_id to our nvidia a30 gpu with PCI passthrough results in the following error:

Error: error reconfiguring virtual machine: error processing PCI passthrough device changes post-clone: ServerFaultCode: The object 'vim.HostSystem:' has already been deleted or has not been completely created

If i comment out pci_device_id, create the resource. Then uncomment pci_device_id and re-apply, everything works fine, and the device is successfully attached.

I'm suspecting this could be because attaching a PCI passthrough device requires a reboot. See: https://kb.vmware.com/s/article/82568

Affected Resources or Data Sources

resource/vsphere_virtual_machine

Terraform Configuration

resource "vsphere_virtual_machine" "node" {

memory = 4096 memory_reservation = 4096

pci_device_id = ["0000:25:00.0"] // # Id of our A30

clone { template_uuid = data.vsphere_virtual_machine.template.id linked_clone = false }

}

Debug Output

Terraform will perform the following actions:

  vsphere_virtual_machine.node["knight-4"] will be created
  + resource "vsphere_virtual_machine" "node" {
      + annotation                              = (known after apply)
      + boot_retry_delay                        = 10000
      + change_version                          = (known after apply)
      + cpu_limit                               = -1
      + cpu_share_count                         = (known after apply)
      + cpu_share_level                         = "normal"
      + datastore_id                            = "datastore-3010"
      + default_ip_address                      = (known after apply)
      + ept_rvi_mode                            = "automatic"
      + extra_config                            = {
          + "guestinfo.metadata"          = "eyJpbnN0YW5jZS1pZCI6ImtuaWdodC00IiwibG9jYWwtaG9zdG5hbWUiOiJrbmlnaHQtNCIsIm5ldHdvcmsiOnsiZXRoZXJuZXRzIjp7ImVuczE5MiI6eyJhZGRyZXNzZXMiOlsiMTkyLjE2OC43LjEzNC8yNCJdLCJkaGNwNCI6ZmFsc2UsImdhdGV3YXk0IjoiMTkyLjE2OC43LjEifX0sInZlcnNpb24iOjJ9fQ=="
          + "guestinfo.metadata.encoding" = "base64"
          + "guestinfo.userdata"          = "<some base64 string, i removed this on purpose for this issue>"
          + "guestinfo.userdata.encoding" = "gzip+base64"
          + "pciPassthru.64bitMMIOSizeGB" = "64"
          + "pciPassthru.use64bitMMIO"    = "TRUE"
        }
      + extra_config_reboot_required            = true
      + firmware                                = "bios"
      + force_power_off                         = true
      + guest_id                                = "ubuntu64Guest"
      + guest_ip_addresses                      = (known after apply)
      + hardware_version                        = (known after apply)
      + host_system_id                          = (known after apply)
      + hv_mode                                 = "hvAuto"
      + id                                      = (known after apply)
      + ide_controller_count                    = 2
      + imported                                = (known after apply)
      + latency_sensitivity                     = "normal"
      + memory                                  = 4096
      + memory_limit                            = -1
      + memory_reservation                      = 4096
      + memory_share_count                      = (known after apply)
      + memory_share_level                      = "normal"
      + migrate_wait_timeout                    = 30
      + moid                                    = (known after apply)
      + name                                    = "knight-4"
      + num_cores_per_socket                    = 1
      + num_cpus                                = 2
      + pci_device_id                           = [
          + "0000:25:00.0",
        ]
      + power_state                             = (known after apply)
      + poweron_timeout                         = 300
      + reboot_required                         = (known after apply)
      + resource_pool_id                        = "resgroup-3016"
      + run_tools_scripts_after_power_on        = true
      + run_tools_scripts_after_resume          = true
      + run_tools_scripts_before_guest_shutdown = true
      + run_tools_scripts_before_guest_standby  = true
      + sata_controller_count                   = 0
      + scsi_bus_sharing                        = "noSharing"
      + scsi_controller_count                   = 1
      + scsi_type                               = "pvscsi"
      + shutdown_wait_timeout                   = 3
      + storage_policy_id                       = (known after apply)
      + swap_placement_policy                   = "inherit"
      + tools_upgrade_policy                    = "manual"
      + uuid                                    = (known after apply)
      + vapp_transport                          = (known after apply)
      + vmware_tools_status                     = (known after apply)
      + vmx_path                                = (known after apply)
      + wait_for_guest_ip_timeout               = 0
      + wait_for_guest_net_routable             = true
      + wait_for_guest_net_timeout              = 5

      + clone {
          + linked_clone  = false
          + template_uuid = "420ef96a-e9e5-23d5-5e96-f00c4de1c903"
          + timeout       = 30
        }

      + disk {
          + attach            = false
          + controller_type   = "scsi"
          + datastore_id      = "<computed>"
          + device_address    = (known after apply)
          + disk_mode         = "persistent"
          + disk_sharing      = "sharingNone"
          + eagerly_scrub     = false
          + io_limit          = -1
          + io_reservation    = 0
          + io_share_count    = 0
          + io_share_level    = "normal"
          + keep_on_remove    = false
          + key               = 0
          + label             = "knight-4.vmdk"
          + path              = (known after apply)
          + size              = 50
          + storage_policy_id = (known after apply)
          + thin_provisioned  = true
          + unit_number       = 0
          + uuid              = (known after apply)
          + write_through     = false
        }

      + network_interface {
          + adapter_type          = "vmxnet3"
          + bandwidth_limit       = -1
          + bandwidth_reservation = 0
          + bandwidth_share_count = (known after apply)
          + bandwidth_share_level = "normal"
          + device_address        = (known after apply)
          + key                   = (known after apply)
          + mac_address           = (known after apply)
          + network_id            = "network-3012"
        }
    }

Plan: 1 to add, 0 to change, 0 to destroy.
2023-06-05T12:41:29.557Z [DEBUG] command: asking for input: "\nDo you want to perform these actions?"

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value: yes

2023-06-05T12:43:03.562Z [INFO]  backend/local: apply calling Apply
2023-06-05T12:43:03.562Z [DEBUG] Building and walking apply graph for NormalMode plan
2023-06-05T12:43:03.563Z [DEBUG] Resource instance state not found for node "vsphere_virtual_machine.node[\"knight-4\"]", instance vsphere_virtual_machine.node["knight-4"]
2023-06-05T12:43:03.563Z [DEBUG] adding implicit provider configuration provider["registry.terraform.io/hashicorp/tls"], implied first by module.datacenter.module.consul_certs.tls_locally_signed_cert.server (expand)

... removed (non relevant and too long)

2023-06-05T12:43:03.714Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:03 [DEBUG] Cached SOAP client session data not valid or persistence not enabled, new session necessary: timestamp=2023-06-05T12:43:03.714Z
2023-06-05T12:43:03.714Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:03 [DEBUG] Creating new SOAP API session on endpoint 192.168.7.243: timestamp=2023-06-05T12:43:03.714Z
2023-06-05T12:43:04.087Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] SOAP API session creation successful: timestamp=2023-06-05T12:43:04.087Z
2023-06-05T12:43:04.087Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] VMWare vSphere Client configured for URL: 192.168.7.243: timestamp=2023-06-05T12:43:04.087Z
2023-06-05T12:43:04.087Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] Setting up REST client: timestamp=2023-06-05T12:43:04.087Z
2023-06-05T12:43:04.484Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] CIS REST client configuration successful: timestamp=2023-06-05T12:43:04.484Z
2023-06-05T12:43:04.769Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = error reading from server: EOF"
2023-06-05T12:43:04.770Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/hashicorp/cloudinit/2.3.2/linux_amd64/terraform-provider-cloudinit_v2.3.2_x5 pid=134722
2023-06-05T12:43:04.770Z [DEBUG] provider: plugin exited
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] vsphere_virtual_machine (ID = <new resource>): Performing diff customization and validation: timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] NetworkInterfaceDiffOperation: Beginning diff validation: timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] network_interface.0 (key 0 at <new device>): Beginning diff validation: timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] network_interface.0 (key 0 at <new device>): Diff validation complete: timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] NetworkInterfaceDiffOperation: Diff validation complete: timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] vsphere_virtual_machine (ID = <new resource>): resource_pool_id modified without change to host_system_id, marking as computed: timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] DiskDiffOperation: Beginning disk diff customization: timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] DiskDiffOperation: Beginning collective diff validation (indexes aligned to new config): timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] disk.0 (key 0 at <new device>) (<unknown>): Beginning diff validation: timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] disk.0 (key 0 at <new device>) (<unknown>): Diff validation complete: timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] DiskDiffOperation: Beginning diff validation and normalization (indexes aligned to old state): timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] DiskDiffOperation: New resource set post-normalization: (key 0 at <new device>): timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] DiskDiffOperation: Disk diff customization complete, sending new diff: timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] contentlibrary.IsContentLibrary: Checking if 420ef96a-e9e5-23d5-5e96-f00c4de1c903 is a content library source: timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:04.782Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:04 [DEBUG] contentlibrary.ItemFromID: Retrieving library item 420ef96a-e9e5-23d5-5e96-f00c4de1c903: timestamp=2023-06-05T12:43:04.782Z
2023-06-05T12:43:05.238Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] ValidateVirtualMachineClone: Validating fitness of source VM/template 420ef96a-e9e5-23d5-5e96-f00c4de1c903: timestamp=2023-06-05T12:43:05.238Z
2023-06-05T12:43:05.238Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] Locating virtual machine with UUID "420ef96a-e9e5-23d5-5e96-f00c4de1c903": timestamp=2023-06-05T12:43:05.238Z
2023-06-05T12:43:05.238Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] Using SearchIndex to look up UUID "420ef96a-e9e5-23d5-5e96-f00c4de1c903": timestamp=2023-06-05T12:43:05.238Z
2023-06-05T12:43:05.376Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] VM "/dc1/vm/ubuntu-server-22.04" found for UUID "420ef96a-e9e5-23d5-5e96-f00c4de1c903": timestamp=2023-06-05T12:43:05.376Z
2023-06-05T12:43:05.376Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] Fetching properties for VM "/dc1/vm/ubuntu-server-22.04": timestamp=2023-06-05T12:43:05.376Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] DiskCloneValidateOperation: Checking existing virtual disk configuration: timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] DiskRefreshOperation: Found controller "controller-1000" for device "disk-1000-0": timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] DiskCloneValidateOperation: Disk devices order before sort: disk-1000-0: timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] DiskCloneValidateOperation: Disk devices order after sort: disk-1000-0: timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] DiskCloneValidateOperation: Current resource set: (key 0 at <new device>): timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] DiskCloneValidateOperation: Resource set order after sort: (key 0 at <new device>): timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] DiskCloneValidateOperation: Running test read operations on all disks: timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] disk.0 (key 2000 at scsi:0:0) (<unknown>): Reading state: timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] FindVirtualDevice: Looking for device with key 2000: timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] FindVirtualDevice: Device found: disk-1000-0: timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] disk.0 (key 2000 at scsi:0:0) (ubuntu-server-22.04/ubuntu-server-22.04.vmdk): Read finished (key and device address may have changed): timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] DiskCloneValidateOperation: All disks in source validated successfully: timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] ValidateVirtualMachineClone: Source VM/template 420ef96a-e9e5-23d5-5e96-f00c4de1c903 is a suitable source for cloning: timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] VAppDiffOperation: Verifying configuration meets requirements for vApp transport: timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] VAppDiffOperation: ISO transport is not supported on this virtual machine or multiple transport options exist: timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.513Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] vsphere_virtual_machine (ID = <new resource>): Diff customization and validation complete: timestamp=2023-06-05T12:43:05.513Z
2023-06-05T12:43:05.516Z [WARN]  Provider "registry.terraform.io/hashicorp/vsphere" produced an invalid plan for vsphere_virtual_machine.node["knight-4"], but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .tools_upgrade_policy: planned value cty.StringVal("manual") for a non-computed attribute
      - .run_tools_scripts_before_guest_standby: planned value cty.True for a non-computed attribute
      - .cpu_limit: planned value cty.NumberIntVal(-1) for a non-computed attribute
      - .run_tools_scripts_before_guest_shutdown: planned value cty.True for a non-computed attribute
      - .ide_controller_count: planned value cty.NumberIntVal(2) for a non-computed attribute
      - .num_cores_per_socket: planned value cty.NumberIntVal(1) for a non-computed attribute
      - .run_tools_scripts_after_power_on: planned value cty.True for a non-computed attribute
      - .latency_sensitivity: planned value cty.StringVal("normal") for a non-computed attribute
      - .scsi_controller_count: planned value cty.NumberIntVal(1) for a non-computed attribute
      - .scsi_type: planned value cty.StringVal("pvscsi") for a non-computed attribute
      - .extra_config_reboot_required: planned value cty.True for a non-computed attribute
      - .wait_for_guest_ip_timeout: planned value cty.NumberIntVal(0) for a non-computed attribute
      - .boot_retry_delay: planned value cty.NumberIntVal(10000) for a non-computed attribute
      - .memory_limit: planned value cty.NumberIntVal(-1) for a non-computed attribute
      - .memory_share_level: planned value cty.StringVal("normal") for a non-computed attribute
      - .poweron_timeout: planned value cty.NumberIntVal(300) for a non-computed attribute
      - .swap_placement_policy: planned value cty.StringVal("inherit") for a non-computed attribute
      - .hv_mode: planned value cty.StringVal("hvAuto") for a non-computed attribute
      - .ept_rvi_mode: planned value cty.StringVal("automatic") for a non-computed attribute
      - .migrate_wait_timeout: planned value cty.NumberIntVal(30) for a non-computed attribute
      - .run_tools_scripts_after_resume: planned value cty.True for a non-computed attribute
      - .cpu_share_level: planned value cty.StringVal("normal") for a non-computed attribute
      - .firmware: planned value cty.StringVal("bios") for a non-computed attribute
      - .wait_for_guest_net_timeout: planned value cty.NumberIntVal(5) for a non-computed attribute
      - .scsi_bus_sharing: planned value cty.StringVal("noSharing") for a non-computed attribute
      - .sata_controller_count: planned value cty.NumberIntVal(0) for a non-computed attribute
      - .force_power_off: planned value cty.True for a non-computed attribute
      - .shutdown_wait_timeout: planned value cty.NumberIntVal(3) for a non-computed attribute
      - .wait_for_guest_net_routable: planned value cty.True for a non-computed attribute
      - .clone[0].timeout: planned value cty.NumberIntVal(30) for a non-computed attribute
      - .disk[0].attach: planned value cty.False for a non-computed attribute
      - .disk[0].io_reservation: planned value cty.NumberIntVal(0) for a non-computed attribute
      - .disk[0].io_share_level: planned value cty.StringVal("normal") for a non-computed attribute
      - .disk[0].controller_type: planned value cty.StringVal("scsi") for a non-computed attribute
      - .disk[0].disk_sharing: planned value cty.StringVal("sharingNone") for a non-computed attribute
      - .disk[0].keep_on_remove: planned value cty.False for a non-computed attribute
      - .disk[0].io_limit: planned value cty.NumberIntVal(-1) for a non-computed attribute
      - .disk[0].disk_mode: planned value cty.StringVal("persistent") for a non-computed attribute
      - .disk[0].io_share_count: planned value cty.NumberIntVal(0) for a non-computed attribute
      - .disk[0].write_through: planned value cty.False for a non-computed attribute
      - .network_interface[0].bandwidth_limit: planned value cty.NumberIntVal(-1) for a non-computed attribute
      - .network_interface[0].bandwidth_reservation: planned value cty.NumberIntVal(0) for a non-computed attribute
      - .network_interface[0].bandwidth_share_level: planned value cty.StringVal("normal") for a non-computed attribute
      - .network_interface[0].adapter_type: planned value cty.StringVal("vmxnet3") for a non-computed attribute
vsphere_virtual_machine.node["knight-4"]: Creating...
2023-06-05T12:43:05.516Z [INFO]  Starting apply for vsphere_virtual_machine.node["knight-4"]
2023-06-05T12:43:05.522Z [DEBUG] vsphere_virtual_machine.node["knight-4"]: applying the planned Create change
2023-06-05T12:43:05.524Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] setting computed for "guest_ip_addresses" from ComputedKeys: timestamp=2023-06-05T12:43:05.524Z
2023-06-05T12:43:05.524Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] setting computed for "vapp_transport" from ComputedKeys: timestamp=2023-06-05T12:43:05.524Z
2023-06-05T12:43:05.524Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] vsphere_virtual_machine (ID = <new resource>): Beginning create: timestamp=2023-06-05T12:43:05.524Z
2023-06-05T12:43:05.524Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] tagsClientIfDefined: No tags configured, skipping loading of tagging client: timestamp=2023-06-05T12:43:05.524Z
2023-06-05T12:43:05.524Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] vsphere_virtual_machine (ID = <new resource>): VM being created from clone: timestamp=2023-06-05T12:43:05.524Z
2023-06-05T12:43:05.524Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] Locating resource pool with ID resgroup-3016: timestamp=2023-06-05T12:43:05.524Z
2023-06-05T12:43:05.593Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] Resource pool found: resgroup-3016: timestamp=2023-06-05T12:43:05.593Z
2023-06-05T12:43:05.593Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] Locating folder at path "" relative to virtual machine root: timestamp=2023-06-05T12:43:05.593Z
2023-06-05T12:43:05.800Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] Folder located: "/dc1/vm": timestamp=2023-06-05T12:43:05.800Z
2023-06-05T12:43:05.800Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] contentlibrary.IsContentLibrary: Checking if 420ef96a-e9e5-23d5-5e96-f00c4de1c903 is a content library source: timestamp=2023-06-05T12:43:05.800Z
2023-06-05T12:43:05.800Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:05 [DEBUG] contentlibrary.ItemFromID: Retrieving library item 420ef96a-e9e5-23d5-5e96-f00c4de1c903: timestamp=2023-06-05T12:43:05.800Z
2023-06-05T12:43:06.085Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] ExpandVirtualMachineCloneSpec: Preparing clone spec for VM: timestamp=2023-06-05T12:43:06.085Z
2023-06-05T12:43:06.085Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] Locating datastore with ID "datastore-3010": timestamp=2023-06-05T12:43:06.085Z
2023-06-05T12:43:06.154Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] Datastore with ID "datastore-3010" found: timestamp=2023-06-05T12:43:06.154Z
2023-06-05T12:43:06.154Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] ExpandVirtualMachineCloneSpec: Cloning from UUID: 420ef96a-e9e5-23d5-5e96-f00c4de1c903: timestamp=2023-06-05T12:43:06.154Z
2023-06-05T12:43:06.154Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] Locating virtual machine with UUID "420ef96a-e9e5-23d5-5e96-f00c4de1c903": timestamp=2023-06-05T12:43:06.154Z
2023-06-05T12:43:06.154Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] Using SearchIndex to look up UUID "420ef96a-e9e5-23d5-5e96-f00c4de1c903": timestamp=2023-06-05T12:43:06.154Z
2023-06-05T12:43:06.292Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] VM "/dc1/vm/ubuntu-server-22.04" found for UUID "420ef96a-e9e5-23d5-5e96-f00c4de1c903": timestamp=2023-06-05T12:43:06.292Z
2023-06-05T12:43:06.292Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] Fetching properties for VM "/dc1/vm/ubuntu-server-22.04": timestamp=2023-06-05T12:43:06.292Z
2023-06-05T12:43:06.432Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] Locating resource pool with ID resgroup-3016: timestamp=2023-06-05T12:43:06.432Z
2023-06-05T12:43:06.502Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] Resource pool found: resgroup-3016: timestamp=2023-06-05T12:43:06.502Z
2023-06-05T12:43:06.502Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] ValidateHost: no host supplied, nothing to do: timestamp=2023-06-05T12:43:06.502Z
2023-06-05T12:43:06.502Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] DiskCloneRelocateOperation: Generating full disk relocate spec list: timestamp=2023-06-05T12:43:06.502Z
2023-06-05T12:43:06.502Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] DiskRefreshOperation: Found controller "controller-1000" for device "disk-1000-0": timestamp=2023-06-05T12:43:06.502Z
2023-06-05T12:43:06.502Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] DiskCloneRelocateOperation: Disk devices located: disk-1000-0: timestamp=2023-06-05T12:43:06.502Z
2023-06-05T12:43:06.502Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] DiskCloneRelocateOperation: Disk devices order after sort: disk-1000-0: timestamp=2023-06-05T12:43:06.502Z
2023-06-05T12:43:06.502Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] DiskCloneRelocateOperation: Current resource set: (key 0 at <new device>): timestamp=2023-06-05T12:43:06.502Z
2023-06-05T12:43:06.502Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] DiskCloneRelocateOperation: Resource set order after sort: (key 0 at <new device>): timestamp=2023-06-05T12:43:06.502Z
2023-06-05T12:43:06.502Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] DiskCloneRelocateOperation: Generating relocators for source disks: timestamp=2023-06-05T12:43:06.502Z
2023-06-05T12:43:06.502Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] DiskCloneRelocateOperation: Disk relocator list:: timestamp=2023-06-05T12:43:06.502Z
2023-06-05T12:43:06.502Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] DiskCloneRelocateOperation: Disk relocator generation complete: timestamp=2023-06-05T12:43:06.502Z
2023-06-05T12:43:06.502Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] ExpandVirtualMachineCloneSpec: Clone spec prep complete: timestamp=2023-06-05T12:43:06.502Z
2023-06-05T12:43:06.502Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:06 [DEBUG] Cloning virtual machine "/dc1/vm/knight-4": timestamp=2023-06-05T12:43:06.502Z
2023-06-05T12:43:10.588Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] Virtual machine "/dc1/vm/knight-4": clone complete (MOID: "vm-4053"): timestamp=2023-06-05T12:43:10.588Z
2023-06-05T12:43:10.657Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] Locating resource pool with ID resgroup-3016: timestamp=2023-06-05T12:43:10.657Z
2023-06-05T12:43:10.725Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] Resource pool found: resgroup-3016: timestamp=2023-06-05T12:43:10.725Z
2023-06-05T12:43:10.725Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] Fetching properties for VM "/dc1/vm/knight-4": timestamp=2023-06-05T12:43:10.725Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] VM "/dc1/vm/knight-4" - UUID is "420ebfed-20e8-2d88-39ab-88a057ef17d2": timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] vsphere_virtual_machine (ID = 420ebfed-20e8-2d88-39ab-88a057ef17d2): Building config spec: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] vsphere_virtual_machine (ID = 420ebfed-20e8-2d88-39ab-88a057ef17d2): Resource argument "guest_id" requires a VM restart: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] vsphere_virtual_machine (ID = 420ebfed-20e8-2d88-39ab-88a057ef17d2): Resource argument "tools_upgrade_policy" requires a VM restart: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] vsphere_virtual_machine (ID = 420ebfed-20e8-2d88-39ab-88a057ef17d2): Resource argument "hv_mode" requires a VM restart: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] vsphere_virtual_machine (ID = 420ebfed-20e8-2d88-39ab-88a057ef17d2): Resource argument "ept_rvi_mode" requires a VM restart: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] vsphere_virtual_machine (ID = 420ebfed-20e8-2d88-39ab-88a057ef17d2): CPU operation requires a VM restart: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] vsphere_virtual_machine (ID = 420ebfed-20e8-2d88-39ab-88a057ef17d2): Resource argument "num_cores_per_socket" requires a VM restart: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] vsphere_virtual_machine (ID = 420ebfed-20e8-2d88-39ab-88a057ef17d2): Memory operation requires a VM restart: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] vsphere_virtual_machine (ID = 420ebfed-20e8-2d88-39ab-88a057ef17d2): Resource argument "swap_placement_policy" requires a VM restart: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] vsphere_virtual_machine (ID = 420ebfed-20e8-2d88-39ab-88a057ef17d2): Resource argument "firmware" requires a VM restart: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] NormalizeBus: Normalizing first 1 controllers on SCSI bus to device type pvscsi: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] NormalizeBus: Normalizing first 0 controllers on SATA bus: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] NormalizeBus: Normalizing first 2 controllers on IDE bus: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] NormalizeBus: Current SCSI bus contents: pvscsi-1000: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] NormalizeBus: Current SATA bus contents:: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] NormalizeBus: Current IDE bus contents: device-200,device-201: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] NormalizeBus: Outgoing device list: ide-200,ide-201,ps2-300,pci-100,sio-400,keyboard-600,pointing-700,video-500,vmci-12000,pvscsi-1000,cdrom-3000,cdrom-3001,disk-1000-0,ethernet-0: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] NormalizeBus: Outgoing device config spec:: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] DiskPostCloneOperation: Looking for disk device changes post-clone: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] DiskRefreshOperation: Found controller "controller-1000" for device "disk-1000-0": timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] DiskPostCloneOperation: Disk devices located: disk-1000-0: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] DiskPostCloneOperation: Disk devices order after sort: disk-1000-0: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] DiskPostCloneOperation: Current resource set: (key 2000 at scsi:0:0): timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] DiskPostCloneOperation: Resource set order after sort: (key 2000 at scsi:0:0): timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] DiskPostCloneOperation: Looking for and applying device changes in source disks: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] disk.0 (key 2000 at scsi:0:0) (<unknown>): Reading state: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] FindVirtualDevice: Looking for device with key 2000: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] FindVirtualDevice: Device found: disk-1000-0: timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] Locating virtual machine with UUID "420ebfed-20e8-2d88-39ab-88a057ef17d2": timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:10.864Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:10 [DEBUG] Using SearchIndex to look up UUID "420ebfed-20e8-2d88-39ab-88a057ef17d2": timestamp=2023-06-05T12:43:10.864Z
2023-06-05T12:43:11.001Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] VM "/dc1/vm/knight-4" found for UUID "420ebfed-20e8-2d88-39ab-88a057ef17d2": timestamp=2023-06-05T12:43:11.001Z
2023-06-05T12:43:11.276Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] queryAssociatedProfile: Retrieving storage policy of server object of type [virtualDiskId] and key [vm-4053:2000].: timestamp=2023-06-05T12:43:11.276Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] disk.0 (key 2000 at scsi:0:0) (knight-4/knight-4.vmdk): Read finished (key and device address may have changed): timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] DiskPostCloneOperation: Post-clone final resource list: (key 2000 at scsi:0:0): timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] DiskPostCloneOperation: Device list at end of operation: ide-200,ide-201,ps2-300,pci-100,sio-400,keyboard-600,pointing-700,video-500,vmci-12000,pvscsi-1000,cdrom-3000,cdrom-3001,disk-1000-0,ethernet-0: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] DiskPostCloneOperation: Device config operations from post-clone:: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] DiskPostCloneOperation: Operation complete, returning updated spec: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] NetworkInterfacePostCloneOperation: Looking for post-clone device changes: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] NetworkInterfacePostCloneOperation: Network devices located: ethernet-0: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] NetworkInterfacePostCloneOperation: Current resource set from configuration: (key 0 at <new device>): timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] NetworkInterfacePostCloneOperation: Layout from source: 1 devices over a 1 unit range: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] NetworkInterfacePostCloneOperation: Reading existing devices: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] network_interface.0 (key 4000 at pci:0:7): Reading state: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] FindVirtualDevice: Looking for device with key 4000: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] FindVirtualDevice: Device found: ethernet-0: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] network_interface.0 (key 4000 at pci:0:7): Read finished (key and device address may have changed): timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] network_interface.0 (key 4000 at pci:0:7): Beginning update: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] FindVirtualDevice: Looking for device with key 4000: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] FindVirtualDevice: Device found: ethernet-0: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] network_interface.0 (key 4000 at pci:0:7): Device config operations from update: (edit: *types.VirtualVmxnet3 at key 4000): timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] network_interface.0 (key 4000 at pci:0:7): Update complete: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] applyDeviceChange: Applying changes: (edit: *types.VirtualVmxnet3 at key 4000): timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] applyDeviceChange: Device list before changes: ide-200,ide-201,ps2-300,pci-100,sio-400,keyboard-600,pointing-700,video-500,vmci-12000,pvscsi-1000,cdrom-3000,cdrom-3001,disk-1000-0,ethernet-0: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] applyDeviceChange: Device list after changes: ide-200,ide-201,ps2-300,pci-100,sio-400,keyboard-600,pointing-700,video-500,vmci-12000,pvscsi-1000,cdrom-3000,cdrom-3001,disk-1000-0,ethernet-0: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] NetworkInterfacePostCloneOperation: Post-clone final resource list: (key 4000 at pci:0:7): timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] NetworkInterfacePostCloneOperation: Device list at end of operation: ide-200,ide-201,ps2-300,pci-100,sio-400,keyboard-600,pointing-700,video-500,vmci-12000,pvscsi-1000,cdrom-3000,cdrom-3001,disk-1000-0,ethernet-0: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] NetworkInterfacePostCloneOperation: Device config operations from post-clone: (edit: *types.VirtualVmxnet3 at key 4000): timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] NetworkInterfacePostCloneOperation: Operation complete, returning updated spec: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] CdromPostCloneOperation: Looking for post-clone device changes: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] CdromPostCloneOperation: CDROM devices located: cdrom-3000,cdrom-3001: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] CdromPostCloneOperation: Current resource set from configuration:: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] CdromPostCloneOperation: Reading existing devices: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] cdrom.0 (key 3000 at ide:0:0): Reading state: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] FindVirtualDevice: Looking for device with key 3000: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] FindVirtualDevice: Device found: cdrom-3000: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 cdrom.0 (key 3000 at ide:0:0): [DEBUG] Unknown CDROM type *types.VirtualCdromRemotePassthroughBackingInfo, clearing all attributes: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.366Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] cdrom.0 (key 3000 at ide:0:0): Read finished (key and device address may have changed): timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] cdrom.1 (key 3001 at ide:0:1): Reading state: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] FindVirtualDevice: Looking for device with key 3001: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] FindVirtualDevice: Device found: cdrom-3001: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 cdrom.1 (key 3001 at ide:0:1): [DEBUG] Unknown CDROM type *types.VirtualCdromRemotePassthroughBackingInfo, clearing all attributes: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] cdrom.1 (key 3001 at ide:0:1): Read finished (key and device address may have changed): timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] cdrom.0 (key 3000 at ide:0:0): Beginning delete: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] FindVirtualDevice: Looking for device with key 3000: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] FindVirtualDevice: Device found: cdrom-3000: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] cdrom.0 (key 3000 at ide:0:0): Device config operations from update: (remove: *types.VirtualCdrom at key 3000): timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] cdrom.0 (key 3000 at ide:0:0): Delete completed: timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] applyDeviceChange: Applying changes: (remove: *types.VirtualCdrom at key 3000): timestamp=2023-06-05T12:43:11.366Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] applyDeviceChange: Device list before changes: ide-200,ide-201,ps2-300,pci-100,sio-400,keyboard-600,pointing-700,video-500,vmci-12000,pvscsi-1000,cdrom-3000,cdrom-3001,disk-1000-0,ethernet-0: timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] applyDeviceChange: Device list after changes: ide-200,ide-201,ps2-300,pci-100,sio-400,keyboard-600,pointing-700,video-500,vmci-12000,pvscsi-1000,cdrom-3001,disk-1000-0,ethernet-0: timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] cdrom.1 (key 3001 at ide:0:1): Beginning delete: timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] FindVirtualDevice: Looking for device with key 3001: timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] FindVirtualDevice: Device found: cdrom-3001: timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] cdrom.1 (key 3001 at ide:0:1): Device config operations from update: (remove: *types.VirtualCdrom at key 3001): timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] cdrom.1 (key 3001 at ide:0:1): Delete completed: timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] applyDeviceChange: Applying changes: (remove: *types.VirtualCdrom at key 3001): timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] applyDeviceChange: Device list before changes: ide-200,ide-201,ps2-300,pci-100,sio-400,keyboard-600,pointing-700,video-500,vmci-12000,pvscsi-1000,cdrom-3001,disk-1000-0,ethernet-0: timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] applyDeviceChange: Device list after changes: ide-200,ide-201,ps2-300,pci-100,sio-400,keyboard-600,pointing-700,video-500,vmci-12000,pvscsi-1000,disk-1000-0,ethernet-0: timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] CdromPostCloneOperation: Post-clone final resource list:: timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] CdromPostCloneOperation: Device list at end of operation: ide-200,ide-201,ps2-300,pci-100,sio-400,keyboard-600,pointing-700,video-500,vmci-12000,pvscsi-1000,disk-1000-0,ethernet-0: timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] CdromPostCloneOperation: Device config operations from post-clone: (remove: *types.VirtualCdrom at key 3000),(remove: *types.VirtualCdrom at key 3001): timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] CdromPostCloneOperation: Operation complete, returning updated spec: timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.367Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] Locating host system ID: timestamp=2023-06-05T12:43:11.367Z
2023-06-05T12:43:11.436Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] vsphere_virtual_machine (ID = 420ebfed-20e8-2d88-39ab-88a057ef17d2): Performing delete: timestamp=2023-06-05T12:43:11.436Z
2023-06-05T12:43:11.436Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] Locating virtual machine with UUID "420ebfed-20e8-2d88-39ab-88a057ef17d2": timestamp=2023-06-05T12:43:11.436Z
2023-06-05T12:43:11.436Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] Using SearchIndex to look up UUID "420ebfed-20e8-2d88-39ab-88a057ef17d2": timestamp=2023-06-05T12:43:11.436Z
2023-06-05T12:43:11.573Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] VM "/dc1/vm/knight-4" found for UUID "420ebfed-20e8-2d88-39ab-88a057ef17d2": timestamp=2023-06-05T12:43:11.573Z
2023-06-05T12:43:11.573Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] Fetching properties for VM "/dc1/vm/knight-4": timestamp=2023-06-05T12:43:11.573Z
2023-06-05T12:43:11.714Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] DiskDestroyOperation: Beginning destroy: timestamp=2023-06-05T12:43:11.714Z
2023-06-05T12:43:11.714Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] DiskDestroyOperation: Detaching devices with keep_on_remove enabled: timestamp=2023-06-05T12:43:11.714Z
2023-06-05T12:43:11.714Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] DiskDestroyOperation: Device config operations from destroy:: timestamp=2023-06-05T12:43:11.714Z
2023-06-05T12:43:11.714Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:11 [DEBUG] Deleting virtual machine "/dc1/vm/knight-4": timestamp=2023-06-05T12:43:11.714Z
2023-06-05T12:43:12.127Z [INFO]  provider.terraform-provider-vsphere_v2.4.0_x5: 2023/06/05 12:43:12 [DEBUG] vsphere_virtual_machine (ID = <new resource>): Delete complete: timestamp=2023-06-05T12:43:12.127Z
2023-06-05T12:43:12.127Z [ERROR] provider.terraform-provider-vsphere_v2.4.0_x5: Response contains error diagnostic: diagnostic_summary="error reconfiguring virtual machine: error processing PCI passthrough device changes post-clone: ServerFaultCode: The object 'vim.HostSystem:' has already been deleted or has not been completely created" tf_req_id=79258b38-bae9-8d89-a0e0-a1cf678de84e @caller=github.com/hashicorp/terraform-plugin-go@v0.14.3/tfprotov5/internal/diag/diagnostics.go:55 diagnostic_detail= diagnostic_severity=ERROR tf_proto_version=5.3 tf_provider_addr=provider tf_resource_type=vsphere_virtual_machine tf_rpc=ApplyResourceChange @module=sdk.proto timestamp=2023-06-05T12:43:12.127Z
2023-06-05T12:43:12.162Z [ERROR] vertex "vsphere_virtual_machine.node[\"knight-4\"]" error: error reconfiguring virtual machine: error processing PCI passthrough device changes post-clone: ServerFaultCode: The object 'vim.HostSystem:' has already been deleted or has not been completely created
╷
│ Error: error reconfiguring virtual machine: error processing PCI passthrough device changes post-clone: ServerFaultCode: The object 'vim.HostSystem:' has already been deleted or has not been completely created
│ 
│   with vsphere_virtual_machine.node["knight-4"],
│   on main.tf line 226, in resource "vsphere_virtual_machine" "node":
│  226: resource "vsphere_virtual_machine" "node" {
│ 
╵
2023-06-05T12:43:12.192Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = error reading from server: EOF"
2023-06-05T12:43:12.194Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/hashicorp/vsphere/2.4.0/linux_amd64/terraform-provider-vsphere_v2.4.0_x5 pid=134737
2023-06-05T12:43:12.194Z [DEBUG] provider: plugin exited

Panic Output

No response

Expected Behavior

Successful creation of the vsphere_virtual_machine resource whilst pci_device_id is set to a passthrough device.

Actual Behavior

Resource vsphere_virtual_machine fails to create with error:

Error: error reconfiguring virtual machine: error processing PCI passthrough device changes post-clone: ServerFaultCode: The object 'vim.HostSystem:' has already been deleted or has not been completely created

Steps to Reproduce

Have a

Create a minimal terraform configuration so that vsphere_virtual_machine is created:

• from a template
• pci_device_id contains the hex id of a PCI passthrough device
• memory_reservation set (requirement for PCI passthrough)

resource "vsphere_virtual_machine" "node" {

  memory = 4096
  memory_reservation =  4096
  pci_device_id = ["0000:25:00.0"] // # Id of our A30

  clone {
    template_uuid = data.vsphere_virtual_machine.template.id
    linked_clone  = false
  }
}

Environment Details

No response

Screenshots

No response

References

No response

[github-actions[bot]]

Hello, rmmr! 🖐

Thank you for submitting an issue for this provider. The issue will now enter into the issue lifecycle.

If you want to contribute to this project, please review the contributing guidelines and information on submitting pull requests.

[rmmr]

So it appears setting host_system_id was required. I was using resource_pool_id.

[github-actions[bot]]

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues. If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.