dmacvicar / terraform-provider-libvirt

Terraform provider to provision infrastructure with Linux's KVM using libvirt
Apache License 2.0
1.54k stars 457 forks source link

Error: can't find storage pool 'default' on remote libvirt host over SSH #919

Open mattsn0w opened 2 years ago

mattsn0w commented 2 years ago

System Information

Host 1 - nuc.example.net: https://www.jetwaycomputer.com/NU591.html w/ 8GB RAM, 64GB M2 SSD Host 2 - brick2.example.net: HP ProDesk 600 G4 Mini Desktop PC Intel i5-8500T 2.10GHz 16GB 512GB SSD

Linux distribution

Both hosts are fresh installs of Ubuntu 20.04.3 LTS 64-bit x86 Server.

msnow@brick:~/terraform_kvm_remote-only$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 20.04.3 LTS
Release:    20.04
Codename:   focal
msnow@brick:~/terraform_kvm_remote-only$ uname -a
Linux nuc 5.4.0-91-generic #102-Ubuntu SMP Fri Nov 5 16:31:28 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux       
msnow@brick:~/terraform_kvm_remote-only$ dpkg --list |grep libvirt
ii  gir1.2-libvirt-glib-1.0:amd64        3.0.0-1                               amd64        GObject introspection files for the libvirt-glib library
ii  libsys-virt-perl                     5.0.0-1build1                         amd64        Perl module providing an extension for the libvirt library
ii  libvirt-clients                      6.0.0-0ubuntu8.15                     amd64        Programs for the libvirt library
ii  libvirt-daemon                       6.0.0-0ubuntu8.15                     amd64        Virtualization daemon
ii  libvirt-daemon-driver-qemu           6.0.0-0ubuntu8.15                     amd64        Virtualization daemon QEMU connection driver
ii  libvirt-daemon-driver-storage-rbd    6.0.0-0ubuntu8.15                     amd64        Virtualization daemon RBD storage driver
ii  libvirt-daemon-system                6.0.0-0ubuntu8.15                     amd64        Libvirt daemon configuration files
ii  libvirt-daemon-system-systemd        6.0.0-0ubuntu8.15                     amd64        Libvirt daemon configuration files (systemd)
ii  libvirt-glib-1.0-0:amd64             3.0.0-1                               amd64        libvirt GLib and GObject mapping library
ii  libvirt0:amd64                       6.0.0-0ubuntu8.15                     amd64        library for interfacing with different virtualization systems
ii  python3-libvirt                      6.1.0-1                               amd64        libvirt Python 3 bindings
msnow@brick:~/terraform_kvm_remote-only$ 

Terraform version

The issue happens with both the latest 1.1 and 0.13 versions of terraform.

msnow@brick:~/terraform_kvm_remote-only$ /opt/bin/terraform_0.13.7 -v
Terraform v0.13.7

Your version of Terraform is out of date! The latest version
is 1.1.2. You can update by downloading from https://www.terraform.io/downloads.html
msnow@brick:~/terraform_kvm_remote-only$ /opt/bin/terraform_1.1.2 -v
Terraform v1.1.2
on linux_amd64
+ provider registry.terraform.io/dmacvicar/libvirt v0.6.12
msnow@brick:~/terraform_kvm_remote-only$ 

Provider and libvirt versions

I tried this with 0.6.11 and the latest 0.6.12.

msnow@brick:~/terraform_kvm_remote-only$ ./.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.11/linux_amd64/terraform-provider-libvirt_v0.6.11 -version
./.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.11/linux_amd64/terraform-provider-libvirt_v0.6.11 0.6.11
msnow@brick:~/terraform_kvm_remote-only$ ./.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 -version
./.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 0.6.12
msnow@brick:~/terraform_kvm_remote-only$ 

Checklist

Description of Issue/Question

Provisioning locally with the libvirt provider uri = "qemu:///system works as expected. I can create networks, pools, domains, etc...
Creating the local default network via the terraform provider requires I first destroy and undefine the 'vanilla' network first since the default net is created when libvirt is installed. This vanilla network is configured with NAT, but I want a bridged network setup so that the VMs can be accessible on the LAN. The bridge netplan config is here )

Provisioning to remote KVM hosts using the examples/v0.13/multiple/main.tf method while relying on password-less SSH keys results in Error: can't find storage pool 'default' .

I have tried creating a new pool name (_poolremote) via the libvirt_pool resource as well as relying on the default, as well as including and/or omitting the definition of the pool to use.
In either case the remote pool is created but volumes cannot be created agains the pool.

msnow@brick2:~/terraform_kvm_remote-only$ virsh pool-dumpxml --pool default 
<pool type='dir'>
  <name>default</name>
  <uuid>30d297b3-1fdf-4bd2-bc1f-42c16d6604d9</uuid>
  <capacity unit='bytes'>501485690880</capacity>
  <allocation unit='bytes'>8371470336</allocation>
  <available unit='bytes'>493114220544</available>
  <source>
  </source>
  <target>
    <path>/var/lib/libvirt/terraform</path>
    <permissions>
      <mode>0775</mode>
      <owner>0</owner>
      <group>108</group>
    </permissions>
  </target>
</pool>

msnow@brick2:~/terraform_kvm_remote-only$ virsh pool-list --all
 Name      State    Autostart
-------------------------------
 default   active   yes

msnow@brick2:~/terraform_kvm_remote-only$ 

Setup

Both hosts have been setup using Ansible roles I created here: https://github.com/mattsn0w/ubuntu_hypervisor a single user was created during OS install and is member to the following groups:

msnow@brick$ groups
msnow adm cdrom sudo dip plugdev kvm lxd libvirt libvirt-qemu
msnow@brick $ ssh brick2 groups
msnow adm cdrom sudo dip plugdev kvm lxd libvirt libvirt-qemu

Clone the remote_debug branch from https://github.com/mattsn0w/terraform_kvm/tree/remote_debug main.tf - https://github.com/mattsn0w/terraform_kvm/blob/remote_debug/main.tf terraform.tfvars - https://github.com/mattsn0w/terraform_kvm/blob/remote_debug/terraform.tfvars

Steps to Reproduce Issue

(Include debug logs if possible and relevant).

Full debug output

msnow@nuc:~/terraform_kvm_remote-only$ TF_LOG=DEBUG terraform apply --var-file=secret.terraform.tfvars
2022-01-01T00:36:08.722Z [INFO]  Terraform version: 1.1.2
2022-01-01T00:36:08.722Z [INFO]  Go runtime version: go1.17.2
2022-01-01T00:36:08.722Z [INFO]  CLI args: []string{"terraform", "apply", "--var-file=secret.terraform.tfvars"}
2022-01-01T00:36:08.723Z [DEBUG] Attempting to open CLI config file: /home/msnow/.terraformrc
2022-01-01T00:36:08.723Z [DEBUG] File doesn't exist, but doesn't need to. Ignoring.
2022-01-01T00:36:08.723Z [DEBUG] ignoring non-existing provider search directory terraform.d/plugins
2022-01-01T00:36:08.723Z [DEBUG] ignoring non-existing provider search directory /home/msnow/.terraform.d/plugins
2022-01-01T00:36:08.723Z [DEBUG] ignoring non-existing provider search directory /home/msnow/.local/share/terraform/plugins
2022-01-01T00:36:08.723Z [DEBUG] ignoring non-existing provider search directory /usr/local/share/terraform/plugins
2022-01-01T00:36:08.723Z [DEBUG] ignoring non-existing provider search directory /usr/share/terraform/plugins
2022-01-01T00:36:08.723Z [DEBUG] ignoring non-existing provider search directory /var/lib/snapd/desktop/terraform/plugins
2022-01-01T00:36:08.724Z [INFO]  CLI command args: []string{"apply", "--var-file=secret.terraform.tfvars"}
2022-01-01T00:36:08.732Z [DEBUG] New state was assigned lineage "b4ef5d76-8d9a-43f0-d377-1f3e25d46c62"
2022-01-01T00:36:09.038Z [DEBUG] checking for provisioner in "."
2022-01-01T00:36:09.038Z [DEBUG] checking for provisioner in "/opt/terraform/bin"
2022-01-01T00:36:09.043Z [INFO]  backend/local: starting Apply operation
2022-01-01T00:36:09.046Z [DEBUG] created provider logger: level=debug
2022-01-01T00:36:09.047Z [INFO]  provider: configuring client automatic mTLS
2022-01-01T00:36:09.086Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 args=[.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12]
2022-01-01T00:36:09.088Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 pid=31850
2022-01-01T00:36:09.089Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12
2022-01-01T00:36:09.130Z [INFO]  provider.terraform-provider-libvirt_v0.6.12: configuring server automatic mTLS: timestamp=2022-01-01T00:36:09.129Z
2022-01-01T00:36:09.320Z [DEBUG] provider: using plugin: version=5
2022-01-01T00:36:09.321Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: plugin address: address=/tmp/plugin194419325 network=unix timestamp=2022-01-01T00:36:09.320Z
2022-01-01T00:36:09.493Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unimplemented desc = unknown service plugin.GRPCStdio"
2022-01-01T00:36:09.496Z [DEBUG] No provider meta schema returned
2022-01-01T00:36:09.504Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 pid=31850
2022-01-01T00:36:09.505Z [DEBUG] provider: plugin exited
2022-01-01T00:36:09.505Z [DEBUG] Building and walking validate graph
2022-01-01T00:36:09.507Z [DEBUG] ProviderTransformer: "libvirt_volume.vm_volume_remote" (*terraform.NodeValidatableResource) needs provider["registry.terraform.io/dmacvicar/libvirt"].brick2
2022-01-01T00:36:09.507Z [DEBUG] ProviderTransformer: "libvirt_volume.focal-base_remote" (*terraform.NodeValidatableResource) needs provider["registry.terraform.io/dmacvicar/libvirt"]
2022-01-01T00:36:09.507Z [DEBUG] ProviderTransformer: "libvirt_cloudinit_disk.commoninit_remote" (*terraform.NodeValidatableResource) needs provider["registry.terraform.io/dmacvicar/libvirt"]
2022-01-01T00:36:09.507Z [DEBUG] ProviderTransformer: "libvirt_domain.vm_domain_remote" (*terraform.NodeValidatableResource) needs provider["registry.terraform.io/dmacvicar/libvirt"]
2022-01-01T00:36:09.508Z [DEBUG] ReferenceTransformer: "var.dns_domain_name" references: []
2022-01-01T00:36:09.508Z [DEBUG] ReferenceTransformer: "var.ethernet_if" references: []
2022-01-01T00:36:09.508Z [DEBUG] ReferenceTransformer: "var.machines_remote" references: []
2022-01-01T00:36:09.508Z [DEBUG] ReferenceTransformer: "var.hostname_prefix" references: []
2022-01-01T00:36:09.508Z [DEBUG] ReferenceTransformer: "var.passwd_hash" references: []
2022-01-01T00:36:09.509Z [DEBUG] ReferenceTransformer: "libvirt_volume.focal-base_remote" references: []
2022-01-01T00:36:09.509Z [INFO]  ReferenceTransformer: reference not found: "path.module"
2022-01-01T00:36:09.509Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:09.509Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:09.509Z [INFO]  ReferenceTransformer: reference not found: "path.module"
2022-01-01T00:36:09.509Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:09.509Z [DEBUG] ReferenceTransformer: "libvirt_cloudinit_disk.commoninit_remote" references: [var.vm_remote_id var.machines_remote var.my_user_name var.root_pw var.ssh_pub_key var.hostname_prefix var.passwd_hash var.dns_domain_one var.dns_domain_two var.dns_ip_one var.dns_ip_two var.ethernet_if var.ip_bitmask var.ip_gateway var.machines_remote]
2022-01-01T00:36:09.509Z [DEBUG] ReferenceTransformer: "var.ssh_pub_key" references: []
2022-01-01T00:36:09.509Z [DEBUG] ReferenceTransformer: "var.ip_gateway" references: []
2022-01-01T00:36:09.509Z [DEBUG] ReferenceTransformer: "var.vm_remote_id" references: []
2022-01-01T00:36:09.509Z [DEBUG] ReferenceTransformer: "var.machines" references: []
2022-01-01T00:36:09.509Z [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/dmacvicar/libvirt\"]" references: []
2022-01-01T00:36:09.510Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:09.510Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:09.510Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:09.510Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:09.510Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:09.510Z [DEBUG] ReferenceTransformer: "libvirt_domain.vm_domain_remote" references: [var.vm_remote_id libvirt_cloudinit_disk.commoninit_remote var.machines_remote libvirt_volume.vm_volume_remote var.machines_remote var.machines_remote]
2022-01-01T00:36:09.510Z [DEBUG] ReferenceTransformer: "var.vm_id" references: []
2022-01-01T00:36:09.510Z [DEBUG] ReferenceTransformer: "var.dns_ip_one" references: []
2022-01-01T00:36:09.511Z [DEBUG] ReferenceTransformer: "var.my_user_name" references: []
2022-01-01T00:36:09.511Z [DEBUG] ReferenceTransformer: "var.dns_domain_one" references: []
2022-01-01T00:36:09.511Z [DEBUG] ReferenceTransformer: "var.ip_bitmask" references: []
2022-01-01T00:36:09.511Z [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/dmacvicar/libvirt\"].brick2" references: []
2022-01-01T00:36:09.511Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:09.511Z [DEBUG] ReferenceTransformer: "libvirt_volume.vm_volume_remote" references: [var.vm_remote_id libvirt_volume.focal-base_remote var.machines_remote]
2022-01-01T00:36:09.511Z [DEBUG] ReferenceTransformer: "var.dns_domain_two" references: []
2022-01-01T00:36:09.511Z [DEBUG] ReferenceTransformer: "var.root_pw" references: []
2022-01-01T00:36:09.511Z [DEBUG] ReferenceTransformer: "var.dns_ip_two" references: []
2022-01-01T00:36:09.514Z [DEBUG] Starting graph walk: walkValidate
2022-01-01T00:36:09.515Z [DEBUG] created provider logger: level=debug
2022-01-01T00:36:09.516Z [INFO]  provider: configuring client automatic mTLS
2022-01-01T00:36:09.560Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 args=[.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12]
2022-01-01T00:36:09.562Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 pid=31859
2022-01-01T00:36:09.562Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12
2022-01-01T00:36:09.589Z [INFO]  provider.terraform-provider-libvirt_v0.6.12: configuring server automatic mTLS: timestamp=2022-01-01T00:36:09.588Z
2022-01-01T00:36:09.775Z [DEBUG] provider: using plugin: version=5
2022-01-01T00:36:09.775Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: plugin address: address=/tmp/plugin026686169 network=unix timestamp=2022-01-01T00:36:09.775Z
2022-01-01T00:36:09.934Z [DEBUG] created provider logger: level=debug
2022-01-01T00:36:09.934Z [INFO]  provider: configuring client automatic mTLS
2022-01-01T00:36:09.936Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unimplemented desc = unknown service plugin.GRPCStdio"
2022-01-01T00:36:09.938Z [DEBUG] No provider meta schema returned
2022-01-01T00:36:09.974Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 args=[.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12]
2022-01-01T00:36:09.975Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 pid=31868
2022-01-01T00:36:09.975Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12
2022-01-01T00:36:10.011Z [INFO]  provider.terraform-provider-libvirt_v0.6.12: configuring server automatic mTLS: timestamp=2022-01-01T00:36:10.010Z
2022-01-01T00:36:10.222Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: plugin address: address=/tmp/plugin663084034 network=unix timestamp=2022-01-01T00:36:10.221Z
2022-01-01T00:36:10.222Z [DEBUG] provider: using plugin: version=5
2022-01-01T00:36:10.378Z [DEBUG] No provider meta schema returned
2022-01-01T00:36:10.378Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unimplemented desc = unknown service plugin.GRPCStdio"
2022-01-01T00:36:10.397Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 pid=31868
2022-01-01T00:36:10.397Z [DEBUG] provider: plugin exited
2022-01-01T00:36:10.404Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 pid=31859
2022-01-01T00:36:10.404Z [DEBUG] provider: plugin exited
2022-01-01T00:36:10.404Z [INFO]  backend/local: apply calling Plan
2022-01-01T00:36:10.405Z [DEBUG] Building and walking plan graph for NormalMode
2022-01-01T00:36:10.406Z [DEBUG] ProviderTransformer: "libvirt_volume.vm_volume_remote (expand)" (*terraform.nodeExpandPlannableResource) needs provider["registry.terraform.io/dmacvicar/libvirt"].brick2
2022-01-01T00:36:10.406Z [DEBUG] ProviderTransformer: "libvirt_volume.focal-base_remote (expand)" (*terraform.nodeExpandPlannableResource) needs provider["registry.terraform.io/dmacvicar/libvirt"]
2022-01-01T00:36:10.406Z [DEBUG] ProviderTransformer: "libvirt_cloudinit_disk.commoninit_remote (expand)" (*terraform.nodeExpandPlannableResource) needs provider["registry.terraform.io/dmacvicar/libvirt"]
2022-01-01T00:36:10.406Z [DEBUG] ProviderTransformer: "libvirt_domain.vm_domain_remote (expand)" (*terraform.nodeExpandPlannableResource) needs provider["registry.terraform.io/dmacvicar/libvirt"]
2022-01-01T00:36:10.407Z [DEBUG] ReferenceTransformer: "libvirt_volume.focal-base_remote (expand)" references: []
2022-01-01T00:36:10.407Z [INFO]  ReferenceTransformer: reference not found: "path.module"
2022-01-01T00:36:10.408Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:10.408Z [INFO]  ReferenceTransformer: reference not found: "path.module"
2022-01-01T00:36:10.408Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:10.408Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:10.408Z [DEBUG] ReferenceTransformer: "libvirt_cloudinit_disk.commoninit_remote (expand)" references: [var.vm_remote_id var.dns_domain_one var.dns_domain_two var.dns_ip_one var.dns_ip_two var.ethernet_if var.ip_bitmask var.ip_gateway var.machines_remote var.machines_remote var.my_user_name var.root_pw var.ssh_pub_key var.hostname_prefix var.passwd_hash]
2022-01-01T00:36:10.408Z [DEBUG] ReferenceTransformer: "var.ip_bitmask" references: []
2022-01-01T00:36:10.408Z [DEBUG] ReferenceTransformer: "var.vm_remote_id" references: []
2022-01-01T00:36:10.408Z [DEBUG] ReferenceTransformer: "var.ssh_pub_key" references: []
2022-01-01T00:36:10.408Z [DEBUG] ReferenceTransformer: "var.machines" references: []
2022-01-01T00:36:10.408Z [DEBUG] ReferenceTransformer: "var.my_user_name" references: []
2022-01-01T00:36:10.408Z [DEBUG] ReferenceTransformer: "var.vm_id" references: []
2022-01-01T00:36:10.408Z [DEBUG] ReferenceTransformer: "var.root_pw" references: []
2022-01-01T00:36:10.408Z [DEBUG] ReferenceTransformer: "var.dns_domain_two" references: []
2022-01-01T00:36:10.408Z [DEBUG] ReferenceTransformer: "var.dns_ip_two" references: []
2022-01-01T00:36:10.408Z [DEBUG] ReferenceTransformer: "var.dns_domain_name" references: []
2022-01-01T00:36:10.408Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:10.408Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:10.408Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:10.408Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:10.408Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:10.408Z [DEBUG] ReferenceTransformer: "libvirt_domain.vm_domain_remote (expand)" references: [var.vm_remote_id libvirt_cloudinit_disk.commoninit_remote (expand) var.machines_remote libvirt_volume.vm_volume_remote (expand) var.machines_remote var.machines_remote]
2022-01-01T00:36:10.409Z [DEBUG] ReferenceTransformer: "var.machines_remote" references: []
2022-01-01T00:36:10.409Z [DEBUG] ReferenceTransformer: "var.passwd_hash" references: []
2022-01-01T00:36:10.409Z [DEBUG] ReferenceTransformer: "var.dns_domain_one" references: []
2022-01-01T00:36:10.409Z [DEBUG] ReferenceTransformer: "var.dns_ip_one" references: []
2022-01-01T00:36:10.409Z [DEBUG] ReferenceTransformer: "var.ip_gateway" references: []
2022-01-01T00:36:10.409Z [DEBUG] ReferenceTransformer: "var.ethernet_if" references: []
2022-01-01T00:36:10.409Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:10.409Z [DEBUG] ReferenceTransformer: "libvirt_volume.vm_volume_remote (expand)" references: [var.vm_remote_id libvirt_volume.focal-base_remote (expand) var.machines_remote]
2022-01-01T00:36:10.409Z [DEBUG] ReferenceTransformer: "var.hostname_prefix" references: []
2022-01-01T00:36:10.409Z [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/dmacvicar/libvirt\"]" references: []
2022-01-01T00:36:10.409Z [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/dmacvicar/libvirt\"].brick2" references: []
2022-01-01T00:36:10.411Z [DEBUG] Starting graph walk: walkPlan
2022-01-01T00:36:10.412Z [DEBUG] created provider logger: level=debug
2022-01-01T00:36:10.412Z [INFO]  provider: configuring client automatic mTLS
2022-01-01T00:36:10.456Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 args=[.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12]
2022-01-01T00:36:10.457Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 pid=31877
2022-01-01T00:36:10.457Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12
2022-01-01T00:36:10.491Z [INFO]  provider.terraform-provider-libvirt_v0.6.12: configuring server automatic mTLS: timestamp=2022-01-01T00:36:10.490Z
2022-01-01T00:36:10.696Z [DEBUG] provider: using plugin: version=5
2022-01-01T00:36:10.696Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: plugin address: address=/tmp/plugin554500671 network=unix timestamp=2022-01-01T00:36:10.695Z
2022-01-01T00:36:10.857Z [DEBUG] created provider logger: level=debug
2022-01-01T00:36:10.857Z [INFO]  provider: configuring client automatic mTLS
2022-01-01T00:36:10.858Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unimplemented desc = unknown service plugin.GRPCStdio"
2022-01-01T00:36:10.903Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 args=[.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12]
2022-01-01T00:36:10.905Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 pid=31886
2022-01-01T00:36:10.905Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12
2022-01-01T00:36:10.939Z [INFO]  provider.terraform-provider-libvirt_v0.6.12: configuring server automatic mTLS: timestamp=2022-01-01T00:36:10.938Z
2022-01-01T00:36:11.137Z [DEBUG] provider: using plugin: version=5
2022-01-01T00:36:11.137Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: plugin address: address=/tmp/plugin810596988 network=unix timestamp=2022-01-01T00:36:11.137Z
2022-01-01T00:36:11.304Z [DEBUG] No provider meta schema returned
2022-01-01T00:36:11.305Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unimplemented desc = unknown service plugin.GRPCStdio"
2022-01-01T00:36:11.307Z [DEBUG] No provider meta schema returned
2022-01-01T00:36:11.316Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:11 [DEBUG] Configuring provider for 'qemu+ssh://msnow@brick2.co.example.net/system?keyfile=/home/msnow/.ssh/id_rsa&sshauth=privkey': &{map[uri:0xc0001223c0] <nil> <nil> 0xc000380080 map[] <nil> 0xc000380100 0xc0005bc108 0xc0005a4730 false map[] {1 {0 0}} false false}
2022-01-01T00:36:11.321Z [WARN]  ValidateProviderConfig from "provider[\"registry.terraform.io/dmacvicar/libvirt\"]" changed the config value, but that value is unused
2022-01-01T00:36:11.322Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:11 [DEBUG] Configuring provider for 'qemu:///system': &{map[uri:0xc0005263c0] <nil> <nil> 0xc00048d140 map[] <nil> 0xc00048d220 0xc000378348 0xc000688eb0 false map[] {1 {0 0}} false false}
2022-01-01T00:36:11.322Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:11 [INFO] Set up libvirt transport: &{{0xc00037e380}}
2022-01-01T00:36:11.325Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:11 [INFO] libvirt client libvirt version: 6000000
2022-01-01T00:36:11.325Z [DEBUG] Resource instance state not found for node "libvirt_volume.focal-base_remote", instance libvirt_volume.focal-base_remote
2022-01-01T00:36:11.326Z [DEBUG] ReferenceTransformer: "libvirt_volume.focal-base_remote" references: []
2022-01-01T00:36:11.326Z [DEBUG] Resource instance state not found for node "libvirt_cloudinit_disk.commoninit_remote[0]", instance libvirt_cloudinit_disk.commoninit_remote[0]
2022-01-01T00:36:11.326Z [INFO]  ReferenceTransformer: reference not found: "var.vm_remote_id"
2022-01-01T00:36:11.326Z [INFO]  ReferenceTransformer: reference not found: "path.module"
2022-01-01T00:36:11.326Z [INFO]  ReferenceTransformer: reference not found: "var.dns_domain_one"
2022-01-01T00:36:11.326Z [INFO]  ReferenceTransformer: reference not found: "var.dns_domain_two"
2022-01-01T00:36:11.326Z [INFO]  ReferenceTransformer: reference not found: "var.dns_ip_one"
2022-01-01T00:36:11.326Z [INFO]  ReferenceTransformer: reference not found: "var.dns_ip_two"
2022-01-01T00:36:11.326Z [INFO]  ReferenceTransformer: reference not found: "var.ethernet_if"
2022-01-01T00:36:11.326Z [INFO]  ReferenceTransformer: reference not found: "var.ip_bitmask"
2022-01-01T00:36:11.326Z [INFO]  ReferenceTransformer: reference not found: "var.ip_gateway"
2022-01-01T00:36:11.326Z [INFO]  ReferenceTransformer: reference not found: "var.machines_remote"
2022-01-01T00:36:11.326Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:11.326Z [INFO]  ReferenceTransformer: reference not found: "path.module"
2022-01-01T00:36:11.327Z [INFO]  ReferenceTransformer: reference not found: "var.machines_remote"
2022-01-01T00:36:11.327Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:11.327Z [INFO]  ReferenceTransformer: reference not found: "var.my_user_name"
2022-01-01T00:36:11.327Z [INFO]  ReferenceTransformer: reference not found: "var.root_pw"
2022-01-01T00:36:11.327Z [INFO]  ReferenceTransformer: reference not found: "var.ssh_pub_key"
2022-01-01T00:36:11.327Z [INFO]  ReferenceTransformer: reference not found: "var.hostname_prefix"
2022-01-01T00:36:11.327Z [INFO]  ReferenceTransformer: reference not found: "var.passwd_hash"
2022-01-01T00:36:11.327Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:11.327Z [DEBUG] ReferenceTransformer: "libvirt_cloudinit_disk.commoninit_remote[0]" references: []
2022-01-01T00:36:11.327Z [DEBUG] refresh: libvirt_volume.focal-base_remote: no state, so not refreshing
2022-01-01T00:36:11.327Z [DEBUG] refresh: libvirt_cloudinit_disk.commoninit_remote[0]: no state, so not refreshing
2022-01-01T00:36:11.332Z [WARN]  Provider "registry.terraform.io/dmacvicar/libvirt" produced an invalid plan for libvirt_volume.focal-base_remote, but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .pool: planned value cty.StringVal("default") for a non-computed attribute
2022-01-01T00:36:11.336Z [WARN]  Provider "registry.terraform.io/dmacvicar/libvirt" produced an invalid plan for libvirt_cloudinit_disk.commoninit_remote[0], but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .pool: planned value cty.StringVal("default") for a non-computed attribute
2022-01-01T00:36:11.904Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:11 [INFO] Set up libvirt transport: &{0xc0003ce0c0 0xc0006b6440 0xc0006b6460}
2022-01-01T00:36:11.911Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:11 [INFO] libvirt client libvirt version: 6000000
2022-01-01T00:36:11.913Z [DEBUG] Resource instance state not found for node "libvirt_volume.vm_volume_remote[0]", instance libvirt_volume.vm_volume_remote[0]
2022-01-01T00:36:11.913Z [INFO]  ReferenceTransformer: reference not found: "var.vm_remote_id"
2022-01-01T00:36:11.913Z [INFO]  ReferenceTransformer: reference not found: "var.machines_remote"
2022-01-01T00:36:11.914Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:11.914Z [DEBUG] ReferenceTransformer: "libvirt_volume.vm_volume_remote[0]" references: []
2022-01-01T00:36:11.915Z [DEBUG] refresh: libvirt_volume.vm_volume_remote[0]: no state, so not refreshing
2022-01-01T00:36:11.924Z [WARN]  Provider "registry.terraform.io/dmacvicar/libvirt" produced an invalid plan for libvirt_volume.vm_volume_remote[0], but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .pool: planned value cty.StringVal("default") for a non-computed attribute
2022-01-01T00:36:11.925Z [DEBUG] Resource instance state not found for node "libvirt_domain.vm_domain_remote[0]", instance libvirt_domain.vm_domain_remote[0]
2022-01-01T00:36:11.926Z [INFO]  ReferenceTransformer: reference not found: "var.vm_remote_id"
2022-01-01T00:36:11.926Z [INFO]  ReferenceTransformer: reference not found: "libvirt_cloudinit_disk.commoninit_remote"
2022-01-01T00:36:11.926Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:11.926Z [INFO]  ReferenceTransformer: reference not found: "var.machines_remote"
2022-01-01T00:36:11.927Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:11.927Z [INFO]  ReferenceTransformer: reference not found: "libvirt_volume.vm_volume_remote"
2022-01-01T00:36:11.927Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:11.927Z [INFO]  ReferenceTransformer: reference not found: "var.machines_remote"
2022-01-01T00:36:11.927Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:11.927Z [INFO]  ReferenceTransformer: reference not found: "var.machines_remote"
2022-01-01T00:36:11.927Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:11.927Z [DEBUG] ReferenceTransformer: "libvirt_domain.vm_domain_remote[0]" references: []
2022-01-01T00:36:11.931Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:11 [DEBUG] cleaning up connection for URI: qemu+ssh://msnow@brick2.co.example.net/system?keyfile=/home/msnow/.ssh/id_rsa&sshauth=privkey
2022-01-01T00:36:11.934Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 pid=31877
2022-01-01T00:36:11.935Z [DEBUG] provider: plugin exited
2022-01-01T00:36:11.935Z [DEBUG] refresh: libvirt_domain.vm_domain_remote[0]: no state, so not refreshing
2022-01-01T00:36:11.955Z [WARN]  Provider "registry.terraform.io/dmacvicar/libvirt" produced an invalid plan for libvirt_domain.vm_domain_remote[0], but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .fw_cfg_name: planned value cty.StringVal("opt/com.coreos/config") for a non-computed attribute
      - .qemu_agent: planned value cty.False for a non-computed attribute
      - .running: planned value cty.True for a non-computed attribute
      - .graphics[0].listen_address: planned value cty.StringVal("127.0.0.1") for a non-computed attribute
      - .console[0].source_service: planned value cty.StringVal("0") for a non-computed attribute
      - .console[0].source_host: planned value cty.StringVal("127.0.0.1") for a non-computed attribute
      - .console[1].source_host: planned value cty.StringVal("127.0.0.1") for a non-computed attribute
      - .console[1].source_service: planned value cty.StringVal("0") for a non-computed attribute
2022-01-01T00:36:11.959Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:11 [DEBUG] cleaning up connection for URI: qemu:///system
2022-01-01T00:36:11.963Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 pid=31886
2022-01-01T00:36:11.963Z [DEBUG] provider: plugin exited

Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following symbols:
  + create

Terraform will perform the following actions:

  # libvirt_cloudinit_disk.commoninit_remote[0] will be created
  + resource "libvirt_cloudinit_disk" "commoninit_remote" {
      + id             = (known after apply)
      + name           = "commoninit_remote_0.iso"
      + network_config = <<-EOT
            version: 2
            ethernets:
              ens3:
                dhcp4: false
              eth0:
                dhcp4: false
              enp1s0:
                dhcp4: false
                addresses:
                  - 172.16.1.62/24
                gateway4: 172.16.1.254
                nameservers:
                  search: [co.example.net, co.example.net]
                  addresses: [172.16.1.53, 172.16.1.81]
        EOT
      + pool           = "default"
      + user_data      = <<-EOT
            #cloud-config
            # vim: syntax=yaml
            #
            # ***********************
            #   ---- for more examples look at: ------
            # ---> https://cloudinit.readthedocs.io/en/latest/topics/examples.html
            # ******************************
            #

            meta-data:
              instance-id: legvm2.co.example.net
              local-hostname: legvm2.co.example.net
            fqdn: legvm2.co.example.net
            hostname: legvm2.co.example.net
            ssh_pwauth: yes
            chpasswd:
              list: |
                 root:terraformk3s
              expire: False
            package_update: true
            packages:
              - net-tools
              - nfs-common
              - qemu-guest-agent
              - sysstat
              - curl
              - apt-transport-https
              - python3-pip
              - gnupg2
              - python-netaddr
              - unzip
            groups:
              - msnow: msnow
            users:
              - default
              - name: msnow
                uid: 1001
                sudo: ALL=(ALL) NOPASSWD:ALL
                groups: wheel, users, admin, sudo
                homedir: /home/msnow
                passwd: *********************************************************************************************
                lock_passwd: False
                primary_group: msnow
                shell: /bin/bash
                ssh_authorized_keys:
                - ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC8MvbgzpmSkdjDsgkfZVzfByO3Amg4P2cUklbhm/WD3SwbBh8uGz9pLG5zdo5Bx14CfRitgxfTzKCz8ACbjK00VXbDaUOAZd3lhZ/qsdfK3HldNsLhZQc8NPhOzHMtZUYN3jDdGw9dxyI9K7tMygop1sKTA7rM4PlN4nJgI0v5CvpIFkvfbH+NZcQBffG0pjtNdIXTVLvusjDX2iMTucHYSKPdfMQXU3nccTi5CO/9801IZqdRHxrU9zeAW8ccbFPJZm+Ag9TYOWSrdm1yZbqbl5fgLSEIwlO/LPgbvGgVEFxuY5Sx4+D9dDTDKOdBkNLM16vSfEMxC7IWCxfCkEDd msnow@msnow-lt2.local
            power_state:
              mode: reboot
              message: Bye Bye
              timeout: 30
              condition: True
        EOT
    }

  # libvirt_domain.vm_domain_remote[0] will be created
  + resource "libvirt_domain" "vm_domain_remote" {
      + arch        = (known after apply)
      + cloudinit   = (known after apply)
      + disk        = [
          + {
              + block_device = null
              + file         = null
              + scsi         = null
              + url          = null
              + volume_id    = (known after apply)
              + wwn          = null
            },
        ]
      + emulator    = (known after apply)
      + fw_cfg_name = "opt/com.coreos/config"
      + id          = (known after apply)
      + machine     = "q35"
      + memory      = 4096
      + name        = "legvm2.co.example.net"
      + qemu_agent  = false
      + running     = true
      + vcpu        = 2

      + console {
          + source_host    = "127.0.0.1"
          + source_service = "0"
          + target_port    = "0"
          + target_type    = "serial"
          + type           = "pty"
        }
      + console {
          + source_host    = "127.0.0.1"
          + source_service = "0"
          + target_port    = "1"
          + target_type    = "virtio"
          + type           = "pty"
        }

      + graphics {
          + autoport       = true
          + listen_address = "127.0.0.1"
          + listen_type    = "address"
          + type           = "spice"
        }

      + network_interface {
          + addresses    = (known after apply)
          + bridge       = "eth0"
          + hostname     = "legvm2.co.example.net"
          + mac          = "56:6f:4f:c1:00:03"
          + network_id   = (known after apply)
          + network_name = (known after apply)
        }

      + xml {
          + xslt = <<-EOT
                <?xml version="1.0" ?>
                <xsl:stylesheet version="1.0"
                                xmlns:xsl="http://www.w3.org/1999/XSL/Transform">
                  <xsl:output omit-xml-declaration="yes" indent="yes"/>
                  <xsl:template match="node()|@*">
                     <xsl:copy>
                       <xsl:apply-templates select="node()|@*"/>
                     </xsl:copy>
                  </xsl:template>

                  <xsl:template match="/domain/devices/disk[@device='cdrom']/target/@bus">
                    <xsl:attribute name="bus">
                      <xsl:value-of select="'sata'"/>
                    </xsl:attribute>
                  </xsl:template>

                </xsl:stylesheet>
            EOT
        }
    }

  # libvirt_volume.focal-base_remote will be created
  + resource "libvirt_volume" "focal-base_remote" {
      + format = "qcow2"
      + id     = (known after apply)
      + name   = "focal-base_remote"
      + pool   = "default"
      + size   = (known after apply)
      + source = "/var/lib/libvirt/terraform/base_images/ubuntu-20.04-server-cloudimg-amd64.img"
    }

  # libvirt_volume.vm_volume_remote[0] will be created
  + resource "libvirt_volume" "vm_volume_remote" {
      + base_volume_id = (known after apply)
      + format         = (known after apply)
      + id             = (known after apply)
      + name           = "legvm2.co.example.net.qcow2"
      + pool           = "default"
      + size           = 30000000000
    }

Plan: 4 to add, 0 to change, 0 to destroy.
2022-01-01T00:36:11.975Z [DEBUG] command: asking for input: "\nDo you want to perform these actions?"

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value: yes

2022-01-01T00:36:13.537Z [INFO]  backend/local: apply calling Apply
2022-01-01T00:36:13.538Z [DEBUG] Building and walking apply graph for NormalMode plan
2022-01-01T00:36:13.540Z [DEBUG] Resource state not found for node "libvirt_cloudinit_disk.commoninit_remote[0]", instance libvirt_cloudinit_disk.commoninit_remote[0]
2022-01-01T00:36:13.541Z [DEBUG] Resource state not found for node "libvirt_volume.vm_volume_remote[0]", instance libvirt_volume.vm_volume_remote[0]
2022-01-01T00:36:13.541Z [DEBUG] Resource state not found for node "libvirt_volume.focal-base_remote", instance libvirt_volume.focal-base_remote
2022-01-01T00:36:13.541Z [DEBUG] Resource state not found for node "libvirt_domain.vm_domain_remote[0]", instance libvirt_domain.vm_domain_remote[0]
2022-01-01T00:36:13.546Z [DEBUG] ProviderTransformer: "libvirt_volume.vm_volume_remote[0]" (*terraform.NodeApplyableResourceInstance) needs provider["registry.terraform.io/dmacvicar/libvirt"].brick2
2022-01-01T00:36:13.546Z [DEBUG] ProviderTransformer: "libvirt_volume.focal-base_remote (expand)" (*terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/dmacvicar/libvirt"]
2022-01-01T00:36:13.546Z [DEBUG] ProviderTransformer: "libvirt_volume.focal-base_remote" (*terraform.NodeApplyableResourceInstance) needs provider["registry.terraform.io/dmacvicar/libvirt"]
2022-01-01T00:36:13.547Z [DEBUG] ProviderTransformer: "libvirt_volume.vm_volume_remote (expand)" (*terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/dmacvicar/libvirt"].brick2
2022-01-01T00:36:13.547Z [DEBUG] ProviderTransformer: "libvirt_cloudinit_disk.commoninit_remote[0]" (*terraform.NodeApplyableResourceInstance) needs provider["registry.terraform.io/dmacvicar/libvirt"]
2022-01-01T00:36:13.547Z [DEBUG] ProviderTransformer: "libvirt_domain.vm_domain_remote[0]" (*terraform.NodeApplyableResourceInstance) needs provider["registry.terraform.io/dmacvicar/libvirt"]
2022-01-01T00:36:13.547Z [DEBUG] ProviderTransformer: "libvirt_cloudinit_disk.commoninit_remote (expand)" (*terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/dmacvicar/libvirt"]
2022-01-01T00:36:13.548Z [DEBUG] ProviderTransformer: "libvirt_domain.vm_domain_remote (expand)" (*terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/dmacvicar/libvirt"]
2022-01-01T00:36:13.551Z [DEBUG] ReferenceTransformer: "var.machines" references: []
2022-01-01T00:36:13.551Z [DEBUG] ReferenceTransformer: "var.ip_bitmask" references: []
2022-01-01T00:36:13.551Z [DEBUG] ReferenceTransformer: "var.vm_id" references: []
2022-01-01T00:36:13.551Z [DEBUG] ReferenceTransformer: "var.ssh_pub_key" references: []
2022-01-01T00:36:13.551Z [DEBUG] ReferenceTransformer: "var.hostname_prefix" references: []
2022-01-01T00:36:13.551Z [DEBUG] ReferenceTransformer: "libvirt_volume.vm_volume_remote (expand)" references: [var.vm_remote_id]
2022-01-01T00:36:13.551Z [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/dmacvicar/libvirt\"]" references: []
2022-01-01T00:36:13.551Z [DEBUG] ReferenceTransformer: "var.dns_domain_name" references: []
2022-01-01T00:36:13.551Z [DEBUG] ReferenceTransformer: "var.dns_domain_one" references: []
2022-01-01T00:36:13.551Z [INFO]  ReferenceTransformer: reference not found: "path.module"
2022-01-01T00:36:13.551Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:13.551Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:13.551Z [INFO]  ReferenceTransformer: reference not found: "path.module"
2022-01-01T00:36:13.551Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:13.552Z [DEBUG] ReferenceTransformer: "libvirt_cloudinit_disk.commoninit_remote[0]" references: [var.vm_remote_id var.machines_remote var.my_user_name var.root_pw var.ssh_pub_key var.hostname_prefix var.passwd_hash var.dns_domain_one var.dns_domain_two var.dns_ip_one var.dns_ip_two var.ethernet_if var.ip_bitmask var.ip_gateway var.machines_remote]
2022-01-01T00:36:13.552Z [DEBUG] ReferenceTransformer: "var.my_user_name" references: []
2022-01-01T00:36:13.552Z [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/dmacvicar/libvirt\"].brick2" references: []
2022-01-01T00:36:13.552Z [DEBUG] ReferenceTransformer: "var.dns_ip_two" references: []
2022-01-01T00:36:13.552Z [DEBUG] ReferenceTransformer: "var.passwd_hash" references: []
2022-01-01T00:36:13.552Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:13.552Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:13.552Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:13.552Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:13.552Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:13.552Z [INFO]  ReferenceTransformer: reference not found: "libvirt_cloudinit_disk.commoninit_remote#destroy"
2022-01-01T00:36:13.552Z [INFO]  ReferenceTransformer: reference not found: "libvirt_volume.vm_volume_remote#destroy"
2022-01-01T00:36:13.552Z [DEBUG] ReferenceTransformer: "libvirt_domain.vm_domain_remote[0]" references: [var.vm_remote_id var.machines_remote libvirt_cloudinit_disk.commoninit_remote[0] libvirt_cloudinit_disk.commoninit_remote (expand) libvirt_volume.vm_volume_remote (expand) libvirt_volume.vm_volume_remote[0] var.machines_remote var.machines_remote]
2022-01-01T00:36:13.552Z [DEBUG] ReferenceTransformer: "libvirt_cloudinit_disk.commoninit_remote (expand)" references: [var.vm_remote_id]
2022-01-01T00:36:13.552Z [DEBUG] ReferenceTransformer: "var.root_pw" references: []
2022-01-01T00:36:13.552Z [DEBUG] ReferenceTransformer: "var.vm_remote_id" references: []
2022-01-01T00:36:13.552Z [DEBUG] ReferenceTransformer: "var.dns_domain_two" references: []
2022-01-01T00:36:13.552Z [DEBUG] ReferenceTransformer: "var.machines_remote" references: []
2022-01-01T00:36:13.553Z [DEBUG] ReferenceTransformer: "libvirt_domain.vm_domain_remote (expand)" references: [var.vm_remote_id]
2022-01-01T00:36:13.553Z [DEBUG] ReferenceTransformer: "var.ethernet_if" references: []
2022-01-01T00:36:13.553Z [INFO]  ReferenceTransformer: reference not found: "count.index"
2022-01-01T00:36:13.553Z [DEBUG] ReferenceTransformer: "libvirt_volume.vm_volume_remote[0]" references: [var.vm_remote_id libvirt_volume.focal-base_remote (expand) libvirt_volume.focal-base_remote libvirt_volume.focal-base_remote var.machines_remote]
2022-01-01T00:36:13.553Z [DEBUG] ReferenceTransformer: "libvirt_volume.focal-base_remote (expand)" references: []
2022-01-01T00:36:13.553Z [DEBUG] ReferenceTransformer: "var.ip_gateway" references: []
2022-01-01T00:36:13.553Z [DEBUG] ReferenceTransformer: "var.dns_ip_one" references: []
2022-01-01T00:36:13.553Z [DEBUG] ReferenceTransformer: "libvirt_volume.focal-base_remote" references: []
2022-01-01T00:36:13.557Z [DEBUG] Starting graph walk: walkApply
2022-01-01T00:36:13.558Z [DEBUG] created provider logger: level=debug
2022-01-01T00:36:13.558Z [INFO]  provider: configuring client automatic mTLS
2022-01-01T00:36:13.597Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 args=[.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12]
2022-01-01T00:36:13.599Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 pid=31895
2022-01-01T00:36:13.599Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12
2022-01-01T00:36:13.635Z [INFO]  provider.terraform-provider-libvirt_v0.6.12: configuring server automatic mTLS: timestamp=2022-01-01T00:36:13.635Z
2022-01-01T00:36:13.828Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: plugin address: network=unix address=/tmp/plugin183279533 timestamp=2022-01-01T00:36:13.827Z
2022-01-01T00:36:13.828Z [DEBUG] provider: using plugin: version=5
2022-01-01T00:36:13.979Z [DEBUG] created provider logger: level=debug
2022-01-01T00:36:13.979Z [INFO]  provider: configuring client automatic mTLS
2022-01-01T00:36:13.980Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unimplemented desc = unknown service plugin.GRPCStdio"
2022-01-01T00:36:13.983Z [DEBUG] No provider meta schema returned
2022-01-01T00:36:14.025Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 args=[.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12]
2022-01-01T00:36:14.027Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 pid=31904
2022-01-01T00:36:14.027Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12
2022-01-01T00:36:14.063Z [INFO]  provider.terraform-provider-libvirt_v0.6.12: configuring server automatic mTLS: timestamp=2022-01-01T00:36:14.063Z
2022-01-01T00:36:14.255Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: plugin address: address=/tmp/plugin288553619 network=unix timestamp=2022-01-01T00:36:14.254Z
2022-01-01T00:36:14.255Z [DEBUG] provider: using plugin: version=5
2022-01-01T00:36:14.416Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 [DEBUG] Configuring provider for 'qemu+ssh://msnow@brick2.co.example.net/system?keyfile=/home/msnow/.ssh/id_rsa&sshauth=privkey': &{map[uri:0xc0000d63c0] <nil> <nil> 0xc00046e380 map[] <nil> 0xc00046e400 0xc0006141c8 0xc00042a870 false map[] {1 {0 0}} false false}
2022-01-01T00:36:14.417Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unimplemented desc = unknown service plugin.GRPCStdio"
2022-01-01T00:36:14.418Z [DEBUG] No provider meta schema returned
2022-01-01T00:36:14.430Z [WARN]  ValidateProviderConfig from "provider[\"registry.terraform.io/dmacvicar/libvirt\"]" changed the config value, but that value is unused
2022-01-01T00:36:14.431Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 [DEBUG] Configuring provider for 'qemu:///system': &{map[uri:0xc0005263c0] <nil> <nil> 0xc0004fa100 map[] <nil> 0xc0004fa180 0xc0005e01f8 0xc00047a3c0 false map[] {1 {0 0}} false false}
2022-01-01T00:36:14.432Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 [INFO] Set up libvirt transport: &{{0xc000198300}}
2022-01-01T00:36:14.434Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 [INFO] libvirt client libvirt version: 6000000
2022-01-01T00:36:14.440Z [WARN]  Provider "registry.terraform.io/dmacvicar/libvirt" produced an invalid plan for libvirt_volume.focal-base_remote, but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .pool: planned value cty.StringVal("default") for a non-computed attribute
libvirt_volume.focal-base_remote: Creating...
2022-01-01T00:36:14.440Z [INFO]  Starting apply for libvirt_volume.focal-base_remote
2022-01-01T00:36:14.441Z [DEBUG] libvirt_volume.focal-base_remote: applying the planned Create change
2022-01-01T00:36:14.448Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 [DEBUG] Locking "default"
2022-01-01T00:36:14.448Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 [DEBUG] Locked "default"
2022-01-01T00:36:14.448Z [WARN]  Provider "registry.terraform.io/dmacvicar/libvirt" produced an invalid plan for libvirt_cloudinit_disk.commoninit_remote[0], but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .pool: planned value cty.StringVal("default") for a non-computed attribute
libvirt_cloudinit_disk.commoninit_remote[0]: Creating...
2022-01-01T00:36:14.449Z [INFO]  Starting apply for libvirt_cloudinit_disk.commoninit_remote[0]
2022-01-01T00:36:14.450Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 [DEBUG] Unlocking "default"
2022-01-01T00:36:14.450Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 [DEBUG] Unlocked "default"
2022-01-01T00:36:14.452Z [DEBUG] libvirt_cloudinit_disk.commoninit_remote[0]: applying the planned Create change
2022-01-01T00:36:14.454Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 [DEBUG] creating cloudinit
2022-01-01T00:36:14.454Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 [INFO] cloudInit: {Name:commoninit_remote_0.iso PoolName:default MetaData: UserData:#cloud-config
2022-01-01T00:36:14.454Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: # vim: syntax=yaml
2022-01-01T00:36:14.454Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: #
2022-01-01T00:36:14.454Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: # ***********************
2022-01-01T00:36:14.454Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: #     ---- for more examples look at: ------
2022-01-01T00:36:14.454Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: # ---> https://cloudinit.readthedocs.io/en/latest/topics/examples.html
2022-01-01T00:36:14.454Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: # ******************************
2022-01-01T00:36:14.454Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: #
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: meta-data:
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   instance-id: legvm2.co.example.net
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   local-hostname: legvm2.co.example.net
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: fqdn: legvm2.co.example.net
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: hostname: legvm2.co.example.net
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: ssh_pwauth: yes
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: chpasswd:
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   list: |
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:      root:terraformk3s
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   expire: False
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: package_update: true
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: packages:
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   - net-tools
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   - nfs-common
2022-01-01T00:36:14.455Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   - qemu-guest-agent
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   - sysstat
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   - curl
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   - apt-transport-https
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   - python3-pip
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   - gnupg2
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   - python-netaddr
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   - unzip
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: groups:
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   - msnow: msnow
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: users:
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   - default
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   - name: msnow
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     uid: 1001
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     sudo: ALL=(ALL) NOPASSWD:ALL
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     groups: wheel, users, admin, sudo
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     homedir: /home/msnow
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     passwd: *********************************************************************************************
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     lock_passwd: False
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     primary_group: msnow
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     shell: /bin/bash
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     ssh_authorized_keys:
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     - ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC8MvbgzpmSkdjDsgkfZVzfByO3Amg4P2cUklbhm/WD3SwbBh8uGz9pLG5zdo5Bx14CfRitgxfTzKCz8ACbjK00VXbDaUOAZd3lhZ/qsdfK3HldNsLhZQc8NPhOzHMtZUYN3jDdGw9dxyI9K7tMygop1sKTA7rM4PlN4nJgI0v5CvpIFkvfbH+NZcQBffG0pjtNdIXTVLvusjDX2iMTucHYSKPdfMQXU3nccTi5CO/9801IZqdRHxrU9zeAW8ccbFPJZm+Ag9TYOWSrdm1yZbqbl5fgLSEIwlO/LPgbvGgVEFxuY5Sx4+D9dDTDKOdBkNLM16vSfEMxC7IWCxfCkEDd msnow@msnow-lt2.local
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: power_state:
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   mode: reboot
2022-01-01T00:36:14.456Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   message: Bye Bye
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   timeout: 30
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   condition: True
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:  NetworkConfig:version: 2
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: ethernets:
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   ens3:
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     dhcp4: false
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   eth0:
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     dhcp4: false
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:   enp1s0:
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     dhcp4: false
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     addresses:
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:       - 172.16.1.62/24
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     gateway4: 172.16.1.254
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:     nameservers:
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:       search: [co.example.net, co.example.net]
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12:       addresses: [172.16.1.53, 172.16.1.81]
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: }
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 Creating new ISO
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 Creating ISO contents
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 ISO contents created
2022-01-01T00:36:14.457Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 About to execute cmd: /usr/bin/mkisofs -output /tmp/cloudinit368359126/commoninit_remote_0.iso -volid cidata -joliet -rock /tmp/cloudinit368359126/user-data /tmp/cloudinit368359126/meta-data /tmp/cloudinit368359126/network-config
2022-01-01T00:36:14.464Z [ERROR] vertex "libvirt_volume.focal-base_remote" error: can't find storage pool 'default'
2022-01-01T00:36:14.473Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 ISO created at /tmp/cloudinit368359126/commoninit_remote_0.iso
2022-01-01T00:36:14.488Z [ERROR] vertex "libvirt_cloudinit_disk.commoninit_remote[0]" error: can't find storage pool 'default'
2022-01-01T00:36:14.932Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 [INFO] Set up libvirt transport: &{0xc0006a80c0 0xc0006280a0 0xc0006280c0}
2022-01-01T00:36:14.939Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 [INFO] libvirt client libvirt version: 6000000
╷
│ Error: can't find storage pool 'default'
│ 
│   with libvirt_volume.focal-base_remote,
│   on main.tf line 21, in resource "libvirt_volume" "focal-base_remote":
│   21: resource "libvirt_volume" "focal-base_remote" {
│ 
╵
╷
│ Error: can't find storage pool 'default'
│ 
│   with libvirt_cloudinit_disk.commoninit_remote[0],
│   on main.tf line 30, in resource "libvirt_cloudinit_disk" "commoninit_remote":
│   30: resource "libvirt_cloudinit_disk" "commoninit_remote" {
│ 
╵
2022-01-01T00:36:14.972Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 [DEBUG] cleaning up connection for URI: qemu+ssh://msnow@brick2.co.example.net/system?keyfile=/home/msnow/.ssh/id_rsa&sshauth=privkey
2022-01-01T00:36:14.973Z [DEBUG] provider.terraform-provider-libvirt_v0.6.12: 2022/01/01 00:36:14 [DEBUG] cleaning up connection for URI: qemu:///system
2022-01-01T00:36:14.978Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 pid=31895
2022-01-01T00:36:14.979Z [DEBUG] provider: plugin exited
2022-01-01T00:36:14.978Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/dmacvicar/libvirt/0.6.12/linux_amd64/terraform-provider-libvirt_v0.6.12 pid=31904
2022-01-01T00:36:14.979Z [DEBUG] provider: plugin exited
msnow@nuc:~/terraform_kvm_remote-only$ 

Additional information:

Do you have SELinux or Apparmor/Firewall enabled? Some special configuration?