search

iterative / cml-playground

4 stars 0 forks source link

Someone left the lights on #99

Closed iterative-olivaw closed 1 year ago

iterative-olivaw commented 2 years ago

Found instances in region us-west-1

Instance i-0d7a585eaf4d16845 on for 09h 00m 19s Instance i-037e0df9ef9d22890 on for 09h 02m 45s

dacbd commented 2 years ago

Instance i-0d7a585eaf4d16845 Run: https://github.com/iterative/cml-playground/actions/runs/3038280137/attempts/1

ubuntu@ip-172-31-19-253:~$ journalctl --no-pager -n all -u cml.service 
-- Logs begin at Thu 2022-08-25 14:12:38 UTC, end at Tue 2022-09-13 15:58:21 UTC. --
Sep 12 14:52:25 ip-172-31-19-253 systemd[1]: Started cml.service.
Sep 12 14:52:25 ip-172-31-19-253 cml.sh[2002]:   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
Sep 12 14:52:25 ip-172-31-19-253 cml.sh[2002]:                                  Dload  Upload   Total   Spent    Left  Speed
Sep 12 14:52:25 ip-172-31-19-253 cml.sh[2002]: [158B blob data]
Sep 12 14:52:27 ip-172-31-19-253 cml.sh[2002]: {"level":"warn","message":"Github Actions timeout has been updated from 72h to 35 days. Update your workflow accordingly to be able to restart it automatically."}
Sep 12 14:52:27 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Preparing workdir /tmp/tmp.3CTEB6Smj4/.cml/cml-ot7set6d9h..."}
Sep 12 14:52:27 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Launching github runner"}
Sep 12 14:52:31 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Terraform 1.2.7"}
Sep 12 14:52:32 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Plan: 0 to add, 0 to change, 0 to destroy."}
Sep 12 14:52:32 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Apply complete! Resources: 0 added, 0 changed, 0 destroyed."}
Sep 12 14:52:32 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Outputs: 0"}
Sep 12 14:52:32 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Connected to acpid service."}
Sep 12 14:52:49 ip-172-31-19-253 cml.sh[2002]: {"date":"2022-09-12T14:52:49.830Z","level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"ready"}
Sep 12 14:53:14 ip-172-31-19-253 cml.sh[2002]: {"date":"2022-09-12T14:53:14.346Z","level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"job_ended","success":true}
Sep 12 14:53:22 ip-172-31-19-253 cml.sh[2002]: {"date":"2022-09-12T14:53:06.871Z","job":8308590505,"level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"job_started"}
ubuntu@ip-172-31-19-253:~$ 

ubuntu@ip-172-31-19-253:~$ sudo systemctl status -l --no-pager cml.service
● cml.service
   Loaded: loaded (/etc/systemd/system/cml.service; enabled; vendor preset: enabled)
   Active: active (running) since Mon 2022-09-12 14:52:25 UTC; 1 day 1h ago
 Main PID: 2002 (cml-internal)
    Tasks: 25 (limit: 2300)
   CGroup: /system.slice/cml.service
           ├─2002 /usr/bin/cml-internal runner --name cml-ot7set6d9h --labels metadata-test --idle-timeout 300 --driver github --repo https://github.com/iterative/cml-playground --token xxx --tf-resource eyJtb2RlIjoibWFuYWdlZCIsInR5cGUiOiJpdGVyYXRpdmVfY21sX3J1bm5lciIsIm5hbWUiOiJydW5uZXIiLCJwcm92aWRlciI6InByb3ZpZGVyW1wicmVnaXN0cnkudGVycmFmb3JtLmlvL2l0ZXJhdGl2ZS9pdGVyYXRpdmVcIl0iLCJpbnN0YW5jZXMiOlt7InByaXZhdGUiOiIiLCJzY2hlbWFfdmVyc2lvbiI6MCwiYXR0cmlidXRlcyI6eyJuYW1lIjoiY21sLW90N3NldDZkOWgiLCJsYWJlbHMiOiIiLCJpZGxlX3RpbWVvdXQiOjMwMCwicmVwbyI6IiIsInRva2VuIjoiIiwiZHJpdmVyIjoiIiwiY2xvdWQiOiJhd3MiLCJjdXN0b21fZGF0YSI6IiIsImlkIjoiaXRlcmF0aXZlLTM0cWllc2tyZmNkNzYiLCJpbWFnZSI6IiIsImluc3RhbmNlX2dwdSI6IiIsImluc3RhbmNlX2hkZF9zaXplIjozNSwiaW5zdGFuY2VfaXAiOiIiLCJpbnN0YW5jZV9sYXVuY2hfdGltZSI6IiIsImluc3RhbmNlX3R5cGUiOiIiLCJyZWdpb24iOiJ1cy13ZXN0LTEiLCJzc2hfbmFtZSI6IiIsInNzaF9wcml2YXRlIjoiIiwic3NoX3B1YmxpYyI6IiIsImF3c19zZWN1cml0eV9ncm91cCI6IiJ9fV19
           ├─3142 /bin/sh -c /tmp/tmp.3CTEB6Smj4/.cml/cml-ot7set6d9h/run.sh
           ├─3143 /bin/bash /tmp/tmp.3CTEB6Smj4/.cml/cml-ot7set6d9h/run.sh
           ├─3148 /bin/bash /tmp/tmp.3CTEB6Smj4/.cml/cml-ot7set6d9h/run-helper.sh
           └─3153 /tmp/tmp.3CTEB6Smj4/.cml/cml-ot7set6d9h/bin/Runner.Listener run

Sep 12 14:52:27 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Preparing workdir /tmp/tmp.3CTEB6Smj4/.cml/cml-ot7set6d9h..."}
Sep 12 14:52:27 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Launching github runner"}
Sep 12 14:52:31 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Terraform 1.2.7"}
Sep 12 14:52:32 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Plan: 0 to add, 0 to change, 0 to destroy."}
Sep 12 14:52:32 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Apply complete! Resources: 0 added, 0 changed, 0 destroyed."}
Sep 12 14:52:32 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Outputs: 0"}
Sep 12 14:52:32 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Connected to acpid service."}
Sep 12 14:52:49 ip-172-31-19-253 cml.sh[2002]: {"date":"2022-09-12T14:52:49.830Z","level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"ready"}
Sep 12 14:53:14 ip-172-31-19-253 cml.sh[2002]: {"date":"2022-09-12T14:53:14.346Z","level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"job_ended","success":true}
Sep 12 14:53:22 ip-172-31-19-253 cml.sh[2002]: {"date":"2022-09-12T14:53:06.871Z","job":8308590505,"level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"job_started"}
ubuntu@ip-172-31-19-253:~$
root@ip-172-31-19-253:/tmp/tmp.3CTEB6Smj4/.cml/cml-ot7set6d9h# cat terraform.tfstate 
{
    "version": 4,
    "terraform_version": "1.2.7",
    "serial": 1,
    "lineage": "ae59c415-b354-e17e-49fe-e75b853c30f1",
    "outputs": {},
    "resources": [
        {
            "mode": "managed",
            "type": "iterative_cml_runner",
            "name": "runner",
            "provider": "provider[\"registry.terraform.io/iterative/iterative\"]",
            "instances": [
                {
                    "private": "",
                    "schema_version": 0,
                    "attributes": {
                        "name": "cml-ot7set6d9h",
                        "labels": "",
                        "idle_timeout": 300,
                        "repo": "",
                        "token": "",
                        "driver": "",
                        "cloud": "aws",
                        "custom_data": "",
                        "id": "iterative-34qieskrfcd76",
                        "image": "",
                        "instance_gpu": "",
                        "instance_hdd_size": 35,
                        "instance_ip": "",
                        "instance_launch_time": "",
                        "instance_type": "",
                        "region": "us-west-1",
                        "ssh_name": "",
                        "ssh_private": "",
                        "ssh_public": "",
                        "aws_security_group": ""
                    }
                }
            ]
        }
    ]
}root@ip-172-31-19-253:/tmp/tmp.3CTEB6Smj4/.cml/cml-ot7set6d9h# 
ubuntu@ip-172-31-19-253:~$ sudo systemctl stop cml.service & journalctl --no-pager -n all -f -u cml.service
[1] 24710
-- Logs begin at Thu 2022-08-25 14:12:38 UTC. --
Sep 12 14:52:25 ip-172-31-19-253 systemd[1]: Started cml.service.
Sep 12 14:52:25 ip-172-31-19-253 cml.sh[2002]:   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
Sep 12 14:52:25 ip-172-31-19-253 cml.sh[2002]:                                  Dload  Upload   Total   Spent    Left  Speed
Sep 12 14:52:25 ip-172-31-19-253 cml.sh[2002]: [158B blob data]
Sep 12 14:52:27 ip-172-31-19-253 cml.sh[2002]: {"level":"warn","message":"Github Actions timeout has been updated from 72h to 35 days. Update your workflow accordingly to be able to restart it automatically."}
Sep 12 14:52:27 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Preparing workdir /tmp/tmp.3CTEB6Smj4/.cml/cml-ot7set6d9h..."}
Sep 12 14:52:27 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Launching github runner"}
Sep 12 14:52:31 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Terraform 1.2.7"}
Sep 12 14:52:32 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Plan: 0 to add, 0 to change, 0 to destroy."}
Sep 12 14:52:32 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Apply complete! Resources: 0 added, 0 changed, 0 destroyed."}
Sep 12 14:52:32 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Outputs: 0"}
Sep 12 14:52:32 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Connected to acpid service."}
Sep 12 14:52:49 ip-172-31-19-253 cml.sh[2002]: {"date":"2022-09-12T14:52:49.830Z","level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"ready"}
Sep 12 14:53:14 ip-172-31-19-253 cml.sh[2002]: {"date":"2022-09-12T14:53:14.346Z","level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"job_ended","success":true}
Sep 12 14:53:22 ip-172-31-19-253 cml.sh[2002]: {"date":"2022-09-12T14:53:06.871Z","job":8308590505,"level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"job_started"}
Sep 13 16:04:23 ip-172-31-19-253 systemd[1]: Stopping cml.service...
Sep 13 16:04:23 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"runner status","reason":"SIGTERM","status":"terminated"}
Sep 13 16:04:23 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Unregistering runner cml-ot7set6d9h..."}
Sep 13 16:04:24 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"\tSuccess"}
Sep 13 16:04:24 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Still pending jobs, retrying workflow..."}
Sep 13 16:04:25 ip-172-31-19-253 cml.sh[2002]: {"level":"info","message":"Waiting 10 seconds to destroy"}
Sep 13 16:04:36 ip-172-31-19-253 cml.sh[2002]: {"level":"error","message":"\tFailed destroying terraform: terraform -chdir='/tmp/tmp.3CTEB6Smj4/.cml/cml-ot7set6d9h' destroy -auto-approve \n\titerative_cml_runner.runner: Refreshing state... [id=iterative-34qieskrfcd76]\n\nTerraform used the selected providers to generate the following execution\nplan. Resource actions are indicated with the following symbols:\n  - destroy\n\nTerraform will perform the following actions:\n\n  # iterative_cml_runner.runner will be destroyed\n  - resource \"iterative_cml_runner\" \"runner\" {\n      - cloud             = \"aws\" -> null\n      - id                = \"iterative-34qieskrfcd76\" -> null\n      - idle_timeout      = 300 -> null\n      - instance_hdd_size = 35 -> null\n      - name              = \"cml-ot7set6d9h\" -> null\n      - region            = \"us-west-1\" -> null\n    }\n\nPlan: 0 to add, 0 to change, 1 to destroy.\niterative_cml_runner.runner: Destroying... [id=iterative-34qieskrfcd76]\n\n\t2022-09-13T16:04:36.311Z [INFO]  provider: configuring client automatic mTLS\n2022-09-13T16:04:36.337Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 args=[.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7]\n2022-09-13T16:04:36.338Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24726\n2022-09-13T16:04:36.339Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7\n2022-09-13T16:04:36.369Z [INFO]  provider.terraform-provider-iterative_v0.11.7: configuring server automatic mTLS: timestamp=2022-09-13T16:04:36.369Z\n2022-09-13T16:04:36.380Z [DEBUG] provider.terraform-provider-iterative_v0.11.7: plugin address: address=/tmp/plugin2299077105 network=unix timestamp=2022-09-13T16:04:36.380Z\n2022-09-13T16:04:36.380Z [DEBUG] provider: using plugin: version=5\n2022-09-13T16:04:36.418Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err=\"rpc error: code = Unavailable desc = transport is closing\"\n2022-09-13T16:04:36.422Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24726\n2022-09-13T16:04:36.422Z [DEBUG] provider: plugin exited\n2022-09-13T16:04:36.428Z [INFO]  provider: configuring client automatic mTLS\n2022-09-13T16:04:36.450Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 args=[.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7]\n2022-09-13T16:04:36.450Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24736\n2022-09-13T16:04:36.450Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7\n2022-09-13T16:04:36.480Z [INFO]  provider.terraform-provider-iterative_v0.11.7: configuring server automatic mTLS: timestamp=2022-09-13T16:04:36.480Z\n2022-09-13T16:04:36.491Z [DEBUG] provider: using plugin: version=5\n2022-09-13T16:04:36.491Z [DEBUG] provider.terraform-provider-iterative_v0.11.7: plugin address: address=/tmp/plugin1626018347 network=unix timestamp=2022-09-13T16:04:36.490Z\n2022-09-13T16:04:36.522Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err=\"rpc error: code = Unavailable desc = transport is closing\"\n2022-09-13T16:04:36.524Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24736\n2022-09-13T16:04:36.524Z [DEBUG] provider: plugin exited\n2022-09-13T16:04:36.525Z [INFO]  provider: configuring client automatic mTLS\n2022-09-13T16:04:36.547Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 args=[.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7]\n2022-09-13T16:04:36.547Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24743\n2022-09-13T16:04:36.547Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7\n2022-09-13T16:04:36.580Z [INFO]  provider.terraform-provider-iterative_v0.11.7: configuring server automatic mTLS: timestamp=2022-09-13T16:04:36.579Z\n2022-09-13T16:04:36.592Z [DEBUG] provider.terraform-provider-iterative_v0.11.7: plugin address: address=/tmp/plugin241104350 network=unix timestamp=2022-09-13T16:04:36.592Z\n2022-09-13T16:04:36.593Z [DEBUG] provider: using plugin: version=5\n2022-09-13T16:04:36.617Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err=\"rpc error: code = Unavailable desc = transport is closing\"\n2022-09-13T16:04:36.618Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24743\n2022-09-13T16:04:36.618Z [DEBUG] provider: plugin exited\n2022-09-13T16:04:36.621Z [INFO]  provider: configuring client automatic mTLS\n2022-09-13T16:04:36.641Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 args=[.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7]\n2022-09-13T16:04:36.641Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24750\n2022-09-13T16:04:36.642Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7\n2022-09-13T16:04:36.676Z [INFO]  provider.terraform-provider-iterative_v0.11.7: configuring server automatic mTLS: timestamp=2022-09-13T16:04:36.676Z\n2022-09-13T16:04:36.688Z [DEBUG] provider.terraform-provider-iterative_v0.11.7: plugin address: address=/tmp/plugin1588074819 network=unix timestamp=2022-09-13T16:04:36.688Z\n2022-09-13T16:04:36.688Z [DEBUG] provider: using plugin: version=5\n╷\n│ Error: Failed disposing the machine: operation error EC2: DescribeInstances, https response error StatusCode: 400, RequestID: fe4a35ee-b63f-4f50-bbc8-129934ff1c24, api error RequestExpired: Request has expired.\n│ \n│ \n╵\n2022-09-13T16:04:36.760Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err=\"rpc error: code = Unavailable desc = transport is closing\"\n2022-09-13T16:04:36.762Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24750\n2022-09-13T16:04:36.762Z [DEBUG] provider: plugin exited\n"}
Sep 13 16:04:36 ip-172-31-19-253 systemd[1]: Stopped cml.service.

{"level":"error","message":"    Failed destroying terraform: terraform -chdir='/tmp/tmp.3CTEB6Smj4/.cml/cml-ot7set6d9h' destroy -auto-approve 
    iterative_cml_runner.runner: Refreshing state... [id=iterative-34qieskrfcd76]

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
  - destroy

Terraform will perform the following actions:

  # iterative_cml_runner.runner will be destroyed
  - resource "iterative_cml_runner" "runner" {
      - cloud             = "aws" -> null
      - id                = "iterative-34qieskrfcd76" -> null
      - idle_timeout      = 300 -> null
      - instance_hdd_size = 35 -> null
      - name              = "cml-ot7set6d9h" -> null
      - region            = "us-west-1" -> null
    }

Plan: 0 to add, 0 to change, 1 to destroy.
iterative_cml_runner.runner: Destroying... [id=iterative-34qieskrfcd76]

    2022-09-13T16:04:36.311Z [INFO]  provider: configuring client automatic mTLS
2022-09-13T16:04:36.337Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 args=[.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7]
2022-09-13T16:04:36.338Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24726
2022-09-13T16:04:36.339Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7
2022-09-13T16:04:36.369Z [INFO]  provider.terraform-provider-iterative_v0.11.7: configuring server automatic mTLS: timestamp=2022-09-13T16:04:36.369Z
2022-09-13T16:04:36.380Z [DEBUG] provider.terraform-provider-iterative_v0.11.7: plugin address: address=/tmp/plugin2299077105 network=unix timestamp=2022-09-13T16:04:36.380Z
2022-09-13T16:04:36.380Z [DEBUG] provider: using plugin: version=5
2022-09-13T16:04:36.418Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-09-13T16:04:36.422Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24726
2022-09-13T16:04:36.422Z [DEBUG] provider: plugin exited
2022-09-13T16:04:36.428Z [INFO]  provider: configuring client automatic mTLS
2022-09-13T16:04:36.450Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 args=[.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7]
2022-09-13T16:04:36.450Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24736
2022-09-13T16:04:36.450Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7
2022-09-13T16:04:36.480Z [INFO]  provider.terraform-provider-iterative_v0.11.7: configuring server automatic mTLS: timestamp=2022-09-13T16:04:36.480Z
2022-09-13T16:04:36.491Z [DEBUG] provider: using plugin: version=5
2022-09-13T16:04:36.491Z [DEBUG] provider.terraform-provider-iterative_v0.11.7: plugin address: address=/tmp/plugin1626018347 network=unix timestamp=2022-09-13T16:04:36.490Z
2022-09-13T16:04:36.522Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-09-13T16:04:36.524Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24736
2022-09-13T16:04:36.524Z [DEBUG] provider: plugin exited
2022-09-13T16:04:36.525Z [INFO]  provider: configuring client automatic mTLS
2022-09-13T16:04:36.547Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 args=[.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7]
2022-09-13T16:04:36.547Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24743
2022-09-13T16:04:36.547Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7
2022-09-13T16:04:36.580Z [INFO]  provider.terraform-provider-iterative_v0.11.7: configuring server automatic mTLS: timestamp=2022-09-13T16:04:36.579Z
2022-09-13T16:04:36.592Z [DEBUG] provider.terraform-provider-iterative_v0.11.7: plugin address: address=/tmp/plugin241104350 network=unix timestamp=2022-09-13T16:04:36.592Z
2022-09-13T16:04:36.593Z [DEBUG] provider: using plugin: version=5
2022-09-13T16:04:36.617Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-09-13T16:04:36.618Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24743
2022-09-13T16:04:36.618Z [DEBUG] provider: plugin exited
2022-09-13T16:04:36.621Z [INFO]  provider: configuring client automatic mTLS
2022-09-13T16:04:36.641Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 args=[.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7]
2022-09-13T16:04:36.641Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24750
2022-09-13T16:04:36.642Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7
2022-09-13T16:04:36.676Z [INFO]  provider.terraform-provider-iterative_v0.11.7: configuring server automatic mTLS: timestamp=2022-09-13T16:04:36.676Z
2022-09-13T16:04:36.688Z [DEBUG] provider.terraform-provider-iterative_v0.11.7: plugin address: address=/tmp/plugin1588074819 network=unix timestamp=2022-09-13T16:04:36.688Z
2022-09-13T16:04:36.688Z [DEBUG] provider: using plugin: version=5
╷
│ Error: Failed disposing the machine: operation error EC2: DescribeInstances, https response error StatusCode: 400, RequestID: fe4a35ee-b63f-4f50-bbc8-129934ff1c24, api error RequestExpired: Request has expired.
│ 
│ 
╵
2022-09-13T16:04:36.760Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"
2022-09-13T16:04:36.762Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=24750
2022-09-13T16:04:36.762Z [DEBUG] provider: plugin exited
"}
dacbd commented 2 years ago

Instance i-037e0df9ef9d22890 run: https://github.com/iterative/cml-playground/actions/runs/3038261966/attempts/1

ubuntu@ip-172-31-16-16:~$ journalctl --no-pager -n all -u cml.service 
-- Logs begin at Thu 2022-08-25 14:12:38 UTC, end at Tue 2022-09-13 20:25:32 UTC. --
Sep 12 14:50:07 ip-172-31-16-16 systemd[1]: Started cml.service.
Sep 12 14:50:07 ip-172-31-16-16 cml.sh[1953]:   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
Sep 12 14:50:07 ip-172-31-16-16 cml.sh[1953]:                                  Dload  Upload   Total   Spent    Left  Speed
Sep 12 14:50:07 ip-172-31-16-16 cml.sh[1953]: [158B blob data]
Sep 12 14:50:10 ip-172-31-16-16 cml.sh[1953]: {"level":"warn","message":"Github Actions timeout has been updated from 72h to 35 days. Update your workflow accordingly to be able to restart it automatically."}
Sep 12 14:50:10 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Preparing workdir /tmp/tmp.m5VUGo521J/.cml/cml-tv1d93emjk..."}
Sep 12 14:50:10 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Launching github runner"}
Sep 12 14:50:15 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Terraform 1.2.7"}
Sep 12 14:50:16 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Plan: 0 to add, 0 to change, 0 to destroy."}
Sep 12 14:50:16 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Apply complete! Resources: 0 added, 0 changed, 0 destroyed."}
Sep 12 14:50:16 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Outputs: 0"}
Sep 12 14:50:16 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Connected to acpid service."}
Sep 12 14:50:32 ip-172-31-16-16 cml.sh[1953]: {"date":"2022-09-12T14:50:32.768Z","level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"ready"}
Sep 12 14:50:59 ip-172-31-16-16 cml.sh[1953]: {"date":"2022-09-12T14:50:59.493Z","level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"job_ended","success":true}
Sep 12 14:51:00 ip-172-31-16-16 cml.sh[1953]: {"date":"2022-09-12T14:50:50.950Z","job":8308542256,"level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"job_started"}
ubuntu@ip-172-31-16-16:~$ 
ubuntu@ip-172-31-16-16:~$ sudo systemctl status -l --no-pager cml.service 
● cml.service
   Loaded: loaded (/etc/systemd/system/cml.service; enabled; vendor preset: enabled)
   Active: active (running) since Mon 2022-09-12 14:50:07 UTC; 1 day 5h ago
 Main PID: 1953 (cml-internal)
    Tasks: 25 (limit: 2300)
   CGroup: /system.slice/cml.service
           ├─1953 /usr/bin/cml-internal runner --name cml-tv1d93emjk --labels private-key_852-test --idle-timeout 300 --driver github --repo https://github.com/iterative/cml-playground --token xxx --tf-resource eyJtb2RlIjoibWFuYWdlZCIsInR5cGUiOiJpdGVyYXRpdmVfY21sX3J1bm5lciIsIm5hbWUiOiJydW5uZXIiLCJwcm92aWRlciI6InByb3ZpZGVyW1wicmVnaXN0cnkudGVycmFmb3JtLmlvL2l0ZXJhdGl2ZS9pdGVyYXRpdmVcIl0iLCJpbnN0YW5jZXMiOlt7InByaXZhdGUiOiIiLCJzY2hlbWFfdmVyc2lvbiI6MCwiYXR0cmlidXRlcyI6eyJuYW1lIjoiY21sLXR2MWQ5M2VtamsiLCJsYWJlbHMiOiIiLCJpZGxlX3RpbWVvdXQiOjMwMCwicmVwbyI6IiIsInRva2VuIjoiIiwiZHJpdmVyIjoiIiwiY2xvdWQiOiJhd3MiLCJjdXN0b21fZGF0YSI6IiIsImlkIjoiaXRlcmF0aXZlLTJwbjUxbTk1YWlnNm0iLCJpbWFnZSI6IiIsImluc3RhbmNlX2dwdSI6IiIsImluc3RhbmNlX2hkZF9zaXplIjozNSwiaW5zdGFuY2VfaXAiOiIiLCJpbnN0YW5jZV9sYXVuY2hfdGltZSI6IiIsImluc3RhbmNlX3R5cGUiOiIiLCJyZWdpb24iOiJ1cy13ZXN0Iiwic3NoX25hbWUiOiIiLCJzc2hfcHJpdmF0ZSI6IiIsInNzaF9wdWJsaWMiOiIiLCJhd3Nfc2VjdXJpdHlfZ3JvdXAiOiIifX1dfQ==
           ├─3135 /bin/sh -c /tmp/tmp.m5VUGo521J/.cml/cml-tv1d93emjk/run.sh
           ├─3144 /bin/bash /tmp/tmp.m5VUGo521J/.cml/cml-tv1d93emjk/run.sh
           ├─3153 /bin/bash /tmp/tmp.m5VUGo521J/.cml/cml-tv1d93emjk/run-helper.sh
           └─3161 /tmp/tmp.m5VUGo521J/.cml/cml-tv1d93emjk/bin/Runner.Listener run

Sep 12 14:50:10 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Preparing workdir /tmp/tmp.m5VUGo521J/.cml/cml-tv1d93emjk..."}
Sep 12 14:50:10 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Launching github runner"}
Sep 12 14:50:15 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Terraform 1.2.7"}
Sep 12 14:50:16 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Plan: 0 to add, 0 to change, 0 to destroy."}
Sep 12 14:50:16 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Apply complete! Resources: 0 added, 0 changed, 0 destroyed."}
Sep 12 14:50:16 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Outputs: 0"}
Sep 12 14:50:16 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Connected to acpid service."}
Sep 12 14:50:32 ip-172-31-16-16 cml.sh[1953]: {"date":"2022-09-12T14:50:32.768Z","level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"ready"}
Sep 12 14:50:59 ip-172-31-16-16 cml.sh[1953]: {"date":"2022-09-12T14:50:59.493Z","level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"job_ended","success":true}
Sep 12 14:51:00 ip-172-31-16-16 cml.sh[1953]: {"date":"2022-09-12T14:50:50.950Z","job":8308542256,"level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"job_started"}
ubuntu@ip-172-31-16-16:~$ 
root@ip-172-31-16-16:/tmp/tmp.m5VUGo521J/.cml/cml-tv1d93emjk# cat terraform.tfstate 
{
    "version": 4,
    "terraform_version": "1.2.7",
    "serial": 1,
    "lineage": "75bee3e1-5ff2-9191-d64f-0620e78d0880",
    "outputs": {},
    "resources": [
        {
            "mode": "managed",
            "type": "iterative_cml_runner",
            "name": "runner",
            "provider": "provider[\"registry.terraform.io/iterative/iterative\"]",
            "instances": [
                {
                    "private": "",
                    "schema_version": 0,
                    "attributes": {
                        "name": "cml-tv1d93emjk",
                        "labels": "",
                        "idle_timeout": 300,
                        "repo": "",
                        "token": "",
                        "driver": "",
                        "cloud": "aws",
                        "custom_data": "",
                        "id": "iterative-2pn51m95aig6m",
                        "image": "",
                        "instance_gpu": "",
                        "instance_hdd_size": 35,
                        "instance_ip": "",
                        "instance_launch_time": "",
                        "instance_type": "",
                        "region": "us-west",
                        "ssh_name": "",
                        "ssh_private": "",
                        "ssh_public": "",
                        "aws_security_group": ""
                    }
                }
            ]
        }
    ]
}root@ip-172-31-16-16:/tmp/tmp.m5VUGo521J/.cml/cml-tv1d93emjk# 

ubuntu@ip-172-31-16-16:~$ sudo systemctl stop cml.service & journalctl --no-pager -n all -f -u cml.service
[1] 25485
-- Logs begin at Thu 2022-08-25 14:12:38 UTC. --
Sep 12 14:50:07 ip-172-31-16-16 systemd[1]: Started cml.service.
Sep 12 14:50:07 ip-172-31-16-16 cml.sh[1953]:   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
Sep 12 14:50:07 ip-172-31-16-16 cml.sh[1953]:                                  Dload  Upload   Total   Spent    Left  Speed
Sep 12 14:50:07 ip-172-31-16-16 cml.sh[1953]: [158B blob data]
Sep 12 14:50:10 ip-172-31-16-16 cml.sh[1953]: {"level":"warn","message":"Github Actions timeout has been updated from 72h to 35 days. Update your workflow accordingly to be able to restart it automatically."}
Sep 12 14:50:10 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Preparing workdir /tmp/tmp.m5VUGo521J/.cml/cml-tv1d93emjk..."}
Sep 12 14:50:10 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Launching github runner"}
Sep 12 14:50:15 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Terraform 1.2.7"}
Sep 12 14:50:16 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Plan: 0 to add, 0 to change, 0 to destroy."}
Sep 12 14:50:16 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Apply complete! Resources: 0 added, 0 changed, 0 destroyed."}
Sep 12 14:50:16 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Outputs: 0"}
Sep 12 14:50:16 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Connected to acpid service."}
Sep 12 14:50:32 ip-172-31-16-16 cml.sh[1953]: {"date":"2022-09-12T14:50:32.768Z","level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"ready"}
Sep 12 14:50:59 ip-172-31-16-16 cml.sh[1953]: {"date":"2022-09-12T14:50:59.493Z","level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"job_ended","success":true}
Sep 12 14:51:00 ip-172-31-16-16 cml.sh[1953]: {"date":"2022-09-12T14:50:50.950Z","job":8308542256,"level":"info","message":"runner status","repo":"https://github.com/iterative/cml-playground","status":"job_started"}
Sep 13 20:28:13 ip-172-31-16-16 systemd[1]: Stopping cml.service...
Sep 13 20:28:13 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"runner status","reason":"SIGTERM","status":"terminated"}
Sep 13 20:28:13 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Unregistering runner cml-tv1d93emjk..."}
Sep 13 20:28:14 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"\tSuccess"}
Sep 13 20:28:14 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Still pending jobs, retrying workflow..."}
Sep 13 20:28:15 ip-172-31-16-16 cml.sh[1953]: {"level":"info","message":"Waiting 10 seconds to destroy"}
Sep 13 20:28:27 ip-172-31-16-16 cml.sh[1953]: {"level":"error","message":"\tFailed destroying terraform: terraform -chdir='/tmp/tmp.m5VUGo521J/.cml/cml-tv1d93emjk' destroy -auto-approve \n\titerative_cml_runner.runner: Refreshing state... [id=iterative-2pn51m95aig6m]\n\nTerraform used the selected providers to generate the following execution\nplan. Resource actions are indicated with the following symbols:\n  - destroy\n\nTerraform will perform the following actions:\n\n  # iterative_cml_runner.runner will be destroyed\n  - resource \"iterative_cml_runner\" \"runner\" {\n      - cloud             = \"aws\" -> null\n      - id                = \"iterative-2pn51m95aig6m\" -> null\n      - idle_timeout      = 300 -> null\n      - instance_hdd_size = 35 -> null\n      - name              = \"cml-tv1d93emjk\" -> null\n      - region            = \"us-west\" -> null\n    }\n\nPlan: 0 to add, 0 to change, 1 to destroy.\niterative_cml_runner.runner: Destroying... [id=iterative-2pn51m95aig6m]\n\n\t2022-09-13T20:28:26.490Z [INFO]  provider: configuring client automatic mTLS\n2022-09-13T20:28:26.519Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 args=[.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7]\n2022-09-13T20:28:26.519Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=25499\n2022-09-13T20:28:26.520Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7\n2022-09-13T20:28:26.565Z [INFO]  provider.terraform-provider-iterative_v0.11.7: configuring server automatic mTLS: timestamp=2022-09-13T20:28:26.564Z\n2022-09-13T20:28:26.576Z [DEBUG] provider.terraform-provider-iterative_v0.11.7: plugin address: address=/tmp/plugin4148981782 network=unix timestamp=2022-09-13T20:28:26.576Z\n2022-09-13T20:28:26.576Z [DEBUG] provider: using plugin: version=5\n2022-09-13T20:28:26.604Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err=\"rpc error: code = Unavailable desc = transport is closing\"\n2022-09-13T20:28:26.607Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=25499\n2022-09-13T20:28:26.607Z [DEBUG] provider: plugin exited\n2022-09-13T20:28:26.611Z [INFO]  provider: configuring client automatic mTLS\n2022-09-13T20:28:26.634Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 args=[.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7]\n2022-09-13T20:28:26.634Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=25506\n2022-09-13T20:28:26.634Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7\n2022-09-13T20:28:26.667Z [INFO]  provider.terraform-provider-iterative_v0.11.7: configuring server automatic mTLS: timestamp=2022-09-13T20:28:26.667Z\n2022-09-13T20:28:26.679Z [DEBUG] provider.terraform-provider-iterative_v0.11.7: plugin address: address=/tmp/plugin1178106905 network=unix timestamp=2022-09-13T20:28:26.679Z\n2022-09-13T20:28:26.679Z [DEBUG] provider: using plugin: version=5\n2022-09-13T20:28:26.717Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err=\"rpc error: code = Unavailable desc = transport is closing\"\n2022-09-13T20:28:26.719Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=25506\n2022-09-13T20:28:26.719Z [DEBUG] provider: plugin exited\n2022-09-13T20:28:26.720Z [INFO]  provider: configuring client automatic mTLS\n2022-09-13T20:28:26.741Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 args=[.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7]\n2022-09-13T20:28:26.742Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=25514\n2022-09-13T20:28:26.742Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7\n2022-09-13T20:28:26.772Z [INFO]  provider.terraform-provider-iterative_v0.11.7: configuring server automatic mTLS: timestamp=2022-09-13T20:28:26.772Z\n2022-09-13T20:28:26.784Z [DEBUG] provider.terraform-provider-iterative_v0.11.7: plugin address: address=/tmp/plugin870031031 network=unix timestamp=2022-09-13T20:28:26.784Z\n2022-09-13T20:28:26.784Z [DEBUG] provider: using plugin: version=5\n2022-09-13T20:28:26.817Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err=\"rpc error: code = Unavailable desc = transport is closing\"\n2022-09-13T20:28:26.819Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=25514\n2022-09-13T20:28:26.819Z [DEBUG] provider: plugin exited\n2022-09-13T20:28:26.823Z [INFO]  provider: configuring client automatic mTLS\n2022-09-13T20:28:26.844Z [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 args=[.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7]\n2022-09-13T20:28:26.844Z [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=25520\n2022-09-13T20:28:26.844Z [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7\n2022-09-13T20:28:26.877Z [INFO]  provider.terraform-provider-iterative_v0.11.7: configuring server automatic mTLS: timestamp=2022-09-13T20:28:26.877Z\n2022-09-13T20:28:26.888Z [DEBUG] provider: using plugin: version=5\n2022-09-13T20:28:26.888Z [DEBUG] provider.terraform-provider-iterative_v0.11.7: plugin address: address=/tmp/plugin1927587162 network=unix timestamp=2022-09-13T20:28:26.888Z\n╷\n│ Error: Failed disposing the machine: operation error EC2: DescribeInstances, https response error StatusCode: 400, RequestID: 69bd205b-795c-42b4-a32f-9ab34042b9d1, api error RequestExpired: Request has expired.\n│ \n│ \n╵\n2022-09-13T20:28:27.181Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err=\"rpc error: code = Unavailable desc = transport is closing\"\n2022-09-13T20:28:27.183Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/iterative/iterative/0.11.7/linux_amd64/terraform-provider-iterative_v0.11.7 pid=25520\n2022-09-13T20:28:27.183Z [DEBUG] provider: plugin exited\n"}
Sep 13 20:28:27 ip-172-31-16-16 systemd[1]: Stopped cml.service.
0x2b3bfa0 commented 2 years ago

Duplicate of #89?