ERROR: failed to start plugin 'aws': error reading from server: EOF (SQLSTATE HV000)

chr-b commented 2 years ago

Describe the bug I am running a custom benchmark against AWS accounts. At some point in time, Steampipe will just hang in the middle of a benchmark. The tracing logs show the following error message: query failed with plugin connectivity error ERROR: failed to start plugin 'aws': error reading from server: EOF (SQLSTATE HV000) - retrying... This is then followed by ERROR: failed to start plugin 'aws': connection error: desc = "transport: error while dialing: dial unix /tmp/plugin157052978: connect: connection refused" (SQLSTATE HV000) - retrying...

Steampipe version (steampipe -v) v0.14.6

Plugin version (steampipe plugin list) latest -> 0.61.0

To reproduce This is the difficult part: the error is not deterministic. Out of seven execution runs, this problems will appear usually once, for a random AWS account.

Steampipe is being executed in a loop over multiple accounts inside a container environment. The structure is basically like this:

steampipe plugin install aws
for accountid in $ACCOUNTLIST
 # generate steampipe config file of the following structure
 # connection "aws" {
 #    plugin  = "aws"
 #    profile = "$accountid"
 #    regions = ["*"]
 #  }
  steampipe \
    check benchmark.mybenchmark \
    --theme plain \
    --progress=false \
    --output json \
    > /output/$accountid.json || true
done

This is using AWS assume role with a particular role_arn for each AWS account.

Expected behavior Steampipe does not hang.

Additional context

The relevant parts of the tracing log for the AWS plugin installation and the benchmark execution where this problem occurs.

2022-05-31 18:45:53.159 UTC [TRACE] steampipe: ociDownloader.Download: downloading us-docker.pkg.dev/steampipe/plugins/turbot/aws:latest
2022-05-31 18:45:53.159 UTC [TRACE] steampipe: ociDownloader.Pull: pulling us-docker.pkg.dev/steampipe/plugins/turbot/aws:latest
2022-05-31 18:45:53.717 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.plugin.linux-amd64.layer.v1+gzip
2022-05-31 18:45:53.717 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.plugin.docs.layer.v1+tar
2022-05-31 18:45:53.717 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.plugin.spc.layer.v1+tar
2022-05-31 18:45:53.717 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.plugin.license.layer.v1+text

2022-05-31 18:45:54.678 UTC [TRACE] steampipe: GetRunStatus - loadRunningInstanceInfo returned nil
2022-05-31 18:45:54.678 UTC [TRACE] steampipe: calling removeRunningInstanceInfo
2022-05-31 18:45:54.679 UTC [TRACE] steampipe: ociDownloader.Download: downloading us-docker.pkg.dev/steampipe/steampipe/db:14.2.0
2022-05-31 18:45:54.679 UTC [TRACE] steampipe: ociDownloader.Pull: pulling us-docker.pkg.dev/steampipe/steampipe/db:14.2.0
2022-05-31 18:45:57.736 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.db.linux-amd64.layer.v1+tar
2022-05-31 18:45:57.736 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.db.doc.layer.v1+text
2022-05-31 18:45:57.740 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.db.license.layer.v1+text
2022-05-31 18:45:57.837 UTC [TRACE] steampipe: GetRunStatus - loadRunningInstanceInfo returned nil
2022-05-31 18:45:57.838 UTC [TRACE] steampipe: ociDownloader.Download: downloading us-docker.pkg.dev/steampipe/steampipe/fdw:1.1.1
2022-05-31 18:45:57.838 UTC [TRACE] steampipe: ociDownloader.Pull: pulling us-docker.pkg.dev/steampipe/steampipe/fdw:1.1.1
2022-05-31 18:45:58.278 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.fdw.linux-amd64.layer.v1+gzip
2022-05-31 18:45:58.278 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.fdw.control.layer.v1+text
2022-05-31 18:45:58.278 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.fdw.sql.layer.v1+text
2022-05-31 18:45:58.278 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.fdw.doc.layer.v1+text
2022-05-31 18:45:58.278 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.fdw.license.layer.v1+text
2022-05-31 18:45:59.474 UTC [TRACE] steampipe: initdb start: /home/steampipe/.steampipe/db/14.2.0/postgres/bin/initdb --auth=trust --username=root --pgdata=/home/steampipe/.steampipe/db/14.2.0/data --encoding=UTF-8 --wal-segsize=1 --debug
2022-05-31 18:46:07.229 UTC [TRACE] steampipe: Connection string:  host=localhost port=40787 user=root dbname=postgres sslmode=disable
2022-05-31 18:46:07.244 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:07.244 UTC [39] LOG:  starting PostgreSQL 14.2 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 4.8.4-2ubuntu1~14.04.4) 4.8.4, 64-bit
2022-05-31 18:46:07.245 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:07.245 UTC [39] LOG:  listening on IPv4 address "127.0.0.1", port 40787
2022-05-31 18:46:07.245 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:07.245 UTC [39] LOG:  could not bind IPv6 address "::1": Cannot assign requested address
2022-05-31 18:46:07.248 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:07.248 UTC [39] LOG:  listening on Unix socket "/tmp/.s.PGSQL.40787"
2022-05-31 18:46:07.250 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:07.250 UTC [39] LOG:  hostssl record cannot match because SSL is disabled
2022-05-31 18:46:07.251 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:07.250 UTC [39] HINT:  Set ssl = on in postgresql.conf.
2022-05-31 18:46:07.251 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:07.250 UTC [39] CONTEXT:  line 2 of configuration file "/home/steampipe/.steampipe/db/14.2.0/data/pg_hba.conf"
2022-05-31 18:46:07.271 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:07.271 UTC [40] LOG:  database system was shut down at 2022-05-31 18:46:05 UTC
2022-05-31 18:46:07.275 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:07.275 UTC [39] LOG:  database system is ready to accept connections
2022-05-31 18:46:07.287 UTC [TRACE] steampipe: valid database name: steampipe
2022-05-31 18:46:07.287 UTC [TRACE] steampipe: installing database with name steampipe
2022-05-31 18:46:07.846 UTC [TRACE] steampipe: Install Foreign Server:  drop extension if exists "steampipe_postgres_fdw" cascade
2022-05-31 18:46:07.846 UTC [TRACE] steampipe: Install Foreign Server:  create extension if not exists "steampipe_postgres_fdw"
2022-05-31 18:46:07.872 UTC [TRACE] steampipe: SERVICE: 2022/05/31 18:46:07 [INFO]
2022-05-31 18:46:07.872 UTC [TRACE] steampipe: SERVICE: ******************************************************
2022-05-31 18:46:07.872 UTC [TRACE] steampipe: SERVICE:         steampipe postgres fdw init
2022-05-31 18:46:07.872 UTC [TRACE] steampipe: SERVICE: ******************************************************
2022-05-31 18:46:07.872 UTC [TRACE] steampipe: SERVICE: 2022/05/31 18:46:07 [INFO] Log level trace
2022-05-31 18:46:07.878 UTC [TRACE] steampipe: Install Foreign Server:  create server "steampipe" foreign data wrapper "steampipe_postgres_fdw"
2022-05-31 18:46:07.879 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:07.879 UTC [39] LOG:  received smart shutdown request
2022-05-31 18:46:07.881 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:07.880 UTC [TRACE] hub: hub: close
2022-05-31 18:46:07.886 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:07.886 UTC [39] LOG:  background worker "logical replication launcher" (PID 46) exited with exit code 1
2022-05-31 18:46:07.927 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:07.927 UTC [41] LOG:  shutting down
2022-05-31 18:46:07.988 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:07.988 UTC [39] LOG:  database system is shut down
2022-05-31 18:46:08.030 UTC [TRACE] steampipe: GetRunStatus - loadRunningInstanceInfo returned nil
2022-05-31 18:46:08.030 UTC [TRACE] steampipe: StartDB invoker plugin
2022-05-31 18:46:08.030 UTC [TRACE] steampipe: StartDB started plugin manager
2022-05-31 18:46:08.030 UTC [TRACE] steampipe: loadRootPrivateKey - failed to load key from /home/steampipe/.steampipe/db/14.2.0/data/root.key: open /home/steampipe/.steampipe/db/14.2.0/data/root.key: no such file or directory
2022-05-31 18:46:10.335 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=postgres sslmode=disable
2022-05-31 18:46:10.379 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:10.379 UTC [54] LOG:  redirecting log output to logging collector process
2022-05-31 18:46:10.379 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:46:10.379 UTC [54] HINT:  Future log output will appear in directory "/home/steampipe/.steampipe/logs".
2022-05-31 18:46:10.428 UTC [TRACE] steampipe: status:  {"pid":54,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"plugin","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-05-31 18:46:10.428 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=postgres sslmode=require
2022-05-31 18:46:10.529 UTC [TRACE] steampipe: status:  {"pid":54,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"plugin","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-05-31 18:46:10.529 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-05-31 18:46:10.630 UTC [TRACE] steampipe: Install Foreign Server:  drop extension if exists "steampipe_postgres_fdw" cascade
2022-05-31 18:46:10.630 UTC [TRACE] steampipe: Install Foreign Server:  create extension if not exists "steampipe_postgres_fdw"
2022-05-31 18:46:10.645 UTC [TRACE] steampipe: Install Foreign Server:  create server "steampipe" foreign data wrapper "steampipe_postgres_fdw"
2022-05-31 18:46:10.685 UTC [TRACE] steampipe: plugin manager state file not found
2022-05-31 18:46:10.685 UTC [TRACE] steampipe: plugin manager state file not found
2022-05-31 18:46:10.743 UTC [TRACE] steampipe: start: started plugin manager, pid 70
2022-05-31 18:46:10.846 UTC [TRACE] steampipe: created local client 0xc0003cd940
2022-05-31 18:46:10.846 UTC [TRACE] steampipe: getSchemaHashesForDynamicSchemas
2022-05-31 18:46:10.846 UTC [TRACE] steampipe: CreateConnectionPlugin creating 0 connections
2022-05-31 18:46:10.846 UTC [TRACE] steampipe: plugin manager is running - returning client
2022-05-31 18:46:10.848 UTC [TRACE] steampipe: fetched schema for 0 dynamic plugins
2022-05-31 18:46:10.848 UTC [TRACE] steampipe: connection aws is out of date or missing
2022-05-31 18:46:10.848 UTC [TRACE] steampipe: CreateConnectionPlugin creating 1 connections
2022-05-31 18:46:10.849 UTC [TRACE] steampipe: plugin manager is running - returning client
2022-05-31 18:46:10.942 UTC [TRACE] steampipe: plugin manager returned reattach config for connection 'aws' - pid 78, reattach protocol:"grpc" addr:{Network:"unix" Address:"/tmp/plugin3105144512"} pid:78
2022-05-31 18:46:10.942 UTC [TRACE] steampipe: NewPluginClient for plugin hub.steampipe.io/plugins/turbot/aws@latest
2022-05-31 18:46:11.235 UTC [TRACE] steampipe: created connection plugin for connection: 'aws', pluginName: 'hub.steampipe.io/plugins/turbot/aws@latest'
2022-05-31 18:46:11.253 UTC [TRACE] steampipe: status:  {"pid":54,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"plugin","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-05-31 18:46:11.255 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-05-31 18:46:11.333 UTC [TRACE] steampipe: executeConnectionUpdateQueries: num updates 1
2022-05-31 18:46:11.333 UTC [TRACE] steampipe: executing update query 0 of 1 for connection 'aws'
2022-05-31 18:46:11.835 UTC [TRACE] steampipe: all update queries executed
2022-05-31 18:46:11.835 UTC [TRACE] steampipe: executing comment query 0 of 1 for plugin 'aws'
2022-05-31 18:46:12.173 UTC [TRACE] steampipe: executeUpdateQueries complete
2022-05-31 18:46:12.174 UTC [TRACE] steampipe: status:  {"pid":54,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"plugin","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-05-31 18:46:12.174 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-05-31 18:46:12.241 UTC [TRACE] steampipe: setting user search path to [public aws internal]
2022-05-31 18:46:12.245 UTC [TRACE] steampipe: user search path sql: alter user "steampipe" set search_path to "public","aws","internal";
2022-05-31 18:46:12.245 UTC [TRACE] steampipe: status:  {"pid":54,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"plugin","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-05-31 18:46:12.245 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-05-31 18:46:12.342 UTC [TRACE] steampipe: close local client 0xc0003cd940
2022-05-31 18:46:12.342 UTC [TRACE] steampipe: local client not NIL
2022-05-31 18:46:12.343 UTC [TRACE] steampipe: DbClient.Close &{0 0xc0009f74a0 0 {0 0} [0xc00019d440] map[] 0 1 0xc0006b8000 false map[0xc00019d440:map[0xc00019d440:true]] map[] 5 5 0 0 <nil> 0 0 0 0 0x4907a0}
2022-05-31 18:46:12.343 UTC [TRACE] steampipe: local client close complete
2022-05-31 18:46:12.343 UTC [TRACE] steampipe: shutdown local service plugin
2022-05-31 18:46:12.345 UTC [TRACE] steampipe: status:  {"pid":54,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"plugin","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-05-31 18:46:12.345 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-05-31 18:46:12.432 UTC [TRACE] steampipe: StopDB invoker plugin, force false
2022-05-31 18:46:12.436 UTC [TRACE] steampipe: plugin manager stop
2022-05-31 18:46:12.436 UTC [TRACE] steampipe: pluginManager.Shutdown
2022-05-31 18:46:12.436 UTC [TRACE] steampipe: PluginManagerClient Shutdown
2022-05-31 18:46:12.449 UTC [TRACE] steampipe: pluginManager state.kill

Installed plugin: [1maws@latest[0m v0.61.0
Documentation:    https://hub.steampipe.io/plugins/turbot/aws

[...]

2022-05-31 18:50:18.982 UTC [TRACE] steampipe: modfile exists in workspace folder - creating pseudo-resources and loading files recursively
2022-05-31 18:50:18.987 UTC [TRACE] steampipe: parse complete after 1 decode passes
2022-05-31 18:50:18.993 UTC [TRACE] steampipe: parse complete after 2 decode passes
2022-05-31 18:50:18.993 UTC [TRACE] steampipe: ensuring check export/output templates
2022-05-31 18:50:18.996 UTC [TRACE] steampipe: GetRunStatus - loadRunningInstanceInfo returned nil
2022-05-31 18:50:18.996 UTC [TRACE] steampipe: StartDB invoker check
2022-05-31 18:50:18.996 UTC [TRACE] steampipe: StartDB started plugin manager
2022-05-31 18:50:18.997 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=postgres sslmode=disable
2022-05-31 18:50:19.034 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:50:19.034 UTC [2722] LOG:  redirecting log output to logging collector process
2022-05-31 18:50:19.035 UTC [TRACE] steampipe: SERVICE: 2022-05-31 18:50:19.034 UTC [2722] HINT:  Future log output will appear in directory "/home/steampipe/.steampipe/logs".
2022-05-31 18:50:19.072 UTC [TRACE] steampipe: status:  {"pid":2722,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"check","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-05-31 18:50:19.072 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=postgres sslmode=require
2022-05-31 18:50:19.144 UTC [TRACE] steampipe: status:  {"pid":2722,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"check","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-05-31 18:50:19.144 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-05-31 18:50:19.220 UTC [TRACE] steampipe: plugin manager state file not found
2022-05-31 18:50:19.220 UTC [TRACE] steampipe: plugin manager state file not found
2022-05-31 18:50:19.286 UTC [TRACE] steampipe: start: started plugin manager, pid 2740
2022-05-31 18:50:19.361 UTC [TRACE] steampipe: created local client 0xc0001c7ac0
2022-05-31 18:50:19.361 UTC [TRACE] steampipe: getSchemaHashesForDynamicSchemas
2022-05-31 18:50:19.361 UTC [TRACE] steampipe: CreateConnectionPlugin creating 0 connections
2022-05-31 18:50:19.361 UTC [TRACE] steampipe: plugin manager is running - returning client
2022-05-31 18:50:19.365 UTC [TRACE] steampipe: fetched schema for 0 dynamic plugins
2022-05-31 18:50:19.365 UTC [TRACE] steampipe: connection aws is out of date or missing
2022-05-31 18:50:19.365 UTC [TRACE] steampipe: CreateConnectionPlugin creating 1 connections
2022-05-31 18:50:19.366 UTC [TRACE] steampipe: plugin manager is running - returning client
2022-05-31 18:50:19.420 UTC [TRACE] steampipe: plugin manager returned reattach config for connection 'aws' - pid 2748, reattach protocol:"grpc" addr:{Network:"unix" Address:"/tmp/plugin157052978"} pid:2748
2022-05-31 18:50:19.420 UTC [TRACE] steampipe: NewPluginClient for plugin hub.steampipe.io/plugins/turbot/aws@latest
2022-05-31 18:50:19.586 UTC [TRACE] steampipe: created connection plugin for connection: 'aws', pluginName: 'hub.steampipe.io/plugins/turbot/aws@latest'
2022-05-31 18:50:19.604 UTC [TRACE] steampipe: status:  {"pid":2722,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"check","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-05-31 18:50:19.604 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-05-31 18:50:19.664 UTC [TRACE] steampipe: executeConnectionUpdateQueries: num updates 1
2022-05-31 18:50:19.664 UTC [TRACE] steampipe: executing update query 0 of 1 for connection 'aws'
2022-05-31 18:50:20.056 UTC [TRACE] steampipe: all update queries executed
2022-05-31 18:50:20.056 UTC [TRACE] steampipe: executing comment query 0 of 1 for plugin 'aws'
2022-05-31 18:50:20.298 UTC [TRACE] steampipe: executeUpdateQueries complete
2022-05-31 18:50:20.299 UTC [TRACE] steampipe: status:  {"pid":2722,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"check","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-05-31 18:50:20.299 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-05-31 18:50:20.384 UTC [TRACE] steampipe: setting user search path to [public aws internal]
2022-05-31 18:50:20.389 UTC [TRACE] steampipe: user search path sql: alter user "steampipe" set search_path to "public","aws","internal";
2022-05-31 18:50:20.389 UTC [TRACE] steampipe: status:  {"pid":2722,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"check","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-05-31 18:50:20.389 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-05-31 18:50:20.453 UTC [TRACE] steampipe: begin ExecutionTree.Execute
2022-05-31 18:50:20.453 UTC [TRACE] steampipe: begin ResultGroup.Execute: root_result_group
2022-05-31 18:50:20.453 UTC [TRACE] steampipe: begin ResultGroup.Execute: mybenchmark.benchmark.mybenchmark_aws
2022-05-31 18:50:20.453 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_compute_1
2022-05-31 18:50:20.453 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_compute_1
2022-05-31 18:50:20.453 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_network_1
2022-05-31 18:50:20.453 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_network_1
2022-05-31 18:50:20.453 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_iam_1
2022-05-31 18:50:20.453 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_iam_1
2022-05-31 18:50:20.453 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_iam_2
2022-05-31 18:50:20.453 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_iam_2
2022-05-31 18:50:20.453 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_iam_3
2022-05-31 18:50:20.453 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_iam_3
2022-05-31 18:50:20.492 UTC [TRACE] steampipe: ensureSessionSearchPath
2022-05-31 18:50:20.492 UTC [TRACE] steampipe: updated the required search path to "public","aws","internal"
2022-05-31 18:50:20.492 UTC [TRACE] steampipe: session search path will be updated to  "public","aws","internal"
2022-05-31 18:50:20.495 UTC [TRACE] steampipe: CreatePreparedStatements
2022-05-31 18:50:20.528 UTC [TRACE] steampipe: ensureSessionSearchPath
2022-05-31 18:50:20.540 UTC [TRACE] steampipe: updated the required search path to "public","aws","internal"
2022-05-31 18:50:20.540 UTC [TRACE] steampipe: session search path will be updated to  "public","aws","internal"
2022-05-31 18:50:20.547 UTC [TRACE] steampipe: ensureSessionSearchPath
2022-05-31 18:50:20.548 UTC [TRACE] steampipe: updated the required search path to "public","aws","internal"
2022-05-31 18:50:20.549 UTC [TRACE] steampipe: session search path will be updated to  "public","aws","internal"
2022-05-31 18:50:20.555 UTC [TRACE] steampipe: ensureSessionSearchPath
2022-05-31 18:50:20.555 UTC [TRACE] steampipe: updated the required search path to "public","aws","internal"
2022-05-31 18:50:20.555 UTC [TRACE] steampipe: session search path will be updated to  "public","aws","internal"
2022-05-31 18:50:20.555 UTC [TRACE] steampipe: CreatePreparedStatements
2022-05-31 18:50:20.562 UTC [TRACE] steampipe: CreatePreparedStatements
2022-05-31 18:50:20.562 UTC [TRACE] steampipe: ensureSessionSearchPath
2022-05-31 18:50:20.562 UTC [TRACE] steampipe: updated the required search path to "public","aws","internal"
2022-05-31 18:50:20.562 UTC [TRACE] steampipe: session search path will be updated to  "public","aws","internal"
2022-05-31 18:50:20.657 UTC [TRACE] steampipe: ResolveQueryFromQueryProvider for mybenchmark.control.mdbi_aws_compute_1
2022-05-31 18:50:20.657 UTC [TRACE] steampipe: control defines inline SQL
2022-05-31 18:50:20.657 UTC [TRACE] steampipe: GetPreparedStatementExecuteSQL source: mybenchmark.control.mdbi_aws_compute_1, sql: execute mybenchmark_mdbi_aws_compute_1_c80a1, args: <empty>
2022-05-31 18:50:20.657 UTC [TRACE] steampipe: setting search path mybenchmark.control.mdbi_aws_compute_1
2022-05-31 18:50:20.657 UTC [TRACE] steampipe: execute start for, mybenchmark.control.mdbi_aws_compute_1
2022-05-31 18:50:20.668 UTC [TRACE] steampipe: CreatePreparedStatements
2022-05-31 18:50:20.793 UTC [TRACE] steampipe: ResolveQueryFromQueryProvider for mybenchmark.control.mdbi_aws_network_1
2022-05-31 18:50:20.793 UTC [TRACE] steampipe: control defines inline SQL
2022-05-31 18:50:20.793 UTC [TRACE] steampipe: GetPreparedStatementExecuteSQL source: mybenchmark.control.mdbi_aws_network_1, sql: execute mybenchmark_mdbi_aws_network_1_cd58f, args: <empty>
2022-05-31 18:50:20.793 UTC [TRACE] steampipe: setting search path mybenchmark.control.mdbi_aws_network_1
2022-05-31 18:50:20.793 UTC [TRACE] steampipe: execute start for, mybenchmark.control.mdbi_aws_network_1
2022-05-31 18:50:20.796 UTC [TRACE] steampipe: CreatePreparedStatements
2022-05-31 18:50:20.834 UTC [TRACE] steampipe: ResolveQueryFromQueryProvider for mybenchmark.control.mdbi_aws_iam_1
2022-05-31 18:50:20.835 UTC [TRACE] steampipe: control defines inline SQL
2022-05-31 18:50:20.835 UTC [TRACE] steampipe: GetPreparedStatementExecuteSQL source: mybenchmark.control.mdbi_aws_iam_1, sql: execute mybenchmark_mdbi_aws_iam_1_c0ebd, args: <empty>
2022-05-31 18:50:20.835 UTC [TRACE] steampipe: setting search path mybenchmark.control.mdbi_aws_iam_1
2022-05-31 18:50:20.835 UTC [TRACE] steampipe: execute start for, mybenchmark.control.mdbi_aws_iam_1
2022-05-31 18:50:20.906 UTC [TRACE] steampipe: ResolveQueryFromQueryProvider for mybenchmark.control.mdbi_aws_iam_3
2022-05-31 18:50:20.906 UTC [TRACE] steampipe: control defines inline SQL
2022-05-31 18:50:20.906 UTC [TRACE] steampipe: GetPreparedStatementExecuteSQL source: mybenchmark.control.mdbi_aws_iam_3, sql: execute mybenchmark_mdbi_aws_iam_3_c7c39, args: <empty>
2022-05-31 18:50:20.906 UTC [TRACE] steampipe: setting search path mybenchmark.control.mdbi_aws_iam_3
2022-05-31 18:50:20.906 UTC [TRACE] steampipe: execute start for, mybenchmark.control.mdbi_aws_iam_3
2022-05-31 18:50:21.001 UTC [TRACE] steampipe: ResolveQueryFromQueryProvider for mybenchmark.control.mdbi_aws_iam_2
2022-05-31 18:50:21.001 UTC [TRACE] steampipe: control defines inline SQL
2022-05-31 18:50:21.001 UTC [TRACE] steampipe: GetPreparedStatementExecuteSQL source: mybenchmark.control.mdbi_aws_iam_2, sql: execute mybenchmark_mdbi_aws_iam_2_cc24e, args: <empty>
2022-05-31 18:50:21.001 UTC [TRACE] steampipe: setting search path mybenchmark.control.mdbi_aws_iam_2
2022-05-31 18:50:21.001 UTC [TRACE] steampipe: execute start for, mybenchmark.control.mdbi_aws_iam_2
2022-05-31 18:50:21.070 UTC [TRACE] steampipe: execute finish for, mybenchmark.control.mdbi_aws_iam_3
2022-05-31 18:50:21.070 UTC [TRACE] steampipe: control mybenchmark.control.mdbi_aws_iam_3 query failed with plugin connectivity error ERROR: failed to start plugin 'aws': error reading from server: EOF (SQLSTATE HV000) - retrying...
2022-05-31 18:50:21.070 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_iam_3
2022-05-31 18:50:21.070 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_iam_3
2022-05-31 18:50:21.070 UTC [TRACE] steampipe: execute finish for, mybenchmark.control.mdbi_aws_iam_1
2022-05-31 18:50:21.070 UTC [TRACE] steampipe: control mybenchmark.control.mdbi_aws_iam_1 query failed with plugin connectivity error ERROR: failed to start plugin 'aws': error reading from server: EOF (SQLSTATE HV000) - retrying...
2022-05-31 18:50:21.070 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_iam_1
2022-05-31 18:50:21.070 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_iam_1
2022-05-31 18:50:21.071 UTC [TRACE] steampipe: execute finish for, mybenchmark.control.mdbi_aws_compute_1
2022-05-31 18:50:21.071 UTC [TRACE] steampipe: control mybenchmark.control.mdbi_aws_compute_1 query failed with plugin connectivity error ERROR: failed to start plugin 'aws': error reading from server: EOF (SQLSTATE HV000) - retrying...
2022-05-31 18:50:21.071 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_compute_1
2022-05-31 18:50:21.071 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_compute_1
2022-05-31 18:50:21.071 UTC [TRACE] steampipe: execute finish for, mybenchmark.control.mdbi_aws_network_1
2022-05-31 18:50:21.071 UTC [TRACE] steampipe: control mybenchmark.control.mdbi_aws_network_1 query failed with plugin connectivity error ERROR: failed to start plugin 'aws': error reading from server: EOF (SQLSTATE HV000) - retrying...
2022-05-31 18:50:21.071 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_network_1
2022-05-31 18:50:21.071 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_network_1
2022-05-31 18:50:21.077 UTC [TRACE] steampipe: execute finish for, mybenchmark.control.mdbi_aws_iam_2
2022-05-31 18:50:21.077 UTC [TRACE] steampipe: control mybenchmark.control.mdbi_aws_iam_2 query failed with plugin connectivity error ERROR: failed to start plugin 'aws': connection error: desc = "transport: error while dialing: dial unix /tmp/plugin157052978: connect: connection refused" (SQLSTATE HV000) - retrying...
2022-05-31 18:50:21.077 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_iam_2
2022-05-31 18:50:21.077 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_iam_2

misraved commented 2 years ago

@chr-b Apologies to see that you are running into issues with Steampipe.

To investigate more around this issue we would like to understand a few things first:

Were you able to run your custom benchmark error-free with earlier versions of the AWS plugin (like v0.60.0 and prior)?
What kind of controls and how many of them are included in your custom benchmark? If possible, could you please share your custom benchmarks/controls?
How many AWS accounts are you using?
What kind of container environment are you using?

The above points will definitely help us to reproduce the issue. 👍

chr-b commented 2 years ago

Hi @misraved ,

I have now tested this with AWS plugin versions 0.61.0, 0.60.0 and 0.59.0. The problem occurs for versions >= 0.60. It seems like the problem does not occur with version 0.59.
The benchmark has 8 controls: 1x aws_ec2_instance, 1x aws_ec2_load_balancer_listener, 1x aws_iam_role, 1x aws_iam_user and aws_iam_access_key, 1x aws_iam_credential_report, 2x aws_s3_bucket and 1x aws_vpc_security_group_rule
There are up to 150 AWS accounts in one loop
The container base image is amazon/aws-cli:2.7.4, where steampipe is installed with your install.sh script.

chr-b commented 2 years ago

So it turned out the problem was something else: the container was actually OOM killed (this was kind of hidden to me because this is being executed in Argo Workflows).

I assume the error message ERROR: failed to start plugin 'aws' is related to Steampipe, or the plugin, being unable to allocate sufficient memory. I guess we can close this issue then, unless you want to change the error reporting to indicate memory allocation problems.

cbruno10 commented 2 years ago

@kaidaguerre Are OOM issues, and similar ones that may cause plugin startups to fail, something we can expose more through our error messages instead of query failed with plugin connectivity error ERROR: failed to start plugin 'aws': error reading from server: EOF (SQLSTATE HV000) - retrying... in the CLI so users have a better idea of what's causing plugin startup to fail?

cbruno10 commented 2 years ago

@chr-b I've raised a feature request in https://github.com/turbot/steampipe/issues/2159 to improve the help messages when plugins fail to start. I'm closing this issue as we can continue the conversation in the new issue, but if you encounter anything else, feel free to re-open. Thanks!

chr-b commented 2 years ago

Hi @cbruno10 ,

It might have been a mistake to attribute this problem to OOM. The issue just just reappeared, but this time independent of OOM. Steampipe is in a stuck state and there are log messages realted to query failed with plugin connectivity error.

From the tracing log:

2022-06-13 12:53:16.870 UTC [TRACE] steampipe: modfile exists in workspace folder - creating pseudo-resources and loading files recursively
2022-06-13 12:53:16.873 UTC [TRACE] steampipe: parse complete after 1 decode passes
2022-06-13 12:53:16.878 UTC [TRACE] steampipe: parse complete after 2 decode passes
2022-06-13 12:53:16.879 UTC [TRACE] steampipe: ensuring check export/output templates
2022-06-13 12:53:16.881 UTC [TRACE] steampipe: GetRunStatus - loadRunningInstanceInfo returned nil
2022-06-13 12:53:16.881 UTC [TRACE] steampipe: StartDB invoker check
2022-06-13 12:53:16.881 UTC [TRACE] steampipe: StartDB started plugin manager
2022-06-13 12:53:16.882 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=postgres sslmode=disable
2022-06-13 12:53:16.912 UTC [TRACE] steampipe: SERVICE: 2022-06-13 12:53:16.912 UTC [20325] LOG:  redirecting log output to logging collector process
2022-06-13 12:53:16.912 UTC [TRACE] steampipe: SERVICE: 2022-06-13 12:53:16.912 UTC [20325] HINT:  Future log output will appear in directory "/home/steampipe/.steampipe/logs".
2022-06-13 12:53:16.957 UTC [TRACE] steampipe: status:  {"pid":20325,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"check","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-06-13 12:53:16.958 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=postgres sslmode=require
2022-06-13 12:53:17.022 UTC [TRACE] steampipe: status:  {"pid":20325,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"check","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-06-13 12:53:17.022 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-06-13 12:53:17.120 UTC [TRACE] steampipe: plugin manager state file not found
2022-06-13 12:53:17.120 UTC [TRACE] steampipe: plugin manager state file not found
2022-06-13 12:53:17.136 UTC [TRACE] steampipe: start: started plugin manager, pid 20342
2022-06-13 12:53:17.205 UTC [TRACE] steampipe: created local client 0xc000695700
2022-06-13 12:53:17.206 UTC [TRACE] steampipe: getSchemaHashesForDynamicSchemas
2022-06-13 12:53:17.206 UTC [TRACE] steampipe: CreateConnectionPlugin creating 0 connections
2022-06-13 12:53:17.206 UTC [TRACE] steampipe: plugin manager is running - returning client
2022-06-13 12:53:17.209 UTC [TRACE] steampipe: fetched schema for 0 dynamic plugins
2022-06-13 12:53:17.209 UTC [TRACE] steampipe: connection aws is out of date or missing
2022-06-13 12:53:17.209 UTC [TRACE] steampipe: CreateConnectionPlugin creating 1 connections
2022-06-13 12:53:17.209 UTC [TRACE] steampipe: plugin manager is running - returning client
2022-06-13 12:53:17.238 UTC [TRACE] steampipe: plugin manager returned reattach config for connection 'aws' - pid 20352, reattach protocol:"grpc" addr:{Network:"unix" Address:"/tmp/plugin1999210270"} pid:20352
2022-06-13 12:53:17.238 UTC [TRACE] steampipe: NewPluginClient for plugin hub.steampipe.io/plugins/turbot/aws@0.61.0
2022-06-13 12:53:17.371 UTC [TRACE] steampipe: created connection plugin for connection: 'aws', pluginName: 'hub.steampipe.io/plugins/turbot/aws@0.61.0'
2022-06-13 12:53:17.382 UTC [TRACE] steampipe: status:  {"pid":20325,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"check","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-06-13 12:53:17.382 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-06-13 12:53:17.438 UTC [TRACE] steampipe: executeConnectionUpdateQueries: num updates 1
2022-06-13 12:53:17.438 UTC [TRACE] steampipe: executing update query 0 of 1 for connection 'aws'
2022-06-13 12:53:17.917 UTC [TRACE] steampipe: all update queries executed
2022-06-13 12:53:17.917 UTC [TRACE] steampipe: executing comment query 0 of 1 for plugin 'aws'
2022-06-13 12:53:18.119 UTC [TRACE] steampipe: executeUpdateQueries complete
2022-06-13 12:53:18.121 UTC [TRACE] steampipe: status:  {"pid":20325,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"check","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-06-13 12:53:18.121 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-06-13 12:53:18.200 UTC [TRACE] steampipe: setting user search path to [public aws internal]
2022-06-13 12:53:18.218 UTC [TRACE] steampipe: user search path sql: alter user "steampipe" set search_path to "public","aws","internal";
2022-06-13 12:53:18.219 UTC [TRACE] steampipe: status:  {"pid":20325,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"check","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-06-13 12:53:18.219 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-06-13 12:53:18.277 UTC [TRACE] steampipe: begin ExecutionTree.Execute
2022-06-13 12:53:18.277 UTC [TRACE] steampipe: begin ResultGroup.Execute: root_result_group
2022-06-13 12:53:18.277 UTC [TRACE] steampipe: begin ResultGroup.Execute: mybenchmark.benchmark.mybenchmark_aws
2022-06-13 12:53:18.277 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_compute_1
2022-06-13 12:53:18.277 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_compute_1
2022-06-13 12:53:18.277 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_network_1
2022-06-13 12:53:18.277 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_network_1
2022-06-13 12:53:18.277 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_iam_1
2022-06-13 12:53:18.277 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_iam_1
2022-06-13 12:53:18.278 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_iam_2
2022-06-13 12:53:18.278 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_iam_2
2022-06-13 12:53:18.278 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_iam_3
2022-06-13 12:53:18.278 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_iam_3
2022-06-13 12:53:18.298 UTC [TRACE] steampipe: ensureSessionSearchPath
2022-06-13 12:53:18.298 UTC [TRACE] steampipe: updated the required search path to "public","aws","internal"
2022-06-13 12:53:18.298 UTC [TRACE] steampipe: session search path will be updated to  "public","aws","internal"
2022-06-13 12:53:18.305 UTC [TRACE] steampipe: CreatePreparedStatements
2022-06-13 12:53:18.454 UTC [TRACE] steampipe: ensureSessionSearchPath
2022-06-13 12:53:18.454 UTC [TRACE] steampipe: updated the required search path to "public","aws","internal"
2022-06-13 12:53:18.454 UTC [TRACE] steampipe: session search path will be updated to  "public","aws","internal"
2022-06-13 12:53:18.455 UTC [TRACE] steampipe: ensureSessionSearchPath
2022-06-13 12:53:18.455 UTC [TRACE] steampipe: updated the required search path to "public","aws","internal"
2022-06-13 12:53:18.455 UTC [TRACE] steampipe: session search path will be updated to  "public","aws","internal"
2022-06-13 12:53:18.458 UTC [TRACE] steampipe: ensureSessionSearchPath
2022-06-13 12:53:18.458 UTC [TRACE] steampipe: updated the required search path to "public","aws","internal"
2022-06-13 12:53:18.458 UTC [TRACE] steampipe: session search path will be updated to  "public","aws","internal"
2022-06-13 12:53:18.463 UTC [TRACE] steampipe: CreatePreparedStatements
2022-06-13 12:53:18.464 UTC [TRACE] steampipe: CreatePreparedStatements
2022-06-13 12:53:18.471 UTC [TRACE] steampipe: ensureSessionSearchPath
2022-06-13 12:53:18.471 UTC [TRACE] steampipe: updated the required search path to "public","aws","internal"
2022-06-13 12:53:18.471 UTC [TRACE] steampipe: session search path will be updated to  "public","aws","internal"
2022-06-13 12:53:18.488 UTC [TRACE] steampipe: ResolveQueryFromQueryProvider for mybenchmark.control.mdbi_aws_compute_1
2022-06-13 12:53:18.488 UTC [TRACE] steampipe: control defines inline SQL
2022-06-13 12:53:18.488 UTC [TRACE] steampipe: GetPreparedStatementExecuteSQL source: mybenchmark.control.mdbi_aws_compute_1, sql: execute mybenchmark_mdbi_aws_compute_1_c80a1, args: <empty>
2022-06-13 12:53:18.488 UTC [TRACE] steampipe: setting search path mybenchmark.control.mdbi_aws_compute_1
2022-06-13 12:53:18.488 UTC [TRACE] steampipe: execute start for, mybenchmark.control.mdbi_aws_compute_1
2022-06-13 12:53:18.554 UTC [TRACE] steampipe: CreatePreparedStatements
2022-06-13 12:53:18.782 UTC [TRACE] steampipe: ResolveQueryFromQueryProvider for mybenchmark.control.mdbi_aws_iam_2
2022-06-13 12:53:18.782 UTC [TRACE] steampipe: control defines inline SQL
2022-06-13 12:53:18.782 UTC [TRACE] steampipe: GetPreparedStatementExecuteSQL source: mybenchmark.control.mdbi_aws_iam_2, sql: execute mybenchmark_mdbi_aws_iam_2_cc24e, args: <empty>
2022-06-13 12:53:18.782 UTC [TRACE] steampipe: setting search path mybenchmark.control.mdbi_aws_iam_2
2022-06-13 12:53:18.782 UTC [TRACE] steampipe: execute start for, mybenchmark.control.mdbi_aws_iam_2
2022-06-13 12:53:18.786 UTC [TRACE] steampipe: CreatePreparedStatements
2022-06-13 12:53:18.862 UTC [TRACE] steampipe: ResolveQueryFromQueryProvider for mybenchmark.control.mdbi_aws_iam_1
2022-06-13 12:53:18.872 UTC [TRACE] steampipe: control defines inline SQL
2022-06-13 12:53:18.872 UTC [TRACE] steampipe: GetPreparedStatementExecuteSQL source: mybenchmark.control.mdbi_aws_iam_1, sql: execute mybenchmark_mdbi_aws_iam_1_c0ebd, args: <empty>
2022-06-13 12:53:18.872 UTC [TRACE] steampipe: setting search path mybenchmark.control.mdbi_aws_iam_1
2022-06-13 12:53:18.872 UTC [TRACE] steampipe: execute start for, mybenchmark.control.mdbi_aws_iam_1
2022-06-13 12:53:18.872 UTC [TRACE] steampipe: ResolveQueryFromQueryProvider for mybenchmark.control.mdbi_aws_network_1
2022-06-13 12:53:18.872 UTC [TRACE] steampipe: control defines inline SQL
2022-06-13 12:53:18.872 UTC [TRACE] steampipe: GetPreparedStatementExecuteSQL source: mybenchmark.control.mdbi_aws_network_1, sql: execute mybenchmark_mdbi_aws_network_1_cd58f, args: <empty>
2022-06-13 12:53:18.872 UTC [TRACE] steampipe: setting search path mybenchmark.control.mdbi_aws_network_1
2022-06-13 12:53:18.872 UTC [TRACE] steampipe: execute start for, mybenchmark.control.mdbi_aws_network_1
2022-06-13 12:53:19.079 UTC [TRACE] steampipe: ResolveQueryFromQueryProvider for mybenchmark.control.mdbi_aws_iam_3
2022-06-13 12:53:19.079 UTC [TRACE] steampipe: control defines inline SQL
2022-06-13 12:53:19.079 UTC [TRACE] steampipe: GetPreparedStatementExecuteSQL source: mybenchmark.control.mdbi_aws_iam_3, sql: execute mybenchmark_mdbi_aws_iam_3_c7c39, args: <empty>
2022-06-13 12:53:19.079 UTC [TRACE] steampipe: setting search path mybenchmark.control.mdbi_aws_iam_3
2022-06-13 12:53:19.079 UTC [TRACE] steampipe: execute start for, mybenchmark.control.mdbi_aws_iam_3
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: execute finish for, mybenchmark.control.mdbi_aws_iam_2
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: control mybenchmark.control.mdbi_aws_iam_2 query failed with plugin connectivity error ERROR: failed to start plugin 'aws@0.61.0': error reading from server: EOF (SQLSTATE HV000) - retrying...
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_iam_2
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_iam_2
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: execute finish for, mybenchmark.control.mdbi_aws_iam_1
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: control mybenchmark.control.mdbi_aws_iam_1 query failed with plugin connectivity error ERROR: failed to start plugin 'aws@0.61.0': error reading from server: EOF (SQLSTATE HV000) - retrying...
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_iam_1
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_iam_1
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: execute finish for, mybenchmark.control.mdbi_aws_iam_3
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: control mybenchmark.control.mdbi_aws_iam_3 query failed with plugin connectivity error ERROR: failed to start plugin 'aws@0.61.0': error reading from server: EOF (SQLSTATE HV000) - retrying...
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_iam_3
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_iam_3
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: execute finish for, mybenchmark.control.mdbi_aws_network_1
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: control mybenchmark.control.mdbi_aws_network_1 query failed with plugin connectivity error ERROR: failed to start plugin 'aws@0.61.0': error reading from server: EOF (SQLSTATE HV000) - retrying...
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_network_1
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_network_1
2022-06-13 12:53:19.774 UTC [TRACE] steampipe: execute finish for, mybenchmark.control.mdbi_aws_compute_1
2022-06-13 12:53:19.774 UTC [TRACE] steampipe: control mybenchmark.control.mdbi_aws_compute_1 query failed with plugin connectivity error ERROR: rpc error: code = Unavailable desc = error reading from server: EOF (SQLSTATE HV000) - retrying...
2022-06-13 12:53:19.774 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_compute_1
2022-06-13 12:53:19.774 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_compute_1

Using AWS plugin 0.61.0 with Steampipe 0.14.6.

cbruno10 commented 2 years ago

@chr-b Sorry you're still running into issues, let me re-open this issue.

@kaidaguerre From the trace logs, I can see lines like:

2022-06-13 12:53:19.771 UTC [TRACE] steampipe: control mybenchmark.control.mdbi_aws_iam_2 query failed with plugin connectivity error ERROR: failed to start plugin 'aws@0.61.0': error reading from server: EOF (SQLSTATE HV000) - retrying...
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_iam_2
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_iam_2
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: execute finish for, mybenchmark.control.mdbi_aws_iam_1
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: control mybenchmark.control.mdbi_aws_iam_1 query failed with plugin connectivity error ERROR: failed to start plugin 'aws@0.61.0': error reading from server: EOF (SQLSTATE HV000) - retrying...
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: begin ControlRun.Start: mybenchmark.control.mdbi_aws_iam_1
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: control start, mybenchmark.control.mdbi_aws_iam_1
2022-06-13 12:53:19.771 UTC [TRACE] steampipe: execute finish for, mybenchmark.control.mdbi_aws_iam_3

Do you have any recommendations on how to better debug this, especially as it's intermittent? I can't see anything particularly helpful from the trace logs currently available.

kaidaguerre commented 2 years ago

@chr-b is there anything helpful in the plugin manager log (look in ~/.steampipe/logs/plugin-2022-06-13.log)

chr-b commented 2 years ago

Hi @kaidaguerre ,

So there is a lot of log data available in the plugin-2022-06-DD.log file.

The regular tracing output indicates that the benchmark execution for the AWS account where steampipe hangs is started at 2022-06-14 07:23:01.240 UTC.

Searching through the plugin log file, I found the following fatal error: concurrent map iteration and map write. Extract of the relevant section below.

2022-06-14 07:23:04.414 UTC [TRACE] steampipe-plugin-aws.plugin: [TRACE] validate table aws_s3_bucket
2022-06-14 07:23:04.414 UTC [TRACE] steampipe-plugin-aws.plugin: [TRACE] validateRequiredColumns
2022-06-14 07:23:04.414 UTC [TRACE] steampipe-plugin-aws.plugin: [TRACE] validateListAndGetConfig
2022-06-14 07:23:04.414 UTC [TRACE] steampipe-plugin-aws.plugin: [TRACE] IgnoreConfig validate: ShouldIgnoreError 0x0, ShouldIgnoreErrorFunc: 0x2b6d6c0
2022-06-14 07:23:04.414 UTC [TRACE] steampipe-plugin-aws.plugin: [TRACE] IgnoreConfig validate: ShouldIgnoreError 0x0, ShouldIgnoreErrorFunc: 0x2b6da00
2022-06-14 07:23:04.414 UTC [TRACE] steampipe-plugin-aws.plugin: [TRACE] validateHydrateDependencies
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: fatal error: concurrent map iteration and map write
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 41 [running]:
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: runtime.throw({0x436cd98?, 0x7ff2dc7555b8?})
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/panic.go:992 +0x71 fp=0xc006797288 sp=0xc006797258 pc=0x433f51
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: runtime.mapiternext(0x0?)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/map.go:871 +0x4eb fp=0xc0067972f8 sp=0xc006797288 pc=0x40fd2b
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: runtime.mapiterinit(0x3888320?, 0xc006797370?, 0x42bf587?)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/map.go:861 +0x228 fp=0xc006797318 sp=0xc0067972f8 pc=0x40f7e8
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Table).detectCyclicHydrateDependencies(0xc00363ef00)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/table_validate.go:156 +0x167 fp=0xc0067974e0 sp=0xc006797318 pc=0xa37d67
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Table).validateHydrateDependencies(0x435cfd3?)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/table_validate.go:131 +0xd0 fp=0xc006797560 sp=0xc0067974e0 pc=0xa37b70
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Table).validate(0xc00363ef00, {0x42d4cfc, 0xd}, {0x0, 0x0, 0x0})
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/table_validate.go:35 +0x294 fp=0xc006797680 sp=0xc006797560 pc=0xa36af4
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Plugin).Validate(0xc00367c480)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/plugin_validate.go:15 +0x1b4 fp=0xc0067977e0 sp=0xc006797680 pc=0xa27974
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Plugin).initialiseTables(0xc00367c480, {0x4a93bb8?, 0xc00047c930?})
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/plugin.go:314 +0x19e fp=0xc0067978e0 sp=0xc0067977e0 pc=0xa26e7e
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Plugin).SetConnectionConfig(0xc00367c480, {0xc0003f6925, 0x3}, {0xc000042270, 0x29})
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/plugin.go:136 +0x2db fp=0xc006797980 sp=0xc0067978e0 pc=0xa2531b
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Plugin).SetConnectionConfig-fm({0xc0003f6925?, 0x88fa4b?}, {0xc000042270?, 0xc000042240?})
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    <autogenerated>:1 +0x3f fp=0xc0067979b8 sp=0xc006797980 pc=0xa391ff
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc.PluginServer.SetConnectionConfig({{}, {0x42fffb7, 0x14}, 0xc003662ff0, 0xc003662fd0, 0xc003662fe0}, 0xc003674480?)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/pluginServer.go:73 +0x9f fp=0xc006797a20 sp=0xc0067979b8 pc=0x9070ff
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc.(*PluginServer).SetConnectionConfig(0x3c48a40?, 0x40d600?)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    <autogenerated>:1 +0x65 fp=0xc006797a88 sp=0xc006797a20 pc=0x907f65
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc/shared.(*GRPCServer).SetConnectionConfig(0x3dec420?, {0xc000251770?, 0x48fda6?}, 0x0?)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/shared/grpc.go:54 +0x24 fp=0xc006797aa8 sp=0xc006797a88 pc=0x8f61c4
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc/proto._WrapperPlugin_SetConnectionConfig_Handler({0x3c48a40?, 0xc003663440}, {0x4a93bb8, 0xc003699f50}, 0xc00366ba40, 0x0)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/proto/plugin_grpc.pb.go:179 +0x170 fp=0xc006797b00 sp=0xc006797aa8 pc=0x8a6b50
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processUnaryRPC(0xc00358f880, {0x4a972a8, 0xc006bfa000}, 0xc003674480, 0xc003699e30, 0x6f970d8, 0x0)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1283 +0xcfd fp=0xc006797e48 sp=0xc006797b00 pc=0x88e61d
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc006bfa000}, 0xc003674480, 0x0)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1620 +0xa1b fp=0xc006797f68 sp=0xc006797e48 pc=0x892c7b
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98 fp=0xc006797fe0 sp=0xc006797f68 pc=0x88c178
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: runtime.goexit()
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/asm_amd64.s:1571 +0x1 fp=0xc006797fe8 sp=0xc006797fe0 pc=0x463ae1
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 1 [select]:
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.Serve(0xc000013d98)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/server.go:471 +0x14c8
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc.PluginServer.Serve({{}, {0x42fffb7, 0x14}, 0xc003662ff0, 0xc003662fd0, 0xc003662fe0})
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/pluginServer.go:88 +0x19d
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.Serve(0xc000017f58)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/serve.go:35 +0x279
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: main.main()
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/work/steampipe-plugin-aws/steampipe-plugin-aws/main.go:9 +0x3f
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 21 [chan receive]:
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/golang/glog.(*loggingT).flushDaemon(0xc000166b40?)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/golang/glog@v1.0.0/glog.go:882 +0x6a
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: created by github.com/golang/glog.init.0
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/golang/glog@v1.0.0/glog.go:410 +0x1bf
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 4 [select]:
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc0001e22c0)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.0/policy.go:102 +0x91
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: created by github.com/dgraph-io/ristretto.newDefaultPolicy
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.0/policy.go:86 +0x156
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 5 [select]:
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc00018c180)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.0/cache.go:452 +0x15e
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: created by github.com/dgraph-io/ristretto.NewCache
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.0/cache.go:207 +0x696
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 6 [select]:
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc0036800c0)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.0/policy.go:102 +0x91
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: created by github.com/dgraph-io/ristretto.newDefaultPolicy
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.0/policy.go:86 +0x156
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 7 [select]:
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc00360e000)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.0/cache.go:452 +0x15e
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: created by github.com/dgraph-io/ristretto.NewCache
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.0/cache.go:207 +0x696
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 64 [semacquire]:
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: sync.runtime_SemacquireMutex(0xc0036aa0a0?, 0x78?, 0x46db09?)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/sema.go:71 +0x25
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: sync.(*Mutex).lockSlow(0xc0000980f0)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/sync/mutex.go:162 +0x165
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: sync.(*Mutex).Lock(...)
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/sync/mutex.go:81
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: log.(*Logger).Output(0xc0000980f0, 0x61?, {0xc009f7b2d0, 0x61})
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/log/log.go:176 +0x9c
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: log.Printf({0x444c7c1?, 0x633875?}, {0x0?, 0x25?, 0xc009f75200?})
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/log/log.go:351 +0x55
2022-06-14 07:23:04.414 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*IgnoreConfig).DefaultTo(0xc006994610?, 0xc006994590?)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/ignore_error_config.go:45 +0x4e
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*GetConfig).initialise(0xc003609dc0, 0xc00363efc0)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/get_config.go:52 +0x199
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Table).initialise(0xc00363efc0, 0xc00367c480)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/table.go:85 +0x2c9
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Plugin).initialiseTables(0xc00367c480, {0x4a93bb8?, 0xc0069645a0?})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/plugin.go:309 +0x179
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Plugin).SetConnectionConfig(0xc00367c480, {0xc0067b4bfd, 0x3}, {0xc0000d4990, 0x29})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/plugin.go:136 +0x2db
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc.PluginServer.SetConnectionConfig({{}, {0x42fffb7, 0x14}, 0xc003662ff0, 0xc003662fd0, 0xc003662fe0}, 0xc006b2c900?)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/pluginServer.go:73 +0x9f
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc/shared.(*GRPCServer).SetConnectionConfig(0x3dec420?, {0xc0067c9770?, 0x48fda6?}, 0x3cea5c0?)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/shared/grpc.go:54 +0x24
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc/proto._WrapperPlugin_SetConnectionConfig_Handler({0x3c48a40?, 0xc003663440}, {0x4a93bb8, 0xc006964000}, 0xc0067b92c0, 0x0)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/proto/plugin_grpc.pb.go:179 +0x170
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processUnaryRPC(0xc00358f880, {0x4a972a8, 0xc006a89ba0}, 0xc006b2c900, 0xc003699e30, 0x6f970d8, 0x0)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1283 +0xcfd
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc006a89ba0}, 0xc006b2c900, 0x0)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1620 +0xa1b
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 9 [IO wait]:
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.runtime_pollWait(0x7ff2b5accdc8, 0x72)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/netpoll.go:302 +0x89
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).wait(0xc000096a80?, 0xc0036bc000?, 0x1)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:83 +0x32
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).waitRead(...)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:88
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*FD).Read(0xc000096a80, {0xc0036bc000, 0x1000, 0x1000})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_unix.go:167 +0x25a
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: os.(*File).read(...)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/os/file_posix.go:31
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: os.(*File).Read(0xc0036401c0, {0xc0036bc000?, 0x400?, 0x3417e00?})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/os/file.go:119 +0x5e
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: bufio.(*Reader).Read(0xc000069f40, {0xc0000e2800, 0x400, 0x0?})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/bufio/bufio.go:236 +0x1b4
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.copyChan({0x4a9f5d8, 0xc0035a7b00}, 0x0?, {0x4a8f600?, 0xc0036401c0?})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_stdio.go:181 +0x1f6
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: created by github.com/hashicorp/go-plugin.newGRPCStdioServer
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_stdio.go:37 +0xf5
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 10 [IO wait]:
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.runtime_pollWait(0x7ff2b5accbe8, 0x72)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/netpoll.go:302 +0x89
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).wait(0xc000096b40?, 0xc0036bd000?, 0x1)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:83 +0x32
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).waitRead(...)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:88
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*FD).Read(0xc000096b40, {0xc0036bd000, 0x1000, 0x1000})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_unix.go:167 +0x25a
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: os.(*File).read(...)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/os/file_posix.go:31
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: os.(*File).Read(0xc0036402d8, {0xc0036bd000?, 0x400?, 0x3417e00?})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/os/file.go:119 +0x5e
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: bufio.(*Reader).Read(0xc000064740, {0xc0000e2c00, 0x400, 0x0?})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/bufio/bufio.go:236 +0x1b4
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.copyChan({0x4a9f5d8, 0xc0035a7b00}, 0x0?, {0x4a8f600?, 0xc0036402d8?})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_stdio.go:181 +0x1f6
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: created by github.com/hashicorp/go-plugin.newGRPCStdioServer
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_stdio.go:38 +0x185
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 12 [syscall]:
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: os/signal.signal_recv()
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/sigqueue.go:151 +0x2f
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: os/signal.loop()
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/os/signal/signal_unix.go:23 +0x19
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: created by os/signal.Notify.func1.1
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/os/signal/signal.go:151 +0x2a
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 13 [chan receive]:
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.Serve.func3()
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/server.go:436 +0x75
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: created by github.com/hashicorp/go-plugin.Serve
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/server.go:433 +0x1292
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 14 [IO wait]:
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.runtime_pollWait(0x7ff2b5acceb8, 0x72)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/netpoll.go:302 +0x89
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).wait(0xc00360e080?, 0x18?, 0x0)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:83 +0x32
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).waitRead(...)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:88
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*FD).Accept(0xc00360e080)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_unix.go:614 +0x22c
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*netFD).accept(0xc00360e080)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/fd_unix.go:172 +0x35
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*UnixListener).accept(0x461a4e?)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/unixsock_posix.go:166 +0x1c
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*UnixListener).Accept(0xc003699890)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/unixsock.go:260 +0x3d
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).Serve(0xc00358f880, {0x4a92ea8?, 0xc003678e00})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:780 +0x477
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.(*GRPCServer).Serve(0xc0035a7b90, {0x4a92ea8?, 0xc003678e00?})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_server.go:138 +0x71
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: created by github.com/hashicorp/go-plugin.Serve
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/server.go:465 +0x143e
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 15 [select]:
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/dgraph-io/ristretto.(*Cache).processItems(0xc006ac3980)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.0/cache.go:452 +0x15e
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: created by github.com/dgraph-io/ristretto.NewCache
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.0/cache.go:207 +0x696
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 28 [select]:
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.(*grpcStdioServer).StreamStdio(0xc003663410, 0x3c49b20?, {0x4a96960, 0xc0036637c0})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_stdio.go:58 +0x11d
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin._GRPCStdio_StreamStdio_Handler({0x386c360?, 0xc003663410}, {0x4a95790, 0xc0004616c0})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_stdio.pb.go:185 +0xd0
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processStreamingRPC(0xc00358f880, {0x4a972a8, 0xc00044a340}, 0xc000437b00, 0xc003699da0, 0x6f8f8e0, 0x0)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1542 +0xedb
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc00044a340}, 0xc000437b00, 0x0)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1624 +0x9d6
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 25 [select]:
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00023e280, 0x1)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/controlbuf.go:407 +0x115
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000096f00)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/controlbuf.go:534 +0x85
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.NewServerTransport.func2()
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:332 +0xc6
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc/internal/transport.NewServerTransport
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:329 +0x19b3
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 26 [select]:
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc00044a340)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:1131 +0x233
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc/internal/transport.NewServerTransport
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:341 +0x19f8
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 27 [IO wait]:
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.runtime_pollWait(0x7ff2b5acc918, 0x72)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/netpoll.go:302 +0x89
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).wait(0xc0035edf00?, 0xc003686000?, 0x0)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:83 +0x32
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).waitRead(...)
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:88
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*FD).Read(0xc0035edf00, {0xc003686000, 0x8000, 0x8000})
2022-06-14 07:23:04.415 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_unix.go:167 +0x25a
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*netFD).Read(0xc0035edf00, {0xc003686000?, 0x461a4e?, 0x436ae7?})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/fd_posix.go:55 +0x29
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*conn).Read(0xc00000e078, {0xc003686000?, 0x0?, 0x7ff2b5ac44d0?})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/net.go:183 +0x45
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: bufio.(*Reader).Read(0xc00366a240, {0xc0001e42e0, 0x9, 0x18?})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/bufio/bufio.go:236 +0x1b4
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadAtLeast({0x4a830c0, 0xc00366a240}, {0xc0001e42e0, 0x9, 0x9}, 0x9)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:331 +0x9a
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadFull(...)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:350
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: golang.org/x/net/http2.readFrameHeader({0xc0001e42e0?, 0x9?, 0xc0000d2420?}, {0x4a830c0?, 0xc00366a240?})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/golang.org/x/net@v0.0.0-20220225172249-27dd8689420f/http2/frame.go:237 +0x6e
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: golang.org/x/net/http2.(*Framer).ReadFrame(0xc0001e42a0)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/golang.org/x/net@v0.0.0-20220225172249-27dd8689420f/http2/frame.go:498 +0x95
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc00044a340, 0x0?, 0x0?)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:611 +0xb2
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams(0xc00358f880, {0x4a972a8?, 0xc00044a340})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:906 +0x142
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleRawConn.func1()
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:848 +0x46
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).handleRawConn
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:847 +0x185
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 40 [select]:
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.(*grpcStdioServer).StreamStdio(0xc003663410, 0x3c49b20?, {0x4a96960, 0xc006adcc50})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_stdio.go:58 +0x11d
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin._GRPCStdio_StreamStdio_Handler({0x386c360?, 0xc003663410}, {0x4a95790, 0xc006aec340})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_stdio.pb.go:185 +0xd0
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processStreamingRPC(0xc00358f880, {0x4a972a8, 0xc006bfa000}, 0xc003674240, 0xc003699da0, 0x6f8f8e0, 0x0)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1542 +0xedb
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc006bfa000}, 0xc003674240, 0x0)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1624 +0x9d6
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 30 [select]:
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc00025e190, {0xc003671f18, 0x5, 0x5})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:179 +0x90
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00025e190, {0xc003671f18?, 0xc0000d2138?, 0xc0036b46e0?})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:173 +0x16f
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc00047c7b0, {0xc003671f18?, 0xc0036b4758?, 0x818447?})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:485 +0x32
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadAtLeast({0x4a8ea60, 0xc00047c7b0}, {0xc003671f18, 0x5, 0x5}, 0x5)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:331 +0x9a
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadFull(...)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:350
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0000f2360, {0xc003671f18, 0x5, 0x5})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:469 +0xa5
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*parser).recvMsg(0xc003671f08, 0x400000)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:559 +0x47
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.recvAndDecompress(0x42e710?, 0xc0000f2360, {0x0, 0x0}, 0x400000, 0x0, {0x0, 0x0})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:690 +0x66
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.recv(0x8?, {0x7ff2b5935228, 0x6fd7588}, 0x203000?, {0x0?, 0x0?}, {0x40dbb60, 0xc000264460}, 0x7ff2b59263a0?, 0x0, ...)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:756 +0x6e
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*serverStream).RecvMsg(0xc0000a88f0, {0x40dbb60?, 0xc000264460})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/stream.go:1583 +0x178
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin.(*gRPCBrokerStartStreamServer).Recv(0xc00675c990)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_broker.pb.go:167 +0x4c
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.(*gRPCBrokerServer).StartStream(0xc003699b60, {0x4a96ee0, 0xc00675c990})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_broker.go:84 +0x152
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin._GRPCBroker_StartStream_Handler({0x3b91260?, 0xc003699b60}, {0x4a95790?, 0xc0000a88f0})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_broker.pb.go:148 +0x9f
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processStreamingRPC(0xc00358f880, {0x4a972a8, 0xc00044a340}, 0xc0000f2360, 0xc003699bf0, 0x6f8f8c0, 0x0)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1542 +0xedb
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc00044a340}, 0xc0000f2360, 0x0)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1624 +0x9d6
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 55 [select]:
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0067c8fa0, 0x1)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/controlbuf.go:407 +0x115
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0067b8de0)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/controlbuf.go:534 +0x85
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.NewServerTransport.func2()
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:332 +0xc6
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc/internal/transport.NewServerTransport
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:329 +0x19b3
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 32 [select]:
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc006ae66c0)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.0/policy.go:102 +0x91
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: created by github.com/dgraph-io/ristretto.newDefaultPolicy
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/dgraph-io/ristretto@v0.1.0/policy.go:86 +0x156
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 63 [select]:
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.(*grpcStdioServer).StreamStdio(0xc003663410, 0x3c49b20?, {0x4a96960, 0xc00675d5f0})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_stdio.go:58 +0x11d
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin._GRPCStdio_StreamStdio_Handler({0x386c360?, 0xc003663410}, {0x4a95790, 0xc0067c45b0})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_stdio.pb.go:185 +0xd0
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processStreamingRPC(0xc00358f880, {0x4a972a8, 0xc006a89ba0}, 0xc006b2c7e0, 0xc003699da0, 0x6f8f8e0, 0x0)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1542 +0xedb
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc006a89ba0}, 0xc006b2c7e0, 0x0)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1624 +0x9d6
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 61 [IO wait]:
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.runtime_pollWait(0x7ff2b5acc828, 0x72)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/netpoll.go:302 +0x89
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).wait(0xc00360fe80?, 0xc006906000?, 0x0)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:83 +0x32
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).waitRead(...)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:88
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*FD).Read(0xc00360fe80, {0xc006906000, 0x8000, 0x8000})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_unix.go:167 +0x25a
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*netFD).Read(0xc00360fe80, {0xc006906000?, 0x42bef9b?, 0xc006bad500?})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/fd_posix.go:55 +0x29
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*conn).Read(0xc003640308, {0xc006906000?, 0x0?, 0x0?})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/net.go:183 +0x45
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: bufio.(*Reader).Read(0xc0067b8f60, {0xc003555700, 0x9, 0x80897b85?})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/bufio/bufio.go:236 +0x1b4
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadAtLeast({0x4a830c0, 0xc0067b8f60}, {0xc003555700, 0x9, 0x9}, 0x9)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:331 +0x9a
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadFull(...)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:350
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: golang.org/x/net/http2.readFrameHeader({0xc003555700?, 0x9?, 0xc0067c92c0?}, {0x4a830c0?, 0xc0067b8f60?})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/golang.org/x/net@v0.0.0-20220225172249-27dd8689420f/http2/frame.go:237 +0x6e
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: golang.org/x/net/http2.(*Framer).ReadFrame(0xc0035556c0)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/golang.org/x/net@v0.0.0-20220225172249-27dd8689420f/http2/frame.go:498 +0x95
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc006bfa1a0, 0x0?, 0x0?)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:611 +0xb2
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams(0xc00358f880, {0x4a972a8?, 0xc006bfa1a0})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:906 +0x142
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleRawConn.func1()
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:848 +0x46
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).handleRawConn
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:847 +0x185
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 57 [IO wait]:
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.runtime_pollWait(0x7ff2b5acca08, 0x72)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/netpoll.go:302 +0x89
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).wait(0xc00360e980?, 0xc006be2000?, 0x0)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:83 +0x32
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).waitRead(...)
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:88
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*FD).Read(0xc00360e980, {0xc006be2000, 0x8000, 0x8000})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_unix.go:167 +0x25a
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*netFD).Read(0xc00360e980, {0xc006be2000?, 0x42bef9b?, 0xc006bad200?})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/fd_posix.go:55 +0x29
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*conn).Read(0xc0036401b8, {0xc006be2000?, 0x0?, 0x0?})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/net.go:183 +0x45
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: bufio.(*Reader).Read(0xc0067b8d80, {0xc0035552a0, 0x9, 0x7a5df902?})
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/bufio/bufio.go:236 +0x1b4
2022-06-14 07:23:04.416 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadAtLeast({0x4a830c0, 0xc0067b8d80}, {0xc0035552a0, 0x9, 0x9}, 0x9)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:331 +0x9a
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadFull(...)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:350
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: golang.org/x/net/http2.readFrameHeader({0xc0035552a0?, 0x9?, 0xc0067c8ff0?}, {0x4a830c0?, 0xc0067b8d80?})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/golang.org/x/net@v0.0.0-20220225172249-27dd8689420f/http2/frame.go:237 +0x6e
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: golang.org/x/net/http2.(*Framer).ReadFrame(0xc003555260)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/golang.org/x/net@v0.0.0-20220225172249-27dd8689420f/http2/frame.go:498 +0x95
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc006bfa000, 0xc003699950?, 0x0?)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:611 +0xb2
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams(0xc00358f880, {0x4a972a8?, 0xc006bfa000})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:906 +0x142
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleRawConn.func1()
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:848 +0x46
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).handleRawConn
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:847 +0x185
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 60 [select]:
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc006bfa1a0)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:1131 +0x233
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc/internal/transport.NewServerTransport
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:341 +0x19f8
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 59 [select]:
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0067c9270, 0x1)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/controlbuf.go:407 +0x115
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0067b8fc0)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/controlbuf.go:534 +0x85
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.NewServerTransport.func2()
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:332 +0xc6
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc/internal/transport.NewServerTransport
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:329 +0x19b3
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 81 [select]:
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc0067c96d0, {0xc0000b7fc0, 0x5, 0x5})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:179 +0x90
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0067c96d0, {0xc0000b7fc0?, 0xc0000d2690?, 0xc006bbc6e0?})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:173 +0x16f
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc006baddd0, {0xc0000b7fc0?, 0xc006bbc758?, 0x818447?})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:485 +0x32
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadAtLeast({0x4a8ea60, 0xc006baddd0}, {0xc0000b7fc0, 0x5, 0x5}, 0x5)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:331 +0x9a
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadFull(...)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:350
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*Stream).Read(0xc006b2ca20, {0xc0000b7fc0, 0x5, 0x5})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:469 +0xa5
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*parser).recvMsg(0xc0000b7fb0, 0x400000)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:559 +0x47
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.recvAndDecompress(0x40d325?, 0xc006b2ca20, {0x0, 0x0}, 0x400000, 0x0, {0x0, 0x0})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:690 +0x66
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.recv(0x8?, {0x7ff2b5935228, 0x6fd7588}, 0x203001?, {0x0?, 0x0?}, {0x40dbb60, 0xc0067c9720}, 0x0?, 0x0, ...)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:756 +0x6e
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*serverStream).RecvMsg(0xc0067c44e0, {0x40dbb60?, 0xc0067c9720})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/stream.go:1583 +0x178
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin.(*gRPCBrokerStartStreamServer).Recv(0xc00675d580)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_broker.pb.go:167 +0x4c
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.(*gRPCBrokerServer).StartStream(0xc003699b60, {0x4a96ee0, 0xc00675d580})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_broker.go:84 +0x152
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin._GRPCBroker_StartStream_Handler({0x3b91260?, 0xc003699b60}, {0x4a95790?, 0xc0067c44e0})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_broker.pb.go:148 +0x9f
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processStreamingRPC(0xc00358f880, {0x4a972a8, 0xc006a89ba0}, 0xc006b2ca20, 0xc003699bf0, 0x6f8f8c0, 0x0)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1542 +0xedb
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc006a89ba0}, 0xc006b2ca20, 0x0)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1624 +0x9d6
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 56 [select]:
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc006bfa000)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:1131 +0x233
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc/internal/transport.NewServerTransport
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:341 +0x19f8
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 73 [select]:
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.(*grpcStdioServer).StreamStdio(0xc003663410, 0x3c49b20?, {0x4a96960, 0xc0069e9440})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_stdio.go:58 +0x11d
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin._GRPCStdio_StreamStdio_Handler({0x386c360?, 0xc003663410}, {0x4a95790, 0xc006a1d040})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_stdio.pb.go:185 +0xd0
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processStreamingRPC(0xc00358f880, {0x4a972a8, 0xc0069401a0}, 0xc003675320, 0xc003699da0, 0x6f8f8e0, 0x0)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1542 +0xedb
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc0069401a0}, 0xc003675320, 0x0)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1624 +0x9d6
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 42 [select]:
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc006b99f90, {0xc006b44790, 0x5, 0x5})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:179 +0x90
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc006b99f90, {0xc006b44790?, 0xc00003c228?, 0xc0036ba6e0?})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:173 +0x16f
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0067bdef0, {0xc006b44790?, 0xc0036ba758?, 0x818447?})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:485 +0x32
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadAtLeast({0x4a8ea60, 0xc0067bdef0}, {0xc006b44790, 0x5, 0x5}, 0x5)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:331 +0x9a
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadFull(...)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:350
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0036745a0, {0xc006b44790, 0x5, 0x5})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:469 +0xa5
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*parser).recvMsg(0xc006b44780, 0x400000)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:559 +0x47
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.recvAndDecompress(0x42e710?, 0xc0036745a0, {0x0, 0x0}, 0x400000, 0x0, {0x0, 0x0})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:690 +0x66
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.recv(0x8?, {0x7ff2b5935228, 0x6fd7588}, 0x203000?, {0x0?, 0x0?}, {0x40dbb60, 0xc000248550}, 0x80?, 0x0, ...)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:756 +0x6e
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*serverStream).RecvMsg(0xc006aec270, {0x40dbb60?, 0xc000248550})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/stream.go:1583 +0x178
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin.(*gRPCBrokerStartStreamServer).Recv(0xc006adcc00)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_broker.pb.go:167 +0x4c
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.(*gRPCBrokerServer).StartStream(0xc003699b60, {0x4a96ee0, 0xc006adcc00})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_broker.go:84 +0x152
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin._GRPCBroker_StartStream_Handler({0x3b91260?, 0xc003699b60}, {0x4a95790?, 0xc006aec270})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_broker.pb.go:148 +0x9f
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processStreamingRPC(0xc00358f880, {0x4a972a8, 0xc006bfa000}, 0xc0036745a0, 0xc003699bf0, 0x6f8f8c0, 0x0)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1542 +0xedb
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc006bfa000}, 0xc0036745a0, 0x0)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1624 +0x9d6
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 70 [select]:
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0068965a0, 0x1)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/controlbuf.go:407 +0x115
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc006898b40)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/controlbuf.go:534 +0x85
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.NewServerTransport.func2()
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:332 +0xc6
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc/internal/transport.NewServerTransport
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:329 +0x19b3
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 45 [select]:
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.(*grpcStdioServer).StreamStdio(0xc003663410, 0x3c49b20?, {0x4a96960, 0xc0068d46e0})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_stdio.go:58 +0x11d
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin._GRPCStdio_StreamStdio_Handler({0x386c360?, 0xc003663410}, {0x4a95790, 0xc006861e10})
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_stdio.pb.go:185 +0xd0
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processStreamingRPC(0xc00358f880, {0x4a972a8, 0xc006bfa1a0}, 0xc003674c60, 0xc003699da0, 0x6f8f8e0, 0x0)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1542 +0xedb
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc006bfa1a0}, 0xc003674c60, 0x0)
2022-06-14 07:23:04.417 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1624 +0x9d6
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 46 [runnable]:
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Table).buildHydrateConfigMap(0xc00363ef00)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/table.go:152 +0x4aa
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Table).initialiseHydrateConfigs(0xc00363ef00)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/table.go:106 +0x25
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Table).initialise(0xc00363ef00, 0xc00367c480)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/table.go:96 +0x305
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Plugin).initialiseTables(0xc00367c480, {0x4a93bb8?, 0xc0068e0900?})
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/plugin.go:309 +0x179
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Plugin).SetConnectionConfig(0xc00367c480, {0xc0003f6a55, 0x3}, {0xc006855740, 0x29})
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/plugin.go:136 +0x2db
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc.PluginServer.SetConnectionConfig({{}, {0x42fffb7, 0x14}, 0xc003662ff0, 0xc003662fd0, 0xc003662fe0}, 0xc003674d80?)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/pluginServer.go:73 +0x9f
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc/shared.(*GRPCServer).SetConnectionConfig(0x3dec420?, {0xc0068960a0?, 0x48fda6?}, 0x0?)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/shared/grpc.go:54 +0x24
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc/proto._WrapperPlugin_SetConnectionConfig_Handler({0x3c48a40?, 0xc003663440}, {0x4a93bb8, 0xc0068e0360}, 0xc00007e420, 0x0)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/proto/plugin_grpc.pb.go:179 +0x170
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processUnaryRPC(0xc00358f880, {0x4a972a8, 0xc006bfa1a0}, 0xc003674d80, 0xc003699e30, 0x6f970d8, 0x0)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1283 +0xcfd
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc006bfa1a0}, 0xc003674d80, 0x0)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1620 +0xa1b
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 47 [select]:
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc006896000, {0xc006b44b08, 0x5, 0x5})
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:179 +0x90
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc006896000, {0xc006b44b08?, 0xc00003d698?, 0xc006bb86e0?})
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:173 +0x16f
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0068e0150, {0xc006b44b08?, 0xc006bb8758?, 0x818447?})
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:485 +0x32
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadAtLeast({0x4a8ea60, 0xc0068e0150}, {0xc006b44b08, 0x5, 0x5}, 0x5)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:331 +0x9a
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadFull(...)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:350
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003674ea0, {0xc006b44b08, 0x5, 0x5})
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:469 +0xa5
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*parser).recvMsg(0xc006b44af8, 0x400000)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:559 +0x47
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.recvAndDecompress(0x0?, 0xc003674ea0, {0x0, 0x0}, 0x400000, 0x0, {0x0, 0x0})
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:690 +0x66
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.recv(0x8?, {0x7ff2b5935228, 0x6fd7588}, 0x203001?, {0x0?, 0x0?}, {0x40dbb60, 0xc006896050}, 0x0?, 0x0, ...)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:756 +0x6e
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*serverStream).RecvMsg(0xc006861d40, {0x40dbb60?, 0xc006896050})
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/stream.go:1583 +0x178
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin.(*gRPCBrokerStartStreamServer).Recv(0xc0068d4670)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_broker.pb.go:167 +0x4c
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.(*gRPCBrokerServer).StartStream(0xc003699b60, {0x4a96ee0, 0xc0068d4670})
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_broker.go:84 +0x152
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin._GRPCBroker_StartStream_Handler({0x3b91260?, 0xc003699b60}, {0x4a95790?, 0xc006861d40})
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_broker.pb.go:148 +0x9f
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processStreamingRPC(0xc00358f880, {0x4a972a8, 0xc006bfa1a0}, 0xc003674ea0, 0xc003699bf0, 0x6f8f8c0, 0x0)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1542 +0xedb
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc006bfa1a0}, 0xc003674ea0, 0x0)
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1624 +0x9d6
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 66 [select]:
2022-06-14 07:23:04.418 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0068962d0, 0x1)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/controlbuf.go:407 +0x115
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc006898780)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/controlbuf.go:534 +0x85
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.NewServerTransport.func2()
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:332 +0xc6
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc/internal/transport.NewServerTransport
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:329 +0x19b3
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 67 [select]:
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc006a89ba0)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:1131 +0x233
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc/internal/transport.NewServerTransport
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:341 +0x19f8
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 68 [IO wait]:
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.runtime_pollWait(0x7ff2b5acc738, 0x72)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/netpoll.go:302 +0x89
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).wait(0xc006ac3c00?, 0xc006952000?, 0x0)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:83 +0x32
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).waitRead(...)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:88
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*FD).Read(0xc006ac3c00, {0xc006952000, 0x8000, 0x8000})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_unix.go:167 +0x25a
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*netFD).Read(0xc006ac3c00, {0xc006952000?, 0x42bef9b?, 0xc00694e900?})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/fd_posix.go:55 +0x29
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*conn).Read(0xc0000bde00, {0xc006952000?, 0x0?, 0x0?})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/net.go:183 +0x45
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: bufio.(*Reader).Read(0xc006898720, {0xc006b48d60, 0x9, 0x844f19b0?})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/bufio/bufio.go:236 +0x1b4
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadAtLeast({0x4a830c0, 0xc006898720}, {0xc006b48d60, 0x9, 0x9}, 0x9)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:331 +0x9a
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadFull(...)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:350
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: golang.org/x/net/http2.readFrameHeader({0xc006b48d60?, 0x9?, 0xc006896320?}, {0x4a830c0?, 0xc006898720?})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/golang.org/x/net@v0.0.0-20220225172249-27dd8689420f/http2/frame.go:237 +0x6e
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: golang.org/x/net/http2.(*Framer).ReadFrame(0xc006b48d20)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/golang.org/x/net@v0.0.0-20220225172249-27dd8689420f/http2/frame.go:498 +0x95
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc006a89ba0, 0xc003699950?, 0x0?)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:611 +0xb2
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams(0xc00358f880, {0x4a972a8?, 0xc006a89ba0})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:906 +0x142
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleRawConn.func1()
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:848 +0x46
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).handleRawConn
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:847 +0x185
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 71 [select]:
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0069401a0)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:1131 +0x233
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc/internal/transport.NewServerTransport
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:341 +0x19f8
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 72 [IO wait]:
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.runtime_pollWait(0x7ff2b5acc648, 0x72)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/netpoll.go:302 +0x89
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).wait(0xc006ac3e00?, 0xc006a32000?, 0x0)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:83 +0x32
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).waitRead(...)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:88
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*FD).Read(0xc006ac3e00, {0xc006a32000, 0x8000, 0x8000})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_unix.go:167 +0x25a
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*netFD).Read(0xc006ac3e00, {0xc006a32000?, 0x42bef9b?, 0xc006a3a000?})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/fd_posix.go:55 +0x29
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*conn).Read(0xc0000bde18, {0xc006a32000?, 0x0?, 0x0?})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/net.go:183 +0x45
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: bufio.(*Reader).Read(0xc006898ae0, {0xc006b48e40, 0x9, 0x8bd75d5d?})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/bufio/bufio.go:236 +0x1b4
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadAtLeast({0x4a830c0, 0xc006898ae0}, {0xc006b48e40, 0x9, 0x9}, 0x9)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:331 +0x9a
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadFull(...)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:350
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: golang.org/x/net/http2.readFrameHeader({0xc006b48e40?, 0x9?, 0xc0068965f0?}, {0x4a830c0?, 0xc006898ae0?})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/golang.org/x/net@v0.0.0-20220225172249-27dd8689420f/http2/frame.go:237 +0x6e
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: golang.org/x/net/http2.(*Framer).ReadFrame(0xc006b48e00)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/golang.org/x/net@v0.0.0-20220225172249-27dd8689420f/http2/frame.go:498 +0x95
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0069401a0, 0xc003699950?, 0x0?)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:611 +0xb2
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams(0xc00358f880, {0x4a972a8?, 0xc0069401a0})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:906 +0x142
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleRawConn.func1()
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:848 +0x46
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).handleRawConn
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:847 +0x185
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 74 [semacquire]:
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: sync.runtime_SemacquireMutex(0x8b0e7f?, 0xc9?, 0xc00a0d5da8?)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/sema.go:71 +0x25
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: sync.(*Mutex).lockSlow(0xc0000980f0)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/sync/mutex.go:162 +0x165
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: sync.(*Mutex).Lock(...)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/sync/mutex.go:81
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: log.(*Logger).Output(0xc0000980f0, 0x61?, {0xc00a0d30a0, 0x61})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/log/log.go:176 +0x9c
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: log.Printf({0x444c7c1?, 0x633875?}, {0x0?, 0x32?, 0xc00a0d5d40?})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/log/log.go:351 +0x55
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*IgnoreConfig).DefaultTo(0xc0069501b0?, 0xc006950130?)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/ignore_error_config.go:45 +0x4e
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*HydrateConfig).initialise(0xc00a0cce40, 0xc0000f7a40)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/hydrate_config.go:59 +0x15c
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Table).initialiseHydrateConfigs(0xc0000f7a40)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/table.go:110 +0x7c
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Table).initialise(0xc0000f7a40, 0xc00367c480)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/table.go:96 +0x305
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Plugin).initialiseTables(0xc00367c480, {0x4a93bb8?, 0xc006a3ae40?})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/plugin.go:309 +0x179
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Plugin).SetConnectionConfig(0xc00367c480, {0xc0003f6c1d, 0x3}, {0xc006a22990, 0x29})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/plugin.go:136 +0x2db
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc.PluginServer.SetConnectionConfig({{}, {0x42fffb7, 0x14}, 0xc003662ff0, 0xc003662fd0, 0xc003662fe0}, 0xc003675440?)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/pluginServer.go:73 +0x9f
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc/shared.(*GRPCServer).SetConnectionConfig(0x3dec420?, {0xc0068969b0?, 0x48fda6?}, 0x46726f7272456572?)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/shared/grpc.go:54 +0x24
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc/proto._WrapperPlugin_SetConnectionConfig_Handler({0x3c48a40?, 0xc003663440}, {0x4a93bb8, 0xc006a3a990}, 0xc0068990e0, 0x0)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/proto/plugin_grpc.pb.go:179 +0x170
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processUnaryRPC(0xc00358f880, {0x4a972a8, 0xc0069401a0}, 0xc003675440, 0xc003699e30, 0x6f970d8, 0x0)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1283 +0xcfd
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc0069401a0}, 0xc003675440, 0x0)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1620 +0xa1b
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 75 [select]:
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc006896910, {0xc006b44f70, 0x5, 0x5})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:179 +0x90
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc006896910, {0xc006b44f70?, 0xc006938930?, 0xc006bbb6e0?})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:173 +0x16f
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc006a3a780, {0xc006b44f70?, 0xc006bbb758?, 0x818447?})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:485 +0x32
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadAtLeast({0x4a8ea60, 0xc006a3a780}, {0xc006b44f70, 0x5, 0x5}, 0x5)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:331 +0x9a
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadFull(...)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:350
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003675560, {0xc006b44f70, 0x5, 0x5})
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:469 +0xa5
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*parser).recvMsg(0xc006b44f60, 0x400000)
2022-06-14 07:23:04.419 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:559 +0x47
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.recvAndDecompress(0x0?, 0xc003675560, {0x0, 0x0}, 0x400000, 0x0, {0x0, 0x0})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:690 +0x66
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.recv(0x8?, {0x7ff2b5935228, 0x6fd7588}, 0x203001?, {0x0?, 0x0?}, {0x40dbb60, 0xc006896960}, 0x0?, 0x0, ...)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:756 +0x6e
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*serverStream).RecvMsg(0xc006a1cf70, {0x40dbb60?, 0xc006896960})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/stream.go:1583 +0x178
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin.(*gRPCBrokerStartStreamServer).Recv(0xc0069e93e0)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_broker.pb.go:167 +0x4c
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.(*gRPCBrokerServer).StartStream(0xc003699b60, {0x4a96ee0, 0xc0069e93e0})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_broker.go:84 +0x152
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin._GRPCBroker_StartStream_Handler({0x3b91260?, 0xc003699b60}, {0x4a95790?, 0xc006a1cf70})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_broker.pb.go:148 +0x9f
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processStreamingRPC(0xc00358f880, {0x4a972a8, 0xc0069401a0}, 0xc003675560, 0xc003699bf0, 0x6f8f8c0, 0x0)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1542 +0xedb
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc0069401a0}, 0xc003675560, 0x0)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1624 +0x9d6
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 98 [select]:
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.(*grpcStdioServer).StreamStdio(0xc003663410, 0x3c49b20?, {0x4a96960, 0xc006aaf460})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_stdio.go:58 +0x11d
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin._GRPCStdio_StreamStdio_Handler({0x386c360?, 0xc003663410}, {0x4a95790, 0xc006b341a0})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_stdio.pb.go:185 +0xd0
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processStreamingRPC(0xc00358f880, {0x4a972a8, 0xc006940d00}, 0xc0036759e0, 0xc003699da0, 0x6f8f8e0, 0x0)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1542 +0xedb
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc006940d00}, 0xc0036759e0, 0x0)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1624 +0x9d6
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 79 [select]:
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc006896cd0, 0x1)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/controlbuf.go:407 +0x115
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc006a46300)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/controlbuf.go:534 +0x85
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.NewServerTransport.func2()
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:332 +0xc6
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc/internal/transport.NewServerTransport
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:329 +0x19b3
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 80 [select]:
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc006940d00)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:1131 +0x233
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc/internal/transport.NewServerTransport
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:341 +0x19f8
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 97 [IO wait]:
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.runtime_pollWait(0x7ff2b5acc558, 0x72)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/netpoll.go:302 +0x89
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).wait(0xc006a44280?, 0xc009d98000?, 0x0)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:83 +0x32
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*pollDesc).waitRead(...)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_poll_runtime.go:88
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: internal/poll.(*FD).Read(0xc006a44280, {0xc009d98000, 0x8000, 0x8000})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/internal/poll/fd_unix.go:167 +0x25a
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*netFD).Read(0xc006a44280, {0xc009d98000?, 0x7ff2b5affd68?, 0xc006a60cd0?})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/fd_posix.go:55 +0x29
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: net.(*conn).Read(0xc0000bdea8, {0xc009d98000?, 0x0?, 0x0?})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/net/net.go:183 +0x45
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: bufio.(*Reader).Read(0xc006a462a0, {0xc006b491c0, 0x9, 0x8e20e819?})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/bufio/bufio.go:236 +0x1b4
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadAtLeast({0x4a830c0, 0xc006a462a0}, {0xc006b491c0, 0x9, 0x9}, 0x9)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:331 +0x9a
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadFull(...)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:350
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: golang.org/x/net/http2.readFrameHeader({0xc006b491c0?, 0x9?, 0xc006896d20?}, {0x4a830c0?, 0xc006a462a0?})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/golang.org/x/net@v0.0.0-20220225172249-27dd8689420f/http2/frame.go:237 +0x6e
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: golang.org/x/net/http2.(*Framer).ReadFrame(0xc006b49180)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/golang.org/x/net@v0.0.0-20220225172249-27dd8689420f/http2/frame.go:498 +0x95
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc006940d00, 0x8ab77a4d?, 0x6fa70c0?)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/http2_server.go:611 +0xb2
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams(0xc00358f880, {0x4a972a8?, 0xc006940d00})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:906 +0x142
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleRawConn.func1()
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:848 +0x46
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).handleRawConn
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:847 +0x185
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 99 [runnable]:
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: sync.runtime_SemacquireMutex(0xc009dd1578?, 0xd9?, 0xc009f75488?)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/runtime/sema.go:71 +0x25
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: sync.(*Mutex).lockSlow(0xc0000980f0)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/sync/mutex.go:162 +0x165
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: sync.(*Mutex).Lock(...)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/sync/mutex.go:81
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: log.(*Logger).Output(0xc0000980f0, 0x61?, {0xc009f7bf80, 0x61})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/log/log.go:176 +0x9c
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: log.Printf({0x444c7c1?, 0x633875?}, {0x0?, 0x25?, 0xc00a0d0dc0?})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/log/log.go:351 +0x55
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*IgnoreConfig).DefaultTo(0x43678be?, 0x14?)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/ignore_error_config.go:45 +0x4e
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*GetConfig).initialise(0xc003653e40, 0xc00367c180)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/get_config.go:48 +0x15f
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Table).initialise(0xc00367c180, 0xc00367c480)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/table.go:85 +0x2c9
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Plugin).initialiseTables(0xc00367c480, {0x4a93bb8?, 0xc006b0d8c0?})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/plugin.go:309 +0x179
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/plugin.(*Plugin).SetConnectionConfig(0xc00367c480, {0xc0003f6dad, 0x3}, {0xc006a23380, 0x29})
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/plugin/plugin.go:136 +0x2db
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc.PluginServer.SetConnectionConfig({{}, {0x42fffb7, 0x14}, 0xc003662ff0, 0xc003662fd0, 0xc003662fe0}, 0xc003675b00?)
2022-06-14 07:23:04.420 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/pluginServer.go:73 +0x9f
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc/shared.(*GRPCServer).SetConnectionConfig(0x3dec420?, {0xc0068970e0?, 0x48fda6?}, 0x0?)
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/shared/grpc.go:54 +0x24
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/turbot/steampipe-plugin-sdk/v3/grpc/proto._WrapperPlugin_SetConnectionConfig_Handler({0x3c48a40?, 0xc003663440}, {0x4a93bb8, 0xc006b0d410}, 0xc006a46a20, 0x0)
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/turbot/steampipe-plugin-sdk/v3@v3.2.0/grpc/proto/plugin_grpc.pb.go:179 +0x170
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processUnaryRPC(0xc00358f880, {0x4a972a8, 0xc006940d00}, 0xc003675b00, 0xc003699e30, 0x6f970d8, 0x0)
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1283 +0xcfd
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc006940d00}, 0xc003675b00, 0x0)
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1620 +0xa1b
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin: 
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin: goroutine 100 [select]:
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc006897040, {0xc006b45378, 0x5, 0x5})
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:179 +0x90
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc006897040, {0xc006b45378?, 0xc006938bd0?, 0xc006a5c6e0?})
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:173 +0x16f
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc006b0d2f0, {0xc006b45378?, 0xc006a5c758?, 0x818447?})
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:485 +0x32
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadAtLeast({0x4a8ea60, 0xc006b0d2f0}, {0xc006b45378, 0x5, 0x5}, 0x5)
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:331 +0x9a
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin: io.ReadFull(...)
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin:    /opt/hostedtoolcache/go/1.18.2/x64/src/io/io.go:350
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003675c20, {0xc006b45378, 0x5, 0x5})
2022-06-14 07:23:04.453 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/internal/transport/transport.go:469 +0xa5
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*parser).recvMsg(0xc006b45368, 0x400000)
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:559 +0x47
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.recvAndDecompress(0x6974706f5f706368?, 0xc003675c20, {0x0, 0x0}, 0x400000, 0x0, {0x0, 0x0})
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:690 +0x66
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.recv(0x8?, {0x7ff2b5935228, 0x6fd7588}, 0x203001?, {0x0?, 0x0?}, {0x40dbb60, 0xc006897090}, 0x205d45434152545b?, 0x0, ...)
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/rpc_util.go:756 +0x6e
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*serverStream).RecvMsg(0xc006b34270, {0x40dbb60?, 0xc006897090})
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/stream.go:1583 +0x178
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin.(*gRPCBrokerStartStreamServer).Recv(0xc006aaf500)
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_broker.pb.go:167 +0x4c
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin.(*gRPCBrokerServer).StartStream(0xc003699b60, {0x4a96ee0, 0xc006aaf500})
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/grpc_broker.go:84 +0x152
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin: github.com/hashicorp/go-plugin/internal/plugin._GRPCBroker_StartStream_Handler({0x3b91260?, 0xc003699b60}, {0x4a95790?, 0xc006b34270})
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/github.com/hashicorp/go-plugin@v1.4.4/internal/plugin/grpc_broker.pb.go:148 +0x9f
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).processStreamingRPC(0xc00358f880, {0x4a972a8, 0xc006940d00}, 0xc003675c20, 0xc003699bf0, 0x6f8f8c0, 0x0)
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1542 +0xedb
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).handleStream(0xc00358f880, {0x4a972a8, 0xc006940d00}, 0xc003675c20, 0x0)
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:1624 +0x9d6
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin: google.golang.org/grpc.(*Server).serveStreams.func1.2()
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:922 +0x98
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin: created by google.golang.org/grpc.(*Server).serveStreams.func1
2022-06-14 07:23:04.454 UTC [DEBUG] steampipe-plugin-aws.plugin:    /home/runner/go/pkg/mod/google.golang.org/grpc@v1.46.0/server.go:920 +0x28a
2022-06-14 07:23:04.454 UTC [ERROR] plugin process exited: path=/home/steampipe/.steampipe/plugins/hub.steampipe.io/plugins/turbot/aws@0.61.0/steampipe-plugin-aws.plugin pid=23595 error="exit status 2"

github-actions[bot] commented 2 years ago

'This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 30 days.'

chr-b commented 2 years ago

The problem still exists, even with plugin version 0.69.0.

e-gineer commented 2 years ago

Could you please try using CLI v0.16.1 with AWS plugin v0.75.1 @chr-b? There are significant changes in that combination (including memory management and a new Steampipe SDK V4.x) that may help 🤞

github-actions[bot] commented 2 years ago

'This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 30 days.'

github-actions[bot] commented 2 years ago

'This issue was closed because it has been stalled for 90 days with no activity.'

turbot / steampipe-plugin-aws

ERROR: failed to start plugin 'aws': error reading from server: EOF (SQLSTATE HV000) #1055