search

nextstrain / status

Nextstrain status pages
https://nextstrain.github.io/status/
1 stars 0 forks source link

CI: steampipe hangs on schemas #5

Open joverlee521 opened 3 months ago

joverlee521 commented 3 months ago

I've gotten alerts of the CI failing after https://github.com/nextstrain/status/pull/4. Seems like the CI jobs intermittently hangs on steampipe schemas:

They all had similar logs that show Waiting for Steampipe plugin schemas to be ready… until the job times out at GitHub Action's 6hr limit. 

mkdir -p build
./steampipe-psql --quiet --no-psqlrc --no-align --tuples-only --set=ON_ERROR_STOP= < pathogen-workflows.sql > build/pathogen-workflows.json
Using PGHOST=localhost PGPORT=9193 PGUSER=steampipe PGDATABASE=steampipe
Steampipe Postgres service not available; starting it…
Steampipe service is running:

Database:

  Host(s):            127.0.0.1, ::1, localhost
  Port:               9193
  Database:           steampipe
  User:               steampipe
  Password:           ********* [use --show-password to reveal]
  Connection string:  postgres://steampipe@127.0.0.1:9193/steampipe

Managing the Steampipe service:

  # Get status of the service
  steampipe service status

  # View database password for connecting from another machine
  steampipe service status --show-password

  # Restart the service
  steampipe service restart

  # Stop the service
  steampipe service stop

Waiting for Steampipe plugin schemas to be ready…
Waiting for Steampipe plugin schemas to be ready…
Waiting for Steampipe plugin schemas to be ready…
Waiting for Steampipe plugin schemas to be ready…
Waiting for Steampipe plugin schemas to be ready…
(...)
Error: The operation was canceled.
joverlee521 commented 2 months ago

Haven't seen this issue since a run on April 2, maybe it's no longer an issue 🤞

joverlee521 commented 2 months ago

Damn, I might have jinxed it (hanging workflow). I shouldn't have said anything.

tsibley commented 2 months ago

Odd. As a workaround for now, we could impose a workflow/job timeout of 10 minutes? 20 minutes? or similar and not let things hang for 6 hours.