search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.11k stars 3.81k forks source link

roachtest: backupFixture/tpce/15GB/revision-history=true/aws failed #120583

Closed cockroach-teamcity closed 5 months ago

cockroach-teamcity commented 8 months ago

roachtest.backupFixture/tpce/15GB/revision-history=true/aws failed with artifacts on master @ 34caf9d2c267f95f6aef2713708806e6f14948d6:

(monitor.go:154).Wait: monitor failure: Workload context was not cancelled. Error returned by workload cmd: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/backupFixture/tpce/15GB/revision-history=true/aws/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for aws clusters

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-36756

msbutler commented 7 months ago

workload error for test fixture generator test

cockroach-teamcity commented 7 months ago

roachtest.backupFixture/tpce/15GB/revision-history=true/aws failed with artifacts on master @ 4a9385cacb82e7a8d6d37e5d9a26a6b7c845aab6:

(monitor.go:154).Wait: monitor failure: Workload context was not cancelled. Error returned by workload cmd: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/backupFixture/tpce/15GB/revision-history=true/aws/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for aws clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 7 months ago

roachtest.backupFixture/tpce/15GB/revision-history=true/aws failed with artifacts on master @ 2a5e231716c436781f12452d800651f51c6383b7:

(monitor.go:154).Wait: monitor failure: Workload context was not cancelled. Error returned by workload cmd: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/backupFixture/tpce/15GB/revision-history=true/aws/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for aws clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 7 months ago

roachtest.backupFixture/tpce/15GB/revision-history=true/aws failed with artifacts on master @ eb495cac325786ea3e148ee64d63bd73ed74701b:

(monitor.go:154).Wait: monitor failure: Workload context was not cancelled. Error returned by workload cmd: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/backupFixture/tpce/15GB/revision-history=true/aws/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for aws clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 7 months ago

roachtest.backupFixture/tpce/15GB/revision-history=true/aws failed with artifacts on master @ f117eea22dd7be380c7141cdf6cd7aba92dd9c70:

(monitor.go:154).Wait: monitor failure: Workload context was not cancelled. Error returned by workload cmd: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/backupFixture/tpce/15GB/revision-history=true/aws/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for aws clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 6 months ago

roachtest.backupFixture/tpce/15GB/revision-history=true/aws failed with artifacts on master @ c4ab095c4f65b9140661ed57adddc690b1e3ce3f:

(monitor.go:154).Wait: monitor failure: Workload context was not cancelled. Error returned by workload cmd: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/backupFixture/tpce/15GB/revision-history=true/aws/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for aws clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 6 months ago

roachtest.backupFixture/tpce/15GB/revision-history=true/aws failed with artifacts on master @ c4ab095c4f65b9140661ed57adddc690b1e3ce3f:

(monitor.go:154).Wait: monitor failure: Workload context was not cancelled. Error returned by workload cmd: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/backupFixture/tpce/15GB/revision-history=true/aws/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for aws clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 6 months ago

roachtest.backupFixture/tpce/15GB/revision-history=true/aws failed with artifacts on master @ 5d02bd9ff6b2bccecf6d43fc6cd647167b91f782:

(monitor.go:154).Wait: monitor failure: Workload context was not cancelled. Error returned by workload cmd: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/backupFixture/tpce/15GB/revision-history=true/aws/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for aws clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 6 months ago

roachtest.backupFixture/tpce/15GB/revision-history=true/aws failed with artifacts on master @ af3173a899e16af30d2ca9489d8c2c926c410121:

                                github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/backup_fixtures.go:421
                                main/pkg/cmd/roachtest/monitor.go:120
                                golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:78
                                src/runtime/asm_amd64.s:1695
    Error:          Received unexpected error:
                    cluster.Install: retryable infrastructure error: could not install [docker]: TRANSIENT_ERROR(install_flake): COMMAND_PROBLEM: exit status 100
                    (1) attached stack trace
                      -- stack trace:
                      | main.(*clusterImpl).Install
                      |     main/pkg/cmd/roachtest/cluster.go:2500
                      | [...repeated from below...]
                    Wraps: (2) cluster.Install
                    Wraps: (3) attached stack trace
                      -- stack trace:
                      | github.com/cockroachdb/cockroach/pkg/roachprod.Install.func1
                      |     github.com/cockroachdb/cockroach/pkg/roachprod/roachprod.go:863
                      | github.com/cockroachdb/cockroach/pkg/util/retry.WithMaxAttempts.func1
                      |     github.com/cockroachdb/cockroach/pkg/util/retry/retry.go:195
                      | github.com/cockroachdb/cockroach/pkg/util/retry.Options.Do
                      |     github.com/cockroachdb/cockroach/pkg/util/retry/retry.go:172
                      | github.com/cockroachdb/cockroach/pkg/util/retry.WithMaxAttempts
                      |     github.com/cockroachdb/cockroach/pkg/util/retry/retry.go:194
                      | github.com/cockroachdb/cockroach/pkg/roachprod.Install
                      |     github.com/cockroachdb/cockroach/pkg/roachprod/roachprod.go:858
                      | main.(*clusterImpl).Install
                      |     main/pkg/cmd/roachtest/cluster.go:2500
                      | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.initTPCESpec
                      |     github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/tpce.go:89
                      | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.tpceRestore.getSpec
                      |     github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/restore.go:757
                      | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.tpceRestore.run
                      |     github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/restore.go:776
                      | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*backupDriver).runWorkload
                      |     github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/backup_fixtures.go:213
                      | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerBackupFixtures.func1.2
                      |     github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/backup_fixtures.go:421
                      | main.(*monitorImpl).Go.func1
                      |     main/pkg/cmd/roachtest/monitor.go:120
                      | golang.org/x/sync/errgroup.(*Group).Go.func1
                      |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:78
                      | runtime.goexit
                      |     src/runtime/asm_amd64.s:1695
                    Wraps: (4) retryable infrastructure error: could not install [docker]
                    Wraps: (5) TRANSIENT_ERROR(install_flake): COMMAND_PROBLEM: exit status 100
                      | (1) TRANSIENT_ERROR(install_flake): COMMAND_PROBLEM: exit status 100
                      | Error types: (1) errors.TransientError
                    Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) errors.TransientError
    Test:           backupFixture/tpce/15GB/revision-history=true/aws
(require.go:1360).NoError: FailNow called
test artifacts and logs in: artifacts/backupFixture/tpce/15GB/revision-history=true/aws/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for aws clusters

This test on roachdash | Improve this report!

msbutler commented 5 months ago

skipped this, no plans to unskip it