cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.15k stars 3.81k forks source link

kv/kvserver/batcheval: TestLeaseTransferWithPipelinedWrite failed #86935

Closed cockroach-teamcity closed 2 years ago

cockroach-teamcity commented 2 years ago

kv/kvserver/batcheval.TestLeaseTransferWithPipelinedWrite failed with artifacts on master @ 82e2a30c5be8046dead49348722a2429d5c29290:

=== RUN   TestLeaseTransferWithPipelinedWrite
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/8b7adba2afa4d2ee9e34e55bcb54994d/logTestLeaseTransferWithPipelinedWrite1276569923
    test_log_scope.go:79: use -show-logs to present logs inline
    cmd_lease_test.go:116: worker failed: pq: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_ASYNC_WRITE_FAILURE - missing intent on: /Table/154/1/0/2/0): "sql txn" meta={id=d3637b9c key=/Table/154/1/0/1/0 pri=0.01114607 epo=0 ts=1661498115.920796648,0 min=1661498115.920796648,0 seq=3} lock=true stat=PENDING rts=1661498115.920796648,0 wto=false gul=1661498116.420796648,0
    panic.go:500: -- test log scope end --
--- FAIL: TestLeaseTransferWithPipelinedWrite (48.04s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

/cc @cockroachdb/kv

This test on roachdash | Improve this report!

Jira issue: CRDB-19042

cockroach-teamcity commented 2 years ago

kv/kvserver/batcheval.TestLeaseTransferWithPipelinedWrite failed with artifacts on master @ 770ff3c545a51752490403da64d56fb397f49c5e:

=== RUN   TestLeaseTransferWithPipelinedWrite
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/8b7adba2afa4d2ee9e34e55bcb54994d/logTestLeaseTransferWithPipelinedWrite3785928723
    test_log_scope.go:79: use -show-logs to present logs inline
    cmd_lease_test.go:116: worker failed: pq: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_ASYNC_WRITE_FAILURE - missing intent on: /Table/178/1/0/1/0): "sql txn" meta={id=3428f6ff key=/Table/178/1/0/1/0 pri=0.00761696 epo=0 ts=1661583874.237597903,0 min=1661583874.237597903,0 seq=3} lock=true stat=PENDING rts=1661583874.237597903,0 wto=false gul=1661583874.737597903,0
    panic.go:500: -- test log scope end --
--- FAIL: TestLeaseTransferWithPipelinedWrite (76.07s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

kv/kvserver/batcheval.TestLeaseTransferWithPipelinedWrite failed with artifacts on master @ 40455917fd24dce339fa63fc837f796d16f3497e:

=== RUN   TestLeaseTransferWithPipelinedWrite
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/8b7adba2afa4d2ee9e34e55bcb54994d/logTestLeaseTransferWithPipelinedWrite2894662229
    test_log_scope.go:79: use -show-logs to present logs inline
    cmd_lease_test.go:116: worker failed: pq: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_ASYNC_WRITE_FAILURE - missing intent on: /Table/165/1/0/2/0): "sql txn" meta={id=9ded0f51 key=/Table/165/1/0/1/0 pri=0.01977687 epo=0 ts=1661670864.201692212,0 min=1661670864.201692212,0 seq=3} lock=true stat=PENDING rts=1661670864.201692212,0 wto=false gul=1661670864.701692212,0
    panic.go:500: -- test log scope end --
--- FAIL: TestLeaseTransferWithPipelinedWrite (64.09s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

kv/kvserver/batcheval.TestLeaseTransferWithPipelinedWrite failed with artifacts on master @ 40455917fd24dce339fa63fc837f796d16f3497e:

=== RUN   TestLeaseTransferWithPipelinedWrite
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/8b7adba2afa4d2ee9e34e55bcb54994d/logTestLeaseTransferWithPipelinedWrite1387475072
    test_log_scope.go:79: use -show-logs to present logs inline
    cmd_lease_test.go:116: worker failed: pq: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_ASYNC_WRITE_FAILURE - missing intent on: /Table/113/1/0/1/0): "sql txn" meta={id=2ab4297b key=/Table/113/1/0/1/0 pri=0.00119107 epo=0 ts=1661673253.081613420,0 min=1661673253.081613420,0 seq=3} lock=true stat=PENDING rts=1661673253.081613420,0 wto=false gul=1661673253.581613420,0
    panic.go:500: -- test log scope end --
--- FAIL: TestLeaseTransferWithPipelinedWrite (61.35s)

Parameters: TAGS=bazel,gss

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

kv/kvserver/batcheval.TestLeaseTransferWithPipelinedWrite failed with artifacts on master @ 3b16435371a43d603d193a1e2b480a23fba3f07a:

=== RUN   TestLeaseTransferWithPipelinedWrite
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/8b7adba2afa4d2ee9e34e55bcb54994d/logTestLeaseTransferWithPipelinedWrite1874104512
    test_log_scope.go:79: use -show-logs to present logs inline
    cmd_lease_test.go:116: worker failed: pq: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_ASYNC_WRITE_FAILURE - missing intent on: /Table/142/1/0/1/0): "sql txn" meta={id=810f474f key=/Table/142/1/0/1/0 pri=0.00938722 epo=0 ts=1661756851.868550934,0 min=1661756851.868550934,0 seq=3} lock=true stat=PENDING rts=1661756851.868550934,0 wto=false gul=1661756852.368550934,0
    panic.go:500: -- test log scope end --
--- FAIL: TestLeaseTransferWithPipelinedWrite (41.39s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

This test on roachdash | Improve this report!

nvanbenschoten commented 2 years ago

Stressed for an hour with roachstress without hitting a failure. The failure pattern here looks like transient flakiness that has since been resolved, so closing for now.