search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
29.77k stars 3.76k forks source link

roachtest: schemachange/mixed-versions failed [existing descriptors that still need to be dropped] #126374

Closed cockroach-teamcity closed 3 weeks ago

cockroach-teamcity commented 2 months ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ b4402507fdebe5682f77e348331a308d378c91e1:

(mixedversion.go:620).Run: mixed-version test failure while running step 29 (run "run schemachange workload and validation after upgrade has finalized"): full command output in run_062129.401407601_n4_cockroach-debug-doct.log: COMMAND_PROBLEM: exit status 125
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #126065 roachtest: schemachange/mixed-versions failed [count-leases: column "crdb_region" does not exist] [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.1.23-rc] - #125379 roachtest: schemachange/mixed-versions failed [attempting to append refresh spans after the tracked timestamp has moved forward] [C-test-failure O-roachtest O-robot T-sql-queries branch-release-23.2]

/cc @cockroachdb/sql-foundations

This test on roachdash | Improve this report!

Jira issue: CRDB-39871

annrpom commented 2 months ago 
run_062129.401407601_n4_cockroach-debug-doct: 2024/06/28 06:21:29 cluster.go:2441: > ./cockroach debug doctor examine cluster --url {pgurl:3}
Examining 796 descriptors and 513 namespace entries...
Examining 1522 jobs...
job 981352223981273092: running schema change GC refers to missing table descriptor(s) [805]; existing descriptors that still need to be dropped [812]; job safe to delete: false.
ERROR: validation failed
Failed running "debug doctor examine cluster"
run_062129.401407601_n4_cockroach-debug-doct: 2024/06/28 06:21:30 cluster.go:2451: > result: COMMAND_PROBLEM: exit status 125
981352223981273092  legacy_payload  2024-06-28 06:15:31.686664+00   \x0a41474320666f722044524f50205441424c4520736368656d616368616e67652e736368656d615f77335f3237362e7461626c655f77345f323930204341534341444512046e6f646518b1a8dee5d2fd86033204a506ac06a001019a0210af163ac31b894039b46845d7f6153dffa202080818100118002000aa011e120d08a50610fdbfe9cdeacec5ee17120d08ac0610fdbfe9cdeacec5ee17
981352223981273092  legacy_progress 2024-06-28 06:15:31.745821+00   \x10c9ede1e5d2fd8603221377616974696e6720666f72204d564343204743a80182bcd1c589d0b2ca25820110120508a5061003120508ac0610032001
                                       jsonb_pretty
-------------------------------------------------------------------------------------------
  {
      "creationClusterId": "af163ac3-1b89-4039-b468-45d7f6153dff",
      "creationClusterVersion": {
          "majorVal": 24,
          "minorVal": 1
      },
      "description": "GC for DROP TABLE schemachange.schema_w3_276.table_w4_290 CASCADE",
      "descriptorIds": [
          805,
          812
      ],
      "noncancelable": true,
      "schemaChangeGC": {
          "tables": [
              {
                  "dropTime": "1719555331634913277",
                  "id": 805
              },
              {
                  "dropTime": "1719555331634913277",
                  "id": 812
              }
          ]
      },
      "startedMicros": "1719555331691569",
      "usernameProto": "node"
  }
(1 row)

this is also in crdb_internal.jobs

981352223981273092  SCHEMA CHANGE GC    GC for DROP TABLE schemachange.schema_w3_276.table_w4_290 CASCADE       node    {805,812}   running waiting for MVCC GC 2024-06-28 06:15:31.626234+00   2024-06-28 06:15:31.691569+00   NULL    2024-06-28 06:15:31.749577+00   0   NULL        4   2708011929623092738 2024-06-28 06:15:31.69157+00    2024-06-28 06:16:01.69157+00    1   NULL    NULL
annrpom commented 2 months ago

this is 812 still in system.descriptor:

812 "{""table"": {""columns"": [{""id"": 1, ""name"": ""value"", ""type"": {""family"": ""IntFamily"", ""oid"": 20, ""width"":
 64}}], ""createAsOfTime"": {""logical"": 1, ""wallTime"": ""1719555330632129841""}, ""formatVersion"": 3, ""id"": 812,
 ""modificationTime"": {}, ""name"": ""seq_w1_303"", ""nextColumnId"": 2, ""nextConstraintId"": 1, ""nextIndexId"": 2, 
""parentId"": 184, ""primaryIndex"": {""createdExplicitly"": true, ""encodingType"": 1, ""foreignKey"": {}, ""geoConfig"": 
{}, ""id"": 1, ""interleave"": {}, ""keyColumnDirections"": [""ASC""], ""keyColumnIds"": [1], ""keyColumnNames"": 
[""value""], ""name"": ""primary"", ""partitioning"": {}, ""sharded"": {}, ""unique"": true, ""version"": 4}, ""privileges"": 
{""ownerProto"": ""roachprod"", ""users"": [{""privileges"": ""2"", ""userProto"": ""admin"", ""withGrantOption"": ""2""}, 
{""privileges"": ""2"", ""userProto"": ""root"", ""withGrantOption"": ""2""}], ""version"": 3}, ""replacementOf"": 
{""time"": {}}, ""sequenceOpts"": {""cacheSize"": ""1"", ""increment"": ""1"", ""maxValue"": ""9223372036854775807"", 
""minValue"": ""1"", ""sequenceOwner"": {""ownerColumnId"": 2, ""ownerTableId"": 805}, ""start"": ""1""}, ""state"": 
""DROP"", ""unexposedParentSchemaId"": 189, ""version"": ""3""}}"
rafiss commented 1 month ago

Is is possible that the validation from debug doctor is too strict? If the schema change GC job is still running, then it should eventually delete that descriptor (812).

annrpom commented 1 month ago

@rafiss that's true -- i can make a change so that the validation doesnt spew out for gc jobs still running

cockroach-teamcity commented 1 month ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 485975b3a824c68c07340e6a336c7864c00d3c6d:

(mixedversion.go:620).Run: mixed-version test failure while running step 15 (run "run schemachange workload and validation in mixed version"): full command output in run_061324.892019417_n4_COCKROACHRANDOMSEED8.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #126784 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.1 release-blocker] - #125379 roachtest: schemachange/mixed-versions failed [attempting to append refresh spans after the tracked timestamp has moved forward] [C-test-failure O-roachtest O-robot T-sql-queries branch-release-23.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 485975b3a824c68c07340e6a336c7864c00d3c6d:

(mixedversion.go:620).Run: mixed-version test failure while running step 8 (run "run schemachange workload and validation in mixed version"): full command output in run_060831.137849600_n4_COCKROACHRANDOMSEED1.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #126784 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.1 release-blocker] - #125379 roachtest: schemachange/mixed-versions failed [attempting to append refresh spans after the tracked timestamp has moved forward] [C-test-failure O-roachtest O-robot T-sql-queries branch-release-23.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 485975b3a824c68c07340e6a336c7864c00d3c6d:

(mixedversion.go:620).Run: mixed-version test failure while running step 6 (run "run schemachange workload and validation in mixed version"): full command output in run_061245.321594362_n4_COCKROACHRANDOMSEED1.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #126784 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.1 release-blocker] - #125379 roachtest: schemachange/mixed-versions failed [attempting to append refresh spans after the tracked timestamp has moved forward] [C-test-failure O-roachtest O-robot T-sql-queries branch-release-23.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 6b22014dec8c5e8e6006d710ed05bab5b01b4ae2:

(mixedversion.go:620).Run: mixed-version test failure while running step 7 (run "run schemachange workload and validation in mixed version"): full command output in run_060619.941900079_n4_COCKROACHRANDOMSEED1.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #126784 roachtest: schemachange/mixed-versions failed [descriptor ID generator unavailable, migration in progress, retry later] [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.1] - #125379 roachtest: schemachange/mixed-versions failed [attempting to append refresh spans after the tracked timestamp has moved forward] [C-test-failure O-roachtest O-robot T-sql-queries branch-release-23.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 month ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 6b22014dec8c5e8e6006d710ed05bab5b01b4ae2:

(mixedversion.go:620).Run: mixed-version test failure while running step 12 (run "run schemachange workload and validation in mixed version"): full command output in run_061008.097493023_n4_COCKROACHRANDOMSEED8.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #126784 roachtest: schemachange/mixed-versions failed [descriptor ID generator unavailable, migration in progress, retry later] [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.1] - #125379 roachtest: schemachange/mixed-versions failed [attempting to append refresh spans after the tracked timestamp has moved forward] [C-test-failure O-roachtest O-robot T-sql-queries branch-release-23.2]

This test on roachdash | Improve this report!

renatolabs commented 1 month ago

Quick note in case this was missed: this test has another failure mode other than the one in the issue title (see failure above as an example):

 "message": "***UNEXPECTED ERROR; Received an unexpected execution error.: ERROR: vector not supported until version 24.2 (SQLSTATE 0A000)",
cockroach-teamcity commented 1 month ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 0b918d1dc3a9ce1f04975202be3b04ec375a816e:

(mixedversion.go:620).Run: mixed-version test failure while running step 15 (run "run schemachange workload and validation in mixed version"): full command output in run_060714.747222088_n4_COCKROACHRANDOMSEED5.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #126883 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.1] - #126784 roachtest: schemachange/mixed-versions failed [descriptor ID generator unavailable, migration in progress, retry later] [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-23.1] - #125379 roachtest: schemachange/mixed-versions failed [attempting to append refresh spans after the tracked timestamp has moved forward] [C-test-failure O-roachtest O-robot T-sql-queries branch-release-23.2]

This test on roachdash | Improve this report!

renatolabs commented 1 month ago

Quick note in case this was missed: this test has another failure mode other than the one in the issue title (see failure above as an example):

 "message": "***UNEXPECTED ERROR; Received an unexpected execution error.: ERROR: vector not supported until version 24.2 (SQLSTATE 0A000)",

Forgot to mention that this particular issue can fail in CI as well (example).

rafiss commented 1 month ago

Thanks for pointing that out. https://github.com/cockroachdb/cockroach/pull/126955 addresses the pgvector failure, so I've resolved those comments, and leaving this open for the original issue.

cockroach-teamcity commented 1 month ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 7c29b0c71f3ee8ccc436b5f039955bf6d2add914:

(mixedversion.go:645).Run: mixed-version test failure while running step 21 (run "run schemachange workload and validation in mixed version"): full command output in run_061517.575499723_n4_cockroach-debug-doct.log: COMMAND_PROBLEM: exit status 125
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #127320 roachtest: schemachange/mixed-versions failed [expected FK violation error, but did not receive one] [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2] - #126883 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 78fa126dfc749e620c28531c1659e35bf98034ec:

(mixedversion.go:682).Run: mixed-version test failure while running step 14 (run "run schemachange workload and validation in mixed version"): full command output in run_065431.579143166_n4_COCKROACHRANDOMSEED2.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #128093 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.2] - #127320 roachtest: schemachange/mixed-versions failed [unexpected unique constraint violation] [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-24.2] - #126883 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 78fa126dfc749e620c28531c1659e35bf98034ec:

(mixedversion.go:682).Run: mixed-version test failure while running step 7 (run "run schemachange workload and validation in mixed version"): full command output in run_071422.482055052_n4_COCKROACHRANDOMSEED5.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #128093 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.2] - #127320 roachtest: schemachange/mixed-versions failed [unexpected unique constraint violation] [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-24.2] - #126883 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 356e1cc24a67d7e9a1e637b98d1664794f70fa03:

(mixedversion.go:682).Run: mixed-version test failure while running step 12 (run "run schemachange workload and validation in mixed version"): full command output in run_060501.736444909_n4_COCKROACHRANDOMSEED7.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #128093 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.2] - #127320 roachtest: schemachange/mixed-versions failed [unexpected unique constraint violation] [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-24.2] - #126883 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 356e1cc24a67d7e9a1e637b98d1664794f70fa03:

(mixedversion.go:682).Run: mixed-version test failure while running step 8 (run "run schemachange workload and validation in mixed version"): full command output in run_073531.420381534_n4_COCKROACHRANDOMSEED7.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #128093 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.2] - #127320 roachtest: schemachange/mixed-versions failed [unexpected unique constraint violation] [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-24.2] - #126883 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ a0a52309cbbe5cb68d576fb366411fa7d7cf3574:

(mixedversion.go:682).Run: mixed-version test failure while running step 13 (run "run schemachange workload and validation in mixed version"): full command output in run_064341.020249576_n4_COCKROACHRANDOMSEED7.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #128093 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.2] - #127320 roachtest: schemachange/mixed-versions failed [unexpected unique constraint violation] [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-24.2] - #126883 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ a0a52309cbbe5cb68d576fb366411fa7d7cf3574:

(mixedversion.go:682).Run: mixed-version test failure while running step 7 (run "run schemachange workload and validation in mixed version"): full command output in run_065441.071717233_n4_COCKROACHRANDOMSEED3.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #128093 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.2] - #127320 roachtest: schemachange/mixed-versions failed [unexpected unique constraint violation] [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-24.2] - #126883 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 5f7709cf41a3996c4bfd7eae1e231e75b024db47:

(mixedversion.go:682).Run: mixed-version test failure while running step 20 (run "run schemachange workload and validation in mixed version"): full command output in run_071053.238617923_n4_COCKROACHRANDOMSEED3.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #128093 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.2] - #127320 roachtest: schemachange/mixed-versions failed [unexpected unique constraint violation] [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-24.2] - #126883 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ dbc62db07a1f149d305cff463b350588086f1b08:

(mixedversion.go:682).Run: mixed-version test failure while running step 24 (run "run schemachange workload and validation in mixed version"): full command output in run_070548.578889221_n4_COCKROACHRANDOMSEED3.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #128093 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.2] - #127320 roachtest: schemachange/mixed-versions failed [unexpected unique constraint violation] [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-24.2] - #126883 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 7917e91eadb2f622faadf635a3e13c384e42070e:

(mixedversion.go:694).Run: mixed-version test failure while running step 18 (run "run schemachange workload and validation in mixed version"): full command output in run_070844.779346845_n4_COCKROACHRANDOMSEED3.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #128438 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.1 release-blocker] - #128093 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-23.2] - #127320 roachtest: schemachange/mixed-versions failed [unexpected unique constraint violation] [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-24.2] - #126883 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 7917e91eadb2f622faadf635a3e13c384e42070e:

(mixedversion.go:694).Run: mixed-version test failure while running step 10 (run "run schemachange workload and validation in mixed version"): full command output in run_073440.586129166_n4_COCKROACHRANDOMSEED1.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #128438 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.1 release-blocker] - #128093 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-23.2] - #127320 roachtest: schemachange/mixed-versions failed [unexpected unique constraint violation] [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-24.2] - #126883 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.1]

This test on roachdash | Improve this report!

blathers-crl[bot] commented 3 weeks ago

Based on the specified backports for linked PR #127865, I applied the following new label(s) to this issue: branch-release-23.1, branch-release-23.2, branch-release-24.1, branch-release-24.2. Please adjust the labels as needed to match the branches actually affected by this issue, including adding any known older branches.

:owl: Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.