cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
29.87k stars 3.77k forks source link

roachtest: schemachange/mixed-versions failed [index contains stored column "" with unknown ID 0] #129395

Open cockroach-teamcity opened 3 weeks ago

cockroach-teamcity commented 3 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ f1a5aa8a633636138fededdf46a8dcc20f899a48:

(mixedversion.go:710).Run: mixed-version test failure while running step 22 (run "run schemachange workload and validation in mixed version"): full command output in run_091011.234416824_n4_COCKROACHRANDOMSEED3.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #129308 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.1.4-rc] - #129303 roachtest: schemachange/mixed-versions failed [computed column cannot reference a foreign key] [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-24.2] - #129104 roachtest: schemachange/mixed-versions failed [pg_lsn in mixed version] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-23.2.10-rc]

/cc @cockroachdb/sql-foundations

This test on roachdash | Improve this report!

Jira issue: CRDB-41520

rafiss commented 3 weeks ago
{
 "workerId": 4,
 "clientTimestamp": "09:10:53.727297",
 "ops": [
  "BEGIN",
  {
   "sql": "CREATE INDEX index_w0_112_w4_613 ON public.table_w0_112 (col112_w0_116, col112_w0_114, \"co\tl1̏12 _w0_113\") STORING (\"co\\\\U0000B125l112_w0_115\", \"co'l112_w0_117\", col11😮2_w0_118)",
   "expectedExecErr": "42701"
  }
 ],
 "expectedExecErrors": "42701",
 "expectedCommitErrors": "",
 "message": "***UNEXPECTED ERROR; Received an unexpected execution error.: ERROR: error executing StatementPhase stage 1 of 1 with 15 MutationType ops: relation \"table_w0_112\" (253): index \"index_w0_112_w4_613\" contains stored column \"\" with unknown ID 0 (SQLSTATE XXUUU)",
 "errorState": {
  "expectedErrors": [
   "42701"
  ],

table definition is

   "sql": "CREATE TABLE IF NOT EXISTS public.table_w0_112 (\"co\tl1̏12 _w0_113\" STRING COLLATE en_US NOT NULL, col112_w0_114 JSONB NOT NULL, \"co\\\\U0000B125l112_w0_115\" STRING COLLATE en_US NOT NULL, col112_w0_116 CHAR, \"co'l112_w0_117\" NAME NULL, col11😮2_w0_118 STRING NOT NULL AS (lower(CAST(\"co\\\\U0000B125l112_w0_115\" AS STRING))) STORED, PRIMARY KEY (\"co\\\\U0000B125l112_w0_115\" ASC), INVERTED INDEX (col112_w0_116, \"co\\\\U0000B125l112_w0_115\", col11😮2_w0_118 gin_trgm_ops ASC), INDEX (\"co\tl1̏12 _w0_113\" DESC), INDEX (col112_w0_114 ASC), UNIQUE (col11😮2_w0_118, col112_w0_114 DESC), INDEX (col11😮2_w0_118 DESC) VISIBILITY 0.06, INDEX (\"co\\\\U0000B125l112_w0_115\" DESC, col112_w0_116 ASC, lower(CAST(\"co\tl1̏12 _w0_113\" AS STRING)) DESC), UNIQUE (col11😮2_w0_118 DESC) STORING (\"co\tl1̏12 _w0_113\", col112_w0_114, \"co'l112_w0_117\"), INDEX (col11😮2_w0_118 DESC), UNIQUE (lower(col112_w0_116)))"

fixed by https://github.com/cockroachdb/cockroach/pull/128240, but that doesn't yet appear in a 24.2 release, so this mixed-version test is hitting the old buggy behavior.

cockroach-teamcity commented 3 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 18c4e23306bb99cc28c83bb3e5726f6f4279b798:

(mixedversion.go:710).Run: mixed-version test failure while running step 11 (run "run schemachange workload and validation in mixed version"): full command output in run_114157.173928783_n4_COCKROACHRANDOMSEED8.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #129460 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2 release-blocker] - #129458 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-23.2 release-blocker] - #129308 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.1.4-rc] - #129104 roachtest: schemachange/mixed-versions failed [pg_lsn in mixed version] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-23.2.10-rc]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ a8f64695f5d025a3347c27ed03ee0e36fbdaacd3:

(mixedversion.go:710).Run: mixed-version test failure while running step 7 (run "run schemachange workload and validation in mixed version"): full command output in run_064726.902607199_n4_COCKROACHRANDOMSEED5.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #129535 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2.1-rc release-blocker] - #129460 roachtest: schemachange/mixed-versions failed ["show cluster setting version" timed out: value differs between local setting and KV] [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2 release-blocker] - #129308 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.1.4-rc] - #129104 roachtest: schemachange/mixed-versions failed [pg_lsn in mixed version] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-23.2.10-rc]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 9e48858c6c8b22af4ec1159bcff6e233e7bfddff:

(mixedversion.go:710).Run: mixed-version test failure while running step 26 (run "run schemachange workload and validation after upgrade has finalized"): full command output in run_072022.384529363_n4_COCKROACHRANDOMSEED2.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #129535 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2.1-rc release-blocker] - #129460 roachtest: schemachange/mixed-versions failed ["show cluster setting version" timed out: value differs between local setting and KV] [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2 release-blocker] - #129308 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.1.4-rc] - #129104 roachtest: schemachange/mixed-versions failed [pg_lsn in mixed version] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-23.2.10-rc]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 9e48858c6c8b22af4ec1159bcff6e233e7bfddff:

(mixedversion.go:710).Run: mixed-version test failure while running step 13 (run "run schemachange workload and validation in mixed version"): full command output in run_064359.288895260_n4_COCKROACHRANDOMSEED8.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #129535 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2.1-rc release-blocker] - #129460 roachtest: schemachange/mixed-versions failed ["show cluster setting version" timed out: value differs between local setting and KV] [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2 release-blocker] - #129308 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.1.4-rc] - #129104 roachtest: schemachange/mixed-versions failed [pg_lsn in mixed version] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-23.2.10-rc]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 weeks ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 6866fbf2dd02a298362f888ee9dc95cb19709d3f:

(mixedversion.go:710).Run: mixed-version test failure while running step 18 (run "run schemachange workload and validation in mixed version"): full command output in run_060838.413114988_n4_COCKROACHRANDOMSEED6.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #129535 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2.1-rc release-blocker] - #129460 roachtest: schemachange/mixed-versions failed ["show cluster setting version" timed out: value differs between local setting and KV] [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2 release-blocker] - #129308 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.1.4-rc] - #129104 roachtest: schemachange/mixed-versions failed [pg_lsn in mixed version] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-23.2.10-rc]

This test on roachdash | Improve this report!

rafiss commented 2 weeks ago

latest failure is

Error: ***UNEXPECTED ERROR; Received an unexpected execution error.: ERROR: column "nan" does not exist (SQLSTATE 42703)

it's fixed by https://github.com/cockroachdb/cockroach/pull/129087, but that needs to appear in a predecessor patch version to fix this mixed-version test.

cockroach-teamcity commented 1 week ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 8551145a0c99c4c95a28ec470e699d0c20ca97ab:

(mixedversion.go:710).Run: mixed-version test failure while running step 14 (run "run schemachange workload and validation in mixed version"): full command output in run_062910.087079452_n4_COCKROACHRANDOMSEED6.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #129535 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.2.1-rc] - #129308 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.1.4-rc] - #129104 roachtest: schemachange/mixed-versions failed [pg_lsn in mixed version] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-23.2.10-rc]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 8551145a0c99c4c95a28ec470e699d0c20ca97ab:

(mixedversion.go:710).Run: mixed-version test failure while running step 18 (run "run schemachange workload and validation in mixed version"): full command output in run_073508.306106308_n4_COCKROACHRANDOMSEED4.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #129535 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.2.1-rc] - #129308 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.1.4-rc] - #129104 roachtest: schemachange/mixed-versions failed [pg_lsn in mixed version] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-23.2.10-rc]

This test on roachdash | Improve this report!

cockroach-teamcity commented 4 days ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ fa9c0528fc0d06be1b4cfc534ec0501448111fbe:

(mixedversion.go:710).Run: mixed-version test failure while running step 29 (run "run schemachange workload and validation after upgrade has finalized"): full command output in run_064238.971315577_n4_COCKROACHRANDOMSEED7.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #130278 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2 release-blocker] - #129535 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.2.1-rc] - #129308 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.1.4-rc] - #129104 roachtest: schemachange/mixed-versions failed [pg_lsn in mixed version] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-23.2.10-rc]

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 days ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 00edd9c46e7f3638846d0dc182a9dd50a0aa9cbc:

(mixedversion.go:710).Run: mixed-version test failure while running step 19 (run "run schemachange workload and validation in mixed version"): full command output in run_065647.235482212_n4_COCKROACHRANDOMSEED3.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #130278 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2 release-blocker] - #129535 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.2.1-rc] - #129308 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.1.4-rc] - #129104 roachtest: schemachange/mixed-versions failed [pg_lsn in mixed version] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-23.2.10-rc]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 days ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 7571549d8772a087ab4577d1e770e02582ba5877:

(mixedversion.go:710).Run: mixed-version test failure while running step 24 (run "run schemachange workload and validation in mixed version"): full command output in run_074327.204128071_n4_COCKROACHRANDOMSEED6.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #130278 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2 release-blocker] - #129535 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.2.1-rc] - #129308 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.1.4-rc] - #129104 roachtest: schemachange/mixed-versions failed [pg_lsn in mixed version] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-23.2.10-rc]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 days ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 7571549d8772a087ab4577d1e770e02582ba5877:

(mixedversion.go:710).Run: mixed-version test failure while running step 18 (run "run schemachange workload and validation in mixed version"): full command output in run_082220.357558837_n4_COCKROACHRANDOMSEED8.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #130278 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2 release-blocker] - #129535 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.2.1-rc] - #129308 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.1.4-rc] - #129104 roachtest: schemachange/mixed-versions failed [pg_lsn in mixed version] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-23.2.10-rc]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 day ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 1b0a374fd2a101cebcfb24cff4b3b57795ad1df6:

(mixedversion.go:710).Run: mixed-version test failure while running step 12 (run "run schemachange workload and validation in mixed version"): full command output in run_071931.465008601_n4_COCKROACHRANDOMSEED7.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #130278 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2] - #129535 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.2.1-rc] - #129308 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.1.4-rc] - #129104 roachtest: schemachange/mixed-versions failed [pg_lsn in mixed version] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-23.2.10-rc]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 day ago

roachtest.schemachange/mixed-versions failed with artifacts on master @ 1b0a374fd2a101cebcfb24cff4b3b57795ad1df6:

(mixedversion.go:710).Run: mixed-version test failure while running step 15 (run "run schemachange workload and validation in mixed version"): full command output in run_082730.549410988_n4_COCKROACHRANDOMSEED4.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

- #130278 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot T-sql-foundations branch-release-24.2] - #129535 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.2.1-rc] - #129308 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.1.4-rc] - #129104 roachtest: schemachange/mixed-versions failed [pg_lsn in mixed version] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-23.2.10-rc]

This test on roachdash | Improve this report!