search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.19k stars 3.82k forks source link

roachtest: schemachange/mixed-versions failed ["parent schema is dropped" error while running helper query] #136065

Open cockroach-teamcity opened 5 days ago

cockroach-teamcity commented 5 days ago

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.schemachange/mixed-versions failed with artifacts on release-24.3.0-rc @ ef2ebe96f3a26fd6d6716e2ec4a0c8c6fe0fb567:

(mixedversion.go:732).Run: mixed-version test failure while running step 23 (run "run schemachange workload and validation in mixed version"): full command output in run_084248.262736819_n4_COCKROACHRANDOMSEED5.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #135798 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-master] - #134636 roachtest: schemachange/mixed-versions failed [function does not exist] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations]

/cc @cockroachdb/sql-foundations

This test on roachdash | Improve this report!

Jira issue: CRDB-44848

cockroach-teamcity commented 3 days ago

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.schemachange/mixed-versions failed with artifacts on release-24.3.0-rc @ 330209cefef4383a9d67ce7d86e2d3a9794ccd4f:

(mixedversion.go:732).Run: mixed-version test failure while running step 24 (run "run schemachange workload and validation in mixed version"): full command output in run_073837.854625854_n4_COCKROACHRANDOMSEED4.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #135798 roachtest: schemachange/mixed-versions failed [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-master] - #134636 roachtest: schemachange/mixed-versions failed [function does not exist] [C-test-failure O-roachtest O-robot P-3 T-sql-foundations]

This test on roachdash | Improve this report!

spilchen commented 2 days ago

Looking at the first two occurances. The errors are slightly different. The first one fails this way:

 {
   "sql": "ALTER FUNCTION schema_w1_1086.udf_w3_1321(public._enum_w1_63, public._enum_w2_681, public.enum_w1_63, public.enum_w2_681, schema_w0_22._composite_w0_669, schema_w0_22._composite_w4_325, schema_w0_22.composite_w0_669, schema_w0_22.composite_w4_325, schema_w4_15._composite_w1_1116, schema_w4_15._composite_w1_850, schema_w4_15._composite_w2_775, schema_w4_15._enum_w0_52, schema_w4_15._enum_w3_1036, schema_w4_15._enum_w3_898, schema_w4_15._enum_w4_962, schema_w4_15.composite_w1_1116, schema_w4_15.composite_w1_850, schema_w4_15.composite_w2_775, schema_w4_15.enum_w0_52, schema_w4_15.enum_w3_1036, schema_w4_15.enum_w3_898, schema_w4_15.enum_w4_962, schema_w3_257._composite_w1_388, \"char\", BOOL, BOX2D, BPCHAR) SET SCHEMA schema_w2_1560"
  }
 ],
 "expectedExecErrors": "",
 "expectedCommitErrors": "",
 "message": "***UNEXPECTED ERROR; Received an unexpected execution error.: ERROR: function udf_w3_1321(enum_w1_63[],enum_w2_681[],enum_w1_63,enum_w2_681,composite_w0_669[],composite_w4_325[],composite_w0_669,composite_w4_325,composite_w1_1116[],composite_w1_850[],composite_w2_775[],enum_w0_52[],enum_w3_1036[],enum_w3_898[],enum_w4_962[],composite_w1_1116,composite_w1_850,composite_w2_775,enum_w0_52,enum_w3_1036,enum_w3_898,enum_w4_962,composite_w1_388[],\"char\",bool,box2d,char) does not exist (SQLSTATE 42883)",

And the second one fails this way:

{
 "workerId": 2,
 "clientTimestamp": "07:39:07.55144",
 "ops": [
  "BEGIN",
  {
   "sql": "CREATE TYPE schema_w3_635.composite_w2_734 AS (ozjvte BIT(0), wc BOOL, jc BOOL, hpdc INT8)"
  }
 ],
 "expectedExecErrors": "",
 "expectedCommitErrors": "",
 "message": "***UNEXPECTED ERROR; Received an unexpected execution error.: ERROR: at or near \")\": syntax error: length for type bit must be at least 1 (SQLSTATE 22023)",

Both of the tests were running 24.2.4. The related fix (#130889) first appears in v24.2.5, which was just released. Once #135608 is merged, this mixed version test will use v24.2.5 and should not encounter this issue.

rafiss commented 2 days ago

should be fixed by https://github.com/cockroachdb/cockroach/pull/135608

cockroach-teamcity commented 1 day ago

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.schemachange/mixed-versions failed with artifacts on release-24.3.0-rc @ 330209cefef4383a9d67ce7d86e2d3a9794ccd4f:

(mixedversion.go:732).Run: mixed-version test failure while running step 29 (run "run schemachange workload and validation in mixed version"): full command output in run_093324.669465525_n4_COCKROACHRANDOMSEED7.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #136196 roachtest: schemachange/mixed-versions failed [BIT(0) not allowed] [B-runtime-assertions-enabled C-test-failure O-roachtest O-robot P-3 T-sql-foundations branch-release-24.3]

This test on roachdash | Improve this report!

rafiss commented 1 day ago

The latest failure is 

E241127 09:34:03.529615 1 workload/cli/run.go:599  [-] 3  ***UNEXPECTED ERROR; Failed to generate a random operation: failed generating operation: createTable: CollectOne: CollectOneRow: Query: SELECT EXISTS (
E241127 09:34:03.529615 1 workload/cli/run.go:599  [-] 3 +  SELECT table_name
E241127 09:34:03.529615 1 workload/cli/run.go:599  [-] 3 +    FROM information_schema.tables 
E241127 09:34:03.529615 1 workload/cli/run.go:599  [-] 3 +   WHERE table_schema = $1
E241127 09:34:03.529615 1 workload/cli/run.go:599  [-] 3 +     AND table_name = $2
E241127 09:34:03.529615 1 workload/cli/run.go:599  [-] 3 +   ) Args: [schema_w3_1143 table_w0_1267]: ERROR: internal error: relation "table_w0_1223" (786): parent schema "schema_w0_712" (509) is dropped (SQLSTATE XX000)

this is similar to the error in https://github.com/cockroachdb/cockroach/issues/136090