cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30k stars 3.79k forks source link

roachtest: schemachange/random-load failed #70016

Closed cockroach-teamcity closed 2 years ago

cockroach-teamcity commented 3 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 99a4816fc272228a63df20dae3cc41d235e705f3:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "11:50:15.270454",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema30 AUTHORIZATION root",
          |   "ALTER DATABASE schemachange ADD REGION \"us-west1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-west1\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "11:50:15.685587",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-east1\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "11:50:15.267228",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "11:50:15.266796",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "ALTER DATABASE schemachange ADD REGION \"us-west1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"us-west1\" already added to database (SQLSTATE 42710)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

Jira issue: CRDB-9901

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 8343f0aed1a685b7a90ea37b10bd3e0ed85e654e:

          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum213 AS ENUM ('fadf', 'fs', 'dadfaa', 'd', 'aaaa', 'ddffa')",
          |   "DROP INDEX schema12.table233@\"IrrelevantIndexName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema12.table233\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:03:58.109265",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema12.table231 RENAME TO schema12.table232"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema12.table231\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:03:58.1062",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          |     2.0s        0           42.0           42.5     10.5    260.0    385.9    385.9 opOk
          |     2.0s        0            9.0            7.5    486.5    906.0    906.0    906.0 txnCmtErr
          |     2.0s        0            1.0            2.0    352.3    352.3    352.3    352.3 txnOk
          |     2.0s        0           34.0           39.5      2.2     35.7    318.8    318.8 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:03:58.114052",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema210 AUTHORIZATION root",
          |   "CREATE TABLE IF NOT EXISTS public.table228 (col228_229 REGTYPE NOT NULL, PRIMARY KEY (col228_229 ASC), UNIQUE (col228_229 ASC), INDEX (col228_229 ASC), UNIQUE (col228_229 ASC))",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: Validation FAIL:\nid 133, db schemachange, schema public, name table228: relation \"table228\" (133): invalid locality config: database schemachange is multi-region enabled, but table table228 has no locality set"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 5c388180155f306a1685ac88bfbeeb03785313dd:

          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:08:46.579638",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq1",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq53",
          |   "CREATE TABLE IF NOT EXISTS public.table54 (col54_55 REGPROC NULL, col54_56 OID NOT NULL, col54_57 REGPROC, col54_58 INET NULL, col54_59 BYTES NULL, col54_60 STRING NULL AS (lower(CAST(col54_55 AS STRING))) STORED, col54_61 STRING NOT NULL AS (lower(CAST(col54_56 AS STRING))) VIRTUAL, UNIQUE (col54_59, col54_56, col54_61 ASC, col54_60, lower(CAST(col54_57 AS STRING)), col54_57 ASC, col54_55 DESC), UNIQUE (col54_60 DESC, col54_57, col54_61 DESC) STORING (col54_55, col54_56, col54_58, col54_59), INDEX (lower(CAST(col54_56 AS STRING)) DESC, col54_57, col54_61 ASC, (CASE WHEN col54_59 IS NULL THEN '':::STRING ELSE 'F7S':::STRING END) DESC) STORING (col54_58, col54_60), INDEX (col54_59 ASC) STORING (col54_55, col54_57), INDEX (col54_58) STORING (col54_55, col54_59, col54_60), FAMILY (col54_58), FAMILY (col54_60, col54_59, col54_55, col54_57), FAMILY (col54_56))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=5b97f3a4 key=/Table/SystemConfigSpan/Start pri=0.01373123 epo=0 ts=1638882527.140128558,1 min=1638882526.579566346,0 seq=49} lock=true stat=PENDING rts=1638882526.579566346,0 wto=false gul=1638882527.079566346,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:08:46.55167",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq40",
          |   "CREATE SCHEMA IF NOT EXISTS schema43 AUTHORIZATION root",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=ba1fb923 key=/Table/SystemConfigSpan/Start pri=0.01014811 epo=0 ts=1638882527.140128558,2 min=1638882526.551597473,0 seq=23} lock=true stat=PENDING rts=1638882526.551597473,0 wto=false gul=1638882527.051597473,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:08:46.552483",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table4 (col4_5 GEOGRAPHY NOT NULL, col4_6 OID NULL, col4_7 TIMESTAMP NOT NULL, col4_8 REGTYPE NOT NULL, col4_9 GEOMETRY, col4_10 REGPROCEDURE NOT NULL, col4_11 OID NOT NULL, PRIMARY KEY (col4_8 ASC, col4_7 ASC), col4_12 STRING NOT NULL AS (lower(CAST(col4_7 AS STRING))) STORED, col4_13 STRING NOT NULL AS (lower(CAST(col4_5 AS STRING))) STORED, INVERTED INDEX (col4_9))",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED COMMIT ERROR; Received an unexpected commit error: ERROR: relation \"table4\" (56): invalid locality config: database schemachange is multi-region enabled, but table table4 has no locality set (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 81d49bd3d2e8ee3da4a5800043b94aa174127ab7:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:07:49.934058",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "CREATE TABLE public.table171 (col171_172 INET NOT NULL, col171_173 GEOMETRY[] NULL, col171_174 BYTES NOT NULL, col171_175 DECIMAL NOT NULL, col171_176 OID NOT NULL, col171_177 STRING NOT NULL, col171_178 INET NULL, col171_179 REGNAMESPACE, col171_180 TIMESTAMPTZ NOT NULL, col171_181 REGTYPE NULL, col171_182 REGCLASS, PRIMARY KEY (col171_180 ASC, col171_177 ASC, col171_172 DESC), col171_183 STRING NOT NULL AS (CASE WHEN col171_174 IS NULL THEN e'\\n\u003efQ\\x06\\x15':::STRING ELSE e'\\\\\u0026R\\f:\\x14\u003c':::STRING END) STORED, INDEX (col171_179 ASC, col171_176))",
          |   "CREATE TYPE schema192.enum193 AS ENUM ('aaffss', 'da')"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema192.enum193\" because the target database or schema does not exist (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:07:49.952676",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: at least 3 regions are required for surviving a region failure (SQLSTATE 22023)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:07:50.084523",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-west1\"",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:07:50.099293",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table153 (col153_154 TIMETZ NULL, col153_155 FLOAT8[] NOT NULL, col153_156 \"char\" NOT NULL, col153_157 BOOL, col153_158 BIT(27), col153_159 INTERVAL NULL, col153_160 VARCHAR NULL, col153_161 BOOL, col153_162 BYTES, col153_163 STRING AS (lower(CAST(col153_158 AS STRING))) STORED, col153_164 STRING NOT NULL AS (lower(col153_156)) VIRTUAL, col153_165 STRING NULL AS (lower(CAST(col153_154 AS STRING))) VIRTUAL, col153_166 STRING AS (lower(CAST(col153_161 AS STRING))) VIRTUAL, col153_167 STRING AS (lower(CAST(col153_161 AS STRING))) STORED, INVERTED INDEX (col153_163, col153_167 ASC, lower(CAST(col153_159 AS STRING)) DESC, col153_155 ASC), UNIQUE (col153_158 DESC, col153_162 ASC, lower(CAST(col153_157 AS STRING)) ASC) STORING (col153_155, col153_160, col153_161, col153_163, col153_167), INVERTED INDEX (col153_160 ASC, col153_157 DESC, col153_154 ASC, col153_161 ASC, col153_167 DESC, lower(CAST(col153_159 AS STRING)), col153_159 DESC, col153_162 DESC, col153_163 DESC, col153_166 ASC, col153_156, lower(CAST(col153_158 AS STRING)) DESC, col153_155), INDEX (col153_163, col153_161, col153_157 ASC, col153_158, col153_166, col153_160) STORING (col153_162), UNIQUE (lower(CAST(col153_154 AS STRING)), col153_164 ASC, col153_162, col153_165 DESC, col153_156 DESC, col153_154 ASC, col153_160), FAMILY (col153_163, col153_162, col153_158), FAMILY (col153_167, col153_155, col153_154), FAMILY (col153_157, col153_161), FAMILY (col153_159), FAMILY (col153_160, col153_156))",
          |   "ALTER TABLE public.table153 ALTER COLUMN crdb_internal_idx_expr_4 SET DEFAULT e'\\x1cvG\\x12\u003e\\x1d\\x124\\x05':::STRING"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table153\" (100): computed column \"crdb_internal_idx_expr_4\" cannot also have a DEFAULT expression (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 1bb94b40c519b775d99dffe64435f968206ced4b:

          |  "clientTimestamp": "13:31:50.064913",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE public.table4 (col4_5 BIT(35) NOT NULL, col4_6 REGROLE NOT NULL, col4_7 INT8 NOT NULL, col4_8 UUID NOT NULL, col4_9 TIME NOT NULL, col4_10 INT8, col4_11 DATE NOT NULL, col4_12 INT4 NOT NULL, col4_13 REGPROCEDURE, col4_14 TIME NOT NULL, col4_15 REGROLE, col4_16 CHAR NOT NULL, col4_17 VARCHAR NOT NULL, col4_18 BOX2D NULL, col4_19 INT2, col4_20 TIMESTAMPTZ NOT NULL, col4_21 BIT(29) NOT NULL, col4_22 VARCHAR NOT NULL, PRIMARY KEY (col4_9, col4_8, col4_5, col4_21 ASC, col4_11 ASC, col4_7, col4_17, col4_14, col4_20, col4_16 ASC, col4_6 DESC), UNIQUE (col4_15, col4_14, col4_20, col4_10 ASC, ((col4_10 + col4_7) + col4_12) ASC, col4_21, col4_11 ASC, col4_18 ASC, col4_6 ASC, col4_19 DESC, (((col4_12 + col4_10) + col4_19) + col4_7), col4_13, col4_5) STORING (col4_12, col4_22), UNIQUE (col4_11 ASC), INDEX (col4_7 ASC, col4_9, col4_14, col4_21 ASC, col4_18 ASC, col4_11 DESC, col4_22 DESC, col4_16 DESC, col4_17, ((col4_19 + col4_10) + col4_12) DESC, lower(CAST(col4_13 AS STRING)) DESC, col4_15 DESC, col4_5, col4_13 ASC), INDEX (col4_14 ASC, col4_21 DESC, col4_12 ASC, col4_18 DESC, col4_17, ((col4_12 + col4_7) + col4_10) ASC, col4_6 ASC, col4_11 ASC, col4_19 DESC, col4_10, col4_13 DESC), INDEX (col4_18 DESC, col4_11 ASC, col4_21) STORING (col4_12, col4_13, col4_15), UNIQUE (col4_22 DESC, ((col4_19 + col4_12) + col4_7) DESC, col4_9, col4_15 DESC, col4_11, col4_18, col4_10 ASC, col4_8 ASC, (CASE WHEN col4_20 IS NULL THEN e'*\\x1clX``':::STRING ELSE '7':::STRING END) ASC, col4_21 DESC, col4_5 DESC, col4_13 ASC, col4_20, col4_19 ASC, col4_6 ASC, col4_12, col4_7, col4_14 DESC), UNIQUE (col4_6 ASC, col4_19, col4_9 DESC, col4_22 DESC, col4_14 DESC, col4_18, col4_17 ASC, col4_20 DESC, col4_12 ASC, col4_10, col4_7 DESC, lower(CAST(col4_13 AS STRING)), col4_8 ASC, col4_15 DESC, col4_13, col4_5 DESC), INDEX (col4_16, col4_15 ASC, col4_7, col4_14 ASC, col4_8 ASC, col4_9 DESC, col4_21 ASC, col4_17 DESC, col4_5 ASC, col4_13 ASC, col4_18, col4_12 DESC, col4_19 ASC, col4_11 DESC, col4_6 ASC), INDEX (col4_7 ASC, col4_17 ASC, col4_19 ASC, (col4_19 + col4_10) ASC))",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"europe-west2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:31:50.064746",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:31:50.064622",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum31 AS ENUM ('affsa', 'aasaa', 'da')",
          |   "ALTER INDEX public.table51@\"IrrelevantConstraintName\" RENAME TO \"OtherConstraintName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table51\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:31:50.065691",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq52",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ cb0222a1980b96ad59c181c96fab8340aa252571:

          |  "workerId": 0,
          |  "clientTimestamp": "13:14:17.696961",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=9455e67a key=/Table/SystemConfigSpan/Start pri=0.07127216 epo=0 ts=1639142057.709797107,1 min=1639142057.696890317,0 seq=24} lock=true stat=PENDING rts=1639142057.696890317,0 wto=false gul=1639142058.196890317,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:14:17.817378",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-east1\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:14:17.697399",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema23 AUTHORIZATION root",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"europe-west2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:14:17.697747",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table2 (col2_3 FLOAT8, col2_4 REGPROC NULL, col2_5 BOX2D[] NOT NULL, col2_6 JSONB NULL, col2_7 NAME NULL, col2_8 BIT(39), col2_9 STRING NULL AS (lower(col2_7)) VIRTUAL, INDEX (col2_7 ASC, col2_3 ASC, lower(col2_7), col2_4 DESC, col2_9 ASC) STORING (col2_8), UNIQUE (lower(CAST(col2_4 AS STRING)) ASC, col2_4 ASC) STORING (col2_5, col2_6, col2_7))",
          |   "ALTER TABLE public.table2 ALTER COLUMN crdb_internal_idx_expr SET DEFAULT e'\\x193':::STRING"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table2\" (57): computed column \"crdb_internal_idx_expr\" cannot also have a DEFAULT expression (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 3cf7ac914c42bb024c688564983445f3eb5da58a:

          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:45:38.934862",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=dce39441 key=/Table/SystemConfigSpan/Start pri=0.00164709 epo=0 ts=1639226739.209228216,1 min=1639226738.934814037,0 seq=24} lock=true stat=PENDING rts=1639226738.934814037,0 wto=false gul=1639226739.434814037,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:45:39.115009",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:45:39.134038",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-east1\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:45:38.936595",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table4 (col4_5 STRING, col4_6 DATE NOT NULL, col4_7 DECIMAL NULL, col4_8 INT8[] NULL, col4_9 VARCHAR, col4_10 REGTYPE, col4_11 INT4[], col4_12 BOX2D NULL, col4_13 BOX2D, col4_14 UUID NOT NULL, col4_15 UUID NULL, col4_16 STRING NULL, col4_17 BOOL NOT NULL, col4_18 FLOAT8 NULL, col4_19 TIMETZ NULL, col4_20 \"char\", col4_21 STRING NULL AS (lower(CAST(col4_12 AS STRING))) VIRTUAL, UNIQUE (col4_21) STORING (col4_13, col4_15, col4_16, col4_17, col4_18), FAMILY (col4_13), FAMILY (col4_9, col4_16), FAMILY (col4_12, col4_17, col4_19, col4_5), FAMILY (col4_7, col4_11, col4_8), FAMILY (col4_18), FAMILY (col4_10, col4_20, col4_14), FAMILY (col4_6), FAMILY (col4_15))",
          |   "DROP TABLE IF EXISTS public.table4 RESTRICT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: getting table columns from public.table4: ERROR: relation \"public.table4\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ c754d101ccd7541b0f597dac2f37809c1a859bf2:

          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table9 (col9_10 GEOGRAPHY NULL, col9_11 REGPROC NULL, col9_12 TIMETZ NULL, col9_13 INT2, col9_14 BIT(21) NULL, col9_15 BOOL NULL, col9_16 VARCHAR NOT NULL, col9_17 BOX2D NULL, col9_18 CHAR NOT NULL, col9_19 STRING NOT NULL AS (lower(col9_16)) VIRTUAL, col9_20 STRING NULL AS (lower(CAST(col9_12 AS STRING))) VIRTUAL, FAMILY (col9_16, col9_18), FAMILY (col9_11), FAMILY (col9_15), FAMILY (col9_13, col9_10, col9_17), FAMILY (col9_14), FAMILY (col9_12))",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=baa7fee2 key=/Table/SystemConfigSpan/Start pri=0.01412509 epo=0 ts=1639484260.057384459,1 min=1639484260.053299653,0 seq=7} lock=true stat=PENDING rts=1639484260.053299653,0 wto=false gul=1639484260.553299653,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:17:40.055427",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "DROP SCHEMA \"schema33\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unknown schema \"schema33\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:17:40.053898",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TYPE public.enum34 AS ENUM ('afasfs', 'a', 'adssfd', 'adf')",
          |   "CREATE TYPE public.enum36 AS ENUM ('sada', 'ssssf', 's', 'das')",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:17:40.05354",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"us-east1\" has not been added to the database (SQLSTATE 42602)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ f963a1eb6daa99bd5fd2c43771773473cdf361f7:

          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE IF NOT EXISTS public.table167 (col167_168 TIMESTAMPTZ NULL, col167_169 TIMETZ NULL, col167_170 OID, col167_171 GEOGRAPHY NOT NULL, col167_172 NAME NOT NULL, col167_173 INT2, col167_174 INT4 NULL, col167_175 REGPROCEDURE, col167_176 NAME, PRIMARY KEY (col167_172 ASC), col167_177 STRING NOT NULL AS (lower(CAST(col167_171 AS STRING))) STORED, col167_178 STRING NOT NULL AS (lower(col167_172)) VIRTUAL, col167_179 INT4 NULL AS (col167_174 + col167_173) VIRTUAL, col167_180 STRING AS (lower(CAST(col167_175 AS STRING))) VIRTUAL, col167_181 INT2 AS (col167_173 + col167_174) STORED, INVERTED INDEX (col167_181, col167_169 ASC, col167_168, col167_172 DESC, col167_176 DESC, col167_177, col167_179, lower(CAST(col167_169 AS STRING)) ASC, col167_180 ASC, col167_175 ASC, col167_171), FAMILY (col167_169, col167_172), FAMILY (col167_176), FAMILY (col167_170, col167_171, col167_173, col167_174), FAMILY (col167_177), FAMILY (col167_181), FAMILY (col167_168, col167_175))",
          |   "CREATE TYPE public.enum182 AS ENUM ('dasdf', 'asssss', 'saffaa')",
          |   "DROP INDEX public.table183@\"IrrelevantIndexName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table183\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:15:22.645943",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE IF EXISTS public.seq112",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE SCHEMA IF NOT EXISTS schema184 AUTHORIZATION root",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=83a938ce key=/Table/SystemConfigSpan/Start pri=0.01414586 epo=0 ts=1639574123.059277820,1 min=1639574122.645879768,0 seq=28} lock=true stat=PENDING rts=1639574122.645879768,0 wto=false gul=1639574123.145879768,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:15:22.686599",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER SEQUENCE public.seq112 RENAME TO public.seq146",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=8a9fc1ef key=/Table/SystemConfigSpan/Start pri=0.02089497 epo=0 ts=1639574122.773285302,1 min=1639574122.686541598,0 seq=14} lock=true stat=PENDING rts=1639574122.686541598,0 wto=false gul=1639574123.186541598,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:15:22.654254",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq154",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "DROP SEQUENCE IF EXISTS public.seq112"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: Validation FAIL:\nid 109, db schemachange, schema public, name seq154: relation \"seq154\" (109): invalid locality config: database schemachange is multi-region enabled, but table seq154 has no locality set"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 3adc6da4ccdf80618e6bbcee5ee9e503a92517e7:

          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema50.view51\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:03:49.638933",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema16.enum17 AS ENUM ('dfdad', 'f', 'fdsdf', 'df')"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema16.enum17\" because the target database or schema does not exist (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:03:49.740869",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:03:49.471436",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-west1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-west1\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:03:49.469638",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table3 (col3_4 REGPROC NOT NULL, col3_5 FLOAT8 NOT NULL, col3_6 INET NOT NULL, col3_7 TIME NOT NULL, col3_8 NAME NOT NULL, col3_9 BIT(22) NOT NULL, PRIMARY KEY (col3_6, col3_5 ASC, col3_7 DESC, col3_4 DESC, col3_8, col3_9 ASC), col3_10 STRING NOT NULL AS (lower(col3_8)) STORED, col3_11 FLOAT8 NOT NULL AS (col3_5 + 0.20047787689637853:::FLOAT8) STORED, UNIQUE (col3_6, col3_9 ASC, col3_11 ASC, col3_5 DESC, col3_4, col3_7 DESC), UNIQUE (col3_4 DESC, col3_8, lower(CAST(col3_6 AS STRING)) ASC, col3_11, col3_7 ASC, col3_9 ASC) STORING (col3_10))",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER TABLE public.table3 ALTER COLUMN col3_10 SET DEFAULT '':::STRING"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table3\" (56): computed column \"col3_10\" cannot also have a DEFAULT expression (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 999d35029f33a9b35dde0599c952efc83ed726a7:

          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:54:58.749076",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum11 AS ENUM ('fa', 'asa', 'dfs', 'd', 'fadff', 'afa')",
          |   "CREATE TYPE public.enum46 AS ENUM ('dfsssd', 'aafs')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=9e70692d key=/Table/SystemConfigSpan/Start pri=0.00650487 epo=0 ts=1639749299.010288347,1 min=1639749298.749010838,0 seq=18} lock=true stat=PENDING rts=1639749298.749010838,0 wto=false gul=1639749299.249010838,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:54:58.748225",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "DROP TABLE public.table67"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table67\" does not exist (SQLSTATE 42P01)"
          | }
          |     2.0s        0           13.0           13.5    939.5   1476.4   1677.7   1677.7 opOk
          |     2.0s        0            1.0            1.0   1811.9   1811.9   1811.9   1811.9 txnCmtErr
          |     2.0s        0            0.0            1.5      0.0      0.0      0.0      0.0 txnOk
          |     2.0s        0            6.0           13.0      0.6      1.0      1.0      1.0 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:54:58.81901",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table14 (col14_15 TIMESTAMPTZ NOT NULL, col14_16 TIME NOT NULL, col14_17 \"char\", col14_18 INT4 NOT NULL, col14_19 INT8 NOT NULL, col14_20 BOOL NULL, PRIMARY KEY (col14_18 DESC, col14_15, col14_16 DESC), UNIQUE ((col14_18 + col14_19)) STORING (col14_20), FAMILY (col14_16, col14_19, col14_15, col14_17, col14_18, col14_20))",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"us-west1\" has not been added to the database (SQLSTATE 42602)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ f51352920c0af2bbede32dab8fee6424fc27a911:

          |  "workerId": 0,
          |  "clientTimestamp": "13:33:52.962776",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-west1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-west1\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:33:52.831558",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER TABLE public.table47 RENAME TO public.table48"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table47\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:33:52.83394",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE IF NOT EXISTS public.table49 (col49_50 DECIMAL[] NOT NULL, col49_51 REGPROC NULL, col49_52 INT2, col49_53 BIT(8), col49_54 TIMETZ NOT NULL, col49_55 INT2 AS (col49_52 + (-5213):::INT8) STORED, UNIQUE (col49_51 ASC, col49_55 ASC, col49_52 ASC, lower(CAST(col49_53 AS STRING)) ASC, col49_54, lower(CAST(col49_53 AS STRING)) DESC) STORING (col49_50), INDEX (col49_55, (CASE WHEN col49_50 IS NULL THEN e'_:TSiu\\x19':::STRING ELSE '':::STRING END) DESC) STORING (col49_51, col49_52), FAMILY (col49_54, col49_51), FAMILY (col49_50, col49_55, col49_52, col49_53))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=3f8a58a4 key=/Table/SystemConfigSpan/Start pri=0.03342223 epo=0 ts=1639834432.838288298,2 min=1639834432.833761018,0 seq=7} lock=true stat=PENDING rts=1639834432.833761018,0 wto=false gul=1639834433.333761018,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:33:52.622242",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 4d0b749d263b95baf3054607d5f13a92cbb6a055:

          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:11:00.138479",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema1 AUTHORIZATION root",
          |   "CREATE TYPE schema1.enum29 AS ENUM ('aads', 'ssffs', 'dffdds')",
          |   "CREATE SCHEMA schema31 AUTHORIZATION root",
          |   "CREATE TYPE schema1.enum38 AS ENUM ('adsas', 'aadffs', 'f')",
          |   "CREATE SCHEMA IF NOT EXISTS schema39 AUTHORIZATION root",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=c7e076ca key=/Table/SystemConfigSpan/Start pri=0.03564334 epo=0 ts=1640005860.251848894,1 min=1640005860.138370761,0 seq=63} lock=true stat=PENDING rts=1640005860.138370761,0 wto=false gul=1640005860.638370761,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:11:00.138045",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE public.table40 (col40_41 BOOL NOT NULL, col40_42 BOX2D, col40_43 NAME NULL, col40_44 STRING NOT NULL AS (lower(CAST(col40_41 AS STRING))) STORED, col40_45 STRING AS (lower(CAST(col40_42 AS STRING))) VIRTUAL, INDEX (col40_45 DESC, col40_43 ASC) STORING (col40_44), INDEX (col40_42 DESC) STORING (col40_43, col40_44), UNIQUE (col40_45 ASC, col40_42, col40_44 ASC, col40_43 DESC, col40_41), INDEX (col40_42 DESC, col40_44 ASC, lower(col40_43) ASC, col40_43 ASC, col40_41 ASC), UNIQUE (col40_45 ASC, col40_43 DESC, col40_42), UNIQUE (col40_41 DESC, col40_44, col40_42 ASC, col40_43 DESC), FAMILY (col40_43), FAMILY (col40_42), FAMILY (col40_44, col40_41))",
          |   "CREATE VIEW public.view54 AS SELECT \"IrrelevantColumnName\", \"IrrelevantColumnName\" FROM public.table50, public.table51"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table50\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:11:00.137684",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 33ec37ae94ff96d2f5804506810fb436b186bc32:

          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.seq143\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:50:19.272299",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-west1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-west1\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:50:19.004676",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "DROP SCHEMA \"schema147\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unknown schema \"schema147\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:50:19.007533",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table70 RENAME TO public.table70",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:50:19.238536",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table70 ALTER COLUMN col70_80 SET DEFAULT '':::STRING"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table70\" (96): computed column \"col70_80\" cannot also have a DEFAULT expression (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 2282896401079fef362d5456b71b32dd600e52b0:

          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:53:07.19221",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table88 (col88_89 DECIMAL NOT NULL, col88_90 REGNAMESPACE NULL, col88_91 BOX2D NULL, col88_92 INT2, col88_93 BYTES, col88_94 BOOL NULL, col88_95 REGPROCEDURE NULL, col88_96 FLOAT4 NOT NULL, col88_97 REGROLE NULL, col88_98 UUID, col88_99 STRING NOT NULL, col88_100 TIMETZ, col88_101 JSONB, col88_102 GEOGRAPHY NULL, col88_103 REGROLE, col88_104 DECIMAL NOT NULL AS (col88_89 + 3.109454038703200290E+30:::DECIMAL) STORED, col88_105 STRING NULL AS (lower(CAST(col88_90 AS STRING))) STORED, col88_106 STRING NULL AS (lower(CAST(col88_94 AS STRING))) VIRTUAL, col88_107 STRING NOT NULL AS (lower(col88_99)) VIRTUAL)",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=ccbc65c4 key=/Table/SystemConfigSpan/Start pri=0.01946273 epo=0 ts=1640177587.242305170,1 min=1640177587.192152145,0 seq=7} lock=true stat=PENDING rts=1640177587.192152145,0 wto=false gul=1640177587.692152145,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:53:07.348326",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema73.enum74 AS ENUM ('f', 'd', 'df', 'fsdf', 'a')"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema73.enum74\" because the target database or schema does not exist (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:53:07.423098",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"europe-west2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:53:07.043625",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"europe-west2\" has not been added to the database (SQLSTATE 42602)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 147ca220b715dbaadef5a8689e1894feecda5358:

          |   "BEGIN",
          |   "CREATE TYPE public.enum67 AS ENUM ('afad', 'afssa', 'assdf', 'd')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=555c5e66 key=/Table/SystemConfigSpan/Start pri=0.00613099 epo=0 ts=1640267858.916888971,1 min=1640267858.820135448,0 seq=9} lock=true stat=PENDING rts=1640267858.820135448,0 wto=false gul=1640267859.320135448,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:57:38.841997",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum38 AS ENUM ('saa', 'saf', 'sasfd', 'sffdad', 'daaad', 'sfffaf')",
          |   "ALTER SEQUENCE public.seq73 RENAME TO public.seq74"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.seq73\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:57:38.607179",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "CREATE TABLE public.table75 (col75_76 TIMESTAMP NOT NULL, col75_77 BOOL, col75_78 FLOAT8 NOT NULL, col75_79 VARCHAR NOT NULL, col75_80 TIMESTAMP NOT NULL, col75_81 CHAR NOT NULL, col75_82 INT2 NOT NULL, col75_83 JSONB NOT NULL, col75_84 STRING NOT NULL AS (lower(CAST(col75_83 AS STRING))) VIRTUAL, col75_85 STRING NOT NULL AS (lower(col75_79)) STORED, col75_86 FLOAT8 NOT NULL AS (col75_78 + 0.9843263056553215:::FLOAT8) STORED, UNIQUE (col75_77, col75_84) STORING (col75_81, col75_85, col75_86), INVERTED INDEX (col75_84, col75_79 ASC, col75_80 ASC, col75_81 ASC, col75_77 DESC, col75_82 ASC, col75_86 DESC, col75_85 ASC, col75_83 ASC), INDEX (col75_84 DESC, col75_80 DESC, col75_78 ASC, col75_85 DESC, col75_86, col75_77 ASC, col75_81 DESC) STORING (col75_79, col75_82, col75_83), UNIQUE (col75_84 DESC, col75_82 DESC, col75_77 ASC, col75_86, col75_76 DESC, col75_79 DESC, lower(CAST(col75_80 AS STRING)), col75_80 DESC, col75_81 ASC), INDEX (lower(CAST(col75_80 AS STRING)), col75_80, col75_76, col75_82, col75_84 DESC) STORING (col75_83), INDEX (col75_82 ASC, col75_81, col75_86 ASC, col75_80 ASC, col75_76 ASC, col75_85), INDEX (col75_80 DESC, col75_82, col75_81 ASC, col75_84 DESC))",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=e9b3ffdc key=/Table/SystemConfigSpan/Start pri=0.02997131 epo=0 ts=1640267859.092202213,1 min=1640267858.607144604,0 seq=48} lock=true stat=PENDING rts=1640267858.607144604,0 wto=false gul=1640267859.107144604,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:57:38.609559",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "ALTER DATABASE schemachange ADD REGION \"us-west1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ ec9330f86763371c445acdc317088e24cbcbaac3:

          | I211224 13:30:25.669762 228 workload/pgx_helpers.go:72  [-] 21 +           AND id NOT IN (SELECT id FROM dependent)
          | I211224 13:30:25.669762 228 workload/pgx_helpers.go:72  [-] 21 +       );]
          | I211224 13:30:25.718248 227 workload/pgx_helpers.go:72  [-] 22  pgx logger [error]: Exec logParams=map[args:[] err:ERROR: cannot create "schema47.enum48" because the target database or schema does not exist (SQLSTATE 3F000) sql:CREATE TYPE schema47.enum48 AS ENUM ('fsafad', 'sdd', 'fasfds')]
          | Error: ***FAIL; Failed to receive an execution error when errors were expected
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 5000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | 5.362112",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:30:25.142813",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "scanBool: \"\\n  WITH database_id AS (\\n                    SELECT id\\n                      FROM system.namespace\\n                     WHERE \\\"parentID\\\" = 0\\n                       AND \\\"parentSchemaID\\\" = 0\\n                       AND name = current_database()\\n                   ),\\n       schema_id AS (\\n                    SELECT nsp.id\\n                      FROM system.namespace AS nsp\\n                      JOIN database_id ON \\\"parentID\\\" = database_id.id\\n                                      AND \\\"parentSchemaID\\\" = 0\\n                                      AND name = $1\\n                 ),\\n       descriptor_ids AS (\\n                        SELECT nsp.id\\n                          FROM system.namespace AS nsp,\\n                               schema_id,\\n                               database_id\\n                         WHERE nsp.\\\"parentID\\\" = database_id.id\\n                           AND nsp.\\\"parentSchemaID\\\" = schema_id.id\\n                      ),\\n       descriptors AS (\\n                    SELECT crdb_internal.pb_to_json(\\n                            'cockroach.sql.sqlbase.Descriptor',\\n                            descriptor\\n                           ) AS descriptor\\n                      FROM system.descriptor AS descriptors\\n                      JOIN descriptor_ids ON descriptors.id\\n                                             = descriptor_ids.id\\n                   ),\\n       types AS (\\n                SELECT descriptor\\n                  FROM descriptors\\n                 WHERE (descriptor-\u003e'type') IS NOT NULL\\n             ),\\n       table_references AS (\\n                            SELECT json_array_elements(\\n                                    descriptor-\u003e'table'-\u003e'dependedOnBy'\\n                                   ) AS ref\\n                              FROM descriptors\\n                             WHERE (descriptor-\u003e'table') IS NOT NULL\\n                        ),\\n       dependent AS (\\n                    SELECT (ref-\u003e\u003e'id')::INT8 AS id FROM table_references\\n                 ),\\n       referenced_descriptors AS (\\n                                SELECT json_array_elements_text(\\n                                        descriptor-\u003e'type'-\u003e'referencingDescriptorIds'\\n                                       )::INT8 AS id\\n                                  FROM types\\n                              )\\nSELECT EXISTS(\\n        SELECT *\\n          FROM system.namespace\\n         WHERE id IN (SELECT id FROM referenced_descriptors)\\n           AND \\\"parentSchemaID\\\" NOT IN (SELECT id FROM schema_id)\\n           AND id NOT IN (SELECT id FROM dependent)\\n       );\" [\"public\"]: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=f6c1edca key=/Table/SystemConfigSpan/Start pri=0.00194674 epo=0 ts=1640352625.368953062,1 min=1640352625.142735659,0 seq=24} lock=true stat=ABORTED rts=1640352625.142735659,0 wto=false gul=1640352625.642735659,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:30:25.142627",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum27 AS ENUM ('adssdd', 'af')",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 2c4bb88e5318fe187e1bf6cb134b31bd63f63528:

          |   "CREATE SCHEMA public AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "42P06",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: schema \"public\" already exists (SQLSTATE 42P06)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:57:32.850129",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema53 AUTHORIZATION root",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-east1\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:57:32.848859",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table2 (col2_3 REGTYPE NOT NULL, col2_4 BIT(35) NOT NULL, col2_5 INET NOT NULL, col2_6 DECIMAL NOT NULL, col2_7 INTERVAL[] NOT NULL, PRIMARY KEY (col2_5, col2_4, col2_6), col2_8 STRING NOT NULL AS (lower(CAST(col2_3 AS STRING))) STORED, col2_9 STRING NOT NULL AS (lower(CAST(col2_5 AS STRING))) VIRTUAL, col2_10 STRING NOT NULL AS (lower(CAST(col2_5 AS STRING))) STORED, INDEX (col2_8 ASC) STORING (col2_3))",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=6836e8db key=/Table/SystemConfigSpan/Start pri=0.00384627 epo=0 ts=1640696253.318922327,1 min=1640696252.848803480,0 seq=48} lock=true stat=PENDING rts=1640696252.848803480,0 wto=false gul=1640696253.348803480,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:57:32.849641",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum13 AS ENUM ('df')",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE IF NOT EXISTS public.table38 (col38_39 OID NULL, col38_40 \"char\", col38_41 GEOMETRY, col38_42 OID NOT NULL, col38_43 UUID NOT NULL, col38_44 FLOAT8[] NOT NULL, col38_45 INT2 NULL, col38_46 REGPROCEDURE NULL, col38_47 GEOMETRY NOT NULL, col38_48 STRING NOT NULL AS (lower(CAST(col38_47 AS STRING))) STORED, col38_49 STRING NULL AS (lower(CAST(col38_39 AS STRING))) VIRTUAL, col38_50 STRING NOT NULL AS (CASE WHEN col38_44 IS NULL THEN 'I':::STRING ELSE 'Dj;ANue@':::STRING END) VIRTUAL, col38_51 STRING NOT NULL AS (lower(CAST(col38_47 AS STRING))) STORED, UNIQUE (col38_40 ASC, col38_50 ASC), FAMILY (col38_43), FAMILY (col38_41), FAMILY (col38_47), FAMILY (col38_40, col38_44, col38_48), FAMILY (col38_46, col38_42, col38_51, col38_45, col38_39))",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED COMMIT ERROR; Received an unexpected commit error: ERROR: relation \"table38\" (64): invalid locality config: database schemachange is multi-region enabled, but table table38 has no locality set (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ c22ac33a023323cb76fde367b766ef988d6e27f7:

          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"europe-west2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:59:06.461577",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:59:06.153653",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE public.table38 (col38_39 BIT NOT NULL, col38_40 DECIMAL NULL, col38_41 BYTES, col38_42 INT4 NOT NULL, col38_43 UUID NULL, PRIMARY KEY (col38_42, col38_39 DESC), col38_44 DECIMAL NULL AS (col38_40 + 6.167941066337379534E+24:::DECIMAL) VIRTUAL, UNIQUE (col38_43) STORING (col38_40), UNIQUE (col38_43 DESC, col38_39 DESC), INDEX (col38_43, col38_41 DESC, col38_44 ASC, col38_40, col38_42 DESC, col38_39), INDEX (col38_42) STORING (col38_40, col38_43), UNIQUE (col38_44, col38_43 ASC, col38_39, col38_40) STORING (col38_41), INDEX (col38_40 DESC, (col38_42 + (-2007416628):::INT8) ASC, col38_44 DESC), UNIQUE (col38_43 ASC, (col38_40 + 3.639626006971201686E+24:::DECIMAL) ASC, (col38_42 + (-534424092):::INT8) DESC) STORING (col38_40, col38_41), UNIQUE (col38_43, col38_44, col38_40 DESC, col38_42 DESC, col38_39 DESC), INDEX (col38_44 DESC, col38_41, col38_42, col38_43, col38_40 DESC, col38_39))",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "DROP VIEW IF EXISTS public.view50 RESTRICT",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=4175861f key=/Table/SystemConfigSpan/Start pri=0.06468906 epo=0 ts=1640872746.153321256,1 min=1640872746.152595037,0 seq=7} lock=true stat=PENDING rts=1640872746.152595037,0 wto=false gul=1640872746.652595037,0 (SQLSTATE 40001)"
          | }
          | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
          |     1.0s        0           14.9           16.0      8.4    436.2    771.8    771.8 opOk
          |     1.0s        0            1.9            2.0    285.2    805.3    805.3    805.3 txnCmtErr
          |     1.0s        0            1.9            2.0     39.8    159.4    159.4    159.4 txnOk
          |     1.0s        0           13.1           14.0      2.6     16.8     18.9     18.9 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:59:06.153415",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ dc72c17f280dc20fa59970209c0e975e4072f91e:

          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:55:22.641869",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS schema1.table33 (col33_34 REGTYPE NOT NULL, col33_35 TIME NULL, col33_36 UUID NULL, col33_37 INTERVAL NULL, col33_38 REGROLE, col33_39 VARCHAR NOT NULL, col33_40 INT8 NOT NULL, col33_41 REGCLASS NOT NULL, col33_42 VARCHAR NOT NULL, col33_43 TIMETZ[], col33_44 INT2[] NOT NULL, col33_45 REGPROC NOT NULL, INDEX (col33_34, col33_37, col33_42, col33_39 ASC, col33_36), FAMILY (col33_36, col33_42), FAMILY (col33_38, col33_40), FAMILY (col33_44, col33_39), FAMILY (col33_45), FAMILY (col33_43), FAMILY (col33_34), FAMILY (col33_41), FAMILY (col33_37), FAMILY (col33_35))",
          |   "CREATE UNIQUE INDEX IF NOT EXISTS index33_89 ON schema1.table33 (col33_39, col33_35 ASC) STORING (col33_43, col33_38, col33_42, col33_37, col33_34, col33_36)",
          |   "CREATE TYPE schema1.enum91 AS ENUM ('ddas', 'asssff')",
          |   "ALTER TABLE schema1.table33 ALTER COLUMN col33_43 SET DEFAULT ARRAY['19:48:32.934009-13:05:00':::TIMETZ]",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"europe-west2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:55:22.505475",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema79 AUTHORIZATION root",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:55:22.569571",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq55",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ fb88f951323864fafd104e132cbf1f2f22f2e3ac:

          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=e7f18b15 key=/Table/SystemConfigSpan/Start pri=0.00678357 epo=0 ts=1641388993.453988337,1 min=1641388992.311113446,0 seq=30} lock=true stat=PENDING rts=1641388992.311113446,0 wto=false gul=1641388992.811113446,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:23:13.569125",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"europe-west2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:23:13.65276",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:23:14.31182",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"europe-west2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:23:12.237512",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 0c8df44947208da2f6234d2736e8ab6d3b0937c0:

          |  "workerId": 0,
          |  "clientTimestamp": "13:15:57.819474",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:15:57.685373",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:15:57.658901",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS schema158.seq213",
          |   "CREATE SEQUENCE IF NOT EXISTS schema158.seq231",
          |   "DROP SEQUENCE IF EXISTS schema158.seq213",
          |   "DROP VIEW schema158.view235"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema158.view235\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:15:57.739445",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"us-west1\" has not been added to the database (SQLSTATE 42602)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 12c606395dc2cfb35bd82972ab65c4453f33c400:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:06:45.772334",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq191",
          |   "ALTER INDEX schema3.table206@\"IrrelevantConstraintName\" RENAME TO \"OtherConstraintName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema3.table206\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:06:45.825904",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema83.enum204 AS ENUM ('safda', 'sdssdf', 'sd', 'sfsas', 'adfafs')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=150bf519 key=/Table/SystemConfigSpan/Start pri=0.02270946 epo=0 ts=1641560805.982775483,1 min=1641560805.825846885,0 seq=9} lock=true stat=PENDING rts=1641560805.825846885,0 wto=false gul=1641560806.325846885,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:06:45.711868",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema3.enum193 AS ENUM ('sfsfs', 'faffas', 'a')",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:06:45.817502",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE schema83.table195 (col195_196 \"char\" NOT NULL, col195_197 VARCHAR NOT NULL, col195_198 FLOAT8 NOT NULL, col195_199 FLOAT8 NOT NULL, PRIMARY KEY (col195_197, col195_198, col195_199 DESC, col195_196 DESC), UNIQUE (col195_196 DESC, col195_197, (col195_198 + col195_199) DESC, col195_198 ASC), FAMILY (col195_196), FAMILY (col195_197, col195_198, col195_199))",
          |   "ALTER TABLE schema83.table195 RENAME TO schema83.table207"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: scanBool: \"\\nWITH\\n\\tdescriptors\\n\\t\\tAS (\\n\\t\\t\\tSELECT\\n\\t\\t\\t\\tcrdb_internal.pb_to_json(\\n\\t\\t\\t\\t\\t'cockroach.sql.sqlbase.Descriptor',\\n\\t\\t\\t\\t\\tdescriptor\\n\\t\\t\\t\\t)-\u003e'table'\\n\\t\\t\\t\\t\\tAS d\\n\\t\\t\\tFROM\\n\\t\\t\\t\\tsystem.descriptor\\n\\t\\t\\tWHERE\\n\\t\\t\\t\\tid = $1::REGCLASS\\n\\t\\t)\\nSELECT\\n\\tEXISTS(\\n\\t\\tSELECT\\n\\t\\t\\t1\\n\\t\\tFROM\\n\\t\\t\\tdescriptors\\n\\t\\tWHERE\\n\\t\\t\\td-\u003e'localityConfig'-\u003e'regionalByRow' IS NOT NULL\\n\\t);\\n\\t\\t\" [\"schema83.table195\"]: ERROR: error in argument for $1: relation \"schema83.table195\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ f26513f0b00c95e2e98d5ce3032abd7e65ff0e3d:

          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:15:01.683483",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:15:01.696354",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:15:01.738178",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq21",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER INDEX public.table50@\"IrrelevantConstraintName\" RENAME TO \"OtherConstraintName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table50\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:15:01.491061",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"europe-west2\" has not been added to the database (SQLSTATE 42602)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ aabce20e9f7a7f00323605d976c8d4db799273c9:

          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "14:07:36.478629",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "14:07:36.674381",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TYPE public.enum88 AS ENUM ('af', 'dsdf', 'dsa', 'afsda', 's', 'sa')",
          |   "CREATE TABLE public.table89 (col89_90 INT2 NOT NULL, col89_91 INTERVAL NOT NULL, col89_92 INT8 NOT NULL, col89_93 REGROLE NOT NULL, col89_94 INT4 NOT NULL, col89_95 REGPROCEDURE NOT NULL, col89_96 TIMETZ NOT NULL, col89_97 TIMETZ[] NOT NULL, col89_98 STRING NOT NULL AS (lower(CAST(col89_93 AS STRING))) VIRTUAL, col89_99 STRING NOT NULL AS (lower(CAST(col89_93 AS STRING))) VIRTUAL, col89_100 INT2 NOT NULL AS (col89_90 + 17310:::INT8) VIRTUAL, INDEX (col89_98 DESC, col89_94, col89_92, col89_90, col89_95 DESC), UNIQUE (col89_95, col89_93 ASC, col89_91 DESC, col89_94 DESC, col89_96 ASC, col89_92 DESC, col89_100))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=3d152f5a key=/Table/SystemConfigSpan/Start pri=0.02153008 epo=0 ts=1641737256.679882129,1 min=1641737256.674293501,0 seq=16} lock=true stat=PENDING rts=1641737256.674293501,0 wto=false gul=1641737257.174293501,0 (SQLSTATE 40001)"
          | }
          | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
          |     1.0s        0           24.3           26.0      5.0    209.7    570.4    570.4 opOk
          |     1.0s        0            2.8            3.0    218.1    604.0    604.0    604.0 txnCmtErr
          |     1.0s        0            2.8            3.0    209.7    234.9    234.9    234.9 txnOk
          |     1.0s        0           28.9           31.0      3.5     75.5    100.7    100.7 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "14:07:36.284315",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE public.table101 (col101_102 INT8 NOT NULL, col101_103 REGCLASS NOT NULL, col101_104 REGCLASS NOT NULL, col101_105 TIMESTAMPTZ NULL, col101_106 REGPROC, col101_107 TIMETZ NULL, col101_108 BOX2D, col101_109 GEOGRAPHY[], col101_110 UUID, INVERTED INDEX (col101_105, lower(CAST(col101_103 AS STRING)), col101_109 DESC), UNIQUE (lower(CAST(col101_104 AS STRING)), col101_104 DESC, col101_108 DESC, col101_107, col101_106, col101_102, col101_110 DESC, col101_105) STORING (col101_103, col101_109))",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 3082c28f2dae9540c4f69ab2ffd6a1d92982b4fe:

          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum16 AS ENUM ('faa', 'fs', 'd', 'sd', 'dsddda')",
          |   "CREATE SCHEMA IF NOT EXISTS schema33 AUTHORIZATION root",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=6a9f0619 key=/Table/SystemConfigSpan/Start pri=0.02565230 epo=0 ts=1641820046.277677843,1 min=1641820045.979671632,0 seq=24} lock=true stat=PENDING rts=1641820045.979671632,0 wto=false gul=1641820046.479671632,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:07:25.894905",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq7",
          |   "CREATE TABLE IF NOT EXISTS public.table24 (col24_25 TIMESTAMPTZ NOT NULL, col24_26 TIMESTAMP NOT NULL, col24_27 INET, col24_28 FLOAT8[] NULL, col24_29 BIT(34) NULL, col24_30 TIMESTAMP NOT NULL, col24_31 TIME NOT NULL, col24_32 VARCHAR NOT NULL, PRIMARY KEY (col24_30, col24_26 ASC), FAMILY (col24_25), FAMILY (col24_27), FAMILY (col24_32), FAMILY (col24_26, col24_30), FAMILY (col24_29), FAMILY (col24_31), FAMILY (col24_28))",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:07:25.983661",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table11 (col11_12 UUID NULL, col11_13 STRING NOT NULL, col11_14 \"char\", PRIMARY KEY (col11_13), FAMILY (col11_12), FAMILY (col11_13), FAMILY (col11_14))"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "querying for validation errors failed: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=8aa73b4a key=/Table/SystemConfigSpan/Start pri=0.00774879 epo=0 ts=1641820045.983488572,0 min=1641820045.983488572,0 seq=7} lock=true stat=ABORTED rts=1641820045.983488572,0 wto=false gul=1641820046.483488572,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:07:25.894841",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table17 (col17_18 NAME NOT NULL, col17_19 \"char\" NOT NULL, PRIMARY KEY (col17_19, col17_18), UNIQUE (col17_19 ASC, col17_18 ASC), INDEX (col17_19 ASC, col17_18 ASC), INDEX (col17_19, col17_18 DESC), INDEX (col17_18 DESC, col17_19 ASC), INDEX (col17_18 DESC, col17_19 DESC), INDEX (col17_18 ASC, col17_19 ASC), UNIQUE (col17_19 DESC, col17_18 DESC), FAMILY (col17_18, col17_19))",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"europe-west2\" has not been added to the database (SQLSTATE 42602)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ f6e5974d563c2700dc68c2f71d4fc05ee1adea6b:

          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table92\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:35:55.12942",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema60 AUTHORIZATION root",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=37cfe4c4 key=/Table/SystemConfigSpan/Start pri=0.00835978 epo=0 ts=1641904556.969898377,1 min=1641904555.129348043,0 seq=15} lock=true stat=PENDING rts=1641904555.129348043,0 wto=false gul=1641904555.629348043,0 (SQLSTATE 40001)"
          | }
          |     3.0s        0            5.0           10.3   1409.3   1744.8   1744.8   1744.8 opOk
          |     3.0s        0            1.0            1.7   2013.3   2013.3   2013.3   2013.3 txnCmtErr
          |     3.0s        0            0.0            0.3      0.0      0.0      0.0      0.0 txnOk
          |     3.0s        0            3.0            9.3      1.0      1.0      1.0      1.0 txnRbk
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError

    cluster.go:1296,context.go:89,cluster.go:1284,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-4090697-1641885242-83-n3cpu4-geo --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 134)
        2: 10051
        3: 9989
        Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 134)
        (1) UNCLASSIFIED_PROBLEM
        Wraps: (2) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod.Monitor
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/roachprod/roachprod.go:596
          | main.glob..func14
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:569
          | main.wrap.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:123
          | github.com/spf13/cobra.(*Command).execute
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
          | github.com/spf13/cobra.(*Command).ExecuteC
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
          | github.com/spf13/cobra.(*Command).Execute
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
          | main.main
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1170
          | runtime.main
          |     /usr/local/go/src/runtime/proc.go:255
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1581
        Wraps: (3) 1: dead (exit status 134)
        Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ b4a27f3634e3e41dc3966214cf05ff6870c055c5:

          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE IF NOT EXISTS public.table34 (col34_35 BIT(3) NOT NULL, col34_36 BOX2D NOT NULL, col34_37 BOOL NOT NULL, PRIMARY KEY (col34_37 ASC, col34_35 ASC, col34_36 ASC), UNIQUE (lower(CAST(col34_36 AS STRING)) ASC), INDEX (col34_35), INDEX (col34_35 DESC, col34_37 DESC, col34_36), UNIQUE (col34_37 DESC, col34_35 DESC), UNIQUE (col34_35 ASC), INDEX (col34_37 ASC, col34_35), INDEX (lower(CAST(col34_36 AS STRING))), INDEX (col34_36 ASC, col34_35 DESC), INDEX (col34_36 ASC, col34_35 ASC, col34_37 ASC))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=005dd245 key=/Table/SystemConfigSpan/Start pri=0.01491392 epo=0 ts=1641995256.893113700,1 min=1641995256.888829793,0 seq=7} lock=true stat=PENDING rts=1641995256.888829793,0 wto=false gul=1641995257.388829793,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:47:36.892851",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table5 (col5_6 TIMESTAMP NOT NULL, PRIMARY KEY (col5_6 DESC))",
          |   "CREATE TYPE public.enum38 AS ENUM ('sddf', 'saaff', 's')",
          |   "ALTER TABLE public.table41 DROP CONSTRAINT IrrelevantConstraintName"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table41\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:47:36.891746",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq10",
          |   "ALTER SEQUENCE public.seq42 RENAME TO public.seq43"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.seq42\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:47:36.892563",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema4 AUTHORIZATION root",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "CREATE SCHEMA schema31 AUTHORIZATION root",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"us-east1\" has not been added to the database (SQLSTATE 42602)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 66442488fcc9c61af6ce438d1bac91cd47f74529:

          |  "clientTimestamp": "13:01:46.346402",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table47 ALTER COLUMN \"col47_48\" DROP DEFAULT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=16d54a6e key=/Table/SystemConfigSpan/Start pri=0.02880963 epo=0 ts=1642078906.941177630,1 min=1642078906.346305933,0 seq=1} lock=true stat=PENDING rts=1642078906.346305933,0 wto=false gul=1642078906.846305933,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:01:46.751044",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE",
          |   "DROP SCHEMA \"schema76\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unknown schema \"schema76\" (SQLSTATE 3F000)"
          | }
          | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
          |     1.0s        0           33.5           36.0     18.9     88.1    285.2    285.2 opOk
          |     1.0s        0            8.4            9.0    251.7    704.6    704.6    704.6 txnCmtErr
          |     1.0s        0            2.8            3.0    151.0    402.7    402.7    402.7 txnOk
          |     1.0s        0           28.9           31.0      7.6     56.6    520.1    520.1 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:01:47.006662",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema71.enum72 AS ENUM ('fdass')"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema71.enum72\" because the target database or schema does not exist (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:01:46.796946",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: collecting referenced descriptors: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - intent pushed): \"sql txn\" meta={id=b977db29 key=/Table/SystemConfigSpan/Start pri=0.02694698 epo=0 ts=1642078907.145197497,1 min=1642078906.796865993,0 seq=0} lock=true stat=PENDING rts=1642078906.796865993,0 wto=false gul=1642078907.296865993,0 (SQLSTATE 40001)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 4df1305911133426c8c5bb2983048c4486a52cfa:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:54:16.633807",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table89 DROP CONSTRAINT IrrelevantConstraintName"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table89\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:54:15.507372",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table43 RENAME COLUMN \"col43_51\" TO \"col43_70\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=158ee86d key=/Table/SystemConfigSpan/Start pri=0.00292063 epo=0 ts=1642164857.183025565,1 min=1642164855.507260067,0 seq=1} lock=true stat=PENDING rts=1642164855.507260067,0 wto=false gul=1642164856.007260067,0 (SQLSTATE 40001)"
          | }
          |     2.0s        0           10.0           17.5    142.6    872.4    872.4    872.4 opOk
          |     2.0s        0            1.0            1.0   1208.0   1208.0   1208.0   1208.0 txnCmtErr
          |     2.0s        0            1.0            2.5    872.4    872.4    872.4    872.4 txnOk
          |     2.0s        0           16.0           19.5      1.8    738.2    838.9    838.9 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:54:17.215717",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE schema113.seq114"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema113.seq114\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:54:16.604835",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table43 ALTER COLUMN col43_55 SET DEFAULT '\"':::STRING"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table43\" (69): computed column \"col43_55\" cannot also have a DEFAULT expression (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 019f070929f94d692d9a0c1306050b9b1044e722:

          |  ],
          |  "expectedExecErrors": "22023",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: at least 3 regions are required for surviving a region failure (SQLSTATE 22023)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:56:07.256256",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE public.table61 (col61_62 REGTYPE NOT NULL, col61_63 BIT(14) NOT NULL, PRIMARY KEY (col61_63 DESC, col61_62 ASC), col61_64 STRING NOT NULL AS (lower(CAST(col61_63 AS STRING))) VIRTUAL, UNIQUE (col61_62 DESC, col61_64 DESC, col61_63 ASC), UNIQUE (lower(CAST(col61_62 AS STRING))), UNIQUE (col61_63 DESC, col61_64 DESC, col61_62 DESC), INDEX (col61_64 ASC, col61_63, col61_62), INDEX (col61_62 ASC), UNIQUE (col61_62 ASC), UNIQUE (col61_62), INDEX (col61_63, col61_64, col61_62 ASC))",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq66",
          |   "CREATE TYPE public.enum67 AS ENUM ('f', 's', 'a', 'fsa', 'fffffa')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=6afb4b7c key=/Table/SystemConfigSpan/Start pri=0.03274572 epo=0 ts=1642251367.263621046,1 min=1642251367.256106016,0 seq=24} lock=true stat=PENDING rts=1642251367.256106016,0 wto=false gul=1642251367.756106016,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:56:07.256555",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE IF NOT EXISTS public.table38 (col38_39 STRING NOT NULL, col38_40 BYTES NULL, col38_41 INTERVAL NOT NULL, col38_42 INTERVAL NOT NULL, col38_43 INT8 NOT NULL, col38_44 REGTYPE, col38_45 TIMETZ NULL, col38_46 TIMESTAMP NOT NULL, col38_47 TIMESTAMP, col38_48 INT2 NOT NULL, col38_49 CHAR NOT NULL, col38_50 BOX2D NOT NULL, col38_51 GEOMETRY, col38_52 REGPROCEDURE NULL, col38_53 TIMESTAMPTZ NOT NULL, col38_54 REGROLE NULL, PRIMARY KEY (col38_43), col38_55 INT2 NOT NULL AS (col38_48 + 31649:::INT8) STORED, col38_56 INT2 NOT NULL AS (col38_48 + col38_43) STORED, UNIQUE (col38_56 ASC, col38_55 DESC, col38_47 DESC, col38_54 ASC, col38_50 DESC), UNIQUE (col38_44 DESC, col38_55 ASC, (col38_48 + col38_43), col38_47), INDEX (col38_48 DESC, col38_45 ASC, col38_56 DESC, col38_42, col38_44 ASC, col38_52 ASC, col38_50 DESC, col38_39 ASC, col38_49, col38_40 DESC, col38_46) STORING (col38_51), UNIQUE ((col38_48 + col38_43), col38_44 ASC, col38_54, col38_52 ASC, lower(CAST(col38_47 AS STRING)), col38_40, col38_43 DESC, col38_55 DESC, (col38_43 + col38_48) DESC, col38_47 ASC, col38_41, col38_53, col38_39, (col38_43 + col38_48) ASC, col38_45) STORING (col38_46, col38_48, col38_51))",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange ADD REGION \"us-west1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-west1\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:56:07.260728",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema34 AUTHORIZATION root",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"europe-west2\" already added to database (SQLSTATE 42710)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ e7edf308b298bbbc11935b497952719dc0c656f9:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:16:15.314196",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TYPE public.enum77 AS ENUM ('d')"
          |  ],
          |  "expectedExecErrors": "42710",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: type \"schemachange.public.enum77\" already exists (SQLSTATE 42710)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:16:15.27911",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER SEQUENCE public.seq43 RENAME TO public.seq198",
          |   "ALTER TABLE public.table220 ALTER COLUMN \"IrrelevantColumnName\" DROP DEFAULT"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table220\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:16:15.698435",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq221",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=6c15b321 key=/Table/SystemConfigSpan/Start pri=0.00178432 epo=0 ts=1642335376.004613930,1 min=1642335375.698355748,0 seq=8} lock=true stat=PENDING rts=1642335375.698355748,0 wto=false gul=1642335376.198355748,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:16:15.139892",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table200 (col200_201 JSONB, col200_202 REGPROC NULL, col200_203 VARCHAR, col200_204 REGCLASS NOT NULL, col200_205 INT4 NOT NULL, col200_206 CHAR NOT NULL, col200_207 \"char\" NOT NULL, col200_208 INTERVAL NULL, col200_209 STRING NULL, col200_210 TIME, col200_211 DATE NULL, col200_212 REGPROCEDURE NOT NULL, col200_213 OID NOT NULL, col200_214 JSONB, col200_215 BOOL, col200_216 FLOAT4 NOT NULL, col200_217 REGPROC NULL, col200_218 STRING AS (lower(CAST(col200_210 AS STRING))) STORED, UNIQUE (col200_210), UNIQUE (col200_204 DESC, col200_203, col200_213 DESC, col200_212 DESC, col200_205 DESC) STORING (col200_201, col200_207, col200_208, col200_209, col200_211, col200_217), UNIQUE (col200_216 DESC, col200_205, lower(col200_207) DESC, col200_211 ASC, col200_206) STORING (col200_201, col200_203, col200_207, col200_208, col200_212, col200_215, col200_217, col200_218), UNIQUE (col200_208 ASC, col200_211) STORING (col200_206, col200_207, col200_212, col200_213, col200_214, col200_215, col200_216, col200_217, col200_218), INDEX (col200_205 DESC, col200_211 DESC, col200_208) STORING (col200_204, col200_206, col200_212, col200_215, col200_217, col200_218))",
          |   "ALTER TABLE public.table200 RENAME TO public.table224"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: relation \"public.table200\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 6b831f0022a111593b442397ad76cce0e2a8cab5:

          |   "CREATE TYPE public.enum13 AS ENUM ('dsf', 'daa', 'fdfdfa', 'a', 'fad')",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:21:15.792728",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:21:15.793896",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE IF NOT EXISTS public.table15 (col15_16 FLOAT4 NULL, col15_17 INTERVAL, col15_18 INT8 NULL, col15_19 TIMESTAMPTZ, col15_20 OID, col15_21 \"char\" NOT NULL, col15_22 UUID, col15_23 UUID, UNIQUE (col15_18 ASC, col15_23 ASC, col15_19 DESC, col15_22 ASC, col15_21 DESC, col15_16 DESC, col15_20 ASC, col15_17 DESC), UNIQUE (col15_20 DESC, lower(CAST(col15_23 AS STRING)) DESC, col15_22, col15_16 DESC, col15_18, col15_21, col15_17 DESC, col15_19 ASC) STORING (col15_23))",
          |   "DROP SCHEMA \"schema25\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unknown schema \"schema25\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:21:15.793496",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema1 AUTHORIZATION root",
          |   "CREATE SEQUENCE IF NOT EXISTS schema1.seq10",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "CREATE SCHEMA IF NOT EXISTS schema26 AUTHORIZATION root",
          |   "CREATE TABLE public.table27 (col27_28 INT4 NOT NULL, col27_29 REGNAMESPACE NULL, col27_30 REGROLE NULL, col27_31 REGTYPE NOT NULL, PRIMARY KEY (col27_31), INDEX (col27_30) STORING (col27_28, col27_29), UNIQUE (col27_29 ASC, col27_31 ASC), INDEX (col27_29 ASC, col27_31, col27_30 DESC, col27_28 ASC), INDEX (col27_31, col27_30 ASC) STORING (col27_29), UNIQUE (col27_30 ASC, col27_31 DESC, col27_29, col27_28 ASC), UNIQUE (col27_30, col27_28, lower(CAST(col27_30 AS STRING)) DESC, col27_29 ASC), UNIQUE (col27_29 ASC, col27_31))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED COMMIT ERROR; Received an unexpected commit error: ERROR: relation \"seq10\" (61): invalid locality config: database schemachange is multi-region enabled, but table seq10 has no locality set (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 0655d082b0d98f27e77471fcced8de94cd9327bc:

          |   "CREATE TABLE IF NOT EXISTS public.table4 (col4_5 TIMESTAMP NOT NULL, col4_6 FLOAT4 NOT NULL, col4_7 REGTYPE NOT NULL, col4_8 OID NOT NULL, col4_9 TIMETZ NOT NULL, PRIMARY KEY (col4_6 DESC, col4_8, col4_5 DESC, col4_9, col4_7 DESC), col4_10 STRING NOT NULL AS (lower(CAST(col4_9 AS STRING))) STORED, INDEX (col4_9 DESC))",
          |   "CREATE SCHEMA schema23 AUTHORIZATION root",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=28b9206a key=/Table/SystemConfigSpan/Start pri=0.03735544 epo=0 ts=1642597523.056674003,1 min=1642597522.666809829,0 seq=22} lock=true stat=PENDING rts=1642597522.666809829,0 wto=false gul=1642597523.166809829,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:05:22.668036",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq39",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=652252a9 key=/Table/SystemConfigSpan/Start pri=0.00013364 epo=0 ts=1642597523.056674003,1 min=1642597522.667976284,0 seq=45} lock=true stat=PENDING rts=1642597522.667976284,0 wto=false gul=1642597523.167976284,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:05:22.670036",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema30 AUTHORIZATION root",
          |   "CREATE TYPE public.enum40 AS ENUM ('fdd', 'adaa', 'ass')",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-east1\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:05:22.668881",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq24",
          |   "CREATE TYPE public.enum29 AS ENUM ('fdda', 'sdaad', 'sfdds', 'fafad', 'aaa', 'ff')",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: Validation FAIL:\nid 57, db schemachange, schema public, name seq24: relation \"seq24\" (57): invalid locality config: database schemachange is multi-region enabled, but table seq24 has no locality set"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 36fb1109856898f2c45c247fe669dc955ccd9f48:

          |  "workerId": 0,
          |  "clientTimestamp": "13:05:03.662906",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq78",
          |   "ALTER INDEX public.table84@\"IrrelevantConstraintName\" RENAME TO \"OtherConstraintName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table84\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:05:03.782208",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table58 (col58_59 VARCHAR NOT NULL, col58_60 STRING NOT NULL, PRIMARY KEY (col58_60 DESC, col58_59 DESC), UNIQUE (col58_60 DESC, col58_59), INDEX (col58_59 ASC, lower(col58_60) DESC), FAMILY (col58_60, col58_59))",
          |   "CREATE SCHEMA schema64 AUTHORIZATION root",
          |   "ALTER TABLE public.table85 ALTER COLUMN IrrelevantColumnName SET NOT NULL"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table85\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:05:03.780859",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:05:03.954261",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq63",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED COMMIT ERROR; Received an unexpected commit error: ERROR: relation \"seq63\" (79): invalid locality config: database schemachange is multi-region enabled, but table seq63 has no locality set (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 74346c2b0bf49d40d044d78a9a10a0ce88188469:

          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:01:21.670898",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table25 ALTER COLUMN IrrelevantColumnName SET DEFAULT \"IrrelevantValue\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table25\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:01:21.67095",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TYPE public.enum27 AS ENUM ('affda')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=9adba715 key=/Table/SystemConfigSpan/Start pri=0.00139982 epo=0 ts=1642770081.676307812,1 min=1642770081.670908681,0 seq=9} lock=true stat=PENDING rts=1642770081.670908681,0 wto=false gul=1642770082.170908681,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:01:21.670299",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"europe-west2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:01:21.671491",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 1c74602223ae3815f20fb9b261b9405ae1a7ce51:

          |  "clientTimestamp": "12:43:22.582245",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"europe-west2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:43:22.505873",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq31",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:43:22.448124",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema56 AUTHORIZATION root",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:43:22.513285",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table39 (col39_40 INTERVAL NOT NULL, col39_41 BOX2D, col39_42 \"char\" NOT NULL, col39_43 OID NOT NULL, col39_44 REGCLASS NOT NULL, col39_45 REGPROCEDURE NULL, col39_46 TIMESTAMPTZ NOT NULL, col39_47 BOX2D NOT NULL, col39_48 DECIMAL NOT NULL, col39_49 INT2 NOT NULL, PRIMARY KEY (col39_48, col39_49 DESC, col39_44, col39_42, col39_47 ASC, col39_43 ASC, col39_40 ASC), col39_50 STRING NOT NULL AS (CASE WHEN col39_40 IS NULL THEN e'\\x12\\x11M3O\\b':::STRING ELSE '':::STRING END) STORED, col39_51 STRING NOT NULL AS (lower(CAST(col39_47 AS STRING))) VIRTUAL, col39_52 STRING AS (lower(CAST(col39_41 AS STRING))) VIRTUAL, col39_53 STRING NOT NULL AS (lower(CAST(col39_47 AS STRING))) STORED, col39_54 STRING AS (lower(CAST(col39_41 AS STRING))) VIRTUAL, col39_55 INT2 NOT NULL AS (col39_49 + 25420:::INT8) STORED, INDEX ((CASE WHEN col39_45 IS NULL THEN e'\\x01\\x05\\x0f9':::STRING ELSE e'\\x1e7':::STRING END) DESC, col39_45, col39_55 ASC, col39_48 ASC, (CASE WHEN col39_46 IS NULL THEN '``}':::STRING ELSE e'\\\\\\x1a':::STRING END) ASC, col39_49 DESC, col39_53), UNIQUE (col39_41 ASC, col39_42 ASC, col39_51 ASC, col39_44 DESC, col39_49 ASC), FAMILY (col39_49), FAMILY (col39_50), FAMILY (col39_42), FAMILY (col39_43), FAMILY (col39_41), FAMILY (col39_55), FAMILY (col39_48, col39_40, col39_53, col39_47), FAMILY (col39_44, col39_45), FAMILY (col39_46))",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "CREATE TYPE public.enum88 AS ENUM ('fssa', 'dss', 'adasf')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED COMMIT ERROR; Received an unexpected commit error: ERROR: relation \"table39\" (74): invalid locality config: database schemachange is multi-region enabled, but table table39 has no locality set (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ ea903ef55abfbbdd8fd963fc7ce5975324d238e5:

          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:13:10.946589",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:13:11.17803",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table36 ADD COLUMN IrrelevantColumnName string"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table36\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:13:10.942816",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:13:11.703407",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR DURING ROLLBACK;: conn closed"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ f479a040709016d40e64ea165b68cbd0d66f8ded:

          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TYPE public.enum126 AS ENUM ('ddf')",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"europe-west2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:11:15.425843",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq127",
          |   "CREATE TABLE IF NOT EXISTS schema1.table129 (col129_130 REGTYPE NULL, col129_131 BOOL NULL, col129_132 JSONB NULL, col129_133 INT4 NOT NULL, col129_134 TIMESTAMP NULL, col129_135 \"char\"[] NULL, col129_136 REGPROC NOT NULL, col129_137 BOX2D, col129_138 INTERVAL NOT NULL, col129_139 REGPROC NULL, col129_140 TIME NULL, col129_141 GEOMETRY, col129_142 TIME[] NOT NULL, INVERTED INDEX (col129_132 DESC), FAMILY (col129_133, col129_131, col129_138, col129_139), FAMILY (col129_130), FAMILY (col129_135), FAMILY (col129_137), FAMILY (col129_134), FAMILY (col129_142), FAMILY (col129_132), FAMILY (col129_140, col129_141), FAMILY (col129_136))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=60d9b2cc key=/Table/SystemConfigSpan/Start pri=0.02621692 epo=0 ts=1643116275.798960503,1 min=1643116275.425755911,0 seq=15} lock=true stat=PENDING rts=1643116275.425755911,0 wto=false gul=1643116275.925755911,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:11:15.486861",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema81 AUTHORIZATION root",
          |   "DROP INDEX schema1.table145@\"IrrelevantIndexName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema1.table145\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:11:15.616786",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE schema1.table107 (col107_108 REGPROC NULL, col107_109 FLOAT4 NOT NULL, col107_110 \"char\", col107_111 NAME NOT NULL, col107_112 DECIMAL NOT NULL, col107_113 BYTES NOT NULL, col107_114 DECIMAL, col107_115 GEOMETRY NOT NULL, col107_116 TIMESTAMP NOT NULL, col107_117 REGPROC, col107_118 BOX2D, col107_119 DECIMAL, col107_120 REGTYPE NULL, col107_121 REGPROC NOT NULL, col107_122 FLOAT4 NOT NULL, col107_123 BIT(40) NOT NULL, col107_124 FLOAT4 NOT NULL AS (col107_122 + col107_109) STORED, col107_125 FLOAT4 NOT NULL AS (col107_109 + col107_122) STORED, FAMILY (col107_111, col107_108), FAMILY (col107_118, col107_120, col107_116), FAMILY (col107_115), FAMILY (col107_113, col107_119, col107_124), FAMILY (col107_125), FAMILY (col107_123, col107_112, col107_117, col107_121, col107_110), FAMILY (col107_109), FAMILY (col107_122, col107_114))",
          |   "DROP TABLE IF EXISTS schema1.table107 CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: relation \"schema1.table107\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 20b5defb2ae53273ca2d3642e585b57f4645b87d:

          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE public.table41 (col41_42 DECIMAL NOT NULL, col41_43 REGCLASS NOT NULL, col41_44 VARCHAR NOT NULL, PRIMARY KEY (col41_42 DESC, col41_44 DESC, col41_43), col41_45 STRING NOT NULL AS (CASE WHEN col41_43 IS NULL THEN e'\\x19\\x1aX!\\x0f@\\x04hf':::STRING ELSE e'\\r\\x0ea\\x02{+\\x0eV ':::STRING END) STORED, col41_46 STRING NOT NULL AS (CASE WHEN col41_43 IS NULL THEN '':::STRING ELSE e'\\x1a\\x04\\x11.l':::STRING END) STORED, UNIQUE (col41_45, col41_42 DESC) STORING (col41_46), FAMILY (col41_46), FAMILY (col41_44, col41_45), FAMILY (col41_42, col41_43))",
          |   "CREATE TYPE public.enum47 AS ENUM ('sadaaf')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=92a3856a key=/Table/SystemConfigSpan/Start pri=0.01708227 epo=0 ts=1643202370.793007642,1 min=1643202370.792830447,0 seq=16} lock=true stat=PENDING rts=1643202370.792830447,0 wto=false gul=1643202371.292830447,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:06:10.792073",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "ALTER TABLE public.table49 ALTER COLUMN IrrelevantColumnName SET NOT NULL"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table49\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:06:10.791361",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TYPE public.enum50 AS ENUM ('ffsad')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=7263d459 key=/Table/SystemConfigSpan/Start pri=0.00880286 epo=0 ts=1643202370.793007642,1 min=1643202370.791287066,0 seq=9} lock=true stat=PENDING rts=1643202370.791287066,0 wto=false gul=1643202371.291287066,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:06:10.791864",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ ba879c1d5404fb03f1e58616fec407aa9502df7b:

          |   "CREATE TYPE public.enum37 AS ENUM ('fsfa', 'saasa', 'fdaafd', 'dfsaf', 'sd')",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=2cb20ee9 key=/Table/SystemConfigSpan/Start pri=0.01371116 epo=0 ts=1643289036.499323595,1 min=1643289036.220991624,0 seq=9} lock=true stat=PENDING rts=1643289036.220991624,0 wto=false gul=1643289036.720991624,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:10:36.212036",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq75",
          |   "CREATE TYPE public.enum95 AS ENUM ('f', 'faadd')",
          |   "ALTER DATABASE schemachange ADD REGION \"us-west1\"",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=d330895b key=/Table/SystemConfigSpan/Start pri=0.00251448 epo=0 ts=1643289036.593168513,1 min=1643289036.211956231,0 seq=54} lock=true stat=PENDING rts=1643289036.211956231,0 wto=false gul=1643289036.711956231,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:10:36.32171",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema20 AUTHORIZATION root",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:10:36.221584",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ f63f6d6f7e8b850b3eaf67e7f6920f251c8598f0:

          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=18db813b key=/Table/SystemConfigSpan/Start pri=0.01954851 epo=0 ts=1643375383.778031266,1 min=1643375382.895066234,0 seq=32} lock=true stat=PENDING rts=1643375382.895066234,0 wto=false gul=1643375383.395066234,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:09:43.011",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE SCHEMA schema90 AUTHORIZATION root",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "ALTER TABLE schema109.table110 DROP CONSTRAINT IrrelevantConstraintName"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema109.table110\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:09:43.218787",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE IF NOT EXISTS public.table53 (col53_54 DECIMAL NOT NULL, col53_55 CHAR NULL, col53_56 REGCLASS, col53_57 BIT(39) NULL, col53_58 INT4 NOT NULL, col53_59 INET NOT NULL, col53_60 STRING NOT NULL AS (lower(CAST(col53_59 AS STRING))) VIRTUAL, col53_61 INT4 NOT NULL AS (col53_58 + (-1167317526):::INT8) VIRTUAL, col53_62 INT4 NOT NULL AS (col53_58 + 127:::INT8) STORED, col53_63 STRING NULL AS (lower(col53_55)) VIRTUAL, col53_64 STRING NULL AS (lower(col53_55)) VIRTUAL, INDEX (col53_58) STORING (col53_54, col53_55, col53_56, col53_57), UNIQUE (col53_55 DESC), UNIQUE (col53_55 ASC, lower(CAST(col53_59 AS STRING)) ASC, col53_61 DESC, col53_59 DESC, col53_60 ASC, col53_58 ASC) STORING (col53_56, col53_62), INDEX ((CASE WHEN col53_56 IS NULL THEN e'\\U00002603':::STRING ELSE '!z+X}W}':::STRING END) DESC, col53_63, col53_57 DESC, col53_54 ASC, col53_61) STORING (col53_58, col53_62), INDEX (col53_63, col53_58 ASC, col53_61 ASC, col53_55 ASC, col53_64 ASC) STORING (col53_54, col53_62), FAMILY (col53_54, col53_62, col53_58, col53_56), FAMILY (col53_55), FAMILY (col53_59, col53_57))",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: Validation FAIL:\nid 76, db schemachange, schema public, name table53: relation \"table53\" (76): invalid locality config: database schemachange is multi-region enabled, but table table53 has no locality set"
          | }
          | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
          |     1.0s        0           36.8           40.0     14.7    234.9    369.1    369.1 opOk
          |     1.0s        0            4.6            5.0    503.3    939.5    939.5    939.5 txnCmtErr
          |     1.0s        0            2.8            3.0    268.4    570.4    570.4    570.4 txnOk
          |     1.0s        0           26.7           29.0      3.7     41.9     44.0     44.0 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:09:43.869132",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-east1\" to database schemachange (SQLSTATE 42P12)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 443e0395c03f0d11182f8863a4ef62538c0f8946:

          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:52:21.103454",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table71 ADD COLUMN IrrelevantColumnName string"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table71\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:52:21.155348",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-east1\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:52:20.842045",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum61 AS ENUM ('dsdfff', 'sfdsa', 'f', 'ssa')",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:52:20.797961",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"europe-west2\" has not been added to the database (SQLSTATE 42602)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ e9fd200d3567aa542da6cd1f255e4d2971cbdd9e:

          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:37:45.273242",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\"",
          |   "CREATE TABLE IF NOT EXISTS public.table142 (col142_143 BOOL NOT NULL, col142_144 UUID, col142_145 GEOMETRY NULL, col142_146 CHAR NOT NULL, col142_147 INT8 NOT NULL, PRIMARY KEY (col142_143 ASC, col142_147, col142_146), col142_148 STRING NULL AS (lower(CAST(col142_145 AS STRING))) STORED, col142_149 STRING AS (lower(CAST(col142_144 AS STRING))) VIRTUAL, col142_150 INT8 NOT NULL AS (col142_147 + (-7471558073420242288):::INT8) VIRTUAL, col142_151 STRING NOT NULL AS (lower(col142_146)) STORED, INVERTED INDEX (col142_148 ASC, col142_149 ASC, col142_151 ASC, col142_147, col142_150, col142_144 ASC, lower(CAST(col142_143 AS STRING)), col142_145 DESC), INDEX (col142_146 ASC, col142_150 DESC, lower(CAST(col142_143 AS STRING)), col142_143 ASC), UNIQUE (col142_150, col142_144, col142_143 DESC, col142_146 ASC, col142_147 ASC) STORING (col142_145, col142_151), INDEX (lower(CAST(col142_144 AS STRING)) ASC, col142_150), INVERTED INDEX (col142_144 DESC, col142_143 ASC, col142_148 ASC, col142_149, col142_150, col142_151 DESC, col142_145 DESC), UNIQUE (col142_148 DESC, col142_143, (col142_147 + 248875411809617998:::INT8) ASC, col142_146 DESC, col142_150 ASC, col142_149 DESC, col142_144 DESC), FAMILY (col142_144, col142_145), FAMILY (col142_148), FAMILY (col142_147), FAMILY (col142_151), FAMILY (col142_146), FAMILY (col142_143))",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=d122f76c key=/Table/SystemConfigSpan/Start pri=0.00441894 epo=0 ts=1643719065.994164957,1 min=1643719065.273140302,0 seq=61} lock=true stat=PENDING rts=1643719065.273140302,0 wto=false gul=1643719065.773140302,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:37:45.448698",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema80 AUTHORIZATION root",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE SCHEMA IF NOT EXISTS schema152 AUTHORIZATION root",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=fa38c16c key=/Table/SystemConfigSpan/Start pri=0.03620717 epo=0 ts=1643719066.131682333,1 min=1643719065.448617039,0 seq=30} lock=true stat=PENDING rts=1643719065.448617039,0 wto=false gul=1643719065.948617039,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:37:45.250997",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "ALTER DATABASE schemachange ADD REGION \"us-west1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"us-west1\" already added to database (SQLSTATE 42710)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 5afb632f77eee9f09f2adfa2943e1979ec4ebedf:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:58:51.745008",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum24 AS ENUM ('ddsf', 'ff')",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:58:51.744381",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"europe-west2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:58:51.747158",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=03f0a8a5 key=/Table/SystemConfigSpan/Start pri=0.00299946 epo=0 ts=1643806731.957433464,1 min=1643806731.747094890,0 seq=24} lock=true stat=PENDING rts=1643806731.747094890,0 wto=false gul=1643806732.247094890,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:58:51.745803",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"us-west1\" has not been added to the database (SQLSTATE 42602)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ c28fca1ce1cc68976e36164a545b8a4d7839de08:

          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema26 AUTHORIZATION root",
          |   "DROP VIEW IF EXISTS public.view56 RESTRICT",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=3272443d key=/Table/SystemConfigSpan/Start pri=0.01172186 epo=0 ts=1643893559.025639605,1 min=1643893558.718418418,0 seq=15} lock=true stat=PENDING rts=1643893558.718418418,0 wto=false gul=1643893559.218418418,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:05:58.85856",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema5.enum55 AS ENUM ('fds', 'afffa')",
          |   "CREATE TYPE schema5.enum57 AS ENUM ('s', 'afs', 'dasss')",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:05:58.549684",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE SCHEMA IF NOT EXISTS schema39 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=88dc6f5e key=/Table/SystemConfigSpan/Start pri=0.00194195 epo=0 ts=1643893559.148174340,1 min=1643893558.549608883,0 seq=8} lock=true stat=PENDING rts=1643893558.549608883,0 wto=false gul=1643893559.049608883,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:05:58.852716",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE schema5.table47 (col47_48 NAME NOT NULL, col47_49 DATE, col47_50 TIME NOT NULL, col47_51 INT4 NULL, col47_52 STRING NOT NULL, PRIMARY KEY (col47_48, col47_52 ASC, col47_50 DESC), col47_53 STRING AS (CASE WHEN col47_49 IS NULL THEN e'4O\\x15X\\x1d\\x01':::STRING ELSE 'm}g#O':::STRING END) STORED, col47_54 STRING NOT NULL AS (lower(CAST(col47_50 AS STRING))) VIRTUAL, UNIQUE (col47_54 ASC, col47_53 ASC, col47_50, col47_49 ASC, col47_48 ASC, col47_51), UNIQUE (col47_53 DESC, col47_48 DESC), INDEX ((CASE WHEN col47_49 IS NULL THEN e'E\\x06$G+ byw':::STRING ELSE '':::STRING END) DESC), INDEX (col47_49, col47_52 ASC, col47_50, col47_53 DESC, col47_48 DESC, col47_51), INDEX (col47_48 ASC, col47_50 DESC, col47_53 DESC, col47_51 DESC), INDEX (col47_49 DESC, lower(CAST(col47_50 AS STRING)) DESC, col47_54 ASC, col47_53, col47_52 DESC, col47_48))",
          |   "DROP TABLE IF EXISTS schema5.table47 RESTRICT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: relation \"schema5.table47\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 9b06fffa0e5ffed8aa92cd0d860380dafe993bd2:

          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum85 AS ENUM ('fadsa', 'ssasff', 's', 'dffsfd', 'fdafs')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=528cf36c key=/Table/SystemConfigSpan/Start pri=0.01544682 epo=0 ts=1643979250.522141518,2 min=1643979250.302782370,0 seq=9} lock=true stat=PENDING rts=1643979250.302782370,0 wto=false gul=1643979250.802782370,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:54:10.398543",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "ALTER TABLE schema50.table87 DROP CONSTRAINT IrrelevantConstraintName"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema50.table87\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:54:10.499337",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"schema50\" CASCADE",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"europe-west2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:54:10.292789",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq82",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "CREATE TYPE public.enum93 AS ENUM ('sfff', 'ff', 'ss')",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 0aa40c1edfb9166b169e91eaa19514ba0898e10c:

          |   "BEGIN",
          |   "DROP SCHEMA \"schema4\" CASCADE",
          |   "CREATE TYPE public.enum254 AS ENUM ('asaaf', 'saa')",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=a51287db key=/Table/SystemConfigSpan/Start pri=0.00379756 epo=0 ts=1644065557.371144010,1 min=1644065556.806979883,0 seq=55} lock=true stat=PENDING rts=1644065556.806979883,0 wto=false gul=1644065557.306979883,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:52:37.156886",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:52:36.984715",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema229 AUTHORIZATION root",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:52:36.919732",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"europe-west2\" already added to database (SQLSTATE 42710)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 79c1f34aa3c91977ed6784338d7383931733d0b6:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:55:30.393259",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=d29aec68 key=/Table/SystemConfigSpan/Start pri=0.00468208 epo=0 ts=1644324931.210800224,1 min=1644324930.393195619,0 seq=10} lock=true stat=PENDING rts=1644324930.393195619,0 wto=false gul=1644324930.893195619,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:55:29.93751",
          |  "ops": [
          |   "BEGIN",
          |   "DROP VIEW schema4.view86 CASCADE",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=b57c1817 key=/Table/SystemConfigSpan/Start pri=0.06594411 epo=0 ts=1644324931.098299173,2 min=1644324929.937463756,0 seq=21} lock=true stat=PENDING rts=1644324929.937463756,0 wto=false gul=1644324930.437463756,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:55:28.797597",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE IF EXISTS public.seq67",
          |   "ALTER TABLE public.table31 ALTER COLUMN \"col31_33\" DROP NOT NULL",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:55:30.338769",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table31 ADD COLUMN col31_229 INTERVAL NULL",
          |   "ALTER TABLE public.table31 RENAME COLUMN \"col31_32\" TO \"col31_268\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: Validation FAIL:\nid 64, db schemachange, schema public, name table31: mutation job 734837246700290049: job not found"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ 92dfb8a4370274257b99cd9bccbe3854e243c268:

          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:07:03.683",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema109 AUTHORIZATION root",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER TABLE schema109.table134 ALTER COLUMN \"IrrelevantColumnName\" DROP DEFAULT"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema109.table134\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:07:03.659383",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE SCHEMA IF NOT EXISTS schema131 AUTHORIZATION root",
          |   "CREATE TYPE schema135.enum136 AS ENUM ('fsada')"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema135.enum136\" because the target database or schema does not exist (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:07:03.286348",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table111 (col111_112 UUID NOT NULL, col111_113 TIMESTAMPTZ NULL, col111_114 DATE NULL, col111_115 INET, col111_116 STRING NOT NULL, col111_117 BYTES NOT NULL, col111_118 TIMESTAMP, col111_119 REGTYPE NOT NULL, col111_120 TIMESTAMP NOT NULL, col111_121 \"char\" NOT NULL, PRIMARY KEY (col111_112 ASC, col111_119, col111_120 DESC), col111_122 STRING NOT NULL AS (CASE WHEN col111_119 IS NULL THEN e'b(}O\\x02':::STRING ELSE e'\\r':::STRING END) VIRTUAL, UNIQUE (col111_122) STORING (col111_113, col111_114, col111_118, col111_121))",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "CREATE TABLE IF NOT EXISTS public.table137 (col137_138 BIT(26) NOT NULL, col137_139 REGPROCEDURE NOT NULL, col137_140 OID NOT NULL, col137_141 REGROLE NOT NULL, col137_142 OID NULL, col137_143 REGPROC NOT NULL, col137_144 GEOGRAPHY NOT NULL, col137_145 TIMESTAMPTZ NULL, col137_146 GEOMETRY, col137_147 OID NOT NULL, col137_148 INT8, col137_149 UUID NOT NULL, col137_150 BOX2D, col137_151 GEOGRAPHY NULL, col137_152 BIT(21), col137_153 BOX2D, PRIMARY KEY (col137_140, col137_141 ASC), col137_154 STRING NOT NULL AS (CASE WHEN col137_139 IS NULL THEN e'Q\\rFN\\x01k\\x06':::STRING ELSE 'XLC$':::STRING END) STORED, col137_155 STRING AS (lower(CAST(col137_152 AS STRING))) STORED, INDEX (col137_152 DESC, col137_154 DESC), INDEX (col137_153, col137_148 ASC, col137_152 ASC, col137_143 ASC, col137_142 ASC, (CASE WHEN col137_145 IS NULL THEN 'N0':::STRING ELSE e'\\x1bE$\u003e.su':::STRING END) ASC, col137_154 DESC, col137_140 ASC) STORING (col137_138, col137_139, col137_144, col137_145, col137_149))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED COMMIT ERROR; Received an unexpected commit error: ERROR: relation \"table111\" (86): invalid locality config: database schemachange is multi-region enabled, but table table111 has no locality set (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.schemachange/random-load failed with artifacts on release-21.2 @ c7d2f46924e8af82a3b2bf175e32adc1d44b06f7:

          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-west1\" to database schemachange (SQLSTATE 42P12)"
          | }
          |     7.0s        0           10.0           13.1     96.5   1543.5   1543.5   1543.5 opOk
          |     7.0s        0            3.0            1.6   3623.9   4160.7   4160.7   4160.7 txnCmtErr
          |     7.0s        0            0.0            0.9      0.0      0.0      0.0      0.0 txnOk
          |     7.0s        0            6.0           12.4     65.0     71.3     71.3     71.3 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:04:56.66949",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema225 AUTHORIZATION root",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-west1\"",
          |   "CREATE SCHEMA schema284 AUTHORIZATION root",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq285",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=de27f472 key=/Table/SystemConfigSpan/Start pri=0.01467355 epo=0 ts=1644498298.289961919,1 min=1644498296.669430730,0 seq=62} lock=true stat=PENDING rts=1644498296.669430730,0 wto=false gul=1644498297.169430730,0 (SQLSTATE 40001)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:04:56.746558",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "13:04:56.944993",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum223 AS ENUM ('fsaa', 'aff')",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"europe-west2\"",
          |   "ALTER DATABASE schemachange ADD REGION \"europe-west2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"europe-west2\" already added to database (SQLSTATE 42710)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63518 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61698 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56235 roachtest: schemachange/random-load failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!