search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
29.99k stars 3.79k forks source link

roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed #70004

Closed cockroach-teamcity closed 2 years ago

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 99a4816fc272228a63df20dae3cc41d235e705f3:

          |  "workerId": 0,
          |  "clientTimestamp": "06:36:15.414061",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table21 (col21_22 \"char\" NOT NULL, col21_23 OID NOT NULL, col21_24 JSONB NULL, col21_25 STRING[] NOT NULL, col21_26 NAME NOT NULL, col21_27 INT4 NULL, col21_28 TIMESTAMPTZ NOT NULL, col21_29 BIT(13) NOT NULL, col21_30 INT2[], INVERTED INDEX ((CASE WHEN col21_30 IS NULL THEN e'85\\bp\\x19r\\x10\\x14':::STRING ELSE e'*\\x0e)``\\x13\\x1d':::STRING END) ASC, col21_29 ASC, col21_24), UNIQUE (col21_22), FAMILY (col21_22, col21_28, col21_26, col21_30, col21_25, col21_24), FAMILY (col21_23, col21_27), FAMILY (col21_29))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:36:15.440435",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:36:15.450918",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER VIEW public.view31 RENAME TO public.view32"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.view31\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:36:15.460751",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table21 ALTER COLUMN crdb_internal_idx_expr SET DEFAULT '6K':::STRING:::NAME",
          |   "ALTER TABLE public.table21 RENAME COLUMN \"col21_30\" TO \"col21_33\"",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE",
          |   "CREATE SCHEMA IF NOT EXISTS schema34 AUTHORIZATION root",
          |   "CREATE UNIQUE INDEX index21_35 ON public.table21 (col21_33 DESC, col21_27) STORING (col21_22, crdb_internal_idx_expr, col21_24, col21_26, col21_25)"
          |  ],
          |  "expectedExecErrors": "0A000,XXUUU",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: column col21_33 is of type int2[] and thus is not indexable (SQLSTATE 0A000)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

Jira issue: CRDB-9892

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 66a451b4e8e948925782c3877f49d0777c9db812:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:30:55.117781",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER SEQUENCE public.seq61 RENAME TO public.seq62",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east-2\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:30:55.158815",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:30:55.165412",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE INDEX IF NOT EXISTS index49_63 ON public.table49 (col49_57) STORING (col49_55, col49_58)"
          |  ],
          |  "expectedExecErrors": "XXUUU",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"table49\" (66): index \"index49_63\" cannot store virtual column \"col49_58\" (SQLSTATE XXUUU)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:30:55.222573",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER TABLE public.table49 RENAME TO public.table64",
          |   "ALTER TABLE public.table49 ALTER COLUMN \"col49_65\" DROP DEFAULT"
          |  ],
          |  "expectedExecErrors": "42703",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"public.table49\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 66a451b4e8e948925782c3877f49d0777c9db812:

          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:14:25.945678",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema19.table25 ALTER COLUMN \"col25_26\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "42611",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col25_26\" is not a computed column (SQLSTATE 42611)"
          | }
          |     2.0s        0           13.0           15.0      3.8      7.6     11.5     11.5 opOk
          |     2.0s        0            0.5            0.5     56.6     56.6     56.6     56.6 txnCmtErr
          |     2.0s        0            4.0            4.0     19.9    159.4    159.4    159.4 txnOk
          |     2.0s        0            4.0            7.0      1.0      6.0      6.0      6.0 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:14:26.01907",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table17 ADD COLUMN col17_40 FLOAT4 NOT NULL",
          |   "ALTER TABLE public.table17 ALTER COLUMN col17_24 SET DEFAULT 0.044226642698049545:::FLOAT8",
          |   "CREATE TABLE schema14.table41 AS SELECT schema19.table25.col25_32, schema19.table25.col25_27, schema19.table25.col25_34, schema19.table25.col25_26, schema19.table25.col25_35, schema19.table25.col25_28, schema19.table25.col25_30, schema19.table25.col25_31, schema19.table25.col25_33, schema19.table25.col25_29, schema19.table25.crdb_internal_idx_expr_1, public.table17.col17_24 FROM schema19.table25, public.table17",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:14:26.472792",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema14.table41 RENAME TO schema14.table42",
          |   "ALTER TABLE schema14.table42 ALTER COLUMN \"col25_34\" DROP NOT NULL",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "CREATE INDEX IF NOT EXISTS index25_43 ON schema19.table25 (col25_28 DESC, col25_32, col25_31 ASC, col25_34 DESC, col25_36, crdb_internal_idx_expr_1, col25_33, col25_27, col25_29, col25_35 ASC, crdb_internal_idx_expr ASC, col25_30) STORING (col25_37, col25_26)"
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"crdb_internal_idx_expr_1\" is inaccessible and cannot be referenced (SQLSTATE 42703)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 8fdbf4dacfdf3c2032937fe5359255f3dc13c61a:

          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: the following columns are not indexable due to their type: col25_37 (type geography), col25_31 (type bytes[]) (SQLSTATE 0A000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:36:53.716082",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table25 ALTER COLUMN col25_28 SET DEFAULT 3513394934:::OID",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:36:53.807284",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER TABLE public.table25 ALTER COLUMN \"col25_27\" DROP NOT NULL",
          |   "ALTER TABLE public.table25 ALTER COLUMN \"col25_34\" SET NOT NULL",
          |   "ALTER TABLE public.table25 ALTER COLUMN \"col25_34\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "42611",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col25_34\" is not a computed column (SQLSTATE 42611)"
          | }
          | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
          |     1.0s        0           20.9           22.0      2.0      6.8     11.0     11.0 opOk
          |     1.0s        0            1.9            2.0     18.9     92.3     92.3     92.3 txnOk
          |     1.0s        0           12.3           13.0      0.5      0.8      0.8      0.8 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:36:53.983117",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq43 OWNED BY public.table25.col25_38",
          |   "ALTER TABLE public.table25 ALTER COLUMN col25_31 SET DEFAULT ARRAY['\\x0ead':::BYTES]",
          |   "ALTER TABLE public.table25 RENAME COLUMN \"col25_38\" TO \"col25_44\"",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east-2\"",
          |   "ALTER TABLE public.table25 RENAME TO public.table45",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED COMMIT ERROR; Received an unexpected commit error: ERROR: relation \"seq43\" (65): invalid locality config: database schemachange is multi-region enabled, but table seq43 has no locality set (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 8fdbf4dacfdf3c2032937fe5359255f3dc13c61a:

          | I211203 08:14:01.771384 71 workload/pgx_helpers.go:72  [-] 4  pgx logger [error]: Exec logParams=map[args:[] err:ERROR: region "us-east1" already added to database (SQLSTATE 42710) sql:ALTER DATABASE schemachange ADD REGION "us-east1"]
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region "us-east1" already added to database (SQLSTATE 42710)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 2000 --concurrency 1 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:14:01.607495",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq1",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:14:01.628395",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:14:01.636162",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE IF EXISTS public.seq1",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"us-east1\" already added to database (SQLSTATE 42710)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ de4cc9bf7f6719ef198958de984ab861ca02a8c5:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:28:10.277194",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE schema50.table68 AS SELECT schema50.table68.col68_69, schema50.table68.col68_78, schema50.table68.crdb_internal_idx_expr_8, schema50.table68.crdb_internal_idx_expr_1, schema50.table68.col68_76, schema50.table68.crdb_internal_idx_expr_2, schema50.table68.col68_83, schema50.table68.col68_70, schema50.table68.crdb_internal_idx_expr_3, schema50.table68.col68_74, schema50.table68.col68_80, schema50.table68.col68_83, schema50.table68.col68_84, schema50.table68.crdb_internal_idx_expr_2, schema50.table68.col68_71, schema50.table68.crdb_internal_idx_expr_1, schema50.table68.col68_85, schema50.table68.crdb_internal_idx_expr_7, schema50.table68.col68_72, schema50.table68.crdb_internal_idx_expr_6, schema50.table68.col68_76, schema50.table68.col68_81, schema50.table68.col68_78, schema50.table68.crdb_internal_idx_expr_4, schema50.table68.col68_79, schema50.table68.crdb_internal_idx_expr_8, schema50.table68.col68_69 FROM schema50.table68, schema50.table68"
          |  ],
          |  "expectedExecErrors": "42701,42712,42P07",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table68\" specified more than once (missing AS clause) (SQLSTATE 42712)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:28:10.368272",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema50.table68 ALTER COLUMN \"col68_81\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "42611",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col68_81\" is not a computed column (SQLSTATE 42611)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:28:10.41961",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema50.table68 ALTER COLUMN \"col68_85\" DROP NOT NULL",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE",
          |   "DROP SCHEMA \"schema50\" CASCADE",
          |   "CREATE TABLE public.table93 (col93_94 BIT(48) NULL, col93_95 NAME NOT NULL, col93_96 INT8 NOT NULL, col93_97 OID NOT NULL, col93_98 REGNAMESPACE NULL, col93_99 TIMESTAMP, col93_100 INET, col93_101 INET NOT NULL, col93_102 VARCHAR[] NOT NULL, col93_103 FLOAT4, col93_104 JSONB NULL, col93_105 REGROLE NULL, col93_106 UUID NOT NULL, PRIMARY KEY (col93_96 ASC, col93_101, col93_106 ASC, col93_95 ASC), col93_107 STRING NOT NULL AS (CASE WHEN col93_102 IS NULL THEN e'\\x15\\x1b_,p-':::STRING ELSE '``Riz':::STRING END) VIRTUAL, col93_108 STRING AS (lower(CAST(col93_99 AS STRING))) STORED, col93_109 STRING NOT NULL AS (lower(CAST(col93_101 AS STRING))) STORED, col93_110 STRING AS (lower(CAST(col93_99 AS STRING))) VIRTUAL, col93_111 STRING NULL AS (lower(CAST(col93_94 AS STRING))) VIRTUAL, INDEX (lower(CAST(col93_101 AS STRING)) ASC, col93_108 DESC) STORING (col93_94, col93_97, col93_98, col93_100, col93_102, col93_103, col93_105, col93_109), INDEX (col93_103), UNIQUE (col93_103, col93_111 DESC) STORING (col93_94, col93_97, col93_98, col93_102, col93_109), UNIQUE (col93_97), UNIQUE (col93_94, col93_98 ASC, lower(CAST(col93_99 AS STRING)) DESC, col93_99, col93_95, col93_97, lower(CAST(col93_98 AS STRING)), col93_111 DESC, col93_96, col93_107 DESC, col93_108 DESC, col93_109 ASC))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:28:10.669811",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: scanBool: \"\\n\\t\\tSELECT json_array_length(\\n        crdb_internal.pb_to_json(\\n            'cockroach.sql.sqlbase.Descriptor',\\n            descriptor\\n        )-\u003e'table'-\u003e'mutations'\\n       )\\n       \u003e 0\\n\\t\\tFROM system.descriptor\\n\\t  WHERE id = $1::REGCLASS\\n\\t\\t\" [\"public.table93\"]: can't scan into dest[0]: cannot assign NULL to *bool"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ de4cc9bf7f6719ef198958de984ab861ca02a8c5:

          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/schemachange_random_load.go:92
          | main.(*testRunner).runTest.func2
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:777
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1581
        Wraps: (2) output in run_080757.204741232_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3847844-1638688297-21-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 2000 --concurrency 1 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I211205 08:07:58.218680 1 workload/cli/run.go:408  [-] 1  creating load generator...
          | I211205 08:07:58.286566 1 workload/cli/run.go:439  [-] 2  creating load generator... done (took 67.884045ms)
          | I211205 08:07:58.324769 73 workload/pgx_helpers.go:72  [-] 3  pgx logger [error]: Exec logParams=map[args:[] err:ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602) sql:ALTER DATABASE schemachange SURVIVE ZONE FAILURE]
          | I211205 08:07:58.414254 73 workload/pgx_helpers.go:72  [-] 4  pgx logger [error]: Exec logParams=map[args:[] err:ERROR: relation "public.table1" does not exist (SQLSTATE 42P01) sql:ALTER TABLE public.table1 SET LOCALITY REGIONAL BY ROW]
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation "public.table1" does not exist (SQLSTATE 42P01)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 2000 --concurrency 1 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:07:58.287155",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:07:58.325803",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table1 (col1_2 JSONB, col1_3 GEOGRAPHY NULL, col1_4 REGPROCEDURE NOT NULL, col1_5 INT2 NOT NULL, col1_6 TIMESTAMPTZ, col1_7 STRING AS (CASE WHEN col1_6 IS NULL THEN e'\\x00':::STRING ELSE ':Y':::STRING END) VIRTUAL, INVERTED INDEX (col1_3), INVERTED INDEX (col1_6 ASC, col1_4, col1_3), FAMILY (col1_3, col1_2), FAMILY (col1_6, col1_4, col1_5))",
          |   "ALTER TABLE public.table1 RENAME TO public.table8",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER TABLE public.table1 SET LOCALITY REGIONAL BY ROW"
          |  ],
          |  "expectedExecErrors": "42P16",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"public.table1\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 8343f0aed1a685b7a90ea37b10bd3e0ed85e654e:

          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:33:07.557043",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq19",
          |   "CREATE SCHEMA schema20 AUTHORIZATION root",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east-2\"",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE",
          |   "DROP SEQUENCE IF EXISTS public.seq19",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:33:07.707897",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER TABLE schema20.table21 DROP CONSTRAINT IrrelevantConstraintName"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema20.table21\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:33:07.744391",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table22 (col22_23 STRING NOT NULL, col22_24 STRING NOT NULL, col22_25 FLOAT8 NOT NULL, col22_26 INT4 NULL, col22_27 \"char\" NOT NULL, col22_28 FLOAT8 NOT NULL, col22_29 STRING NOT NULL, PRIMARY KEY (col22_23 ASC, col22_24, col22_28, col22_27 ASC, col22_25 ASC), col22_30 STRING NOT NULL AS (lower(col22_24)) STORED, col22_31 FLOAT8 NOT NULL AS (col22_28 + (-0.08423318408104508):::FLOAT8) VIRTUAL, col22_32 STRING NOT NULL AS (lower(col22_24)) VIRTUAL, UNIQUE (col22_25 DESC, col22_27, col22_23 DESC, col22_28 DESC, col22_32 ASC, col22_29 DESC, col22_30 ASC, col22_26), FAMILY (col22_23, col22_25), FAMILY (col22_26), FAMILY (col22_29, col22_24, col22_30, col22_28, col22_27))",
          |   "ALTER TABLE public.table22 ADD COLUMN col22_33 REGROLE NOT NULL"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: scanBool: \"\\n\\t\\tSELECT json_array_length(\\n        crdb_internal.pb_to_json(\\n            'cockroach.sql.sqlbase.Descriptor',\\n            descriptor\\n        )-\u003e'table'-\u003e'mutations'\\n       )\\n       \u003e 0\\n\\t\\tFROM system.descriptor\\n\\t  WHERE id = $1::REGCLASS\\n\\t\\t\" [\"public.table22\"]: can't scan into dest[0]: cannot assign NULL to *bool"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 8343f0aed1a685b7a90ea37b10bd3e0ed85e654e:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:10:17.369529",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table49 ALTER COLUMN \"col49_54\" SET NOT NULL",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: at least 3 regions are required for surviving a region failure (SQLSTATE 22023)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:10:17.464508",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table49 ALTER COLUMN col49_51 SET DEFAULT e'W+\\x1f)(':::STRING:::NAME",
          |   "ALTER TABLE schema20.table59 ADD COLUMN IrrelevantColumnName string"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema20.table59\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:10:17.546139",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE schema20.table60 (col60_61 REGTYPE NOT NULL, col60_62 DATE NOT NULL, col60_63 BIT(10) NOT NULL, col60_64 VARCHAR NOT NULL, PRIMARY KEY (col60_64 DESC), col60_65 STRING NOT NULL AS (lower(col60_64)) VIRTUAL, col60_66 STRING NOT NULL AS (lower(CAST(col60_63 AS STRING))) VIRTUAL, UNIQUE (lower(CAST(col60_62 AS STRING)) DESC, col60_61 ASC, col60_65 ASC, col60_66, col60_64 ASC, col60_63 ASC), UNIQUE (col60_61 DESC, col60_62 ASC, col60_63 ASC, col60_64 DESC, col60_66 ASC, lower(CAST(col60_62 AS STRING))), INDEX (col60_62 ASC, col60_65, col60_66, col60_64 ASC, col60_63 DESC, col60_61), UNIQUE (col60_66 DESC, col60_63 ASC, col60_61, col60_64 DESC), UNIQUE (col60_64 DESC, col60_62, lower(CAST(col60_62 AS STRING)), col60_66 DESC), UNIQUE (col60_61, col60_63 ASC), INDEX (col60_61, col60_66 ASC) STORING (col60_62), UNIQUE (col60_61, col60_63 DESC, col60_66, col60_62 DESC, col60_65, col60_64 DESC), INDEX (col60_62, col60_64, col60_61 ASC, col60_66))",
          |   "ALTER TABLE public.table67 SET LOCALITY REGIONAL BY ROW"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table67\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:10:17.577179",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table49 ALTER COLUMN \"crdb_internal_idx_expr\" DROP DEFAULT",
          |   "CREATE VIEW schema20.view69 AS SELECT public.table49.col49_52, \"IrrelevantColumnName\" FROM public.table49, public.table68"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table68\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 5c388180155f306a1685ac88bfbeeb03785313dd:

          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:12.059944",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema2.table22 ALTER COLUMN col22_36 SET DEFAULT B'100010111011'"
          |  ],
          |  "expectedExecErrors": "42804",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: expected DEFAULT expression to have type string, but 'B'100010111011'' has type varbit (SQLSTATE 42804)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:12.124071",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"schema2\" CASCADE",
          |   "CREATE SCHEMA IF NOT EXISTS schema37 AUTHORIZATION root",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east-2\""
          |  ],
          |  "expectedExecErrors": "42710",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: region \"us-east-2\" already added to database (SQLSTATE 42710)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:12.185168",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE VIEW schema2.view38 AS SELECT schema2.table22.col22_23, schema2.table22.col22_30, schema2.table22.col22_27, schema2.table22.col22_23, schema2.table22.col22_25, schema2.table22.col22_34 FROM schema2.table22, schema2.table22"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table22\" specified more than once (missing AS clause) (SQLSTATE 42712)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:12.252117",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema2.table22 RENAME COLUMN \"col22_26\" TO \"col22_39\"",
          |   "CREATE TABLE public.table40 AS SELECT schema2.table22.col22_26, schema2.table22.col22_28, schema2.table22.col22_23, schema2.table22.col22_24, schema2.table22.col22_31, schema2.table22.col22_33, schema2.table22.col22_27, schema2.table22.col22_34, schema2.table22.col22_32, schema2.table22.col22_29, schema2.table22.col22_25, schema2.table22.col22_36 FROM schema2.table22"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"schema2.table22.col22_26\" does not exist (SQLSTATE 42703)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 5c388180155f306a1685ac88bfbeeb03785313dd:

          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE public.table7 (col7_8 UUID NULL, col7_9 REGCLASS NULL, col7_10 CHAR NOT NULL, col7_11 INT2 NULL, col7_12 GEOMETRY NULL, col7_13 GEOGRAPHY, col7_14 REGROLE NOT NULL, col7_15 UUID NOT NULL, col7_16 UUID NOT NULL, col7_17 REGTYPE, col7_18 INT8 NOT NULL, col7_19 INT8 NULL AS (col7_18 + col7_11) STORED, col7_20 STRING NOT NULL AS (lower(CAST(col7_15 AS STRING))) VIRTUAL, col7_21 STRING NOT NULL AS (lower(col7_10)) STORED, col7_22 INT2 NULL AS (col7_11 + col7_18) STORED, col7_23 STRING NOT NULL AS (lower(col7_10)) STORED, col7_24 INT2 NULL AS (col7_11 + col7_18) VIRTUAL, col7_25 INT2 NULL AS (col7_11 + col7_18) VIRTUAL, col7_26 STRING NOT NULL AS (lower(CAST(col7_16 AS STRING))) VIRTUAL, INDEX (col7_25, col7_17 DESC, col7_19 ASC, col7_10 DESC, col7_11 DESC, col7_26 ASC, col7_22, col7_20 DESC, lower(CAST(col7_9 AS STRING)) ASC, col7_9, col7_18 DESC), FAMILY (col7_19, col7_18, col7_15, col7_9, col7_8), FAMILY (col7_12, col7_11, col7_13, col7_21, col7_23, col7_22), FAMILY (col7_14), FAMILY (col7_10), FAMILY (col7_17), FAMILY (col7_16))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:13:01.538061",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"schema6\" CASCADE",
          |   "ALTER TABLE public.table7 ALTER COLUMN \"col7_13\" DROP DEFAULT",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:13:01.715936",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER TABLE public.table7 RENAME TO public.table27",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:13:01.81529",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table27 ALTER COLUMN col7_22 SET DEFAULT (-23313):::INT8"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table27\" (57): computed column \"col7_22\" cannot also have a DEFAULT expression (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 81d49bd3d2e8ee3da4a5800043b94aa174127ab7:

          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema1 AUTHORIZATION root",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq2",
          |   "ALTER SEQUENCE public.seq3 RENAME TO public.seq4"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.seq3\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:44.176526",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east-2\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:44.235056",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE IF NOT EXISTS public.table5 (col5_6 BYTES NOT NULL, col5_7 TIMESTAMPTZ NOT NULL, col5_8 REGROLE NOT NULL, col5_9 BIT(24) NOT NULL, PRIMARY KEY (col5_9 ASC, col5_6 DESC, col5_8, col5_7), INDEX ((CASE WHEN col5_7 IS NULL THEN e'O,\\x18':::STRING ELSE 'BDk!':::STRING END) DESC, lower(CAST(col5_8 AS STRING)), col5_6, col5_9 ASC), UNIQUE (lower(CAST(col5_8 AS STRING)) DESC, col5_8), INDEX (col5_9 DESC, col5_8 DESC, col5_6), INDEX (col5_6, col5_7 ASC, lower(CAST(col5_9 AS STRING)) DESC, col5_9 ASC), UNIQUE (lower(CAST(col5_8 AS STRING)) ASC), UNIQUE (col5_6 DESC, (CASE WHEN col5_7 IS NULL THEN e'([CPL\\x1e_':::STRING ELSE e'\\x1c=RU=Bo':::STRING END)), INDEX (col5_8 ASC, lower(CAST(col5_9 AS STRING)) DESC, col5_9 ASC, col5_6 DESC), FAMILY (col5_7, col5_8, col5_9), FAMILY (col5_6))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:44.260626",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table5 ALTER COLUMN \"col5_8\" DROP DEFAULT",
          |   "ALTER TABLE public.table5 ALTER COLUMN \"crdb_internal_idx_expr_6\" DROP NOT NULL",
          |   "ALTER TABLE public.table5 RENAME COLUMN \"crdb_internal_idx_expr_6\" TO \"col5_10\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"crdb_internal_idx_expr_6\" is inaccessible and cannot be renamed (SQLSTATE 42703)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 81d49bd3d2e8ee3da4a5800043b94aa174127ab7:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:11:21.191172",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS public AUTHORIZATION root",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq28",
          |   "ALTER TABLE public.table22 RENAME COLUMN \"col22_26\" TO \"col22_29\"",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:11:21.330561",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table22 DROP CONSTRAINT \"primary\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "0A000",
          |  "message": "COMMIT; Successfully got expected commit error"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:11:21.372565",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table22 ALTER COLUMN col22_26 SET DEFAULT 'j':::STRING:::NAME"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table22\" (63): computed column \"col22_26\" cannot also have a DEFAULT expression (SQLSTATE 42P16)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:11:21.449038",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table30 ALTER COLUMN \"IrrelevantColumnName\" DROP NOT NULL"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table30\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 1bb94b40c519b775d99dffe64435f968206ced4b:

          |  "clientTimestamp": "07:30:15.392527",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum19 AS ENUM ('fdsa')",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east-2\"",
          |   "DROP SCHEMA \"schema20\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unknown schema \"schema20\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:30:15.442012",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east-2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-east-2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:30:15.452206",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE IF EXISTS public.seq4",
          |   "CREATE SCHEMA schema21 AUTHORIZATION root",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:30:15.507772",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE schema21.table22 (col22_23 DECIMAL[] NULL, col22_24 INT4, col22_25 INET NOT NULL, col22_26 TIMESTAMPTZ NULL, col22_27 CHAR, col22_28 BIT(9) NOT NULL, col22_29 TIMESTAMPTZ[], col22_30 VARCHAR NOT NULL, col22_31 JSONB NULL, col22_32 CHAR NULL, col22_33 REGNAMESPACE NULL, col22_34 INT8 NOT NULL, col22_35 BOOL NULL, PRIMARY KEY (col22_30 ASC), col22_36 INT4 AS (col22_24 + col22_34) STORED, col22_37 INT8 AS (col22_34 + col22_24) STORED, col22_38 INT8 AS (col22_34 + col22_24) VIRTUAL, col22_39 INT4 AS (col22_24 + col22_34) VIRTUAL, col22_40 STRING NULL AS (lower(CAST(col22_35 AS STRING))) VIRTUAL, col22_41 INT8 AS (col22_34 + col22_24) STORED, UNIQUE (col22_27 ASC, col22_33))",
          |   "ALTER TABLE schema21.table22 RENAME TO schema21.table42"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: relation \"schema21.table22\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 1bb94b40c519b775d99dffe64435f968206ced4b:

          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:07:31.786973",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table42 AS SELECT schema19.table22.col22_30, schema19.table22.col22_26, schema19.table22.col22_33, schema19.table22.col22_37, schema19.table22.col22_35, schema19.table22.col22_27, schema19.table22.col22_38, schema19.table22.col22_28, schema19.table22.col22_33, schema19.table22.col22_23, schema19.table22.col22_34, schema19.table22.col22_38, schema19.table22.col22_38, schema19.table22.col22_24, schema19.table22.col22_31, schema19.table22.col22_35 FROM schema19.table22, schema19.table22, schema19.table22"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table22\" specified more than once (missing AS clause) (SQLSTATE 42712)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:07:31.929637",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42710",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: region \"us-east1\" already added to database (SQLSTATE 42710)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:07:31.950476",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "DROP SCHEMA \"schema41\" CASCADE",
          |   "CREATE VIEW schema19.view43 AS SELECT schema19.table22.col22_29, schema19.table22.col22_33, schema19.table22.col22_28, schema19.table22.col22_37, schema19.table22.col22_36, schema19.table22.col22_35, schema19.table22.col22_34, schema19.table22.col22_31, schema19.table22.col22_30, schema19.table22.col22_25, schema19.table22.col22_38, schema19.table22.col22_26, schema19.table22.col22_32, schema19.table22.col22_24, schema19.table22.col22_27, schema19.table22.col22_23, schema19.table22.col22_37, schema19.table22.col22_27, schema19.table22.col22_31, schema19.table22.col22_33, schema19.table22.col22_36, schema19.table22.col22_35, schema19.table22.col22_38, schema19.table22.col22_30, schema19.table22.col22_25, schema19.table22.col22_34, schema19.table22.col22_24, schema19.table22.col22_28, schema19.table22.col22_29, schema19.table22.col22_26 FROM schema19.table22, schema19.table22"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table22\" specified more than once (missing AS clause) (SQLSTATE 42712)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:07:32.068661",
          |  "ops": [
          |   "BEGIN",
          |   "DROP INDEX schema19.table22@\"index22_44\" CASCADE"
          |  ],
          |  "expectedExecErrors": "42704",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: index \"index22_44\" does not exist (SQLSTATE 42704)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ cb0222a1980b96ad59c181c96fab8340aa252571:

          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region "us-east-2" already added to database (SQLSTATE 42710)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 2000 --concurrency 1 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:42:59.157921",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER INDEX schema1.table2@\"IrrelevantConstraintName\" RENAME TO \"OtherConstraintName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema1.table2\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:42:59.177873",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema3 AUTHORIZATION root",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE SEQUENCE IF NOT EXISTS schema4.seq5"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema4.seq5\" because the target database or schema does not exist (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:42:59.212004",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east-2\"",
          |   "CREATE TABLE IF NOT EXISTS public.table6 (col6_7 REGPROC, col6_8 BOOL NULL, col6_9 GEOMETRY NULL, col6_10 FLOAT4 NULL, col6_11 GEOGRAPHY NULL, col6_12 INTERVAL[] NULL, col6_13 REGPROCEDURE NULL, col6_14 TIMESTAMPTZ NOT NULL, col6_15 INT4, col6_16 INT4 NULL, col6_17 STRING NOT NULL AS (CASE WHEN col6_14 IS NULL THEN e'[\\x02DkRCDT':::STRING ELSE e'\\t{Q0\\x048M':::STRING END) VIRTUAL, UNIQUE (col6_15 ASC, col6_13 DESC, col6_17 DESC))",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east-2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"us-east-2\" already added to database (SQLSTATE 42710)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ cb0222a1980b96ad59c181c96fab8340aa252571:

          | id 53, db schemachange, schema public, name seq2: relation "seq2" (53): invalid locality config: database schemachange is multi-region enabled, but table seq2 has no locality set
          | id 54, db schemachange, schema public, name table3: relation "table3" (54): invalid locality config: database schemachange is multi-region enabled, but table table3 has no locality set
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 2000 --concurrency 1 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:19:35.863474",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table1 ALTER COLUMN IrrelevantColumnName DROP STORED"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table1\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:19:35.882994",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:19:35.922962",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq2",
          |   "CREATE TABLE IF NOT EXISTS public.table3 (col3_4 BYTES NULL, col3_5 TIME, col3_6 BIT, col3_7 JSONB, col3_8 TIMESTAMP NOT NULL, col3_9 TIMESTAMPTZ NULL, col3_10 CHAR, col3_11 REGTYPE NULL, col3_12 UUID NOT NULL, col3_13 DECIMAL NOT NULL, col3_14 UUID NULL, col3_15 INET NULL, PRIMARY KEY (col3_13), col3_16 STRING AS (lower(CAST(col3_6 AS STRING))) STORED, FAMILY (col3_6, col3_16, col3_15), FAMILY (col3_11, col3_13, col3_4, col3_12), FAMILY (col3_14, col3_8, col3_5, col3_7), FAMILY (col3_9), FAMILY (col3_10))",
          |   "DROP VIEW IF EXISTS public.view17",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: Validation FAIL:\nid 53, db schemachange, schema public, name seq2: relation \"seq2\" (53): invalid locality config: database schemachange is multi-region enabled, but table seq2 has no locality set\nid 54, db schemachange, schema public, name table3: relation \"table3\" (54): invalid locality config: database schemachange is multi-region enabled, but table table3 has no locality set"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 3cf7ac914c42bb024c688564983445f3eb5da58a:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:31:03.381302",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema91.table116 ALTER COLUMN \"col116_124\" SET NOT NULL",
          |   "CREATE SCHEMA schema126 AUTHORIZATION root",
          |   "CREATE VIEW public.view127 AS SELECT schema91.table116.col116_117, schema91.table116.col116_122, schema91.table116.col116_119, schema91.table116.col116_123, schema91.table116.col116_120 FROM schema91.table116",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:31:03.525275",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE IF EXISTS public.seq128",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:31:03.530711",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema91.table116 ALTER COLUMN \"col116_129\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "42611,42703",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col116_129\" does not exist (SQLSTATE 42703)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:31:03.603701",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE schema91.table130 AS SELECT schema91.table116.col116_125, schema91.table116.col116_121, schema91.table116.col116_124, schema91.table116.col116_118, schema91.table116.col116_122, schema91.table116.col116_117, schema91.table116.crdb_internal_idx_expr, schema91.table116.col116_119, schema91.table116.col116_123, schema91.table116.crdb_internal_idx_expr, schema91.table116.col116_125, schema91.table116.col116_120, schema91.table116.col116_119, schema91.table116.col116_123 FROM schema91.table116, schema91.table116"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table116\" specified more than once (missing AS clause) (SQLSTATE 42712)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 3cf7ac914c42bb024c688564983445f3eb5da58a:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:12:45.860232",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42710",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: region \"us-east1\" already added to database (SQLSTATE 42710)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:12:45.889546",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE",
          |   "CREATE TABLE schema38.table40 AS SELECT public.table39.col22_36, public.table39.col22_37, public.table39.col22_26, public.table39.col22_29, public.table39.col22_34, public.table39.col22_30, public.table39.col22_28, public.table39.col22_27, public.table39.col22_25, public.table39.col22_32, public.table39.col22_31, public.table39.col22_33, public.table39.col22_24, public.table39.col22_35, public.table39.col22_23, public.table39.col22_36, public.table39.col22_35, public.table39.col22_31, public.table39.col22_29, public.table39.col22_32, public.table39.col22_26, public.table39.col22_34, public.table39.col22_23, public.table39.col22_28, public.table39.col22_27, public.table39.col22_24, public.table39.col22_25, public.table39.col22_30, public.table39.col22_33, public.table39.col22_30 FROM public.table39, public.table39, public.table39"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table39\" specified more than once (missing AS clause) (SQLSTATE 42712)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:12:46.031655",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table39 ADD COLUMN col39_41 INET UNIQUE",
          |   "ALTER TABLE public.table39 ALTER COLUMN \"col22_31\" DROP DEFAULT",
          |   "CREATE VIEW schema38.view42 AS SELECT public.table39.col22_25, public.table39.col22_33, public.table39.col22_37, public.table39.col22_36, public.table39.col22_28, public.table39.col22_32, public.table39.col22_27, public.table39.col22_35, public.table39.col22_23, public.table39.col22_31, public.table39.col22_24, public.table39.col22_30, public.table39.col22_27, public.table39.col22_23, public.table39.col22_31, public.table39.col22_34, public.table39.col22_36, public.table39.col22_29, public.table39.col22_25, public.table39.col22_27, public.table39.col22_29, public.table39.col22_31, public.table39.col22_36, public.table39.col22_33, public.table39.col22_35, public.table39.col22_23, public.table39.col22_28 FROM public.table39, public.table39, public.table39"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table39\" specified more than once (missing AS clause) (SQLSTATE 42712)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:12:46.272106",
          |  "ops": [
          |   "BEGIN",
          |   "DROP TABLE public.table39"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: relation \"public.table39\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ c754d101ccd7541b0f597dac2f37809c1a859bf2:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:40:31.904905",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: at least 3 regions are required for surviving a region failure (SQLSTATE 22023)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:40:31.931787",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:40:31.939697",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE IF EXISTS public.seq3",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east-2\""
          |  ],
          |  "expectedExecErrors": "42710",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: region \"us-east-2\" already added to database (SQLSTATE 42710)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:40:31.969539",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table29 (col29_30 REGROLE NULL, col29_31 INT4 NOT NULL, col29_32 TIMESTAMP, col29_33 STRING, col29_34 DATE NULL, col29_35 TIME NULL, col29_36 GEOGRAPHY NOT NULL, col29_37 \"char\" NOT NULL, col29_38 JSONB, col29_39 DATE NOT NULL, col29_40 STRING AS (lower(CAST(col29_38 AS STRING))) VIRTUAL, col29_41 STRING NULL AS (lower(CAST(col29_35 AS STRING))) VIRTUAL, col29_42 STRING AS (lower(CAST(col29_32 AS STRING))) VIRTUAL, col29_43 STRING NOT NULL AS (lower(col29_37)) VIRTUAL, col29_44 STRING NOT NULL AS (lower(col29_37)) STORED, col29_45 STRING NOT NULL AS (lower(col29_37)) STORED, col29_46 STRING NOT NULL AS (lower(CAST(col29_36 AS STRING))) VIRTUAL, col29_47 STRING AS (lower(CAST(col29_38 AS STRING))) STORED, col29_48 STRING NOT NULL AS (lower(CAST(col29_39 AS STRING))) VIRTUAL, UNIQUE (col29_45 DESC, col29_39 DESC, col29_34 DESC, col29_33, col29_30, col29_41 ASC, col29_46 ASC, col29_44, col29_32 DESC, col29_37 ASC), INDEX (col29_39, col29_35, col29_41 DESC), INVERTED INDEX (lower(CAST(col29_36 AS STRING)) DESC, col29_36 DESC))",
          |   "ALTER TABLE public.table29 RENAME TO public.table49",
          |   "DROP TABLE public.table29"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"public.table29\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ c754d101ccd7541b0f597dac2f37809c1a859bf2:

          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:20:08.707832",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema5.enum17 AS ENUM ('sfdsff', 'asffff', 'sa', 'ssdf')",
          |   "ALTER TABLE public.table6 ALTER COLUMN \"col6_9\" DROP NOT NULL"
          |  ],
          |  "expectedExecErrors": "42P16",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col6_9\" is in a primary index (SQLSTATE 42P16)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:20:08.798006",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq18 OWNED BY public.table6.crdb_internal_idx_expr",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:20:08.912322",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table6 RENAME COLUMN \"col6_9\" TO \"col6_19\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: scanBool: \"\\n\\t\\tSELECT json_array_length(\\n        crdb_internal.pb_to_json(\\n            'cockroach.sql.sqlbase.Descriptor',\\n            descriptor\\n        )-\u003e'table'-\u003e'mutations'\\n       )\\n       \u003e 0\\n\\t\\tFROM system.descriptor\\n\\t  WHERE id = $1::REGCLASS\\n\\t\\t\" [\"public.table6\"]: can't scan into dest[0]: cannot assign NULL to *bool"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:20:09.049051",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema20 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR DURING ROLLBACK;: conn closed"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ f963a1eb6daa99bd5fd2c43771773473cdf361f7:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:40:13.644967",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE IF EXISTS public.seq28",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq31",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east-2\"",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east-2\""
          |  ],
          |  "expectedExecErrors": "42710",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: region \"us-east-2\" already added to database (SQLSTATE 42710)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:40:13.714085",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:40:13.722475",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:40:13.728939",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table32 (col32_33 FLOAT4, col32_34 REGPROCEDURE, col32_35 GEOGRAPHY NOT NULL, col32_36 DATE NULL, col32_37 STRING NOT NULL, col32_38 TIMETZ NULL, col32_39 INT2 NOT NULL, col32_40 FLOAT4 NOT NULL, col32_41 BYTES, PRIMARY KEY (col32_37 ASC), col32_42 STRING NOT NULL AS (lower(CAST(col32_35 AS STRING))) STORED, UNIQUE (col32_40 DESC, col32_42 DESC, col32_36 ASC) STORING (col32_33, col32_39, col32_41), INDEX (col32_42, col32_40 DESC, col32_36 DESC, col32_38 DESC, col32_41, col32_37 ASC) STORING (col32_33, col32_39), INVERTED INDEX ((col32_33 + 1.3024996519088745:::FLOAT8) ASC, col32_41 ASC, col32_35 DESC), UNIQUE (col32_33 ASC, col32_40 DESC, col32_36 ASC, col32_38 DESC, col32_39, col32_42 ASC) STORING (col32_34), INDEX (col32_42 DESC, col32_38 DESC, col32_41 DESC, col32_34 ASC) STORING (col32_36, col32_39), INDEX (col32_34 ASC, col32_37 DESC) STORING (col32_33, col32_38, col32_39), FAMILY (col32_33), FAMILY (col32_35), FAMILY (col32_40), FAMILY (col32_41), FAMILY (col32_37, col32_36, col32_38, col32_39), FAMILY (col32_34, col32_42))"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: scanBool: \"SELECT EXISTS (\\n\\t\\tSELECT crdb_internal_idx_expr\\n\\t\\t  FROM public.table32\\n\\t   WHERE crdb_internal_idx_expr IS NULL\\n\\t)\" []: ERROR: column \"crdb_internal_idx_expr\" does not exist (SQLSTATE 42703)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ f963a1eb6daa99bd5fd2c43771773473cdf361f7:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:21:27.36715",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE public.seq18",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:21:27.449141",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema20.table21 ALTER COLUMN IrrelevantColumnName DROP STORED"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema20.table21\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:21:27.487557",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema22 AUTHORIZATION root",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:21:27.518537",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq23",
          |   "DROP SEQUENCE IF EXISTS public.seq23",
          |   "ALTER SEQUENCE public.seq23 RENAME TO public.seq23"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"public.seq23\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 3adc6da4ccdf80618e6bbcee5ee9e503a92517e7:

          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: cannot drop UNIQUE constraint \"table1_col1_16_key\" using ALTER TABLE DROP CONSTRAINT, use DROP INDEX CASCADE instead (SQLSTATE 0A000)"
          | }
          | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
          |     1.0s        0           13.4           14.0      1.7      4.5      8.9      8.9 opOk
          |     1.0s        0            1.0            1.0     37.7     37.7     37.7     37.7 txnCmtErr
          |     1.0s        0            4.8            5.0     83.9    302.0    302.0    302.0 txnOk
          |     1.0s        0           12.4           13.0      0.7      0.9      0.9      0.9 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:38:27.032078",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table1 ALTER COLUMN \"col1_8\" DROP DEFAULT",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east-2\"",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR DURING ROLLBACK;: conn closed"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError

    cluster.go:1296,context.go:89,cluster.go:1284,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3924329-1639639209-01-n3cpu4 --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 134)
        3: 7057
        2: 6776
        Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 134)
        (1) UNCLASSIFIED_PROBLEM
        Wraps: (2) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod.Monitor
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/roachprod/roachprod.go:596
          | main.glob..func14
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:569
          | main.wrap.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:123
          | github.com/spf13/cobra.(*Command).execute
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
          | github.com/spf13/cobra.(*Command).ExecuteC
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
          | github.com/spf13/cobra.(*Command).Execute
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
          | main.main
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1170
          | runtime.main
          |     /usr/local/go/src/runtime/proc.go:255
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1581
        Wraps: (3) 1: dead (exit status 134)
        Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 3adc6da4ccdf80618e6bbcee5ee9e503a92517e7:

          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE schema12.table33 (col33_34 FLOAT8 NULL, col33_35 CHAR NOT NULL, col33_36 BIT(35) NOT NULL, col33_37 DATE, col33_38 \"char\" NOT NULL, col33_39 INT2, PRIMARY KEY (col33_38 DESC, col33_35 ASC), col33_40 STRING NOT NULL AS (lower(CAST(col33_36 AS STRING))) STORED, col33_41 INT2 AS (col33_39 + (-6778):::INT8) VIRTUAL, UNIQUE (col33_40 DESC, col33_34, col33_39 ASC, col33_37 DESC) STORING (col33_36), INDEX (col33_36, lower(col33_38), col33_34 ASC, col33_35, col33_37 DESC, col33_41 DESC, lower(col33_35) ASC), INDEX ((col33_34 + 1.1212245023620444:::FLOAT8) DESC, col33_34 DESC) STORING (col33_36), UNIQUE (col33_40, col33_38 ASC, col33_37, col33_34), INDEX (lower(CAST(col33_37 AS STRING)), col33_39 ASC, col33_35 DESC, col33_36 ASC, col33_37 DESC, col33_40 DESC, col33_41 ASC, col33_38), INDEX (col33_34 DESC, col33_37, col33_41 ASC, col33_38 DESC, col33_40 ASC, lower(CAST(col33_36 AS STRING))), FAMILY (col33_36), FAMILY (col33_34, col33_38), FAMILY (col33_40), FAMILY (col33_39, col33_35), FAMILY (col33_37))",
          |   "CREATE TABLE public.table42 AS SELECT schema12.table33.crdb_internal_idx_expr_4, schema12.table33.col33_36, schema12.table33.col33_41, schema12.table33.col33_34 FROM schema12.table33",
          |   "DROP TABLE IF EXISTS schema12.table33 CASCADE",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:19:18.96339",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema12.enum43 AS ENUM ('saf', 'adddad', 'a', 'sda', 'saa')",
          |   "CREATE SCHEMA schema44 AUTHORIZATION root",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:19:18.98329",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table42 ADD COLUMN col42_45 OID",
          |   "ALTER TABLE public.table42 RENAME COLUMN \"col33_41\" TO \"col42_46\"",
          |   "ALTER TABLE schema12.table47 DROP CONSTRAINT IrrelevantConstraintName"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema12.table47\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:19:19.154404",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: at least 3 regions are required for surviving a region failure (SQLSTATE 22023)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 999d35029f33a9b35dde0599c952efc83ed726a7:

          |  "workerId": 0,
          |  "clientTimestamp": "08:17:12.539967",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE SCHEMA IF NOT EXISTS schema17 AUTHORIZATION root",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:17:12.657073",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:17:12.676201",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-east1\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:17:12.708773",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq18",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "CREATE TYPE public.enum19 AS ENUM ('aff', 'aadf', 'fdad', 's', 'fffds', 'd')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED COMMIT ERROR; Received an unexpected commit error: ERROR: relation \"seq18\" (54): invalid locality config: database schemachange is multi-region enabled, but table seq18 has no locality set (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 999d35029f33a9b35dde0599c952efc83ed726a7:

          |   "CREATE TABLE public.table23 (col23_24 JSONB, col23_25 CHAR, col23_26 BOX2D, col23_27 TIMESTAMP NOT NULL, col23_28 BYTES, col23_29 JSONB, col23_30 DATE, col23_31 BOOL, col23_32 GEOGRAPHY NULL, col23_33 TIMETZ NOT NULL, col23_34 REGCLASS NOT NULL, col23_35 BIT(30), col23_36 STRING NOT NULL AS (lower(CAST(col23_34 AS STRING))) VIRTUAL, col23_37 STRING AS (lower(col23_25)) VIRTUAL, col23_38 STRING AS (lower(CAST(col23_26 AS STRING))) VIRTUAL, UNIQUE (col23_35 DESC, col23_26 ASC, col23_28, col23_33 ASC) STORING (col23_25, col23_34), FAMILY (col23_26), FAMILY (col23_34, col23_27, col23_33, col23_28, col23_24), FAMILY (col23_31, col23_30), FAMILY (col23_25), FAMILY (col23_32, col23_35, col23_29))",
          |   "CREATE TYPE schema14.enum39 AS ENUM ('d')",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq40",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "09:09:33.749079",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER SEQUENCE public.seq40 RENAME TO public.seq41",
          |   "ALTER TABLE public.table23 RENAME COLUMN \"col23_30\" TO \"col23_42\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "09:09:33.880483",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table23 ADD COLUMN col23_29 INET NOT NULL"
          |  ],
          |  "expectedExecErrors": "42701",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col23_29\" of relation \"table23\" already exists (SQLSTATE 42701)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "09:09:33.951831",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table23 ALTER COLUMN col23_33 SET DEFAULT '08:05:23.306501+09:20:00':::TIMETZ",
          |   "CREATE TABLE public.table43 (col43_44 REGPROC NOT NULL, col43_45 BOOL[] NULL, col43_46 TIMESTAMPTZ, col43_47 REGNAMESPACE, col43_48 CHAR, col43_49 VARCHAR NULL, col43_50 TIMESTAMPTZ, col43_51 BOOL, col43_52 INET, col43_53 BIT(39) NOT NULL, col43_54 TIME, PRIMARY KEY (col43_44 DESC), col43_55 STRING AS (lower(CAST(col43_52 AS STRING))) VIRTUAL, UNIQUE (col43_50, col43_51, col43_48, col43_44, col43_54 ASC) STORING (col43_45, col43_47), UNIQUE (col43_52 DESC, col43_51, col43_44, col43_54 DESC, col43_53 ASC, col43_47 ASC, col43_46 ASC, col43_48 ASC, col43_50 DESC, col43_55), INDEX (col43_52 ASC, col43_50 ASC, col43_48 DESC, col43_44 DESC, col43_54, col43_51 DESC), FAMILY (col43_52), FAMILY (col43_47, col43_53, col43_48), FAMILY (col43_51, col43_46), FAMILY (col43_54), FAMILY (col43_50, col43_44, col43_49), FAMILY (col43_45))",
          |   "DROP SCHEMA \"schema56\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unknown schema \"schema56\" (SQLSTATE 3F000)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ f51352920c0af2bbede32dab8fee6424fc27a911:

          |   "ALTER TABLE public.table1 ADD COLUMN col1_39 REGPROC NULL",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:33:24.461666",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east-2\"",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR DURING ROLLBACK;: conn closed"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError

    cluster.go:1296,context.go:89,cluster.go:1284,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3944406-1639811695-02-n3cpu4 --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 134)
        3: 9288
        2: 9190
        Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 134)
        (1) UNCLASSIFIED_PROBLEM
        Wraps: (2) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod.Monitor
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/roachprod/roachprod.go:596
          | main.glob..func14
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:569
          | main.wrap.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:123
          | github.com/spf13/cobra.(*Command).execute
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
          | github.com/spf13/cobra.(*Command).ExecuteC
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
          | github.com/spf13/cobra.(*Command).Execute
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
          | main.main
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1170
          | runtime.main
          |     /usr/local/go/src/runtime/proc.go:255
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1581
        Wraps: (3) 1: dead (exit status 134)
        Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ f51352920c0af2bbede32dab8fee6424fc27a911:

          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col4_8\" is not a computed column (SQLSTATE 42611)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:11:38.52169",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-east1\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:11:38.528781",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema14 AUTHORIZATION root",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:11:38.554563",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table4 DROP CONSTRAINT \"table4_col4_10_col4_11_col4_9_col4_8_col4_6_col4_5_col4_7_key\""
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: cannot drop UNIQUE constraint \"table4_col4_10_col4_11_col4_9_col4_8_col4_6_col4_5_col4_7_key\" using ALTER TABLE DROP CONSTRAINT, use DROP INDEX CASCADE instead (SQLSTATE 0A000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:11:38.588436",
          |  "ops": [
          |   "BEGIN",
          |   "DROP TABLE public.table4 RESTRICT",
          |   "ALTER SEQUENCE public.seq15 RENAME TO public.seq16"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.seq15\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 4d0b749d263b95baf3054607d5f13a92cbb6a055:

          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:30:08.120169",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:30:08.132876",
          |  "ops": [
          |   "BEGIN",
          |   "DROP TABLE IF EXISTS schema3.table27 CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: scanBool: \"\\n\\t\\tSELECT json_array_length(\\n        crdb_internal.pb_to_json(\\n            'cockroach.sql.sqlbase.Descriptor',\\n            descriptor\\n        )-\u003e'table'-\u003e'mutations'\\n       )\\n       \u003e 0\\n\\t\\tFROM system.descriptor\\n\\t  WHERE id = $1::REGCLASS\\n\\t\\t\" [\"schema3.table32\"]: can't scan into dest[0]: cannot assign NULL to *bool"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:30:08.177558",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE INVERTED INDEX index27_43 ON schema3.table27 (col24_25 DESC)"
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column col24_25 of type regproc is not allowed as the last column in an inverted index (SQLSTATE 0A000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:30:08.226697",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema3.table44 RENAME COLUMN \"IrrelevantColumnName\" TO \"OtherIrrelevantName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema3.table44\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 4d0b749d263b95baf3054607d5f13a92cbb6a055:

          |  "clientTimestamp": "12:11:39.658679",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:11:39.703938",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq2",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:11:39.741516",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: at least 3 regions are required for surviving a region failure (SQLSTATE 22023)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "12:11:39.772386",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema1.enum3 AS ENUM ('s', 'sda', 'adaf')",
          |   "CREATE TYPE public.enum4 AS ENUM ('a', 'ffsfaf')",
          |   "CREATE TABLE IF NOT EXISTS schema1.table5 (col5_6 BOX2D NOT NULL, col5_7 BOOL NOT NULL, col5_8 BYTES NOT NULL, col5_9 FLOAT8 NOT NULL, col5_10 FLOAT8 NOT NULL, col5_11 UUID NOT NULL, col5_12 BYTES NOT NULL, col5_13 BOOL NOT NULL, col5_14 TIMETZ NOT NULL, col5_15 REGNAMESPACE NULL, PRIMARY KEY (col5_9 DESC, col5_14, col5_11 ASC, col5_10 DESC, col5_12, col5_7, col5_6 DESC, col5_13, col5_8 DESC), col5_16 FLOAT8 NOT NULL AS (col5_9 + col5_10) VIRTUAL, col5_17 FLOAT8 NOT NULL AS (col5_10 + col5_9) VIRTUAL, col5_18 FLOAT8 NOT NULL AS (col5_10 + col5_9) VIRTUAL, col5_19 STRING NULL AS (lower(CAST(col5_15 AS STRING))) STORED, col5_20 FLOAT8 NOT NULL AS (col5_9 + col5_10) STORED, col5_21 STRING NOT NULL AS (lower(CAST(col5_7 AS STRING))) STORED, col5_22 FLOAT8 NOT NULL AS (col5_10 + col5_9) VIRTUAL, col5_23 STRING NOT NULL AS (lower(CAST(col5_11 AS STRING))) STORED, col5_24 FLOAT8 NOT NULL AS (col5_10 + col5_9) VIRTUAL, UNIQUE (col5_17, col5_10 ASC, col5_15 DESC, col5_7 DESC, col5_20 DESC, col5_6 DESC, col5_22 ASC, col5_24, col5_12, col5_23 DESC, col5_18, col5_11 ASC, (col5_10 + col5_9), (col5_9 + col5_10) DESC, col5_8, col5_19, col5_9 ASC), FAMILY (col5_10), FAMILY (col5_19, col5_13), FAMILY (col5_11, col5_9), FAMILY (col5_8, col5_15), FAMILY (col5_7, col5_21), FAMILY (col5_23), FAMILY (col5_12, col5_6), FAMILY (col5_20, col5_14))",
          |   "ALTER TABLE schema1.table5 RENAME TO schema1.table25"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: scanBool: \"\\n\\t\\tSELECT json_array_length(\\n        crdb_internal.pb_to_json(\\n            'cockroach.sql.sqlbase.Descriptor',\\n            descriptor\\n        )-\u003e'table'-\u003e'mutations'\\n       )\\n       \u003e 0\\n\\t\\tFROM system.descriptor\\n\\t  WHERE id = $1::REGCLASS\\n\\t\\t\" [\"schema1.table5\"]: ERROR: error in argument for $1: relation \"schema1.table5\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 33ec37ae94ff96d2f5804506810fb436b186bc32:

          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema56.seq57\" because the target database or schema does not exist (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:08.109509",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER VIEW public.view59 RENAME TO public.view60"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.view59\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:08.118491",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: at least 3 regions are required for surviving a region failure (SQLSTATE 22023)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:08.145039",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE public.seq61"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.seq61\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:08.153961",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table62 (col62_63 FLOAT4 NOT NULL, col62_64 TIMESTAMPTZ NOT NULL, col62_65 BYTES NOT NULL, col62_66 BIT(27) NOT NULL, PRIMARY KEY (col62_65 DESC, col62_66 DESC, col62_63, col62_64 DESC), INDEX (col62_63 ASC), UNIQUE (col62_63 ASC), INDEX (col62_63 DESC, col62_66, col62_65 DESC, col62_64 ASC), UNIQUE (col62_64, col62_63 DESC, col62_65, col62_66 DESC), UNIQUE (col62_64 ASC), UNIQUE (col62_66 ASC), UNIQUE (col62_64), INDEX (col62_66 ASC, col62_65 DESC), UNIQUE (col62_66 DESC, col62_63, col62_64 DESC), FAMILY (col62_63, col62_65, col62_66), FAMILY (col62_64))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 33ec37ae94ff96d2f5804506810fb436b186bc32:

          |   "BEGIN",
          |   "DROP SEQUENCE public.seq2",
          |   "CREATE TYPE schema23.enum24 AS ENUM ('afda', 'd')"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema23.enum24\" because the target database or schema does not exist (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:14:34.028678",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR DURING ROLLBACK;: conn closed"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError

    cluster.go:1296,context.go:89,cluster.go:1284,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3964661-1640071019-21-n3cpu4 --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 134)
        3: 15749
        2: 15155
        Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 134)
        (1) UNCLASSIFIED_PROBLEM
        Wraps: (2) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod.Monitor
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/roachprod/roachprod.go:596
          | main.glob..func14
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:569
          | main.wrap.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:123
          | github.com/spf13/cobra.(*Command).execute
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
          | github.com/spf13/cobra.(*Command).ExecuteC
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
          | github.com/spf13/cobra.(*Command).Execute
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
          | main.main
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1170
          | runtime.main
          |     /usr/local/go/src/runtime/proc.go:255
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1581
        Wraps: (3) 1: dead (exit status 134)
        Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 2282896401079fef362d5456b71b32dd600e52b0:

          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:28:21.959348",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER INDEX public.table82@\"index82_83\" RENAME TO \"index82_84\""
          |  ],
          |  "expectedExecErrors": "42704",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: index \"index82_83\" does not exist (SQLSTATE 42704)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:28:21.973451",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE public.table85 AS SELECT public.table82.crdb_internal_idx_expr_1, public.table82.col60_61, public.table82.col60_75, public.table82.col60_70, public.table82.col60_76, public.table82.col60_62, public.table82.col60_65, public.table82.col60_62, public.table82.col60_66, public.table82.col60_64, public.table82.col60_68, public.table82.col60_74, public.table82.col60_71, public.table82.col60_75, public.table82.col60_76, public.table82.crdb_internal_idx_expr_1, public.table82.col60_61 FROM public.table82, public.table82"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table82\" specified more than once (missing AS clause) (SQLSTATE 42712)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:28:22.040955",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table82 ALTER COLUMN \"col82_86\" SET NOT NULL"
          |  ],
          |  "expectedExecErrors": "42703",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col82_86\" does not exist (SQLSTATE 42703)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:28:22.073924",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table82 RENAME COLUMN \"col60_64\" TO \"col82_87\"",
          |   "DROP TABLE public.table82 CASCADE",
          |   "CREATE TYPE public.enum88 AS ENUM ('a', 'ss', 'af', 'ddss', 's', 'sfdd')"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: randColumnWithMeta: \"\\n SELECT column_name, data_type, is_nullable\\n   FROM [SHOW COLUMNS FROM public.table82]\\n  WHERE column_name != 'rowid'\\nORDER BY random()\\n  LIMIT 1;\\n\": ERROR: relation \"public.table82\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 2282896401079fef362d5456b71b32dd600e52b0:

          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema2.table4\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:07:54.058625",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE IF EXISTS public.seq5",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:07:54.065657",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42710",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: region \"us-east1\" already added to database (SQLSTATE 42710)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:07:54.084806",
          |  "ops": [
          |   "BEGIN",
          |   "DROP INDEX public.table6@\"IrrelevantIndexName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table6\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:07:54.091798",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table7 (col7_8 BYTES NULL, col7_9 REGTYPE, col7_10 NAME NULL, col7_11 FLOAT8, col7_12 CHAR NOT NULL, col7_13 STRING NOT NULL AS (lower(col7_12)) STORED, col7_14 FLOAT8 AS (col7_11 + (-0.7199234359085753):::FLOAT8) VIRTUAL, col7_15 STRING AS (lower(CAST(col7_9 AS STRING))) VIRTUAL, INDEX (col7_8 ASC, lower(CAST(col7_9 AS STRING)), col7_12, col7_11 ASC, col7_14 ASC, col7_13 DESC, col7_10) STORING (col7_9), INDEX (col7_8 ASC, col7_15) STORING (col7_9, col7_12, col7_13), UNIQUE (col7_15 DESC, col7_10 ASC, col7_8 ASC, col7_12 ASC, col7_13 DESC, col7_11), INDEX (col7_13 DESC, col7_11 ASC), INDEX (col7_14 ASC) STORING (col7_9, col7_11, col7_12, col7_13), UNIQUE (lower(col7_12), col7_12 ASC, col7_9), INDEX (col7_9 ASC) STORING (col7_8, col7_11, col7_13), FAMILY (col7_9, col7_11), FAMILY (col7_12, col7_13, col7_10, col7_8))"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: scanBool: \"\\n\\t\\tSELECT json_array_length(\\n        crdb_internal.pb_to_json(\\n            'cockroach.sql.sqlbase.Descriptor',\\n            descriptor\\n        )-\u003e'table'-\u003e'mutations'\\n       )\\n       \u003e 0\\n\\t\\tFROM system.descriptor\\n\\t  WHERE id = $1::REGCLASS\\n\\t\\t\" [\"public.table7\"]: can't scan into dest[0]: cannot assign NULL to *bool"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 147ca220b715dbaadef5a8689e1894feecda5358:

          |  "workerId": 0,
          |  "clientTimestamp": "07:34:42.92256",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER SEQUENCE public.seq2 RENAME TO public.seq3"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.seq2\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:34:42.935515",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:34:42.949973",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east-2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-east-2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:34:42.955046",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema4 AUTHORIZATION root",
          |   "CREATE TABLE public.table5 (col5_6 INT2 NULL, col5_7 REGTYPE, col5_8 BIT(36) NOT NULL, col5_9 VARCHAR NOT NULL, col5_10 JSONB, col5_11 REGROLE, col5_12 INTERVAL NOT NULL, col5_13 BOX2D, col5_14 GEOGRAPHY[] NULL, col5_15 JSONB NOT NULL, col5_16 DATE, col5_17 STRING NOT NULL AS (lower(CAST(col5_15 AS STRING))) STORED, col5_18 STRING NULL AS (CASE WHEN col5_14 IS NULL THEN '':::STRING ELSE e'\\'':::STRING END) STORED, col5_19 STRING AS (lower(CAST(col5_7 AS STRING))) VIRTUAL, col5_20 STRING AS (lower(CAST(col5_10 AS STRING))) VIRTUAL, col5_21 INT2 NULL AS (col5_6 + (-20216):::INT8) VIRTUAL, col5_22 STRING AS (lower(CAST(col5_10 AS STRING))) VIRTUAL)",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east-2\"",
          |   "DROP SCHEMA \"schema4\" CASCADE",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED COMMIT ERROR; Received an unexpected commit error: ERROR: relation \"table5\" (54): invalid locality config: database schemachange is multi-region enabled, but table table5 has no locality set (SQLSTATE 42P16)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 147ca220b715dbaadef5a8689e1894feecda5358:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:11:25.772462",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE REGION FAILURE"
          |  ],
          |  "expectedExecErrors": "22023,42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:11:25.777662",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq21",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED COMMIT ERROR; Received an unexpected commit error: ERROR: relation \"seq21\" (63): invalid locality config: database schemachange is multi-region enabled, but table seq21 has no locality set (SQLSTATE 42P16)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:11:25.856098",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER TABLE schema19.table22 ALTER COLUMN \"IrrelevantColumnName\" DROP NOT NULL"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema19.table22\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:11:25.916528",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ ec9330f86763371c445acdc317088e24cbcbaac3:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:31:48.664583",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table45 ALTER COLUMN \"col45_52\" DROP NOT NULL",
          |   "DROP SCHEMA \"schema42\" CASCADE",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:31:48.864344",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table45 RENAME TO public.table55",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:31:49.00998",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER SEQUENCE schema56.seq57 RENAME TO schema56.seq58"
          |  ],
          |  "expectedExecErrors": "3F000,42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema56.seq57\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:31:49.016343",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum59 AS ENUM ('df', 'sdadf', 'fdasa', 'fdsf', 'afdf', 'dddss')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ ec9330f86763371c445acdc317088e24cbcbaac3:

          | I211224 08:10:48.920387 70 workload/pgx_helpers.go:72  [-] 3 +   LIMIT 1;]
          | Error: ***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: relation "public.table1" does not exist (SQLSTATE 42P01)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 2000 --concurrency 1 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:10:48.549692",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table1 (col1_2 FLOAT4 NOT NULL, col1_3 OID NOT NULL, col1_4 REGNAMESPACE NOT NULL, col1_5 INTERVAL NOT NULL, col1_6 TIMESTAMPTZ NOT NULL, PRIMARY KEY (col1_5 DESC, col1_4 DESC, col1_6, col1_2 ASC, col1_3 ASC), col1_7 FLOAT4 NOT NULL AS (col1_2 + (-1.3427907228469849):::FLOAT8) VIRTUAL, col1_8 STRING NOT NULL AS (lower(CAST(col1_5 AS STRING))) VIRTUAL, col1_9 STRING NOT NULL AS (lower(CAST(col1_4 AS STRING))) STORED, UNIQUE (col1_2 ASC, col1_8 DESC, col1_9 DESC, col1_6 ASC, col1_7 ASC), INDEX (col1_7 DESC, col1_5 DESC, col1_8), INDEX (col1_4), INDEX (col1_3 DESC, col1_8), INDEX (col1_4 DESC, col1_7 ASC, col1_5 ASC), INDEX (col1_9 DESC, col1_7 ASC, col1_2 ASC, col1_3, col1_8 DESC, col1_5 ASC, col1_4 DESC, col1_6 DESC), INDEX (col1_7 ASC, col1_4 DESC, (col1_2 + 0.4302682876586914:::FLOAT8) DESC, col1_9, col1_3 DESC), UNIQUE (col1_8, lower(CAST(col1_4 AS STRING)) ASC, (col1_2 + (-1.4452440738677979):::FLOAT8) ASC, col1_7 ASC), UNIQUE (col1_3 ASC, col1_5, col1_7 DESC, col1_8 ASC), FAMILY (col1_2, col1_9), FAMILY (col1_6, col1_4, col1_5), FAMILY (col1_3))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:10:48.577471",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table1 RENAME COLUMN \"col1_8\" TO \"col1_10\"",
          |   "ALTER TABLE public.table1 ADD COLUMN col1_11 BOOL NULL",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:10:48.839991",
          |  "ops": [
          |   "BEGIN",
          |   "DROP TABLE IF EXISTS public.table1 RESTRICT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: relation \"public.table1\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 2c4bb88e5318fe187e1bf6cb134b31bd63f63528:

          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:04.477884",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:04.501069",
          |  "ops": [
          |   "BEGIN",
          |   "DROP VIEW public.view4 RESTRICT"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.view4\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:04.510036",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum5 AS ENUM ('safsd', 'a', 'dfa', 'faf')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:04.518942",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table6 (col6_7 CHAR, col6_8 BYTES NOT NULL, col6_9 BOOL NOT NULL, col6_10 REGNAMESPACE NOT NULL, col6_11 TIME, col6_12 GEOMETRY NULL, col6_13 BYTES NOT NULL, col6_14 INTERVAL NULL, col6_15 REGROLE NOT NULL, col6_16 GEOMETRY NULL, col6_17 BIT(37) NOT NULL, col6_18 INET NOT NULL, col6_19 CHAR, col6_20 UUID NOT NULL, PRIMARY KEY (col6_9 DESC, col6_17, col6_8 DESC, col6_13 DESC, col6_18 ASC), col6_21 STRING NOT NULL AS (lower(CAST(col6_9 AS STRING))) VIRTUAL, col6_22 STRING AS (lower(CAST(col6_11 AS STRING))) VIRTUAL, INVERTED INDEX (lower(CAST(col6_15 AS STRING)) ASC, col6_13 DESC, col6_16), FAMILY (col6_14), FAMILY (col6_12, col6_7), FAMILY (col6_16, col6_11), FAMILY (col6_10, col6_8), FAMILY (col6_19), FAMILY (col6_20), FAMILY (col6_9), FAMILY (col6_17, col6_13, col6_18, col6_15))",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east-2\"",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east-2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"us-east-2\" already added to database (SQLSTATE 42710)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 2c4bb88e5318fe187e1bf6cb134b31bd63f63528:

          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:12:16.246062",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table45 ADD COLUMN col45_61 REGNAMESPACE NULL",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:12:16.498507",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table45 ALTER COLUMN \"col45_46\" DROP NOT NULL"
          |  ],
          |  "expectedExecErrors": "42P16",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col45_46\" is in a primary index (SQLSTATE 42P16)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:12:16.568801",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE INDEX index45_62 ON public.table45 (col45_54 ASC, col45_49 DESC, col45_61 ASC, col45_56 ASC) STORING (col45_50, col45_47)"
          |  ],
          |  "expectedExecErrors": "42701",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: index \"index45_62\" already contains column \"col45_47\" (SQLSTATE 42701)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:12:16.638474",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ c22ac33a023323cb76fde367b766ef988d6e27f7:

          |   "BEGIN",
          |   "ALTER SEQUENCE public.seq4 RENAME TO schema1.seq5"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot change schema of table with RENAME (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:34:53.896601",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east-2\"",
          |   "CREATE TABLE public.table6 (col6_7 INTERVAL NOT NULL, PRIMARY KEY (col6_7 ASC))",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR DURING ROLLBACK;: conn closed"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError

    cluster.go:1296,context.go:89,cluster.go:1284,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-4010638-1640848531-02-n3cpu4 --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 134)
        3: 9422
        2: 12297
        Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 134)
        (1) UNCLASSIFIED_PROBLEM
        Wraps: (2) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod.Monitor
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/roachprod/roachprod.go:596
          | main.glob..func14
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:569
          | main.wrap.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:123
          | github.com/spf13/cobra.(*Command).execute
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
          | github.com/spf13/cobra.(*Command).ExecuteC
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
          | github.com/spf13/cobra.(*Command).Execute
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
          | main.main
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1170
          | runtime.main
          |     /usr/local/go/src/runtime/proc.go:255
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1581
        Wraps: (3) 1: dead (exit status 134)
        Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ c22ac33a023323cb76fde367b766ef988d6e27f7:

          |  "expectedExecErrors": "42611",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col6_17\" is not a computed column (SQLSTATE 42611)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:10:38.589144",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "ALTER TABLE public.table25 ADD COLUMN col25_28 REGTYPE NULL",
          |   "ALTER TABLE public.table25 SET LOCALITY REGIONAL BY ROW"
          |  ],
          |  "expectedExecErrors": "42P16",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot alter a table's LOCALITY if its database is not multi-region enabled (SQLSTATE 42P16)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:10:38.676545",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
          |     1.0s        0           18.6           20.0      3.9     12.6     15.7     15.7 opOk
          |     1.0s        0            2.8            3.0    125.8    134.2    134.2    134.2 txnOk
          |     1.0s        0            7.4            8.0      0.7      1.1      1.1      1.1 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:10:38.8022",
          |  "ops": [
          |   "BEGIN",
          |   "DROP TABLE public.table25 RESTRICT",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "DROP SEQUENCE IF EXISTS public.seq26",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE VIEW public.view30 AS SELECT \"IrrelevantColumnName\" FROM public.table29"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table29\" does not exist (SQLSTATE 42P01)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ dc72c17f280dc20fa59970209c0e975e4072f91e:

          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table17 ALTER COLUMN col5_15 SET DEFAULT 'BOX(-0.28857391079323974 -2.529308750356023,1.820865112148447 0.1302888198463371)':::BOX2D",
          |   "ALTER TABLE public.table17 RENAME COLUMN \"col5_6\" TO \"col5_8\""
          |  ],
          |  "expectedExecErrors": "42701",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col5_8\" of relation \"table17\" already exists (SQLSTATE 42701)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:32:23.505287",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table17 ALTER COLUMN \"col17_20\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "42611,42703",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col17_20\" does not exist (SQLSTATE 42703)"
          | }
          | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
          |     1.0s        0           18.0           19.0      2.5      3.9     11.0     11.0 opOk
          |     1.0s        0            3.8            4.0     92.3    192.9    192.9    192.9 txnOk
          |     1.0s        0            9.5           10.0      0.7      4.7      4.7      4.7 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:32:23.53689",
          |  "ops": [
          |   "BEGIN",
          |   "DROP TABLE IF EXISTS public.table17 RESTRICT",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:32:23.597086",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table21 (col21_22 GEOMETRY NOT NULL, col21_23 REGNAMESPACE, col21_24 BOOL NULL, col21_25 FLOAT4 NULL, col21_26 INT2, col21_27 CHAR NOT NULL, col21_28 CHAR NOT NULL, col21_29 TIMETZ NOT NULL, col21_30 INT2 NOT NULL, col21_31 FLOAT4, PRIMARY KEY (col21_28 ASC, col21_27 DESC), col21_32 INT2 NOT NULL AS (col21_30 + (-21034):::INT8) STORED, col21_33 FLOAT4 NULL AS (col21_25 + col21_31) STORED, col21_34 STRING NOT NULL AS (lower(col21_28)) STORED, col21_35 STRING AS (lower(CAST(col21_23 AS STRING))) STORED, col21_36 INT2 AS (col21_26 + col21_30) VIRTUAL, col21_37 INT2 AS (col21_26 + 13206:::INT8) STORED, INDEX (col21_33 DESC, col21_26 DESC, col21_34 DESC, col21_35 ASC, (col21_30 + col21_26), col21_23 DESC, (col21_30 + col21_26) ASC, col21_37 ASC, col21_29 ASC, col21_36, col21_30) STORING (col21_22, col21_24, col21_31, col21_32), INDEX (col21_29 DESC) STORING (col21_22, col21_24, col21_25, col21_26, col21_31, col21_34, col21_37), INDEX (col21_29, lower(CAST(col21_22 AS STRING)) ASC, col21_30 ASC, col21_26 ASC, col21_32, (col21_25 + col21_31) DESC, col21_28 ASC, col21_23, col21_37, col21_27 DESC, col21_35 DESC), INDEX (col21_35 ASC, col21_24 DESC) STORING (col21_22, col21_23, col21_26, col21_30, col21_31, col21_32, col21_37), INDEX (col21_37 ASC, col21_29 DESC, (col21_30 + col21_26) DESC, col21_32 DESC, col21_31, col21_30 DESC, col21_25, col21_23, (col21_30 + col21_26) ASC) STORING (col21_24, col21_26, col21_34, col21_35), FAMILY (col21_22, col21_25), FAMILY (col21_23), FAMILY (col21_37, col21_24, col21_35), FAMILY (col21_26, col21_28), FAMILY (col21_32, col21_31), FAMILY (col21_29), FAMILY (col21_27, col21_30, col21_34, col21_33))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ dc72c17f280dc20fa59970209c0e975e4072f91e:

          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region "us-east1" already added to database (SQLSTATE 42710)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 2000 --concurrency 1 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:08:07.492697",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:08:07.51846",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum1 AS ENUM ('sa', 'a', 'sd', 'safaas', 'f')",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:08:07.574068",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "CREATE SCHEMA IF NOT EXISTS public AUTHORIZATION root",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: region \"us-east1\" already added to database (SQLSTATE 42710)"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ fb88f951323864fafd104e132cbf1f2f22f2e3ac:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:31:47.479075",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table32 ALTER COLUMN \"col17_18\" DROP NOT NULL",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:31:47.562571",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "CREATE TABLE public.table36 (col36_37 REGPROCEDURE NOT NULL, col36_38 GEOMETRY NULL, col36_39 \"char\" NULL, col36_40 BOX2D NULL, col36_41 INET NOT NULL, INVERTED INDEX (col36_39, col36_37 ASC, col36_38 DESC), INDEX (col36_37 ASC, col36_39) STORING (col36_40, col36_41), FAMILY (col36_39, col36_41, col36_40), FAMILY (col36_38), FAMILY (col36_37))",
          |   "DROP SEQUENCE IF EXISTS public.seq16",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:31:47.602444",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA public AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "42P06",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: schema \"public\" already exists (SQLSTATE 42P06)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:31:47.605018",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq42"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: scanBool: \"\\n\\t\\tSELECT json_array_length(\\n        crdb_internal.pb_to_json(\\n            'cockroach.sql.sqlbase.Descriptor',\\n            descriptor\\n        )-\u003e'table'-\u003e'mutations'\\n       )\\n       \u003e 0\\n\\t\\tFROM system.descriptor\\n\\t  WHERE id = $1::REGCLASS\\n\\t\\t\" [\"public.table36\"]: can't scan into dest[0]: cannot assign NULL to *bool"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ fb88f951323864fafd104e132cbf1f2f22f2e3ac:

The test failed on branch=release-21.2, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/scbench/randomload/nodes=3/ops=2000/conc=1/run_1
    schemachange_random_load.go:159,schemachange_random_load.go:92,test_runner.go:777: output in run_081436.020623920_n1_workload_run_schemachange: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-4042066-1641366923-22-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 2000 --concurrency 1 --txn-log /mnt/data1/cockroach/transactions.json returned: exit status 20
        (1) attached stack trace
          -- stack trace:
          | main.(*clusterImpl).RunE
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2030
          | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runSchemaChangeRandomLoad
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/schemachange_random_load.go:156
          | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerRandomLoadBenchSpec.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/schemachange_random_load.go:92
          | main.(*testRunner).runTest.func2
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:777
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1581
        Wraps: (2) output in run_081436.020623920_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-4042066-1641366923-22-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 2000 --concurrency 1 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I220105 08:14:37.105636 1 workload/cli/run.go:408  [-] 1  creating load generator...
          | I220105 08:14:37.176138 1 workload/cli/run.go:439  [-] 2  creating load generator... done (took 70.501121ms)
          | Error: ***UNEXPECTED ERROR; Failed to generate a random operation: Validation FAIL:
          | id 54, db schemachange, schema public, name table2: relation "table2" (54): invalid locality config: database schemachange is multi-region enabled, but table table2 has no locality set
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 2000 --concurrency 1 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:14:37.176681",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema1 AUTHORIZATION root",
          |   "CREATE TABLE IF NOT EXISTS public.table2 (col2_3 INET NOT NULL, col2_4 CHAR, col2_5 TIMESTAMP NOT NULL, col2_6 INT2 NOT NULL, PRIMARY KEY (col2_3, col2_6, col2_5 DESC), INDEX (col2_4, col2_3 DESC, col2_6 DESC, lower(CAST(col2_5 AS STRING)) DESC), INDEX (col2_6 DESC, col2_4, col2_3 ASC), UNIQUE (col2_4, col2_3 ASC), UNIQUE (col2_4 ASC, col2_3 DESC, col2_6 ASC), UNIQUE (col2_3 DESC), UNIQUE (col2_3 ASC, col2_6, lower(col2_4) DESC, col2_5 ASC) STORING (col2_4))",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: Validation FAIL:\nid 54, db schemachange, schema public, name table2: relation \"table2\" (54): invalid locality config: database schemachange is multi-region enabled, but table table2 has no locality set"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 0c8df44947208da2f6234d2736e8ab6d3b0937c0:

          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:55.778836",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table9 ALTER COLUMN \"col9_14\" DROP NOT NULL",
          |   "CREATE UNIQUE INDEX index9_19 ON public.table9 (col9_14 ASC, col9_13 DESC, col9_11) STORING (col9_10)"
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: column col9_11 is of type geography and thus is not indexable (SQLSTATE 0A000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:55.872742",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange ADD REGION \"us-east-2\""
          |  ],
          |  "expectedExecErrors": "42P12",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot add region \"us-east-2\" to database schemachange (SQLSTATE 42P12)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:55.877706",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table9 DROP CONSTRAINT \"primary\"",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "0A000",
          |  "message": "COMMIT; Successfully got expected commit error"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:35:55.908873",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east-2\"",
          |   "ALTER TABLE public.table9 ALTER COLUMN \"col9_10\" DROP DEFAULT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: scanBool: \"\\n\\t\\tSELECT json_array_length(\\n        crdb_internal.pb_to_json(\\n            'cockroach.sql.sqlbase.Descriptor',\\n            descriptor\\n        )-\u003e'table'-\u003e'mutations'\\n       )\\n       \u003e 0\\n\\t\\tFROM system.descriptor\\n\\t  WHERE id = $1::REGCLASS\\n\\t\\t\" [\"public.table9\"]: can't scan into dest[0]: cannot assign NULL to *bool"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 0c8df44947208da2f6234d2736e8ab6d3b0937c0:

          |  "workerId": 0,
          |  "clientTimestamp": "08:14:18.881786",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table21 RENAME COLUMN \"col9_14\" TO \"col9_11\""
          |  ],
          |  "expectedExecErrors": "42701",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col9_11\" of relation \"table21\" already exists (SQLSTATE 42701)"
          | }
          | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
          |     1.0s        0           11.3           12.0      4.5     15.7     15.7     15.7 opOk
          |     1.0s        0            6.6            7.0     71.3    176.2    176.2    176.2 txnOk
          |     1.0s        0            6.6            7.0      0.9      5.8      5.8      5.8 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:14:19.023518",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE INDEX index21_23 ON public.table21 (col9_11 DESC) STORING (col9_14)",
          |   "ALTER TABLE public.table21 SET LOCALITY REGIONAL BY ROW"
          |  ],
          |  "expectedExecErrors": "42P16",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot alter a table's LOCALITY if its database is not multi-region enabled (SQLSTATE 42P16)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:14:19.106711",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER DATABASE schemachange SURVIVE ZONE FAILURE"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: database must have associated regions before a survival goal can be set (SQLSTATE 42602)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:14:19.116799",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table19 ADD COLUMN col19_24 INT8"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: Validation FAIL:\nid 59, db schemachange, schema public, name table19: mutation job 725439149436141569: job not found"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 12c606395dc2cfb35bd82972ab65c4453f33c400:

          |  "workerId": 0,
          |  "clientTimestamp": "07:33:06.040578",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE public.seq37",
          |   "ALTER TABLE public.table50 ALTER COLUMN \"col50_59\" DROP STORED",
          |   "CREATE TYPE public.enum67 AS ENUM ('dasasd', 'sdf', 'sdff')",
          |   "CREATE TABLE public.table68 AS SELECT public.table50.col50_57, public.table50.col50_58, public.table50.col50_51, public.table50.col50_58, public.table50.col50_54, public.table50.col50_53, public.table50.col50_59 FROM public.table50, public.table50"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table50\" specified more than once (missing AS clause) (SQLSTATE 42712)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:33:06.174746",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:33:06.194252",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER SEQUENCE public.seq37 RENAME TO public.seq69",
          |   "ALTER TABLE public.table50 RENAME TO public.table50",
          |   "ALTER TABLE public.table50 DROP CONSTRAINT \"table50_col50_51_col50_57_col50_53_col50_52_key\""
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: cannot drop UNIQUE constraint \"table50_col50_51_col50_57_col50_53_col50_52_key\" using ALTER TABLE DROP CONSTRAINT, use DROP INDEX CASCADE instead (SQLSTATE 0A000)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:33:06.306028",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table70 (col70_71 BOOL, col70_72 TIMETZ NOT NULL, col70_73 VARCHAR NULL, col70_74 TIMESTAMP NOT NULL, col70_75 UUID NOT NULL, col70_76 JSONB, col70_77 TIMESTAMP NULL, col70_78 DATE, col70_79 VARCHAR NULL, col70_80 STRING NOT NULL AS (lower(CAST(col70_74 AS STRING))) VIRTUAL, col70_81 STRING NULL AS (lower(CAST(col70_77 AS STRING))) STORED, INDEX (col70_78 DESC) STORING (col70_72, col70_74, col70_75, col70_79, col70_81), UNIQUE (col70_78 DESC, col70_72 ASC) STORING (col70_76), UNIQUE (col70_78 DESC), UNIQUE (col70_77 DESC, col70_75 DESC) STORING (col70_72, col70_73, col70_78, col70_79))"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: scanBool: \"\\n\\t\\tSELECT json_array_length(\\n        crdb_internal.pb_to_json(\\n            'cockroach.sql.sqlbase.Descriptor',\\n            descriptor\\n        )-\u003e'table'-\u003e'mutations'\\n       )\\n       \u003e 0\\n\\t\\tFROM system.descriptor\\n\\t  WHERE id = $1::REGCLASS\\n\\t\\t\" [\"public.table50\"]: can't scan into dest[0]: cannot assign NULL to *bool"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.scbench/randomload/nodes=3/ops=2000/conc=1 failed with artifacts on release-21.2 @ 12c606395dc2cfb35bd82972ab65c4453f33c400:

          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table36\" does not exist (SQLSTATE 42P01)"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:10:30.71582",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum37 AS ENUM ('fsdd', 'affd', 'aad', 'af')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:10:30.743832",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema38 AUTHORIZATION root",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
          | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
          |     1.0s        0           21.7           23.0      3.7      8.9     15.2     15.2 opOk
          |     1.0s        0            3.8            4.0     37.7    130.0    130.0    130.0 txnOk
          |     1.0s        0           13.2           14.0      0.8      5.2      5.5      5.5 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "08:10:30.78137",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema39 AUTHORIZATION root",
          |   "CREATE SEQUENCE IF NOT EXISTS schema38.seq40",
          |   "ALTER DATABASE schemachange PRIMARY REGION \"us-east1\"",
          |   "CREATE TABLE schema39.table42 (col42_43 REGROLE NOT NULL, col42_44 REGTYPE NULL, col42_45 NAME NULL, col42_46 INT4 NOT NULL, col42_47 TIMETZ NOT NULL, col42_48 REGCLASS NOT NULL, col42_49 REGPROCEDURE NOT NULL, col42_50 CHAR NOT NULL, col42_51 INT4, PRIMARY KEY (col42_50), col42_52 STRING NOT NULL AS (lower(CAST(col42_48 AS STRING))) VIRTUAL, col42_53 STRING NOT NULL AS (lower(CAST(col42_47 AS STRING))) VIRTUAL, col42_54 INT4 AS (col42_51 + col42_46) VIRTUAL, UNIQUE (col42_46, col42_49 ASC, (col42_51 + col42_46) ASC, col42_44 ASC) STORING (col42_45, col42_48, col42_51), UNIQUE ((col42_46 + col42_51), col42_53, col42_51, col42_52 DESC, col42_43 ASC, col42_48 DESC, (col42_46 + col42_51) DESC, col42_46 DESC), INDEX (col42_54 DESC, (col42_51 + col42_46) ASC, lower(CAST(col42_49 AS STRING)) DESC, col42_48 ASC, col42_46 ASC, col42_51 DESC, col42_43 ASC, col42_47 ASC), INDEX (col42_53 ASC, col42_44, col42_49 ASC, col42_54, col42_50 DESC), UNIQUE (col42_47 ASC, lower(CAST(col42_47 AS STRING)) ASC, col42_46 DESC, col42_51, col42_54 ASC, col42_44 DESC, col42_48 DESC, col42_45 ASC, col42_50 ASC, col42_52 DESC), UNIQUE (col42_49 ASC) STORING (col42_46), INDEX (lower(CAST(col42_43 AS STRING)) DESC, col42_45, col42_50 ASC, col42_54, col42_53 DESC, col42_46 ASC, col42_43 DESC) STORING (col42_48, col42_49, col42_51), UNIQUE (col42_51, col42_43 ASC), FAMILY (col42_46, col42_43), FAMILY (col42_48, col42_47), FAMILY (col42_44), FAMILY (col42_51, col42_49, col42_50, col42_45))",
          |   "SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": ""
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *exec.ExitError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

Same failure on other branches

- #63514 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #61976 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #61685 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-21.1] - #56081 roachtest: scbench/randomload/nodes=3/ops=2000/conc=1 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!