cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30k stars 3.79k forks source link

roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed #61688

Closed cockroach-teamcity closed 2 years ago

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@8c3fa11ca35deca2f38a1e6fb5f0dea4a77285bd:

          |  "workerId": 0,
          |  "clientTimestamp": "07:51:38.22948",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER VIEW schema177.view295 RENAME TO schema177.view296"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema177.view295\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:51:37.982605",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema177.table315 DROP COLUMN \"IrrelevantColumnName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema177.table315\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:51:38.507529",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table257 ADD CONSTRAINT table257_col257_314_unique UNIQUE (col257_314)"
          |  ],
          |  "expectedExecErrors": "42703",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col257_314\" does not exist (SQLSTATE 42703)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:51:38.43934",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table258 (col258_259 DECIMAL, col258_260 REGNAMESPACE NULL, col258_261 REGCLASS NOT NULL, col258_262 VARCHAR NOT NULL, col258_263 TIMESTAMPTZ NOT NULL, col258_264 INT8, col258_265 REGPROCEDURE NOT NULL, col258_266 REGNAMESPACE NOT NULL, PRIMARY KEY (col258_265 DESC, col258_261 DESC, col258_262, col258_266), col258_267 STRING AS (lower(CAST(col258_261 AS STRING))) VIRTUAL, UNIQUE (col258_264 DESC, col258_261, col258_267, col258_260 DESC, col258_266 ASC, col258_259, col258_263 DESC, col258_265 ASC, col258_262 DESC), INDEX (col258_267 DESC, col258_259, col258_266 ASC), UNIQUE (col258_265 DESC, col258_263 DESC, col258_259 DESC, col258_261 ASC, col258_266 ASC, col258_264 DESC, col258_267 ASC, col258_260 DESC, col258_262), UNIQUE (col258_267, col258_266 DESC, col258_263 ASC, col258_262 DESC, col258_260), INDEX (col258_263 DESC, col258_266, col258_261 DESC, col258_264 DESC, col258_267 DESC) STORING (col258_260), INDEX (col258_267) STORING (col258_259, col258_260, col258_263))",
          |   "INSERT INTO public.table258 (col258_259,col258_260,col258_261,col258_262,col258_263,col258_264,col258_265,col258_266,col258_267) VALUES (51225135152357214.38:::DECIMAL,262312517:::OID,2243024149:::OID,'\"':::STRING,'1998-04-19 21:35:45.000389+00:00':::TIMESTAMPTZ,9117111860797605753:::INT8,3924504503:::OID,1942673304:::OID,'':::STRING),(70228663145.89621194:::DECIMAL,0:::OID,3185619865:::OID,e'$WW\\x7f%\\f5':::STRING,'1989-10-15 23:42:05.000733+00:00':::TIMESTAMPTZ,(-3600514830243974164):::INT8,2935998227:::OID,772003351:::OID,'A':::STRING),(2.922084246122010643E+32:::DECIMAL,4150309104:::OID,1313584268:::OID,e',K\\x1bR$p':::STRING,'1992-09-21 13:45:35.000815+00:00':::TIMESTAMPTZ,8600552832911437258:::INT8,1988186621:::OID,0:::OID,e'\\\\=LR':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col258_267\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2757432&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

Jira issue: CRDB-6265

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 62ea894aa0cd36435e43c7ce09ac5ebef91be78e:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:04.831349",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema7.table36 ALTER COLUMN \"col36_38\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "42611",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col36_38\" is not a computed column (SQLSTATE 42611)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:04.779453",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE INVERTED INDEX index36_59 ON schema7.table36 (col36_37 DESC) STORING (col36_44, col36_40, col36_45, col36_38, col36_46, col36_47, col36_41, col36_42)"
          |  ],
          |  "expectedExecErrors": "0A000,26000,42701",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: inverted indexes don't support stored columns (SQLSTATE 26000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:04.966248",
          |  "ops": [
          |   "BEGIN",
          |   "INSERT INTO schema7.table36 (col36_37,col36_38,col36_39,col36_40,col36_41,col36_42,col36_43,col36_44,col36_45,col36_46,col36_47,col36_48) VALUES ('16 years 8 mons 689 days 08:07:49.998461':::INTERVAL,0:::OID,'1':::JSONB,(-5089):::INT8,'01050000000A000000010200000003000000600B641AA1820042307E224858AAEE41120AF7E256C3F5C1AAB6F5D7D68AFA41ECCDFC33CCD3EDC1D8B19CE9E2CDDF410102000000070000006DAC47B810EBFFC18D25A4A75287F1C1683651684AF2F7C1D381470F4412F0C1182F6E29BEC9E7C1401882515A73D4C17450C041F662DEC1522361796F8DF2C1A0F06A1E24F0BF41C0BDCCE19552A6C1903A674A14F6F941CECA85265E4EF741DC57D24F459FE941C4F1FD70E6CCFE4101020000000400000036950DE39A2001C21D17A53AF8AAF0C188AB1E487196F4C11EC45D697C43F7C18640A95C957DE0C15F3D6DA80FC200C290B1705DB055EC413A631AD2D939F9C10102000000020000005239AFC950280242E0D873E408CEFF4194D3A810867DE3C10CA78AB6C7B8F1410102000000090000007E1F2105A79BF2417AD20CAFFE0800C248D2D2E994B50142774B0346B6BE00C2C8B42920F71FEE41B02899E1C737E7C1A2AD223BC327F74114FEFD4D41C3E1C1C8727F5F2767E841726042397F6DE1C17021A93AB10BEE414096708F455EB6C112F070C49CBFEFC1AEAF07E21A37F441AAB9245DE0FCF1C190E6E57A9DE2C3C1B0FD9B01D79DD7C11266BB7C82E9E8C1010200000005000000E8B91C12B553D041A9B37B62270FF1C11C07E0252DEEFA41D91DD03323A8FAC1348A0B594AD6FA41517BE3B1FE74F2C178CC31AE5971EF41C6E85E82F738E1C1DA25366EFF1BF2419C70F8D50F6EF74101020000000300000068425399FADFEF418913FEC9C68401C2C81654AEE23BE641888BCCD3C1EEDC415CC08386484CF7C1507CB27E941FCAC1010200000006000000F26B2E3F0F4C0042A5FE197CA2C2F0C16CCE8B4B5E0BE641B04BD699ADD3CEC19C2A8ED1C6C7FD413EC6C1092B5AEDC160015BD33F60F0412025CE1C4CDBE1416859B4EE468DE141EC7E83D78150F341409136159678F8C154741E6720B1FE41010200000007000000187979010EBAF0418092ED119097D741403745486463E641E2820D3180AA01C26C23E58E627AFB4164F39E85D6DFE0C1C0D773A8F72CFD41248AFF12977AEC412E284F942207014200268721F7B4F941A8EEE60D467BF441A4F525C6DF27FC415428C64FB793ED41B69E3ACCB21002420102000000020000009CC8F7A83500EB41AED7657C7D9FF041FA79580F6C7FFFC17E3CD640818AF941':::GEOMETRY,542935557:::OID,'04:09:43.991697':::TIME,'1988-06-08 17:30:17.000431+00:00':::TIMESTAMPTZ,'-80 years -6 mons -57 days -11:13:33.343387':::INTERVAL,'-':::STRING,'\"':::STRING,e'\\x00':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col36_48\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:04.902519",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #66215 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-66206] - #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 88f78879adc48ba5b0a8c13f9aeb7931d89f3608:

          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table42\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:01:11.293154",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA public AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "42P06",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: schema \"public\" already exists (SQLSTATE 42P06)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:01:11.292225",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema32 AUTHORIZATION root",
          |   "SELECT 'validating all objects'",
          |   "CREATE TABLE IF NOT EXISTS schema32.table44 (col44_45 REGPROCEDURE NOT NULL, col44_46 INT2 NOT NULL, col44_47 OID NULL, col44_48 BIT(45) NOT NULL, PRIMARY KEY (col44_48 DESC, col44_45, col44_46 ASC), col44_49 INT2 AS (col44_46 + (-23445):::INT8) VIRTUAL, col44_50 STRING NOT NULL AS (lower(CAST(col44_47 AS STRING))) VIRTUAL, INDEX (col44_45 ASC) STORING (col44_47), INDEX (col44_45 ASC, col44_50 ASC, col44_48 DESC, col44_46 ASC, col44_47 ASC), UNIQUE (col44_49, col44_50 DESC), UNIQUE (col44_50 DESC, col44_47 DESC), UNIQUE (col44_49 DESC) STORING (col44_47))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=e16064c9 key=/Table/SystemConfigSpan/Start pri=0.01496971 epo=0 ts=1623308471.544216566,1 min=1623308471.292113905,0 seq=20} lock=true stat=PENDING rts=1623308471.292113905,0 wto=false gul=1623308471.792113905,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:01:11.293267",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table24 (col24_25 INT8, col24_26 \"char\" NOT NULL, col24_27 NAME NOT NULL, col24_28 REGTYPE NOT NULL, PRIMARY KEY (col24_27 ASC), col24_29 STRING AS (lower(col24_26)) VIRTUAL, col24_30 STRING AS (lower(col24_26)) VIRTUAL, col24_31 STRING AS (lower(col24_26)) VIRTUAL, INDEX (col24_30, col24_28, col24_29, col24_31 ASC, col24_27 DESC, col24_25, col24_26 DESC), UNIQUE (col24_30), INDEX (col24_27 DESC, col24_26 DESC, col24_28 ASC, col24_31 DESC, col24_25 DESC), UNIQUE (col24_25 ASC, col24_30 ASC) STORING (col24_26), UNIQUE (col24_28, col24_27 DESC), INDEX (col24_29 ASC, col24_27 DESC, col24_25 DESC, col24_30, col24_26, col24_28, col24_31 DESC), INDEX (col24_28, col24_27, col24_29 DESC) STORING (col24_25, col24_26))",
          |   "CREATE TYPE public.enum35 AS ENUM ('assfad', 'd', 'sfaffa', 'a', 'ffs', 'ss')",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq40",
          |   "ALTER TABLE public.table24 ALTER COLUMN \"col24_29\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"col24_29\" is not a stored computed column (SQLSTATE 42611)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 3da8bae2842269ad9ce72b22501293b2efcd3a71:

          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | : [
          |   "BEGIN",
          |   "INSERT INTO public.table2 (col2_3,col2_4,col2_5,col2_6,col2_7) VALUES ('0103000020E610000001000000060000001725D716C6ED60C000CC8254264C23C0603C12D9E99C3EC0A049EC9FFD7936C060F9E5D7137044C06069E350933E10C0E02DC1C834A745C010987E35565E144021B542D2A3C563C010DCB85D726B48401725D716C6ED60C000CC8254264C23C0':::GEOGRAPHY,0.09282097668494249:::FLOAT8,'3':::STRING,true,ARRAY['06:49:40.225042+07:57:00':::TIMETZ,'14:34:39.390934-05:37:00':::TIMETZ,'15:55:22.62064+12:49:00':::TIMETZ]),('0104000020E6100000070000000101000000942117DFB4E347C0DCFD72CEE95E40400101000000E8722F44038046408091CB68C36030C0010100000010E4A2D0D2F44840081E50B5D18A34C0010100000045A7C97B23C663C0B3B2A50E3A3C56C00101000000286BCA2D8A9E37C0D0B482ADACDA12400101000000C9774FCEE7EE62C0E2E9EA44EE4F4DC00101000000F0C21B7CF5B9284030AF5D669E471040':::GEOGRAPHY,(-0.3638427249129614):::FLOAT8,'\u0026':::STRING,true,ARRAY['13:05:10.460867-06:49:00':::TIMETZ,'05:45:45.312334+00:59:00':::TIMETZ]),('0104000020E6100000010000000101000000C8A4B45C2547474098D61DABB1B43440':::GEOGRAPHY,'-Inf':::FLOAT8,'f':::STRING,true,ARRAY['14:38:47.122196+02:02:00':::TIMETZ])"
          |  ],
          |  "expectedExecErrors": "23505",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: duplicate key value violates unique constraint \"table2_col2_6_key\" (SQLSTATE 23505)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          |     2.0s        0           26.0           28.0     13.6    738.2    738.2    738.2 opOk
          |     2.0s        0            5.0            4.5   1140.9   1543.5   1543.5   1543.5 txnCmtErr
          |     2.0s        0            1.0            2.0    251.7    251.7    251.7    251.7 txnOk
          |     2.0s        0           18.0           21.0      2.5     12.6     62.9     62.9 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:51:46.713711",
          |  "ops": [
          |   "BEGIN",
          |   "INSERT INTO public.table2 (col2_3,col2_4,col2_5,col2_6,col2_7) VALUES ('0104000020E61000000700000001010000008E889C03556A61C088DC5FFDA5172740010100000050B11CB639A25B403025756F412817400101000000B9324EB4DF8259C0C4F682820A7C46400101000000AA098A7F316764C0D8B3F6AE188D5140010100000080B6B3AB8B263FC038899B4AF2DC3DC0010100000060F196E8704B4F40CA3F9D91A15A4BC0010100000057C2FCCBF06D63C03B0F4FF8295B45C0':::GEOGRAPHY,(-0.6317496423074243):::FLOAT8,'h':::STRING,true,ARRAY['24:00:00-15:59:00':::TIMETZ]),('0104000020E61000000200000001010000006C2404E4C08556401082B81FE99D2AC00101000000E8E5C4D52B4D5DC04211950E62B353C0':::GEOGRAPHY,1.2234395399577331:::FLOAT8,'f':::STRING,false,NULL)",
          |   "CREATE TABLE public.table108 AS SELECT public.table2.col2_5, public.table2.col2_3, public.table2.col2_7, public.table2.col2_3, public.table2.col2_4, public.table2.col2_7, public.table2.col2_3, public.table2.col2_6, public.table2.col2_5, public.table2.col2_7 FROM public.table2, public.table2, public.table2"
          |  ],
          |  "expectedExecErrors": "0A000,42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table2\" specified more than once (missing AS clause) (SQLSTATE 42712)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:51:46.259019",
          |  "ops": [
          |   "BEGIN",
          |   "DROP TABLE public.table2 RESTRICT",
          |   "CREATE TYPE public.enum102 AS ENUM ('d', 'sds', 'sasfff', 'fs')",
          |   "CREATE TABLE public.table103 (col103_104 JSONB NOT NULL, col103_105 INT8 NOT NULL, col103_106 REGNAMESPACE NOT NULL, col103_107 INT8 AS (col103_105 + 7893516347612384189:::INT8) STORED, INDEX (col103_106) STORING (col103_105, col103_107), UNIQUE (col103_106 ASC), INVERTED INDEX (col103_104), UNIQUE (col103_105 ASC, col103_107, col103_106 ASC), INDEX (col103_106), UNIQUE (col103_105 DESC), FAMILY (col103_106), FAMILY (col103_107), FAMILY (col103_105), FAMILY (col103_104))",
          |   "ALTER TABLE public.table103 DROP COLUMN \"col103_105\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"col103_105\" is referenced by computed column \"col103_107\" (SQLSTATE 42P10)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 52c1760093875d5ba25279749617dff5a4dbc8c8:

          |  "workerId": 0,
          |  "clientTimestamp": "07:00:38.626537",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "ALTER TABLE public.table163 DROP CONSTRAINT \"table163_col163_177_col163_174_col163_176_col163_168_col163_169_col163_171_col163_173_col163_164_col163_175_key\""
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: cannot drop UNIQUE constraint \"table163_col163_177_col163_174_col163_176_col163_168_col163_169_col163_171_col163_173_col163_164_col163_175_key\" using ALTER TABLE DROP CONSTRAINT, use DROP INDEX CASCADE instead (SQLSTATE 0A000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:00:38.892894",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table180 ALTER COLUMN IrrelevantColumnName DROP STORED"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table180\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:00:38.855869",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema158 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=6aaab3fd key=/Table/SystemConfigSpan/Start pri=0.00322042 epo=0 ts=1623481239.160542260,1 min=1623481238.855807072,0 seq=6} lock=true stat=PENDING rts=1623481238.855807072,0 wto=false gul=1623481239.355807072,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:00:38.850793",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE UNIQUE INDEX index163_182 ON public.table163 (col163_175 ASC, col163_177, col163_169 DESC, col163_174 DESC, col163_167 DESC, col163_165 ASC, col163_168, col163_171 DESC, col163_172 ASC) STORING (col163_173, col163_176, col163_166, col163_164)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table163\" (87): index \"index163_182\" cannot store virtual column \"col163_176\" (SQLSTATE XXUUU)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 10abf6e8bc246ec5c8b32ddc973f434595a46e5b:

          |   "CREATE TABLE public.table34 (col34_35 BOX2D, col34_36 OID, col34_37 FLOAT8, col34_38 CHAR, col34_39 BOOL NULL, col34_40 REGNAMESPACE, col34_41 TIMETZ NOT NULL, col34_42 UUID NULL, col34_43 REGPROC NOT NULL, col34_44 INTERVAL NOT NULL, col34_45 FLOAT4 NOT NULL, PRIMARY KEY (col34_43 DESC), col34_46 FLOAT8 NULL AS (col34_37 + col34_45) VIRTUAL, col34_47 FLOAT4 NULL AS (col34_45 + col34_37) STORED, UNIQUE (col34_45 ASC, col34_43 DESC, col34_46 ASC, col34_35 ASC, col34_38, col34_47 DESC, col34_39 DESC, col34_36, col34_37 DESC, col34_44 DESC) STORING (col34_40), INDEX (col34_37, col34_38 ASC, col34_36 DESC, col34_39, col34_35 DESC, col34_45 ASC, col34_40 ASC, col34_43 ASC), INDEX (col34_37, col34_43 DESC, col34_39 ASC, col34_45 DESC, col34_41 ASC), UNIQUE (col34_41, col34_38 DESC, col34_46, col34_37 ASC, col34_42, col34_39, col34_47 ASC) STORING (col34_35, col34_36, col34_40, col34_45), UNIQUE (col34_40 ASC) STORING (col34_35, col34_37, col34_38, col34_39, col34_41, col34_44, col34_45, col34_47))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=d8551bb1 key=/Table/SystemConfigSpan/Start pri=0.02099490 epo=0 ts=1623654096.323406369,1 min=1623654096.321452808,0 seq=7} lock=true stat=PENDING rts=1623654096.321452808,0 wto=false gul=1623654096.821452808,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:01:36.321925",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:01:36.322369",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema2 AUTHORIZATION root",
          |   "CREATE TYPE public.enum30 AS ENUM ('dfaa', 'sfdfs', 'af', 'as', 'adfs')",
          |   "CREATE TYPE schema49.enum50 AS ENUM ('ad', 'd', 'dsfaf')"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema49.enum50\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:01:36.320534",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table10 (col10_11 STRING NOT NULL, col10_12 FLOAT8 NOT NULL, col10_13 TIME NOT NULL, col10_14 FLOAT8 NOT NULL, PRIMARY KEY (col10_14 ASC, col10_12 ASC, col10_13 DESC, col10_11 DESC), col10_15 FLOAT8 NOT NULL AS (col10_14 + col10_12) STORED, col10_16 STRING NOT NULL AS (lower(col10_11)) STORED, UNIQUE (col10_14, col10_11 DESC, col10_13 ASC, col10_16 ASC), UNIQUE (col10_14 DESC), UNIQUE (col10_15, col10_12 DESC, col10_13, col10_16, col10_14 ASC), INDEX (col10_12, col10_11, col10_14 ASC, col10_16 DESC, col10_15 ASC), UNIQUE (col10_16), INDEX (col10_13 ASC), INDEX (col10_12 DESC, col10_13, col10_16 DESC, col10_15 ASC, col10_14 ASC), FAMILY (col10_16), FAMILY (col10_15), FAMILY (col10_14, col10_12), FAMILY (col10_13, col10_11))",
          |   "INSERT INTO public.table10 (col10_11,col10_12,col10_13,col10_14,col10_15,col10_16) VALUES (e'{gKIe\\r\\x05S':::STRING,1.7512680938006429:::FLOAT8,'19:44:03.953515':::TIME,(-1.7836769668788426):::FLOAT8,'+Inf':::FLOAT8,'':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col10_15\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 8cd2c9de5d5539e4837d6daa12a7b5c799554aca:

          | stderr:
          | I210615 06:49:50.863346 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210615 06:49:50.957224 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 93.876877ms)
          | Error: ***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | rors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=ddc261e7 key=/Table/SystemConfigSpan/Start pri=0.03672387 epo=0 ts=1623739791.505427516,1 min=1623739791.055169626,0 seq=16} lock=true stat=ABORTED rts=1623739791.055169626,0 wto=false gul=1623739791.555169626,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:49:51.174871",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE public.seq42",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq98",
          |   "CREATE TABLE IF NOT EXISTS public.table99 (col99_100 BOX2D, col99_101 FLOAT8 NOT NULL, col99_102 REGTYPE NULL, col99_103 REGPROC NOT NULL, col99_104 REGNAMESPACE NOT NULL, col99_105 UUID, col99_106 DATE NULL, col99_107 REGTYPE NULL, col99_108 FLOAT4, col99_109 FLOAT4 NULL, col99_110 INT2[], col99_111 INET NOT NULL, col99_112 REGTYPE, col99_113 NAME NOT NULL, col99_114 CHAR NOT NULL, col99_115 INET NOT NULL, col99_116 CHAR NOT NULL, PRIMARY KEY (col99_116 ASC), UNIQUE (col99_111, col99_113 DESC, col99_116 ASC, col99_107 DESC, col99_105 DESC, col99_114 DESC, col99_104 ASC, col99_106, col99_109 DESC) STORING (col99_100, col99_110, col99_112), INDEX (col99_111 DESC, col99_102 DESC, col99_100, col99_107 DESC))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=98780f5b key=/Table/SystemConfigSpan/Start pri=0.02595978 epo=0 ts=1623739791.505427516,1 min=1623739791.174805355,0 seq=26} lock=true stat=PENDING rts=1623739791.174805355,0 wto=false gul=1623739791.674805355,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:49:51.505511",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table77 (col77_78 DECIMAL NOT NULL, col77_79 BOOL NULL, col77_80 INT4 NULL, col77_81 INTERVAL, col77_82 TIMESTAMPTZ NOT NULL, col77_83 OID NOT NULL, col77_84 TIMESTAMP NULL, PRIMARY KEY (col77_83), col77_85 STRING NOT NULL AS (CASE WHEN col77_82 IS NULL THEN NULL ELSE e'w\\x17+]\u003cy*':::STRING END) VIRTUAL, col77_86 STRING NOT NULL AS (lower(CAST(col77_84 AS STRING))) STORED, col77_87 DECIMAL NOT NULL AS (col77_78 + (-8.389874005639649583E+28):::DECIMAL) VIRTUAL, col77_88 STRING NOT NULL AS (CASE WHEN col77_82 IS NULL THEN e'My\\t\\x06\\\\\\x1ad\\n':::STRING ELSE e'\\fs\\x1f]':::STRING END) STORED, col77_89 STRING AS (lower(CAST(col77_79 AS STRING))) STORED, INDEX (col77_89 ASC, col77_81 ASC, col77_86, col77_84 ASC, col77_78 DESC, col77_85, col77_79 ASC, col77_82 DESC, col77_88 ASC, col77_83 ASC), UNIQUE (col77_82, col77_87 DESC, col77_81, col77_88 DESC, col77_79, col77_78 DESC, col77_86 ASC, col77_85 ASC, col77_80), UNIQUE (col77_87 ASC), UNIQUE (col77_85 DESC, col77_82) STORING (col77_78, col77_79, col77_86, col77_88, col77_89), INDEX (col77_83 DESC), INDEX (col77_89 ASC, col77_83 DESC, col77_79, col77_85 ASC) STORING (col77_78, col77_80, col77_81, col77_82, col77_88), INDEX (col77_80, col77_79, col77_82 ASC, col77_84 ASC, col77_88, col77_83 DESC, col77_85 ASC, col77_86, col77_89 ASC) STORING (col77_78, col77_81), UNIQUE (col77_85 DESC, col77_79, col77_89 DESC, col77_83, col77_81 DESC, col77_87 DESC, col77_78, col77_82 DESC), UNIQUE (col77_82 ASC) STORING (col77_78, col77_79, col77_86, col77_89), FAMILY (col77_84, col77_86, col77_83), FAMILY (col77_81, col77_80, col77_88), FAMILY (col77_89, col77_82), FAMILY (col77_79), FAMILY (col77_78))",
          |   "ALTER SEQUENCE public.seq42 RENAME TO public.seq94",
          |   "CREATE TYPE public.enum117 AS ENUM ('sdddfd', 'faa', 'da', 'ff', 'dsa')"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ af2c90b391faa0e0256b96269a0e3c2e29a0ca7b:

          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: cannot drop UNIQUE constraint \"table105_col105_106_col105_107_key\" using ALTER TABLE DROP CONSTRAINT, use DROP INDEX CASCADE instead (SQLSTATE 0A000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:25:26.978518",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema37.enum214 AS ENUM ('f')",
          |   "SELECT 'validating all objects'",
          |   "CREATE SEQUENCE IF NOT EXISTS schema37.seq246",
          |   "ALTER TABLE public.table105 ADD CONSTRAINT table105_col105_107_table105_col105_107_fk FOREIGN KEY (col105_107) REFERENCES public.table105 (col105_107) ON DELETE CASCADE ON UPDATE CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=5a241c66 key=/Table/SystemConfigSpan/Start pri=0.01545087 epo=0 ts=1623828327.416373616,1 min=1623828326.978456635,0 seq=22} lock=true stat=ABORTED rts=1623828326.978456635,0 wto=false gul=1623828327.478456635,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:25:27.058489",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table215 (col215_216 DECIMAL[], col215_217 BOX2D, col215_218 GEOGRAPHY NULL, col215_219 REGTYPE NOT NULL, col215_220 REGNAMESPACE NOT NULL, PRIMARY KEY (col215_219 DESC, col215_220 ASC), FAMILY (col215_218, col215_220), FAMILY (col215_216, col215_219, col215_217))",
          |   "DROP SCHEMA \"schema37\" CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=1a13690c key=/Table/SystemConfigSpan/Start pri=0.00884156 epo=0 ts=1623828327.847927359,1 min=1623828327.058408860,0 seq=13} lock=true stat=ABORTED rts=1623828327.058408860,0 wto=false gul=1623828327.558408860,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:25:27.180176",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table105 ADD CONSTRAINT table105_col105_106_unique UNIQUE (col105_106)",
          |   "SELECT 'validating all objects'",
          |   "INSERT INTO public.table105 (col105_106,col105_107) VALUES ('06:05:33.722073':::TIME,'':::STRING),('12:16:50.759075':::TIME,'ieN9kP':::STRING)",
          |   "ALTER TABLE public.table105 ALTER COLUMN \"col105_106\" DROP NOT NULL"
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ e8671f5785c19039945459cc630c527d03f59d2e:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/scbench/randomload/nodes=3/ops=10000/conc=20/run_1
    schemachange_random_load.go:145,schemachange_random_load.go:80,test_runner.go:767: output in run_070258.133_n1_workload_run_schemachange: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3091918-1623909886-22-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned: exit status 20
        (1) attached stack trace
          -- stack trace:
          | main.(*cluster).RunE
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2312
          | main.runSchemaChangeRandomLoad
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:142
          | main.registerRandomLoadBenchSpec.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:80
          | main.(*testRunner).runTest.func2
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:767
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1374
        Wraps: (2) output in run_070258.133_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3091918-1623909886-22-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I210617 07:02:59.048273 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210617 07:02:59.136799 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 88.525009ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col34_49" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | DFBF76A1A23EC0A085122138B44140BC3DE4F335E861C0F0DED24618CC444016C3493DF0E363C018FD1CC10AB0244001030000000100000009000000E0D15C24B54F3F40DCD41E964E503FC0907952E47A125340C9DEA1DBC5A647C042C69BD842D962407EFE4A2CFDF655C0A8C6C72BE9CF614070780EBB27E72440246B6FECA3AC63406E6DFDA86E0C5040D08ADDEB606822404C5547124C893E4051297F8BEAB156C0D26B76967BBA5340AFBE403A832760C064C1ECB2ED6C4D40E0D15C24B54F3F40DCD41E964E503FC001030000000100000009000000014D4394AD8F5FC09F23D90864034FC0B3E0B69CE92357C0E5041353F9CF42C0E0582D44F5C642C03ECDB377819751C0346A38FAD0E741C0537741A2CE8B45C068A45200BE3546C0282C3D98792B26C0C0F0B2354D783BC08CAA5044907E4B408806C2E6425E39C088D51A9E872A54403DE66EAC090251C0F8B92862A4E84440014D4394AD8F5FC09F23D90864034FC001030000000100000008000000F81DAEC73DC55440EF4193673F7051C01C004D53221F6640427B4E2B2FDD45C0609163C03F0E6140206311EA1C0D07C0984781835FEA5D404CE693C93F3D4C402A60058B3C8060403C941ABD84BA524077CDF84DBA235EC098ED7798ECA2544088E274E4E2C141C0B4AD0617ED9F3B40F81DAEC73DC55440EF4193673F7051C0010300000001000000090000007185D2683D4F5AC0F8D3BDD8504C2AC060322C29FA6827C03A588B2C75543BC000E08DB3CC5ED93FE098FCBBED9031C08803EA6D372A37407CA74E0D947732C02E518A154D7A664096CDA368F8E341406CE36A11DC225A405C45959A48474F40CC6ECCB85E714AC0CA7707FD6AA9534007E2C7984C505CC0221FF4365A4242407185D2683D4F5AC0F8D3BDD8504C2AC0':::GEOGRAPHY,false,'03:11:25.239244':::TIME,'BOX(-10 -10,10 10)':::BOX2D,B'111',e'l-X\\x1b_z':::STRING,e'ig\\x1ckPS=\\x01':::STRING,NULL),(e'+lE\\x05zz':::STRING,'12.153.111.65/21':::INET,210039281:::OID,'affdbd9c-aaf5-47b0-9313-13522e1e6358':::UUID,e'\\x13':::STRING:::NAME,'0107000020E6100000050000000103000020E61000000100000008000000406B2E923D833340B6593BF107E255C0682F4A7A5C95354003E279856ED350C038CF197A54AA48404678BD7205234BC0048808FA2D5C444080D61BC4EBE0FB3FDC8197B16C854AC020817D5A313D28C00CFE106F16BF52C0C00904D5BBB331C0F93DEF29806A55C04F6EB249EBC740C0406B2E923D833340B6593BF107E255C00104000020E6100000070000000101000000008381EDCC69544010AC260AB0A43840010100000060670933483623C01C442784A387454001010000004460BE747A9F56403C0AAFFEE6164A400101000000AA51AC7522BE61C014B7634CC1C7544001010000008040BC2C410BFC3FB8EA863FBF0B2D400101000000363DB62ED19E6440FC6DBBF915E63D400101000000C0235912122C0E407025E2C6B1D924400102000020E6100000020000007ECB3A4D602D6140A64AE1933DE3524034D66537F8E547404C4B6C1848EE55400105000020E6100000070000000102000000040000008C6A3BC9DB5440405475F9C0DD0B304002138064058B4FC064194B7D85714C40C58D3832F5D753C018382867F65E404048B362098E3E61C002BB25A823EB50400102000000020000002CA1CBCDFAB9524002A294C4045F504034B081FB62B146C0F8AE8947C5EF4E4001020000000500000028CA4D5262364EC02FE620C1282A51C000C431E4CBD6CA3FBBF89B945ABF47C0440BB8FD411958408FCA681EDDD954C02CD2611E59E75440598688F8A43846C00CED122826266540568ADE3B653E4FC0010200000007000000748DE65F827164C0D0215A38BF9050C0BD20C616774050C000F677F5730217C0FC8BB429C2314340E4E0D3139C854CC0042DDB5BE6EF61403C9C1F9D9130354020B038B46B754A4014072D9AA67F4440E88546828D8758403897E62CAC3B5340486866137A6147401877B8423DBC4D4001020000000200000050993E9FF0964FC0B8F3CBEB6097544075C1A802826362C0B0DCD6C7A35037400102000000050000005CB3B5B2BBB04240D27793A659F84040B2CC0E16A501614098DAE19266E44140C4B56FE943095F4028368F99D4824340144A90B3DC365440347297FBF7134D40A01F0767380362C01C69C6085D09484001020000000400000018528C90337A44C0AC2225C337E149C0B49A23A128DC4A405888D2A3EC54384050AE743194BF26C064EC6EF64B2A39405C9638ADC07F66C04EF577EC9E3050400101000020E6100000401145FB91011040A6453D3FC3B044C0':::GEOGRAPHY,ARRAY['%':::STRING],'\\xf02091':::BYTES,0:::OID,'0102000020E610000003000000287C7B55901E574008F7F6ED9B205540602122E6DB62294078DE16081EF44540009A2022E9E55FC0084D30FB414E5040':::GEOGRAPHY,false,'00:51:32.015592':::TIME,'BOX(0.15308254708477476 -0.0942104658137557,2.159060833910495 0.02783233385785433)':::BOX2D,B'011',NULL,e'\\x0e^x':::STRING,e'z\\x13\\x0fdt\\x04u``':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col34_49\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 4d113ce4e43672d60e0473831c02229583f18119:

        Wraps: (2) output in run_070149.696_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3095660-1623996152-21-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I210618 07:01:50.593301 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210618 07:01:50.684964 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 91.660623ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col59_74" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | 80,0 wto=false gul=1623999711.565318780,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:01:51.131665",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema24.enum105 AS ENUM ('sssf')",
          |   "CREATE TABLE schema24.table128 (col128_129 INET NOT NULL, col128_130 GEOMETRY NULL, col128_131 BIT(34), col128_132 REGCLASS NOT NULL, col128_133 BOX2D NOT NULL, col128_134 REGPROC NOT NULL, col128_135 BOOL NOT NULL, col128_136 CHAR NOT NULL, col128_137 REGCLASS, PRIMARY KEY (col128_134 ASC, col128_136, col128_135 ASC, col128_133, col128_132 ASC, col128_129), col128_138 STRING NULL AS (lower(CAST(col128_130 AS STRING))) VIRTUAL, col128_139 STRING AS (lower(CAST(col128_132 AS STRING))) STORED, col128_140 STRING NOT NULL AS (lower(CAST(col128_131 AS STRING))) VIRTUAL, col128_141 STRING NULL AS (lower(CAST(col128_137 AS STRING))) VIRTUAL, col128_142 STRING NOT NULL AS (lower(CAST(col128_132 AS STRING))) STORED, col128_143 STRING NOT NULL AS (lower(CAST(col128_134 AS STRING))) STORED, col128_144 STRING NOT NULL AS (lower(CAST(col128_130 AS STRING))) STORED, col128_145 STRING NULL AS (lower(CAST(col128_129 AS STRING))) VIRTUAL, INDEX (col128_133 DESC), UNIQUE (col128_141, col128_138 DESC, col128_129 ASC, col128_142 ASC, col128_131, col128_137, col128_145 ASC), INVERTED INDEX (col128_129, col128_132, col128_131, col128_138 ASC, col128_137 DESC, col128_143, col128_134, col128_141 DESC, col128_142, col128_133, col128_144 ASC, col128_130 DESC), UNIQUE (col128_134 DESC, col128_141 ASC, col128_131 DESC, col128_136) STORING (col128_130, col128_139, col128_142, col128_144))",
          |   "SELECT 'validating all objects'",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=b88560e5 key=/Table/SystemConfigSpan/Start pri=0.05768882 epo=0 ts=1623999711.384170880,1 min=1623999711.131591172,0 seq=16} lock=true stat=PENDING rts=1623999711.131591172,0 wto=false gul=1623999711.631591172,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:01:50.800736",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table59 (col59_60 REGCLASS NOT NULL, col59_61 BYTES NULL, col59_62 UUID NOT NULL, col59_63 JSONB NOT NULL, col59_64 INET NOT NULL, col59_65 UUID, col59_66 INTERVAL, col59_67 NAME NULL, col59_68 INTERVAL NOT NULL, col59_69 TIME NOT NULL, col59_70 BOX2D NOT NULL, col59_71 BOX2D NOT NULL, col59_72 BIT(35) NOT NULL, col59_73 CHAR NOT NULL, PRIMARY KEY (col59_71, col59_68 ASC, col59_72 ASC, col59_70, col59_64 DESC), col59_74 STRING AS (lower(CAST(col59_60 AS STRING))) VIRTUAL, col59_75 STRING NOT NULL AS (lower(CAST(col59_65 AS STRING))) VIRTUAL, INVERTED INDEX (col59_68, col59_63 ASC))",
          |   "INSERT INTO public.table59 (col59_60,col59_61,col59_62,col59_63,col59_64,col59_65,col59_66,col59_67,col59_68,col59_69,col59_70,col59_71,col59_72,col59_73,col59_74,col59_75) VALUES (809061875:::OID,'\\x9739d138':::BYTES,'f5b2346d-2ea6-4c62-bf96-e6ef511052f3':::UUID,'{\"8Q6:G?UJ8i0\": null, \"bar\": [{\"c\": {\"foo\": []}, \"foo\": {}}, {}], \"|N{}2imq\u0026b:\": [[{\"\u0026x6^\": null}, []]]}':::JSONB,'c720:cb10:445f:879f:692a:6cba:d60a:3a55/126':::INET,'ffffffff-ffff-ffff-ffff-ffffffffffff':::UUID,'13 years 3 mons 103 days 13:01:43.354663':::INTERVAL,e'|\\x16':::STRING:::NAME,'43 years 8 mons 392 days 20:08:05.988844':::INTERVAL,'02:20:28.164097':::TIME,'BOX(-1.2212555713622057 0.07772664553220288,-0.1237375064122137 0.595302660129007)':::BOX2D,'BOX(0.4675548872709261 -0.5401704442958549,0.9539759176384521 -0.24718061246828932)':::BOX2D,B'00110101100011011111000010101101011',e'\\x15':::STRING,e'\\x10-\\x1e':::STRING,e'\\x18':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col59_74\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 2d94ccf10cd0fefd113ec48261705f8810990cf3:

          |   "CREATE TYPE schema82.enum299 AS ENUM ('asf', 'sdd', 'dfas', 'asd', 's')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=ed901fdd key=/Table/SystemConfigSpan/Start pri=0.01920117 epo=0 ts=1624086140.555680414,1 min=1624086140.366369881,0 seq=9} lock=true stat=PENDING rts=1624086140.366369881,0 wto=false gul=1624086140.866369881,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:02:20.349475",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema305.table306 RENAME COLUMN \"IrrelevantColumnName\" TO \"OtherIrrelevantName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema305.table306\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:02:20.158405",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum287 AS ENUM ('sssaad', 'ssa', 'fsdsff', 'sadfa')",
          |   "CREATE TYPE public.enum287 AS ENUM ('a', 'fas', 'ss', 'aa', 'sdsdd', 'f')"
          |  ],
          |  "expectedExecErrors": "42710",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: type \"schemachange.public.enum287\" already exists (SQLSTATE 42710)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:02:19.615999",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE IF EXISTS public.seq40",
          |   "SELECT 'validating all objects'",
          |   "CREATE TABLE schema82.table291 (col291_292 REGTYPE NULL, col291_293 \"char\" NOT NULL, col291_294 JSONB NOT NULL, col291_295 BOX2D NULL, col291_296 JSONB NOT NULL, col291_297 STRING NOT NULL AS (lower(CAST(col291_295 AS STRING))) VIRTUAL, INDEX (col291_297 ASC, col291_293 DESC, col291_295 DESC) STORING (col291_296), UNIQUE (col291_295), INVERTED INDEX (col291_296 DESC))",
          |   "INSERT INTO schema82.table291 (col291_292,col291_293,col291_294,col291_295,col291_296,col291_297) VALUES (142810382:::OID,'J':::STRING,'{\"test\": \"json\"}':::JSONB,NULL,e'[{\"n7\\\\\"QTE\u0026\u003c\": {\"b\": \"bar\"}}, {\"baz\": {}}, {\"81\\\\\"\": {\"_\\'yALiRd+ODr\": {\"bjp-\": []}, \"bar\": []}}, 2.104497973927982, false]':::JSONB,e'\\x03[D#tZc\\t':::STRING),(270876456:::OID,'8':::STRING,'[false, {}]':::JSONB,'BOX(-0.2309779370033498 -0.17843102677288894,0.715068997213657 0.342016763452814)':::BOX2D,e'{\"B0I2ive62\": 0.8995640511262084, \"R.\\\\\")9\": {\"baz\": true}, \"baz\": [[null], null], \"c\": [], \"foo\": true}':::JSONB,e'\\x18\"t\\x05dDRy\\x1f':::STRING),(1403901242:::OID,'S':::STRING,'{}':::JSONB,'BOX(-0.10362556033839421 -1.3778106149372937,1.7313213055359158 0.5030437987648166)':::BOX2D,e'\"6}\u003c:wF\\'\"':::JSONB,'\u0026R=TB-)w':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col291_297\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 6267da0f19b6cdc08e9fdd39899e35212694cb78:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:38.207613",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table6 ALTER COLUMN \"col6_8\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "42611",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col6_8\" is not a computed column (SQLSTATE 42611)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:37.959911",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE VIEW public.view78 AS SELECT public.table6.col6_9, public.table6.col6_7, public.table6.col6_7, public.table6.col6_29, public.table6.col6_8, public.table6.col6_9 FROM public.table6, public.table6"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table6\" specified more than once (missing AS clause) (SQLSTATE 42712)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:38.19478",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table6 DROP COLUMN \"col6_8\""
          |  ],
          |  "expectedExecErrors": "42P10",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col6_8\" is referenced by the primary key (SQLSTATE 42P10)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:38.255913",
          |  "ops": [
          |   "BEGIN",
          |   "INSERT INTO public.table6 (col6_7,col6_8,col6_9,col6_29) VALUES ('h':::STRING,e'\\x17':::STRING,NULL,'\\xb1a6dfd2f31391d7ec':::BYTES),(e'\\x17':::STRING,e'\\x13':::STRING,NULL,'\\x9e43bac176186d':::BYTES),(e'\\x1e':::STRING,'p':::STRING,NULL,'\\x':::BYTES)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col6_9\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ f60fbf28b0bb6110cf9870cc398ea169b81ff8f0:

          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table45 DROP COLUMN \"IrrelevantColumnName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table45\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:03:23.709445",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq12",
          |   "CREATE SCHEMA schema44 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=1c9dcbdb key=/Table/SystemConfigSpan/Start pri=0.04336061 epo=0 ts=1624431804.051881349,1 min=1624431803.709379216,0 seq=14} lock=true stat=PENDING rts=1624431803.709379216,0 wto=false gul=1624431804.209379216,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:03:23.711092",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "ALTER TABLE public.table46 RENAME COLUMN \"IrrelevantColumnName\" TO \"OtherIrrelevantName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table46\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:03:23.709766",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table15 (col15_16 BOX2D NULL, col15_17 TIMESTAMP NOT NULL, col15_18 BOX2D NULL, PRIMARY KEY (col15_17), col15_19 STRING NOT NULL AS (lower(CAST(col15_17 AS STRING))) STORED, col15_20 STRING AS (lower(CAST(col15_17 AS STRING))) VIRTUAL, UNIQUE (col15_17 DESC), UNIQUE (col15_18 ASC, col15_16 ASC, col15_17 ASC, col15_20 ASC, col15_19 DESC), UNIQUE (col15_16, col15_19 DESC), INDEX (col15_20, col15_18, col15_17, col15_19), INDEX (col15_17), UNIQUE (col15_18, col15_16 ASC), INDEX (col15_17 ASC, col15_16 ASC), INDEX (col15_17 DESC) STORING (col15_18), FAMILY (col15_19), FAMILY (col15_18), FAMILY (col15_16), FAMILY (col15_17))",
          |   "ALTER TABLE public.table15 ALTER COLUMN \"col15_20\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"col15_20\" is not a stored computed column (SQLSTATE 42611)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 92e342b8f0032a5771d3e50932df4c6d7d85fe41:

          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=fff2c6ff key=/Table/SystemConfigSpan/Start pri=0.00793766 epo=0 ts=1624518382.737449731,1 min=1624518382.736043692,0 seq=9} lock=true stat=PENDING rts=1624518382.736043692,0 wto=false gul=1624518383.236043692,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:06:22.735566",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE public.seq79"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.seq79\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:06:22.737512",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "DROP TABLE IF EXISTS public.table35 CASCADE",
          |   "SELECT 'validating all objects'",
          |   "ALTER INDEX public.table80@\"IrrelevantConstraintName\" RENAME TO \"OtherConstraintName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table80\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:06:22.736203",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum37 AS ENUM ('fffaa')",
          |   "CREATE TABLE IF NOT EXISTS public.table61 (col61_62 BIT(5) NOT NULL, col61_63 FLOAT4 NULL, col61_64 TIME NOT NULL, col61_65 INT8 NOT NULL, col61_66 OID, col61_67 FLOAT4 NOT NULL, col61_68 TIMETZ NOT NULL, col61_69 NAME NOT NULL, col61_70 GEOGRAPHY, col61_71 JSONB NOT NULL, col61_72 REGNAMESPACE NOT NULL, col61_73 BIT(27) NOT NULL, col61_74 INT8 NULL AS (col61_65 + 1567789808546137910:::INT8) VIRTUAL, col61_75 FLOAT4 NULL AS (col61_63 + '-Inf':::FLOAT8) STORED, col61_76 FLOAT4 NOT NULL AS (col61_63 + col61_67) VIRTUAL, col61_77 STRING AS (lower(CAST(col61_68 AS STRING))) STORED, col61_78 FLOAT4 NULL AS (col61_63 + col61_67) STORED, UNIQUE (col61_78 DESC, col61_62, col61_67 DESC, col61_65 ASC, col61_63, col61_72 ASC, col61_76 ASC, col61_66 DESC), INVERTED INDEX (col61_76, col61_72 DESC, col61_74 ASC, col61_70 ASC))",
          |   "ALTER TABLE public.table61 DROP COLUMN \"col61_77\"",
          |   "CREATE UNIQUE INDEX index61_81 ON public.table61 (col61_69, col61_75 DESC) STORING (col61_62, col61_67, col61_65, col61_72, col61_76, col61_74, col61_66, col61_64, col61_71, col61_70, col61_63, col61_68)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table61\" (63): index \"index61_81\" cannot store virtual column \"col61_76\" (SQLSTATE XXUUU)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ c38781390f0d07cf3d39d1af9ed01b4e370aaffa:

          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq72",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:25:55.207801",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE public.seq94"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.seq94\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:25:54.915507",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table66 RENAME TO public.table93",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=fb227b4a key=/Table/SystemConfigSpan/Start pri=0.00027423 epo=0 ts=1624692355.286362048,1 min=1624692354.915428329,0 seq=12} lock=true stat=PENDING rts=1624692354.915428329,0 wto=false gul=1624692355.415428329,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:25:54.604013",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE SCHEMA schema64 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ ede1628bd625a07b3f966a36ea841009803fc8a9:

          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:04:14.612215",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "DROP INDEX public.table63@\"IrrelevantIndexName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table63\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:04:14.612514",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum62 AS ENUM ('ssa', 'd', 'ss', 'a')",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:04:14.611706",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum31 AS ENUM ('dd', 'ss', 'asff', 'fffss', 'ssada')",
          |   "CREATE TABLE IF NOT EXISTS public.table48 (col48_49 VARCHAR NOT NULL, col48_50 UUID NOT NULL, col48_51 TIMESTAMPTZ NOT NULL, col48_52 DECIMAL NULL, col48_53 OID NOT NULL, col48_54 TIMETZ NULL, col48_55 \"char\" NOT NULL, col48_56 REGCLASS NOT NULL, PRIMARY KEY (col48_49, col48_50 DESC, col48_51, col48_56 DESC), col48_57 STRING NOT NULL AS (lower(CAST(col48_54 AS STRING))) VIRTUAL, col48_58 STRING NOT NULL AS (lower(CAST(col48_54 AS STRING))) STORED, col48_59 STRING NOT NULL AS (lower(CAST(col48_54 AS STRING))) VIRTUAL, col48_60 STRING NOT NULL AS (lower(CAST(col48_50 AS STRING))) STORED, col48_61 STRING NULL AS (lower(CAST(col48_54 AS STRING))) STORED, INDEX (col48_55) STORING (col48_52, col48_54), INDEX (col48_54, col48_53 ASC, col48_56, col48_61 ASC, col48_49 ASC, col48_60 DESC, col48_50 ASC, col48_52 ASC), INDEX (col48_55 DESC, col48_54 DESC, col48_59, col48_60 DESC, col48_51, col48_57 ASC), UNIQUE (col48_57 DESC, col48_52 ASC, col48_55, col48_54 DESC, col48_61 DESC, col48_58 ASC, col48_50 DESC, col48_51, col48_59) STORING (col48_53), UNIQUE (col48_60 DESC, col48_59 DESC, col48_57 ASC, col48_55 DESC), INDEX (col48_55, col48_49 DESC), FAMILY (col48_50), FAMILY (col48_52, col48_55, col48_56), FAMILY (col48_60), FAMILY (col48_54), FAMILY (col48_49, col48_53, col48_61), FAMILY (col48_51, col48_58))",
          |   "ALTER TABLE public.table48 ADD COLUMN col48_64 OID",
          |   "INSERT INTO public.table48 (col48_49,col48_50,col48_51,col48_52,col48_53,col48_54,col48_55,col48_56,col48_57,col48_58,col48_59,col48_60,col48_61,col48_64) VALUES ('uP?kNGb:5':::STRING,'b54c6eaf-8ce6-4bd5-9c0d-efd810da1736':::UUID,'2032-09-19 13:14:45.000451+00:00':::TIMESTAMPTZ,(-14268423443007197.32):::DECIMAL,1016649422:::OID,'03:42:12.847315-03:32:00':::TIMETZ,e'\\x07':::STRING,171685291:::OID,'%x8':::STRING,e'\u003c\\x05\\x06':::STRING,e'Tv\\x7f.su\\x17;\\x02':::STRING,e' (\\x12b':::STRING,e'\\x14P\\x19\\fJ``M\\x17':::STRING,3261095033:::OID),('j':::STRING,'721ab587-0b51-4fc7-9403-67c4b103255f':::UUID,'1977-11-21 19:21:47.000202+00:00':::TIMESTAMPTZ,6.134168520754759018E+35:::DECIMAL,710262511:::OID,'14:28:33.467751-04:54:00':::TIMETZ,'F':::STRING,1468619366:::OID,e'E\"\\x0bPdRq':::STRING,e'%~rQ+]2\\x19\\x18':::STRING,'':::STRING,e'\\x14;FyL\\x01/':::STRING,'._D\"/nLey':::STRING,946116659:::OID),('O^':::STRING,'d838fa72-de9d-4069-b4c3-1aae78f85cb7':::UUID,'1980-03-26 10:05:32.000847+00:00':::TIMESTAMPTZ,7.171656926698915020E+19:::DECIMAL,1826596509:::OID,'02:56:37.910842-06:18:00':::TIMETZ,';':::STRING,2684644804:::OID,'':::STRING,'':::STRING,'{1':::STRING,e'O\\x03':::STRING,e'5\\foS +':::STRING,211067480:::OID)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col48_57\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ db3cdb8913ba56599cc52766411893438b5c4b54:

          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table161\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:07:11.231744",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:07:11.122384",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:07:11.293313",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table86 DROP COLUMN \"col86_95\"",
          |   "CREATE VIEW public.view157 AS SELECT public.table86.col86_96, public.table86.col86_94, public.table86.col86_88, public.table86.col86_91, public.table86.col86_98, public.table86.col86_92 FROM public.table86",
          |   "CREATE TABLE public.table159 (col159_160 REGPROC NOT NULL, PRIMARY KEY (col159_160 ASC), INDEX (col159_160 DESC), UNIQUE (col159_160 DESC), INDEX (col159_160))",
          |   "INSERT INTO public.table86 (col86_87,col86_88,col86_89,col86_90,col86_91,col86_92,col86_93,col86_94,col86_96,col86_97,col86_98,col86_99,col86_100) VALUES ('0104000000020000000101000000A4F1FE95C48BF6C1038296EEC51BFFC10101000000C0568E380EACA1C1FA4F23B3BF6EF141':::GEOMETRY,'\\x00':::BYTES,(-4.284782636193798921E+36):::DECIMAL,e'\\'':::STRING,'BOX(-0.7240145102434612 -0.28314648809582565,1.1027606883041907 0.5633784147649247)':::BOX2D,(-1387547042867154332):::INT8,NULL,true,'06:43:28.598824':::TIME,'-33 years -6 mons -909 days -18:37:20.856514':::INTERVAL,B'0011011',B'0011110101111010010110011',e'\\x1d':::STRING),('0104000000010000000101000000CB1603D37178F8C1A4EF8788FBD70042':::GEOMETRY,'\\x':::BYTES,(-28219595114872092.96):::DECIMAL,e'\\x03':::STRING,'BOX(-0.8724055962264906 0.8151862181274777,-0.7050410210559759 0.8911820327887039)':::BOX2D,414606489302042020:::INT8,NULL,true,'24:00:00':::TIME,'39 years 2 mons 745 days 14:52:47.013963':::INTERVAL,B'0000000',B'0000000000000000000000000','A':::STRING),('0103000000010000000B0000005843F65F5A68F9C1D8B7583A3BACD4C12C85DC47079BEBC150CA2F57BBC9D9C126571B48DAE001C2F5A0F8AF5F9500C2003435C12C697A4177B94E7CD07BF8C14058E5985211EE41CE45FDDAB065F1C1383D549F6C9DEB4144BA7831173BEEC1C4F865970EC4E541220E5ECEADB6F141B4F41165BA56DCC1708A23251AC7C3C179709C38EC2CF0C1BE587549FBF8014290F06B0567F8F2C134D8D5B53BAAE3415843F65F5A68F9C1D8B7583A3BACD4C1':::GEOMETRY,'\\xe29883':::BYTES,(-65434826306661.37467):::DECIMAL,'^':::STRING,'BOX(-0.10361768569051588 0.05026188188333314,1.2767019204739898 1.0885676398278976)':::BOX2D,(-32768):::INT8,0.4953593313694:::FLOAT8,false,'15:40:33.363395':::TIME,'33 years 7 mons 125 days 20:12:08.591523':::INTERVAL,B'0100111',B'1100011001000010011110011','Y':::STRING)",
          |   "ALTER TABLE public.table159 DROP CONSTRAINT \"primary\""
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "0A000",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ a671a4e57d8c7e6270a95477d30f9ced6fc5e108:

          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table41 (col41_42 FLOAT4 NOT NULL, col41_43 BOOL NOT NULL, col41_44 BYTES NULL, col41_45 BIT(14) NOT NULL, col41_46 GEOGRAPHY NOT NULL, col41_47 TIMETZ NOT NULL, col41_48 BIT(31) NOT NULL, col41_49 REGPROC NOT NULL, col41_50 INET NOT NULL, col41_51 BIT(43) NOT NULL, col41_52 VARCHAR NOT NULL, col41_53 STRING NOT NULL AS (CASE WHEN col41_44 IS NULL THEN 'snb':::STRING ELSE e'Av\\rth+':::STRING END) VIRTUAL, col41_54 STRING NULL AS (lower(CAST(col41_47 AS STRING))) VIRTUAL, col41_55 STRING NOT NULL AS (lower(col41_52)) STORED, col41_56 FLOAT4 NULL AS (col41_42 + 1.8526805639266968:::FLOAT8) STORED, col41_57 STRING NULL AS (lower(col41_52)) VIRTUAL, UNIQUE (col41_48, col41_56 DESC), UNIQUE (col41_49) STORING (col41_42, col41_43, col41_45, col41_52), UNIQUE (col41_57 ASC, col41_52, col41_49, col41_44 DESC, col41_53, col41_45 DESC, col41_48 ASC, col41_50, col41_51, col41_54, col41_47 ASC, col41_42, col41_56 DESC, col41_43 DESC))",
          |   "CREATE SCHEMA IF NOT EXISTS schema63 AUTHORIZATION root",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:46.917294",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table41 DROP CONSTRAINT \"table41_col41_48_col41_56_key\""
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: cannot drop UNIQUE constraint \"table41_col41_48_col41_56_key\" using ALTER TABLE DROP CONSTRAINT, use DROP INDEX CASCADE instead (SQLSTATE 0A000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:46.996953",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table41 ALTER COLUMN \"col41_50\" SET NOT NULL",
          |   "ALTER TABLE schema63.table146 ADD COLUMN IrrelevantColumnName string"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema63.table146\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:46.840934",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table41 ALTER COLUMN \"col41_53\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"col41_53\" is not a stored computed column (SQLSTATE 42611)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 5e8abbb1796889f75550fef774632b1bb2dfa87b:

          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema5.table128\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:07.387378",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE schema5.table102 (col102_103 DATE NOT NULL, col102_104 DECIMAL NOT NULL, PRIMARY KEY (col102_103 DESC, col102_104 ASC), UNIQUE (col102_104), INDEX (col102_104 ASC), INDEX (col102_103), INDEX (col102_103 DESC), FAMILY (col102_104), FAMILY (col102_103))",
          |   "CREATE TABLE schema5.table102 AS SELECT \"IrrelevantColumnName\", schema5.table102.col102_104, schema5.table102.col102_103, schema5.table102.col102_104 FROM schema5.table111, schema5.table102, schema5.table102"
          |  ],
          |  "expectedExecErrors": "42701,42712,42P01,42P07",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema5.table111\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:07.15786",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "CREATE TYPE public.enum121 AS ENUM ('aa', 'sds', 'ddd')",
          |   "DROP SCHEMA \"schema129\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unknown schema \"schema129\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:07.604749",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS schema5.table107 (col107_108 FLOAT4 NOT NULL, PRIMARY KEY (col107_108 ASC), UNIQUE (col107_108))",
          |   "INSERT INTO schema5.table107 (col107_108) VALUES ('+Inf':::FLOAT8)",
          |   "ALTER TABLE schema5.table107 ADD CONSTRAINT table107_col107_108_unique UNIQUE (col107_108)"
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ a866c9fe3948bcfcd028b94fc06afda7268fa985:

          |  "workerId": 0,
          |  "clientTimestamp": "07:01:36.1154",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table139 ALTER COLUMN \"col139_147\" DROP DEFAULT"
          |  ],
          |  "expectedExecErrors": "42703",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col139_147\" does not exist (SQLSTATE 42703)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:01:35.818445",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table123 ALTER COLUMN \"col123_144\" SET NOT NULL"
          |  ],
          |  "expectedExecErrors": "42703",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col123_144\" does not exist (SQLSTATE 42703)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:01:34.984324",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema1 AUTHORIZATION root",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:01:35.940243",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE UNIQUE INDEX IF NOT EXISTS index123_145 ON public.table123 (col123_129 DESC, col123_128, col123_140 ASC, col123_133, col123_127, col123_131 DESC, col123_125 DESC, col123_130 DESC) STORING (col123_132)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table123\" (83): index \"index123_145\" cannot store virtual column \"col123_132\" (SQLSTATE XXUUU)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 21b5b06ea907f4adf0fef3318848e28f454138ea:

          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=cad246c7 key=/Table/SystemConfigSpan/Start pri=0.02035750 epo=0 ts=1625468976.118266513,1 min=1625468975.478940097,0 seq=9} lock=true stat=PENDING rts=1625468975.478940097,0 wto=false gul=1625468975.978940097,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:09:35.520571",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "ALTER TABLE public.table437 ADD COLUMN IrrelevantColumnName string"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table437\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:09:35.614981",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq410",
          |   "DROP SEQUENCE IF EXISTS public.seq420",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq438",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=2dff1336 key=/Table/SystemConfigSpan/Start pri=0.02392214 epo=0 ts=1625468976.118266513,1 min=1625468975.614892974,0 seq=16} lock=true stat=PENDING rts=1625468975.614892974,0 wto=false gul=1625468976.114892974,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:09:35.565752",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE TABLE public.table398 (col398_399 DATE NULL, col398_400 BOOL NULL, col398_401 BOOL NULL, col398_402 GEOGRAPHY NULL, col398_403 DATE NULL, col398_404 STRING NULL, col398_405 STRING, col398_406 DECIMAL NOT NULL, col398_407 VARCHAR, col398_408 REGCLASS, INDEX (col398_408 ASC, col398_404, col398_405 ASC, col398_403, col398_400), INVERTED INDEX (col398_402 ASC), UNIQUE (col398_400 DESC), INDEX (col398_405 DESC, col398_403 DESC, col398_408, col398_404 DESC, col398_401 ASC, col398_406 DESC, col398_399, col398_407 DESC) STORING (col398_402), INDEX (col398_399 ASC, col398_405), INVERTED INDEX (col398_406 ASC, col398_408, col398_404 ASC, col398_407 DESC, col398_403 ASC, col398_399 ASC, col398_402), INVERTED INDEX (col398_408 ASC, col398_403, col398_405 DESC, col398_404 DESC, col398_407, col398_406 DESC, col398_402 ASC), INDEX (col398_401 ASC), FAMILY (col398_402, col398_408, col398_399, col398_401, col398_407), FAMILY (col398_400, col398_403), FAMILY (col398_405, col398_404), FAMILY (col398_406))",
          |   "CREATE TABLE IF NOT EXISTS public.table398 (col398_412 OID, col398_413 GEOGRAPHY NOT NULL, col398_414 BOX2D NOT NULL, INVERTED INDEX (col398_413), UNIQUE (col398_412 DESC), INVERTED INDEX (col398_412, col398_413 ASC), INDEX (col398_412 ASC), FAMILY (col398_413), FAMILY (col398_414), FAMILY (col398_412))",
          |   "ALTER TABLE public.table398 ADD CONSTRAINT table398_col398_400_table398_col398_400_fk FOREIGN KEY (col398_400) REFERENCES public.table398 (col398_400) ON DELETE CASCADE ON UPDATE CASCADE",
          |   "DROP TABLE public.table398 RESTRICT"
          |  ],
          |  "expectedExecErrors": "2BP01",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 32273aa49ce7006677bb1b4a0003b4ed8ac8b455:

          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table44\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:59:27.759656",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum23 AS ENUM ('fssaf', 'sassad')",
          |   "CREATE SCHEMA schema29 AUTHORIZATION root",
          |   "CREATE TABLE IF NOT EXISTS public.table47 (col47_48 TIMETZ NOT NULL, col47_49 DATE NOT NULL, col47_50 REGPROC NOT NULL, col47_51 REGTYPE NOT NULL, col47_52 INT4 NOT NULL, col47_53 FLOAT4 NOT NULL, col47_54 INT8 NOT NULL, col47_55 DECIMAL NOT NULL, col47_56 REGPROC NULL, col47_57 INT4 NULL, col47_58 BIT(21) NOT NULL, col47_59 FLOAT8 NOT NULL, col47_60 \"char\" NOT NULL, col47_61 INT8 NOT NULL, col47_62 BOOL NOT NULL, col47_63 TIMETZ NOT NULL, PRIMARY KEY (col47_62 DESC, col47_50 ASC, col47_61 DESC, col47_53 DESC, col47_63 DESC, col47_60, col47_48 DESC, col47_49 ASC, col47_54 DESC, col47_52), col47_64 INT4 NOT NULL AS (((col47_57 + col47_61) + col47_54) + col47_52) STORED, col47_65 STRING NOT NULL AS (lower(CAST(col47_49 AS STRING))) STORED, UNIQUE (col47_61 DESC, col47_54 ASC, col47_50, col47_60 DESC, col47_51 ASC, col47_64, col47_49 ASC, col47_58 ASC, col47_57, col47_53 ASC, col47_48, col47_65 DESC, col47_59 ASC, col47_56 ASC, col47_55 ASC, col47_62 ASC), INDEX (col47_65, col47_51, col47_62 ASC) STORING (col47_56, col47_57, col47_64), INDEX (col47_51 ASC, col47_55 DESC, col47_64, col47_49 DESC, col47_59 ASC, col47_58 ASC, col47_62 DESC, col47_60 DESC, col47_56, col47_63, col47_61, col47_57 DESC), UNIQUE (col47_48 DESC, col47_51, col47_62, col47_52 ASC, col47_63 ASC), INDEX (col47_56 DESC, col47_59) STORING (col47_51, col47_58))",
          |   "ALTER TABLE public.table47 ALTER COLUMN col47_51 SET DEFAULT 2434018299:::OID",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=a2d4db5b key=/Table/SystemConfigSpan/Start pri=0.00346415 epo=0 ts=1625554768.168255954,1 min=1625554767.759559462,0 seq=35} lock=true stat=PENDING rts=1625554767.759559462,0 wto=false gul=1625554768.259559462,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:59:27.760114",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema30 AUTHORIZATION root",
          |   "DROP SCHEMA \"schema30\" CASCADE",
          |   "CREATE TYPE public.enum66 AS ENUM ('adfafd', 'dfd')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=0e9918bc key=/Table/SystemConfigSpan/Start pri=0.03441200 epo=0 ts=1625554768.168255954,2 min=1625554767.760001727,0 seq=39} lock=true stat=PENDING rts=1625554767.760001727,0 wto=false gul=1625554768.260001727,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:59:28.066161",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema36 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 4bdd64a13faabc2024969f68d3bca17feacb5147:

          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq58",
          |   "CREATE TYPE schema84.enum85 AS ENUM ('sfd')"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema84.enum85\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:00:32.25357",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table32 (col32_33 STRING NULL, col32_34 TIMESTAMPTZ[], col32_35 DATE NULL, col32_36 \"char\", col32_37 \"char\", col32_38 GEOGRAPHY NULL, UNIQUE (col32_35 ASC, col32_33 ASC), INDEX (col32_36), INVERTED INDEX (col32_38), FAMILY (col32_36), FAMILY (col32_34), FAMILY (col32_33, col32_35, col32_38), FAMILY (col32_37))",
          |   "ALTER TABLE public.table32 DROP CONSTRAINT \"table32_col32_35_col32_33_key\""
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: cannot drop UNIQUE constraint \"table32_col32_35_col32_33_key\" using ALTER TABLE DROP CONSTRAINT, use DROP INDEX CASCADE instead (SQLSTATE 0A000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:00:32.314934",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum31 AS ENUM ('sfa', 'af', 'asda', 'adda', 'fds', 'adsds')",
          |   "CREATE SCHEMA schema83 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=fc0839c2 key=/Table/SystemConfigSpan/Start pri=0.00970727 epo=0 ts=1625641232.555241246,1 min=1625641232.314865359,0 seq=14} lock=true stat=ABORTED rts=1625641232.314865359,0 wto=false gul=1625641232.814865359,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:00:32.368037",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema72 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ b7eaf3b47c220003b3d949af6d48d220c5f92db4:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/scbench/randomload/nodes=3/ops=10000/conc=20/run_1
    schemachange_random_load.go:145,schemachange_random_load.go:80,test_runner.go:733: output in run_071111.876_n1_workload_run_schemachange: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3159095-1625724816-22-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned: exit status 20
        (1) attached stack trace
          -- stack trace:
          | main.(*cluster).RunE
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2332
          | main.runSchemaChangeRandomLoad
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:142
          | main.registerRandomLoadBenchSpec.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:80
          | main.(*testRunner).runTest.func2
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:733
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1371
        Wraps: (2) output in run_071111.876_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3159095-1625724816-22-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I210708 07:11:12.800815 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210708 07:11:12.887705 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 86.889767ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col282_298" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | 020E61000000500000001010000009A813CB0AD66514086977EE2825E4FC001010000004CD5D3CFF8F94E40A8FBEFEE92B32140010100000041D1C4E57EF562C07062456B9A134840010100000040B6CAF163111A40F35424D0A9CC4AC0010100000060985655C4F714C06A4F1A287B6951400105000020E61000000400000001020000000600000054EB6B23DC3861C08AB87FA12D8354C0C0084C594DA4264007E318B91AED4CC0D4AFA814A0BC5E408948F844BE8852C06CB9589038346540DA304BD74D7253C01675D476C07D62401C72FD14E3A05540003BDE5E21913A40BE398928EBD654400102000000070000004050865DE4D408C06CC2F1B29BB83D40F2C636DF3C1E65C040DAEFC1F43B02C02C88A85570B862408CBE13C4CE903EC0C0F7F94AC2B64A40F0223721586B3D40CC31A350FD8E6040C8E8D3B2CF744F40FC9C5AB8C2E05840A0D6E97A08074B40FEA4F76D9F576540EA2C0B20C6F45340010200000002000000505C7AD5EE4A5A4058389C8AD8413240347F7944A5F3414024D4C8FF0B3E33C001020000000300000000384940A25CFDBFF6585A220EDD55C096A21F1DDBAB6140700B78732A551B40CCF6C6DC66DE59400C31F024992B42400104000020E6100000070000000101000000582AF77F287A574060A1F0D304244E40010100000000BE61F7D64E054000AEC5654E6A19C00101000000F8DE7A8EEB995F403693650957BB48C001010000004B07C0A60DCE60C0CCEA39E369CD3D40010100000078D7D4DCE7945940A33A925FBE164FC00101000000A8A600269FB95340F4A429E62D3F36C00101000000A82D8C9645D360402EDDF617A24854400103000020E6100000010000000A0000003CB78463CB6341C020526FE04BDD3240F046E5DAC5D22140A0D59D80F69651C010C650962DD06240186E9E83B70D35C0C6B88E5D9A456040A0955753684D1CC010D9904F53376440C8540C8DDBC44F405CCD58ACE64B604028A68E29E4C3554024E2E8228BB4574084FF038EA221484064375382C16D534098CD4863606F3B4038E74DD1806339C0E8C176508C9847403CB78463CB6341C020526FE04BDD32400106000020E6100000040000000103000000010000000A00000054EC23FD72B44DC0D85783561C2C2240DF0908D6A2BC58C0C18B4BA5727941C03B21502D7A355CC006A2374540034FC0185BD2F2039B544000625C38F9852340365D55D25AA36240BC01657DAB163A4004650808A7856440B8416DB9720F4F409814BE4224C13E401200DBEDCDB3554080A99CB31B3220407C1B0D340FD1544080426DF1D8C218C0B02A42D237E6434054EC23FD72B44DC0D85783561C2C22400103000000010000000A00000038FAE11328CB3FC0B866F549A09552C0E4EB01242334504012A7106455DB41C0162A593C31DA634086793AFB235154C0C01191195489494080F1C2A02FBB1040A6305F6AE411634048DF6949CBEF4740D4E509BF437D52C038D69987D60651400B80230C0F5B55C084F12BD35E045240F8A38F742FE560C0BC399B5C93CB514010A29D01FD594CC0CC4AC5B8922C384038FAE11328CB3FC0B866F549A09552C00103000000010000000900000009586A4350EA5FC00AC63F9EE6FB48C0B0063AA30B94344021A94653425743C0CC55530D37D66440640D373D16314CC0507181FA0B795940E057D780C92336C048641496C70B5640C0B677501F420FC04005F53A4D6C2E40A06440EA02853F40205EB4BA92D62BC0F6EBD6AE3F0E534028FE25134E9A65C030F69B2B2B221B4009586A4350EA5FC00AC63F9EE6FB48C001030000000100000008000000EAD2AFF92DDF62C068B7EA9ED90E3FC0E930521B659063C0DCE820F4640041C040D8EEADA4104AC0BC37AC34F5FB43C060AFE29B621F3AC028AA073D9FD752C018D537187613444090BB423DB5A91240E07AB005F37F6140485CF1CA94F94740CB1B6233C18663C0B4FF930AEE9F5140EAD2AFF92DDF62C068B7EA9ED90E3FC00102000020E610000006000000485127CB1A8F4B40788D9D6C5F5B33C0F8449A2CA85E3740FA624413729150C028CB9BAF475C65400330C98BEFBB54C010712C752016614084400186E4DB3A40F016BD9E3C332E40FEDEBEF8C6F55540D0AC076021AD394000F7A01B93FF26400103000020E61000000100000005000000C0DE2F98A9EA08C00043DF51C29A1440D2C21E77BCBC6440F07584D399981E40126E54B36F2862406CCBC9E1C43B334048181876D82C62C0E0BB58245B512E40C0DE2F98A9EA08C00043DF51C29A14400101000020E610000064A3F00370125A40D0EB58A9544E2D40':::GEOGRAPHY,'0102000020E610000002000000000000000000F03F000000000000F03F00000000000000400000000000000040':::GEOGRAPHY],0.9510747194290161:::FLOAT8,(-7277772794827244884):::INT8,true,e'[{\"T0[v~hqjnB{\": null, \"baz\": {}}, {\"$v!\\\\\"D,om\": null, \"D)\u003cK]j\": {}}, {\"1)D\u003cIA\\'VN\": true}, 0.743816797396861]':::JSONB,'t':::STRING,1485995712:::OID,NULL,912337439:::OID,B'111001101100000101001111110',2016658572:::INT8,1890569368608351057:::INT8,'y':::STRING,'wf':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col282_298\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 3ee6d71402938c32c266243cffd94c2c1d7bef9a:

          | main.runSchemaChangeRandomLoad
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:142
          | main.registerRandomLoadBenchSpec.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:80
          | main.(*testRunner).runTest.func2
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:733
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1371
        Wraps: (2) output in run_070623.602_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3163950-1625810646-22-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I210709 07:06:24.552679 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210709 07:06:24.652307 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 99.627157ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col282_296" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | .table326 (col326_327 \"char\" NOT NULL, col326_328 REGPROC NULL, col326_329 INT8 NULL, col326_330 NAME[], col326_331 \"char\", col326_332 INT8, col326_333 TIMETZ NOT NULL, col326_334 DECIMAL NULL, col326_335 \"char\", col326_336 INT8 NOT NULL AS (col326_332 + col326_329) STORED, col326_337 INT8 NULL AS (col326_329 + col326_332) STORED, col326_338 STRING NOT NULL AS (lower(col326_335)) STORED, col326_339 STRING NOT NULL AS (lower(CAST(col326_333 AS STRING))) VIRTUAL, INVERTED INDEX (col326_330 DESC), INDEX (col326_337, col326_335 ASC), INDEX (col326_327 DESC, col326_337, col326_331 ASC, col326_328 DESC), INDEX (col326_335 DESC, col326_331 ASC, col326_334 ASC, col326_328 DESC, col326_338 ASC, col326_336 DESC))",
          |   "DROP VIEW public.view344"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.view344\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:06:27.165964",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema27.enum255 AS ENUM ('fddf', 'sfsaa', 's', 'sfss', 'afdfa', 'sfffd')",
          |   "CREATE TABLE schema89.table282 (col282_283 INTERVAL NULL, col282_284 INT8, col282_285 REGCLASS, col282_286 TIMETZ NULL, col282_287 CHAR NOT NULL, col282_288 BYTES NULL, col282_289 VARCHAR, col282_290 INT2, col282_291 STRING, col282_292 BOX2D NOT NULL, col282_293 BOOL[] NULL, col282_294 NAME NULL, col282_295 VARCHAR NOT NULL, col282_296 INT2 NULL AS (col282_290 + col282_284) STORED, INDEX (col282_296 DESC, col282_288, col282_284, col282_283, col282_285, col282_295 DESC, col282_287 ASC) STORING (col282_286, col282_289, col282_290, col282_292, col282_293, col282_294), INVERTED INDEX (col282_295 ASC, col282_292, col282_291 DESC, col282_285 DESC, col282_289, col282_287, col282_296 ASC, col282_290, col282_294, col282_283, col282_288, col282_286, col282_293 ASC), UNIQUE (col282_286, col282_295 DESC, col282_284 DESC, col282_283 DESC), UNIQUE (col282_288 ASC, col282_290, col282_296 DESC) STORING (col282_284, col282_286, col282_287, col282_292, col282_294, col282_295), FAMILY (col282_294), FAMILY (col282_284), FAMILY (col282_293, col282_287), FAMILY (col282_286, col282_290, col282_289), FAMILY (col282_285), FAMILY (col282_295, col282_292), FAMILY (col282_283, col282_296, col282_288), FAMILY (col282_291))",
          |   "ALTER TABLE schema89.table282 RENAME TO schema89.table320",
          |   "INSERT INTO schema89.table320 (col282_283,col282_284,col282_285,col282_286,col282_287,col282_288,col282_289,col282_290,col282_291,col282_292,col282_293,col282_294,col282_295,col282_296) VALUES ('-52 years -4 mons -223 days -04:55:33.909589':::INTERVAL,4248484659777538781:::INT8,2664251232:::OID,'21:23:40.489152+04:37:00':::TIMETZ,'^':::STRING,'\\x4bc760a5bdae04':::BYTES,e'?N\\x19\\x047':::STRING,(-32768):::INT8,e'\\U00002603':::STRING,'BOX(-0.024833860233858696 0.05337113498299023,0.20977285428615244 0.338051446790697)':::BOX2D,NULL,'5A':::STRING:::NAME,'1wjlY':::STRING,(-14137):::INT8),('67 years 4 mons 222 days 10:15:18.730718':::INTERVAL,5054203524672194469:::INT8,2510622382:::OID,'03:04:52.364716+00:45:00':::TIMETZ,e'\\x17':::STRING,'\\x7c':::BYTES,NULL,30082:::INT8,'V':::STRING,'BOX(-1.2362466539683874 -2.5744956773151464,1.6710099347485348 2.1071061199441523)':::BOX2D,ARRAY[true,true],e'\\x1a0K\u003c*e]j':::STRING:::NAME,'U':::STRING,(-745):::INT8),('-13 years -2 mons -839 days -20:36:52.961569':::INTERVAL,1861476896507396481:::INT8,3892694573:::OID,'15:44:36.549543-11:04:00':::TIMETZ,'%':::STRING,'\\x3a77dfe6':::BYTES,e'\\x0e2\\x16S3':::STRING,28019:::INT8,'\"':::STRING,'BOX(-0.6478380341555469 -1.004322369737429,-0.37574148943653213 -0.7664011132132148)':::BOX2D,ARRAY[]:::BOOL[],e'\\x0bE\\x16\\x18C}\\x07.':::STRING:::NAME,e'\\x7fA:$^0O':::STRING,(-10565):::INT8)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col282_296\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ a59bb25a0c234e1752aa201fc8d6ccc4683c16b1:

          |  "clientTimestamp": "07:05:49.038839",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table76 AS SELECT public.table44.col44_46 FROM public.table44",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=5800ee05 key=/Table/SystemConfigSpan/Start pri=0.00473880 epo=0 ts=1625900749.395952745,1 min=1625900749.038716028,0 seq=7} lock=true stat=PENDING rts=1625900749.038716028,0 wto=false gul=1625900749.538716028,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:49.383379",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table69 ADD CONSTRAINT IrrelevantConstraintName UNIQUE (IrrelevantColumnName)"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table69\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:49.567572",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:49.208306",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "INSERT INTO public.table44 (col44_45,col44_46,col44_47,col44_48,col44_49,col44_50,col44_51,col44_52,col44_53,col44_54,col44_55,col44_56) VALUES ('08164cca-fd86-44c2-8eb3-c06582937f6b':::UUID,1280836249:::OID,(-1):::DECIMAL,e'[[], {\"7Z,%%\": {\"P\\'{,BB``b[s\\\\\"S\": false}, \"bar\": [], \"foobar\": {\"b\": 0.6941095814020681}}, {\"-w6ja(=n,s.\": null}, [], {}]':::JSONB,757953287:::INT8,'00:00:00':::INTERVAL,174651229:::OID,'08:52:19.695545':::TIME,'\\x27':::BYTES,4559:::INT8,NULL,NULL),('b23f9e4b-b548-44b9-b6f1-1801350e93f0':::UUID,2127317557:::OID,39617.68824929904140:::DECIMAL,NULL,(-64002589):::INT8,'53 years 9 mons 158 days 17:50:48.662397':::INTERVAL,2752859781:::OID,'24:00:00':::TIME,'\\xbe402947322c230e85':::BYTES,30306:::INT8,ARRAY[(-8328007293203477642):::INT8,(-4681190321975310631):::INT8,(-2803434298745022342):::INT8,4312292245872420158:::INT8],e'FPRD\\x16.|':::STRING),('ce127474-3c77-476b-83d6-f6c4f045eafa':::UUID,1235614944:::OID,649523955.3173066029:::DECIMAL,'1':::JSONB,551168053:::INT8,'-17 years -10 mons -408 days -22:59:57.458895':::INTERVAL,979772054:::OID,'23:32:07.215777':::TIME,'\\x':::BYTES,(-8818):::INT8,ARRAY[7963471521293882344:::INT8,6639483721860847667:::INT8],e'\\x1fX;\\x15':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col44_56\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 03b83e02502e8876ecb366659156ab00f7431a51:

          |   "CREATE TABLE schema46.table47 (col47_48 BOOL NOT NULL, col47_49 REGTYPE NOT NULL, col47_50 INT8 NOT NULL, col47_51 REGCLASS NOT NULL, col47_52 INT8 NULL, col47_53 INT2 NOT NULL, col47_54 DECIMAL[], col47_55 INT8 NOT NULL AS ((col47_52 + col47_53) + col47_50) STORED, col47_56 STRING NOT NULL AS (lower(CAST(col47_51 AS STRING))) VIRTUAL, col47_57 INT8 AS ((col47_50 + col47_53) + col47_52) STORED, INDEX (col47_51 DESC) STORING (col47_49, col47_54, col47_55), INVERTED INDEX (col47_54), FAMILY (col47_48, col47_50), FAMILY (col47_53), FAMILY (col47_57, col47_51), FAMILY (col47_49), FAMILY (col47_52), FAMILY (col47_54, col47_55))"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema46.table47\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:03:02.146709",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq16",
          |   "ALTER SEQUENCE public.seq16 RENAME TO public.seq43",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=b88c55e8 key=/Table/SystemConfigSpan/Start pri=0.00092327 epo=0 ts=1626159782.246456532,1 min=1626159782.146625854,0 seq=17} lock=true stat=PENDING rts=1626159782.146625854,0 wto=false gul=1626159782.646625854,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:03:02.146385",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "ALTER TABLE schema59.table60 RENAME COLUMN \"IrrelevantColumnName\" TO \"OtherIrrelevantName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema59.table60\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:03:02.147797",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table4 (col4_5 REGTYPE NULL, col4_6 DECIMAL[], col4_7 INT2 NOT NULL, col4_8 STRING NOT NULL AS (CASE WHEN col4_6 IS NULL THEN e'\\\\':::STRING ELSE e'\\x13\\x17JG':::STRING END) VIRTUAL, UNIQUE (col4_5 DESC), FAMILY (col4_7), FAMILY (col4_5, col4_6))",
          |   "INSERT INTO public.table4 (col4_5,col4_6,col4_7,col4_8) VALUES (1696172702:::OID,ARRAY[(-490166255346228096.5):::DECIMAL],(-31271):::INT8,'':::STRING),(3990264520:::OID,ARRAY[7.460738320615727920E+31:::DECIMAL,1:::DECIMAL,(-30267.8080953769940):::DECIMAL,(-1986369.655180564807):::DECIMAL,(-8.357011248413779016E+25):::DECIMAL,2720054513997879.800:::DECIMAL],(-12739):::INT8,e'~\\x1cs':::STRING),(2201191011:::OID,ARRAY[81675287243520267.40:::DECIMAL,(-8.763144896281723037E+30):::DECIMAL,(-835818688702499.1645):::DECIMAL,(-7.872095623458380885E+22):::DECIMAL,(-2.7488867892662850E+17):::DECIMAL],(-25505):::INT8,e'\\x16.D\\x04/\\x17\\x1dea':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col4_8\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 018479af8598930806ed99fda946c4ea72eb9d6a:

          |   "BEGIN",
          |   "INSERT INTO public.table219 (col219_220,col219_221,col219_222,col219_223,col219_224,col219_225,col219_226,col219_227) VALUES ((-0.026176463190529242):::FLOAT8,1844208768:::OID,e'QM\\x16n\\x7f\\x10_':::STRING,'b3199178-0906-4e60-be09-5064e3c8d291':::UUID,'V':::STRING,NULL,'{}':::JSONB,'0104000020E61000000A0000000101000000121BEA4BFBB552C0187346F67AAB3140010100000017F8B157449461C04068B2C0644FF8BF01010000002258686B523357C04BFA2F6CB9C349C001010000009CE5D92708F258408EC96B3B35DB4240010100000002274592EDC064C05C7611C7DC3153C0010100000044F91C15194A5940D68F4A4421FD554001010000008A57BCDA661851404EC14542F0A850C0010100000007FE6090961764C07B30107E5DF154C0010100000098DCB17911A142C088D6F073159A2DC0010100000088BD711D068A4AC0E82E03A0F8373E40':::GEOGRAPHY),((-1.041659179389396):::FLOAT8,0:::OID,e'\\x07':::STRING,'14b5aaaf-cc2d-4785-ab4f-00d651e1c1f4':::UUID,'v':::STRING,(-0.7896256926569141):::FLOAT8,e'[{\"DP~zKtAB\": [{\"9D;(IM\\'MZL\u003cx\": \"b\", \"OJi,\": \"fjz5~l7\\\\\"wW7\"}, true, []], \"b\": [null]}, [null, \"1K9{|dsI\"], {}]':::JSONB,'0104000020E61000000A000000010100000010787C9B3990404040EAFF5BE17F5340010100000074657606FA8F5A40BF6B4510F3EE51C0010100000067144AFBDFBE53C070A3F48B848C4A40010100000070C51B5608E23CC08853EEEED5DF53C00101000000078F3AD982BA65C040558E63DCAC3CC001010000002C3D853AEE2445C0782CE1E0E30020400101000000C097E2A6B5B22040C046F1EC76E726C0010100000081B160BE691560C0041100F609D243C00101000000E45E673CC3EA42C0E070A813313A3A4001010000006739438E4A1E61C027E69A07BD754EC0':::GEOGRAPHY)",
          |   "ALTER TABLE public.table219 ALTER COLUMN \"col219_224\" DROP NOT NULL"
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: the first schema change statement in a transaction must precede any writes (SQLSTATE 0A000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:03:14.754172",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table219 ADD CONSTRAINT table219_col219_226_unique UNIQUE (col219_226)"
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: column col219_226 is of type jsonb and thus is not indexable (SQLSTATE 0A000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:03:14.812607",
          |  "ops": [
          |   "BEGIN",
          |   "DROP TABLE public.table219",
          |   "CREATE SEQUENCE IF NOT EXISTS schema195.seq265",
          |   "CREATE SCHEMA schema266 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=1cb96d24 key=/Table/SystemConfigSpan/Start pri=0.03793729 epo=0 ts=1626246195.277359342,1 min=1626246194.812536215,0 seq=24} lock=true stat=ABORTED rts=1626246194.812536215,0 wto=false gul=1626246195.312536215,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:03:14.517291",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table219 ALTER COLUMN \"col219_220\" SET NOT NULL",
          |   "ALTER TABLE public.table219 ALTER COLUMN col219_227 SET DEFAULT '0103000020E6100000010000000A0000005B60B1598A0665C08C9A67A98CDF4FC0100C9E3184323AC096674EFB752947C0482BC79681CB4E40C224953873F755C0E0E3172FE24F5640A69D65913CF151C050DEC4EBE6E45D404A220CFCBB3242C0A4DE8084D34F5340FA7A94ECBF6B3DC09E532899893966406009B98C21BC0640DC97DAF83D0B5C40DCD4F610E26347401092E78858F32040904A8F3F232522405B60B1598A0665C08C9A67A98CDF4FC0':::GEOGRAPHY"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ aa9506903f7a71f8117e89d1e344cd91a7d50cf4:

          |   "ALTER TABLE public.table58 ALTER COLUMN IrrelevantColumnName SET DEFAULT \"IrrelevantValue\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table58\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:06:27.061108",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE TABLE public.table45 (col45_46 JSONB, col45_47 TIMESTAMPTZ NOT NULL, col45_48 GEOGRAPHY NOT NULL, col45_49 OID NOT NULL, col45_50 VARCHAR NOT NULL, col45_51 JSONB NOT NULL, col45_52 REGNAMESPACE NOT NULL, col45_53 FLOAT4 NULL, col45_54 \"char\" NULL, col45_55 CHAR NULL, PRIMARY KEY (col45_50 DESC, col45_52, col45_47 DESC), col45_56 STRING AS (lower(col45_50)) VIRTUAL, UNIQUE (col45_49 DESC), INVERTED INDEX (col45_53, col45_54 DESC, col45_46))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=93c777cd key=/Table/SystemConfigSpan/Start pri=0.01900727 epo=0 ts=1626419187.234086681,1 min=1626419187.061051407,0 seq=7} lock=true stat=PENDING rts=1626419187.061051407,0 wto=false gul=1626419187.561051407,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:06:27.222764",
          |  "ops": [
          |   "BEGIN",
          |   "DROP INDEX public.table60@\"IrrelevantIndexName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table60\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:06:27.060772",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table2 (col2_3 REGCLASS NULL, col2_4 BOOL NULL, col2_5 REGCLASS NULL, col2_6 REGCLASS NULL, col2_7 NAME NOT NULL, col2_8 STRING NOT NULL, col2_9 STRING NOT NULL AS (lower(CAST(col2_3 AS STRING))) VIRTUAL, col2_10 STRING AS (lower(col2_8)) VIRTUAL, col2_11 STRING NOT NULL AS (lower(CAST(col2_5 AS STRING))) VIRTUAL, col2_12 STRING NULL AS (lower(CAST(col2_4 AS STRING))) STORED, col2_13 STRING NOT NULL AS (lower(col2_7)) STORED, UNIQUE (col2_7 ASC), UNIQUE (col2_5, col2_3 ASC, col2_6 DESC, col2_12 ASC, col2_4, col2_10, col2_8 ASC), INDEX (col2_13 DESC, col2_9 DESC, col2_4, col2_10, col2_11, col2_8, col2_5, col2_6 DESC, col2_3, col2_7 ASC, col2_12))",
          |   "SELECT 'validating all objects'",
          |   "DROP SEQUENCE IF EXISTS public.seq35",
          |   "ALTER TABLE public.table2 DROP COLUMN \"col2_8\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"col2_8\" is referenced by computed column \"col2_10\" (SQLSTATE 42P10)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 42486498706391d1a63cf49fd47ffd67388293ab:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/scbench/randomload/nodes=3/ops=10000/conc=20/run_1
    schemachange_random_load.go:145,schemachange_random_load.go:80,test_runner.go:733: output in run_152048.056_n1_workload_run_schemachange: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3193813-1626704536-22-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned: exit status 20
        (1) attached stack trace
          -- stack trace:
          | main.(*cluster).RunE
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2332
          | main.runSchemaChangeRandomLoad
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:142
          | main.registerRandomLoadBenchSpec.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:80
          | main.(*testRunner).runTest.func2
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:733
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1371
        Wraps: (2) output in run_152048.056_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3193813-1626704536-22-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I210719 15:20:48.909697 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210719 15:20:48.997097 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 87.399066ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col2_10" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | EOGRAPHY, col2_9 BIT(32) NOT NULL, col2_10 STRING AS (lower(CAST(col2_4 AS STRING))) STORED, col2_11 STRING NOT NULL AS (lower(CAST(col2_7 AS STRING))) VIRTUAL, col2_12 STRING NOT NULL AS (lower(CAST(col2_4 AS STRING))) STORED, col2_13 STRING AS (lower(CAST(col2_8 AS STRING))) VIRTUAL, INDEX (col2_7 DESC, col2_13) STORING (col2_5))",
          |   "ALTER TABLE public.table2 ALTER COLUMN \"col2_3\" SET NOT NULL",
          |   "CREATE TABLE IF NOT EXISTS public.table2 (col2_39 REGCLASS NOT NULL, col2_40 BOX2D NOT NULL, col2_41 CHAR, col2_42 REGNAMESPACE NOT NULL, col2_43 FLOAT8 NOT NULL, col2_44 STRING NULL, col2_45 INT4 NOT NULL, col2_46 VARCHAR NOT NULL, PRIMARY KEY (col2_46 DESC, col2_40), col2_47 STRING AS (lower(col2_41)) VIRTUAL, col2_48 STRING NOT NULL AS (lower(CAST(col2_39 AS STRING))) STORED, col2_49 STRING AS (lower(col2_44)) VIRTUAL, col2_50 STRING AS (lower(col2_44)) STORED, col2_51 STRING AS (lower(col2_44)) VIRTUAL, UNIQUE (col2_47 DESC, col2_40 DESC, col2_45 ASC, col2_48, col2_41 ASC, col2_43, col2_49 DESC, col2_44, col2_51 DESC, col2_46 ASC, col2_42, col2_39), INDEX (col2_44, col2_49, col2_48, col2_46 DESC, col2_51 DESC, col2_47 ASC, col2_42 DESC, col2_50, col2_41 ASC, col2_39, col2_43), UNIQUE (col2_39, col2_48 DESC, col2_42 ASC, col2_43 DESC, col2_50 ASC, col2_51 ASC, col2_40, col2_46, col2_47 DESC, col2_41 DESC, col2_45 DESC, col2_49), UNIQUE (col2_39, col2_41 ASC, col2_44, col2_47 ASC, col2_40 DESC, col2_43, col2_50 ASC, col2_45 DESC, col2_42 DESC, col2_51 DESC, col2_49 DESC, col2_48 DESC, col2_46 DESC), UNIQUE (col2_40 ASC, col2_47 ASC, col2_46 ASC, col2_48 ASC, col2_39 ASC, col2_44 ASC, col2_50, col2_43 ASC, col2_45, col2_51, col2_49 ASC), INDEX (col2_50 ASC, col2_42 ASC, col2_40 DESC, col2_46 ASC, col2_44, col2_51 DESC) STORING (col2_41, col2_43), INDEX (col2_48 ASC, col2_39 DESC, col2_46, col2_41 DESC, col2_43, col2_51 DESC, col2_44 DESC, col2_42, col2_50, col2_45 DESC, col2_49, col2_47), UNIQUE (col2_49 ASC, col2_39, col2_50 DESC, col2_40, col2_43 DESC, col2_47 ASC), UNIQUE (col2_48, col2_42 DESC, col2_49, col2_45 ASC), FAMILY (col2_50, col2_48), FAMILY (col2_41), FAMILY (col2_46), FAMILY (col2_44, col2_42, col2_39), FAMILY (col2_45, col2_43, col2_40))",
          |   "INSERT INTO public.table2 (col2_3,col2_4,col2_5,col2_6,col2_7,col2_8,col2_9,col2_10,col2_11,col2_12,col2_13) VALUES (NULL,3039798202:::OID,'1972-03-02 18:51:52.000744+00:00':::TIMESTAMPTZ,ARRAY['36.101.144.38/22':::INET,'201.141.202.178/12':::INET,'d340:608c:27dd:ba56:317c:5772:b44a:cb43/19':::INET,'71.15.183.55/5':::INET],3909143404:::OID,'0101000020E6100000CAEB7FC8526A63C0505F6120CBF75040':::GEOGRAPHY,B'11001000011001010100001100110100',e'\\x0f\\r55,h_':::STRING,e'SV$e\\x07\\x16':::STRING,'':::STRING,e'\\x02;v\\x10k\\fD':::STRING),('p':::STRING,2315642029:::OID,NULL,ARRAY['da3a:e8b3:a1d2:3e90:eb5:40bd:2116:5f8e/8':::INET,'6752:2071:c660:3ee8:d72d:80e9:d849:bc2b/101':::INET],379749618:::OID,'0106000020E6100000010000000103000000010000000B0000009885BA579EAC64C06C99CEFE5E4131C08B077DC07EA861C084078769A11956C0C8E37063217F49C06FA8F737F9C146C02838014434C644C0F2049A1F6E8A4AC0782818AE4F0E46C000452A2F79E2D6BF80E463FFA3ED0840A0AC827EB3210F4070CBA0F77CF05440F8AAD1DCBD0A4A4000141168E908C23F781B8CC52ED14940BC4EEFDFAF554CC07C17B0F8717C5240E58534F4A6F256C014F84567BC0043409885BA579EAC64C06C99CEFE5E4131C0':::GEOGRAPHY,B'01001000101011001110111101000011','z}':::STRING,'d':::STRING,e'\\x00':::STRING,e'\\x015J#XV':::STRING),('0':::STRING,1943685224:::OID,'1982-10-29 03:54:36.0008+00:00':::TIMESTAMPTZ,ARRAY['2fc1:88f5:e9f9:9e12:19c5:32e9:bbf5:ed56/35':::INET,'9c4c:2f8b:4f6e:55b5:85dd:4f2e:4edb:bfe/28':::INET,'238.130.184.29/5':::INET],0:::OID,'0101000020E6100000F0829F55DB0D2BC0C0892107B7B23440':::GEOGRAPHY,B'10011100001101110111011100010001','Y.':::STRING,e']qNFt\\x06':::STRING,e'\\x1e\\x14w\\x030':::STRING,e'N!S\\x135\\x01;':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col2_10\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 7c3cf23b898815395fbc80e08ed8947a243267bc:

          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=d3e6b6fc key=/Table/SystemConfigSpan/Start pri=0.02867463 epo=0 ts=1626764802.022614136,1 min=1626764801.380149821,0 seq=17} lock=true stat=PENDING rts=1626764801.380149821,0 wto=false gul=1626764801.880149821,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:06:41.533624",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "INSERT INTO public.table147 (IrrelevantColumnName) VALUES (\"IrrelevantValue\")"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table147\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:06:41.683192",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS schema23.seq132",
          |   "ALTER TABLE public.table149 ALTER COLUMN IrrelevantColumnName SET DATA TYPE IrrelevantDataType"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table149\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:06:41.567215",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table89 (col89_90 FLOAT4, col89_91 REGTYPE NULL, col89_92 TIMESTAMPTZ, col89_93 REGPROCEDURE, col89_94 DATE NULL, col89_95 INT4[] NULL, col89_96 \"char\" NULL, col89_97 STRING NULL, col89_98 INTERVAL NULL, col89_99 NAME, col89_100 BOOL NULL, col89_101 FLOAT8 NULL, col89_102 FLOAT4 NOT NULL AS (col89_90 + col89_101) VIRTUAL, col89_103 FLOAT4 AS (col89_90 + col89_101) VIRTUAL, col89_104 FLOAT8 AS (col89_101 + col89_90) VIRTUAL, col89_105 FLOAT4 NULL AS (col89_90 + col89_101) VIRTUAL, col89_106 FLOAT8 NULL AS (col89_101 + col89_90) VIRTUAL, col89_107 FLOAT4 NOT NULL AS (col89_90 + col89_101) STORED, INDEX (col89_99 ASC, col89_107, col89_103 ASC, col89_94 ASC, col89_102, col89_93 DESC, col89_90 DESC))",
          |   "SELECT 'validating all objects'",
          |   "CREATE INDEX IF NOT EXISTS index89_150 ON public.table89 (col89_96, col89_90 DESC, col89_107 ASC, col89_97 ASC, col89_103 DESC, col89_102 ASC, col89_98 ASC, col89_101 DESC) STORING (col89_95, col89_92, col89_99, col89_91, col89_106)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table89\" (78): index \"index89_150\" cannot store virtual column \"col89_106\" (SQLSTATE XXUUU)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 5f22b990fbe53cefbf8493efa3270a88752d9e37:

          |  "clientTimestamp": "07:24:17.120807",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:24:17.25821",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS schema72.seq366",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:24:17.344618",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema275 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "42P06",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: schema \"schema275\" already exists (SQLSTATE 42P06)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:24:17.247976",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"schema72\" CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 615719388e48e1c527913403b5c154fc7d389b39:

    schemachange_random_load.go:146,schemachange_random_load.go:81,test_runner.go:733: output in run_070501.641_n1_workload_run_schemachange: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3209872-1626934016-22-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned: exit status 20
        (1) attached stack trace
          -- stack trace:
          | main.(*cluster).RunE
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2332
          | main.runSchemaChangeRandomLoad
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:143
          | main.registerRandomLoadBenchSpec.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:81
          | main.(*testRunner).runTest.func2
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:733
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1371
        Wraps: (2) output in run_070501.641_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3209872-1626934016-22-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I210722 07:05:02.567033 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210722 07:05:02.666526 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 99.489795ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col116_120" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | tart pri=0.02338453 epo=0 ts=1626937503.720206579,1 min=1626937503.389222970,0 seq=18} lock=true stat=PENDING rts=1626937503.389222970,0 wto=false gul=1626937503.889222970,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:03.534211",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table116 (col116_117 TIMESTAMPTZ NULL, col116_118 CHAR NOT NULL, col116_119 GEOMETRY, PRIMARY KEY (col116_118 ASC), col116_120 STRING AS (lower(CAST(col116_119 AS STRING))) VIRTUAL, INVERTED INDEX (col116_118, col116_117 DESC, col116_120 DESC, col116_119 ASC))",
          |   "ALTER TABLE public.table116 ADD CONSTRAINT table116_col116_118_table116_col116_118_fk FOREIGN KEY (col116_118) REFERENCES public.table116 (col116_118) ON DELETE CASCADE ON UPDATE CASCADE",
          |   "ALTER TABLE public.table116 RENAME COLUMN \"col116_117\" TO \"col116_145\"",
          |   "INSERT INTO public.table116 (col116_145,col116_118,col116_119,col116_120) VALUES ('2001-02-06 10:31:26.000942+00:00':::TIMESTAMPTZ,'q':::STRING,'010200000002000000000000000000F03F000000000000F03F00000000000000400000000000000040':::GEOMETRY,e'Bgsf{\\'\\x04':::STRING),('2021-05-07 09:21:08.000425+00:00':::TIMESTAMPTZ,'g':::STRING,NULL,e'\\x1eO':::STRING),('1976-07-08 01:29:59.000159+00:00':::TIMESTAMPTZ,'a':::STRING,'0106000000080000000103000000010000000D000000AC0770891922F4C100E8D869E8E99741F589ADFA9694F2C1FAA5075ECAFAEBC1D87C2A017563D84198E06F6E0BC1E141869283E620F6F04180C26FCA6432A2C13CF48CB60247FE413075CD073361D141CCF26E75F123014258A710A153E6DE41B2E8323C54B5F441AC23C8DA1E11E84162AF4C45F00CF941DA584F7C8AE0F041446AD4EDCE01E241E84055BE79D1FD41F8F406D00717E5C11073D9A36BDCFE41D76E6B98C9C3F4C1D45438084DA6F441593674E875BAF6C176B2C83E48D4F141AC0770891922F4C100E8D869E8E9974101030000000100000006000000A29872EE0C37FDC1D6CA6E2E30D9ECC1C8958B48EDD8E241F0E028AED09BCAC18C418F2DB010FE418AE214915CE0F941BA70A0E0C880F0C158F9FF517DE9D8417DD3F5ADBE65F2C1A09883205084D041A29872EE0C37FDC1D6CA6E2E30D9ECC10103000000010000000C00000094346229F61002C238C2F1781848D2C183F76A756B7601C2A39D3BA331A9FBC19ECE0FEEE804F4C13A6DA4204493FBC1C8E210680B8DEFC1503A7175D1C1E7C1D03ECF6B74F9D0C1EC1C4F73258CF3C15A331EE18486E1C1B88E9CAC6397D341A20171B0EEC5E8C108CFACE07979FF4126F9BB6D5FEAF3C1E85390CE4635D541AF06A9E36E3BF5C1288201F1E4D0FF41CADE5883AB06F9C1445BB72C8CFFFA41A07C36F50482FCC1B01472F37CDDE14194346229F61002C238C2F1781848D2C101030000000100000007000000C6DF0947B366FCC14656E33AF4D6E6C194BB846A32A6F6C14C2F5C759B02E7C1148611BE65C1E341B25C99AA31F6F4C1508ABE0E61A4F0418A04906A3A58E3C1DA9E840D7324F9415A3B8824E3F1F8414A4BC0323E5AF0C1CEE2D3D0D4CAF241C6DF0947B366FCC14656E33AF4D6E6C101030000000100000008000000E096945FDFB4D2412E14DB72731FEFC10009A4596059E2410581FB68E887FDC1E28A57809FBDF541F92502CDE7CC01C202284B9BF2ABF341E228CA2D54B6F6C1548C99F687130242D09E40CB30F1FE41FAF4876674BDF141ACE75286A330FF411EFC30C23DEFE6C10842035F85BE0142E096945FDFB4D2412E14DB72731FEFC10103000000010000000D000000A5CF79D80536FEC123D639E0C93702C2788F1CA245EBDA41A77B44122220FCC158FEEFEFB2E0E141347C52E7C03B02C292A59FA1092E00429046529F11EDC241B03FD57ABD3FE34170059CA8118ECB41EE3C64CF6896FA41247CDAF8B48BE34124808371D133EA41884C76FB187BDC41806AE4978438F241E8FD473AC994E44170D535FA0505DAC16410C2E08C78FF411C300BBEC47DF5C11C401AB475F5F1416343F9408937FDC1FCFDFABCDD5FF3412112760AC952FCC1105F60DDBAA2D541A5CF79D80536FEC123D639E0C93702C20103000000010000000700000088EB8D6473DAF1C1122EF9008A1CEDC1CE0496B5AD7CF5C15650D9AED4F4F6C1D054E977E77DE4C12426C907E994EDC158E6362F6B80D541C0756C6F42A8AD41D050AF6B33D2E3411C1ACE7DD3190242021B2788DC29EBC130FD6788F715C94188EB8D6473DAF1C1122EF9008A1CEDC1010300000001000000050000009CC4EFFEE8A6EBC1CECAD4C9AF07E8C14C2CEA574FA5E8412870977B71BA01C2C8D02E456F54014274E31521D887E14100DEA0EDDA26E6C158C732383876F1419CC4EFFEE8A6EBC1CECAD4C9AF07E8C1':::GEOMETRY,e'Ve\"\\x17':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col116_120\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 91efca27c8061c95f0e27efb4fd26c3e10464782:

          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2332
          | main.runSchemaChangeRandomLoad
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:143
          | main.registerRandomLoadBenchSpec.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:81
          | main.(*testRunner).runTest.func2
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:733
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1371
        Wraps: (2) output in run_070828.458_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3219267-1627107080-22-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I210724 07:08:29.375658 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210724 07:08:29.475653 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 99.999427ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col32_44" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | D INDEX (col60_63, col60_61 DESC, col60_68 ASC, col60_69 ASC, col60_66), UNIQUE (col60_68 DESC) STORING (col60_61, col60_62, col60_64, col60_65, col60_66, col60_69, col60_72), FAMILY (col60_64), FAMILY (col60_61, col60_71), FAMILY (col60_65), FAMILY (col60_67), FAMILY (col60_70, col60_72), FAMILY (col60_63, col60_69, col60_73), FAMILY (col60_66), FAMILY (col60_62, col60_68))",
          |   "ALTER TABLE public.table60 ALTER COLUMN \"col60_74\" DROP NOT NULL"
          |  ],
          |  "expectedExecErrors": "42703",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col60_74\" does not exist (SQLSTATE 42703)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:08:29.477252",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE TABLE IF NOT EXISTS public.table32 (col32_33 INT2 NULL, col32_34 BIT NOT NULL, col32_35 REGCLASS NOT NULL, col32_36 INET NOT NULL, col32_37 DATE NOT NULL, col32_38 DECIMAL, col32_39 NAME NULL, col32_40 FLOAT8 NOT NULL, col32_41 BYTES NOT NULL, col32_42 OID NOT NULL, col32_43 NAME NOT NULL, PRIMARY KEY (col32_37 DESC, col32_40 DESC, col32_35 DESC, col32_36, col32_42, col32_43 DESC), col32_44 STRING NULL AS (lower(CAST(col32_34 AS STRING))) VIRTUAL, col32_45 STRING NOT NULL AS (lower(CAST(col32_37 AS STRING))) VIRTUAL, col32_46 STRING AS (lower(CAST(col32_36 AS STRING))) STORED, col32_47 DECIMAL AS (col32_38 + 6.514569738390410303E+33:::DECIMAL) STORED, col32_48 STRING NOT NULL AS (lower(CAST(col32_35 AS STRING))) STORED, col32_49 DECIMAL AS (col32_38 + 91672205.95101213505:::DECIMAL) VIRTUAL, col32_50 STRING NULL AS (lower(CAST(col32_37 AS STRING))) STORED, col32_51 STRING AS (lower(CAST(col32_36 AS STRING))) STORED, UNIQUE (col32_36 ASC, col32_41 ASC, col32_46 ASC, col32_38 ASC, col32_35 DESC, col32_43, col32_42 ASC, col32_49, col32_37, col32_39 DESC) STORING (col32_34, col32_47, col32_48), INDEX (col32_46 ASC, col32_43 ASC, col32_42 ASC, col32_51 DESC, col32_36, col32_45, col32_50, col32_33 DESC, col32_47 DESC, col32_38 DESC, col32_40 ASC) STORING (col32_34, col32_39), INDEX (col32_37 ASC, col32_46 DESC, col32_42 DESC, col32_51, col32_40, col32_36, col32_38 DESC, col32_49 DESC, col32_44, col32_41 ASC, col32_45 ASC), INDEX (col32_48, col32_39, col32_38 ASC, col32_40, col32_45 ASC, col32_47 ASC, col32_51, col32_36 DESC, col32_43) STORING (col32_33, col32_41, col32_50))",
          |   "INSERT INTO public.table32 (col32_33,col32_34,col32_35,col32_36,col32_37,col32_38,col32_39,col32_40,col32_41,col32_42,col32_43,col32_44,col32_45,col32_46,col32_47,col32_48,col32_49,col32_50,col32_51) VALUES (0:::INT8,B'0',1248849250:::OID,'4b29:9896:24f3:83:9eea:a33b:1b37:10ac/13':::INET,'1983-07-11':::DATE,3.236848944724505967E+27:::DECIMAL,e'\\rw\\x1e;I+#\u003c':::STRING:::NAME,(-0.651548670441616):::FLOAT8,'\\x822c36a93ea810':::BYTES,153851080:::OID,e';!!\\\\':::STRING:::NAME,'?a':::STRING,e'\\x1a\\x11rNw*\\r[':::STRING,'':::STRING,5.663670411908134952E+29:::DECIMAL,e'K[P``\\\\':::STRING,0.6780368408311040012:::DECIMAL,e'\\'':::STRING,'':::STRING),(5677:::INT8,B'0',1436163021:::OID,'205.135.134.222/1':::INET,'1975-03-26':::DATE,(-7.628072226342647784E+23):::DECIMAL,e'\\'':::STRING,2.2631725473842677:::FLOAT8,'\\xb74767':::BYTES,4274463705:::OID,'':::STRING:::NAME,'y':::STRING,e'|O\\x07':::STRING,'-z':::STRING,(-1.100265111176917168):::DECIMAL,e'\\x05,;':::STRING,(-2.711216125058422425E+27):::DECIMAL,'; ':::STRING,NULL),(NULL,B'1',3298682227:::OID,'180.254.0.111/20':::INET,'1974-12-29':::DATE,1.326734511850550081E+26:::DECIMAL,e'i\\x16)':::STRING:::NAME,(-0.9810509471559644):::FLOAT8,'\\xb43b':::BYTES,2119178912:::OID,e'\\\\9a9FfE':::STRING:::NAME,'X':::STRING,e'Z\\x07pR[\\x11\\fN':::STRING,'y':::STRING,0.07790500387669933328:::DECIMAL,e'\\'':::STRING,409674102584307.2365:::DECIMAL,'':::STRING,'':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col32_44\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ b69ba4f24cbd604cc01fd471aed7f7262ece781d:

        Wraps: (2) output in run_070548.913_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3222824-1627279758-22-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I210726 07:05:49.842544 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210726 07:05:49.942630 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 100.084531ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col97_105" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | 96880864,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:50.519372",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema137 AUTHORIZATION root",
          |   "ALTER TABLE schema45.table159 DROP CONSTRAINT IrrelevantConstraintName"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema45.table159\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:50.586677",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table97 (col97_98 BOX2D NULL, col97_99 DATE, col97_100 REGTYPE NULL, col97_101 INET NOT NULL, col97_102 INTERVAL NOT NULL, col97_103 TIMESTAMPTZ NOT NULL, col97_104 BIT NULL, col97_105 STRING NOT NULL AS (CASE WHEN col97_103 IS NULL THEN e'mG\\x18\\x12_uW\\x14(':::STRING ELSE '6Pg.':::STRING END) STORED, col97_106 STRING AS (lower(CAST(col97_102 AS STRING))) VIRTUAL, col97_107 STRING AS (lower(CAST(col97_98 AS STRING))) STORED, col97_108 STRING NULL AS (lower(CAST(col97_104 AS STRING))) STORED, col97_109 STRING NOT NULL AS (lower(CAST(col97_101 AS STRING))) STORED, col97_110 STRING NULL AS (CASE WHEN col97_103 IS NULL THEN e'\\x03':::STRING ELSE e'\\x02M\\nu\\x07?':::STRING END) VIRTUAL, UNIQUE (col97_98, col97_100 DESC, col97_110 ASC, col97_104, col97_99 ASC, col97_105 ASC, col97_103 ASC, col97_106 ASC, col97_108 ASC, col97_109 DESC), UNIQUE (col97_102 DESC, col97_104 ASC, col97_108 ASC, col97_100 DESC, col97_105, col97_106 ASC, col97_98 ASC, col97_109, col97_110 DESC), INDEX (col97_99 ASC, col97_100, col97_98, col97_104, col97_107 ASC, col97_101, col97_106, col97_110 DESC, col97_109, col97_108 DESC, col97_103, col97_102) STORING (col97_105), UNIQUE (col97_101, col97_100, col97_109 DESC, col97_102) STORING (col97_99, col97_104, col97_108), UNIQUE (col97_100 ASC, col97_102 DESC, col97_109, col97_101 ASC, col97_103, col97_108 ASC) STORING (col97_98, col97_99), UNIQUE (col97_102 ASC, col97_104, col97_103 ASC, col97_108 DESC, col97_106 ASC, col97_107 ASC, col97_101 ASC, col97_100 ASC, col97_105 ASC, col97_110, col97_109 DESC), INDEX (col97_100 ASC, col97_110 ASC, col97_108 ASC, col97_106 ASC, col97_103 DESC, col97_102), FAMILY (col97_108, col97_105, col97_101), FAMILY (col97_104, col97_102), FAMILY (col97_100, col97_107, col97_98, col97_99), FAMILY (col97_109), FAMILY (col97_103))",
          |   "ALTER TABLE public.table97 RENAME TO public.table135",
          |   "ALTER TABLE public.table135 ALTER COLUMN \"col97_104\" DROP DEFAULT",
          |   "INSERT INTO public.table135 (col97_98,col97_99,col97_100,col97_101,col97_102,col97_103,col97_104,col97_105,col97_106,col97_107,col97_108,col97_109,col97_110) VALUES ('BOX(-10 -10,10 10)':::BOX2D,'1993-11-26':::DATE,NULL,'200.47.191.223/23':::INET,'-56 years -4 mons -369 days -22:12:15.601774':::INTERVAL,'2026-03-21 15:30:22.000985+00:00':::TIMESTAMPTZ,B'0','Z':::STRING,e'Zj\\fT(\\x0e}':::STRING,e'\\x03!6bZ?u\u003e(':::STRING,e'@\\x01vJ':::STRING,e'\\x00':::STRING,e'^=Kd1\\x13+\\r\\x03':::STRING),('BOX(-1.940703651165414 0.6774004050072504,-0.014230000576104795 0.8984300277773816)':::BOX2D,NULL,1760492816:::OID,'a748:2af6:8f1d:ba09:8fcc:8f84:3cdf:d97/82':::INET,'53 years 3 mons 455 days 08:11:42.449281':::INTERVAL,'1991-07-12 03:19:30.000901+00:00':::TIMESTAMPTZ,B'0',e'\\'_':::STRING,'L':::STRING,'3':::STRING,'':::STRING,e'\\x0e\\tg\\x16\\x1fc':::STRING,e'b\\x15``M2``':::STRING),('BOX(-0.18898390364725431 -1.807069376844111,0.9506583900778596 1.6238390439649346)':::BOX2D,'1987-07-10':::DATE,709195734:::OID,'b971:7e84:20da:5f52:66dc:a2bc:2b24:d153/81':::INET,'4 years 9 mons 848 days 00:53:34.193259':::INTERVAL,'0001-01-01 00:00:00+00:00':::TIMESTAMPTZ,B'0','':::STRING,e'\\r\\x1a!HqC':::STRING,'':::STRING,'X':::STRING,'Cb':::STRING,'2J{WT':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col97_105\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 5a086be5e8da9dcd80decccd9393887d370f2531:

          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "DROP SEQUENCE IF EXISTS public.seq141",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:06:56.734942",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema307.enum308 AS ENUM ('sdfa', 'ad', 'afaffa', 'sdad', 'aaassd', 'dff')"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema307.enum308\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:06:56.742276",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE INDEX \"IrrelevantName\" ON schema98.table309 (\"IrrelevantColumn\" ASC)"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema98.table309\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:06:56.524684",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE TABLE IF NOT EXISTS schema198.table294 (col294_295 REGNAMESPACE, col294_296 INT4 NOT NULL, col294_297 FLOAT8 NULL, col294_298 INT4 NULL, col294_299 TIMESTAMP NOT NULL, col294_300 TIMESTAMP NOT NULL, col294_301 TIMETZ NULL, col294_302 REGPROCEDURE NOT NULL, PRIMARY KEY (col294_302 ASC), col294_303 INT4 NULL AS (col294_296 + col294_298) VIRTUAL, UNIQUE (col294_303 ASC, col294_298 DESC) STORING (col294_299, col294_300, col294_301), UNIQUE (col294_303 ASC, col294_297 DESC, col294_300 DESC, col294_299, col294_295 DESC, col294_301 ASC, col294_296, col294_298 DESC), UNIQUE (col294_299 DESC, col294_303 DESC, col294_302, col294_296 ASC, col294_297, col294_295 DESC, col294_300, col294_298, col294_301 ASC), INDEX (col294_298 ASC, col294_302, col294_300 ASC, col294_297, col294_299, col294_303 DESC, col294_295 ASC, col294_301, col294_296 ASC), UNIQUE (col294_296 DESC, col294_298 DESC, col294_303, col294_299, col294_301 ASC, col294_297, col294_302, col294_300 DESC) STORING (col294_295), INDEX (col294_295 ASC, col294_303 DESC, col294_300, col294_298 ASC, col294_296 DESC, col294_302 ASC, col294_301, col294_297 ASC), INDEX (col294_302) STORING (col294_297, col294_299, col294_300), UNIQUE (col294_298 ASC, col294_302), FAMILY (col294_296), FAMILY (col294_298), FAMILY (col294_299, col294_297), FAMILY (col294_302), FAMILY (col294_295), FAMILY (col294_301, col294_300))",
          |   "ALTER TABLE schema198.table294 DROP COLUMN \"col294_298\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"col294_298\" is referenced by computed column \"col294_303\" (SQLSTATE 42P10)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 82f3ddb1ec92af3538cc004522e6431bc9049503:

          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "0A000",
          |  "message": "COMMIT; Successfully got expected commit error",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:11:07.835742",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table202 AS SELECT public.table173.col173_174, public.table173.col173_174 FROM public.table173, public.table173"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table173\" specified more than once (missing AS clause) (SQLSTATE 42712)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:11:08.095798",
          |  "ops": [
          |   "BEGIN",
          |   "INSERT INTO public.table173 (col173_174) VALUES ('!_':::STRING),(e'\u0026\\x12\\x15++]Nh/':::STRING)",
          |   "DROP SEQUENCE public.seq172"
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: the first schema change statement in a transaction must precede any writes (SQLSTATE 0A000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          |     2.0s        0           32.0           35.0      7.6    302.0    671.1    671.1 opOk
          |     2.0s        0            6.0            5.5    453.0   1040.2   1040.2   1040.2 txnCmtErr
          |     2.0s        0            1.0            1.0    453.0    503.3    503.3    503.3 txnOk
          |     2.0s        0           28.0           25.5      2.6    637.5    671.1    671.1 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:11:07.741531",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE IF EXISTS public.seq172",
          |   "CREATE INDEX index173_199 ON public.table173 (col173_174 DESC)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 9645e434ab37c2eef55c69091fcb0c8393fb5f56:

          |   "ALTER TABLE public.table79 DROP COLUMN \"IrrelevantColumnName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table79\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:28:35.241483",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE TYPE public.enum5 AS ENUM ('dasd', 'dasf', 'fdd')",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "CREATE TYPE public.enum5 AS ENUM ('ad', 'affsad')"
          |  ],
          |  "expectedExecErrors": "42710",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: type \"schemachange.public.enum5\" already exists (SQLSTATE 42710)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:28:35.241954",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum75 AS ENUM ('ds', 'afasdf')",
          |   "CREATE TABLE schema80.table81 (col81_82 BIT(2), col81_83 INT8 NOT NULL, col81_84 TIMESTAMPTZ NOT NULL, col81_85 DECIMAL NOT NULL, col81_86 CHAR NOT NULL, col81_87 BOOL NOT NULL, PRIMARY KEY (col81_83, col81_84 ASC), INDEX (col81_82 ASC), UNIQUE (col81_87 DESC, col81_86 ASC, col81_82, col81_85 DESC, col81_83), UNIQUE (col81_83 DESC, col81_85 ASC), UNIQUE (col81_87 ASC, col81_83 DESC, col81_86) STORING (col81_85), UNIQUE (col81_83 DESC, col81_82 ASC), FAMILY (col81_82), FAMILY (col81_83, col81_86, col81_84), FAMILY (col81_87, col81_85))"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema80.table81\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:28:35.624461",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema55 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ b82beb85ab5d49bdd64f5dfb2ec5bf2da44f7e4e:

          |  "workerId": 0,
          |  "clientTimestamp": "07:04:05.307626",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER INDEX public.table96@\"IrrelevantConstraintName\" RENAME TO \"OtherConstraintName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table96\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:04:05.48203",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER SEQUENCE public.seq94 RENAME TO public.seq95"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.seq94\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:04:05.490003",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table92 RENAME TO public.table93"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table92\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:04:05.337296",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table29 (col29_30 DECIMAL NOT NULL, col29_31 INET NOT NULL, col29_32 BOX2D NOT NULL, col29_33 TIME NOT NULL, col29_34 BYTES NOT NULL, col29_35 REGPROC NOT NULL, col29_36 BOX2D NOT NULL, col29_37 REGNAMESPACE NOT NULL, col29_38 BYTES NOT NULL, col29_39 VARCHAR NOT NULL, col29_40 TIME NOT NULL, PRIMARY KEY (col29_30, col29_39, col29_38, col29_32 ASC, col29_31 ASC, col29_36 ASC, col29_33, col29_40, col29_34 DESC, col29_37 DESC, col29_35 ASC), col29_41 STRING AS (lower(CAST(col29_37 AS STRING))) STORED, col29_42 STRING NOT NULL AS (lower(CAST(col29_35 AS STRING))) STORED, col29_43 STRING AS (lower(CAST(col29_40 AS STRING))) VIRTUAL, UNIQUE (col29_35, col29_34 ASC, col29_33 DESC, col29_31, col29_43, col29_37 DESC, col29_41, col29_39 DESC), UNIQUE (col29_31 ASC, col29_42 DESC, col29_32 ASC, col29_40, col29_34 DESC, col29_35 ASC, col29_37 ASC, col29_43 DESC, col29_39 DESC, col29_33 ASC, col29_41 DESC, col29_30), UNIQUE (col29_32, col29_33, col29_42, col29_41 ASC, col29_34 ASC, col29_36 ASC, col29_38 DESC, col29_37 DESC, col29_35 ASC), INDEX (col29_35, col29_41 ASC, col29_33 DESC, col29_40, col29_43 DESC) STORING (col29_42), INDEX (col29_41 ASC, col29_37 DESC, col29_39, col29_30, col29_43, col29_32 ASC, col29_36 DESC, col29_38, col29_40 ASC, col29_33, col29_34 ASC, col29_35, col29_42 DESC), UNIQUE (col29_39 ASC, col29_36 DESC, col29_41 ASC, col29_37, col29_31, col29_33, col29_32 DESC) STORING (col29_42), FAMILY (col29_42, col29_36), FAMILY (col29_33), FAMILY (col29_35), FAMILY (col29_30), FAMILY (col29_34), FAMILY (col29_31), FAMILY (col29_38), FAMILY (col29_39), FAMILY (col29_37, col29_32, col29_40), FAMILY (col29_41))",
          |   "INSERT INTO public.table29 (col29_30,col29_31,col29_32,col29_33,col29_34,col29_35,col29_36,col29_37,col29_38,col29_39,col29_40,col29_41,col29_42,col29_43) VALUES (0.5947751273764383120:::DECIMAL,'28.116.116.194/19':::INET,'BOX(-0.08307366829676865 0.22095233124890412,0.9647316570086024 0.8442238501159305)':::BOX2D,'01:23:08.493018':::TIME,'\\x22':::BYTES,1979659922:::OID,'BOX(-1.7519585438115164 -0.8175162107860944,0.17780281384816354 0.9492976293055293)':::BOX2D,904979647:::OID,'\\xdb33':::BYTES,e'\\x19-F,|P':::STRING,'23:59:30.895644':::TIME,e'\\x00':::STRING,'z02jrU.CE':::STRING,'':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col29_41\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ cc5263fffe2288c19fad31bea5847da3ec644d3c:

          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:01:31.746194",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table3 (col3_4 STRING NOT NULL, col3_5 TIMESTAMPTZ NOT NULL, col3_6 INTERVAL NOT NULL, col3_7 DATE NULL, col3_8 REGTYPE NOT NULL, col3_9 UUID NOT NULL, col3_10 INT2 NOT NULL, PRIMARY KEY (col3_10 DESC, col3_9, col3_8 DESC, col3_4 ASC, col3_5 ASC), col3_11 STRING NOT NULL AS (lower(CAST(col3_7 AS STRING))) VIRTUAL, col3_12 STRING NULL AS (lower(CAST(col3_9 AS STRING))) STORED, col3_13 STRING NOT NULL AS (lower(col3_4)) STORED, UNIQUE (col3_12, col3_13), FAMILY (col3_10), FAMILY (col3_7, col3_5), FAMILY (col3_4, col3_9, col3_6), FAMILY (col3_13), FAMILY (col3_8, col3_12))",
          |   "ALTER TABLE public.table3 RENAME COLUMN \"col3_12\" TO \"col3_41\"",
          |   "ALTER TABLE public.table3 RENAME TO public.table61",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=26042cad key=/Table/SystemConfigSpan/Start pri=0.08639456 epo=0 ts=1627714891.746336097,1 min=1627714891.746122976,0 seq=22} lock=true stat=PENDING rts=1627714891.746122976,0 wto=false gul=1627714892.246122976,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:01:31.744552",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq65",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:01:31.846786",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema19 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ f395e17e098631a353741ff16c9754407a30f3cb:

          |   "SELECT 'validating all objects'",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:26:32.482398",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "CREATE TYPE schema87.enum173 AS ENUM ('fss')",
          |   "ALTER TABLE public.table175 DROP CONSTRAINT IrrelevantConstraintName"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table175\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:26:32.493195",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE TABLE schema87.table176 AS SELECT \"IrrelevantColumnName\" FROM public.table174"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table174\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:26:32.500832",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema146 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 391ec3d916cd43e6fd2629fd254407384db5279f:

          |  ],
          |  "expectedExecErrors": "42701",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: index \"index269_402\" already contains column \"col269_270\" (SQLSTATE 42701)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:59:32.245345",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"schema307\" CASCADE",
          |   "ALTER TABLE schema214.table269 ALTER COLUMN \"col269_271\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "42611",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col269_271\" is not a computed column (SQLSTATE 42611)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:59:31.989635",
          |  "ops": [
          |   "BEGIN",
          |   "INSERT INTO schema214.table269 (col269_270,col269_271,col269_272) VALUES ('2021-10-17 15:42:06.000828+00:00':::TIMESTAMPTZ,1196621555:::OID,368245561803250782:::INT8),('2017-10-10 23:29:32.000353+00:00':::TIMESTAMPTZ,608851705:::OID,(-1188502467301786674):::INT8)",
          |   "ALTER TABLE schema307.table403 ALTER COLUMN \"IrrelevantColumnName\" DROP DEFAULT"
          |  ],
          |  "expectedExecErrors": "0A000,42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema307.table403\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          |     4.0s        0           26.0           33.5     22.0    285.2    385.9    385.9 opOk
          |     4.0s        0            7.0            5.5    738.2    872.4    872.4    872.4 txnCmtErr
          |     4.0s        0            0.0            1.5      0.0      0.0      0.0      0.0 txnOk
          |     4.0s        0           20.0           25.0      1.1     19.9    167.8    167.8 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:59:32.355412",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema395 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 5d888d26fd21151de33a98e63d26d241b999df88:

          |   "CREATE SCHEMA IF NOT EXISTS schema324 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=115dce4f key=/Table/SystemConfigSpan/Start pri=0.00525634 epo=0 ts=1628147133.040013417,1 min=1628147132.445700113,0 seq=25} lock=true stat=PENDING rts=1628147132.445700113,0 wto=false gul=1628147132.945700113,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:32.242217",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table251 ADD COLUMN col251_279 REGPROC",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=27ccbe15 key=/Table/SystemConfigSpan/Start pri=0.00061360 epo=0 ts=1628147133.050695184,1 min=1628147132.242157353,0 seq=11} lock=true stat=PENDING rts=1628147132.242157353,0 wto=false gul=1628147132.742157353,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:31.576092",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "DROP SCHEMA \"schema11\" CASCADE",
          |   "CREATE TABLE public.table251 (col251_252 INT8 NULL, col251_253 BIT(46) NOT NULL, col251_254 UUID NOT NULL, col251_255 BOOL, col251_256 INTERVAL NOT NULL, col251_257 BYTES, col251_258 REGPROC, col251_259 INT4 NULL, col251_260 DECIMAL NOT NULL, col251_261 FLOAT8[] NOT NULL, col251_262 INT4 AS (col251_259 + col251_252) STORED, col251_263 INT8 NULL AS (col251_252 + col251_259) STORED, col251_264 STRING NULL AS (lower(CAST(col251_258 AS STRING))) STORED, col251_265 INT8 NULL AS (col251_252 + 2831969028708135045:::INT8) STORED, INDEX (col251_264 ASC, col251_263 DESC, col251_253 ASC, col251_255 ASC, col251_265, col251_254 DESC, col251_259 DESC, col251_258 ASC, col251_262 ASC, col251_260 ASC) STORING (col251_252, col251_257, col251_261))",
          |   "ALTER TABLE public.table251 ADD CONSTRAINT table251_col251_262_unique UNIQUE (col251_262)",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:32.508098",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table251 ADD CONSTRAINT table251_col251_262_table251_col251_259_fk FOREIGN KEY (col251_259) REFERENCES public.table251 (col251_262) ON DELETE CASCADE ON UPDATE CASCADE"
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ d6df81d52cb8eb2f5a4667f782aa599bd40d497f:

          |   "DROP SCHEMA \"schema21\" CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=ce722ae3 key=/Table/SystemConfigSpan/Start pri=0.01188195 epo=0 ts=1628233786.296256388,1 min=1628233785.890165060,0 seq=7} lock=true stat=PENDING rts=1628233785.890165060,0 wto=false gul=1628233786.390165060,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:09:46.018936",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema103.table185 ADD CONSTRAINT IrrelevantConstraintName UNIQUE (IrrelevantColumnName)"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema103.table185\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:09:45.756068",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table188 (col188_189 TIME NOT NULL, col188_190 \"char\" NOT NULL, PRIMARY KEY (col188_190 DESC, col188_189), INDEX (col188_189 ASC, col188_190 DESC), UNIQUE (col188_190 ASC), INDEX (col188_190), INDEX (col188_189 ASC), INDEX (col188_189), INDEX (col188_189 ASC), UNIQUE (col188_189 DESC), INDEX (col188_190, col188_189 ASC), FAMILY (col188_189, col188_190))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=510242ab key=/Table/SystemConfigSpan/Start pri=0.01748987 epo=0 ts=1628233786.129922463,1 min=1628233785.755771127,0 seq=7} lock=true stat=PENDING rts=1628233785.755771127,0 wto=false gul=1628233786.255771127,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          |     2.0s        0           33.0           32.0      9.4    226.5    285.2    285.2 opOk
          |     2.0s        0            8.0            7.5    604.0    771.8    771.8    771.8 txnCmtErr
          |     2.0s        0            3.0            2.0    385.9   1140.9   1140.9   1140.9 txnOk
          |     2.0s        0           20.0           25.0      2.5    234.9    469.8    469.8 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:09:46.299763",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema184 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 71459e86f0a37f8983a3fed260031dd4163a13bd:

          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:32:50.245191",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "ALTER TABLE public.table85 ADD CONSTRAINT table85_col85_88_unique UNIQUE (col85_88)",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq122",
          |   "ALTER TABLE public.table85 RENAME TO public.table85",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=08bc8a93 key=/Table/SystemConfigSpan/Start pri=0.05776980 epo=0 ts=1628321570.895985227,1 min=1628321570.245121672,0 seq=19} lock=true stat=PENDING rts=1628321570.245121672,0 wto=false gul=1628321570.745121672,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:32:50.689749",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE VIEW public.view123 AS SELECT public.table85.col85_86, public.table85.col85_88, public.table85.col85_86, public.table85.col85_88, public.table85.col85_86, public.table85.col85_87 FROM public.table85, public.table85, public.table85"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table85\" specified more than once (missing AS clause) (SQLSTATE 42712)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:32:50.896084",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table85 RENAME TO public.table117",
          |   "ALTER TABLE public.table117 ALTER COLUMN col85_87 SET DEFAULT '19:55:30.289516':::TIME",
          |   "INSERT INTO public.table117 (col85_86,col85_87,col85_88) VALUES (B'01111111111111111111111111111111','07:55:02.32145':::TIME,e'n\\x10|':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col85_88\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 3168f9b6c1090bbc827da97dfbd89553ed24a88f:

          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema126 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=8a1410be key=/Table/SystemConfigSpan/Start pri=0.06516837 epo=0 ts=1628579467.081281374,1 min=1628579466.739202642,0 seq=6} lock=true stat=PENDING rts=1628579466.739202642,0 wto=false gul=1628579467.239202642,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:11:06.7568",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table127 ALTER COLUMN IrrelevantColumnName SET NOT NULL"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table127\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:11:06.741989",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE TABLE public.table104 (col104_105 TIMESTAMP NULL, col104_106 BOX2D NULL, col104_107 INTERVAL NOT NULL, col104_108 BIT(41) NULL, col104_109 BYTES[], col104_110 GEOMETRY NOT NULL, col104_111 FLOAT8, col104_112 REGCLASS NULL, col104_113 TIME NOT NULL, col104_114 STRING NULL AS (lower(CAST(col104_108 AS STRING))) VIRTUAL, col104_115 STRING AS (lower(CAST(col104_108 AS STRING))) VIRTUAL, col104_116 STRING NOT NULL AS (lower(CAST(col104_108 AS STRING))) STORED, col104_117 STRING NOT NULL AS (lower(CAST(col104_106 AS STRING))) VIRTUAL, UNIQUE (col104_106, col104_114, col104_105 ASC, col104_111 DESC, col104_116 DESC, col104_117 DESC) STORING (col104_107, col104_108, col104_110), INDEX (col104_115, col104_117 ASC, col104_113 ASC, col104_108, col104_107, col104_111 ASC), FAMILY (col104_112, col104_107, col104_110, col104_106), FAMILY (col104_108), FAMILY (col104_113), FAMILY (col104_116), FAMILY (col104_105), FAMILY (col104_109), FAMILY (col104_111))",
          |   "ALTER TABLE public.table104 ALTER COLUMN \"col104_105\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "42611",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col104_105\" is not a computed column (SQLSTATE 42611)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:11:06.376989",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table3 (col3_4 DECIMAL NULL, col3_5 INT4[], col3_6 DATE, col3_7 CHAR, col3_8 BOOL NOT NULL, col3_9 REGPROCEDURE NOT NULL, col3_10 GEOGRAPHY, col3_11 DECIMAL NULL, col3_12 INT4 NULL, col3_13 TIMESTAMP, col3_14 FLOAT4, col3_15 \"char\" NULL, col3_16 BOX2D NULL, col3_17 REGTYPE, col3_18 BIT(6) NOT NULL, col3_19 DECIMAL AS (col3_11 + col3_4) STORED, col3_20 STRING AS (lower(CAST(col3_10 AS STRING))) STORED, col3_21 DECIMAL AS (col3_11 + col3_4) VIRTUAL, col3_22 STRING NOT NULL AS (lower(CAST(col3_18 AS STRING))) VIRTUAL, FAMILY (col3_5), FAMILY (col3_11, col3_15, col3_20), FAMILY (col3_19), FAMILY (col3_6, col3_4), FAMILY (col3_12, col3_7), FAMILY (col3_8, col3_18, col3_13), FAMILY (col3_10), FAMILY (col3_16, col3_17), FAMILY (col3_9), FAMILY (col3_14))",
          |   "CREATE UNIQUE INDEX IF NOT EXISTS index3_125 ON public.table3 (col3_7 DESC, col3_6 DESC, col3_9 DESC, col3_15, col3_4 ASC, col3_8 ASC) STORING (col3_11, col3_20, col3_13, col3_21, col3_19)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table3\" (71): index \"index3_125\" cannot store virtual column \"col3_21\" (SQLSTATE XXUUU)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 87f6dcbb43655b9d66378291683d798f03eecef5:

          |   "CREATE TYPE schema147.enum148 AS ENUM ('da')"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema147.enum148\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:13:32.971535",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table23 RENAME TO public.table123",
          |   "DROP SCHEMA \"schema17\" CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=82b7ffbd key=/Table/SystemConfigSpan/Start pri=0.00662683 epo=0 ts=1628666013.162706423,1 min=1628666012.971471182,0 seq=12} lock=true stat=ABORTED rts=1628666012.971471182,0 wto=false gul=1628666013.471471182,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:13:32.861729",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "ALTER TABLE public.table23 ALTER COLUMN \"col23_29\" SET NOT NULL",
          |   "CREATE TABLE IF NOT EXISTS schema77.table106 (col106_149 TIME NOT NULL, col106_150 UUID NOT NULL, col106_151 INET NOT NULL, col106_152 INT8 NULL, col106_153 REGTYPE NOT NULL, col106_154 REGPROC, col106_155 INT8 NULL, col106_156 BOOL, col106_157 NAME NOT NULL, col106_158 JSONB NOT NULL, col106_159 INT2 NOT NULL, col106_160 INT4 NOT NULL, col106_161 STRING NOT NULL AS (lower(col106_157)) VIRTUAL, col106_162 INT2 AS (col106_159 + col106_155) STORED, FAMILY (col106_151), FAMILY (col106_154, col106_152, col106_156), FAMILY (col106_155), FAMILY (col106_150), FAMILY (col106_157), FAMILY (col106_153), FAMILY (col106_158, col106_149), FAMILY (col106_162), FAMILY (col106_159), FAMILY (col106_160))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=f8520a8d key=/Table/SystemConfigSpan/Start pri=0.00035148 epo=0 ts=1628666013.162706423,1 min=1628666012.861665168,0 seq=11} lock=true stat=PENDING rts=1628666012.861665168,0 wto=false gul=1628666013.361665168,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:13:32.495981",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table23 ALTER COLUMN \"col23_31\" DROP DEFAULT",
          |   "DROP TABLE IF EXISTS public.table23"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ c4d0e7baee3925541eed599ae771abb95c97732b:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:12:33.777796",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema1.table194 RENAME TO schema1.table228",
          |   "ALTER TABLE schema1.table228 ALTER COLUMN \"col194_196\" DROP DEFAULT",
          |   "DROP SEQUENCE IF EXISTS schema249.seq250",
          |   "ALTER TABLE schema1.table228 ALTER COLUMN \"col194_196\" DROP DEFAULT",
          |   "DROP TABLE IF EXISTS schema1.table228 RESTRICT",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=02621ee2 key=/Table/SystemConfigSpan/Start pri=0.02276935 epo=0 ts=1628752354.406038923,1 min=1628752353.777723546,0 seq=36} lock=true stat=PENDING rts=1628752353.777723546,0 wto=false gul=1628752354.277723546,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:12:34.097493",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema1.table194 ALTER COLUMN \"col194_195\" DROP NOT NULL",
          |   "ALTER TABLE schema1.table194 ADD CONSTRAINT table194_col194_198_table194_col194_196_fk FOREIGN KEY (col194_196) REFERENCES schema1.table194 (col194_198) ON DELETE CASCADE ON UPDATE CASCADE",
          |   "ALTER TABLE schema1.table194 ADD COLUMN col194_251 INT4",
          |   "CREATE SCHEMA IF NOT EXISTS schema252 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=17e1fcb4 key=/Table/SystemConfigSpan/Start pri=0.00762437 epo=0 ts=1628752354.406038923,1 min=1628752354.097409134,0 seq=32} lock=true stat=ABORTED rts=1628752354.097409134,0 wto=false gul=1628752354.597409134,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          |     3.0s        0           20.0           32.0     12.1    285.2    536.9    536.9 opOk
          |     3.0s        0            3.0            6.0    469.8    939.5    939.5    939.5 txnCmtErr
          |     3.0s        0            2.0            3.3    369.1    570.4    570.4    570.4 txnOk
          |     3.0s        0           14.0           17.0      5.8    104.9    104.9    104.9 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:12:33.974473",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema1.table194 ALTER COLUMN \"col194_198\" SET NOT NULL"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 0d7ae9fe48bee65304c051f73c2b09b8887d0922:

          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | , UNIQUE (col25_26))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=2f697d43 key=/Table/SystemConfigSpan/Start pri=0.01764079 epo=0 ts=1628838885.838884026,1 min=1628838885.837297223,0 seq=7} lock=true stat=PENDING rts=1628838885.837297223,0 wto=false gul=1628838886.337297223,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:14:45.838373",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table35 ADD COLUMN IrrelevantColumnName string"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table35\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:14:45.837938",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE SCHEMA IF NOT EXISTS schema21 AUTHORIZATION root",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq36 OWNED BY schema21.table40.\"IrrelevantColumnName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema21.table40\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:14:45.83795",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table3 (col3_4 TIMETZ NOT NULL, col3_5 BIT(9), col3_6 INET, col3_7 REGTYPE NULL, col3_8 UUID NOT NULL, col3_9 BIT(19) NOT NULL, col3_10 FLOAT8 NOT NULL, col3_11 BYTES, PRIMARY KEY (col3_8 ASC, col3_10 DESC, col3_4 DESC, col3_9 DESC), col3_12 STRING NULL AS (lower(CAST(col3_7 AS STRING))) STORED, col3_13 STRING NOT NULL AS (CASE WHEN col3_11 IS NULL THEN ' Y':::STRING ELSE e';,f_.3\\x1f':::STRING END) STORED, col3_14 STRING AS (lower(CAST(col3_9 AS STRING))) STORED, UNIQUE (col3_11 DESC, col3_4 ASC, col3_7 DESC), UNIQUE (col3_5, col3_4, col3_7 ASC, col3_11, col3_9, col3_8, col3_14 DESC, col3_12 ASC, col3_6 DESC, col3_13), INDEX (col3_8), UNIQUE (col3_14 DESC, col3_11 DESC) STORING (col3_6, col3_12), INDEX (col3_11 DESC, col3_6 DESC, col3_9 ASC, col3_14, col3_5 DESC, col3_4 ASC, col3_13), INDEX (col3_11 DESC, col3_5, col3_12 DESC, col3_7, col3_8 ASC, col3_9, col3_10 ASC) STORING (col3_6, col3_14), UNIQUE (col3_8, col3_5 DESC, col3_10 DESC, col3_12 DESC, col3_9 ASC, col3_13) STORING (col3_7, col3_11, col3_14), INDEX (col3_8 ASC, col3_13 ASC, col3_12, col3_10 ASC, col3_14 ASC, col3_11 ASC, col3_4) STORING (col3_5), UNIQUE (col3_4 ASC, col3_6 ASC), FAMILY (col3_10), FAMILY (col3_5, col3_8, col3_4), FAMILY (col3_11), FAMILY (col3_7, col3_6), FAMILY (col3_14, col3_12), FAMILY (col3_13, col3_9))",
          |   "INSERT INTO public.table3 (col3_4,col3_5,col3_6,col3_7,col3_8,col3_9,col3_10,col3_11,col3_12,col3_13,col3_14) VALUES ('20:07:35.991456+06:53:00':::TIMETZ,B'110011111','208.60.101.154/19':::INET,3328661743:::OID,'3f33322f-ddc1-46a0-b1ab-cd1076bdc781':::UUID,B'0111111111111111111',0.8181368739311691:::FLOAT8,'\\x65c1bf22ae1b08e6':::BYTES,NULL,e'\\x1eT\\bj':::STRING,'7':::STRING),('19:43:22.944924-00:26:00':::TIMETZ,B'100001110','93a9:fe4f:dbcc:36ee:4bde:318c:564b:574a/56':::INET,757219291:::OID,'62c2b73f-02ec-4514-8f34-1d2bcf6f53b6':::UUID,B'0011011001100011011',(-1.9325301213720802):::FLOAT8,NULL,e'\\x07':::STRING,e'w\\n``\\bD\\x16D':::STRING,'Mg':::STRING),('24:00:00-15:59:00':::TIMETZ,NULL,'8c33:99f3:31af:8514:3d9d:bb46:6fd4:b8d8/44':::INET,2137712155:::OID,'e8be6205-052e-4586-90e0-23e0744d0757':::UUID,B'1010100110000110101',0.670453060389768:::FLOAT8,'\\x1f0f5c7657':::BYTES,e'\\x04X':::STRING,e'\\x7fq3qJ/':::STRING,'':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col3_12\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 22dad757f6f5ba0d0a10ce3ccdf9712e54cf1a56:

          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table74 AS SELECT public.table30.col30_33 FROM public.table30",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=b6b337b3 key=/Table/SystemConfigSpan/Start pri=0.02575088 epo=0 ts=1628925398.164893728,1 min=1628925397.970102307,0 seq=7} lock=true stat=PENDING rts=1628925397.970102307,0 wto=false gul=1628925398.470102307,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:16:37.808702",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table30 (col30_76 CHAR, col30_77 NAME NOT NULL, col30_78 GEOGRAPHY, col30_79 \"char\" NOT NULL, col30_80 TIMESTAMPTZ NULL, col30_81 REGNAMESPACE NULL, col30_82 REGPROC NULL, col30_83 DATE, col30_84 OID NOT NULL, col30_85 DECIMAL[] NOT NULL, col30_86 TIMESTAMP NULL, col30_87 UUID, col30_88 TIME NULL, col30_89 CHAR NULL, col30_90 INT2 NULL, col30_91 TIME NULL, col30_92 BIT(41), col30_93 INTERVAL, col30_94 STRING NULL AS (lower(col30_79)) STORED, INDEX (col30_89, col30_94, col30_76 DESC, col30_82 DESC, col30_79 DESC, col30_91 ASC, col30_93 ASC, col30_92, col30_90 ASC), INDEX (col30_89 ASC, col30_86 DESC, col30_81) STORING (col30_78, col30_79, col30_80, col30_82, col30_85, col30_90, col30_92, col30_93), UNIQUE (col30_82, col30_87 DESC, col30_89 ASC, col30_91 ASC))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:16:38.068182",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE VIEW public.view95 AS SELECT public.table30.col30_31, public.table30.col30_32, public.table30.col30_31, public.table30.col30_32, public.table30.col30_32, public.table30.col30_31 FROM public.table30, public.table30, public.table30"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table30\" specified more than once (missing AS clause) (SQLSTATE 42712)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:16:37.831632",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table30 ADD COLUMN col30_65 DATE",
          |   "INSERT INTO public.table30 (col30_31,col30_32,col30_33) VALUES ('0105000020E610000007000000010200000006000000125FC3937E1B5240328921F570994BC036C8FB5D4B38624014E266D5FE5136C0D4E52456793359401084DF1620D214C07C00B3DE67575D40C875A20FFC31384038FB7C5851A35340BCBAE320C686474040934AAD1A4106C048D6586719E34C400102000000040000006CF916633A1C5340580DF10EE9FB354056F49131F0EC60402CFAED2E957D5240636C04684BA353C0A04A0CADABD13A40C79EBBB0423F59C0C00CFFB523121C40010200000002000000E812C987F64F63C014D2FAE96BD8354078224A8B2F9E3CC01053C69E080E134001020000000200000050B7CD82B2C447C00869A6790BB731C07464A0A1AA116240626AF943B89441C001020000000500000080F4E4CEA51D1340FCE38B9CAF3B40C028375F27848231C09F4E6E39C66C4EC0B0A611491B283F40C865392FC81253C0E289D32E44A560402B46E1C276E154C03826664086135B4024B620AA71C73E400102000000030000007CB9F9EF72FC5C406482A114587037C02853786612716140D8F67D75734A3C40F70D874CC47455C010BFFE7AF36114C00102000000060000005720AEBE37B561C00020D50BD305D93F3C31D6A198AB60C0C3DDAD2F76EF55C0A8D120DBBF3345C0F89BD298DB6A28C078EDDE13B623614060C43003CE1E1B406088600D78434C40F40532AB025A4D405C6B8B7A6CD74040609BF428AD294C40':::GEOGRAPHY,'\\x33e2bfb43e':::BYTES,e'M\\x1envg=H':::STRING),('0103000020E61000000100000005000000A2ECBC23D76364C01451B0F138B253C03C6BE7947DEE42C0E24D4B27BBC440C0E094CB18C5C519C0742780FC61AF3BC060E409D5347347405CB123EBC67A3A40A2ECBC23D76364C01451B0F138B253C0':::GEOGRAPHY,'\\x67':::BYTES,e'Mi\\f':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col30_33\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 147ff1527172ca8ce2d190594d098314af1c2ab6:

          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema83.table84\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:09:40.105188",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema87 AUTHORIZATION root",
          |   "ALTER SEQUENCE schema1.seq90 RENAME TO schema1.seq91"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema1.seq90\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
          |     1.0s        0           33.0           36.0     11.5     71.3    142.6    142.6 opOk
          |     1.0s        0            3.7            4.0    318.8    503.3    503.3    503.3 txnCmtErr
          |     1.0s        0            5.5            6.0    335.5    805.3    805.3    805.3 txnOk
          |     1.0s        0           22.9           25.0      5.2     48.2     92.3     92.3 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:09:40.132086",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table24 ALTER COLUMN \"col24_111\" DROP NOT NULL"
          |  ],
          |  "expectedExecErrors": "42703",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col24_111\" does not exist (SQLSTATE 42703)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:09:40.136581",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE public.seq109",
          |   "ALTER TABLE public.table24 ALTER COLUMN col24_26 SET DEFAULT '447e:ffc3:cc57:c080:12bc:7927:3cb9:c07a/109':::INET"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot T-sql-schema branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!