cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30k stars 3.79k forks source link

roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed #61688

Closed cockroach-teamcity closed 2 years ago

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@8c3fa11ca35deca2f38a1e6fb5f0dea4a77285bd:

          |  "workerId": 0,
          |  "clientTimestamp": "07:51:38.22948",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER VIEW schema177.view295 RENAME TO schema177.view296"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema177.view295\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:51:37.982605",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema177.table315 DROP COLUMN \"IrrelevantColumnName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema177.table315\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:51:38.507529",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table257 ADD CONSTRAINT table257_col257_314_unique UNIQUE (col257_314)"
          |  ],
          |  "expectedExecErrors": "42703",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col257_314\" does not exist (SQLSTATE 42703)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:51:38.43934",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table258 (col258_259 DECIMAL, col258_260 REGNAMESPACE NULL, col258_261 REGCLASS NOT NULL, col258_262 VARCHAR NOT NULL, col258_263 TIMESTAMPTZ NOT NULL, col258_264 INT8, col258_265 REGPROCEDURE NOT NULL, col258_266 REGNAMESPACE NOT NULL, PRIMARY KEY (col258_265 DESC, col258_261 DESC, col258_262, col258_266), col258_267 STRING AS (lower(CAST(col258_261 AS STRING))) VIRTUAL, UNIQUE (col258_264 DESC, col258_261, col258_267, col258_260 DESC, col258_266 ASC, col258_259, col258_263 DESC, col258_265 ASC, col258_262 DESC), INDEX (col258_267 DESC, col258_259, col258_266 ASC), UNIQUE (col258_265 DESC, col258_263 DESC, col258_259 DESC, col258_261 ASC, col258_266 ASC, col258_264 DESC, col258_267 ASC, col258_260 DESC, col258_262), UNIQUE (col258_267, col258_266 DESC, col258_263 ASC, col258_262 DESC, col258_260), INDEX (col258_263 DESC, col258_266, col258_261 DESC, col258_264 DESC, col258_267 DESC) STORING (col258_260), INDEX (col258_267) STORING (col258_259, col258_260, col258_263))",
          |   "INSERT INTO public.table258 (col258_259,col258_260,col258_261,col258_262,col258_263,col258_264,col258_265,col258_266,col258_267) VALUES (51225135152357214.38:::DECIMAL,262312517:::OID,2243024149:::OID,'\"':::STRING,'1998-04-19 21:35:45.000389+00:00':::TIMESTAMPTZ,9117111860797605753:::INT8,3924504503:::OID,1942673304:::OID,'':::STRING),(70228663145.89621194:::DECIMAL,0:::OID,3185619865:::OID,e'$WW\\x7f%\\f5':::STRING,'1989-10-15 23:42:05.000733+00:00':::TIMESTAMPTZ,(-3600514830243974164):::INT8,2935998227:::OID,772003351:::OID,'A':::STRING),(2.922084246122010643E+32:::DECIMAL,4150309104:::OID,1313584268:::OID,e',K\\x1bR$p':::STRING,'1992-09-21 13:45:35.000815+00:00':::TIMESTAMPTZ,8600552832911437258:::INT8,1988186621:::OID,0:::OID,e'\\\\=LR':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col258_267\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2757432&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

Jira issue: CRDB-6265

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@e5aebce55e34e66e8ce0cdbd81b9d9653243df81:

          |  "clientTimestamp": "18:02:34.062609",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE schema64.table65 AS SELECT public.table12.col12_26, public.table12.col12_19, public.table12.col12_18, public.table12.col12_21, public.table12.col12_20, public.table12.col12_22, public.table12.col12_13, public.table12.col12_16 FROM public.table12"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema64.table65\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "18:02:33.958176",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table12 RENAME TO public.table53",
          |   "CREATE TABLE public.table58 (col58_59 INT8 NOT NULL, col58_60 DECIMAL NOT NULL, col58_61 REGCLASS NOT NULL, col58_62 FLOAT4 NULL, PRIMARY KEY (col58_60, col58_61 DESC, col58_59), col58_63 FLOAT4 AS (col58_62 + (-1.3794074058532715):::FLOAT8) VIRTUAL, UNIQUE (col58_61 ASC, col58_59 DESC, col58_63 ASC, col58_62, col58_60 ASC), INDEX (col58_61 ASC, col58_60, col58_62 DESC), INDEX (col58_59 DESC, col58_63 ASC), INDEX (col58_63 DESC, col58_60, col58_62 ASC, col58_61 ASC), FAMILY (col58_60), FAMILY (col58_62), FAMILY (col58_59, col58_61))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=70a5144d key=/Table/SystemConfigSpan/Start pri=0.00910293 epo=0 ts=1615572154.081886996,1 min=1615572153.958088624,0 seq=19} lock=true stat=PENDING rts=1615572153.958088624,0 wto=false gul=1615572154.458088624,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "18:02:34.097897",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table41 ADD COLUMN IrrelevantColumnName string"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table41\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "18:02:34.018489",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table12 ALTER COLUMN \"col12_24\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"col12_24\" is not a stored computed column (SQLSTATE 42611)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2771411&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@4a47e0e305cbdabf963f896c1cb571a28b34e63d:

          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum51 AS ENUM ('aaa')",
          |   "ALTER SEQUENCE schema6.seq101 RENAME TO schema6.seq102"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema6.seq101\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:50:04.354605",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table104 ADD CONSTRAINT IrrelevantConstraintName UNIQUE (IrrelevantColumnName)"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table104\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:50:04.745559",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE IF EXISTS public.seq62",
          |   "CREATE TABLE public.table89 (col89_90 VARCHAR, col89_91 OID NOT NULL, col89_92 STRING, PRIMARY KEY (col89_91), INDEX (col89_91 DESC, col89_92 ASC), INDEX (col89_90, col89_91 ASC, col89_92 ASC), UNIQUE (col89_90 DESC, col89_92, col89_91 ASC), INDEX (col89_92 ASC, col89_91 DESC))",
          |   "CREATE TABLE schema117.table118 AS SELECT public.table89.col89_91, public.table89.col89_92, public.table89.col89_90 FROM public.table89"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema117.table118\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:50:05.010513",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema88 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2780761&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@ba54410af79c0481e1e8f8fc45a9b132ee09a2b4:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/scbench/randomload/nodes=3/ops=10000/conc=20/run_1
    schemachange_random_load.go:145,schemachange_random_load.go:80,test_runner.go:767: output in run_071414.987_n1_workload_run_schemachange: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2785193-1615960807-23-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned: exit status 20
        (1) attached stack trace
          -- stack trace:
          | main.(*cluster).RunE
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2332
          | main.runSchemaChangeRandomLoad
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:142
          | main.registerRandomLoadBenchSpec.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:80
          | main.(*testRunner).runTest.func2
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:767
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1374
        Wraps: (2) output in run_071414.987_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2785193-1615960807-23-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I210317 07:14:15.698424 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210317 07:14:15.797171 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 98.746257ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col47_93" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ```
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ```
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | 85442C89C22EFC1A853E701A936FBC10C8779243D2DE241C06D6254AB9CDF41640FB3119322F3412823BCFF08BBE74128E03703F793E8415466A78F7FA7F24180CEE815053CCE41B82A83770B3AF741006E7B556A07BA411097A8D1AFD0F54167EB9849E14AF7C17C94164656A6F4416D36C3BFA845F1C178DE7A419666EA41CE560126F95BF1C100F24B88DE41D1410103000000010000000900000098A7572D3BDEF6C13AD53AA42410EEC1533C25233270F0C1A10F44E802D600C2B8CB5C73BD5AF14135DD59045FBEFBC1B40F5ADEE762E34173A35168B834F2C1300EC561694DD941F46B162D764FD9C126C6B8CD59EE0042541B673580BBF241B04154F96EC8F64104F6F7283D2DED41F1844822B16CFEC1A0DE7EB7ABC9DFC198A7572D3BDEF6C13AD53AA42410EEC10102000000050000000034C8803EC09441A2149FB89DAEF2C13A1C8EF7C735F941307060A72F37DB410CDECB375F2DFD416CEB7BAD583C014260E009AB5D5CF541F0ED9D5CD5F9FC4170DD31495AECEA41D4E7A043662801420103000000010000000B0000009E61285928B600C2082C0C83CE25DFC1DC9F20D70E92E9C148544DD67B9BFAC124C9769CAE96D9C1AEA1B3DA1723F6C18C7E7653CD76EB41DB2EC29A3592FCC1B08844C05B23F841B996B5B95EFEFDC18055BF4E9F7FBEC1A43E8A8023E9E84120EC172FC068BC41A29B17170000004268D8DFBE8DEDE1C1B883E0AB0683F7410027F914185EE5C1C0D9583272F3AB4121ACFE52E60B00C28433983D731AE2419E61285928B600C2082C0C83CE25DFC10106000000070000000103000000010000000A0000002A6DB58D62F3FDC1DB22D802F209F0C158AA9B9AED85E94156DEE475210D02C208E6556E3EA7F3412261E22D5563E4C1CC5292EDABA4E441003B7A55C9A589C1C85BEB299B29F941305381465EC1ED41F259A0C6743C024260107F48B4E3FF41E01E7F9D9204B741781F02F5F69DE441087B389FAC78D5C130E73C32FCC5D6419C6DA65FF0FDE9C180C14FD3800EDC412A6DB58D62F3FDC1DB22D802F209F0C101030000000100000009000000A0BABD1C31DEBB4178B57636F2A4F7C1B0AA87341F9DEB419FD7F6459740F7C10299FDBB19BBF14100BC9F914B3FC241A809EBF6E94EEDC130BE65CBEB8DE7413F149ADA1841F7C19CA851AB91CD01424E380FC24DBFFCC128773687B744FB41C5D42E25CEF601C2A8AD03045AD5ED4169A403F1953402C20C4E996BDC62EC41A0BABD1C31DEBB4178B57636F2A4F7C10103000000010000000B000000C62B4754152D02C21183AB44EBE800C23CBE050F3221FAC1EF3DD5022E9BF8C15ACAF972A2E9F7C12575B517C06FFBC1644CEE9595E2ECC1DF8192B8980502C2FC3D88F9AEFAFA4162E690067597E9C19CB319A118A9F8416CABB0726152F141A0D0DDED41CDC8C1885A84D50104F041BE1286ADF3A7ECC148D7BD13A675FF418B9A7D866220F3C168353649B8E3D2C1938C1951D281FBC1B0389F846906D3C1C62B4754152D02C21183AB44EBE800C201030000000100000006000000184C0AB9A0F7D54180020489B811DBC12443CEA56149FC416B14FEE72811F2C1C2D70624B7A2F341006AC313215FB1C120EB2336773EC3C140B5DD54E9B3B1416B5EC6EC8923F2C1E08C5612419FBD41184C0AB9A0F7D54180020489B811DBC10103000000010000000B0000002E848DDD2660F0C12049548D22F2BD41E4EAE164B428E1C18005B34DE85B93C188DAC6AF62A6DBC1EE711F24522FEFC1FA95DC08B5E1F941CB995ED939BCF3C14220C5691A4F0242B860D3A374EBD3C1660E167C792D0042B4AC760A6CEDEA41A4754CD605C3E9419CCB4D4F1B2AE7418C6A96BD9855EE41AE3CCF4027A1FA41381DD77D9B6DE1C1CA07D0ED5035F3413079BFC8F26FDC41F019023D72A9D0412E848DDD2660F0C12049548D22F2BD410103000000010000000A000000A0F446C95BDFDCC1E0852CA108E8EBC10F265ACC4CEFF6C15F551F5F9098F5C1CB6A41DFBBC0F1C1F4479133402900C2500D5FB337C8C141AC6CE60D5D66FBC11423E4E2467E004220DB3D8E62D3FEC114395AAC80FBF6412018BD681AB9C0411A7D620BAD20024276535A7DBDF5F041A485705C5395E74100277BDF00F1F241E0354A3F1445F8C1D0CC65065BDBCC41A0F446C95BDFDCC1E0852CA108E8EBC10103000000010000000C00000008716192C15400C29F4EE64C472AF2C1DC355A22C78301C2700AD46A950AF4C18E3736ECDF8C00C228E26BF39D22FBC1A003C7C36F42B7C1D39949E55AF600C258E89C06C20CDBC1487526677BD3D1C18256B05160DCF441F099B46EA97FE1C1C86424F1E86DD74140499BBE8057AC41F462DED88D47FC41D06AFAA055DFE741247477A21064D6C1C6C570B8CBA1F541A1FEFD9BADEDF4C140FB085FDEFFFE416B6BD5069600F9C16483339B37E7F44108716192C15400C29F4EE64C472AF2C1':::GEOMETRY,3021758946:::OID,'-infinity':::DATE,'24:00:00-15:59:00':::TIMETZ,'BOX(0.44636093895587403 -0.9326050909621908,0.7181674814975567 -0.08019695239589279)':::BOX2D,e'\"\\x18}':::STRING,'Y8^_d':::STRING,'Z_a':::STRING,'59C.A@P':::STRING,e'2E\\x02\\b8cy\\f':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col47_93\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2785193&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@0ee391c3b96ba8695839ea60c45069bc771229b6:

          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:07:00.876277",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq149",
          |   "CREATE TABLE public.table159 (col159_160 \"char\" NOT NULL, PRIMARY KEY (col159_160 ASC), UNIQUE (col159_160 ASC), INDEX (col159_160 ASC), UNIQUE (col159_160), UNIQUE (col159_160 DESC), INDEX (col159_160 ASC), INDEX (col159_160 ASC))",
          |   "ALTER TABLE public.table161 ALTER COLUMN IrrelevantColumnName DROP STORED"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table161\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:07:00.718749",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE public.seq46",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "CREATE SCHEMA public AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "42P06",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: schema \"public\" already exists (SQLSTATE 42P06)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:07:00.936965",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table138 (col138_139 GEOGRAPHY NULL, col138_140 JSONB NULL, col138_141 REGCLASS NULL, col138_142 REGPROCEDURE NULL, col138_143 JSONB NOT NULL, col138_144 STRING NOT NULL AS (lower(CAST(col138_141 AS STRING))) STORED, UNIQUE (col138_142 DESC), FAMILY (col138_143), FAMILY (col138_144, col138_141, col138_142), FAMILY (col138_139), FAMILY (col138_140))",
          |   "SELECT 'validating all objects'",
          |   "INSERT INTO public.table138 (col138_139,col138_140,col138_141,col138_142,col138_143,col138_144) VALUES (NULL,'[[{\"a\": [], \"baz\": []}, {\"foo\": null}, [[]], true, []], [{}, 0.4739929693347228], {\" -s\u003ey2rl\": []}, {}]':::JSONB,3057411731:::OID,2671282370:::OID,'{\"foo\": [], \"r;~*Ct@o\": {\"a\": []}}':::JSONB,'xI ':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col138_144\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2789039&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@cba235b11752e2f1e1c6dfee7ac55c514f4ea930:

          |  "clientTimestamp": "07:09:31.328448",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema230.table267 DROP CONSTRAINT IrrelevantConstraintName"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema230.table267\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:09:31.498307",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema230.table276 DROP COLUMN \"IrrelevantColumnName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema230.table276\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:09:31.616663",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE TYPE public.enum273 AS ENUM ('sf', 'fda')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:09:31.65447",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"schema3\" CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2792436&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@8cdd17ff30a89b861a015a8f9d92da77ae781373:

          | I210320 07:07:04.732981 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 105.756849ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col26_33" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ```
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ```
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          |  col52_60 JSONB, col52_61 REGTYPE NOT NULL, col52_62 REGNAMESPACE NOT NULL, col52_63 JSONB NULL, col52_64 REGTYPE NOT NULL, col52_65 INT2 NOT NULL, col52_66 STRING[] NOT NULL, col52_67 BOOL, col52_68 DECIMAL NULL, col52_69 STRING AS (lower(CAST(col52_53 AS STRING))) STORED, col52_70 STRING AS (lower(col52_58)) STORED, INVERTED INDEX (col52_56 ASC, col52_58, col52_65, col52_53, col52_69 DESC, col52_61 ASC, col52_67 ASC, col52_64 DESC, col52_63), INVERTED INDEX (col52_70 ASC, col52_62 DESC, col52_57 ASC, col52_64, col52_55 ASC, col52_68 ASC, col52_58 ASC, col52_61, col52_53, col52_69 DESC, col52_65, col52_67 DESC, col52_60 DESC), FAMILY (col52_69, col52_56), FAMILY (col52_54, col52_64), FAMILY (col52_63), FAMILY (col52_70), FAMILY (col52_57), FAMILY (col52_68, col52_66, col52_58, col52_59, col52_65, col52_61), FAMILY (col52_53, col52_62), FAMILY (col52_67, col52_60), FAMILY (col52_55))",
          |   "CREATE TYPE public.enum75 AS ENUM ('ddsa')",
          |   "DROP SEQUENCE public.seq79"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.seq79\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:07:04.733855",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table80 ALTER COLUMN IrrelevantColumnName SET DATA TYPE IrrelevantDataType"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table80\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:07:04.734946",
          |  "ops": [
          |   "BEGIN",
          |   "DROP TABLE IF EXISTS schema1.table2 CASCADE",
          |   "CREATE TABLE public.table26 (col26_27 TIME, col26_28 VARCHAR NOT NULL, col26_29 REGTYPE NOT NULL, col26_30 TIMESTAMPTZ NULL, col26_31 BIT(45) NOT NULL, col26_32 BIT(4), PRIMARY KEY (col26_31 ASC, col26_28), col26_33 STRING NOT NULL AS (lower(CAST(col26_31 AS STRING))) STORED, col26_34 STRING NULL AS (lower(col26_28)) VIRTUAL, col26_35 STRING NOT NULL AS (lower(CAST(col26_31 AS STRING))) VIRTUAL, col26_36 STRING AS (IF(col26_30 IS NULL, e'6p\\tNNj2z':::STRING, 'd\"K':::STRING)) VIRTUAL, INDEX (col26_27 DESC, col26_34, col26_35, col26_33 DESC, col26_30 DESC, col26_31 ASC, col26_32, col26_29 DESC, col26_28), INDEX (col26_33 DESC, col26_35 DESC, col26_28 DESC) STORING (col26_27, col26_29, col26_32), INDEX (col26_29 DESC, col26_28, col26_36, col26_34 ASC, col26_27 ASC, col26_33 ASC, col26_35 ASC) STORING (col26_30, col26_32), UNIQUE (col26_27 ASC, col26_29 DESC, col26_30 DESC, col26_28, col26_33), INDEX (col26_33, col26_35 ASC), UNIQUE (col26_36 DESC) STORING (col26_27, col26_30, col26_33), INDEX (col26_29 DESC, col26_27 ASC, col26_31, col26_35), UNIQUE (col26_34 ASC, col26_35, col26_29 ASC, col26_28), INDEX (col26_33 ASC, col26_27 DESC, col26_34), FAMILY (col26_32, col26_29, col26_27), FAMILY (col26_31, col26_30), FAMILY (col26_33, col26_28))",
          |   "INSERT INTO public.table26 (col26_27,col26_28,col26_29,col26_30,col26_31,col26_32,col26_33,col26_34,col26_35,col26_36) VALUES ('07:35:13.812695':::TIME,e'CP\\x10':::STRING,1712189638:::OID,NULL,B'011111111111111111111111111111111111111111111',B'1111','':::STRING,e'Nx\\x1cgp(c%':::STRING,'X':::STRING,e'\\x00':::STRING),('06:01:51.725164':::TIME,e'B0YH\\x03':::STRING,0:::OID,'1973-12-15 09:57:18.000997+00:00':::TIMESTAMPTZ,B'010100110010100011010110001110010101011101101',NULL,e'F2r8=@H\\x0b':::STRING,NULL,e'#su_u\\x06s':::STRING,'\"':::STRING),('23:45:06.46141':::TIME,e'!\\x16;\\x1e\\x1d!:#\\x19':::STRING,1726508138:::OID,'2013-07-20 03:36:28.000512+00:00':::TIMESTAMPTZ,B'001010111110111111011001100010011111000000001',B'0111',e'dnK7\\x13Qk\\x1bP':::STRING,'ghe':::STRING,e'a\\x16':::STRING,'#':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col26_33\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2795707&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@2bdb62260a178e5bb63cf15f704944c5384f4347:

          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema489.enum490\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:56:01.385633",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema247.enum455 AS ENUM ('sdas', 'saadsf', 'sda', 'dsfs', 'sada', 'dsss')",
          |   "ALTER TABLE schema442.table492 ADD CONSTRAINT IrrelevantConstraintName UNIQUE (IrrelevantColumnName)"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema442.table492\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:56:00.782392",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema315.enum473 AS ENUM ('asad')",
          |   "CREATE TYPE public.enum493 AS ENUM ('af', 'fafsaa', 'ass', 'a', 'asf', 'dfs')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=e0e8a974 key=/Table/SystemConfigSpan/Start pri=0.00894535 epo=0 ts=1616396161.385566035,1 min=1616396160.782320272,0 seq=18} lock=true stat=PENDING rts=1616396160.782320272,0 wto=false gul=1616396161.282320272,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:56:00.673283",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "CREATE TABLE schema315.table477 (col477_478 BYTES NULL, col477_479 \"char\" NOT NULL, col477_480 REGNAMESPACE NULL, col477_481 OID, PRIMARY KEY (col477_479 DESC), col477_482 STRING NOT NULL AS (lower(CAST(col477_481 AS STRING))) STORED, col477_483 STRING NOT NULL AS (lower(CAST(col477_481 AS STRING))) STORED, UNIQUE (col477_478 ASC, col477_479 DESC, col477_482) STORING (col477_480), UNIQUE (col477_482 ASC, col477_483, col477_479 ASC, col477_480 ASC, col477_481 DESC, col477_478 ASC), INDEX (col477_483, col477_478, col477_482 DESC, col477_481 DESC, col477_479 DESC, col477_480 ASC), UNIQUE (col477_480 DESC, col477_479 ASC, col477_483, col477_481 ASC, col477_478, col477_482 DESC), UNIQUE (col477_478, col477_479) STORING (col477_481, col477_483), INDEX (col477_482 DESC, col477_480 ASC, col477_479 DESC) STORING (col477_478, col477_483), INDEX (col477_481 ASC), INDEX (col477_481 DESC, col477_480 DESC, col477_478 ASC))",
          |   "ALTER TABLE schema315.table477 DROP COLUMN \"col477_481\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"col477_481\" is referenced by computed column \"col477_482\" (SQLSTATE 42P10)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2798738&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@9ff77c449e4a4d24d36dc88f55830973815ce3d8:

          |  "clientTimestamp": "07:07:11.084525",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq403 OWNED BY public.table437.\"IrrelevantColumnName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table437\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:07:10.924841",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema22.table293 ADD CONSTRAINT table293_col293_304_unique UNIQUE (col293_304)",
          |   "DROP INDEX schema22.table438@\"IrrelevantIndexName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema22.table438\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:07:11.128634",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema435 AUTHORIZATION root",
          |   "ALTER TABLE schema22.table293 DROP CONSTRAINT \"table293_col293_301_col293_298_col293_295_col293_307_col293_294_col293_296_key\""
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: cannot drop UNIQUE constraint \"table293_col293_301_col293_298_col293_295_col293_307_col293_294_col293_296_key\" using ALTER TABLE DROP CONSTRAINT, use DROP INDEX CASCADE instead (SQLSTATE 0A000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:07:11.204469",
          |  "ops": [
          |   "BEGIN",
          |   "INSERT INTO schema22.table293 (col293_294,col293_295,col293_296,col293_297,col293_298,col293_299,col293_300,col293_301,col293_302,col293_303,col293_304,col293_305,col293_306,col293_307) VALUES (0.024985771626234055:::FLOAT8,B'1110011010111111001011100100001011011',(-25464):::INT8,0:::OID,1.4709209203720093:::FLOAT8,(-5849743715282269291):::INT8,'4280f2f8-f84a-465d-9073-532dbc6aab54':::UUID,'\\xba954f0bf4a2fd2b':::BYTES,14788:::INT8,(-309002021826646113):::INT8,1.7555793523788452:::FLOAT8,7167718317041216120:::INT8,NULL,16552:::INT8)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col293_303\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2803002&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@23e7cb53bf5baede071832b59bd92ea8164531a6:

          |   "ALTER TABLE public.table349 ALTER COLUMN col349_392 SET DEFAULT \"IrrelevantValue\""
          |  ],
          |  "expectedExecErrors": "42703",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col349_392\" does not exist (SQLSTATE 42703)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:54:50.007056",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE VIEW public.view391 AS SELECT public.table369.col310_313, public.table369.col310_315, public.table369.col310_319, public.table369.col310_311, public.table369.col310_318, public.table369.col310_312, public.table369.col310_316 FROM public.table369",
          |   "CREATE TABLE schema396.table397 AS SELECT public.table369.col310_311, public.table369.col310_317 FROM public.table369"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema396.table397\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:54:50.089806",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "ALTER TABLE public.table369 RENAME COLUMN \"col310_318\" TO \"col310_317\""
          |  ],
          |  "expectedExecErrors": "42701",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col310_317\" of relation \"table369\" already exists (SQLSTATE 42701)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:54:49.346617",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table349 ADD CONSTRAINT table349_col349_352_unique UNIQUE (col349_352)",
          |   "CREATE TABLE public.table394 AS SELECT public.table320.col310_315, public.table320.col310_316, public.table320.col310_319, public.table320.col310_313 FROM public.table320",
          |   "INSERT INTO public.table320 (col310_311,col310_312,col310_313,col310_314,col310_315,col310_316,col310_317,col310_318,col310_319) VALUES ((-1287655962):::INT8,'01040000000A0000000101000000EC9F1878E9A2F841C172C41AFB37FCC10101000000C0E501EDF059F541B06ED8A7F4CBFFC1010100000080C53FF0BD3EE0C17EC43ABF36B0F8C1010100000018A3D041CD7FFF41C69F2906DE87FBC10101000000680D8572DFB6F041B815006307F3DB410101000000E082904DFEEDD6419627A9FF2E18F341010100000084100D3B2F6BEEC1DA2B90E3A8E5FCC1010100000096C3D3F8185CFBC1C0A49B4DD76EB0C10101000000947555471235F14160CFD3428070F8410101000000F84A438061F6EDC12094A1DBCE0BB741':::GEOMETRY,e'8i5E[\\x1fyr':::STRING:::NAME,2258609472:::OID,(-0.6953754425048828):::FLOAT8,':':::STRING:::NAME,'':::STRING,3921997372:::OID,'\\x96':::BYTES),(NULL,'0101000000B064FBDCA288D041EC7AA9A9ACAFF7C1':::GEOMETRY,'x51J':::STRING:::NAME,400274388:::OID,'+Inf':::FLOAT8,e'B\\r':::STRING:::NAME,'':::STRING,NULL,'\\xc825798be0b9387cd2':::BYTES)",
          |   "ALTER TABLE public.table349 RENAME TO public.table399"
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2808064&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@da3c3dcccd18129bcd963eeca66bc063fc8b9756:

          |   "BEGIN",
          |   "CREATE TABLE public.table209 (col209_210 BOX2D NULL, col209_211 INTERVAL NULL, col209_212 REGCLASS, col209_213 TIMESTAMP, col209_214 GEOMETRY, col209_215 REGNAMESPACE NULL, col209_216 TIMESTAMPTZ, col209_217 TIME NOT NULL, col209_218 TIME NOT NULL, col209_219 JSONB, col209_220 UUID NULL, col209_221 STRING NOT NULL AS (lower(CAST(col209_214 AS STRING))) STORED, col209_222 STRING NOT NULL AS (IF(col209_216 IS NULL, e'\\x19_B\\rGs':::STRING, '|T':::STRING)) STORED, col209_223 STRING NULL AS (lower(CAST(col209_214 AS STRING))) STORED, col209_224 STRING NOT NULL AS (lower(CAST(col209_212 AS STRING))) VIRTUAL, col209_225 STRING NOT NULL AS (lower(CAST(col209_219 AS STRING))) STORED, col209_226 STRING AS (IF(col209_216 IS NULL, e'\\x00':::STRING, e'\\x02z+':::STRING)) VIRTUAL, INDEX (col209_211 ASC), INDEX (col209_212 ASC) STORING (col209_210, col209_213, col209_216, col209_217, col209_218, col209_219, col209_220, col209_223, col209_225), INDEX (col209_223, col209_210, col209_222 DESC, col209_220 ASC) STORING (col209_211, col209_212, col209_213, col209_214, col209_215, col209_225), UNIQUE (col209_221 DESC, col209_216))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=885aa6fa key=/Table/SystemConfigSpan/Start pri=0.00267467 epo=0 ts=1616656203.707047579,1 min=1616656203.394620447,0 seq=7} lock=true stat=PENDING rts=1616656203.394620447,0 wto=false gul=1616656203.894620447,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:03.327498",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema165 AUTHORIZATION root",
          |   "ALTER TABLE public.table227 ALTER COLUMN IrrelevantColumnName SET DATA TYPE IrrelevantDataType"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table227\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:03.56912",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq185",
          |   "CREATE TYPE public.enum229 AS ENUM ('sfsdsf', 'a', 'afas')",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:03.803713",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema179 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2812323&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@f602e37e31a256980ae897917f45cba9c135b412:

          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema259.table262 RENAME TO schema259.table285",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=9a2b4625 key=/Table/SystemConfigSpan/Start pri=0.00479426 epo=0 ts=1616741710.331294635,1 min=1616741710.171099809,0 seq=12} lock=true stat=PENDING rts=1616741710.171099809,0 wto=false gul=1616741710.671099809,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:55:09.802713",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq287",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=bc44a828 key=/Table/SystemConfigSpan/Start pri=0.04125452 epo=0 ts=1616741710.331294635,1 min=1616741709.802648848,0 seq=8} lock=true stat=PENDING rts=1616741709.802648848,0 wto=false gul=1616741710.302648848,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:55:09.974019",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "ALTER TABLE schema259.table262 DROP COLUMN \"col262_270\""
          |  ],
          |  "expectedExecErrors": "42P10",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col262_270\" is referenced by the primary key (SQLSTATE 42P10)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:55:10.264532",
          |  "ops": [
          |   "BEGIN",
          |   "INSERT INTO schema259.table262 (col262_263,col262_264,col262_265,col262_266,col262_267,col262_268,col262_269,col262_270,col262_271,col262_272,col262_273,col262_274,col262_275,col262_276,col262_277,col262_278,col262_279) VALUES ((-1739363772):::INT8,2993138793:::OID,3454640954:::OID,'Rk':::STRING:::NAME,'BOX(-1.978100616404923 0.08772774250892912,0.022218248368443883 0.4862626735011346)':::BOX2D,3733657704:::OID,B'111101111101100101000101110101110',3260695288:::OID,(-50314.82610466199652):::DECIMAL,'43 years 2 mons 651 days 12:56:50.185075':::INTERVAL,'2014-06-12 06:18:51.000779+00:00':::TIMESTAMPTZ,'21:40:16.375556+08:18:00':::TIMETZ,e'\\x06\u003cT;(z':::STRING,e'\\'':::STRING,(-1858071240):::INT8,'':::STRING,'3a1f9658-8a49-4366-9ba0-42f545ed3438':::UUID),(2147483647:::INT8,2526589080:::OID,1374056751:::OID,')':::STRING:::NAME,'BOX(-1.706658727266771 0.3430305641692044,-0.39850252895804533 1.0071889802708984)':::BOX2D,1621794473:::OID,B'100001101101000011000000100010010',4148186230:::OID,(-25359834576116378.72):::DECIMAL,'71 years 2 mons 42 days 00:55:59.914414':::INTERVAL,'2024-03-23 10:56:21.000785+00:00':::TIMESTAMPTZ,'11:20:15.965404+14:42:00':::TIMETZ,e'TgB)\\x06':::STRING,'Twb`':::STRING,(-2009333637):::INT8,'59i':::STRING,'ffffffff-ffff-ffff-ffff-ffffffffffff':::UUID)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col262_276\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2816384&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@9caf4f8d29ed00aa01188a081465d9061c5fea64:

          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:52:08.756147",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE SCHEMA schema47 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=67ddef60 key=/Table/SystemConfigSpan/Start pri=0.00005430 epo=0 ts=1616827929.244659009,1 min=1616827928.756093952,0 seq=6} lock=true stat=PENDING rts=1616827928.756093952,0 wto=false gul=1616827929.256093952,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:52:08.755531",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema3 AUTHORIZATION root",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:52:09.019686",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema38 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2819746&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@b886d8089334416b026391f2be76bc32e3a09b8a:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/scbench/randomload/nodes=3/ops=10000/conc=20/run_1
    schemachange_random_load.go:145,schemachange_random_load.go:80,test_runner.go:767: output in run_071421.488_n1_workload_run_schemachange: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2827485-1617084060-23-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned: exit status 20
        (1) attached stack trace
          -- stack trace:
          | main.(*cluster).RunE
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2332
          | main.runSchemaChangeRandomLoad
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:142
          | main.registerRandomLoadBenchSpec.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:80
          | main.(*testRunner).runTest.func2
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:767
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1374
        Wraps: (2) output in run_071421.488_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2827485-1617084060-23-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I210330 07:14:22.213769 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210330 07:14:22.324813 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 111.041958ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col193_203" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ```
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ```
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | er(CAST(col193_202 AS STRING))) STORED, col193_207 STRING AS (lower(CAST(col193_200 AS STRING))) STORED)",
          |   "ALTER TABLE public.table181 RENAME COLUMN \"col154_165\" TO \"col181_220\"",
          |   "SELECT 'validating all objects'",
          |   "INSERT INTO schema27.table193 (col193_194,col193_195,col193_196,col193_197,col193_198,col193_199,col193_200,col193_201,col193_202,col193_203,col193_204,col193_205,col193_206,col193_207) VALUES (e'\\x17':::STRING,(-1):::INT8,e'hQD\\x0e':::STRING,'94.133.206.38/19':::INET,0:::OID,858692797:::OID,'0105000020E61000000500000001020000000300000069D76FA4408950C0E0AB983F3C8842C0606B6592CF1517C050C068043CFD2040AC8395C9F367414098ABE87A97E43C40010200000007000000FDF28921F87763C06D280B26C14550C0BA26650857D45DC0432A15C3437752C02C3FD66417D04B403ABEA047B39C52C0F2E6347162866140AF16054E10EF53C084CA7A6EB0A9644010E844EE36B14CC0A8A102CE3073554010CBF3A6BD0641402032FA3C0BFA264000DDF2D42261DFBF01020000000400000000F66038E6C162C0D029433276A01F40EBFC81AF135066C0001D81C30D3D16C0A25281B29FB65DC091A98121A7BB53C0AC4EB53102276640E0FCC64FA2D017C00102000000020000003DF12A7634A250C03A1A334DF7A251406085CBDD1F2F3EC024BA1EF4B3B04540010200000009000000E0D6EC9092AE5740A70E6BA478EF55C00C9EF77DD9C94940800DBC30AA8A39C00C5D1570E77B5A4076A8B1C1093140C07CDDA6FDEB82654044F8131BEA4648406C7E4407E6624F4080FB22A3B6AC2F4060FD5BCEA5CA544020956C5560C93E40F0ACF0CBBC983440E0E9428DC3B307C02D07B27A06C75EC06085C401F9EE3140D668CE4C0D0860C040439E176833F2BF':::GEOGRAPHY,372469236:::OID,'-20 years -11 mons -148 days -24:02:17.282534':::INTERVAL,'X':::STRING,'_':::STRING,'h-U9':::STRING,e'3\\x1a':::STRING,'J\u003cS':::STRING),(e'\\x1b':::STRING,3770017338930926272:::INT8,e'n,J\\x1fQWP[':::STRING,'4eb4:fe30:8361:60d5:7d94:4c81:e2d0:e868/113':::INET,280420680:::OID,126181707:::OID,'0101000020E6100000FBD279F6209B62C071876483CB0F4BC0':::GEOGRAPHY,3536700712:::OID,'290 years':::INTERVAL,e'\\x16!/9\\x1e\\r':::STRING,e'\\x16\\x7fd8\\x13':::STRING,'':::STRING,e'\\x122!.\\x0b4':::STRING,e'!\u0026\\x17\\x04\\x11^I(':::STRING),('}':::STRING,(-7427941695458374796):::INT8,e'\\x1c:0WY$\\x121':::STRING,'ee1b:23bc:59ec:b6ba:95f2:342f:d53f:3feb/123':::INET,2484708600:::OID,0:::OID,'0106000020E61000000500000001030000000100000005000000A53EF56AAB7164C088342BC307B321C090720C84E64E5B40D6BC27C1EF1E43C09444198F488250402C329AECAFDD5040DA64BFB5557260C0C8474FFA5C195240A53EF56AAB7164C088342BC307B321C001030000000100000004000000284D9C39A2B365C07644E0BA44A248C0E81E938BE4705840001BB94920BD44C0A4857C92D4DD5940B0052DE9CEE740C0284D9C39A2B365C07644E0BA44A248C00103000000010000000D00000000EE1267857125C093D3055E8B4D41C098E660389BCB3C400F8EC3069CAF45C0AC8E5BF035074140967B4EA779C550C0A095E02F376A4640D85AFB72A75550C0C8FCE663E3B948407BBD9CE83A6343C03C36C64FA3A55C404F6D0C2AB24E43C0B88D1F55B7526340294B6996DEA744C03C829149E824564014E838DE3DA13CC084CA5EDDFD7E614040C686CF2B8DFB3F04465A8B6D544C409C2D25D45FB436C0908FBB27A72B324080706F062047E43F5DD11C1FDB0662C024F7AF8FC176344000EE1267857125C093D3055E8B4D41C001030000000100000007000000A4A248537C1F45C03F7BF25BD9C945C01858009EB172484014FBF143314149C0A42F419E8C7B55405E1A366262B14EC03ACFD043DA86604086361BAF7E00554048715F5963F648400433C3D7BDB4534018450BA31C3F66C04C85A316E25A5640A4A248537C1F45C03F7BF25BD9C945C00103000000010000000C00000036C95E2917145BC0B07B88F1853249C083F537F6CA995CC0CE4E5FCA827F53C0CFAE60E0F6E650C0AB7E5EE5C73640C00065BD58BEDB48C0C81447263D5132C062D85F5B15A863403FC71277B5D453C0CCFB9D60544D4D4090D312CEE6B3474048EE3F7EBF953D40CEF5DDE4EB2B5640F0C0141FDC6B30C0C4FC24A3D9CA4D401D2387B615D35AC0861D72F1EA245340DEAED544E29E5EC06418077B47A5534085BDBEA6B98061C0B890BE591E823F4036C95E2917145BC0B07B88F1853249C0':::GEOGRAPHY,1195235099:::OID,'-72 years -5 mons -127 days -17:36:43.577641':::INTERVAL,e'%\\x14\u003cr\\t,8:':::STRING,e'c\\x12\\x1b\\b':::STRING,'aE1H-$DC':::STRING,e'n\\x01':::STRING,'s\u003efU%':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col193_203\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2827485&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@e6d07fa0b8fb13c447805709e2eadcceb783d661:

          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | /SystemConfigSpan/Start pri=0.00510607 epo=0 ts=1617173983.210961664,1 min=1617173982.799072854,0 seq=9} lock=true stat=PENDING rts=1617173982.799072854,0 wto=false gul=1617173983.299072854,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:59:42.988943",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"schema98\" CASCADE",
          |   "SELECT 'validating all objects'",
          |   "DROP SCHEMA \"schema362\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unknown schema \"schema362\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:59:42.760388",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema98.enum317 AS ENUM ('fdddsd', 'ddssaa', 'a', 'f')",
          |   "ALTER TABLE public.table364 ALTER COLUMN IrrelevantColumnName DROP STORED"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table364\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:59:43.088876",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS schema226.table319 (col319_320 OID NOT NULL, col319_321 FLOAT8 NOT NULL, col319_322 BYTES, col319_323 DATE NOT NULL, col319_324 BIT(8) NOT NULL, col319_325 UUID NULL, col319_326 TIMETZ, col319_327 REGCLASS NOT NULL, col319_328 GEOGRAPHY NOT NULL, col319_329 REGTYPE, col319_330 DECIMAL, col319_331 FLOAT4 NOT NULL, col319_332 REGPROCEDURE NULL, PRIMARY KEY (col319_327 ASC, col319_323 ASC, col319_331 DESC, col319_321), col319_333 STRING NOT NULL AS (lower(CAST(col319_320 AS STRING))) STORED, col319_334 FLOAT8 NOT NULL AS (col319_321 + col319_331) VIRTUAL, col319_335 STRING NULL AS (lower(CAST(col319_323 AS STRING))) VIRTUAL, INDEX (col319_333, col319_326 DESC, col319_323), INDEX (col319_334 ASC, col319_325 ASC, col319_324, col319_333 DESC, col319_329, col319_327, col319_326, col319_332 DESC), INDEX (col319_320 ASC) STORING (col319_322, col319_326, col319_332, col319_333), UNIQUE (col319_326, col319_332, col319_334, col319_333, col319_325, col319_321, col319_330, col319_322 ASC, col319_331 ASC, col319_327 DESC), INDEX (col319_327 DESC, col319_333, col319_329 DESC), UNIQUE (col319_329, col319_320, col319_334 ASC, col319_335 ASC, col319_321 DESC, col319_326 DESC, col319_322, col319_327, col319_331, col319_325, col319_332 ASC, col319_333 DESC, col319_330))",
          |   "INSERT INTO schema226.table319 (col319_320,col319_321,col319_322,col319_323,col319_324,col319_325,col319_326,col319_327,col319_328,col319_329,col319_330,col319_331,col319_332,col319_333,col319_334,col319_335) VALUES (3594179647:::OID,0.0:::FLOAT8,'\\x22':::BYTES,'-infinity':::DATE,B'11010010','05b63d77-2237-4748-ba95-a355878027de':::UUID,'02:18:56.226611+01:14:00':::TIMETZ,1983697910:::OID,'0103000020E61000000100000004000000C49BD4E672B35B405451BD2EC54955C0BEC45F121EF160408C4C0486EAA44440BCADC1E3284E4240B04CCF3BFE1429C0C49BD4E672B35B405451BD2EC54955C0':::GEOGRAPHY,3450368338:::OID,(-1):::DECIMAL,1.5865356922149658:::FLOAT8,589659867:::OID,e'C\\x05`UQ':::STRING,0.926811671893632:::FLOAT8,e'%bs\\'Sc\\x13':::STRING),(4129213617:::OID,(-0.1095857887180482):::FLOAT8,'\\xda95aba05c0b':::BYTES,'1990-09-19':::DATE,B'11100100','b981b72f-1793-44b7-bc8c-94edfa459287':::UUID,'11:48:57.33567-13:18:00':::TIMETZ,3270303274:::OID,'0102000020E6100000060000001A6B6A484A656640C377FDF98B3756C0E4F4C4B3558259407035862429EB25C0307C24471716604080242FA5EB3801C0C09D510C12155F4038074DE685513740E2B3564D0F3561C00C148E2013325340BF9319D50C9964C056822FB608005040':::GEOGRAPHY,3215727477:::OID,2597737041677388457:::DECIMAL,0.3275173306465149:::FLOAT8,1122323729:::OID,e'\\bL':::STRING,(-0.23504552591192107):::FLOAT8,'Y=':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col319_333\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2832008&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@eaa839f1da532d5b0076e1d32d202b9f620008cd:

          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:56.619728",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:56.620578",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table5 (col5_6 STRING NULL, col5_7 BYTES NULL, col5_8 GEOMETRY NULL, col5_9 UUID NULL, col5_10 TIMESTAMP, col5_11 NAME, col5_12 TIMESTAMP NULL, col5_13 \"char\" NULL, col5_14 REGPROC NULL, col5_15 STRING NOT NULL AS (lower(CAST(col5_8 AS STRING))) STORED, col5_16 STRING NULL AS (IF(col5_7 IS NULL, e'A\u0026-\\x7fk':::STRING, e'N\u003eZ\\x1c':::STRING)) VIRTUAL, col5_17 STRING NULL AS (lower(CAST(col5_8 AS STRING))) STORED, col5_18 STRING NOT NULL AS (lower(CAST(col5_12 AS STRING))) VIRTUAL, col5_19 STRING NOT NULL AS (lower(CAST(col5_8 AS STRING))) VIRTUAL, col5_20 STRING AS (lower(CAST(col5_8 AS STRING))) STORED, col5_21 STRING NOT NULL AS (lower(col5_11)) VIRTUAL, col5_22 STRING NOT NULL AS (lower(CAST(col5_10 AS STRING))) STORED, UNIQUE (col5_12 DESC, col5_11 ASC, col5_13) STORING (col5_6, col5_10, col5_14, col5_17, col5_20), UNIQUE (col5_14, col5_6 DESC, col5_12, col5_22, col5_19, col5_9 DESC, col5_18 DESC, col5_20 ASC, col5_13 DESC, col5_10 ASC) STORING (col5_7, col5_11), UNIQUE (col5_6 DESC, col5_20 DESC, col5_7, col5_13 DESC, col5_9, col5_22 DESC, col5_10, col5_14 ASC, col5_19, col5_15, col5_12 DESC, col5_11 DESC), UNIQUE (col5_21, col5_14 DESC, col5_7, col5_20 ASC))",
          |   "SELECT 'validating all objects'",
          |   "CREATE SCHEMA schema28 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=44b7309c key=/Table/SystemConfigSpan/Start pri=0.02350304 epo=0 ts=1617347456.620761609,1 min=1617347456.620525224,0 seq=12} lock=true stat=ABORTED rts=1617347456.620525224,0 wto=false gul=1617347457.120525224,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:10:56.619699",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table48 (col48_49 BYTES, col48_50 REGPROC NOT NULL, col48_51 BIT(29) NOT NULL, col48_52 GEOMETRY NOT NULL, col48_53 REGCLASS, col48_54 REGTYPE NULL, col48_55 REGPROCEDURE NULL, col48_56 REGNAMESPACE, col48_57 STRING NULL AS (lower(CAST(col48_50 AS STRING))) VIRTUAL, UNIQUE (col48_57 DESC, col48_55 DESC), FAMILY (col48_55), FAMILY (col48_54), FAMILY (col48_50, col48_56, col48_53), FAMILY (col48_52, col48_49, col48_51))",
          |   "INSERT INTO public.table48 (col48_49,col48_50,col48_51,col48_52,col48_53,col48_54,col48_55,col48_56,col48_57) VALUES ('\\xd3fe3100':::BYTES,776725237:::OID,B'11010000000000101011001010111','01030000000100000005000000B6999F558054EEC1005A75FA33FD7FC120DDF962A4DCB0C16086C6EDA472D741E43D58231293F941C882AF568EBCFE418CCED093CA32F5C19C74AEFC024AFA41B6999F558054EEC1005A75FA33FD7FC1':::GEOMETRY,NULL,0:::OID,0:::OID,1403277526:::OID,e'wEM\\x05[\\x15':::STRING),('\\x':::BYTES,2805207768:::OID,B'00000100111111111000010001101','0101000000000000000000F87F000000000000F87F':::GEOMETRY,3126382105:::OID,212478021:::OID,1274315959:::OID,989949582:::OID,e'{\\'':::STRING),('\\xe29883':::BYTES,2992738222:::OID,B'01000010011011110001011001100','010100000050B8E746481CE84148E559B94A87F241':::GEOMETRY,0:::OID,0:::OID,3493657761:::OID,3119210099:::OID,NULL)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col48_57\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2841736&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@3fa241dd0d3aba2547e04ec5ef936315c0c5d3e1:

          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=60af2a44 key=/Table/SystemConfigSpan/Start pri=0.00658054 epo=0 ts=1617693348.353653145,1 min=1617693347.817220683,0 seq=22} lock=true stat=PENDING rts=1617693347.817220683,0 wto=false gul=1617693348.317220683,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:15:47.856792",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER SEQUENCE public.seq176 RENAME TO public.seq566",
          |   "SELECT 'validating all objects'",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=f02fa6ed key=/Table/SystemConfigSpan/Start pri=0.02935845 epo=0 ts=1617693347.917307038,1 min=1617693347.856729024,0 seq=12} lock=true stat=PENDING rts=1617693347.856729024,0 wto=false gul=1617693348.356729024,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:15:47.790482",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table551 (col551_552 REGPROC, col551_553 BYTES NOT NULL, col551_554 INTERVAL, col551_555 TIMESTAMPTZ, col551_556 REGCLASS NULL, col551_557 DECIMAL, col551_558 GEOGRAPHY, col551_559 FLOAT8 NOT NULL, col551_560 INT4, col551_561 INTERVAL, col551_562 TIMETZ, col551_563 GEOMETRY[], col551_564 BOOL, col551_565 DECIMAL NOT NULL AS (col551_557 + 502814296962731.62:::DECIMAL) STORED, INDEX (col551_565, col551_560 DESC, col551_557 ASC, col551_561, col551_559 DESC, col551_555, col551_564 DESC, col551_562 DESC), INDEX (col551_557 DESC, col551_564 DESC), INVERTED INDEX (col551_562, col551_556 ASC, col551_554 DESC, col551_561 DESC, col551_557 ASC, col551_559 DESC, col551_558 DESC))",
          |   "ALTER TABLE public.table551 ADD COLUMN col551_593 OID NOT NULL",
          |   "CREATE TYPE public.enum599 AS ENUM ('fsdff')",
          |   "CREATE TABLE public.table603 AS SELECT \"IrrelevantColumnName\" FROM public.table602"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table602\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:15:47.790351",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "CREATE TABLE IF NOT EXISTS public.table596 (col596_597 FLOAT8 NOT NULL, PRIMARY KEY (col596_597 ASC), INDEX (col596_597), UNIQUE (col596_597 DESC), UNIQUE (col596_597 ASC), INDEX (col596_597 ASC), UNIQUE (col596_597 DESC))",
          |   "INSERT INTO public.table596 (col596_597) VALUES (1.2085717158135205:::FLOAT8),((-0.022674217912548533):::FLOAT8),(0.9147376857021057:::FLOAT8)",
          |   "ALTER TABLE public.table596 RENAME TO public.table604"
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "***FAIL; Failed to receive an execution error when errors were expected",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2851154&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@f6904d0734d08d05ba929e8b542646981c0844d9:

          |  "workerId": 0,
          |  "clientTimestamp": "07:11:52.279567",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER INDEX public.table412@\"IrrelevantConstraintName\" RENAME TO \"OtherConstraintName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table412\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:11:52.397634",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema406 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=6af33ae6 key=/Table/SystemConfigSpan/Start pri=0.00318489 epo=0 ts=1617779512.671858002,1 min=1617779512.397552106,0 seq=6} lock=true stat=PENDING rts=1617779512.397552106,0 wto=false gul=1617779512.897552106,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:11:52.060587",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq410 OWNED BY public.table337.col337_414"
          |  ],
          |  "expectedExecErrors": "42703",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col337_414\" does not exist (SQLSTATE 42703)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:11:52.375798",
          |  "ops": [
          |   "BEGIN",
          |   "INSERT INTO public.table337 (col337_338,col337_339,col337_340,col337_341,col337_342,col337_343,col337_344,col337_345,col337_346,col337_347,col337_348,col337_349,col337_350,col337_351,col337_352,col337_353) VALUES ('60143d69-f450-4a35-b525-ce615cf87ae1':::UUID,B'010',0:::OID,e'\\x18':::STRING,'22:00:17.252617+10:51:00':::TIMETZ,1.981285329364351:::FLOAT8,551653356:::OID,3882492313:::OID,'ffff:ffff:ffff:ffff:ffff:ffff:ffff:ffff':::INET,642320760:::INT8,(-0.6096291219794445):::FLOAT8,'0101000020E610000060E807C302984F40E6534482E8E35440':::GEOGRAPHY,e'\\x16':::STRING,'2021-03-23 16:55:40.000022+00:00':::TIMESTAMPTZ,'ccw':::STRING,0.04942731036381631:::FLOAT8),('54c60be9-aa30-4a4e-a76f-d00864b569f7':::UUID,B'111',0:::OID,e'\\x1f':::STRING,'06:58:26.420332+06:17:00':::TIMETZ,(-0.6826537023767099):::FLOAT8,0:::OID,202391797:::OID,'246.141.201.16/6':::INET,499166865:::INT8,NULL,'0103000020E6100000020000000500000000000000000000000000000000000000000000000000F03F0000000000000000000000000000F03F000000000000F03F0000000000000000000000000000F03F00000000000000000000000000000000050000009A9999999999C93F9A9999999999C93F9A9999999999C93F9A9999999999D93F9A9999999999D93F9A9999999999D93F9A9999999999D93F9A9999999999C93F9A9999999999C93F9A9999999999C93F':::GEOGRAPHY,e'\u003e\\x0bC)':::STRING,'1989-01-15 18:14:39.00025+00:00':::TIMESTAMPTZ,'d+':::STRING,'-Inf':::FLOAT8)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col337_353\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2855015&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@389cbd4be0e9ce22ca7789cd61802f1f90392c97:

          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table111\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
          |     1.0s        0           36.3           40.0      9.4     88.1    192.9    192.9 opOk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:53:20.486519",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE IF EXISTS schema1.seq69",
          |   "CREATE TYPE public.enum109 AS ENUM ('sds', 'dds', 'fa', 'ssdafd', 'fddsa', 'asf')",
          |   "CREATE TABLE IF NOT EXISTS schema1.table112 (col112_113 BYTES NULL, col112_114 UUID NOT NULL, col112_115 \"char\" NOT NULL, col112_116 OID NOT NULL, col112_117 BYTES NULL, col112_118 BOOL NOT NULL, col112_119 UUID NOT NULL, col112_120 REGPROCEDURE NOT NULL, col112_121 DATE NOT NULL, col112_122 INT2 NOT NULL, PRIMARY KEY (col112_122, col112_119 DESC, col112_118 DESC, col112_115 DESC, col112_116 DESC, col112_120 ASC, col112_114), col112_123 STRING NOT NULL AS (lower(CAST(col112_116 AS STRING))) STORED, col112_124 STRING NOT NULL AS (CASE WHEN col112_113 IS NULL THEN '':::STRING ELSE e'\\\\Gs\\x0e':::STRING END) VIRTUAL, col112_125 STRING AS (lower(CAST(col112_116 AS STRING))) STORED, col112_126 STRING NULL AS (lower(CAST(col112_119 AS STRING))) VIRTUAL, col112_127 STRING NULL AS (lower(CAST(col112_121 AS STRING))) STORED, col112_128 STRING NULL AS (lower(CAST(col112_118 AS STRING))) STORED, col112_129 STRING NOT NULL AS (lower(CAST(col112_118 AS STRING))) STORED, col112_130 STRING NULL AS (lower(CAST(col112_116 AS STRING))) VIRTUAL, INDEX (col112_121 DESC, col112_127, col112_115, col112_129 ASC, col112_114 ASC, col112_130 DESC, col112_125 ASC, col112_119, col112_126 DESC, col112_118 DESC, col112_117, col112_124 ASC, col112_116 DESC, col112_122) STORING (col112_128), INDEX (col112_115, col112_113 DESC, col112_118 ASC, col112_119 DESC, col112_117, col112_114 ASC, col112_126 ASC, col112_124 ASC, col112_122 DESC) STORING (col112_129), INDEX (col112_113 ASC, col112_125 DESC, col112_127 DESC, col112_115 DESC, col112_122 ASC, col112_120 ASC, col112_130, col112_124) STORING (col112_117, col112_123, col112_129))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=18ccbf0f key=/Table/SystemConfigSpan/Start pri=0.00397051 epo=0 ts=1617864800.969759466,1 min=1617864800.486441320,0 seq=27} lock=true stat=PENDING rts=1617864800.486441320,0 wto=false gul=1617864800.986441320,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          |     1.0s        0            7.3            8.0    335.5    486.5    486.5    486.5 txnCmtErr
          |     1.0s        0            3.6            4.0    251.7    637.5    637.5    637.5 txnOk
          |     1.0s        0           20.8           23.0      3.4    268.4    453.0    453.0 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:53:20.750259",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"schema1\" CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=efeb91a6 key=/Table/SystemConfigSpan/Start pri=0.00904645 epo=0 ts=1617864801.171783398,1 min=1617864800.750185467,0 seq=7} lock=true stat=ABORTED rts=1617864800.750185467,0 wto=false gul=1617864801.250185467,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:53:20.611618",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema33 AUTHORIZATION root",
          |   "DROP SEQUENCE schema1.seq69"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2859883&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@80709778b7c7de7b2b704972197022305bb3ca12:

          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:10:23.138699",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema211 AUTHORIZATION root",
          |   "CREATE TABLE IF NOT EXISTS public.table239 (col239_240 BYTES NOT NULL, col239_241 FLOAT4 NOT NULL, col239_242 FLOAT4 NULL, col239_243 STRING NOT NULL, col239_244 REGTYPE NOT NULL, col239_245 TIMESTAMP NOT NULL, col239_246 \"char\" NOT NULL, PRIMARY KEY (col239_245 DESC, col239_246, col239_240 ASC), col239_247 FLOAT4 NULL AS (col239_242 + col239_241) VIRTUAL, col239_248 FLOAT4 NULL AS (col239_242 + col239_241) VIRTUAL, col239_249 FLOAT4 NOT NULL AS (col239_241 + col239_242) VIRTUAL, UNIQUE (col239_240, col239_241 ASC, col239_246 DESC, col239_242 DESC), UNIQUE (col239_244 ASC, col239_245 DESC, col239_248, col239_242, col239_247 ASC), FAMILY (col239_245, col239_240, col239_246), FAMILY (col239_243), FAMILY (col239_241, col239_242), FAMILY (col239_244))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=ddd03556 key=/Table/SystemConfigSpan/Start pri=0.02728524 epo=0 ts=1617912623.784579340,1 min=1617912623.138633762,0 seq=20} lock=true stat=PENDING rts=1617912623.138633762,0 wto=false gul=1617912623.638633762,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          |     2.0s        0           39.0           40.5      6.6    604.0    671.1    671.1 opOk
          |     2.0s        0            5.7            6.0    738.2   1140.9   1342.2   1342.2 txnCmtErr
          |     2.0s        0            2.0            2.0    637.5   1409.3   1409.3   1409.3 txnOk
          |     2.0s        0           12.0           19.0      2.4     12.6     14.7     14.7 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:10:23.352438",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum195 AS ENUM ('fffa', 'dadda', 'dffa', 'fffdf', 'safaa')",
          |   "SELECT 'validating all objects'",
          |   "CREATE SCHEMA schema213 AUTHORIZATION root",
          |   "DROP SCHEMA \"schema1\" CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=e82b0996 key=/Table/SystemConfigSpan/Start pri=0.00008713 epo=0 ts=1617912623.874854326,1 min=1617912623.352369117,0 seq=22} lock=true stat=ABORTED rts=1617912623.352369117,0 wto=false gul=1617912623.852369117,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:10:22.839087",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema234 AUTHORIZATION root",
          |   "CREATE TYPE schema234.enum253 AS ENUM ('fsfff', 'ddd')"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2862820&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@69122e0b458d473d62a7bf3e3b8dbb40162fc005:

          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:54:10.507036",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "ALTER TABLE public.table67 ALTER COLUMN \"IrrelevantColumnName\" DROP NOT NULL"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table67\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:54:10.505102",
          |  "ops": [
          |   "BEGIN",
          |   "DROP TABLE IF EXISTS public.table55 RESTRICT",
          |   "CREATE TABLE IF NOT EXISTS public.table68 (col68_69 GEOGRAPHY NOT NULL, col68_70 FLOAT4 NOT NULL, col68_71 TIME NOT NULL, col68_72 REGPROC NULL, PRIMARY KEY (col68_70 ASC, col68_71), UNIQUE (col68_70 DESC, col68_71 DESC, col68_72 DESC), INVERTED INDEX (col68_72 DESC, col68_71 DESC, col68_70, col68_69 DESC), INDEX (col68_70 ASC), INDEX (col68_71 ASC, col68_70 ASC) STORING (col68_72), FAMILY (col68_70), FAMILY (col68_69, col68_71), FAMILY (col68_72))",
          |   "DROP SEQUENCE public.seq73"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.seq73\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:54:10.722524",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema37 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2867198&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-release-20.2](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-release-20.2) [release-blocker](https://api.github.com/repos/cockroachdb/cockroach/labels/release-blocker) - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@5323c44e1c3d3d9ded95a9f20be5ba738cd542ec:

          |   "SELECT 'validating all objects'",
          |   "CREATE TABLE public.table224 (col224_225 REGNAMESPACE NOT NULL, col224_226 BYTES, col224_227 OID NULL, col224_228 DATE NULL, col224_229 BOX2D NOT NULL, PRIMARY KEY (col224_229 DESC), INDEX (col224_228 DESC, col224_227, col224_226 ASC, col224_229 ASC, col224_225 DESC), UNIQUE (col224_228, col224_226 ASC, col224_225))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=dfac9ae2 key=/Table/SystemConfigSpan/Start pri=0.01439904 epo=0 ts=1618084652.281437509,1 min=1618084651.607437531,0 seq=7} lock=true stat=PENDING rts=1618084651.607437531,0 wto=false gul=1618084652.107437531,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:57:31.893463",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "ALTER TABLE public.table261 RENAME COLUMN \"IrrelevantColumnName\" TO \"OtherIrrelevantName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table261\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:57:31.848486",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE INDEX \"IrrelevantName\" ON public.table259 (\"IrrelevantColumn\" ASC)"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table259\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:57:32.095745",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema230 AUTHORIZATION root",
          |   "CREATE SCHEMA IF NOT EXISTS schema240 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2870055&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-release-20.2](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-release-20.2) [release-blocker](https://api.github.com/repos/cockroachdb/cockroach/labels/release-blocker) - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@8f66611a35da94ccdd98103dc7e7f3b694c3e8f2:

          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table131\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:56:36.045376",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum120 AS ENUM ('ssddf', 'daf')",
          |   "CREATE TYPE public.enum132 AS ENUM ('ad', 'sdfad', 'a', 'ddd', 'dsfds', 'fd')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=0c85d242 key=/Table/SystemConfigSpan/Start pri=0.00434257 epo=0 ts=1618257396.178885888,1 min=1618257396.045305252,0 seq=18} lock=true stat=PENDING rts=1618257396.045305252,0 wto=false gul=1618257396.545305252,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:56:36.081899",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq130",
          |   "SELECT 'validating all objects'",
          |   "CREATE TABLE IF NOT EXISTS public.table135 (col135_136 BOX2D NOT NULL, PRIMARY KEY (col135_136 DESC), INDEX (col135_136 DESC))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=f79caa68 key=/Table/SystemConfigSpan/Start pri=0.00754083 epo=0 ts=1618257396.178885888,1 min=1618257396.081815077,0 seq=15} lock=true stat=PENDING rts=1618257396.081815077,0 wto=false gul=1618257396.581815077,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:56:35.647515",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE SCHEMA schema109 AUTHORIZATION root",
          |   "CREATE SCHEMA schema134 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2873213&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-release-20.2](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-release-20.2) [release-blocker](https://api.github.com/repos/cockroachdb/cockroach/labels/release-blocker) - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@458eda63dfb5e7091dbe75d647f48071018d5f59:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:06:57.909647",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"schema65\" CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=0ae32b41 key=/Table/SystemConfigSpan/Start pri=0.00338671 epo=0 ts=1618430818.805735058,1 min=1618430817.909582669,0 seq=7} lock=true stat=PENDING rts=1618430817.909582669,0 wto=false gul=1618430818.409582669,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:06:58.620979",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"schema179\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unknown schema \"schema179\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:06:57.957411",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema180 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=72b68a7a key=/Table/SystemConfigSpan/Start pri=0.00867522 epo=0 ts=1618430818.805735058,1 min=1618430817.957347208,0 seq=6} lock=true stat=PENDING rts=1618430817.957347208,0 wto=false gul=1618430818.457347208,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:06:58.544366",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema176 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2882941&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-63484](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-63484) - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-release-20.2](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-release-20.2) - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@0eb5ba6e6c433f57ed1851a0c160f7739e7a7725:

          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:80
          | main.(*testRunner).runTest.func2
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:767
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1374
        Wraps: (2) output in run_195740.216_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2903636-1618945277-23-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I210420 19:57:40.942175 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210420 19:57:41.063597 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 121.421167ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col62_78" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ```
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ```
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          |    16.0           18.0      5.5    453.0    486.5    486.5 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:57:41.263384",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:57:41.312416",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table62 (col62_63 REGCLASS NULL, col62_64 DECIMAL, col62_65 FLOAT8 NULL, col62_66 TIMESTAMPTZ NULL, col62_67 JSONB, col62_68 BYTES[] NOT NULL, col62_69 UUID, col62_70 INET NULL, col62_71 INTERVAL NULL, col62_72 NAME NOT NULL, col62_73 BYTES, col62_74 JSONB NOT NULL, col62_75 INT2, col62_76 DECIMAL NULL, col62_77 GEOMETRY, col62_78 STRING NOT NULL AS (lower(CAST(col62_77 AS STRING))) VIRTUAL, col62_79 DECIMAL AS (col62_64 + col62_76) STORED)",
          |   "INSERT INTO public.table62 (col62_63,col62_64,col62_65,col62_66,col62_67,col62_68,col62_69,col62_70,col62_71,col62_72,col62_73,col62_74,col62_75,col62_76,col62_77,col62_78,col62_79) VALUES (527973076:::OID,(-7751474.267277549672):::DECIMAL,1.4653370962364056:::FLOAT8,'1986-11-28 00:50:41.000646+00:00':::TIMESTAMPTZ,'null':::JSONB,ARRAY['\\x00':::BYTES,'\\x6618c52deca3':::BYTES,'\\x583870538e2543ba':::BYTES,'\\x':::BYTES],'e8052184-6165-4d1e-b7d0-32645ef45c1b':::UUID,'234.228.43.155/5':::INET,'51 years 7 mons 935 days 17:27:36.579707':::INTERVAL,'X':::STRING,'\\xb56bf97e553f189722':::BYTES,e'{\"\\\\\\\\!/{{5Gb4aS+\": {}, \"b5WLi.w{3\": {\")!E{\": [[]], \"a\": {\"b\": {}}, \"baz\": []}, \"fPg L~j@Es=\": 0.18190642182840633, \"foo\": {\"c\": null}, \"foobar\": [\"c\", {\"MK9V,\": \"m)rd\"}, []]}':::JSONB,30502:::INT8,(-6.851195642171692581):::DECIMAL,'010200000003000000CA5A76880B40F641F089D1CCC36CFC41D8DBEEC0134CEF41D6B477C13FE8004220E07921CAFAF3C1F8C46DD0D112FD41':::GEOMETRY,e']\\x03\\x1a7Fytlz':::STRING,(-1.234E+401):::DECIMAL),(152837394:::OID,(-129666468809074.4187):::DECIMAL,0.4028528285972083:::FLOAT8,'1989-10-05 07:41:54.00062+00:00':::TIMESTAMPTZ,'{\"-bTGO\": [{\"c\": {}, \"rb+{Vt*\": {\"-k6t\": {}}}, {\"baz\": {}}], \"{9x6!!\": [\"a\", []]}':::JSONB,ARRAY['\\x5f265c19b4e4ceca':::BYTES],'c1efa017-6dff-4ec7-89e5-b976e5936bd9':::UUID,'64bd:a7d2:febf:6fdc:f21b:f16b:f6a2:b9ff/66':::INET,'56 years 8 mons 501 days 02:02:26.036879':::INTERVAL,e'\\'':::STRING,'\\x00':::BYTES,'[{\"c\": {}, \"foobar\": 0.26575941009926785}, [[false], {\"J\u0026 \": [], \"c\": 0.48092653477772984}, false], [], [\"b\"], {}, [null]]':::JSONB,(-10257):::INT8,10485361.68352403692:::DECIMAL,'0101000000B8BAE6EA40C7D9411D3257F70706F3C1':::GEOMETRY,e'!i\\x14\\x0b$':::STRING,(-20334876248493.59701):::DECIMAL),(1108848499:::OID,3.020765162717248822E+29:::DECIMAL,(-1.222145618271486):::FLOAT8,'1980-01-13 15:31:20.000589+00:00':::TIMESTAMPTZ,NULL,ARRAY['\\xb361baa808c4':::BYTES,'\\xdbfc0ed5d7':::BYTES,'\\x5deb':::BYTES],'e1ec68a6-c12d-4a7d-b35a-52833467c15e':::UUID,'f97b:c657:203f:4963:9775:e2b1:55ee:a464/107':::INET,'35 years 5 mons 746 days 21:20:48.777536':::INTERVAL,e'\\x11@ T':::STRING:::NAME,'\\x27':::BYTES,'[null, [[\"baz\", {}], 0.6604121348295738], true, 0.8026698644418409, {\"v58kEV \": []}, null]':::JSONB,14516:::INT8,(-0.2885506172478636573):::DECIMAL,'01040000000A00000001010000001CAB3544154CFC41C09FAE5E2A30F54101010000002C0A248F3840FCC1C06E0237E459FC410101000000441BB92C07F6F641C0617EF0CEB2B3410101000000C45C506F67980242FF7B04F6BEDCF3C101010000006E6174F88FE9F84150778B644624E6410101000000F6FDDCC1B789F24172382699031B02420101000000D415A42ACCA20142387CFD04C051F9C10101000000F00C226C15D6D2C1F89D730AD152D2C10101000000DA35023C8FD0F3411818F4257F30FCC101010000004A14C20AE387F44140ADAF695AA1EF41':::GEOMETRY,'3':::STRING,530910754579209.8742:::DECIMAL)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col62_78\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2903636&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-63484](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-63484) - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-release-20.2](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-release-20.2) - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@f3b14a95b781f57ac53a472b9979270b0ecbedfb:

          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | "
          |  ],
          |  "expectedExecErrors": "42703",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col32_176\" does not exist (SQLSTATE 42703)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:28:04.093562",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table32 ADD COLUMN col32_146 INT8 NULL",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=0d93b457 key=/Table/SystemConfigSpan/Start pri=0.02607955 epo=0 ts=1619036885.241227473,1 min=1619036884.093491532,0 seq=11} lock=true stat=PENDING rts=1619036884.093491532,0 wto=false gul=1619036884.593491532,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:28:04.84144",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE TABLE public.table157 (col157_158 INET NOT NULL, col157_159 BIT(12) NOT NULL, col157_160 INT2 NOT NULL, col157_161 TIMESTAMP NOT NULL, col157_162 REGPROC NULL, col157_163 FLOAT4, col157_164 BYTES, col157_165 REGPROC NOT NULL, col157_166 TIMESTAMP NOT NULL, col157_167 VARCHAR NOT NULL, PRIMARY KEY (col157_167 DESC, col157_161 DESC, col157_158 DESC, col157_159 DESC, col157_165, col157_166, col157_160 ASC), INDEX (col157_163 DESC, col157_161 DESC, col157_158 DESC, col157_159 ASC), UNIQUE (col157_158 DESC, col157_162, col157_163 ASC, col157_160 DESC, col157_165 DESC, col157_159 ASC, col157_167, col157_164), UNIQUE (col157_163, col157_159, col157_164 ASC, col157_162 DESC, col157_160 ASC, col157_165 DESC, col157_161 ASC, col157_166 DESC), INDEX (col157_165, col157_158, col157_167 ASC, col157_161 DESC, col157_166) STORING (col157_164), UNIQUE (col157_159 ASC), INDEX (col157_164 DESC, col157_166 ASC, col157_167 DESC, col157_158 DESC, col157_165, col157_161, col157_159 DESC) STORING (col157_163), INDEX (col157_166) STORING (col157_162), INDEX (col157_158 DESC, col157_159 ASC, col157_167, col157_163 ASC, col157_164 ASC, col157_162 ASC, col157_161 DESC), UNIQUE (col157_162 ASC, col157_165 ASC, col157_164 DESC, col157_160, col157_166 DESC, col157_163 DESC, col157_161, col157_159 ASC), FAMILY (col157_163), FAMILY (col157_165), FAMILY (col157_167), FAMILY (col157_159, col157_166), FAMILY (col157_160, col157_162, col157_161, col157_164, col157_158))",
          |   "INSERT INTO public.table32 (col32_33,col32_34,col32_35,col32_36,col32_37,col32_41,col32_45) VALUES (e';\u003cR\\bvByC':::STRING,'d293fc33-105f-45c5-b402-acc4fed3aa9f':::UUID,'-61 years -4 mons -642 days -15:37:39.59694':::INTERVAL,e'0\\n/E':::STRING,3218614316:::OID,'2000-11-25 20:28:20.000693+00:00':::TIMESTAMPTZ,'09:33:56.582563-03:32:00':::TIMETZ),('':::STRING,'d9a4e927-f44e-4dcc-a923-7d1ed34d9480':::UUID,'18 years 5 mons 117 days 10:18:32.383473':::INTERVAL,e'\\x13\\x7fk\\r':::STRING,1825133981:::OID,'0001-01-01 00:00:00+00:00':::TIMESTAMPTZ,'08:23:17.149961-00:09:00':::TIMETZ)",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=a21fc81e key=/Table/SystemConfigSpan/Start pri=0.04341886 epo=0 ts=1619036885.241227473,2 min=1619036884.841370023,0 seq=27} lock=true stat=PENDING rts=1619036884.841370023,0 wto=false gul=1619036885.341370023,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:28:05.359028",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema174 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2907612&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-63484](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-63484) - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-release-20.2](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-release-20.2) - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@affd857ffc05591f5898701690b8a9136859ab1b:

          |  "clientTimestamp": "20:09:16.951699",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SEQUENCE public.seq305",
          |   "ALTER TABLE public.table334 ALTER COLUMN \"col334_337\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "42611",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col334_337\" is not a computed column (SQLSTATE 42611)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:09:16.733946",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table334 RENAME TO schema298.table398"
          |  ],
          |  "expectedExecErrors": "42602",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot change schema of table with RENAME (SQLSTATE 42602)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:09:16.455479",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE VIEW public.view419 AS SELECT public.table334.col334_335, public.table334.col334_340, public.table334.col334_343, public.table334.col334_338, public.table334.col334_336, public.table334.col334_335, public.table334.col334_343, public.table334.col334_341, public.table334.col334_342, public.table334.col334_339, public.table334.col334_340, public.table334.col334_343, public.table334.col334_338, public.table334.col334_341, public.table334.col334_337 FROM public.table334, public.table334, public.table334"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table334\" specified more than once (missing AS clause) (SQLSTATE 42712)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:09:16.934346",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table367 (col367_368 INT4 NULL, col367_369 DATE NULL, col367_370 FLOAT4, col367_371 GEOGRAPHY NULL, col367_372 DATE NULL, col367_373 DATE NOT NULL, col367_374 INT8 NULL, col367_375 REGPROCEDURE NULL, col367_376 REGPROCEDURE, col367_377 BYTES NOT NULL, PRIMARY KEY (col367_377 DESC), col367_378 STRING NOT NULL AS (lower(CAST(col367_375 AS STRING))) VIRTUAL, col367_379 STRING NULL AS (CASE WHEN col367_377 IS NULL THEN NULL ELSE '':::STRING END) STORED, col367_380 INT4 NOT NULL AS (col367_368 + (-1032835251):::INT8) VIRTUAL, col367_381 INT8 NULL AS (col367_374 + col367_368) VIRTUAL, col367_382 INT4 NULL AS (col367_368 + (-138851439):::INT8) VIRTUAL, col367_383 FLOAT4 NOT NULL AS (col367_370 + (-1.3348156213760376):::FLOAT8) VIRTUAL, col367_384 STRING NULL AS (lower(CAST(col367_371 AS STRING))) STORED, col367_385 INT8 NOT NULL AS (col367_374 + col367_368) VIRTUAL, col367_386 INT4 AS (col367_368 + col367_374) STORED, FAMILY (col367_369, col367_386, col367_368), FAMILY (col367_372), FAMILY (col367_375), FAMILY (col367_377), FAMILY (col367_384), FAMILY (col367_373), FAMILY (col367_376), FAMILY (col367_374), FAMILY (col367_371, col367_379), FAMILY (col367_370))",
          |   "ALTER TABLE public.table367 DROP COLUMN \"col367_374\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"col367_374\" is referenced by computed column \"col367_381\" (SQLSTATE 42P10)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2921836&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-63484](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-63484) - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-release-20.2](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-release-20.2) - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

(roachtest).scbench/randomload/nodes=3/ops=10000/conc=20 failed on release-21.1@3447b13373c947d4b70d33dacc3eda7e5c15e753:

          |  "ops": [
          |   "BEGIN",
          |   "CREATE VIEW public.view405 AS SELECT public.table288.col288_293, public.table288.col288_290, public.table288.col288_294, public.table288.col288_291, public.table288.col288_289, public.table288.col288_296, public.table288.col288_295, public.table288.col288_294, public.table288.col288_290, public.table288.col288_296, public.table288.col288_291, public.table288.col288_292, public.table288.col288_289, public.table288.col288_293 FROM public.table288, public.table288"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table288\" specified more than once (missing AS clause) (SQLSTATE 42712)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:57:32.451941",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table288 ALTER COLUMN \"col288_296\" DROP DEFAULT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=222e9ba6 key=/Table/SystemConfigSpan/Start pri=0.02536741 epo=0 ts=1619467052.700663429,1 min=1619467052.451864309,0 seq=5} lock=true stat=ABORTED rts=1619467052.451864309,0 wto=false gul=1619467052.951864309,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:57:32.139231",
          |  "ops": [
          |   "BEGIN",
          |   "INSERT INTO public.table288 (col288_289,col288_290,col288_291,col288_292,col288_293,col288_294,col288_295,col288_296) VALUES ('-79 years -11 mons -762 days -23:11:12.895309':::INTERVAL,ARRAY['17:34:55.358131':::TIME,'12:16:22.621823':::TIME,'12:15:08.79398':::TIME],NULL,3596358579:::OID,'1986-11-27':::DATE,'/':::STRING,3630609528:::OID,1402967118:::OID)",
          |   "CREATE TABLE public.table411 AS SELECT public.table288.col288_294, public.table288.col288_296, public.table288.col288_293, public.table288.col288_292, public.table288.col288_289, public.table288.col288_291, public.table288.col288_291, public.table288.col288_290, public.table288.col288_295, public.table288.col288_296, public.table288.col288_294, public.table288.col288_294, public.table288.col288_291, public.table288.col288_292, public.table288.col288_296 FROM public.table288, public.table288, public.table288"
          |  ],
          |  "expectedExecErrors": "0A000,42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table288\" specified more than once (missing AS clause) (SQLSTATE 42712)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:57:32.680129",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table288 ADD CONSTRAINT table288_col288_293_unique UNIQUE (col288_293)",
          |   "CREATE SCHEMA schema401 AUTHORIZATION root",
          |   "ALTER TABLE public.table288 ALTER COLUMN \"col288_289\" SET NOT NULL"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: [/scbench/randomload/nodes=3/ops=10000/conc=20](https://teamcity.cockroachdb.com/viewLog.html?buildId=2924753&tab=artifacts#/scbench/randomload/nodes=3/ops=10000/conc=20) Related: - #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-63484](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-63484) - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-release-20.2](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-release-20.2) - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure](https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure) [O-roachtest](https://api.github.com/repos/cockroachdb/cockroach/labels/O-roachtest) [O-robot](https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot) [branch-master](https://api.github.com/repos/cockroachdb/cockroach/labels/branch-master) [See this test on roachdash](https://roachdash.crdb.dev/?filter=status%3Aopen+t%3A.%2Ascbench%2Frandomload%2Fnodes%3D3%2Fops%3D10000%2Fconc%3D20.%2A&sort=title&restgroup=false&display=lastcommented+project) powered by [pkg/cmd/internal/issues](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 44a4b10cabb511842a9fe30285b9f7d1041870a1:

          |  "workerId": 0,
          |  "clientTimestamp": "19:59:17.749345",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table262 ALTER COLUMN \"IrrelevantColumnName\" DROP NOT NULL"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table262\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:59:18.331809",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq260",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=ee532d9c key=/Table/SystemConfigSpan/Start pri=0.00498323 epo=0 ts=1619553558.498196159,1 min=1619553558.331751517,0 seq=8} lock=true stat=PENDING rts=1619553558.331751517,0 wto=false gul=1619553558.831751517,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:59:17.970226",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE INDEX index220_266 ON public.table220 (col220_233 ASC, col220_230 ASC, col220_229 ASC, col220_224 ASC, col220_234 ASC, col220_227, col220_221 DESC, col220_235 ASC, col220_231 ASC, col220_223 ASC, col220_222 DESC, col220_225 ASC, col220_226)"
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: column col220_233 is of type geometry and thus is not indexable (SQLSTATE 0A000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:59:18.570916",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema265 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 654f6311c0b3d6f172a0ecc49c7e37340ad1f9e8:

          |   "CREATE TABLE public.table75 (col75_76 GEOMETRY, col75_77 REGTYPE NOT NULL, col75_78 UUID NOT NULL, col75_79 FLOAT4 NULL, col75_80 INET NULL, col75_81 DATE NOT NULL, col75_82 INT8 NOT NULL, col75_83 GEOMETRY[] NOT NULL, col75_84 TIMESTAMP NOT NULL, col75_85 VARCHAR NOT NULL, col75_86 GEOGRAPHY, col75_87 FLOAT4 NULL, PRIMARY KEY (col75_85 ASC, col75_77, col75_84 DESC), INDEX (col75_78, col75_77 DESC), INDEX (col75_81 ASC, col75_82 DESC, col75_80) STORING (col75_78, col75_79, col75_83, col75_86, col75_87), INDEX (col75_82 ASC, col75_80 DESC), FAMILY (col75_80, col75_77), FAMILY (col75_81, col75_82, col75_83, col75_87, col75_85, col75_86), FAMILY (col75_76, col75_84), FAMILY (col75_79), FAMILY (col75_78))",
          |   "ALTER TABLE public.table75 ALTER COLUMN \"col75_78\" DROP DEFAULT",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:02:32.268634",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema1.table55 ALTER COLUMN col55_56 SET DEFAULT '2005-01-06 14:28:23.000716+00:00':::TIMESTAMPTZ",
          |   "CREATE TYPE schema1.enum93 AS ENUM ('df', 'ad')",
          |   "ALTER TABLE schema1.table55 ALTER COLUMN \"col55_56\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "42611",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col55_56\" is not a computed column (SQLSTATE 42611)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:02:32.611037",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema1.table74 DROP CONSTRAINT IrrelevantConstraintName"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema1.table74\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:02:32.415868",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema1.table55 RENAME TO schema1.table68",
          |   "INSERT INTO schema1.table68 (col55_56,col55_57,col55_58,col55_59) VALUES ('-2000-01-01 00:00:00+00:00':::TIMESTAMPTZ,0.08150264142000574:::FLOAT8,'1984-07-26':::DATE,e';4\\x0e':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col55_59\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 2fb7b6a9af22779a20e3354e81dc90d5270b641f:

          |  "clientTimestamp": "20:00:00.394424",
          |  "ops": [
          |   "BEGIN",
          |   "DROP TABLE IF EXISTS public.table36",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=3af269f2 key=/Table/SystemConfigSpan/Start pri=0.01163450 epo=0 ts=1619812801.272365463,1 min=1619812800.394346767,0 seq=11} lock=true stat=PENDING rts=1619812800.394346767,0 wto=false gul=1619812800.894346767,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:00:00.588684",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table36 RENAME TO public.table72",
          |   "DROP SCHEMA \"schema8\" CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=932990e2 key=/Table/SystemConfigSpan/Start pri=0.03110790 epo=0 ts=1619812801.455608938,1 min=1619812800.588601726,0 seq=19} lock=true stat=PENDING rts=1619812800.588601726,0 wto=false gul=1619812801.088601726,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:00:01.202108",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table118 AS SELECT public.table36.col36_37, public.table36.col36_49, public.table36.col36_44, public.table36.col36_48, public.table36.col36_52, public.table36.col36_46, public.table36.col36_40, public.table36.col36_53 FROM public.table36, public.table36"
          |  ],
          |  "expectedExecErrors": "42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table36\" specified more than once (missing AS clause) (SQLSTATE 42712)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:00:00.966613",
          |  "ops": [
          |   "BEGIN",
          |   "INSERT INTO public.table36 (col36_37,col36_38,col36_39,col36_40,col36_41,col36_42,col36_43,col36_44,col36_45,col36_46,col36_47,col36_48,col36_49,col36_50,col36_51,col36_52,col36_53) VALUES (966282958:::OID,0.28940242528915405:::FLOAT8,0.052714708656951936:::FLOAT8,false,14303:::INT8,2635662545:::OID,(-2.03170625695517):::FLOAT8,ARRAY['24:00:00-15:59:00':::TIMETZ,'18:55:20.701726-01:08:00':::TIMETZ],e'{\"baz\": \"s9]M\\\\\"\", \"foobar\": [{\"c\": {}}]}':::JSONB,'\\x':::BYTES,(-634652215):::INT8,(-62396012827.16558153):::DECIMAL,(-781912706):::INT8,NULL,(-920149465):::INT8,(-1778535468):::INT8,e'$v\\x1fej8l\\x17\\x1f':::STRING),(2863812042:::OID,(-0.10406526923179626):::FLOAT8,0.20675281505168597:::FLOAT8,false,11720:::INT8,1208827412:::OID,(-1.3039751460002305):::FLOAT8,ARRAY['19:59:21.740421+11:53:00':::TIMETZ],e'{\"\\\\\\\\q0$\": {}, \"j#W\u003e\u003ci4I(EG\": [[{\"Pb0H}\": {\"24 7E\\\\\"\\\\\"v9\": {}}, \"WJJ4t2\": [], \"{\\'tn\\\\\"KEh5(^8\": []}, true, []], [[[{}, {}], [], 0.7965509694105456, {}], []]]}':::JSONB,'\\xdc8e':::BYTES,(-1763019081):::INT8,1.258198687408050793E+20:::DECIMAL,NULL,561602558:::INT8,294137612:::INT8,342374916:::INT8,'\u003cYZ4Y':::STRING),(2583685438:::OID,(-0.20122173428535461):::FLOAT8,1.0170052838167472:::FLOAT8,true,127:::INT8,3188662719:::OID,1.5677474258251716:::FLOAT8,ARRAY['11:04:44.742275+07:24:00':::TIMETZ],'{\"Y,s}l``3\": {\"bar\": {\"}(*6X_T:%g\": {\"RrLePlr!hJ\": {}}}, \"c\": [[\"b\"]]}, \"b\": {\"bar\": [[]]}}':::JSONB,'\\x46f8e1389e':::BYTES,(-2082484848):::INT8,0:::DECIMAL,(-1823769178):::INT8,826639018:::INT8,(-214373961):::INT8,(-128):::INT8,e'gj\\x18\\x0413R':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col36_51\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ f05a57facec0c2c3f623977b90506b76f94771df:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/scbench/randomload/nodes=3/ops=10000/conc=20/run_1
    schemachange_random_load.go:145,schemachange_random_load.go:80,test_runner.go:767: output in run_195912.923_n1_workload_run_schemachange: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2945669-1620068819-23-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned: exit status 20
        (1) attached stack trace
          -- stack trace:
          | main.(*cluster).RunE
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2312
          | main.runSchemaChangeRandomLoad
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:142
          | main.registerRandomLoadBenchSpec.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:80
          | main.(*testRunner).runTest.func2
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:767
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1374
        Wraps: (2) output in run_195912.923_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2945669-1620068819-23-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I210503 19:59:13.644937 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210503 19:59:13.755916 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 110.97765ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col99_108" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | 1706A5207BA2DF641A08702CE1D79F5C1500B0326A1DDF041001143F53B30F4C170759D3B703EDB41':::GEOMETRY,649102253:::INT8,false,'72 years 2 mons 513 days 10:03:32.79851':::INTERVAL,'L':::STRING,e'\\x0653':::STRING),('\\xb5372bca5a80':::BYTES,'ad80e4b0-9d4d-4854-9c80-959867602c16':::UUID,'0107000020E6100000070000000106000020E610000001000000010300000001000000080000003467FADEEA264CC08DDD18B50A7748C0626D85B02B7566403014B26946EB54C04AFE2BF592476640046D6EBB5F6E50C05824D0A786A96140871CF6DA480E41C0F004A4068C363940949B5A1BE21F404040C37D75C8000BC0BC29513154253140EA0A9C10964E57C078E611C1431E28403467FADEEA264CC08DDD18B50A7748C00102000020E610000004000000007292E1C8A141402A50E2F142555440909A6BCA9A9B44C0C4A5D558E19B5040B0C19FE2A49646C06C6A5172470837404F3DE36DC45861C0109F4FCFE8E91F400104000020E61000000500000001010000000CB7B26C8F3E4FC0005CA6F96D18C5BF010100000070C45792CC2F2540D8240C5236D64640010100000090A1C66BB10D64402E4C4B3AB5C64EC00101000000AE9EE3E8E68D6040FCCF93B06C343B4001010000000060F34B940AAB3FA4A9E1CB480E31400101000020E6100000606C8792B3844540C05CA5234D4353C00101000020E6100000903795EB7DD93DC0BE29CF5D5FF454400103000020E6100000010000000700000080ACAD824B691AC0C05FF9A0E5BC20C008FDCB282D663340600B314264720DC03AAE548EEFD06440ABF2A79F097454C006A9E881437A504030D007D3107E1E40103CCCA7FED3554004D738FCBF553640496026D1341E65C0D4CA18F22F704C4080ACAD824B691AC0C05FF9A0E5BC20C00105000020E610000008000000010200000002000000F09F20FDF54C5040D86DEEC923D63040FCE432504BE95B4074A804B8047C4B40010200000002000000E962D3914A2350C03B0CA8ACD40352C0F8FA3297FEAF6440838D640FC9CA4EC0010200000005000000980C7A2C0A0534C0903E157EDB781EC064D5416BE87543C09681F0554DE843C0C87A5AEB6F4948404297144373AA55C0E85C2BAF9D346540C70AA1D1183956C0AC30A50B91B45D40D07F62F266B42BC0010200000003000000AAD990348A0F58C0E809905496BF55C074001E47E1DA5F40205FF8B286C003407850BA757F64574060B599623DE332400102000000060000004E16F4C735664DC0D88A92004C8620C0980D63D047DC58C00D6B43A5531B53C0BA5C9950BBC060401BEEC923135F4FC0322E0C07C7AC6040CC3737ED1DF93BC05CE232B8BE4E6140005042DE5728ADBFA0BFF105CCA764409662B70BA09755400102000000070000004854A4890D2041C0705859D7DCEF3CC0B804C158327836C0FE7C90EFF59451C0A67D42C4E03860403C0E145EC94B55C0823C22A15FF06540F11B7052EBCD54C054915086440B40C07C9A6CEDBA4D52406023D062EB711CC0F0A712EAC9C61BC0288AFF359B2D3AC0A0119CEF05D30A400102000000020000003ED264B91E4B6240F15E1F16177E42C08829D15DF607484050B60B7969743940010200000003000000A03AB235CF71644018AA392924ED3FC07A46EBD99B8A6040809DBB191E9CF13FBC3A27AAD1154F40683B31CC72D54940':::GEOGRAPHY,NULL,'01010000004045A1554438BBC1476D544F6519FFC1':::GEOMETRY,(-1690351125):::INT8,true,'-35 years -11 mons -881 days -11:07:48.49411':::INTERVAL,e'k3/(e\\x12T':::STRING,'':::STRING),('\\x9a2ff12ab418':::BYTES,'a33df6e3-6e36-4efe-9815-fde7ab6628d8':::UUID,'0101000020E6100000F4F68534660262402C50AC856E7C3A40':::GEOGRAPHY,ARRAY[false],'01050000000500000001020000000600000060C68D59D860BFC1900CC40DF08BE3C156CDDB552A25F6C1CD47C6E80A1EFFC11ABBBFF1C09801424B4CE338A5F9FCC1FA32C770B4F6F641B209AEA0A6CEEEC1064EC97CBB04F741F00B6012D4DDC8C1247C8B1927D5E641905F32857780FF41010200000008000000ECCECFE4EB54EEC1E0C84B07BD04D8C15AD1258A4130F9C13A11A18DDDD9ECC1ACA57DD97DD9ECC133775584BAEAF5C1A6F0579F031DE5C1AE774AE53A6502C2E8BD56E72332F7413899E088B4E401C2607ADD5D775DEE41348F0BCFE64BF541D40CB15FED4FEC41A6060FE25D48F941F47D9FED77C5F4415806BDF472EB014201020000000500000058DDFECA0BA7DF4196DC41BED934E8C1700021D1ACDDD1C1C800CEAA6C9EE54138C26CC1ACDEEDC190B191F73EB5F1410A5BE9F0D23CE0C1C015E2D008BAC541EC62DE7A835C01C288A1D15ED6CEFF41010200000002000000F44ECA75BCA8E541B887D95B06C9EF418C7E643D10FEDFC120F9B11CAC81CE4101020000000300000040DE87DBA6F2CBC1AC9F8327A42FFCC1B049B65B63D1CA41E08B99D958C3FAC1BC5D974A50F4FF41D886925D6A7402C2':::GEOMETRY,198647927:::INT8,true,'290 years':::INTERVAL,e' \u003cI``\\x05\\x1eH\\n':::STRING,e'tL\\x1334?/y\\x01':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col99_108\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ eb9e1a7c237edac6893141d6c8dc10f05a829861:

          |   "BEGIN",
          |   "ALTER TABLE schema9.table102 ADD CONSTRAINT IrrelevantConstraintName UNIQUE (IrrelevantColumnName)"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema9.table102\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:04:11.912085",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table83 (col83_84 JSONB, col83_85 STRING, col83_86 \"char\" NOT NULL, col83_87 FLOAT8, col83_88 VARCHAR, col83_89 BOX2D NOT NULL, col83_90 STRING NOT NULL AS (lower(col83_85)) STORED, col83_91 STRING NULL AS (lower(col83_85)) STORED)",
          |   "CREATE VIEW schema9.view104 AS SELECT public.table83.col83_87, public.table83.col83_91, public.table83.col83_86, public.table83.col83_85, public.table83.col83_84, public.table83.col83_90, public.table83.col83_90, public.table83.col83_84, public.table83.col83_85, public.table83.col83_86, public.table83.col83_91, public.table83.col83_89 FROM public.table83, public.table83"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table83\" specified more than once (missing AS clause) (SQLSTATE 42712)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:04:11.777254",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:04:11.422104",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table95 (col95_96 INTERVAL NOT NULL, col95_97 DATE NULL, PRIMARY KEY (col95_96), col95_98 STRING AS (lower(CAST(col95_96 AS STRING))) VIRTUAL, INDEX (col95_96 DESC, col95_98, col95_97 DESC), INDEX (col95_96 ASC, col95_98 ASC, col95_97 ASC), INDEX (col95_96 DESC, col95_98), FAMILY (col95_96), FAMILY (col95_97))",
          |   "ALTER TABLE public.table95 ALTER COLUMN \"col95_98\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"col95_98\" is not a stored computed column (SQLSTATE 42611)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ aedf03967e1d9179943f403567433c9c1c6d6f23:

          |  "clientTimestamp": "19:52:23.630984",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:52:23.373542",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:52:23.543336",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema92.table93 ALTER COLUMN IrrelevantColumnName SET DEFAULT \"IrrelevantValue\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema92.table93\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:52:23.594064",
          |  "ops": [
          |   "BEGIN",
          |   "DROP TABLE IF EXISTS public.table51"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 3bf34abe95cf99091c7ddea2eb767cdf0a297bd8:

          |   "BEGIN",
          |   "CREATE TABLE schema100.table101 (col101_102 INT4 NOT NULL, col101_103 JSONB, col101_104 TIME NOT NULL, col101_105 BYTES NOT NULL, PRIMARY KEY (col101_105 ASC, col101_102, col101_104), col101_106 STRING NOT NULL AS (CASE WHEN col101_105 IS NULL THEN NULL ELSE '~':::STRING END) STORED, col101_107 INT4 AS (col101_102 + 1604735251:::INT8) VIRTUAL, col101_108 INT4 AS (col101_102 + 66122855:::INT8) VIRTUAL, INDEX (col101_107 DESC), UNIQUE (col101_105, col101_106, col101_104 DESC, col101_108, col101_102 ASC), INDEX (col101_106, col101_108, col101_105 ASC, col101_107 ASC) STORING (col101_103))"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema100.table101\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:49:18.405722",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER INDEX public.table109@\"IrrelevantConstraintName\" RENAME TO \"OtherConstraintName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table109\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:49:18.402685",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "CREATE TYPE public.enum96 AS ENUM ('sffa', 'aasf', 'fds')",
          |   "SELECT 'validating all objects'",
          |   "CREATE SCHEMA IF NOT EXISTS schema112 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=3a6ff785 key=/Table/SystemConfigSpan/Start pri=0.00808672 epo=0 ts=1620935358.848762596,1 min=1620935358.402617466,0 seq=15} lock=true stat=PENDING rts=1620935358.402617466,0 wto=false gul=1620935358.902617466,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:49:18.420801",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table83 (col83_84 INT4 NOT NULL, col83_85 JSONB NOT NULL, col83_86 INT8 NOT NULL, col83_87 VARCHAR NULL, col83_88 TIMETZ, col83_89 BYTES NULL, col83_90 UUID, col83_91 NAME, col83_92 INT4 NOT NULL AS (col83_84 + col83_86) STORED, UNIQUE (col83_86, col83_91 DESC, col83_88 ASC), UNIQUE (col83_88, col83_89 DESC, col83_92, col83_90 DESC))",
          |   "INSERT INTO public.table83 (col83_84,col83_85,col83_86,col83_87,col83_88,col83_89,col83_90,col83_91,col83_92) VALUES ((-348002860):::INT8,e'{\"3S1\": {\"baz\": {\"QSKku\": []}}, \"FMTE-\": {\"baz\": \"[N6zSR03\"}, \"RDeR/5\": \"jhN\", \"Ze{\": [\"\u003e8\\'\", [{}]], \"baz\": [{}, null]}':::JSONB,3098564204463835594:::INT8,':si':::STRING,'15:57:03.622694-04:40:00':::TIMETZ,'\\xd882a3010f1632':::BYTES,'f8e094ce-5c29-457e-857c-1588b6e22229':::UUID,e'\\U00002603':::STRING,(-1800723622):::INT8)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col83_92\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ c1e87bb93b8782dc71ebba12145ca0446dd6a93b:

          -- stack trace:
          | main.(*cluster).RunE
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2312
          | main.runSchemaChangeRandomLoad
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:142
          | main.registerRandomLoadBenchSpec.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:80
          | main.(*testRunner).runTest.func2
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:767
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1374
        Wraps: (2) output in run_195812.812_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2985425-1621105457-22-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I210515 19:58:13.729330 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210515 19:58:13.819098 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 89.766274ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col2_12" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | table55 RENAME TO public.table56"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table55\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:58:13.821182",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table2 (col2_3 REGCLASS NOT NULL, col2_4 TIMETZ, col2_5 BIT(24), col2_6 GEOMETRY, col2_7 GEOGRAPHY, col2_8 TIMESTAMP NULL, col2_9 REGCLASS NULL, col2_10 REGTYPE NULL, col2_11 \"char\", col2_12 STRING NOT NULL AS (lower(CAST(col2_6 AS STRING))) STORED, col2_13 STRING AS (lower(CAST(col2_7 AS STRING))) STORED, col2_14 STRING AS (lower(CAST(col2_10 AS STRING))) VIRTUAL, col2_15 STRING AS (lower(CAST(col2_7 AS STRING))) VIRTUAL, INVERTED INDEX (col2_10 ASC, col2_4, col2_3 DESC, col2_13 ASC, col2_14 DESC, col2_5 DESC, col2_7 DESC), FAMILY (col2_13), FAMILY (col2_8), FAMILY (col2_10, col2_7), FAMILY (col2_3), FAMILY (col2_11, col2_4), FAMILY (col2_6, col2_9, col2_5), FAMILY (col2_12))",
          |   "INSERT INTO public.table2 (col2_3,col2_4,col2_5,col2_6,col2_7,col2_8,col2_9,col2_10,col2_11,col2_12,col2_13,col2_14,col2_15) VALUES (4008094817:::OID,'00:35:02.197544+14:35:00':::TIMETZ,B'010110101010100101101011',NULL,'0103000020E6100000010000000A0000002C2C19C63BDE494029BF1041C65150C0F03E2967A23E5440C146147BCCA142C0787FDB3BA445564000B9E57CB7F735409CAA06E639C3624044034E4C81D03E40E0E05003D7FE3F403C5B230FF3813B40182F7B88608E3DC0BA5B4663302855409088110724213AC09C51D836CB384640930BFBF6FBAB59C03C0474047097504090614C7C9F232A40C84DC5618B2C38402C2C19C63BDE494029BF1041C65150C0':::GEOGRAPHY,'2008-04-07 13:40:15.000965':::TIMESTAMP,422920891:::OID,1854291558:::OID,'v':::STRING,e'ngU\\x10\\x07\\x1eWOC':::STRING,e'\\x13``JQ\\x14WLX\\t':::STRING,e'\\x01s':::STRING,e'\\x16\\x02:\\'\\x1d':::STRING),(2425391200:::OID,'12:02:32.449804+02:20:00':::TIMETZ,B'001000001011100010101011','01050000000A000000010200000003000000F282D142FF90F441C0388918DE9EB941A2172B2B1347F941E03758CFEED1E841E147C605F83EF1C14C1E45AAF321F841010200000007000000A0F9816C1F20BFC1B47140801160F0C1E80C0536FFEED441BC138FB5C91200C2D87706685293EF41301A8AF24FABFBC1BCEE331116B60042C2B32500FF5500C2E6870733B5F9F141A641B84099A4EBC17CAAC121D91FFB41A8FA1CC6BB96ED410861DBCB06A6DB4160B368D72CAF0142010200000004000000B1B5888A1F24FFC1884E02C52FA9FAC138466B673CE4D741126E4D9A4B4FF2C1D0460155DEF9EF4187E305F9200200C2ACC8FA9E92D7EF412E02048085A2F8C101020000000200000074114D153514FB41104A47DD83D3D841601152048F0BDF41C0174B37B6D3A941010200000009000000303F124F6191DCC19B236B48CC5F01C230AEA2511899C24196B90B7FBF9FFCC1FC4F80052716EF413B30B8B7016F02C2A8060C3BA56AEE4130908221D826F9C1984D26072A52FE414C85494B4DFDD5C14812DFBCA801004290E38657593EC541324D050BC536F7410006B39F76CA9E418E3F9B7462E2F34100C96F2209C4A04180DE99C4C2C6CB41A402A737AB51EEC10102000000050000008AFD1657CDD7FDC1AE1E91051623F1C100E07C1CE3DAAF41D476B020CAD1F6C17646C2198C60F3417A9739D43B6902C2FC229E600B04FF41D11ED3B8434801C2C052AA162901E941A0D991F46EF9BB4101020000000300000072DA01362CB3E3C1D40C37CBEBEA00C28624C34485D7F7412ECDA76A0A5DF841A80CFCB57C73D0C1F0E21FDF8B7FCC4101020000000600000084FC7F63E846E2C19A3A1A56F25600C2B019A68CB1EEDA4120E0F25C6AD0BDC1A21B018D7F750142401F2604BAE4E6C1A01A3C3DD9720042409AC73D9AD7FC41D843A0FAD854DD414E26BD566EBAF8419E055C71C500E8C19ED511B676D2F641010200000007000000FE2CDF54317CFAC19CDB4B7E8031D5C179C7E3ED1579FEC10004FFF593EAF6C128F35D1BAC37EAC141617DDC3BBEF1C10893E0A2C459FE4193254AA218D9F0C1D8F82EF17728FE416083D6CCF702B841DCCD003CAD09EA4176D336844B95F54160B779811810BF417828FBFA5F27D94101020000000200000030010C8165D7DC41C85E5041DDA5E4416068DF70B8F2CF41E2D22E97EFA1E1C1':::GEOMETRY,'0105000020E610000000000000':::GEOGRAPHY,NULL,NULL,1451958905:::OID,NULL,',uY|':::STRING,NULL,e'GfW@2\\nb':::STRING,e'\\x03':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col2_12\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ c6917a3058604cc42381915f108428533e1d47ff:

          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=cf8283a6 key=/Table/SystemConfigSpan/Start pri=0.00107344 epo=0 ts=1621195249.800236734,1 min=1621195249.725756650,0 seq=9} lock=true stat=PENDING rts=1621195249.725756650,0 wto=false gul=1621195250.225756650,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:00:49.726153",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table37 (col37_38 REGTYPE NULL, col37_39 NAME NOT NULL, col37_40 BOX2D NULL, col37_41 FLOAT8 NULL, col37_42 INET NOT NULL, col37_43 INT4 NOT NULL, col37_44 REGPROC NOT NULL, col37_45 REGPROCEDURE NOT NULL, col37_46 REGNAMESPACE, col37_47 DATE, col37_48 INT4 AS (col37_43 + 1:::INT8) VIRTUAL, col37_49 STRING AS (lower(CAST(col37_45 AS STRING))) VIRTUAL, INDEX (col37_42 ASC), INDEX (col37_40 ASC, col37_46 DESC) STORING (col37_38, col37_39, col37_42, col37_43, col37_45, col37_47), UNIQUE (col37_45, col37_44 DESC, col37_42 DESC, col37_40 ASC, col37_43 DESC, col37_49, col37_41 ASC) STORING (col37_39, col37_46), INDEX (col37_41 DESC, col37_49) STORING (col37_38, col37_40, col37_42))",
          |   "CREATE VIEW public.view76 AS SELECT public.table37.col37_40, public.table37.col37_39, public.table37.col37_43 FROM public.table37",
          |   "CREATE VIEW schema88.view89 AS SELECT public.table37.col37_49, public.table37.col37_40, public.table37.col37_46, public.table37.col37_41, public.table37.col37_43, public.table37.col37_48, public.table37.col37_47, public.table37.col37_38, public.table37.col37_47 FROM public.table37, public.table37, public.table37"
          |  ],
          |  "expectedExecErrors": "3F000,42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema88.view89\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:00:49.725936",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum35 AS ENUM ('adsd', 'sad', 'sdsff')",
          |   "CREATE TYPE public.enum77 AS ENUM ('adfs', 'fasdsf', 'sfsafa')",
          |   "ALTER TABLE public.table90 ALTER COLUMN \"IrrelevantColumnName\" DROP NOT NULL"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table90\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:00:49.796856",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema34 AUTHORIZATION root",
          |   "CREATE TABLE IF NOT EXISTS public.table83 (col83_84 UUID NOT NULL, col83_85 BIT(22) NOT NULL, col83_86 INT4 NOT NULL, PRIMARY KEY (col83_85 DESC), col83_87 INT4 NOT NULL AS (col83_86 + (-629124875):::INT8) STORED, INDEX (col83_87, col83_86), INDEX (col83_87, col83_84 ASC, col83_85 DESC, col83_86 ASC), INDEX (col83_85 ASC, col83_87 ASC) STORING (col83_84, col83_86), INDEX (col83_84 ASC) STORING (col83_86), UNIQUE (col83_87 DESC, col83_85 DESC, col83_84 ASC), UNIQUE (col83_85 DESC) STORING (col83_84), UNIQUE (col83_84 ASC, col83_86 DESC) STORING (col83_87))",
          |   "INSERT INTO public.table83 (col83_84,col83_85,col83_86,col83_87) VALUES ('59fd1749-df80-4593-b27c-972cba3eccdf':::UUID,B'0101100000100111101100',(-875542048):::INT8,1885124200:::INT8)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col83_87\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 803e71d5b92591547f058cc731482cc2ccdd032a:

          |     /usr/local/go/src/runtime/asm_amd64.s:1374
        Wraps: (2) output in run_194703.255_n1_workload_run_schemachange
        Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2993979-1621364395-25-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
          | stderr:
          | I210518 19:47:04.222621 1 workload/cli/run.go:361  [-] 1  creating load generator...
          | I210518 19:47:04.331298 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 108.675359ms)
          | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col211_225" (SQLSTATE 55000)
          | Error: COMMAND_PROBLEM: exit status 1
          | (1) COMMAND_PROBLEM
          | Wraps: (2) Node 1. Command with error:
          |   | ``````
          |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 10000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
          |   | ``````
          | Wraps: (3) exit status 1
          | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
          |
          | stdout:
          | <... some data truncated by circular buffer; go to artifacts for details ...>
          | rkerId": 0,
          |  "clientTimestamp": "19:47:05.531847",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq178",
          |   "CREATE SCHEMA schema231 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=030889c3 key=/Table/SystemConfigSpan/Start pri=0.00153999 epo=0 ts=1621367225.950367600,1 min=1621367225.531793342,0 seq=13} lock=true stat=ABORTED rts=1621367225.531793342,0 wto=false gul=1621367226.031793342,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          |     2.0s        0           39.0           40.0     13.1     83.9    201.3    201.3 opOk
          |     2.0s        0            6.0            8.0    570.4    771.8    771.8    771.8 txnCmtErr
          |     2.0s        0            2.0            2.5    318.8    318.8    318.8    318.8 txnOk
          |     2.0s        0           23.0           25.0      4.7     46.1    201.3    201.3 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:47:05.603118",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS schema1.table211 (col211_212 JSONB, col211_213 INET NULL, col211_214 INT8 NOT NULL, col211_215 OID[], col211_216 NAME NULL, col211_217 \"char\", col211_218 REGCLASS NULL, col211_219 FLOAT8 NOT NULL, col211_220 TIME NULL, col211_221 BOX2D, col211_222 INTERVAL NULL, col211_223 REGTYPE NOT NULL, col211_224 INET, col211_225 STRING AS (lower(CAST(col211_223 AS STRING))) VIRTUAL, col211_226 STRING NULL AS (lower(CAST(col211_220 AS STRING))) VIRTUAL, UNIQUE (col211_220 DESC, col211_218 ASC, col211_214 DESC) STORING (col211_215, col211_217, col211_219, col211_221, col211_223), INDEX (col211_220, col211_213 ASC) STORING (col211_214, col211_215, col211_218, col211_221, col211_224), UNIQUE (col211_220 DESC, col211_219 DESC, col211_218 ASC, col211_217 DESC, col211_214) STORING (col211_215, col211_221, col211_222, col211_224), INDEX (col211_214 DESC, col211_223, col211_219, col211_225, col211_224 ASC, col211_217, col211_222 DESC) STORING (col211_215, col211_216), INDEX (col211_221, col211_216, col211_218 ASC, col211_222 ASC) STORING (col211_212, col211_213, col211_215, col211_217, col211_219), FAMILY (col211_215), FAMILY (col211_214), FAMILY (col211_223), FAMILY (col211_224, col211_217), FAMILY (col211_219, col211_222, col211_220), FAMILY (col211_212), FAMILY (col211_216), FAMILY (col211_221, col211_218, col211_213))",
          |   "SELECT 'validating all objects'",
          |   "INSERT INTO schema1.table211 (col211_212,col211_213,col211_214,col211_215,col211_216,col211_217,col211_218,col211_219,col211_220,col211_221,col211_222,col211_223,col211_224,col211_225,col211_226) VALUES (e'{\"5WU4SYVmz_1h\": \"a\", \"=l\u003e.0~\u003ent\": {}, \"a\": [[null], \"L6*P8RfTb\\\\\\\\\"], \"bar\": \"bar\", \"foo\": 3.967528168907581}':::JSONB,'134.172.109.104/7':::INET,(-5766525951396999139):::INT8,ARRAY[3437638052:::OID,3301876402:::OID],'Yzo':::STRING:::NAME,'l':::STRING,3708628218:::OID,0.7520706269219939:::FLOAT8,NULL,'BOX(0.13077234389290165 -0.38143034170561996,0.32660747013515135 1.1178055916627994)':::BOX2D,'10 years 8 mons 104 days 19:34:07.381917':::INTERVAL,2436518477:::OID,'25.154.139.130/6':::INET,e'7\\x15=\\x1ehl\\x15r':::STRING,e'\\x1d':::STRING),(e'[[], [[{\"Q]V8D1#!3B\\\\\"\": []}], []], {\"bar\": [], \"baz\": [null], \"~i8{?#|PQ\": {}}, true]':::JSONB,'acd4:8eb6:f036:d40:c4ca:569:aaae:7ac3/111':::INET,(-128):::INT8,ARRAY[0:::OID,1865573765:::OID,26098157:::OID,786202547:::OID],';nj@z{x':::STRING:::NAME,e'\\x1e':::STRING,0:::OID,0.0:::FLOAT8,'24:00:00':::TIME,'BOX(1.0288598316942583 -1.6680554109078116,1.389733203066046 1.0783727823611802)':::BOX2D,'62 years 9 mons 300 days 00:08:39.246665':::INTERVAL,223290690:::OID,'4555:c0a9:a884:dc3e:4ed1:d52f:191:23ee/48':::INET,'':::STRING,'Oc':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col211_225\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 3597e1e739382a7f067d86f6fba9ec39841dbb2c:

          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:07:16.669766",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table139 (col139_140 CHAR NOT NULL, col139_141 BOOL, col139_142 BIT(25) NOT NULL, col139_143 FLOAT4 NULL, col139_144 REGCLASS NOT NULL, col139_145 BIT(3) NULL, col139_146 GEOGRAPHY NULL, col139_147 BIT(48), col139_148 BOOL NULL, col139_149 BOX2D NULL, col139_150 BOOL NULL, col139_151 CHAR, col139_152 TIMESTAMPTZ NOT NULL, col139_153 REGTYPE NOT NULL, col139_154 DECIMAL, col139_155 STRING AS (lower(CAST(col139_144 AS STRING))) VIRTUAL, col139_156 STRING NOT NULL AS (lower(CAST(col139_147 AS STRING))) STORED)",
          |   "ALTER TABLE public.table139 ADD COLUMN col139_188 TIMESTAMPTZ NOT NULL",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=9f3df56d key=/Table/SystemConfigSpan/Start pri=0.03588698 epo=0 ts=1621454836.899031480,1 min=1621454836.669681974,0 seq=13} lock=true stat=PENDING rts=1621454836.669681974,0 wto=false gul=1621454837.169681974,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:07:16.796989",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table192 ALTER COLUMN IrrelevantColumnName DROP STORED"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table192\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:07:16.899103",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table167 (col167_168 TIMESTAMP NOT NULL, col167_169 REGPROC NULL, col167_170 VARCHAR NOT NULL, col167_171 INT2[] NOT NULL, col167_172 UUID NOT NULL, col167_173 TIMESTAMPTZ NULL, col167_174 STRING AS (CASE WHEN col167_173 IS NULL THEN e'\\x18||#\\'\\n!':::STRING ELSE e'i80\\x1a\\x1e\\x0bn':::STRING END) STORED, UNIQUE (col167_170 DESC, col167_169) STORING (col167_171, col167_174), FAMILY (col167_173), FAMILY (col167_168), FAMILY (col167_169), FAMILY (col167_171, col167_172, col167_174, col167_170))",
          |   "INSERT INTO public.table167 (col167_168,col167_169,col167_170,col167_171,col167_172,col167_173,col167_174) VALUES ('1987-12-16 19:29:41.000454':::TIMESTAMP,716473113:::OID,e'\\x02r\\x16':::STRING,ARRAY[3246:::INT8,(-12164):::INT8],'b31cef28-5a44-4f8a-a10e-708417287193':::UUID,'1975-06-03 12:26:43.000963+00:00':::TIMESTAMPTZ,e'(\\x14^8i2':::STRING),('2001-05-13 07:19:34.00066':::TIMESTAMP,1956697499:::OID,e'Z\\x05_I]j\\x1e\\x12\\x02':::STRING,ARRAY[]:::INT2[],'984ae704-ab69-4f12-9dc4-d3bacb6c468f':::UUID,'1996-02-19 22:21:39.000764+00:00':::TIMESTAMPTZ,'':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col167_174\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 8a9909257235309ea01fff1ef9ce73d00fec5b97:

          |  "clientTimestamp": "22:48:50.542364",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "22:48:50.7992",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema30 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "42P06",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: schema \"schema30\" already exists (SQLSTATE 42P06)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "22:48:49.054937",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema212 AUTHORIZATION root",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "22:48:50.272107",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE schema30.table354 AS SELECT schema212.table271.col271_281, schema212.table271.col271_274, schema212.table271.col271_280, schema212.table271.col271_279, schema212.table271.col271_275, schema212.table271.col271_276 FROM schema212.table271",
          |   "INSERT INTO schema212.table271 (col271_272,col271_273,col271_274,col271_275,col271_276,col271_277,col271_278,col271_279,col271_280,col271_281) VALUES (2299104253:::OID,'db03bb6a-d715-498c-8759-eb7d5402462b':::UUID,729374595:::OID,1.401298464324817e-45:::FLOAT8,'BOX(0.5544449684799838 -0.49884846615854417,1.9608242066506314 0.3221964171831199)':::BOX2D,'j':::STRING,'0102000020E61000000600000068BAD16A84666640B034155A1AFC23C090A4870ED7445C40603D38369CFA5040488110B7E0486140500DDD6A0B895540225BB6E35F50504092571ACC4923554054A7DCF1188741C04E84A7810C8E5540603D268D591115C040E1548B309D4B40':::GEOGRAPHY,'09:11:48.073921':::TIME,'fba2438c-ad1b-4b28-9a4f-b26b9c16419e':::UUID,e'2/\\x06*?kY':::STRING),(456082040:::OID,'3e48dd4e-1160-4786-b6a0-9a7946cb6fac':::UUID,137308515:::OID,(-0.9101393818855286):::FLOAT8,'BOX(0.847779297974122 -0.7278745515328855,1.1876900148668295 -0.10885592298742708)':::BOX2D,e'\\'':::STRING,'0102000020E610000003000000C039B1BF784717408435B2A0B7863FC0B851B637EFBA4C402C3B11AC2D603CC0521EFA033E0660406499464BDD214C40':::GEOGRAPHY,'03:36:26.80138':::TIME,'9daef257-b600-44a5-90f2-220a895cb23e':::UUID,e'rth\\x0e':::STRING)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col271_281\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 9a6c8c0a3fecb76585843fb8ee7c9e5b10b7630a:

          |   "CREATE TABLE IF NOT EXISTS schema302.table303 (col303_304 BYTES NOT NULL, col303_305 BIT NOT NULL, PRIMARY KEY (col303_305 DESC, col303_304), INDEX (col303_304 ASC, col303_305 ASC), UNIQUE (col303_304))"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema302.table303\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:06:07.748654",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema306.table307 DROP CONSTRAINT IrrelevantConstraintName"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema306.table307\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:06:07.05643",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE schema43.enum199 AS ENUM ('d')",
          |   "DROP SEQUENCE schema155.seq178",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:06:07.381994",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TYPE public.enum289 AS ENUM ('sssfsd', 'ssdsd', 'dd', 'sa', 'ddfff')",
          |   "CREATE SEQUENCE IF NOT EXISTS schema43.seq308",
          |   "CREATE TABLE IF NOT EXISTS schema43.table309 (col309_310 BYTES NOT NULL, col309_311 VARCHAR NOT NULL, col309_312 INT8 NOT NULL, col309_313 FLOAT8 NOT NULL, col309_314 NAME NOT NULL, col309_315 INT8 NOT NULL, col309_316 DATE NOT NULL, PRIMARY KEY (col309_311, col309_314, col309_315, col309_313 ASC, col309_312, col309_310 ASC, col309_316), col309_317 INT8 NOT NULL AS (col309_312 + col309_315) VIRTUAL, UNIQUE (col309_317 ASC, col309_314, col309_315, col309_316 DESC, col309_311, col309_312 ASC), UNIQUE (col309_310, col309_315, col309_317 DESC, col309_316 DESC, col309_311, col309_312 DESC), UNIQUE (col309_312, col309_313), UNIQUE (col309_313 ASC))",
          |   "INSERT INTO schema43.table309 (col309_310,col309_311,col309_312,col309_313,col309_314,col309_315,col309_316,col309_317) VALUES ('\\xab1030fa2b6ed5':::BYTES,e'\u003e:Y\u003eV1C!\\x15':::STRING,(-5134207601480956978):::INT8,0.9741458728331917:::FLOAT8,')':::STRING:::NAME,(-6638138275631953064):::INT8,'1971-03-04':::DATE,32767:::INT8),('\\x07966e4e':::BYTES,'/':::STRING,2472096703386935200:::INT8,0.5435003903734762:::FLOAT8,e'\\x16\\f)*q@\u003c(v':::STRING:::NAME,4872332188213089648:::INT8,'1993-12-02':::DATE,(-1250459975612622508):::INT8),('\\x028715df8f6ff40a':::BYTES,e'$\\x0b\\',':::STRING,1293814253609296336:::INT8,(-0.9663633527682942):::FLOAT8,e'D\u0026\\x12\\x16Q':::STRING:::NAME,(-3797039662690548095):::INT8,'1993-11-17':::DATE,(-3655253315863851638):::INT8)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col309_317\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 349b8be9d101ec656e61d0b6a49dda0dc26bad57:

          |  "clientTimestamp": "19:58:05.765155",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "DROP SCHEMA \"schema249\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unknown schema \"schema249\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:58:05.999596",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema217.table248 RENAME COLUMN \"IrrelevantColumnName\" TO \"OtherIrrelevantName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema217.table248\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:58:05.760079",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS public.seq250",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=7481c3b4 key=/Table/SystemConfigSpan/Start pri=0.05358406 epo=0 ts=1621713486.033126550,1 min=1621713485.760036787,0 seq=8} lock=true stat=PENDING rts=1621713485.760036787,0 wto=false gul=1621713486.260036787,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "19:58:05.79341",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE INDEX IF NOT EXISTS index220_259 ON public.table220 (col220_222, col220_225 ASC, col220_223 DESC) STORING (col220_227)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table220\" (95): index \"index220_259\" cannot store virtual column \"col220_227\" (SQLSTATE XXUUU)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ b600d9c2283e19886406e658369e70b5c61a612f:

          |  "clientTimestamp": "20:07:27.978356",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE schema25.table349 AS SELECT public.table308.col308_313, public.table308.col308_323, public.table308.col308_324, public.table308.col308_321, public.table308.col308_322, public.table308.col308_314, public.table308.col308_315, public.table308.col308_325, public.table308.col308_310, public.table308.col308_316, public.table308.col308_320, public.table308.col308_311, public.table308.col308_318, public.table308.col308_317, public.table308.col308_312, public.table308.col308_313, public.table308.col308_310, public.table308.col308_312, public.table308.col308_322, public.table308.col308_315, public.table308.col308_324, public.table308.col308_309, public.table308.col308_320, public.table308.col308_323, public.table308.col308_311, public.table308.col308_310, public.table308.col308_315, public.table308.col308_321, public.table308.col308_325, public.table308.col308_313 FROM public.table308, public.table308, public.table308"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table308\" specified more than once (missing AS clause) (SQLSTATE 42712)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:07:27.719373",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS schema132.seq342",
          |   "CREATE INDEX IF NOT EXISTS index308_350 ON public.table308 (col308_324, col308_319, col308_315 ASC, col308_316 ASC, col308_317 ASC, col308_323 DESC, col308_325 DESC, col308_320 ASC) STORING (col308_310, col308_309, col308_311, col308_318, col308_322)"
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: column col308_317 is of type float[] and thus is not indexable (SQLSTATE 0A000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:07:28.018822",
          |  "ops": [
          |   "BEGIN",
          |   "DROP TABLE IF EXISTS public.table308 CASCADE",
          |   "CREATE TYPE schema352.enum353 AS ENUM ('fdff', 'sdfa')"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema352.enum353\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "20:07:28.664899",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"schema25\" CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 15a6a314706eb15fb094feb6956600a9b864451b:

          |  "clientTimestamp": "06:47:47.430551",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table18 (col18_19 INTERVAL NOT NULL, col18_20 FLOAT8 NOT NULL, PRIMARY KEY (col18_19 ASC, col18_20 DESC), UNIQUE (col18_20), UNIQUE (col18_20 DESC, col18_19 DESC), INDEX (col18_20 DESC, col18_19), UNIQUE (col18_20 DESC), UNIQUE (col18_20 ASC), INDEX (col18_19 DESC), UNIQUE (col18_20 DESC, col18_19 ASC), FAMILY (col18_20), FAMILY (col18_19))",
          |   "CREATE TYPE public.enum27 AS ENUM ('fsasf', 'ss', 'fs')",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=38ae2f8a key=/Table/SystemConfigSpan/Start pri=0.01568361 epo=0 ts=1622184467.433194157,1 min=1622184467.430481141,0 seq=16} lock=true stat=PENDING rts=1622184467.430481141,0 wto=false gul=1622184467.930481141,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:47:47.428511",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table31 ALTER COLUMN IrrelevantColumnName SET DEFAULT \"IrrelevantValue\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table31\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:47:47.429676",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:47:47.550666",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema17 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 4837b15a513fe9f0283b1583fece7fe8d3cd49ae:

          |  "workerId": 0,
          |  "clientTimestamp": "06:55:46.416099",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema393 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=5fd10638 key=/Table/SystemConfigSpan/Start pri=0.04575807 epo=0 ts=1622271347.289672896,1 min=1622271346.416031410,0 seq=6} lock=true stat=PENDING rts=1622271346.416031410,0 wto=false gul=1622271346.916031410,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:55:46.271803",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema415 AUTHORIZATION root"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=dc0c02e4 key=/Table/SystemConfigSpan/Start pri=0.01140321 epo=0 ts=1622271347.302828804,1 min=1622271346.271760217,0 seq=6} lock=true stat=PENDING rts=1622271346.271760217,0 wto=false gul=1622271346.771760217,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:55:47.039",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE VIEW public.view427 AS SELECT schema307.table382.col382_387, schema307.table382.col382_384, schema307.table382.col382_386, schema307.table382.col382_383, schema307.table382.col382_391, schema307.table382.col382_385, schema307.table382.col382_391, schema307.table382.col382_384, schema307.table382.col382_387, schema307.table382.col382_383, schema307.table382.col382_383, schema307.table382.col382_387, schema307.table382.col382_384, schema307.table382.col382_391, schema307.table382.col382_385, schema307.table382.col382_386 FROM schema307.table382, schema307.table382, schema307.table382"
          |  ],
          |  "expectedExecErrors": "42701,42712",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table382\" specified more than once (missing AS clause) (SQLSTATE 42712)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:55:46.898259",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema307.table382 ALTER COLUMN \"col382_384\" DROP NOT NULL",
          |   "DROP SCHEMA \"schema307\" CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 587aaedda1a00fe03dd16317ec6da329f69a3ac9:

          |  "clientTimestamp": "07:14:35.730762",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table25 ALTER COLUMN \"col25_28\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "42611",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col25_28\" is not a computed column (SQLSTATE 42611)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:14:35.610556",
          |  "ops": [
          |   "BEGIN",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:14:35.580685",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table25 ALTER COLUMN \"col25_35\" SET NOT NULL",
          |   "ALTER TABLE public.table25 DROP CONSTRAINT \"table25_col25_41_col25_31_col25_32_col25_33_key\""
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: cannot drop UNIQUE constraint \"table25_col25_41_col25_31_col25_32_col25_33_key\" using ALTER TABLE DROP CONSTRAINT, use DROP INDEX CASCADE instead (SQLSTATE 0A000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:14:35.515171",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "INSERT INTO public.table25 (col25_26,col25_27,col25_28,col25_29,col25_30,col25_31,col25_32,col25_33,col25_34,col25_35,col25_36,col25_37,col25_38,col25_39,col25_40,col25_41,col25_42,col25_43) VALUES ('2017-11-18 17:38:39.000059+00:00':::TIMESTAMPTZ,'1970-06-16 01:49:57.000967':::TIMESTAMP,ARRAY['00:00:00+15:59:00':::TIMETZ,'17:33:12.825224+06:55:00':::TIMETZ,'17:57:39.188518-13:42:00':::TIMETZ],'22:58:48.780803-13:10:00':::TIMETZ,B'010000100011101','1975-09-26':::DATE,'00:50:28.652588+01:19:00':::TIMETZ,1747729534:::INT8,'0101000020E610000053F598F99C5260C0744638A110E33A40':::GEOGRAPHY,'1992-01-01':::DATE,'144.176.92.63/26':::INET,e'{\"\\\\\\\\kx\u003ca%Jg\": false, \"bar\": {}, \"baz\": [\"b\", [{}, []], false, [true]]}':::JSONB,'010200000006000000F08F9FD9EE62FE41ABD4D91DD6EDFEC1C4E3157F6C6CF7419A5F3DDA5304E2C1D8D5A97D0D9FFC41949A753CAE8BDEC1C05FCE4A872CDB414651AA036740F8419048DC78333BC041AE8C4B939F2CF44123AA025C63E7F4C1E0B5CDC29753D041':::GEOMETRY,NULL,(-9046751922049660415):::INT8,'195.95.162.195/16':::INET,'BOX(0.7235266469080479 -1.4460479514295435,0.7563118812186123 -0.9776510449144602)':::BOX2D,(-7279964156179523232):::INT8),('1991-05-12 17:11:37.000432+00:00':::TIMESTAMPTZ,'1973-09-08 01:47:09.000728':::TIMESTAMP,ARRAY['00:00:00+15:59:00':::TIMETZ,'16:33:09.766385-06:14:00':::TIMETZ,'19:39:44.391196+04:57:00':::TIMETZ,'19:28:01.104598+06:50:00':::TIMETZ],'24:00:00-15:59:00':::TIMETZ,B'001100000110111','1981-10-25':::DATE,'07:14:44.015065+00:18:00':::TIMETZ,(-285669532):::INT8,'0106000020E610000000000000':::GEOGRAPHY,'infinity':::DATE,'64.196.181.87/23':::INET,e'{\"%|;YAYF\": {\"4}/\u0026c3y\": {\"7}\\'\": {\"L~nSiV+\": [[{}]]}, \"foo\": false}, \"=4AK_{ z)eV\": [], \"\u003eKyVAtQg\": []}, \"baz\": {}, \"c\": {}, \"u:B2O*W\": []}':::JSONB,'010200000003000000B464AB3D77F4E4C1795C677F082102C2C8683E459BD9E24134743EC044C8FCC17C2BABB4B014FAC170701343AE3EC5C1':::GEOMETRY,'%':::STRING,(-3656253266872690913):::INT8,'b116:d3e:e85f:a980:bb3f:b73e:5565:ce0c/91':::INET,'BOX(-0.21390681351979826 0.26852815646051187,0.6948209395921926 1.4070787943358776)':::BOX2D,NULL)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col25_43\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 1e2234a8449f6fe886387128dc5103866c4d244e:

          |   "SELECT 'validating all objects'",
          |   "CREATE TABLE schema282.table374 (col374_375 GEOGRAPHY NOT NULL, INVERTED INDEX (col374_375 ASC), INVERTED INDEX (col374_375 ASC), INVERTED INDEX (col374_375), INVERTED INDEX (col374_375), INVERTED INDEX (col374_375 DESC), INVERTED INDEX (col374_375), INVERTED INDEX (col374_375 DESC))",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=ef3a0019 key=/Table/SystemConfigSpan/Start pri=0.01020599 epo=0 ts=1622618186.821632188,1 min=1622618186.382179003,0 seq=7} lock=true stat=PENDING rts=1622618186.382179003,0 wto=false gul=1622618186.882179003,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusCommitFailure"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:16:26.454966",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SEQUENCE IF NOT EXISTS schema384.seq385"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema384.seq385\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:16:26.528747",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "ALTER TABLE schema282.table411 ALTER COLUMN IrrelevantColumnName SET DATA TYPE IrrelevantDataType"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema282.table411\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:16:26.784416",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA schema371 AUTHORIZATION root",
          |   "DROP SCHEMA \"schema371\" CASCADE"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ df9809c830c5cc26c9ebca67fba9ca4fcfa045ee:

          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:56:31.943825",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:56:31.944459",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE SCHEMA IF NOT EXISTS schema11 AUTHORIZATION root",
          |   "CREATE TABLE IF NOT EXISTS schema11.table47 (col47_48 REGNAMESPACE, col47_49 \"char\" NULL, col47_50 REGNAMESPACE NULL, col47_51 INET NULL, col47_52 UUID NOT NULL, col47_53 FLOAT8 NOT NULL, col47_54 STRING NOT NULL, PRIMARY KEY (col47_53 ASC, col47_52), col47_55 STRING AS (lower(CAST(col47_50 AS STRING))) VIRTUAL, col47_56 STRING NULL AS (lower(col47_54)) VIRTUAL, col47_57 STRING NULL AS (lower(col47_49)) VIRTUAL, col47_58 STRING NULL AS (lower(col47_54)) STORED, col47_59 STRING NULL AS (lower(col47_54)) STORED, INDEX (col47_49, col47_55 DESC, col47_54 DESC, col47_58 ASC, col47_51), FAMILY (col47_53, col47_52), FAMILY (col47_54), FAMILY (col47_49, col47_59), FAMILY (col47_50, col47_51), FAMILY (col47_48, col47_58))",
          |   "CREATE TYPE schema61.enum62 AS ENUM ('ssdss', 'ffff')"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema61.enum62\" because the target database or schema does not exist (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "06:56:31.943204",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE IF NOT EXISTS public.table1 (col1_2 REGPROC NOT NULL, col1_4 GEOMETRY NULL, PRIMARY KEY (col1_2 DESC), INVERTED INDEX (col1_4 ASC), UNIQUE (col1_2 DESC))",
          |   "CREATE TYPE public.enum31 AS ENUM ('ffadaf', 'a', 'sfas', 'sfsss')",
          |   "INSERT INTO public.table1 (col1_2,col1_4) VALUES (3631252578:::OID,'01020000000300000098AE5EB5ADB4FE419E1E38E67953F541844D7856C43FE041FC88A4FEA944F941D65B0550B32BF0C11A6CB308A0790042':::GEOMETRY),(1361341651:::OID,'010500000007000000010200000007000000315D8D16189CFDC1C0C324455844B141C8806349796100C2ECB597F02415FBC19A5BC88348F7EEC1D0D45BEBE02CCE4118FF7CA15F8BDC416090C98ED772C441000B70336A29FB414087A12B70880142507F5E7882C6E7C1ECBD5C809C5FF04120278A155B07C8414E52987B41420242010200000004000000024BE89DADB8FFC12A1FC7DC004CFCC1E0EEEBBA1D00F1C19559E7FB685102C2807DD29E5BFEBB4186DAD292B513F9C11061B8CF5619FD41D3E704CCD26201C201020000000200000014818C01D995D9C1F8EC720C8F84FD4100C0A0548EFE85C1906258BE4F32F241010200000009000000709C20D69D3BDE413431E9DDAF24F0C1D429384D4C65EA41DEA2B81429D9FFC1B0447B413687E64136CD37971632E7C18E80BB4DF475014238040D4E265FDDC12EAAB84DF600F34134B281A118F0F141F02B25DA1E8CD141B4C73304C4830042600B5457BCC1BB41802F68A4BFECD94174F99230680AE0C11E4FA5BBD204FA41B4720D8B3520DAC1ECD7C68B6DB1F541010200000005000000FA3FE92BFA75F5C1841C78E38115DCC1B68F1B407FF4FFC13C02287BAE1EFFC1A0D47728E124E2417C1B13D357B1E6C1E047A7C5516DB64100E2B87FEBC5AB41202DD7D29E76D241C0EA80A89C06C04101020000000300000060374192B60FFF41A0BD8329DE0CB441B0696E3B981EF941308E5D4549E7CC4103132F15D59DF2C1203C670F24B8E74101020000000600000048FA47DE5CE70042DFC67F3C8B06F2C19CEC6EE4937D00420AA12E18F50AEAC198FD64E467BEF6418086835FACC5CCC180D09679E9AEFB41D00774CC6204F341408216E28DAAB1C1389ED26CEAF0F841E02D68A4AEABD1C1D89E6BE6C6B4FB41':::GEOMETRY),(1454782082:::OID,NULL)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: geos: error during GEOS init: geos: cannot load GEOS from dir \"/usr/local/lib/cockroach\": geos error: /usr/local/lib/cockroach/libgeos.so: cannot open shared object file: No such file or directory (SQLSTATE XXUUU)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ 00b770d51383793d83c6c886357788dc211f7158:

          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:21.185851",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "DROP SCHEMA \"public\" CASCADE"
          |  ],
          |  "expectedExecErrors": "3F000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:21.179628",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "SELECT 'validating all objects'",
          |   "COMMIT"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "",
          |  "txStatus": "TxStatusCommitSuccess"
          | }
          | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
          |     1.0s        0           36.0           39.0      6.8     58.7    302.0    302.0 opOk
          |     1.0s        0            2.8            3.0    671.1    704.6    704.6    704.6 txnCmtErr
          |     1.0s        0            3.7            4.0    167.8    604.0    604.0    604.0 txnOk
          |     1.0s        0           30.5           33.0      2.2     28.3     35.7     35.7 txnRbk
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:21.331846",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE TABLE public.table58 (col58_59 REGCLASS NOT NULL, col58_60 DECIMAL NOT NULL, col58_61 REGNAMESPACE NOT NULL, col58_62 OID NOT NULL, col58_63 REGTYPE NOT NULL, col58_64 BOOL NULL, col58_65 REGTYPE NOT NULL, col58_66 FLOAT8 NOT NULL, col58_67 FLOAT4, col58_68 VARCHAR[] NULL, PRIMARY KEY (col58_66 ASC, col58_62 DESC, col58_65 DESC, col58_63), col58_69 STRING NOT NULL AS (CASE WHEN col58_68 IS NULL THEN e'q*^``I\\x19B%':::STRING ELSE '|':::STRING END) VIRTUAL, col58_70 DECIMAL AS (col58_60 + 6.334094176032650281E+31:::DECIMAL) STORED, col58_71 STRING NULL AS (CASE WHEN col58_68 IS NULL THEN e'\\x0fK10ld':::STRING ELSE '':::STRING END) STORED, col58_72 FLOAT4 AS (col58_67 + col58_66) VIRTUAL, col58_73 DECIMAL NOT NULL AS (col58_60 + 3.839027605126001002E+20:::DECIMAL) VIRTUAL, UNIQUE (col58_66 ASC, col58_69, col58_73 ASC, col58_62), FAMILY (col58_67, col58_60), FAMILY (col58_70, col58_68), FAMILY (col58_62, col58_71), FAMILY (col58_65), FAMILY (col58_61), FAMILY (col58_66), FAMILY (col58_63), FAMILY (col58_59, col58_64))",
          |   "ALTER TABLE public.table58 RENAME COLUMN \"col58_63\" TO \"col58_112\"",
          |   "CREATE TYPE public.enum118 AS ENUM ('sd', 'sddfsd')",
          |   "INSERT INTO public.table58 (col58_59,col58_60,col58_61,col58_62,col58_112,col58_64,col58_65,col58_66,col58_67,col58_68,col58_69,col58_70,col58_71,col58_72,col58_73) VALUES (355148837:::OID,(-6.60387227383935077E+32):::DECIMAL,0:::OID,71073312:::OID,1186782662:::OID,true,1043547648:::OID,1.7976931348623157e+308:::FLOAT8,0.8598732948303223:::FLOAT8,NULL,e'7/z\\x1f':::STRING,'-Infinity':::DECIMAL,'[rDE':::STRING,(-0.40391474962234497):::FLOAT8,67718363985.53321059:::DECIMAL),(2596554292:::OID,(-483078348185705556.0):::DECIMAL,3648651206:::OID,1309410640:::OID,3057826787:::OID,true,0:::OID,(-0.04434672778732063):::FLOAT8,0.3070119321346283:::FLOAT8,ARRAY[e'dS\\x1b\\x1b\\x0e.r':::STRING],e'rs\\x11Z0*U':::STRING,7.972152547281427028E+19:::DECIMAL,e'\\x14o7$X':::STRING,(-1.6189730167388916):::FLOAT8,6.467040700889697939E+28:::DECIMAL)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col58_69\" (SQLSTATE 55000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ ac27d325ed08b76408e3bfdec3707c74d5a1c565:

          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:03:43.929887",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE INDEX index567_569 ON schema101.table567 (col526_562 DESC, col526_530 ASC, col526_531 DESC, col526_528 DESC, col526_536, col526_532, col526_534 DESC, col526_527 ASC) STORING (col526_537, col526_535)"
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: column col526_536 is of type float[] and thus is not indexable (SQLSTATE 0A000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:03:43.839248",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema101.table567 ALTER COLUMN \"col526_533\" DROP STORED"
          |  ],
          |  "expectedExecErrors": "42611",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col526_533\" is not a computed column (SQLSTATE 42611)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:03:43.459443",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER SEQUENCE public.seq390 RENAME TO public.seq525"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=65c935e9 key=/Table/SystemConfigSpan/Start pri=0.00012685 epo=0 ts=1622876624.361316670,1 min=1622876623.459366366,0 seq=6} lock=true stat=PENDING rts=1622876623.459366366,0 wto=false gul=1622876623.959366366,0 (SQLSTATE 40001)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:03:43.840547",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE schema101.table567 DROP COLUMN \"col526_533\""
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"col526_533\" is referenced by computed column \"col526_538\" (SQLSTATE 42P10)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

cockroach-teamcity commented 3 years ago

roachtest.scbench/randomload/nodes=3/ops=10000/conc=20 failed with artifacts on release-21.1 @ d8f279692a7c23013dacb774df231d51d9c6cd35:

          |  "workerId": 0,
          |  "clientTimestamp": "07:05:21.740992",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table89 DROP COLUMN \"IrrelevantColumnName\""
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table89\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:21.616261",
          |  "ops": [
          |   "BEGIN",
          |   "SELECT 'validating all objects'",
          |   "ALTER SEQUENCE public.seq85 RENAME TO public.seq86"
          |  ],
          |  "expectedExecErrors": "42P01",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.seq85\" does not exist (SQLSTATE 42P01)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:21.884264",
          |  "ops": [
          |   "BEGIN",
          |   "ALTER TABLE public.table60 DROP CONSTRAINT \"table60_col60_67_key\""
          |  ],
          |  "expectedExecErrors": "0A000",
          |  "expectedCommitErrors": "",
          |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: cannot drop UNIQUE constraint \"table60_col60_67_key\" using ALTER TABLE DROP CONSTRAINT, use DROP INDEX CASCADE instead (SQLSTATE 0A000)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
          | {
          |  "workerId": 0,
          |  "clientTimestamp": "07:05:21.960514",
          |  "ops": [
          |   "BEGIN",
          |   "CREATE UNIQUE INDEX index60_90 ON public.table60 (col60_75, col60_76 DESC) STORING (col60_61, col60_65, col60_72, col60_67, col60_69, col60_66, col60_71, col60_73, col60_62, col60_74)"
          |  ],
          |  "expectedExecErrors": "",
          |  "expectedCommitErrors": "",
          |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table60\" (64): index \"index60_90\" cannot store virtual column \"col60_72\" (SQLSTATE XXUUU)",
          |  "txStatus": "TxStatusRollbackSuccess"
          | }
        Wraps: (4) exit status 20
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: ```bash # From https://go.crdb.dev/p/roachstress, perhaps edited lightly. caffeinate ./roachstress.sh scbench/randomload/nodes=3/ops=10000/conc=20 ```

Same failure on other branches

- #63496 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-63484] - #63373 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-release-20.2] - #56230 roachtest: scbench/randomload/nodes=3/ops=10000/conc=20 failed [C-test-failure O-roachtest O-robot branch-master]

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!