cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.11k stars 3.81k forks source link

compose: TestComposeCompare failed #73421

Closed cockroach-teamcity closed 1 year ago

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 8fdbf4dacfdf3c2032937fe5359255f3dc13c61a:

        postgres_1    |             AS tab_33492
        postgres_1    |     ORDER BY
        postgres_1    |         col_59994 NULLS FIRST, col_59995 NULLS FIRST, col_59996 NULLS FIRST, col_59997 NULLS FIRST, col_59998 NULLS FIRST
        test_1        | --- FAIL: TestCompare (658.61s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (56.01s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |                 pgtype.Numeric{
        test_1        |             -       Int:    s"17320508075688772935",
        test_1        |             +       Int:    s"1732050807568877",
        test_1        |             -       Exp:    -19,
        test_1        |             +       Exp:    -15,
        test_1        |                     Status: 2,
        test_1        |                     NaN:    false,
        test_1        |                 },
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT sqrt(3:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL AS col_60044) AS tab_33521
        test_1        |             ORDER BY
        test_1        |                 col_60044 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT sqrt(3::DECIMAL::DECIMAL::DECIMAL)::DECIMAL AS col_60044) AS tab_33521
        test_1        |             ORDER BY
        test_1        |                 col_60044 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

Jira issue: CRDB-11579

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ de4cc9bf7f6719ef198958de984ab861ca02a8c5:

        postgres_1    |         col_46382 NULLS FIRST,
        postgres_1    |         col_46383 NULLS FIRST,
        postgres_1    |         col_46384 NULLS FIRST
        test_1        | --- FAIL: TestCompare (636.17s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (32.82s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |                 pgtype.Numeric{
        test_1        |             -       Int:    s"22360679774997896964",
        test_1        |             +       Int:    s"2236067977499790",
        test_1        |             -       Exp:    -19,
        test_1        |             +       Exp:    -15,
        test_1        |                     Status: 2,
        test_1        |                     NaN:    false,
        test_1        |                 },
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT sqrt(5::DECIMAL::DECIMAL::DECIMAL)::DECIMAL AS col_46397) AS tab_24404
        test_1        |             ORDER BY
        test_1        |                 col_46397 NULLS FIRST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT sqrt(5:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL AS col_46397) AS tab_24404
        test_1        |             ORDER BY
        test_1        |                 col_46397 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 8343f0aed1a685b7a90ea37b10bd3e0ed85e654e:

        test_1        | --- FAIL: TestCompare (624.30s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (21.48s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare postgres to cockroach1:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |                 pgtype.Numeric{
        test_1        |             -       Int:    s"100776960000000000000000",
        test_1        |             +       Int:    s"10077696",
        test_1        |             -       Exp:    -16,
        test_1        |             +       Exp:    0,
        test_1        |                     Status: 2,
        test_1        |                     NaN:    false,
        test_1        |                 },
        test_1        |                 nil,
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT (6::DECIMAL::DECIMAL::DECIMAL ^ 9::INT8::INT8::INT8)::DECIMAL AS col_20591, NULL::rand_typ_3 AS col_20592)
        test_1        |                     AS tab_15422
        test_1        |             ORDER BY
        test_1        |                 col_20591 NULLS FIRST, col_20592 NULLS FIRST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT (6:::DECIMAL::DECIMAL::DECIMAL ^ 9:::INT8::INT8::INT8)::DECIMAL AS col_20591, NULL::rand_typ_3 AS col_20592)
        test_1        |                     AS tab_15422
        test_1        |             ORDER BY
        test_1        |                 col_20591 NULLS FIRST, col_20592 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 5c388180155f306a1685ac88bfbeeb03785313dd:

        test_1        | 
        test_1        | goroutine 25 [running]:
        test_1        | testing.tRunner.func1.2(0x1ee3e00, 0x4055dd0)
        test_1        |     /usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc000d02180)
        test_1        |     /usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1ee3e00, 0x4055dd0)
        test_1        |     /usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | math/big.(*Int).Set(...)
        test_1        |     /usr/local/go/src/math/big/int.go:75
        test_1        | github.com/cockroachdb/apd/v2.NewWithBigInt(0x0, 0x0, 0x1)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/apd/v2/decimal.go:95 +0x58
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.glob..func1(0xc000414290, 0x1, 0x1, 0x0, 0x0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:118 +0x29e
        test_1        | reflect.Value.call(0x1e7b7e0, 0x26b1208, 0x13, 0x214629f, 0x4, 0xc000fd5028, 0x1, 0x1, 0xc000fd4f68, 0x43170b, ...)
        test_1        |     /usr/local/go/src/reflect/value.go:476 +0x8e7
        test_1        | reflect.Value.Call(0x1e7b7e0, 0x26b1208, 0x13, 0xc000fd5028, 0x1, 0x1, 0xc00000f710, 0x1, 0x1)
        test_1        |     /usr/local/go/src/reflect/value.go:337 +0xb9
        test_1        | github.com/google/go-cmp/cmp.(*state).callTRFunc(0xc00028bd60, 0x1e7b7e0, 0x26b1208, 0x13, 0x1e3c760, 0xc00000f698, 0x97, 0xc0004f94a0, 0x0, 0x0, ...)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:333 +0x265
        test_1        | github.com/google/go-cmp/cmp.(*transformer).apply(0xc00052d500, 0xc00028bd60, 0x1e3c760, 0xc00000f698, 0x97, 0x1e3c760, 0xc00000f6b0, 0x97)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/options.go:320 +0x12c
        test_1        | github.com/google/go-cmp/cmp.(*state).tryOptions(0xc00028bd60, 0x31bd258, 0x1e3c760, 0x1e3c760, 0xc00000f698, 0x97, 0x1e3c760, 0xc00000f6b0, 0x97, 0x7f9f093204a0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:303 +0x132
        test_1        | github.com/google/go-cmp/cmp.(*state).compareAny(0xc00028bd60, 0x30d88d0, 0xc00035cfc0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:258 +0x2f2
        test_1        | github.com/google/go-cmp/cmp.Diff(0x1e3c760, 0xc00000f698, 0x1e3c760, 0xc00000f6b0, 0x438eb00, 0x7, 0x7, 0x6436805b8fa97d0d, 0x30d8c30)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:119 +0xab
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareVals(0xc000414290, 0x1, 0x1, 0xc0004142b0, 0x1, 0x1, 0x1, 0x20)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:39 +0xed
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.compareRows(0xc000fd5880, 0xc000fd5801, 0x2150c8b, 0xa, 0xc000fd5ab8)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:251 +0x225
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareConns(0x30e1390, 0xc000d9aae0, 0x6fc23ac00, 0xc000fd5da0, 0x0, 0x0, 0xc000c37c00, 0x2aa, 0x1, 0x0, ...)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:213 +0x571
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000d02180)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:176 +0xabe
        test_1        | testing.tRunner(0xc000d02180, 0xc000c7c660)
        test_1        |     /usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        |     /usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 81d49bd3d2e8ee3da4a5800043b94aa174127ab7:

        test_1        | 
        test_1        | goroutine 130033 [running]:
        test_1        | testing.tRunner.func1.2(0x1ee3e60, 0x4055dd0)
        test_1        |     /usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc000c28c00)
        test_1        |     /usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1ee3e60, 0x4055dd0)
        test_1        |     /usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | math/big.(*Int).Set(...)
        test_1        |     /usr/local/go/src/math/big/int.go:75
        test_1        | github.com/cockroachdb/apd/v2.NewWithBigInt(0x0, 0x0, 0x1)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/apd/v2/decimal.go:95 +0x58
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.glob..func1(0xc00044fa50, 0x1, 0x1, 0x0, 0x0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:118 +0x29e
        test_1        | reflect.Value.call(0x1e7b840, 0x26b1298, 0x13, 0x21462ff, 0x4, 0xc001029028, 0x1, 0x1, 0xc001028f68, 0x43170b, ...)
        test_1        |     /usr/local/go/src/reflect/value.go:476 +0x8e7
        test_1        | reflect.Value.Call(0x1e7b840, 0x26b1298, 0x13, 0xc001029028, 0x1, 0x1, 0xc000696708, 0x1, 0x1)
        test_1        |     /usr/local/go/src/reflect/value.go:337 +0xb9
        test_1        | github.com/google/go-cmp/cmp.(*state).callTRFunc(0xc000286d20, 0x1e7b840, 0x26b1298, 0x13, 0x1e3c7c0, 0xc000696690, 0x97, 0xc000c4f860, 0x0, 0x0, ...)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:333 +0x265
        test_1        | github.com/google/go-cmp/cmp.(*transformer).apply(0xc000779500, 0xc000286d20, 0x1e3c7c0, 0xc000696690, 0x97, 0x1e3c7c0, 0xc0006966a8, 0x97)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/options.go:320 +0x12c
        test_1        | github.com/google/go-cmp/cmp.(*state).tryOptions(0xc000286d20, 0x31bd2f8, 0x1e3c7c0, 0x1e3c7c0, 0xc000696690, 0x97, 0x1e3c7c0, 0xc0006966a8, 0x97, 0x7ff5728613b8)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:303 +0x132
        test_1        | github.com/google/go-cmp/cmp.(*state).compareAny(0xc000286d20, 0x30d8970, 0xc000cb5640)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:258 +0x2f2
        test_1        | github.com/google/go-cmp/cmp.Diff(0x1e3c7c0, 0xc000696690, 0x1e3c7c0, 0xc0006966a8, 0x438eb00, 0x7, 0x7, 0x19ff45d5377496cb, 0x30d8cd0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:119 +0xab
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareVals(0xc00044fa50, 0x1, 0x1, 0xc00044fa70, 0x1, 0x1, 0x1, 0x20)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:39 +0xed
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.compareRows(0xc001029880, 0xc001029801, 0x2150cf5, 0xa, 0xc001029ab8)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:251 +0x225
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareConns(0x30e1430, 0xc0002f9560, 0x6fc23ac00, 0xc001029da0, 0x0, 0x0, 0xc0004bec00, 0x320, 0x1, 0x0, ...)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:213 +0x571
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000c28c00)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:176 +0xabe
        test_1        | testing.tRunner(0xc000c28c00, 0xc000cb1890)
        test_1        |     /usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        |     /usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 1bb94b40c519b775d99dffe64435f968206ced4b:

        test_1        | 
        test_1        | goroutine 605505 [running]:
        test_1        | testing.tRunner.func1.2(0x1ee3e60, 0x4055dd0)
        test_1        |     /usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc0003fea80)
        test_1        |     /usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1ee3e60, 0x4055dd0)
        test_1        |     /usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | math/big.(*Int).Set(...)
        test_1        |     /usr/local/go/src/math/big/int.go:75
        test_1        | github.com/cockroachdb/apd/v2.NewWithBigInt(0x0, 0x0, 0x1)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/apd/v2/decimal.go:95 +0x58
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.glob..func1(0xc000e5c020, 0x1, 0x1, 0x0, 0x0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:118 +0x29e
        test_1        | reflect.Value.call(0x1e7b840, 0x26b1298, 0x13, 0x21462ff, 0x4, 0xc001101028, 0x1, 0x1, 0xc001100f68, 0x43170b, ...)
        test_1        |     /usr/local/go/src/reflect/value.go:476 +0x8e7
        test_1        | reflect.Value.Call(0x1e7b840, 0x26b1298, 0x13, 0xc001101028, 0x1, 0x1, 0xc000e440c0, 0x1, 0x1)
        test_1        |     /usr/local/go/src/reflect/value.go:337 +0xb9
        test_1        | github.com/google/go-cmp/cmp.(*state).callTRFunc(0xc000c960a0, 0x1e7b840, 0x26b1298, 0x13, 0x1e3c7c0, 0xc000e44000, 0x97, 0xc000e560a0, 0x0, 0x0, ...)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:333 +0x265
        test_1        | github.com/google/go-cmp/cmp.(*transformer).apply(0xc000687500, 0xc000c960a0, 0x1e3c7c0, 0xc000e44000, 0x97, 0x1e3c7c0, 0xc000e44030, 0x97)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/options.go:320 +0x12c
        test_1        | github.com/google/go-cmp/cmp.(*state).tryOptions(0xc000c960a0, 0x31bd2f8, 0x1e3c7c0, 0x1e3c7c0, 0xc000e44000, 0x97, 0x1e3c7c0, 0xc000e44030, 0x97, 0x7f3440c92ec8)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:303 +0x132
        test_1        | github.com/google/go-cmp/cmp.(*state).compareAny(0xc000c960a0, 0x30d8970, 0xc000b74040)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:258 +0x2f2
        test_1        | github.com/google/go-cmp/cmp.Diff(0x1e3c7c0, 0xc000e44000, 0x1e3c7c0, 0xc000e44030, 0x438eb00, 0x7, 0x7, 0x3d0d6d3571fdfc6f, 0x30d8cd0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:119 +0xab
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareVals(0xc000e5c020, 0x1, 0x1, 0xc000e5c040, 0x1, 0x1, 0x1, 0x40)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:39 +0xed
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.compareRows(0xc001101880, 0xc001101801, 0x2150ceb, 0xa, 0xc001101ab8)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:251 +0x225
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareConns(0x30e1430, 0xc00108c840, 0x6fc23ac00, 0xc001101da0, 0x0, 0x0, 0xc000d62200, 0x18d, 0x1, 0x0, ...)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:213 +0x571
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc0003fea80)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:176 +0xabe
        test_1        | testing.tRunner(0xc0003fea80, 0xc00079fe00)
        test_1        |     /usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        |     /usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ cb0222a1980b96ad59c181c96fab8340aa252571:

        test_1        | 
        test_1        | goroutine 6 [running]:
        test_1        | testing.tRunner.func1.2(0x1ee4aa0, 0x4057dd0)
        test_1        |     /usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc0003e9e00)
        test_1        |     /usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1ee4aa0, 0x4057dd0)
        test_1        |     /usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | math/big.(*Int).Set(...)
        test_1        |     /usr/local/go/src/math/big/int.go:75
        test_1        | github.com/cockroachdb/apd/v2.NewWithBigInt(0x0, 0x0, 0x1)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/apd/v2/decimal.go:95 +0x58
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.glob..func1(0xc0003c0850, 0x1, 0x1, 0x0, 0x0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:118 +0x29e
        test_1        | reflect.Value.call(0x1e7c4e0, 0x26b2100, 0x13, 0x214707f, 0x4, 0xc0012db028, 0x1, 0x1, 0xc0012daf68, 0x43170b, ...)
        test_1        |     /usr/local/go/src/reflect/value.go:476 +0x8e7
        test_1        | reflect.Value.Call(0x1e7c4e0, 0x26b2100, 0x13, 0xc0012db028, 0x1, 0x1, 0xc000c1c078, 0x1, 0x1)
        test_1        |     /usr/local/go/src/reflect/value.go:337 +0xb9
        test_1        | github.com/google/go-cmp/cmp.(*state).callTRFunc(0xc000d5a000, 0x1e7c4e0, 0x26b2100, 0x13, 0x1e3d460, 0xc000c1c000, 0x97, 0xc000c3a280, 0x0, 0x0, ...)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:333 +0x265
        test_1        | github.com/google/go-cmp/cmp.(*transformer).apply(0xc00059d540, 0xc000d5a000, 0x1e3d460, 0xc000c1c000, 0x97, 0x1e3d460, 0xc000c1c018, 0x97)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/options.go:320 +0x12c
        test_1        | github.com/google/go-cmp/cmp.(*state).tryOptions(0xc000d5a000, 0x31be498, 0x1e3d460, 0x1e3d460, 0xc000c1c000, 0x97, 0x1e3d460, 0xc000c1c018, 0x97, 0x7fdcb776faa8)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:303 +0x132
        test_1        | github.com/google/go-cmp/cmp.(*state).compareAny(0xc000d5a000, 0x30d9b10, 0xc000b64080)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:258 +0x2f2
        test_1        | github.com/google/go-cmp/cmp.Diff(0x1e3d460, 0xc000c1c000, 0x1e3d460, 0xc000c1c018, 0x4390b80, 0x7, 0x7, 0x1e980f350b5ad105, 0x30d9e70)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:119 +0xab
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareVals(0xc0003c0850, 0x1, 0x1, 0xc0003c0880, 0x1, 0x1, 0x1, 0x20)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:39 +0xed
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.compareRows(0xc0012db880, 0xc0012db801, 0x2151a75, 0xa, 0xc0012dbab8)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:251 +0x225
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareConns(0x30e25d0, 0xc000afef00, 0x6fc23ac00, 0xc0012dbda0, 0x0, 0x0, 0xc000af8c00, 0x1fb, 0x1, 0x0, ...)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:213 +0x571
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc0003e9e00)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:176 +0xabe
        test_1        | testing.tRunner(0xc0003e9e00, 0xc000b50570)
        test_1        |     /usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        |     /usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 3cf7ac914c42bb024c688564983445f3eb5da58a:

        test_1        | 
        test_1        | goroutine 27 [running]:
        test_1        | testing.tRunner.func1.2(0x1ee5a20, 0x4058dd0)
        test_1        |     /usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc000954780)
        test_1        |     /usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1ee5a20, 0x4058dd0)
        test_1        |     /usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | math/big.(*Int).Set(...)
        test_1        |     /usr/local/go/src/math/big/int.go:75
        test_1        | github.com/cockroachdb/apd/v2.NewWithBigInt(0x0, 0x0, 0xc0005650e0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/apd/v2/decimal.go:95 +0x58
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.glob..func1(0xc000b8bc40, 0x2, 0x2, 0x0, 0x0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:118 +0x29e
        test_1        | reflect.Value.call(0x1e7d460, 0x26b3190, 0x13, 0x21480df, 0x4, 0xc0010d5028, 0x1, 0x1, 0xc0010d4f68, 0x43170b, ...)
        test_1        |     /usr/local/go/src/reflect/value.go:476 +0x8e7
        test_1        | reflect.Value.Call(0x1e7d460, 0x26b3190, 0x13, 0xc0010d5028, 0x1, 0x1, 0xc000a219c8, 0x1, 0x1)
        test_1        |     /usr/local/go/src/reflect/value.go:337 +0xb9
        test_1        | github.com/google/go-cmp/cmp.(*state).callTRFunc(0xc000d675e0, 0x1e7d460, 0x26b3190, 0x13, 0x1e3e3e0, 0xc000a21950, 0x97, 0xc0006c4af0, 0x0, 0x0, ...)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:333 +0x265
        test_1        | github.com/google/go-cmp/cmp.(*transformer).apply(0xc000613540, 0xc000d675e0, 0x1e3e3e0, 0xc000a21950, 0x97, 0x1e3e3e0, 0xc000a21968, 0x97)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/options.go:320 +0x12c
        test_1        | github.com/google/go-cmp/cmp.(*state).tryOptions(0xc000d675e0, 0x31bf5b8, 0x1e3e3e0, 0x1e3e3e0, 0xc000a21950, 0x97, 0x1e3e3e0, 0xc000a21968, 0x97, 0x7f6b20c3d4a0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:303 +0x132
        test_1        | github.com/google/go-cmp/cmp.(*state).compareAny(0xc000d675e0, 0x30dac30, 0xc000be5d40)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:258 +0x2f2
        test_1        | github.com/google/go-cmp/cmp.Diff(0x1e3e3e0, 0xc000a21950, 0x1e3e3e0, 0xc000a21968, 0x4391b80, 0x7, 0x7, 0x1f156267b36c7212, 0x30daf90)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/vendor/github.com/google/go-cmp/cmp/compare.go:119 +0xab
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareVals(0xc000b8bc40, 0x2, 0x2, 0xc000b8bc60, 0x2, 0x2, 0x2, 0x20)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/compare.go:39 +0xed
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.compareRows(0xc0010d5880, 0xc0010d5801, 0x2152ad5, 0xa, 0xc0010d5ab8)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:251 +0x225
        test_1        | github.com/cockroachdb/cockroach/pkg/cmd/cmpconn.CompareConns(0x30e36f0, 0xc000111bc0, 0x6fc23ac00, 0xc0010d5da0, 0x0, 0x0, 0xc000e4f000, 0x3e3, 0x1, 0x0, ...)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/cmd/cmpconn/conn.go:213 +0x571
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000954780)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:176 +0xabe
        test_1        | testing.tRunner(0xc000954780, 0xc00095c180)
        test_1        |     /usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        |     /usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ c754d101ccd7541b0f597dac2f37809c1a859bf2:

        postgres_1    |         col_16367 NULLS FIRST,
        postgres_1    |         col_16368 NULLS FIRST,
        postgres_1    |         col_16369 NULLS FIRST,
        postgres_1    |         col_16370 NULLS FIRST,
        postgres_1    |         col_16371 NULLS FIRST,
        postgres_1    |         col_16372 NULLS FIRST,
        postgres_1    |         col_16373 NULLS FIRST,
        postgres_1    |         col_16374 NULLS FIRST,
        postgres_1    |         col_16375 NULLS FIRST
        test_1        | --- FAIL: TestCompare (621.98s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (17.26s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             -   nil,
        test_1        |             +   string("BOX(-45 0,0 45)"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_box2dfromgeohash('E':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D AS col_16390) AS tab_8434
        test_1        |             ORDER BY
        test_1        |                 CAST(col_16390 AS STRING) NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_box2dfromgeohash('E'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_16390) AS tab_8434
        test_1        |             ORDER BY
        test_1        |                 CAST(col_16390 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ f963a1eb6daa99bd5fd2c43771773473cdf361f7:

        test_1        |                         JOIN postgres.public.table2@primary AS tab_417629 ON
        test_1        |                                 (tab_417628.col4_8) = (tab_417629.crdb_internal_idx_expr_1)
        test_1        |                                 AND (tab_417628.col4_2) = (tab_417629.crdb_internal_idx_expr_1)
        test_1        |                                 AND (tab_417627.col4_2) = (tab_417629.col2_3)
        test_1        |                         JOIN postgres.public.table2@primary AS tab_417630
        test_1        |                             JOIN postgres.public.table2 AS tab_417631
        test_1        |                                 JOIN postgres.public.table2 AS tab_417632 ON (tab_417631.col2_2) = (tab_417632.col2_2)
        test_1        |                                 JOIN postgres.public.table2@table2_col2_2_col2_1_col2_3_col2_0_col2_5_col2_4_key AS tab_417633
        test_1        |                                     JOIN postgres.public.table2@[0] AS tab_417634
        test_1        |                                         JOIN postgres.public.table2@[0] AS tab_417635 ON (tab_417634.col2_4) = (tab_417635.col2_4)
        test_1        |                                         JOIN postgres.public.table4 AS tab_417636
        test_1        |                                             JOIN postgres.public.table4 AS tab_417637 ON
        test_1        |                                                     (tab_417636.col4_6) = (tab_417637.col4_6)
        test_1        |                                                     AND (tab_417636.col4_2) = (tab_417637.col4_2)
        test_1        |                                                     AND (tab_417636.col4_8) = (tab_417637.col4_8) ON
        test_1        |                                                 (tab_417635.crdb_internal_idx_expr_1) = (tab_417636.col4_8) ON
        test_1        |                                             (tab_417633.crdb_internal_idx_expr) = (tab_417635.crdb_internal_idx_expr)
        test_1        |                                             AND (tab_417633.col2_0) = (tab_417635.crdb_internal_idx_expr)
        test_1        |                                             AND (tab_417633.col2_3) = (tab_417635.col2_3)
        test_1        |                                             AND (tab_417633.col2_5) = (tab_417634.col2_5) ON
        test_1        |                                         (tab_417632.col2_2) = (tab_417634.col2_2) ON
        test_1        |                                     (tab_417630.col2_5) = (tab_417633.crdb_internal_idx_expr)
        test_1        |                                     AND (tab_417630.col2_3) = (tab_417635.crdb_internal_idx_expr_1)
        test_1        |                                     AND (tab_417630.col2_4) = (tab_417634.col2_4)
        test_1        |                                     AND (tab_417630.col2_1) = (tab_417633.col2_1)
        test_1        |                                     AND (tab_417630.col2_4) = (tab_417633.col2_1)
        test_1        |                                     AND (tab_417630.crdb_internal_idx_expr) = (tab_417634.crdb_internal_idx_expr)
        test_1        |                                     AND (tab_417630.col2_0) = (tab_417633.col2_0) ON
        test_1        |                                 (tab_417626.col1_0) = (tab_417633.col2_5)
        test_1        |                                 AND (tab_417629.col2_5) = (tab_417633.crdb_internal_idx_expr)
        test_1        |                                 AND (tab_417628.col4_8) = (tab_417637.col4_8)
        test_1        |                                 AND (tab_417626.col1_1) = (tab_417634.tableoid)
        test_1        |                     WHERE
        test_1        |                         true::BOOL
        test_1        |                 )
        test_1        |                     AS tab_417638
        test_1        |             ORDER BY
        test_1        |                 col_722735 NULLS FIRST, col_722736 NULLS FIRST
        test_1        |         compare_test.go:193: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 3adc6da4ccdf80618e6bbcee5ee9e503a92517e7:

        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('f', 'whuhic', 'bo', 'cwnq', 'ifx');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('x', 'i');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        |     --- FAIL: TestCompare/mutators (0.00s)
        test_1        |         compare_test.go:125: starting test: mutators
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 51 [running]:
        test_1        | testing.tRunner.func1.2(0x1fb8ac0, 0xc000cbe5e0)
        test_1        |     /usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc000603c80)
        test_1        |     /usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1fb8ac0, 0xc000cbe5e0)
        test_1        |     /usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x406df60, 0x31b8bd8, 0xc000dbd950, 0x31b8bd8, 0xc000dbd950, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:368 +0x5d3
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0xc000caa5d0, 0x406df60, 0x0, 0x0, 0x0, 0x0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:301 +0x17f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc0004f6480)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:220 +0x9e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc000caa5d0, 0xc000756640, 0x5, 0x5, 0x0, 0x0, 0x0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:251 +0xbeb
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0x26b38e0, 0xc000caa5d0, 0xc000756640, 0x5, 0x5, 0x0, 0xc0004aa320, 0xe0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:97 +0x4e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc000caa5d0, 0x214a516, 0x5, 0x5, 0xc0005bfa30, 0x3, 0x3, 0xe0, 0x4436d7, 0x8)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:89 +0x163
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0xc000caa5d0, 0x5, 0x4, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:91 +0x19e
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc000caa5d0, 0x4394f8, 0x30)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:77 +0x4f
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.wrapCommonSetup.func1(0xc000caa5d0, 0xc45d5533c412c4b3, 0x11)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:43 +0x44
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000603c80)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:127 +0x113
        test_1        | testing.tRunner(0xc000603c80, 0xc000caa570)
        test_1        |     /usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        |     /usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 999d35029f33a9b35dde0599c952efc83ed726a7:

        postgres_1    |                 postgres.public.table3 AS tab_29840
        postgres_1    |             WHERE
        postgres_1    |                 false::BOOL
        postgres_1    |             ORDER BY
        postgres_1    |                 tab_29840.crdb_internal_idx_expr ASC, tab_29840.crdb_internal_idx_expr
        postgres_1    |         )
        postgres_1    |             AS tab_29841
        postgres_1    |     ORDER BY
        postgres_1    |         col_43121 NULLS FIRST, col_43122 NULLS FIRST, col_43123 NULLS FIRST
        test_1        | --- FAIL: TestCompare (638.45s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (34.40s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             -   nil,
        test_1        |             +   string("BOX(-90 0,-45 45)"),
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_box2dfromgeohash('D'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_43124) AS tab_29842
        test_1        |             ORDER BY
        test_1        |                 CAST(col_43124 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_box2dfromgeohash('D':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D AS col_43124) AS tab_29842
        test_1        |             ORDER BY
        test_1        |                 CAST(col_43124 AS STRING) NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ f51352920c0af2bbede32dab8fee6424fc27a911:

        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (18.30s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             -   nil,
        test_1        |             +   string("BOX(-180 45,-135 90)H"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (st_box2dfromgeohash('B':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D::BOX2D || 'H':::STRING::STRING::STRING)::STRING
        test_1        |                             AS col_18185
        test_1        |                 )
        test_1        |                     AS tab_10018
        test_1        |             ORDER BY
        test_1        |                 col_18185 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (st_box2dfromgeohash('B'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D::BOX2D || 'H'::TEXT::TEXT::TEXT)::TEXT
        test_1        |                             AS col_18185
        test_1        |                 )
        test_1        |                     AS tab_10018
        test_1        |             ORDER BY
        test_1        |                 col_18185 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 4d0b749d263b95baf3054607d5f13a92cbb6a055:

        postgres_1    | 2021-12-20 06:14:46.524 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2021-12-20 06:14:46.529 UTC [68] LOG:  database system was shut down at 2021-12-20 06:14:46 UTC
        postgres_1    | 2021-12-20 06:14:46.534 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2021-12-20 06:14:49.352 UTC [78] ERROR:  functions in index expression must be marked IMMUTABLE
        postgres_1    | 2021-12-20 06:14:49.352 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 TIMESTAMP NOT NULL, col1_1 INT2, col1_2 INT8 NULL, col1_3 NAME NOT NULL, col1_4 DATE, col1_5 BYTEA, col1_6 OID NULL, col1_7 INT8[] NOT NULL, col1_8 FLOAT4, col1_9 GEOGRAPHY, col1_10 REGPROCEDURE, col1_11 BOOL NULL, col1_12 DECIMAL NOT NULL, col1_13 NAME NOT NULL, col1_14 OID NULL, col1_15 BOX2D, col1_16 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_7 IS NULL THEN ''::TEXT ELSE e'Hf6\x11MIW'::TEXT END) STORED);
        postgres_1    |     CREATE UNIQUE INDEX ON table1 (col1_1 ASC, col1_14);
        postgres_1    |     CREATE UNIQUE INDEX ON table1 ((CASE WHEN col1_0 IS NULL THEN e'\x15\x1e\x05Q+2'::TEXT ELSE e'?sR\n!)s*'::TEXT END), col1_13, col1_1 ASC, col1_14 ASC, col1_10 DESC, col1_11 DESC) INCLUDE (col1_0, col1_3, col1_4, col1_5, col1_12);
        postgres_1    |     CREATE TABLE table2 (col2_0 TEXT NOT NULL, col2_1 TIMESTAMPTZ NOT NULL, col2_2 REGROLE NOT NULL, col2_3 "char" NOT NULL, PRIMARY KEY (col2_3, col2_1, col2_0, col2_2));
        postgres_1    |     CREATE INDEX ON table2 (col2_0 ASC, col2_3);
        postgres_1    |     CREATE INDEX ON table2 (col2_0 ASC, col2_2 ASC, col2_1 ASC);
        postgres_1    |     CREATE INDEX ON table2 (lower(CAST(col2_2 AS TEXT)) DESC, col2_0 ASC);
        postgres_1    |     CREATE INDEX ON table2 (lower(col2_3) ASC, col2_2, lower(col2_0) ASC);
        postgres_1    |     CREATE TYPE rand_typ_0 AS ENUM ('tok', 'k', 'w', 'icjc');
        postgres_1    |     CREATE TYPE rand_typ_1 AS ENUM ('i', 'tia', 'nx', 'lftb', 'qqawsd', 'h');
        postgres_1    |     CREATE TYPE rand_typ_2 AS ENUM ('ucmxf', 'xkg', 'ey', 'ijfj');
        postgres_1    |     CREATE TYPE rand_typ_3 AS ENUM ('nsklw', 'zj', 'gtldxn', 'ybj', 'p');
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (607.76s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (2.39s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 TIMESTAMP NOT NULL, col1_1 INT2, col1_2 INT8 NULL, col1_3 NAME NOT NULL, col1_4 DATE, col1_5 BYTEA, col1_6 OID NULL, col1_7 INT8[] NOT NULL, col1_8 FLOAT4, col1_9 GEOGRAPHY, col1_10 REGPROCEDURE, col1_11 BOOL NULL, col1_12 DECIMAL NOT NULL, col1_13 NAME NOT NULL, col1_14 OID NULL, col1_15 BOX2D, col1_16 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_7 IS NULL THEN ''::TEXT ELSE e'Hf6\x11MIW'::TEXT END) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_1 ASC, col1_14);
        test_1        |             CREATE UNIQUE INDEX ON table1 ((CASE WHEN col1_0 IS NULL THEN e'\x15\x1e\x05Q+2'::TEXT ELSE e'?sR\n!)s*'::TEXT END), col1_13, col1_1 ASC, col1_14 ASC, col1_10 DESC, col1_11 DESC) INCLUDE (col1_0, col1_3, col1_4, col1_5, col1_12);
        test_1        |             CREATE TABLE table2 (col2_0 TEXT NOT NULL, col2_1 TIMESTAMPTZ NOT NULL, col2_2 REGROLE NOT NULL, col2_3 "char" NOT NULL, PRIMARY KEY (col2_3, col2_1, col2_0, col2_2));
        test_1        |             CREATE INDEX ON table2 (col2_0 ASC, col2_3);
        test_1        |             CREATE INDEX ON table2 (col2_0 ASC, col2_2 ASC, col2_1 ASC);
        test_1        |             CREATE INDEX ON table2 (lower(CAST(col2_2 AS TEXT)) DESC, col2_0 ASC);
        test_1        |             CREATE INDEX ON table2 (lower(col2_3) ASC, col2_2, lower(col2_0) ASC);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('tok', 'k', 'w', 'icjc');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('i', 'tia', 'nx', 'lftb', 'qqawsd', 'h');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('ucmxf', 'xkg', 'ey', 'ijfj');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('nsklw', 'zj', 'gtldxn', 'ybj', 'p');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 33ec37ae94ff96d2f5804506810fb436b186bc32:

        postgres_1    | 2021-12-21 06:15:41.484 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2021-12-21 06:15:41.488 UTC [68] LOG:  database system was shut down at 2021-12-21 06:15:41 UTC
        postgres_1    | 2021-12-21 06:15:41.492 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2021-12-21 06:15:43.340 UTC [78] ERROR:  syntax error at or near "ASC" at character 773
        postgres_1    | 2021-12-21 06:15:43.340 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 OID, col1_1 TIMETZ NULL, col1_2 VARCHAR NOT NULL, col1_3 GEOMETRY NOT NULL, col1_4 FLOAT4 NULL, col1_5 CHAR NULL, col1_6 REGPROCEDURE NOT NULL, col1_7 REGCLASS NOT NULL, col1_8 REGROLE, col1_9 GEOGRAPHY NOT NULL, col1_10 DATE NULL, col1_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_3 AS TEXT))) STORED, col1_12 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_7 AS TEXT))) STORED, UNIQUE (col1_2), UNIQUE (col1_10));
        postgres_1    |     CREATE TABLE table2 (col2_0 DECIMAL NOT NULL, col2_1 CHAR NULL, col2_2 NAME NOT NULL, col2_3 INET[], col2_4 INTERVAL NULL, col2_5 BIT(37) NOT NULL, col2_6 "char" NOT NULL, col2_7 TIMESTAMP, col2_8 OID, col2_9 REGCLASS NULL, col2_10 REGNAMESPACE NOT NULL, col2_11 DATE NULL, col2_12 OID NOT NULL, PRIMARY KEY (col2_2 ASC, col2_10 DESC, col2_6, col2_0 DESC, col2_12, col2_5 DESC), col2_13 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_4 AS TEXT))) STORED, col2_14 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_11 AS TEXT))) STORED, col2_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(col2_6)) STORED, UNIQUE (col2_5));
        postgres_1    |     CREATE TABLE table3 (col3_0 DECIMAL NOT NULL, col3_1 GEOGRAPHY NOT NULL, col3_2 FLOAT4 NULL, col3_3 INET NOT NULL, UNIQUE (col3_2 DESC, (col3_0 + 2.473344391090436850E+29::DECIMAL) DESC) WHERE (table3.col3_0 != 1::DECIMAL) OR (table3.col3_2 <= '-Inf'::FLOAT8), UNIQUE (col3_0, lower(CAST(col3_1 AS TEXT)) ASC, col3_3), INVERTED INDEX (col3_1 DESC) WHERE (table3.col3_2 > 0.0::FLOAT8) AND (table3.col3_0 >= '-Infinity'::DECIMAL));
        postgres_1    |     CREATE TABLE table4 (col4_0 BOOL[] NULL, col4_1 REGCLASS, col4_2 "char" NULL, col4_3 DATE NULL, col4_4 INTERVAL NULL, col4_5 BIT(40), col4_6 INET NOT NULL, col4_7 TEXT GENERATED ALWAYS AS (lower(CAST(col4_1 AS TEXT))) STORED, col4_8 TEXT GENERATED ALWAYS AS (lower(CAST(col4_5 AS TEXT))) STORED, UNIQUE (col4_7, lower(col4_2) ASC, col4_4 ASC, col4_3 DESC, col4_2, col4_1, col4_8 DESC, lower(col4_2)));
        postgres_1    |     CREATE TABLE table5 (col5_0 DATE NOT NULL, col5_1 INT8, col5_2 INET NULL, col5_3 BOOL, col5_4 FLOAT8, col5_5 JSONB, col5_6 CHAR NOT NULL, col5_7 DATE NULL, col5_8 BOX2D, col5_9 TEXT GENERATED ALWAYS AS (lower(CAST(col5_3 AS TEXT))) STORED, col5_10 TEXT GENERATED ALWAYS AS (lower(CAST(col5_3 AS TEXT))) STORED);
        postgres_1    |     ALTER TABLE table2 ADD FOREIGN KEY (col2_6) REFERENCES table1 (col1_2);
        postgres_1    |     ALTER TABLE table4 ADD FOREIGN KEY (col4_5) REFERENCES table2 (col2_5) ON DELETE CASCADE;
        postgres_1    |     ALTER TABLE table4 ADD FOREIGN KEY (col4_3) REFERENCES table1 (col1_10) ON DELETE RESTRICT;
        postgres_1    |     CREATE TYPE rand_typ_0 AS ENUM ('ndoew', 'g', 'nefwvv', 'ngq');
        postgres_1    |     CREATE TYPE rand_typ_1 AS ENUM ('nhvfz', 'zx');
        postgres_1    |     CREATE TYPE rand_typ_2 AS ENUM ('n', 'c', 'f', 'qwwf');
        postgres_1    |     CREATE TYPE rand_typ_3 AS ENUM ('qwvs');
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (607.85s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.28s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 OID, col1_1 TIMETZ NULL, col1_2 VARCHAR NOT NULL, col1_3 GEOMETRY NOT NULL, col1_4 FLOAT4 NULL, col1_5 CHAR NULL, col1_6 REGPROCEDURE NOT NULL, col1_7 REGCLASS NOT NULL, col1_8 REGROLE, col1_9 GEOGRAPHY NOT NULL, col1_10 DATE NULL, col1_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_3 AS TEXT))) STORED, col1_12 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_7 AS TEXT))) STORED, UNIQUE (col1_2), UNIQUE (col1_10));
        test_1        |             CREATE TABLE table2 (col2_0 DECIMAL NOT NULL, col2_1 CHAR NULL, col2_2 NAME NOT NULL, col2_3 INET[], col2_4 INTERVAL NULL, col2_5 BIT(37) NOT NULL, col2_6 "char" NOT NULL, col2_7 TIMESTAMP, col2_8 OID, col2_9 REGCLASS NULL, col2_10 REGNAMESPACE NOT NULL, col2_11 DATE NULL, col2_12 OID NOT NULL, PRIMARY KEY (col2_2 ASC, col2_10 DESC, col2_6, col2_0 DESC, col2_12, col2_5 DESC), col2_13 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_4 AS TEXT))) STORED, col2_14 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_11 AS TEXT))) STORED, col2_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(col2_6)) STORED, UNIQUE (col2_5));
        test_1        |             CREATE TABLE table3 (col3_0 DECIMAL NOT NULL, col3_1 GEOGRAPHY NOT NULL, col3_2 FLOAT4 NULL, col3_3 INET NOT NULL, UNIQUE (col3_2 DESC, (col3_0 + 2.473344391090436850E+29::DECIMAL) DESC) WHERE (table3.col3_0 != 1::DECIMAL) OR (table3.col3_2 <= '-Inf'::FLOAT8), UNIQUE (col3_0, lower(CAST(col3_1 AS TEXT)) ASC, col3_3), INVERTED INDEX (col3_1 DESC) WHERE (table3.col3_2 > 0.0::FLOAT8) AND (table3.col3_0 >= '-Infinity'::DECIMAL));
        test_1        |             CREATE TABLE table4 (col4_0 BOOL[] NULL, col4_1 REGCLASS, col4_2 "char" NULL, col4_3 DATE NULL, col4_4 INTERVAL NULL, col4_5 BIT(40), col4_6 INET NOT NULL, col4_7 TEXT GENERATED ALWAYS AS (lower(CAST(col4_1 AS TEXT))) STORED, col4_8 TEXT GENERATED ALWAYS AS (lower(CAST(col4_5 AS TEXT))) STORED, UNIQUE (col4_7, lower(col4_2) ASC, col4_4 ASC, col4_3 DESC, col4_2, col4_1, col4_8 DESC, lower(col4_2)));
        test_1        |             CREATE TABLE table5 (col5_0 DATE NOT NULL, col5_1 INT8, col5_2 INET NULL, col5_3 BOOL, col5_4 FLOAT8, col5_5 JSONB, col5_6 CHAR NOT NULL, col5_7 DATE NULL, col5_8 BOX2D, col5_9 TEXT GENERATED ALWAYS AS (lower(CAST(col5_3 AS TEXT))) STORED, col5_10 TEXT GENERATED ALWAYS AS (lower(CAST(col5_3 AS TEXT))) STORED);
        test_1        |             ALTER TABLE table2 ADD FOREIGN KEY (col2_6) REFERENCES table1 (col1_2);
        test_1        |             ALTER TABLE table4 ADD FOREIGN KEY (col4_5) REFERENCES table2 (col2_5) ON DELETE CASCADE;
        test_1        |             ALTER TABLE table4 ADD FOREIGN KEY (col4_3) REFERENCES table1 (col1_10) ON DELETE RESTRICT;
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('ndoew', 'g', 'nefwvv', 'ngq');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('nhvfz', 'zx');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('n', 'c', 'f', 'qwwf');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('qwvs');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: syntax error at or near "ASC" (SQLSTATE 42601)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 2282896401079fef362d5456b71b32dd600e52b0:

        test_1        |                         'H':::STRING::STRING AS col_286789
        test_1        |                     FROM
        test_1        |                         postgres.public.table4@[0] AS tab_165167
        test_1        |                         JOIN postgres.public.table3 AS tab_165168
        test_1        |                             JOIN postgres.public.table3 AS tab_165169 ON (tab_165168.col3_0) = (tab_165169.col3_0)
        test_1        |                             JOIN postgres.public.table4@[0] AS tab_165170
        test_1        |                                 JOIN postgres.public.table3@[0] AS tab_165171 ON (tab_165170.tableoid) = (tab_165171.col3_0)
        test_1        |                                 JOIN postgres.public.table4@[0] AS tab_165172 ON (tab_165170.col4_10) = (tab_165172.col4_4) ON
        test_1        |                                     (tab_165168.col3_2) = (tab_165172.col4_6) AND (tab_165169.col3_2) = (tab_165172.col4_6)
        test_1        |                             JOIN postgres.public.table3@[0] AS tab_165173 ON
        test_1        |                                     (tab_165171.col3_2) = (tab_165173.col3_2)
        test_1        |                                     AND (tab_165171.col3_3) = (tab_165173.col3_3)
        test_1        |                                     AND (tab_165172.col4_1) = (tab_165173.col3_0)
        test_1        |                             JOIN postgres.public.table3@table3_col3_0_col3_2_col3_3_key AS tab_165174 ON
        test_1        |                                     (tab_165171.col3_3) = (tab_165174.col3_2)
        test_1        |                                     AND (tab_165172.tableoid) = (tab_165174.col3_0)
        test_1        |                                     AND (tab_165171.col3_0) = (tab_165174.col3_0)
        test_1        |                             JOIN postgres.public.table5@table5_col5_3_col5_2_col5_8_expr_key AS tab_165175 ON
        test_1        |                                     (tab_165173.col3_2) = (tab_165175.col5_0)
        test_1        |                                     AND (tab_165169.col3_2) = (tab_165175.col5_0)
        test_1        |                                     AND (tab_165174.col3_0) = (tab_165175.col5_1)
        test_1        |                                     AND (tab_165168.col3_2) = (tab_165175.crdb_internal_idx_expr)
        test_1        |                                     AND (tab_165170.col4_2) = (tab_165175.col5_5) ON
        test_1        |                                 (tab_165167.col4_8) = (tab_165170.col4_9)
        test_1        |                                 AND (tab_165167.col4_9) = (tab_165170.col4_8)
        test_1        |                                 AND (tab_165167.col4_4) = (tab_165172.col4_8),
        test_1        |                         postgres.public.table4@[0] AS tab_165176
        test_1        |                     ORDER BY
        test_1        |                         tab_165167.col4_2 DESC, tab_165167.col4_4 ASC
        test_1        |                 )
        test_1        |                     AS tab_165177
        test_1        |             ORDER BY
        test_1        |                 col_286784 NULLS FIRST,
        test_1        |                 col_286785 NULLS FIRST,
        test_1        |                 col_286786 NULLS FIRST,
        test_1        |                 col_286787 NULLS FIRST,
        test_1        |                 col_286788 NULLS FIRST,
        test_1        |                 col_286789 NULLS FIRST
        test_1        |         compare_test.go:193: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 147ca220b715dbaadef5a8689e1894feecda5358:

        postgres_1    |     CREATE INDEX ON table1 (col1_1, lower(CAST(col1_6 AS TEXT)) ASC, col1_9 DESC, col1_7, col1_11, col1_2 ASC);
        postgres_1    |     CREATE INDEX ON table1 (col1_9, col1_6 DESC, col1_10 ASC, col1_12, lower(CAST(col1_4 AS TEXT)), lower(CAST(col1_0 AS TEXT)) ASC, col1_7, col1_11 DESC, col1_1 ASC, col1_3 ASC, col1_4);
        postgres_1    |     CREATE INDEX ON table1 (col1_5, col1_8 ASC, col1_11 ASC);
        postgres_1    |     CREATE INDEX ON table1 (lower(CAST(col1_0 AS TEXT)) ASC, col1_7 DESC);
        postgres_1    |     CREATE INDEX ON table1 (col1_3 ASC, col1_4 ASC, col1_6, col1_5 DESC, col1_2, col1_11 ASC, col1_12 ASC, col1_1, col1_10 ASC, col1_7 DESC, col1_9 ASC, col1_8 ASC);
        postgres_1    |     CREATE INDEX ON table1 (col1_5 ASC, col1_1 ASC, col1_2 DESC);
        postgres_1    |     CREATE TABLE table2 (col2_0 REGROLE NULL, col2_1 REGCLASS NULL, col2_2 INT2[], col2_3 TIME NULL, col2_4 INT8 NULL, col2_5 FLOAT8 NULL, col2_6 REGNAMESPACE NOT NULL, col2_7 REGROLE NULL, col2_8 CHAR NULL, col2_9 GEOGRAPHY, col2_10 REGROLE NOT NULL, col2_11 DECIMAL NOT NULL, col2_12 GEOGRAPHY NULL, col2_13 REGPROC NOT NULL, col2_14 INT8 NULL GENERATED ALWAYS AS (col2_4 + (-9022043841025872529)::INT8) STORED, col2_15 DECIMAL NOT NULL GENERATED ALWAYS AS (col2_11 + 54980389502053.99772::DECIMAL) STORED, col2_16 TEXT GENERATED ALWAYS AS (lower(CAST(col2_9 AS TEXT))) STORED, col2_17 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_6 IS NULL THEN 'LW'::TEXT ELSE '=ph/=SFiD'::TEXT END) STORED, col2_18 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col2_1 IS NULL THEN 'SY?X:'::TEXT ELSE 'U'::TEXT END) STORED);
        postgres_1    |     CREATE TABLE table3 (col3_0 INT2 NULL, col3_1 GEOMETRY NOT NULL, col3_2 INT2 NULL GENERATED ALWAYS AS (col3_0 + 11822::INT8) STORED);
        postgres_1    |     CREATE UNIQUE INDEX ON table3 (col3_0, col3_2);
        postgres_1    |     CREATE UNIQUE INDEX ON table3 (col3_0 DESC);
        postgres_1    |     CREATE INDEX ON table3 (lower(CAST(col3_1 AS TEXT)) ASC, col3_0 ASC);
        postgres_1    |     CREATE TYPE rand_typ_0 AS ENUM ('djmsir', 'bvhqf', 'r', 'mmfxgz');
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (608.26s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (5.14s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 BOX2D NOT NULL, col1_1 CHAR NOT NULL, col1_2 BOOL NOT NULL, col1_3 INET NOT NULL, col1_4 TIMESTAMP NOT NULL, col1_5 INTERVAL NOT NULL, col1_6 TIMETZ NOT NULL, PRIMARY KEY (col1_6, col1_3, col1_5, col1_4, col1_1, col1_2), col1_7 TEXT NOT NULL GENERATED ALWAYS AS (lower(col1_1)) STORED, col1_8 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_4 IS NULL THEN e'\t{9'::TEXT ELSE e'q\x06*Sl'::TEXT END) STORED, col1_9 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_5 AS TEXT))) STORED, col1_10 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_0 AS TEXT))) STORED, col1_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_5 AS TEXT))) STORED, col1_12 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_5 AS TEXT))) STORED);
        test_1        |             CREATE INDEX ON table1 (col1_1 DESC, col1_9 DESC, col1_6 ASC, lower(CAST(col1_3 AS TEXT)) ASC, col1_3, col1_2 DESC, col1_11, col1_7 ASC, col1_10) INCLUDE (col1_0, col1_8);
        test_1        |             CREATE UNIQUE INDEX ON table1 ((CASE WHEN col1_4 IS NULL THEN '%y#Ie'::TEXT ELSE e'\x03\'\x05s'::TEXT END) ASC, col1_7, col1_10 ASC, col1_1 ASC, col1_3, col1_5, col1_9 DESC, col1_11 ASC, col1_12 ASC, col1_2 DESC, col1_6 ASC, col1_4, col1_8 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_11, col1_5, col1_4 ASC, col1_7 ASC, col1_1, col1_6 DESC, col1_10 ASC, col1_8 ASC, col1_3 ASC, col1_9, col1_12, lower(CAST(col1_2 AS TEXT)) DESC);
        test_1        |             CREATE INDEX ON table1 (col1_1, lower(CAST(col1_6 AS TEXT)) ASC, col1_9 DESC, col1_7, col1_11, col1_2 ASC);
        test_1        |             CREATE INDEX ON table1 (col1_9, col1_6 DESC, col1_10 ASC, col1_12, lower(CAST(col1_4 AS TEXT)), lower(CAST(col1_0 AS TEXT)) ASC, col1_7, col1_11 DESC, col1_1 ASC, col1_3 ASC, col1_4);
        test_1        |             CREATE INDEX ON table1 (col1_5, col1_8 ASC, col1_11 ASC);
        test_1        |             CREATE INDEX ON table1 (lower(CAST(col1_0 AS TEXT)) ASC, col1_7 DESC);
        test_1        |             CREATE INDEX ON table1 (col1_3 ASC, col1_4 ASC, col1_6, col1_5 DESC, col1_2, col1_11 ASC, col1_12 ASC, col1_1, col1_10 ASC, col1_7 DESC, col1_9 ASC, col1_8 ASC);
        test_1        |             CREATE INDEX ON table1 (col1_5 ASC, col1_1 ASC, col1_2 DESC);
        test_1        |             CREATE TABLE table2 (col2_0 REGROLE NULL, col2_1 REGCLASS NULL, col2_2 INT2[], col2_3 TIME NULL, col2_4 INT8 NULL, col2_5 FLOAT8 NULL, col2_6 REGNAMESPACE NOT NULL, col2_7 REGROLE NULL, col2_8 CHAR NULL, col2_9 GEOGRAPHY, col2_10 REGROLE NOT NULL, col2_11 DECIMAL NOT NULL, col2_12 GEOGRAPHY NULL, col2_13 REGPROC NOT NULL, col2_14 INT8 NULL GENERATED ALWAYS AS (col2_4 + (-9022043841025872529)::INT8) STORED, col2_15 DECIMAL NOT NULL GENERATED ALWAYS AS (col2_11 + 54980389502053.99772::DECIMAL) STORED, col2_16 TEXT GENERATED ALWAYS AS (lower(CAST(col2_9 AS TEXT))) STORED, col2_17 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_6 IS NULL THEN 'LW'::TEXT ELSE '=ph/=SFiD'::TEXT END) STORED, col2_18 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col2_1 IS NULL THEN 'SY?X:'::TEXT ELSE 'U'::TEXT END) STORED);
        test_1        |             CREATE TABLE table3 (col3_0 INT2 NULL, col3_1 GEOMETRY NOT NULL, col3_2 INT2 NULL GENERATED ALWAYS AS (col3_0 + 11822::INT8) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_0, col3_2);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_0 DESC);
        test_1        |             CREATE INDEX ON table3 (lower(CAST(col3_1 AS TEXT)) ASC, col3_0 ASC);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('djmsir', 'bvhqf', 'r', 'mmfxgz');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ ec9330f86763371c445acdc317088e24cbcbaac3:

        postgres_1    | 2021-12-24 06:15:44.532 UTC [50] LOG:  shutting down
        postgres_1    | 2021-12-24 06:15:44.631 UTC [48] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2021-12-24 06:15:44.749 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2021-12-24 06:15:44.749 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2021-12-24 06:15:44.749 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2021-12-24 06:15:44.753 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2021-12-24 06:15:44.758 UTC [67] LOG:  database system was shut down at 2021-12-24 06:15:44 UTC
        postgres_1    | 2021-12-24 06:15:44.763 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2021-12-24 06:15:46.216 UTC [77] ERROR:  syntax error at or near "(" at character 498
        postgres_1    | 2021-12-24 06:15:46.216 UTC [77] STATEMENT:  CREATE TABLE table1 (col1_0 GEOGRAPHY NOT NULL, col1_1 REGNAMESPACE, col1_2 REGCLASS, col1_3 INT4);
        postgres_1    |     CREATE TABLE table2 (col2_0 REGROLE NOT NULL, col2_1 BOX2D NULL, col2_2 JSONB NULL, col2_3 GEOMETRY NULL, col2_4 OID, col2_5 TIMESTAMP NULL, col2_6 UUID NULL, col2_7 GEOMETRY, col2_8 BYTEA, col2_9 TIMETZ NOT NULL, col2_10 BOOL, col2_11 BIT(49) NOT NULL, col2_12 FLOAT8, col2_13 UUID, col2_14 TIMESTAMP, col2_15 FLOAT4 NOT NULL, col2_16 FLOAT4 GENERATED ALWAYS AS (col2_15 + col2_12) STORED, INDEX (col2_14) WHERE (((((((table2.col2_9 = '00:00:00+15:59:00'::TIMETZ) AND (table2.col2_15 > 1.0::FLOAT8)) OR (table2.col2_16 > 1.0::FLOAT8)) OR table2.col2_10) OR (table2.col2_14 = '0001-01-01 00:00:00'::TIMESTAMP)) OR (table2.col2_12 >= 1.7976931348623157e+308::FLOAT8)) AND (table2.col2_8 >= e'\\x27'::BYTEA)) AND (table2.col2_5 >= '-2000-01-01 00:00:00'::TIMESTAMP));
        postgres_1    |     CREATE TABLE table3 (col3_0 REGPROC NOT NULL, col3_1 "char" NOT NULL, col3_2 TIMESTAMP NULL, col3_3 VARCHAR NULL, col3_4 "char" NULL, col3_5 BOX2D, col3_6 NAME NOT NULL, col3_7 JSONB, col3_8 INTERVAL NOT NULL, col3_9 TIMESTAMP NULL, col3_10 DATE NULL, col3_11 REGPROC, col3_12 REGPROCEDURE NULL, col3_13 GEOMETRY NOT NULL, col3_14 TEXT NOT NULL GENERATED ALWAYS AS (lower(col3_6)) STORED, col3_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(col3_6)) STORED, col3_16 TEXT NULL GENERATED ALWAYS AS (lower(col3_4)) STORED, col3_17 TEXT GENERATED ALWAYS AS (lower(CAST(col3_7 AS TEXT))) STORED);
        postgres_1    |     CREATE TYPE rand_typ_0 AS ENUM ('kfrlk', 'lbue');
        postgres_1    |     CREATE TYPE rand_typ_1 AS ENUM ('wpij', 'pctfsr', 'jkcyc', 'db', 'cfp');
        postgres_1    |     CREATE TYPE rand_typ_2 AS ENUM ('d', 'vjohj');
        postgres_1    |     CREATE TYPE rand_typ_3 AS ENUM ('bjl', 'brlty', 'tl', 'vl', 'o', 'qyck');
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (604.46s)
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (0.88s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 GEOGRAPHY NOT NULL, col1_1 REGNAMESPACE, col1_2 REGCLASS, col1_3 INT4);
        test_1        |             CREATE TABLE table2 (col2_0 REGROLE NOT NULL, col2_1 BOX2D NULL, col2_2 JSONB NULL, col2_3 GEOMETRY NULL, col2_4 OID, col2_5 TIMESTAMP NULL, col2_6 UUID NULL, col2_7 GEOMETRY, col2_8 BYTEA, col2_9 TIMETZ NOT NULL, col2_10 BOOL, col2_11 BIT(49) NOT NULL, col2_12 FLOAT8, col2_13 UUID, col2_14 TIMESTAMP, col2_15 FLOAT4 NOT NULL, col2_16 FLOAT4 GENERATED ALWAYS AS (col2_15 + col2_12) STORED, INDEX (col2_14) WHERE (((((((table2.col2_9 = '00:00:00+15:59:00'::TIMETZ) AND (table2.col2_15 > 1.0::FLOAT8)) OR (table2.col2_16 > 1.0::FLOAT8)) OR table2.col2_10) OR (table2.col2_14 = '0001-01-01 00:00:00'::TIMESTAMP)) OR (table2.col2_12 >= 1.7976931348623157e+308::FLOAT8)) AND (table2.col2_8 >= e'\\x27'::BYTEA)) AND (table2.col2_5 >= '-2000-01-01 00:00:00'::TIMESTAMP));
        test_1        |             CREATE TABLE table3 (col3_0 REGPROC NOT NULL, col3_1 "char" NOT NULL, col3_2 TIMESTAMP NULL, col3_3 VARCHAR NULL, col3_4 "char" NULL, col3_5 BOX2D, col3_6 NAME NOT NULL, col3_7 JSONB, col3_8 INTERVAL NOT NULL, col3_9 TIMESTAMP NULL, col3_10 DATE NULL, col3_11 REGPROC, col3_12 REGPROCEDURE NULL, col3_13 GEOMETRY NOT NULL, col3_14 TEXT NOT NULL GENERATED ALWAYS AS (lower(col3_6)) STORED, col3_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(col3_6)) STORED, col3_16 TEXT NULL GENERATED ALWAYS AS (lower(col3_4)) STORED, col3_17 TEXT GENERATED ALWAYS AS (lower(CAST(col3_7 AS TEXT))) STORED);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('kfrlk', 'lbue');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('wpij', 'pctfsr', 'jkcyc', 'db', 'cfp');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('d', 'vjohj');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('bjl', 'brlty', 'tl', 'vl', 'o', 'qyck');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: syntax error at or near "(" (SQLSTATE 42601)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 2c4bb88e5318fe187e1bf6cb134b31bd63f63528:

        postgres_1    |         (
        postgres_1    |             SELECT
        postgres_1    |                 (NULL::GEOMETRY::GEOMETRY || tab_32733.col2_18::TEXT)::TEXT AS col_63396
        postgres_1    |             FROM
        postgres_1    |                 postgres.public.table2 AS tab_32733
        postgres_1    |         )
        postgres_1    |             AS tab_32734
        postgres_1    |     ORDER BY
        postgres_1    |         col_63396 NULLS FIRST
        test_1        | --- FAIL: TestCompare (684.74s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (80.59s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             -   nil,
        test_1        |             +   string("BOX(-135 45,-90 90)"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_box2dfromgeohash('C':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D AS col_63659) AS tab_32879
        test_1        |             ORDER BY
        test_1        |                 CAST(col_63659 AS STRING) NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_box2dfromgeohash('C'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_63659) AS tab_32879
        test_1        |             ORDER BY
        test_1        |                 CAST(col_63659 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ c22ac33a023323cb76fde367b766ef988d6e27f7:

        postgres_1    | 2021-12-30 06:16:31.524 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2021-12-30 06:16:34.609 UTC [78] ERROR:  functions in index expression must be marked IMMUTABLE
        postgres_1    | 2021-12-30 06:16:34.609 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 "char" NULL, col1_1 BYTEA, col1_2 REGPROC, col1_3 TEXT GENERATED ALWAYS AS (CASE WHEN col1_2 IS NULL THEN e'\x7fL\x1aH}EUyP'::TEXT ELSE e'ZI%6\x13w3h{'::TEXT END) STORED);
        postgres_1    |     CREATE INDEX ON table1 ((CASE WHEN col1_1 IS NULL THEN e'\f'::TEXT ELSE '}n0-y7J'::TEXT END) ASC, lower(CAST(col1_2 AS TEXT)) ASC) INCLUDE (col1_2);
        postgres_1    |     CREATE TABLE table2 (col2_0 CHAR NOT NULL, col2_1 GEOGRAPHY, col2_2 OID NULL, col2_3 REGPROC NOT NULL, col2_4 TIME, col2_5 BOOL NULL, col2_6 VARCHAR, col2_7 UUID NOT NULL, col2_8 TEXT[] NULL, col2_9 BYTEA NULL, col2_10 FLOAT8 NULL, col2_11 REGROLE, col2_12 BIT(11), col2_13 REGPROC NULL, col2_14 TEXT GENERATED ALWAYS AS (lower(CAST(col2_12 AS TEXT))) STORED, col2_15 TEXT GENERATED ALWAYS AS (lower(CAST(col2_4 AS TEXT))) STORED);
        postgres_1    |     CREATE INDEX ON table2 (col2_15 ASC, col2_13, col2_9, col2_12 DESC, col2_5 ASC, col2_10 ASC, col2_4 DESC, col2_11) INCLUDE (col2_1, col2_2, col2_7);
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_5 DESC, (CASE WHEN col2_8 IS NULL THEN 'c8Tb-'::TEXT ELSE e'^\x17Y\x19B!\tq$'::TEXT END), col2_6 DESC, col2_11, col2_7 DESC, col2_2, col2_12 ASC, col2_10 ASC, col2_9 DESC, col2_15 ASC) INCLUDE (col2_0, col2_3, col2_4);
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_0);
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_9, col2_2);
        postgres_1    |     ALTER TABLE table1 ADD FOREIGN KEY (col1_0) REFERENCES table2 (col2_0) ON DELETE CASCADE ON UPDATE CASCADE;
        postgres_1    |     ALTER TABLE table1 ADD FOREIGN KEY (col1_1, col1_2) REFERENCES table2 (col2_9, col2_2);
        postgres_1    |     CREATE TYPE rand_typ_0 AS ENUM ('ur', 'nf', 'j', 'yiom', 'an');
        postgres_1    |     CREATE TYPE rand_typ_1 AS ENUM ('xnoc', 'nthxum');
        postgres_1    |     CREATE TYPE rand_typ_2 AS ENUM ('j', 'rrj', 'wupct', 'kiygk', 'tznppo');
        postgres_1    |     CREATE TYPE rand_typ_3 AS ENUM ('xawf', 'uapx');
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (604.81s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (2.80s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 "char" NULL, col1_1 BYTEA, col1_2 REGPROC, col1_3 TEXT GENERATED ALWAYS AS (CASE WHEN col1_2 IS NULL THEN e'\x7fL\x1aH}EUyP'::TEXT ELSE e'ZI%6\x13w3h{'::TEXT END) STORED);
        test_1        |             CREATE INDEX ON table1 ((CASE WHEN col1_1 IS NULL THEN e'\f'::TEXT ELSE '}n0-y7J'::TEXT END) ASC, lower(CAST(col1_2 AS TEXT)) ASC) INCLUDE (col1_2);
        test_1        |             CREATE TABLE table2 (col2_0 CHAR NOT NULL, col2_1 GEOGRAPHY, col2_2 OID NULL, col2_3 REGPROC NOT NULL, col2_4 TIME, col2_5 BOOL NULL, col2_6 VARCHAR, col2_7 UUID NOT NULL, col2_8 TEXT[] NULL, col2_9 BYTEA NULL, col2_10 FLOAT8 NULL, col2_11 REGROLE, col2_12 BIT(11), col2_13 REGPROC NULL, col2_14 TEXT GENERATED ALWAYS AS (lower(CAST(col2_12 AS TEXT))) STORED, col2_15 TEXT GENERATED ALWAYS AS (lower(CAST(col2_4 AS TEXT))) STORED);
        test_1        |             CREATE INDEX ON table2 (col2_15 ASC, col2_13, col2_9, col2_12 DESC, col2_5 ASC, col2_10 ASC, col2_4 DESC, col2_11) INCLUDE (col2_1, col2_2, col2_7);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_5 DESC, (CASE WHEN col2_8 IS NULL THEN 'c8Tb-'::TEXT ELSE e'^\x17Y\x19B!\tq$'::TEXT END), col2_6 DESC, col2_11, col2_7 DESC, col2_2, col2_12 ASC, col2_10 ASC, col2_9 DESC, col2_15 ASC) INCLUDE (col2_0, col2_3, col2_4);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_0);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_9, col2_2);
        test_1        |             ALTER TABLE table1 ADD FOREIGN KEY (col1_0) REFERENCES table2 (col2_0) ON DELETE CASCADE ON UPDATE CASCADE;
        test_1        |             ALTER TABLE table1 ADD FOREIGN KEY (col1_1, col1_2) REFERENCES table2 (col2_9, col2_2);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('ur', 'nf', 'j', 'yiom', 'an');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('xnoc', 'nthxum');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('j', 'rrj', 'wupct', 'kiygk', 'tznppo');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('xawf', 'uapx');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ dc72c17f280dc20fa59970209c0e975e4072f91e:

        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         3::OID::OID AS col_242312,
        test_1        |                         tab_125396.col1_3 AS col_242313,
        test_1        |                         tab_125396.col1_4 AS col_242314,
        test_1        |                         tab_125396.col1_11 AS col_242315,
        test_1        |                         tab_125396.col1_12 AS col_242316,
        test_1        |                         tab_125396.col1_2 AS col_242317,
        test_1        |                         (tab_125396.col1_6::INET[] || '::/0'::INET::INET::INET)::INET[] AS col_242318
        test_1        |                     FROM
        test_1        |                         (
        test_1        |                             VALUES
        test_1        |                                 (NULL::TIMESTAMPTZ),
        test_1        |                                 ('2000-01-01 07:00:00+00:00'::TIMESTAMPTZ::TIMESTAMPTZ),
        test_1        |                                 ('2000-01-01 02:00:00+00:00'::TIMESTAMPTZ::TIMESTAMPTZ),
        test_1        |                                 ('2000-01-01 08:00:00+00:00'::TIMESTAMPTZ::TIMESTAMPTZ),
        test_1        |                                 ('2000-01-01 07:00:00+00:00'::TIMESTAMPTZ::TIMESTAMPTZ)
        test_1        |                         )
        test_1        |                             AS tab_125395 (col_242311)
        test_1        |                         LEFT JOIN postgres.public.table1 AS tab_125396 ON NULL::BOOL
        test_1        |                     WHERE
        test_1        |                         true::BOOL
        test_1        |                     ORDER BY
        test_1        |                         tab_125396.col1_7,
        test_1        |                         tab_125395.col_242311 ASC,
        test_1        |                         tab_125396.col1_4 DESC,
        test_1        |                         tab_125396.col1_2 DESC,
        test_1        |                         tab_125396.col1_3
        test_1        |                 )
        test_1        |                     AS tab_125397
        test_1        |             ORDER BY
        test_1        |                 col_242312 NULLS FIRST,
        test_1        |                 col_242313 NULLS FIRST,
        test_1        |                 col_242314 NULLS FIRST,
        test_1        |                 col_242315 NULLS FIRST,
        test_1        |                 col_242316 NULLS FIRST,
        test_1        |                 col_242317 NULLS FIRST,
        test_1        |                 col_242318 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ fb88f951323864fafd104e132cbf1f2f22f2e3ac:

        postgres_1    |                 st_relatematch('C'::TEXT::TEXT::TEXT, 'D'::TEXT::TEXT::TEXT)::BOOL
        postgres_1    |             GROUP BY
        postgres_1    |                 tab_29169.col4_1, tab_29169.col4_0
        postgres_1    |             ORDER BY
        postgres_1    |                 tab_29169.col4_1 ASC, tab_29169.col4_0 DESC
        postgres_1    |         )
        postgres_1    |             AS tab_29170
        postgres_1    |     ORDER BY
        postgres_1    |         col_43080 NULLS FIRST
        test_1        | --- FAIL: TestCompare (649.40s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (45.96s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare postgres to cockroach1:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             -   string("BOX(0 -90,45 -45)"),
        test_1        |             +   nil,
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_box2dfromgeohash('H':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D AS col_43188) AS tab_29244
        test_1        |             ORDER BY
        test_1        |                 CAST(col_43188 AS STRING) NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_box2dfromgeohash('H'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_43188) AS tab_29244
        test_1        |             ORDER BY
        test_1        |                 CAST(col_43188 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 0c8df44947208da2f6234d2736e8ab6d3b0937c0:

        test_1        |                                                 (
        test_1        |                                                     VALUES
        test_1        |                                                         ('01:33:22.376917':::TIME),
        test_1        |                                                         ('04:03:27.172455':::TIME),
        test_1        |                                                         ('18:38:45.555543':::TIME)
        test_1        |                                                 )
        test_1        |                                                     AS tab_176813 (col_258104)
        test_1        |                                         )
        test_1        |                                 SELECT
        test_1        |                                     tab_176810.col1_3::INT8 AS col_258105
        test_1        |                                 FROM
        test_1        |                                     postgres.public.table2@table2_col2_0_idx1 AS tab_176814
        test_1        |                                 WHERE
        test_1        |                                     true
        test_1        |                             )
        test_1        |                 )
        test_1        |                     AS tab_176815
        test_1        |             ORDER BY
        test_1        |                 col_258106 NULLS FIRST,
        test_1        |                 col_258107 NULLS FIRST,
        test_1        |                 col_258108 NULLS FIRST,
        test_1        |                 col_258109 NULLS FIRST,
        test_1        |                 col_258110 NULLS FIRST,
        test_1        |                 col_258111 NULLS FIRST,
        test_1        |                 col_258112 NULLS FIRST,
        test_1        |                 col_258113 NULLS FIRST,
        test_1        |                 col_258114 NULLS FIRST,
        test_1        |                 col_258115 NULLS FIRST,
        test_1        |                 col_258116 NULLS FIRST,
        test_1        |                 col_258117 NULLS FIRST,
        test_1        |                 col_258118 NULLS FIRST,
        test_1        |                 col_258119 NULLS FIRST,
        test_1        |                 col_258120 NULLS FIRST,
        test_1        |                 col_258121 NULLS FIRST,
        test_1        |                 col_258122 NULLS FIRST,
        test_1        |                 col_258123 NULLS FIRST,
        test_1        |                 col_258124 NULLS FIRST,
        test_1        |                 col_258125 NULLS FIRST
        test_1        |         compare_test.go:193: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 12c606395dc2cfb35bd82972ab65c4453f33c400:

        test_1        |                                 JOIN postgres.public.table1@[0] AS tab_196483
        test_1        |                                     JOIN postgres.public.table1@[0] AS tab_196484
        test_1        |                                         JOIN postgres.public.table1@primary AS tab_196485 ON
        test_1        |                                                 (tab_196484.col1_11) = (tab_196485.col1_12) ON
        test_1        |                                             (tab_196483.col1_5) = (tab_196485.col1_5) ON
        test_1        |                                         (tab_196482.col1_12) = (tab_196485.col1_14) ON
        test_1        |                                     (tab_196478.col1_12) = (tab_196485.col1_12)
        test_1        |                                     AND (tab_196478.tableoid) = (tab_196484.tableoid)
        test_1        |                                     AND (tab_196478.col1_12) = (tab_196481.col1_11)
        test_1        |                                     AND (tab_196478.col1_9) = (tab_196481.col1_9) ON
        test_1        |                                 (tab_196477.col1_14) = (tab_196478.col1_13)
        test_1        |                                 AND (tab_196477.col1_7) = (tab_196483.col1_7)
        test_1        |                                 AND (tab_196477.col1_13) = (tab_196483.col1_13),
        test_1        |                         postgres.public.table1@[0] AS tab_196486
        test_1        |                     ORDER BY
        test_1        |                         tab_196478.col1_1,
        test_1        |                         tab_196484.col1_1 ASC,
        test_1        |                         tab_196478.crdb_internal_mvcc_timestamp DESC,
        test_1        |                         tab_196482.col1_0 ASC
        test_1        |                 )
        test_1        |                     AS tab_196487
        test_1        |             ORDER BY
        test_1        |                 col_340147 NULLS FIRST,
        test_1        |                 col_340148 NULLS FIRST,
        test_1        |                 col_340149 NULLS FIRST,
        test_1        |                 col_340150 NULLS FIRST,
        test_1        |                 col_340151 NULLS FIRST,
        test_1        |                 col_340152 NULLS FIRST,
        test_1        |                 col_340153 NULLS FIRST,
        test_1        |                 col_340154 NULLS FIRST,
        test_1        |                 col_340155 NULLS FIRST,
        test_1        |                 col_340156 NULLS FIRST,
        test_1        |                 col_340157 NULLS FIRST,
        test_1        |                 col_340158 NULLS FIRST,
        test_1        |                 col_340159 NULLS FIRST,
        test_1        |                 col_340160 NULLS FIRST,
        test_1        |                 col_340161 NULLS FIRST,
        test_1        |                 col_340162 NULLS FIRST
        test_1        |         compare_test.go:193: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ f26513f0b00c95e2e98d5ce3032abd7e65ff0e3d:

        postgres_1    |     CREATE TYPE rand_typ_1 AS ENUM ('f', 'idg', 'xhh');
        postgres_1    |     CREATE TYPE rand_typ_2 AS ENUM ('xyo', 'zpy', 'qbua', 'cvh');
        postgres_1    |     CREATE TYPE rand_typ_3 AS ENUM ('czvtx', 'bw', 'q');
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (608.98s)
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (5.55s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 REGPROCEDURE NULL, col1_1 INT4, col1_2 "char", col1_3 GEOMETRY NULL, col1_4 REGPROCEDURE NULL, col1_5 UUID NULL, col1_6 BIT(43) NULL, col1_7 REGNAMESPACE, col1_8 GEOMETRY, col1_9 TIMESTAMP NULL, col1_10 REGROLE NULL, col1_11 FLOAT8 NOT NULL, col1_12 "char", col1_13 INT2 NULL, col1_14 BYTEA NULL, col1_15 TEXT, col1_16 FLOAT4 NULL, col1_17 REGROLE NULL, col1_18 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col1_0 IS NULL THEN e'jz(\x1ef>\x1b/}'::TEXT ELSE e'\''::TEXT END) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_6 DESC, col1_12, col1_10 ASC, (col1_11 + col1_16) ASC, col1_13, col1_4 ASC, (CASE WHEN col1_14 IS NULL THEN 'Q;pCfI;gG'::TEXT ELSE e'\rba3\x10j'::TEXT END) DESC) INCLUDE (col1_1, col1_3, col1_5, col1_8, col1_16);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_11, col1_16, col1_2 ASC, col1_14 ASC, col1_12 DESC, col1_5 ASC, col1_18, col1_6 DESC, col1_17 ASC, col1_7 DESC, col1_13 ASC, col1_9 DESC, (CASE WHEN col1_14 IS NULL THEN e'-\x19\x02dP~>!%'::TEXT ELSE ''::TEXT END) ASC) INCLUDE (col1_0, col1_1, col1_4, col1_10);
        test_1        |             CREATE TABLE table2 (col2_0 DECIMAL NULL, col2_1 GEOGRAPHY NULL, col2_2 INT2, col2_3 BOOL NULL, col2_4 BOX2D NULL, col2_5 OID NOT NULL, col2_6 DATE NULL, col2_7 BOOL NOT NULL, col2_8 INT2 GENERATED ALWAYS AS (col2_2 + 2509::INT8) STORED, col2_9 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_1 AS TEXT))) STORED, col2_10 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_3 AS TEXT))) STORED, col2_11 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_4 AS TEXT))) STORED, col2_12 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col2_6 IS NULL THEN e'Sa\\'::TEXT ELSE e'\x10t'::TEXT END) STORED, col2_13 DECIMAL NULL GENERATED ALWAYS AS (col2_0 + (-3.282095538818727175E+30)::DECIMAL) STORED);
        test_1        |             CREATE INDEX ON table2 (col2_13, col2_9 ASC, (col2_0 + 64483532720.89331766::DECIMAL) ASC, col2_11, col2_3 ASC, col2_7, col2_10 DESC) INCLUDE (col2_1, col2_2, col2_4, col2_6);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_11 ASC, lower(CAST(col2_7 AS TEXT)) ASC);
        test_1        |             CREATE INDEX ON table2 (col2_9 ASC, lower(CAST(col2_6 AS TEXT)) DESC, col2_6 DESC) INCLUDE (col2_1, col2_2, col2_3, col2_5, col2_7, col2_12, col2_13);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_9) INCLUDE (col2_1, col2_4, col2_5, col2_6, col2_7, col2_13);
        test_1        |             CREATE INDEX ON table2 ((col2_0 + 'Infinity'::DECIMAL), col2_0 ASC, col2_10 DESC, col2_3 DESC, col2_2 ASC, col2_5 ASC, col2_7 DESC, lower(CAST(col2_1 AS TEXT)) ASC, col2_13 ASC, col2_9 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_2 ASC, col2_12 DESC, lower(CAST(col2_7 AS TEXT)), col2_3 DESC, col2_5, col2_8 DESC, col2_7 DESC, col2_0, col2_6 ASC, col2_9 ASC, col2_13 ASC, col2_10 ASC);
        test_1        |             CREATE TABLE table3 (col3_0 TEXT, col3_1 REGNAMESPACE NULL, col3_2 OID NOT NULL, col3_3 INT2 NULL, col3_4 OID NULL, col3_5 REGNAMESPACE, col3_6 TIMESTAMP, col3_7 REGTYPE, col3_8 FLOAT8 NULL, col3_9 BOX2D NOT NULL, col3_10 CHAR NOT NULL, PRIMARY KEY (col3_10), col3_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col3_9 AS TEXT))) STORED);
        test_1        |             CREATE INDEX ON table3 (col3_11 ASC, col3_7, (col3_3 + 16218::INT8), col3_6 DESC, col3_2 ASC) INCLUDE (col3_0, col3_1, col3_3, col3_4, col3_8);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_10 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_2, (CASE WHEN col3_2 IS NULL THEN '3``lP&{'::TEXT ELSE e'\x05\x1a\x06'::TEXT END) ASC, col3_7 DESC, col3_0 ASC, col3_10 ASC, col3_3 DESC, col3_8, col3_6 DESC, col3_1 ASC, col3_5 DESC, col3_4 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_5, col3_4 DESC) INCLUDE (col3_1, col3_2, col3_6, col3_9);
        test_1        |             CREATE INDEX ON table3 (col3_6, col3_11, col3_5 DESC, col3_8 DESC, col3_2 ASC, col3_1 ASC, col3_10, col3_0 ASC, lower(col3_10) ASC, col3_4 ASC);
        test_1        |             CREATE TABLE table4 (col4_0 "char"[] NOT NULL, col4_1 INT8 NOT NULL, col4_2 REGROLE NOT NULL, col4_3 REGCLASS, col4_4 DECIMAL NOT NULL, col4_5 GEOMETRY NOT NULL, col4_6 INT8, col4_7 UUID NOT NULL, col4_8 BOOL, col4_9 GEOGRAPHY, col4_10 DATE NOT NULL, col4_11 OID NULL, col4_12 TEXT GENERATED ALWAYS AS (lower(CAST(col4_9 AS TEXT))) STORED, col4_13 INT8 GENERATED ALWAYS AS (col4_6 + col4_1) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table4 ((col4_1 + col4_6) ASC, col4_1 ASC) INCLUDE (col4_3, col4_4, col4_8, col4_13);
        test_1        |             CREATE INDEX ON table4 (col4_3 DESC, col4_11);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_2);
        test_1        |             ALTER TABLE table3 ADD FOREIGN KEY (col3_1) REFERENCES table4 (col4_2) ON UPDATE CASCADE;
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('qlplih');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('f', 'idg', 'xhh');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('xyo', 'zpy', 'qbua', 'cvh');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('czvtx', 'bw', 'q');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ aabce20e9f7a7f00323605d976c8d4db799273c9:

        postgres_1    |     CREATE TYPE rand_typ_1 AS ENUM ('iv', 'mnhs', 'hte', 'ysni', 'hgkzpw');
        postgres_1    |     CREATE TYPE rand_typ_2 AS ENUM ('dt', 'qn');
        postgres_1    |     CREATE TYPE rand_typ_3 AS ENUM ('umctxx', 'ino', 'tysmj', 'cugtbn', 'su', 'egnzp');
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (609.67s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (5.70s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 DECIMAL NOT NULL, col1_1 REGCLASS NOT NULL, col1_2 CHAR NOT NULL, col1_3 BOX2D NOT NULL, col1_4 REGPROCEDURE NOT NULL, col1_5 INT2 NOT NULL, col1_6 REGNAMESPACE NOT NULL, col1_7 BYTEA NOT NULL, col1_8 "char" NOT NULL, col1_9 REGCLASS NOT NULL, col1_10 UUID NOT NULL, PRIMARY KEY (col1_9, col1_1, col1_0, col1_7, col1_4, col1_6, col1_10, col1_2, col1_5), col1_11 DECIMAL NOT NULL GENERATED ALWAYS AS (col1_0 + (-2.891998222617653437E+30)::DECIMAL) STORED, col1_12 TEXT NOT NULL GENERATED ALWAYS AS (lower(col1_8)) STORED, col1_13 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_7 IS NULL THEN ''::TEXT ELSE '~cLQRYPA'::TEXT END) STORED, col1_14 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_1 IS NULL THEN ''::TEXT ELSE ''::TEXT END) STORED, col1_15 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_7 IS NULL THEN e'qE\x0f}|\x1e\x05<z'::TEXT ELSE 'GlnW]'::TEXT END) STORED, col1_16 INT2 NOT NULL GENERATED ALWAYS AS (col1_5 + (-7498)::INT8) STORED, col1_17 DECIMAL NOT NULL GENERATED ALWAYS AS (col1_0 + 7.659054876802400882::DECIMAL) STORED, col1_18 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_10 AS TEXT))) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_4, col1_11 ASC, col1_7 DESC, lower(CAST(col1_3 AS TEXT)) DESC, col1_16 ASC, col1_15 DESC, col1_14 ASC, col1_0 ASC, col1_5 DESC, col1_13, col1_1);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_10 ASC, lower(col1_8) ASC, col1_4 DESC, col1_0, col1_18 DESC, col1_15, col1_2 ASC, col1_5 ASC, col1_17) INCLUDE (col1_8, col1_16);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_14 ASC, col1_15 ASC);
        test_1        |             CREATE INDEX ON table1 (col1_10, col1_5 DESC, col1_0 DESC, col1_7 ASC, col1_12 ASC, col1_15 ASC, col1_13, col1_17 DESC, col1_2 DESC, col1_18 DESC) INCLUDE (col1_8);
        test_1        |             CREATE UNIQUE INDEX ON table1 (lower(CAST(col1_3 AS TEXT)), col1_9 DESC, col1_2 DESC, col1_15 ASC, col1_11 ASC, col1_14 ASC) INCLUDE (col1_16);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_8 DESC, col1_15, col1_6, col1_7 DESC, col1_2 ASC, col1_1 ASC, col1_0 DESC, lower(col1_8) ASC, col1_11 ASC, col1_5 DESC, col1_12 DESC) INCLUDE (col1_16);
        test_1        |             CREATE INDEX ON table1 (col1_8 ASC, col1_17 DESC, col1_7 ASC) INCLUDE (col1_16);
        test_1        |             CREATE INDEX ON table1 (col1_9 DESC, col1_16 ASC, col1_10 ASC, col1_7 ASC, col1_18, col1_17, col1_13);
        test_1        |             CREATE TABLE table2 (col2_0 VARCHAR NOT NULL, col2_1 INT8 NOT NULL, col2_2 DECIMAL NOT NULL, col2_3 TIME NOT NULL, col2_4 REGROLE NOT NULL, col2_5 TEXT NOT NULL, col2_6 FLOAT4 NOT NULL, col2_7 REGNAMESPACE, col2_8 CHAR NOT NULL, col2_9 DECIMAL NOT NULL, col2_10 BIT(17) NULL, col2_11 REGPROCEDURE NOT NULL, PRIMARY KEY (col2_3, col2_9, col2_5, col2_4, col2_2, col2_6, col2_0), col2_12 DECIMAL NOT NULL GENERATED ALWAYS AS (col2_2 + col2_9) STORED, col2_13 DECIMAL NOT NULL GENERATED ALWAYS AS (col2_9 + col2_2) STORED, col2_14 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_4 IS NULL THEN e',\x13vS( '::TEXT ELSE e'3\x16\x1ab}In\x1f'::TEXT END) STORED, col2_15 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_4 IS NULL THEN e'\x1f'::TEXT ELSE ''::TEXT END) STORED, col2_16 FLOAT4 NOT NULL GENERATED ALWAYS AS (col2_6 + 0.09077384322881699::FLOAT8) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_16 DESC, col2_9 DESC, col2_11, col2_1 ASC, col2_7 ASC, col2_10, col2_3 ASC, col2_15, col2_13 DESC) INCLUDE (col2_8);
        test_1        |             CREATE INDEX ON table2 (col2_11, col2_1 DESC, col2_13 ASC, (col2_1 + 1::INT8) ASC, lower(col2_5) ASC, col2_0 DESC, col2_14, col2_9 DESC, col2_4 ASC, col2_16 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_10 DESC, col2_13 ASC, lower(col2_5) ASC, col2_8 DESC, (col2_6 + 0.8334824442863464::FLOAT8) ASC, col2_5, col2_15 DESC) INCLUDE (col2_7, col2_11, col2_16);
        test_1        |             CREATE INDEX ON table2 (col2_8 DESC, lower(CAST(col2_4 AS TEXT)));
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_0 ASC, col2_1 DESC, col2_4, col2_2, col2_10 ASC, col2_3, col2_9 ASC, col2_16 ASC, col2_12 DESC, col2_7 ASC, col2_6 ASC, (col2_2 + col2_9), col2_5 ASC, col2_15, col2_11 ASC) INCLUDE (col2_8);
        test_1        |             CREATE TABLE table3 (col3_0 CHAR NOT NULL, col3_1 REGTYPE, col3_2 INT8, col3_3 BOOL, col3_4 TIMETZ NULL, col3_5 GEOMETRY[], col3_6 REGCLASS, col3_7 INET, col3_8 REGNAMESPACE, col3_9 REGNAMESPACE NOT NULL, col3_10 "char" NULL, col3_11 "char" NULL, col3_12 TEXT GENERATED ALWAYS AS (CASE WHEN col3_1 IS NULL THEN e'a\x07\x1fy\x18\x117F\x1d'::TEXT ELSE e'\b?n0DotY'::TEXT END) STORED);
        test_1        |             CREATE INDEX ON table3 (col3_12 DESC, col3_6 ASC, col3_10 ASC, col3_2 DESC, col3_4, col3_3 ASC, col3_9 DESC, col3_11 DESC, col3_8 DESC);
        test_1        |             CREATE TABLE table4 (col4_0 INT2 NOT NULL, col4_1 REGNAMESPACE, col4_2 UUID NULL, col4_3 REGCLASS NULL, col4_4 GEOMETRY NOT NULL, col4_5 BYTEA NULL, col4_6 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col4_2 AS TEXT))) STORED);
        test_1        |             CREATE INDEX ON table4 (col4_2 DESC) INCLUDE (col4_0, col4_6);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_6 DESC, col4_2 DESC, col4_0 ASC, col4_3 ASC) INCLUDE (col4_1);
        test_1        |             CREATE INDEX ON table4 (col4_6, col4_0 ASC) INCLUDE (col4_1, col4_3, col4_4);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('hne', 'svjjf', 'ngizkl', 'wru', 'kqkzfl');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('iv', 'mnhs', 'hte', 'ysni', 'hgkzpw');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('dt', 'qn');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('umctxx', 'ino', 'tysmj', 'cugtbn', 'su', 'egnzp');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 3082c28f2dae9540c4f69ab2ffd6a1d92982b4fe:

        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_box2dfromgeohash('H'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_256928) AS tab_169408
        test_1        |             ORDER BY
        test_1        |                 CAST(col_256928 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.55s)
        test_1        |         compare_test.go:125: starting test: mutators
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: cockroach2
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 316361 [running]:
        test_1        | testing.tRunner.func1.2(0x1fbd3c0, 0xc000c70be0)
        test_1        |     /usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc000af2000)
        test_1        |     /usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1fbd3c0, 0xc000c70be0)
        test_1        |     /usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x4079fc0, 0x31c3198, 0xc000c98f00, 0x31c3198, 0xc000c98f00, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:368 +0x5d3
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0xc000d06060, 0x4079fc0, 0x0, 0x0, 0x0, 0x0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:301 +0x17f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc000c14000)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:220 +0x9e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc000d06060, 0xc0004abe00, 0x13, 0x13, 0x80, 0xc000bcd100, 0xc000a1b998, 0x4358bf)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:251 +0xbeb
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0x26b8c10, 0xc000d06060, 0xc0004abe00, 0x13, 0x13, 0x7fa42fee5ed0, 0xc000a1b9c8, 0x436cca, 0x1f02900)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:97 +0x4e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.Apply(0xc000d06060, 0xc0004abe00, 0x13, 0x13, 0xc000bcd100, 0x6, 0x8, 0x8, 0x0, 0x0, ...)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:108 +0xad
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.ApplyString(0xc000d06060, 0xc0009e8000, 0x5546, 0xc000382c60, 0x6, 0x6, 0x0, 0x6, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:159 +0x2e5
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000af2000)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:151 +0x2db
        test_1        | testing.tRunner(0xc000af2000, 0xc000d06000)
        test_1        |     /usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        |     /usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ f6e5974d563c2700dc68c2f71d4fc05ee1adea6b:

        postgres_1    |     CREATE TYPE rand_typ_4 AS ENUM ('bv', 'ei', 'kgkb');
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (609.63s)
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (5.88s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 BOX2D NOT NULL);
        test_1        |             CREATE UNIQUE INDEX ON table1 (lower(CAST(col1_0 AS TEXT)));
        test_1        |             CREATE TABLE table2 (col2_0 "char" NOT NULL, col2_1 "char" NULL, PRIMARY KEY (col2_0), col2_2 TEXT NULL GENERATED ALWAYS AS (lower(col2_1)) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_1, col2_2 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_0, col2_2 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_2 ASC, col2_1 ASC, col2_0);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_1 ASC, col2_0 ASC) INCLUDE (col2_2);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_0, col2_1 ASC, col2_2);
        test_1        |             CREATE TABLE table3 (col3_0 NAME, col3_1 CHAR, col3_2 NAME NOT NULL, col3_3 TEXT, col3_4 INTERVAL, col3_5 TIMESTAMP, col3_6 BOX2D, col3_7 TEXT GENERATED ALWAYS AS (lower(CAST(col3_6 AS TEXT))) STORED, col3_8 TEXT GENERATED ALWAYS AS (lower(CAST(col3_6 AS TEXT))) STORED, col3_9 TEXT GENERATED ALWAYS AS (lower(CAST(col3_4 AS TEXT))) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_2 DESC, col3_3, (CASE WHEN col3_5 IS NULL THEN e'_D \nD3k.'::TEXT ELSE e'\x14T?{d\x137'::TEXT END) ASC, col3_1 ASC, col3_0 DESC, col3_8) INCLUDE (col3_4, col3_6, col3_9);
        test_1        |             CREATE INDEX ON table3 (col3_8 ASC, col3_2 DESC, col3_9 DESC, col3_7, col3_0 DESC, lower(col3_1) ASC, col3_3 DESC, col3_4 DESC);
        test_1        |             CREATE INDEX ON table3 (col3_8 DESC, lower(CAST(col3_5 AS TEXT)) DESC, col3_4 ASC, lower(col3_2), col3_1 ASC);
        test_1        |             CREATE INDEX ON table3 (col3_8, lower(col3_2), col3_0 ASC, col3_2 DESC, col3_4 ASC, col3_5 ASC, col3_3 ASC);
        test_1        |             CREATE INDEX ON table3 (lower(col3_2) ASC, col3_4 DESC, col3_3, lower(col3_1), col3_1 ASC, col3_0 DESC, col3_2 ASC, col3_7 DESC, lower(CAST(col3_6 AS TEXT)) DESC);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_2 ASC, col3_7 DESC, col3_5, col3_3 DESC, col3_9, col3_4 ASC, col3_1 ASC, lower(col3_3)) INCLUDE (col3_0);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_4, col3_7 DESC, col3_3) INCLUDE (col3_5, col3_9);
        test_1        |             CREATE TABLE table4 (col4_0 TIMETZ[], col4_1 BOOL NOT NULL, col4_2 INT4 NOT NULL, PRIMARY KEY (col4_1), col4_3 TEXT GENERATED ALWAYS AS (CASE WHEN col4_0 IS NULL THEN e'WA?k\t'::TEXT ELSE ''::TEXT END) STORED, col4_4 INT4 NOT NULL GENERATED ALWAYS AS (col4_2 + 382394639::INT8) STORED);
        test_1        |             CREATE INDEX ON table4 (col4_4, col4_2, col4_1);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_2);
        test_1        |             CREATE TABLE table5 (col5_0 INT2, col5_1 UUID NOT NULL, col5_2 NAME, col5_3 BIT(6) NULL, col5_4 GEOGRAPHY NOT NULL, col5_5 TIMESTAMPTZ NOT NULL, col5_6 INT2 NOT NULL, col5_7 BIT(46), col5_8 INT2 NULL, col5_9 GEOGRAPHY, col5_10 INT2 GENERATED ALWAYS AS (col5_0 + col5_6) STORED, col5_11 INT2 NULL GENERATED ALWAYS AS ((col5_6 + col5_8) + col5_0) STORED, col5_12 INT2 NULL GENERATED ALWAYS AS ((col5_8 + col5_0) + col5_6) STORED, col5_13 TEXT GENERATED ALWAYS AS (lower(col5_2)) STORED, col5_14 TEXT GENERATED ALWAYS AS (lower(col5_2)) STORED, col5_15 INT2 GENERATED ALWAYS AS ((col5_0 + col5_6) + col5_8) STORED, col5_16 INT2 NULL GENERATED ALWAYS AS (col5_8 + (-9526)::INT8) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table5 (col5_13, col5_14 DESC);
        test_1        |             ALTER TABLE table5 ADD FOREIGN KEY (col5_0) REFERENCES table4 (col4_2);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('ehyd', 'xiri', 'k', 'deh');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('ae', 'k');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('pqxj', 'ev', 'qb', 'lt', 's');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('ars', 'ai');
        test_1        |             CREATE TYPE rand_typ_4 AS ENUM ('bv', 'ei', 'kgkb');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ b4a27f3634e3e41dc3966214cf05ff6870c055c5:

        test_1        |                         tab_131882.tableoid AS col_176814,
        test_1        |                         '':::STRING AS col_176815,
        test_1        |                         tab_131881.col1_1 AS col_176816
        test_1        |                     FROM
        test_1        |                         postgres.public.table1@table1_col1_0_col1_2_idx AS tab_131875,
        test_1        |                         postgres.public.table1@primary AS tab_131876,
        test_1        |                         postgres.public.table1 AS tab_131877
        test_1        |                         JOIN postgres.public.table1 AS tab_131878 ON (tab_131877.col1_0) = (tab_131878.col1_0)
        test_1        |                         JOIN postgres.public.table1@table1_col1_0_col1_1_col1_2_idx AS tab_131879
        test_1        |                             JOIN postgres.public.table1 AS tab_131880
        test_1        |                                 JOIN postgres.public.table1 AS tab_131881 ON (tab_131880.col1_2) = (tab_131881.col1_2)
        test_1        |                                 JOIN postgres.public.table1@[0] AS tab_131882 ON
        test_1        |                                         (tab_131880.col1_1) = (tab_131882.col1_1) AND (tab_131881.col1_1) = (tab_131882.col1_1) ON
        test_1        |                                     (tab_131879.col1_0) = (tab_131882.col1_0)
        test_1        |                                     AND (tab_131879.col1_1) = (tab_131881.col1_1)
        test_1        |                                     AND (tab_131879.col1_2) = (tab_131881.col1_1)
        test_1        |                             JOIN postgres.public.table1@table1_col1_0_col1_2_idx AS tab_131883 ON true ON
        test_1        |                                 (tab_131877.col1_0) = (tab_131883.col1_0) AND (tab_131877.col1_0) = (tab_131882.col1_0)
        test_1        |                     WHERE
        test_1        |                         true
        test_1        |                     ORDER BY
        test_1        |                         tab_131880.col1_1 DESC, tab_131882.col1_1
        test_1        |                 )
        test_1        |                     AS tab_131884
        test_1        |             ORDER BY
        test_1        |                 col_176804 NULLS FIRST,
        test_1        |                 col_176805 NULLS FIRST,
        test_1        |                 col_176806 NULLS FIRST,
        test_1        |                 col_176807 NULLS FIRST,
        test_1        |                 col_176808 NULLS FIRST,
        test_1        |                 col_176809 NULLS FIRST,
        test_1        |                 col_176810 NULLS FIRST,
        test_1        |                 col_176811 NULLS FIRST,
        test_1        |                 col_176812 NULLS FIRST,
        test_1        |                 col_176813 NULLS FIRST,
        test_1        |                 col_176814 NULLS FIRST,
        test_1        |                 col_176815 NULLS FIRST,
        test_1        |                 col_176816 NULLS FIRST
        test_1        |         compare_test.go:193: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 66442488fcc9c61af6ce438d1bac91cd47f74529:

        postgres_1    |     CREATE TABLE table2 (col2_0 OID NOT NULL, col2_1 DECIMAL, col2_2 INET NOT NULL, col2_3 DATE NULL, col2_4 GEOGRAPHY NULL, col2_5 DATE NOT NULL, col2_6 REGPROC NOT NULL, col2_7 CHAR, col2_8 REGNAMESPACE NOT NULL, PRIMARY KEY (col2_6), col2_9 TEXT GENERATED ALWAYS AS (lower(col2_7)) STORED);
        postgres_1    |     CREATE TABLE table3 (col3_0 OID NULL, col3_1 BIT(49) NOT NULL, col3_2 FLOAT8 NULL, col3_3 REGNAMESPACE, col3_4 DECIMAL NOT NULL, col3_5 TIMESTAMP NULL, col3_6 TIMESTAMPTZ NOT NULL, col3_7 GEOGRAPHY, col3_8 "char" NULL, col3_9 REGNAMESPACE, col3_10 DECIMAL NOT NULL GENERATED ALWAYS AS (col3_4 + 3.972812815656753664E+27::DECIMAL) STORED, col3_11 FLOAT8 NULL GENERATED ALWAYS AS (col3_2 + '+Inf'::FLOAT8) STORED);
        postgres_1    |     CREATE UNIQUE INDEX ON table3 (col3_9, col3_0, col3_2 DESC, (CASE WHEN col3_0 IS NULL THEN e'c-\r\'3\x1f'::TEXT ELSE e'\x07\x10'::TEXT END) ASC, col3_11 DESC, col3_1 ASC, col3_6 DESC, col3_10 ASC, col3_4 DESC, (col3_4 + 36217802999305706.21::DECIMAL) DESC, col3_5 DESC, col3_8 ASC);
        postgres_1    |     CREATE TABLE table4 (col4_0 FLOAT4 NOT NULL, col4_1 JSONB NULL, col4_2 INT4 NOT NULL);
        postgres_1    |     CREATE TABLE table5 (col5_0 INT2 NOT NULL, PRIMARY KEY (col5_0));
        postgres_1    |     CREATE UNIQUE INDEX ON table5 (col5_0 DESC);
        postgres_1    |     CREATE INDEX ON table5 (col5_0);
        postgres_1    |     CREATE INDEX ON table5 (col5_0);
        postgres_1    |     CREATE INDEX ON table5 (col5_0 ASC);
        postgres_1    |     CREATE UNIQUE INDEX ON table5 (col5_0);
        postgres_1    |     ALTER TABLE table2 ADD FOREIGN KEY (col2_0) REFERENCES table1 (col1_2);
        postgres_1    |     CREATE TYPE rand_typ_0 AS ENUM ('umqia');
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (607.21s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (3.51s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 INT2 NOT NULL, col1_1 JSONB, col1_2 REGROLE NOT NULL, col1_3 INET NOT NULL, col1_4 TIME NOT NULL, col1_5 REGTYPE NULL, col1_6 REGROLE, col1_7 BIT(31) NULL, col1_8 OID, col1_9 BIT(45) NULL, col1_10 GEOMETRY[], col1_11 REGCLASS NULL, col1_12 BIT(17) NOT NULL, col1_13 OID NOT NULL);
        test_1        |             CREATE INDEX ON table1 (col1_5 DESC, col1_8, col1_4 DESC, col1_9 ASC, col1_0 ASC, col1_13 ASC, col1_11 ASC, col1_6 ASC, col1_7 ASC, col1_12 ASC) INCLUDE (col1_10);
        test_1        |             CREATE INDEX ON table1 (col1_6 ASC, col1_8 DESC, lower(CAST(col1_6 AS TEXT)) DESC, col1_4 ASC) INCLUDE (col1_1, col1_2, col1_9, col1_10, col1_12);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_2);
        test_1        |             CREATE TABLE table2 (col2_0 OID NOT NULL, col2_1 DECIMAL, col2_2 INET NOT NULL, col2_3 DATE NULL, col2_4 GEOGRAPHY NULL, col2_5 DATE NOT NULL, col2_6 REGPROC NOT NULL, col2_7 CHAR, col2_8 REGNAMESPACE NOT NULL, PRIMARY KEY (col2_6), col2_9 TEXT GENERATED ALWAYS AS (lower(col2_7)) STORED);
        test_1        |             CREATE TABLE table3 (col3_0 OID NULL, col3_1 BIT(49) NOT NULL, col3_2 FLOAT8 NULL, col3_3 REGNAMESPACE, col3_4 DECIMAL NOT NULL, col3_5 TIMESTAMP NULL, col3_6 TIMESTAMPTZ NOT NULL, col3_7 GEOGRAPHY, col3_8 "char" NULL, col3_9 REGNAMESPACE, col3_10 DECIMAL NOT NULL GENERATED ALWAYS AS (col3_4 + 3.972812815656753664E+27::DECIMAL) STORED, col3_11 FLOAT8 NULL GENERATED ALWAYS AS (col3_2 + '+Inf'::FLOAT8) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_9, col3_0, col3_2 DESC, (CASE WHEN col3_0 IS NULL THEN e'c-\r\'3\x1f'::TEXT ELSE e'\x07\x10'::TEXT END) ASC, col3_11 DESC, col3_1 ASC, col3_6 DESC, col3_10 ASC, col3_4 DESC, (col3_4 + 36217802999305706.21::DECIMAL) DESC, col3_5 DESC, col3_8 ASC);
        test_1        |             CREATE TABLE table4 (col4_0 FLOAT4 NOT NULL, col4_1 JSONB NULL, col4_2 INT4 NOT NULL);
        test_1        |             CREATE TABLE table5 (col5_0 INT2 NOT NULL, PRIMARY KEY (col5_0));
        test_1        |             CREATE UNIQUE INDEX ON table5 (col5_0 DESC);
        test_1        |             CREATE INDEX ON table5 (col5_0);
        test_1        |             CREATE INDEX ON table5 (col5_0);
        test_1        |             CREATE INDEX ON table5 (col5_0 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table5 (col5_0);
        test_1        |             ALTER TABLE table2 ADD FOREIGN KEY (col2_0) REFERENCES table1 (col1_2);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('umqia');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 4df1305911133426c8c5bb2983048c4486a52cfa:

        test_1        |                                 JOIN postgres.public.table1@[0] AS tab_226501 ON
        test_1        |                                         (tab_226500.tableoid) = (tab_226501.col1_2)
        test_1        |                                         AND (tab_226500.crdb_internal_mvcc_timestamp) = (tab_226501.crdb_internal_mvcc_timestamp) ON
        test_1        |                                     (tab_226499.tableoid) = (tab_226501.col1_2)
        test_1        |                                     AND (tab_226497.crdb_internal_mvcc_timestamp) = (tab_226500.crdb_internal_mvcc_timestamp)
        test_1        |                             JOIN postgres.public.table4@[0] AS tab_226502
        test_1        |                                 JOIN postgres.public.table3@[0] AS tab_226503 ON
        test_1        |                                         (tab_226502.col4_6) = (tab_226503.tableoid)
        test_1        |                                         AND (tab_226502.tableoid) = (tab_226503.tableoid)
        test_1        |                                         AND (tab_226502.col4_0) = (tab_226503.col3_0) ON
        test_1        |                                     (tab_226501.col1_5) = (tab_226502.col4_8) AND (tab_226497.col4_6) = (tab_226503.tableoid) ON
        test_1        |                                 (tab_226496.tableoid) = (tab_226497.col4_6)
        test_1        |                                 AND (tab_226496.crdb_internal_mvcc_timestamp) = (tab_226497.crdb_internal_mvcc_timestamp)
        test_1        |                     ORDER BY
        test_1        |                         tab_226503.crdb_internal_mvcc_timestamp DESC, tab_226496.col5_0 ASC
        test_1        |                 )
        test_1        |                     AS tab_226504
        test_1        |             ORDER BY
        test_1        |                 col_310956 NULLS FIRST,
        test_1        |                 col_310957 NULLS FIRST,
        test_1        |                 col_310958 NULLS FIRST,
        test_1        |                 col_310959 NULLS FIRST,
        test_1        |                 col_310960 NULLS FIRST,
        test_1        |                 col_310961 NULLS FIRST,
        test_1        |                 col_310962 NULLS FIRST,
        test_1        |                 col_310963 NULLS FIRST,
        test_1        |                 col_310964 NULLS FIRST,
        test_1        |                 col_310965 NULLS FIRST,
        test_1        |                 col_310966 NULLS FIRST,
        test_1        |                 col_310967 NULLS FIRST,
        test_1        |                 col_310968 NULLS FIRST,
        test_1        |                 col_310969 NULLS FIRST,
        test_1        |                 col_310970 NULLS FIRST,
        test_1        |                 col_310971 NULLS FIRST,
        test_1        |                 col_310972 NULLS FIRST,
        test_1        |                 col_310973 NULLS FIRST,
        test_1        |                 col_310974 NULLS FIRST,
        test_1        |                 col_310975 NULLS FIRST
        test_1        |         compare_test.go:193: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 019f070929f94d692d9a0c1306050b9b1044e722:

        postgres_1    | 
        postgres_1    | 2022-01-15 06:15:45.830 UTC [50] LOG:  received fast shutdown request
        postgres_1    | waiting for server to shut down....2022-01-15 06:15:45.832 UTC [50] LOG:  aborting any active transactions
        postgres_1    | 2022-01-15 06:15:45.833 UTC [50] LOG:  background worker "logical replication launcher" (PID 57) exited with exit code 1
        postgres_1    | 2022-01-15 06:15:45.835 UTC [52] LOG:  shutting down
        postgres_1    | 2022-01-15 06:15:45.929 UTC [50] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2022-01-15 06:15:45.952 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2022-01-15 06:15:45.952 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2022-01-15 06:15:45.952 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2022-01-15 06:15:45.956 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2022-01-15 06:15:45.961 UTC [69] LOG:  database system was shut down at 2022-01-15 06:15:45 UTC
        postgres_1    | 2022-01-15 06:15:45.966 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2022-01-15 06:15:47.248 UTC [79] ERROR:  syntax error at or near "DESC" at character 628
        postgres_1    | 2022-01-15 06:15:47.248 UTC [79] STATEMENT:  CREATE TABLE table1 (col1_0 INT2 NOT NULL, col1_1 GEOGRAPHY, col1_2 REGNAMESPACE NOT NULL, col1_3 BOOL, col1_4 GEOGRAPHY, col1_5 "char" NOT NULL, col1_6 GEOMETRY NULL, col1_7 JSONB NOT NULL);
        postgres_1    |     CREATE TABLE table2 (col2_0 INT4 NULL, col2_1 REGCLASS NOT NULL, col2_2 INT2 NOT NULL, col2_3 JSONB NULL, col2_4 REGNAMESPACE NOT NULL, col2_5 "char" NOT NULL, col2_6 FLOAT4 NOT NULL, col2_7 BOOL NOT NULL, col2_8 GEOGRAPHY, col2_9 FLOAT8 NULL, col2_10 BYTEA NULL, col2_11 GEOMETRY, col2_12 FLOAT8 NULL GENERATED ALWAYS AS (col2_9 + col2_6) STORED, col2_13 INT2 NULL GENERATED ALWAYS AS (col2_2 + col2_0) STORED, INVERTED INDEX (col2_7 DESC, col2_10, col2_11), INDEX (col2_9 ASC) INCLUDE (col2_0, col2_1, col2_5, col2_6, col2_10, col2_11, col2_12), INDEX (col2_0 DESC, (col2_9 + (-0.08798767080842929)::FLOAT8) DESC, col2_4, col2_12 ASC, col2_5, col2_1 ASC, col2_2 ASC, col2_9 DESC) WHERE ((((((((NOT table2.col2_7) OR (table2.col2_10 = e'\\x22'::BYTEA)) AND (table2.col2_9 <= 1.7976931348623157e+308::FLOAT8)) OR (table2.col2_5 = e'\U00002603'::TEXT)) OR (table2.col2_12 >= 'NaN'::FLOAT8)) AND (table2.col2_2 != (-1)::INT8)) AND (table2.col2_0 = (-1)::INT8)) AND (table2.col2_6 = '+Inf'::FLOAT8)) OR (table2.col2_13 > (-32768)::INT8));
        postgres_1    |     CREATE TABLE table3 (col3_0 UUID NULL, col3_1 TIMESTAMPTZ NOT NULL, col3_2 TIMESTAMP, col3_3 REGPROCEDURE NOT NULL, col3_4 NAME NULL, col3_5 INET NULL, PRIMARY KEY (col3_3 ASC), col3_6 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col3_0 AS TEXT))) STORED, UNIQUE (col3_4 DESC, col3_1 ASC, col3_6, col3_2 DESC) INCLUDE (col3_0, col3_5) WHERE (table3.col3_6 = e'\''::TEXT) OR (table3.col3_1 = '294276-12-31 23:59:59.999999+00:00'::TIMESTAMPTZ), INDEX (col3_2 ASC, col3_3 ASC));
        postgres_1    |     CREATE TABLE table4 (col4_0 BOOL[] NULL, col4_1 INT4 NOT NULL, col4_2 TEXT NULL, col4_3 DATE NOT NULL, col4_4 REGPROCEDURE NOT NULL, col4_5 UUID NOT NULL, PRIMARY KEY (col4_3 ASC, col4_5 DESC, col4_4 ASC), col4_6 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col4_3 AS TEXT))) STORED, col4_7 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col4_3 AS TEXT))) STORED, col4_8 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col4_5 AS TEXT))) STORED, col4_9 INT4 NOT NULL GENERATED ALWAYS AS (col4_1 + 229354355::INT8) STORED, col4_10 INT4 NOT NULL GENERATED ALWAYS AS (col4_1 + 0::INT8) STORED);
        postgres_1    |     CREATE TYPE rand_typ_0 AS ENUM ('utikku', 'k');
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (604.73s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.88s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 INT2 NOT NULL, col1_1 GEOGRAPHY, col1_2 REGNAMESPACE NOT NULL, col1_3 BOOL, col1_4 GEOGRAPHY, col1_5 "char" NOT NULL, col1_6 GEOMETRY NULL, col1_7 JSONB NOT NULL);
        test_1        |             CREATE TABLE table2 (col2_0 INT4 NULL, col2_1 REGCLASS NOT NULL, col2_2 INT2 NOT NULL, col2_3 JSONB NULL, col2_4 REGNAMESPACE NOT NULL, col2_5 "char" NOT NULL, col2_6 FLOAT4 NOT NULL, col2_7 BOOL NOT NULL, col2_8 GEOGRAPHY, col2_9 FLOAT8 NULL, col2_10 BYTEA NULL, col2_11 GEOMETRY, col2_12 FLOAT8 NULL GENERATED ALWAYS AS (col2_9 + col2_6) STORED, col2_13 INT2 NULL GENERATED ALWAYS AS (col2_2 + col2_0) STORED, INVERTED INDEX (col2_7 DESC, col2_10, col2_11), INDEX (col2_9 ASC) INCLUDE (col2_0, col2_1, col2_5, col2_6, col2_10, col2_11, col2_12), INDEX (col2_0 DESC, (col2_9 + (-0.08798767080842929)::FLOAT8) DESC, col2_4, col2_12 ASC, col2_5, col2_1 ASC, col2_2 ASC, col2_9 DESC) WHERE ((((((((NOT table2.col2_7) OR (table2.col2_10 = e'\\x22'::BYTEA)) AND (table2.col2_9 <= 1.7976931348623157e+308::FLOAT8)) OR (table2.col2_5 = e'\U00002603'::TEXT)) OR (table2.col2_12 >= 'NaN'::FLOAT8)) AND (table2.col2_2 != (-1)::INT8)) AND (table2.col2_0 = (-1)::INT8)) AND (table2.col2_6 = '+Inf'::FLOAT8)) OR (table2.col2_13 > (-32768)::INT8));
        test_1        |             CREATE TABLE table3 (col3_0 UUID NULL, col3_1 TIMESTAMPTZ NOT NULL, col3_2 TIMESTAMP, col3_3 REGPROCEDURE NOT NULL, col3_4 NAME NULL, col3_5 INET NULL, PRIMARY KEY (col3_3 ASC), col3_6 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col3_0 AS TEXT))) STORED, UNIQUE (col3_4 DESC, col3_1 ASC, col3_6, col3_2 DESC) INCLUDE (col3_0, col3_5) WHERE (table3.col3_6 = e'\''::TEXT) OR (table3.col3_1 = '294276-12-31 23:59:59.999999+00:00'::TIMESTAMPTZ), INDEX (col3_2 ASC, col3_3 ASC));
        test_1        |             CREATE TABLE table4 (col4_0 BOOL[] NULL, col4_1 INT4 NOT NULL, col4_2 TEXT NULL, col4_3 DATE NOT NULL, col4_4 REGPROCEDURE NOT NULL, col4_5 UUID NOT NULL, PRIMARY KEY (col4_3 ASC, col4_5 DESC, col4_4 ASC), col4_6 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col4_3 AS TEXT))) STORED, col4_7 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col4_3 AS TEXT))) STORED, col4_8 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col4_5 AS TEXT))) STORED, col4_9 INT4 NOT NULL GENERATED ALWAYS AS (col4_1 + 229354355::INT8) STORED, col4_10 INT4 NOT NULL GENERATED ALWAYS AS (col4_1 + 0::INT8) STORED);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('utikku', 'k');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: syntax error at or near "DESC" (SQLSTATE 42601)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 6b831f0022a111593b442397ad76cce0e2a8cab5:

        postgres_1    | 2022-01-18 06:16:02.085 UTC [51] LOG:  shutting down
        postgres_1    | 2022-01-18 06:16:02.177 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2022-01-18 06:16:02.201 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2022-01-18 06:16:02.201 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2022-01-18 06:16:02.201 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2022-01-18 06:16:02.205 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2022-01-18 06:16:02.210 UTC [68] LOG:  database system was shut down at 2022-01-18 06:16:02 UTC
        postgres_1    | 2022-01-18 06:16:02.215 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2022-01-18 06:16:04.240 UTC [78] ERROR:  functions in index expression must be marked IMMUTABLE
        postgres_1    | 2022-01-18 06:16:04.240 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 DATE, col1_1 BOOL NOT NULL, col1_2 FLOAT4 NOT NULL, col1_3 TIMESTAMP NOT NULL, col1_4 GEOGRAPHY, col1_5 UUID NOT NULL, col1_6 FLOAT4 NULL, col1_7 VARCHAR NOT NULL, col1_8 INET NOT NULL, col1_9 REGPROCEDURE NOT NULL, col1_10 REGTYPE NOT NULL, col1_11 INT2 NULL, col1_12 INTERVAL NOT NULL, col1_13 JSONB NOT NULL, PRIMARY KEY (col1_10, col1_3, col1_1, col1_9, col1_12, col1_7), col1_14 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_5 AS TEXT))) STORED, col1_15 TEXT GENERATED ALWAYS AS (CASE WHEN col1_0 IS NULL THEN e'\x1bt(D'::TEXT ELSE e'\x0f'::TEXT END) STORED, col1_16 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_12 AS TEXT))) STORED);
        postgres_1    |     CREATE UNIQUE INDEX ON table1 (col1_6, lower(CAST(col1_4 AS TEXT)) ASC);
        postgres_1    |     CREATE INDEX ON table1 (col1_14 ASC, lower(CAST(col1_3 AS TEXT)) DESC) INCLUDE (col1_2, col1_4, col1_5, col1_11, col1_13, col1_16);
        postgres_1    |     CREATE UNIQUE INDEX ON table1 (col1_8 ASC, col1_9, col1_15 DESC, col1_16, col1_12 ASC, lower(CAST(col1_13 AS TEXT)), lower(col1_7) ASC, col1_2 ASC, (CASE WHEN col1_0 IS NULL THEN e'>9\x15:\x7fS7'::TEXT ELSE e'@\x11\x13}a}Y$'::TEXT END) DESC, lower(CAST(col1_1 AS TEXT)));
        postgres_1    |     CREATE TYPE rand_typ_0 AS ENUM ('iyfw', 'e', 'ompm', 'aeta');
        postgres_1    |     CREATE TYPE rand_typ_1 AS ENUM ('vki', 'zhbikc', 'yubjfr', 'odl');
        postgres_1    |     CREATE TYPE rand_typ_2 AS ENUM ('ahr', 'cl', 'civgft');
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (604.60s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.63s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 DATE, col1_1 BOOL NOT NULL, col1_2 FLOAT4 NOT NULL, col1_3 TIMESTAMP NOT NULL, col1_4 GEOGRAPHY, col1_5 UUID NOT NULL, col1_6 FLOAT4 NULL, col1_7 VARCHAR NOT NULL, col1_8 INET NOT NULL, col1_9 REGPROCEDURE NOT NULL, col1_10 REGTYPE NOT NULL, col1_11 INT2 NULL, col1_12 INTERVAL NOT NULL, col1_13 JSONB NOT NULL, PRIMARY KEY (col1_10, col1_3, col1_1, col1_9, col1_12, col1_7), col1_14 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_5 AS TEXT))) STORED, col1_15 TEXT GENERATED ALWAYS AS (CASE WHEN col1_0 IS NULL THEN e'\x1bt(D'::TEXT ELSE e'\x0f'::TEXT END) STORED, col1_16 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_12 AS TEXT))) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_6, lower(CAST(col1_4 AS TEXT)) ASC);
        test_1        |             CREATE INDEX ON table1 (col1_14 ASC, lower(CAST(col1_3 AS TEXT)) DESC) INCLUDE (col1_2, col1_4, col1_5, col1_11, col1_13, col1_16);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_8 ASC, col1_9, col1_15 DESC, col1_16, col1_12 ASC, lower(CAST(col1_13 AS TEXT)), lower(col1_7) ASC, col1_2 ASC, (CASE WHEN col1_0 IS NULL THEN e'>9\x15:\x7fS7'::TEXT ELSE e'@\x11\x13}a}Y$'::TEXT END) DESC, lower(CAST(col1_1 AS TEXT)));
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('iyfw', 'e', 'ompm', 'aeta');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('vki', 'zhbikc', 'yubjfr', 'odl');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('ahr', 'cl', 'civgft');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 0655d082b0d98f27e77471fcced8de94cd9327bc:

        postgres_1    |                 postgres.public.table1 AS tab_142002
        postgres_1    |         )
        postgres_1    |             AS tab_142003
        postgres_1    |     ORDER BY
        postgres_1    |         col_212168 NULLS FIRST,
        postgres_1    |         col_212169 NULLS FIRST,
        postgres_1    |         col_212170 NULLS FIRST,
        postgres_1    |         col_212171 NULLS FIRST,
        postgres_1    |         col_212172 NULLS FIRST
        test_1        | --- FAIL: TestCompare (817.63s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (214.25s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             -   nil,
        test_1        |             +   string("01030000000100000005000000000000000000000000000000008056C0000000000000000000000000008046C0000000000080464000000000008046C0000000000080464000000000008056C0000000000000000000000000008056C0"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_geomfromgeohash('H':::STRING::STRING::STRING, NULL::INT4::INT4)::GEOMETRY AS col_212187) AS tab_142012
        test_1        |             ORDER BY
        test_1        |                 col_212187 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_geomfromgeohash('H'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::GEOMETRY AS col_212187) AS tab_142012
        test_1        |             ORDER BY
        test_1        |                 col_212187 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 36fb1109856898f2c45c247fe669dc955ccd9f48:

        postgres_1    |     CREATE TYPE rand_typ_0 AS ENUM ('nzbovx', 'lklo', 'g', 'j', 'ptvsa');
        postgres_1    |     CREATE TYPE rand_typ_1 AS ENUM ('cuccm', 'njz');
        postgres_1    |     CREATE TYPE rand_typ_2 AS ENUM ('osxy');
        postgres_1    |     CREATE TYPE rand_typ_3 AS ENUM ('het', 'uvm', 'hs', 'wcsxtq', 'ikatv');
        postgres_1    |     CREATE TYPE rand_typ_4 AS ENUM ('f', 'fhsrt', 'tqbmx', 'kid');
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (607.81s)
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (4.53s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 DECIMAL, col1_1 REGNAMESPACE, col1_2 BYTEA, col1_3 INT4, col1_4 INET NOT NULL, col1_5 INET, col1_6 INT8 NULL, col1_7 NAME NOT NULL, col1_8 INET, col1_9 NAME[] NULL, col1_10 TIMETZ NOT NULL, PRIMARY KEY (col1_7, col1_4), col1_11 INT4 GENERATED ALWAYS AS (col1_3 + (-1853134997)::INT8) STORED, col1_12 INT8 NULL GENERATED ALWAYS AS (col1_6 + (-5815049731198932731)::INT8) STORED, col1_13 INT8 NULL GENERATED ALWAYS AS (col1_6 + col1_3) STORED, col1_14 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_4 AS TEXT))) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_7 ASC, (col1_3 + col1_6), col1_8, col1_10 DESC, col1_5 DESC, col1_13 DESC, col1_3 DESC, col1_0 ASC, col1_12 DESC, col1_4, (col1_6 + col1_3) ASC, col1_11 ASC, col1_6 ASC, col1_1) INCLUDE (col1_9, col1_14);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_6, col1_8 ASC);
        test_1        |             CREATE INDEX ON table1 (col1_14 DESC, col1_1, col1_5 DESC, col1_12, col1_3 ASC) INCLUDE (col1_6, col1_8, col1_9);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_3 DESC, col1_7, col1_6, col1_10 ASC, col1_5 ASC, col1_2 DESC, col1_8, col1_13 ASC) INCLUDE (col1_1, col1_11, col1_14);
        test_1        |             CREATE TABLE table2 (col2_0 REGROLE NOT NULL, PRIMARY KEY (col2_0));
        test_1        |             CREATE INDEX ON table2 (col2_0 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_0 ASC);
        test_1        |             CREATE TABLE table3 (col3_0 GEOMETRY[] NOT NULL, col3_1 TIMESTAMPTZ NULL, col3_2 CHAR NOT NULL, col3_3 INT8 NULL, col3_4 BOOL, col3_5 REGROLE NOT NULL, col3_6 REGTYPE NOT NULL, col3_7 FLOAT8 NULL, col3_8 OID, col3_9 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col3_1 IS NULL THEN ''::TEXT ELSE e'\U00002603'::TEXT END) STORED, col3_10 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col3_5 IS NULL THEN NULL ELSE e'nDaM(f\x14\x13w'::TEXT END) STORED, col3_11 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col3_6 IS NULL THEN e'\U00002603'::TEXT ELSE 'o'::TEXT END) STORED, col3_12 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col3_5 IS NULL THEN ''::TEXT ELSE e'3Bco\x1eI4L'::TEXT END) STORED, col3_13 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col3_5 IS NULL THEN ''::TEXT ELSE e'K\x1a\x17.\x0eMkF'::TEXT END) STORED, col3_14 TEXT GENERATED ALWAYS AS (lower(CAST(col3_4 AS TEXT))) STORED, col3_15 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col3_1 IS NULL THEN 'O{z'::TEXT ELSE e'\x17\\+\'\n>'::TEXT END) STORED);
        test_1        |             CREATE INDEX ON table3 (col3_10 ASC, lower(CAST(col3_6 AS TEXT)) DESC);
        test_1        |             CREATE TABLE table4 (col4_0 REGPROC NOT NULL, col4_1 GEOGRAPHY[] NOT NULL, col4_2 REGPROCEDURE NULL, col4_3 INTERVAL, col4_4 FLOAT4, col4_5 NAME, col4_6 INT8 NOT NULL, col4_7 DECIMAL, col4_8 JSONB, col4_9 BYTEA NOT NULL, col4_10 INET NULL, col4_11 BOX2D NOT NULL, col4_12 BIT(8) NULL, col4_13 FLOAT8 NOT NULL, col4_14 "char" NULL, col4_15 UUID, col4_16 BOOL, col4_17 NAME NOT NULL, col4_18 INT4 NULL, PRIMARY KEY (col4_9, col4_17));
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_5) INCLUDE (col4_0, col4_7, col4_8, col4_18);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_5 ASC, col4_15 ASC, lower(CAST(col4_11 AS TEXT)) DESC) INCLUDE (col4_1, col4_4, col4_7, col4_8, col4_10, col4_12, col4_13, col4_14, col4_16, col4_18);
        test_1        |             CREATE INDEX ON table4 (col4_5 ASC) INCLUDE (col4_0, col4_1, col4_2, col4_4, col4_6, col4_7, col4_10, col4_12, col4_13, col4_14, col4_15, col4_18);
        test_1        |             CREATE INDEX ON table4 (col4_17 DESC, col4_18 DESC, (col4_4 + col4_13) ASC, col4_9 ASC, col4_0 DESC, col4_10 ASC, col4_5, col4_14 ASC) INCLUDE (col4_2, col4_3, col4_6, col4_7, col4_12, col4_13, col4_15);
        test_1        |             CREATE UNIQUE INDEX ON table4 ((col4_18 + col4_6) ASC, col4_12 ASC) INCLUDE (col4_1, col4_14, col4_15, col4_16, col4_18);
        test_1        |             CREATE INDEX ON table4 (col4_13 ASC, lower(CAST(col4_16 AS TEXT)) ASC, col4_7 DESC, lower(col4_17) ASC, col4_16 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_15, lower(CAST(col4_16 AS TEXT)) ASC, col4_4 DESC, col4_3 DESC, col4_14, (col4_6 + col4_18) DESC, col4_7 DESC);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('nzbovx', 'lklo', 'g', 'j', 'ptvsa');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('cuccm', 'njz');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('osxy');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('het', 'uvm', 'hs', 'wcsxtq', 'ikatv');
        test_1        |             CREATE TYPE rand_typ_4 AS ENUM ('f', 'fhsrt', 'tqbmx', 'kid');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 74346c2b0bf49d40d044d78a9a10a0ce88188469:

        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (7.58s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 VARCHAR, col1_1 BYTEA NOT NULL, col1_2 TIME, col1_3 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_1 IS NULL THEN e'\''::TEXT ELSE e'N2\x14eaM'::TEXT END) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_1 DESC, col1_2 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_1 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_2 ASC, col1_1 ASC, col1_3 ASC) INCLUDE (col1_0);
        test_1        |             CREATE INDEX ON table1 (lower(CAST(col1_2 AS TEXT)) ASC, col1_3, col1_1);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_1 ASC) INCLUDE (col1_2);
        test_1        |             CREATE INDEX ON table1 (col1_2 ASC, col1_0 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_1 ASC) INCLUDE (col1_0, col1_2);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_0, col1_3 ASC) INCLUDE (col1_1);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_3 ASC) INCLUDE (col1_0, col1_2);
        test_1        |             CREATE TABLE table2 (col2_0 FLOAT4 NOT NULL, col2_1 OID NULL, col2_2 TEXT NOT NULL, col2_3 REGROLE NOT NULL, PRIMARY KEY (col2_3, col2_0, col2_2), col2_4 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col2_1 IS NULL THEN NULL ELSE ']^!RZs'::TEXT END) STORED, col2_5 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col2_1 IS NULL THEN e'\x05%x\x12I\x06O'::TEXT ELSE e'AW]\x05'::TEXT END) STORED, col2_6 TEXT NOT NULL GENERATED ALWAYS AS (lower(col2_2)) STORED);
        test_1        |             CREATE TABLE table3 (col3_0 "char" NOT NULL, col3_1 FLOAT4 NOT NULL, col3_2 CHAR NOT NULL, col3_3 "char", col3_4 DECIMAL NOT NULL, col3_5 TIMESTAMP NOT NULL, PRIMARY KEY (col3_5, col3_1, col3_0, col3_4, col3_2), col3_6 DECIMAL NOT NULL GENERATED ALWAYS AS (col3_4 + 2.932050941992286550E+23::DECIMAL) STORED, col3_7 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col3_5 IS NULL THEN NULL ELSE e'\x05'::TEXT END) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_6 ASC, col3_4 DESC, col3_7 DESC, col3_5 ASC, col3_1 DESC, col3_2 DESC) INCLUDE (col3_3);
        test_1        |             CREATE INDEX ON table3 (col3_1 ASC, col3_3 DESC, col3_2, col3_4, col3_5 DESC, col3_6 DESC, col3_0 ASC, col3_7);
        test_1        |             CREATE INDEX ON table3 (col3_6 DESC, col3_4, col3_0, col3_2 DESC, col3_5 ASC);
        test_1        |             CREATE INDEX ON table3 (col3_1, col3_2 DESC, col3_6 ASC, col3_3 DESC);
        test_1        |             CREATE INDEX ON table3 (col3_1, col3_7 ASC, col3_0, lower(CAST(col3_5 AS TEXT)) DESC);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_7 ASC);
        test_1        |             CREATE INDEX ON table3 (col3_2 DESC, (col3_4 + 0.2545930691406640373::DECIMAL) DESC, lower(col3_0) DESC, col3_7 DESC, col3_4, col3_6 ASC, col3_1);
        test_1        |             CREATE TABLE table4 (col4_0 TIMESTAMP NOT NULL, col4_1 INT2 NOT NULL, col4_2 UUID, col4_3 TIMESTAMPTZ NULL, col4_4 DATE NULL, col4_5 BOX2D, col4_6 TIMESTAMP, col4_7 UUID, col4_8 TEXT NOT NULL, col4_9 REGROLE NULL, col4_10 FLOAT8 NOT NULL, col4_11 NAME NOT NULL, col4_12 REGROLE NULL, col4_13 VARCHAR NULL, col4_14 NAME NOT NULL, col4_15 TIMETZ, col4_16 INT4, col4_17 TIMESTAMPTZ, col4_18 TIMESTAMP[] NOT NULL);
        test_1        |             CREATE INDEX ON table4 (col4_17, (col4_16 + col4_1) ASC, col4_0, col4_3 ASC, col4_12, (col4_1 + col4_16) ASC, col4_9 ASC, col4_10 DESC, col4_11, col4_15 DESC, col4_7, col4_8 DESC, col4_13 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_0, col4_2 DESC, col4_14, col4_7 ASC, col4_16 ASC, col4_17, col4_10) INCLUDE (col4_1, col4_8, col4_9, col4_11, col4_12);
        test_1        |             CREATE INDEX ON table4 (col4_11 DESC, col4_2 DESC, (col4_1 + col4_16) DESC, col4_3, col4_7, col4_12 ASC);
        test_1        |             CREATE INDEX ON table4 (col4_12 ASC, col4_16 DESC, col4_4 DESC, col4_3 ASC, col4_15 ASC, col4_13 DESC, (col4_10 + 0.7450813389882124::FLOAT8) ASC, col4_10, col4_8, col4_7 DESC, col4_9, col4_17, col4_14, col4_0, col4_6 ASC, col4_11 ASC, col4_1 ASC, col4_2);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_16 ASC, col4_13 ASC, col4_1 DESC, col4_11) INCLUDE (col4_0, col4_2, col4_4, col4_6, col4_9, col4_18);
        test_1        |             CREATE TABLE table5 (col5_0 UUID, col5_1 BOOL NULL, col5_2 REGPROCEDURE NULL, col5_3 DECIMAL NULL, col5_4 DATE, col5_5 TEXT NOT NULL, col5_6 TIMESTAMP NULL, col5_7 BIT(36), col5_8 INET NULL, col5_9 REGNAMESPACE NULL, col5_10 GEOMETRY NULL, col5_11 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col5_9 IS NULL THEN e'\x02Q\x1b'::TEXT ELSE e'+;]E-\x0b'::TEXT END) STORED, col5_12 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col5_8 AS TEXT))) STORED, col5_13 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col5_6 IS NULL THEN NULL ELSE NULL END) STORED, col5_14 TEXT GENERATED ALWAYS AS (lower(CAST(col5_7 AS TEXT))) STORED, col5_15 TEXT GENERATED ALWAYS AS (lower(CAST(col5_0 AS TEXT))) STORED, col5_16 TEXT GENERATED ALWAYS AS (CASE WHEN col5_4 IS NULL THEN e'\x128KmFw'::TEXT ELSE NULL END) STORED, col5_17 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col5_1 AS TEXT))) STORED, col5_18 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col5_10 AS TEXT))) STORED);
        test_1        |             CREATE INDEX ON table5 (col5_14, col5_8 DESC, col5_5, col5_17 DESC, col5_16 ASC, col5_13 DESC, col5_4 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table5 (col5_18, col5_16 ASC, col5_3, col5_12 DESC, col5_17, col5_0 DESC);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('fqo', 'cc', 'rfjljw', 'fwgt', 'v');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('e');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('fzjs', 'vylz');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('f', 'xt');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: functions in index expression must be marked IMMUTABLE (SQLSTATE 42P17)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 1c74602223ae3815f20fb9b261b9405ae1a7ce51:

        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (88.81s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             -   nil,
        test_1        |             +   string("BOX(-135 45,-90 90)"),
        test_1        |                 s"1",
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         st_box2dfromgeohash('C':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D AS col_104949,
        test_1        |                         sign(2:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL AS col_104950
        test_1        |                 )
        test_1        |                     AS tab_53475
        test_1        |             ORDER BY
        test_1        |                 CAST(col_104949 AS STRING) NULLS FIRST, col_104950 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         st_box2dfromgeohash('C'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_104949,
        test_1        |                         sign(2::DECIMAL::DECIMAL::DECIMAL)::DECIMAL AS col_104950
        test_1        |                 )
        test_1        |                     AS tab_53475
        test_1        |             ORDER BY
        test_1        |                 CAST(col_104949 AS TEXT) NULLS FIRST, col_104950 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ ea903ef55abfbbdd8fd963fc7ce5975324d238e5:

        test_1        | --- FAIL: TestCompare (2.34s)
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (0.00s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 68 [running]:
        test_1        | testing.tRunner.func1.2(0x1fbeaa0, 0xc0005fe9a0)
        test_1        |     /usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc00030d380)
        test_1        |     /usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1fbeaa0, 0xc0005fe9a0)
        test_1        |     /usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x4083fc0, 0x31cc2f8, 0xc000cb8450, 0x31cc2f8, 0xc000cb8450, 0x80)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:368 +0x5d3
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0xc0005e1b00, 0x4083fc0, 0x0, 0x0, 0x0, 0x0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:301 +0x17f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc00030d680)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:220 +0x9e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc0005e1b00, 0xc0005fe780, 0x2, 0x2, 0x0, 0x0, 0x0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:251 +0xbeb
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0x26ba7f0, 0xc0005e1b00, 0xc0005fe780, 0x2, 0x2, 0x0, 0xc00020a820, 0xe0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:97 +0x4e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc0005e1b00, 0x2150ad6, 0x5, 0x2, 0xc000b11a30, 0x3, 0x3, 0xe0, 0x4436d7, 0x8)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:89 +0x163
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0xc0005e1b00, 0x2, 0x1, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:91 +0x19e
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc0005e1b00, 0x4394f8, 0x30)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:77 +0x4f
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.wrapCommonSetup.func1(0xc0005e1b00, 0x78dbbb54ef5da4be, 0x11)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:43 +0x44
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc00030d380)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:127 +0x113
        test_1        | testing.tRunner(0xc00030d380, 0xc0005e1aa0)
        test_1        |     /usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        |     /usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ f479a040709016d40e64ea165b68cbd0d66f8ded:

        postgres_1    |             FROM
        postgres_1    |                 postgres.public.table4 AS tab_250076
        postgres_1    |                 LEFT JOIN postgres.public.table2 AS tab_250077 ON true::BOOL,
        postgres_1    |                 postgres.public.table2 AS tab_250078
        postgres_1    |             ORDER BY
        postgres_1    |                 tab_250078.col2_4 DESC, tab_250078.col2_2, tab_250076.col4_1
        postgres_1    |         )
        postgres_1    |             AS tab_250079
        postgres_1    |     ORDER BY
        postgres_1    |         col_469503 NULLS FIRST, col_469504 NULLS FIRST, col_469505 NULLS FIRST, col_469506 NULLS FIRST
        test_1        | --- FAIL: TestCompare (1011.02s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (406.97s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             -   string("{NULL,NULL}"),
        test_1        |             +   string("{NULL:NULL}"),
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (NULL::GEOGRAPHY::GEOGRAPHY || (NULL::GEOGRAPHY[]::GEOGRAPHY[] || st_centroid(NULL::GEOGRAPHY::GEOGRAPHY)::GEOGRAPHY::GEOGRAPHY)::GEOGRAPHY[]::GEOGRAPHY[])::GEOGRAPHY[]
        test_1        |                             AS col_469719
        test_1        |                 )
        test_1        |                     AS tab_250199
        test_1        |             ORDER BY
        test_1        |                 col_469719 NULLS FIRST;
        test_1        |             
        test_1        |             cockroach1: [same as previous]
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 20b5defb2ae53273ca2d3642e585b57f4645b87d:

        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_2 DESC, col2_13 DESC, col2_12 DESC, col2_5, col2_0, col2_8);
        postgres_1    |     CREATE INDEX ON table2 (col2_2, col2_11 ASC, (col2_4 + col2_0) ASC) INCLUDE (col2_3, col2_4, col2_6, col2_8, col2_13);
        postgres_1    |     CREATE TABLE table3 (col3_0 INT8 NOT NULL, col3_1 INT4 NOT NULL, col3_2 INT4 NOT NULL, col3_3 NAME NOT NULL, col3_4 NAME, col3_5 BYTEA NOT NULL, PRIMARY KEY (col3_5, col3_0, col3_1, col3_2), col3_6 INT8 NOT NULL GENERATED ALWAYS AS ((col3_0 + col3_2) + col3_1) STORED, col3_7 INT4 NOT NULL GENERATED ALWAYS AS (col3_2 + col3_0) STORED, col3_8 TEXT GENERATED ALWAYS AS (lower(col3_4)) STORED, col3_9 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col3_5 IS NULL THEN e'\x16"\\'::TEXT ELSE '%a'::TEXT END) STORED, col3_10 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col3_5 IS NULL THEN '0'::TEXT ELSE e'\''::TEXT END) STORED);
        postgres_1    |     CREATE UNIQUE INDEX ON table3 ((col3_1 + col3_0) ASC, col3_2);
        postgres_1    |     CREATE TABLE table4 (col4_0 BYTEA NOT NULL, col4_1 DATE NOT NULL, col4_2 JSONB NOT NULL, col4_3 REGROLE NOT NULL, col4_4 REGPROC NOT NULL, col4_5 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col4_3 IS NULL THEN e'\x00'::TEXT ELSE e'\x12\x112apW\r|k'::TEXT END) STORED);
        postgres_1    |     CREATE TABLE table5 (col5_0 TIMETZ NOT NULL, col5_1 BYTEA NOT NULL, col5_2 REGCLASS NULL, PRIMARY KEY (col5_0, col5_1));
        postgres_1    |     CREATE UNIQUE INDEX ON table5 (col5_1 ASC, col5_2 DESC, col5_0 DESC);
        postgres_1    |     CREATE TYPE rand_typ_0 AS ENUM ('jay', 'tuwucd', 'sepom');
        postgres_1    |     CREATE TYPE rand_typ_1 AS ENUM ('cscy', 'l', 'gwy', 'jtihu', 'cc');
        postgres_1    |     CREATE TYPE rand_typ_2 AS ENUM ('nuwo', 'su', 'uewxvz', 'aebg', 'cvlkp');
        postgres_1    |     CREATE TYPE rand_typ_3 AS ENUM ('zilvh', 'ip', 'vbl', 'zlf');
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (606.18s)
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     --- FAIL: TestCompare/postgres (2.91s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 DATE NOT NULL, col1_1 FLOAT8 NOT NULL, PRIMARY KEY (col1_1, col1_0));
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_0 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_0, col1_1 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_0 DESC);
        test_1        |             CREATE INDEX ON table1 (col1_1, (col1_1 + (-0.24951936492370708)::FLOAT8) DESC);
        test_1        |             CREATE TABLE table2 (col2_0 INT4 NOT NULL, col2_1 DECIMAL NOT NULL, col2_2 REGCLASS NOT NULL, col2_3 TIMESTAMPTZ[] NOT NULL, col2_4 INT2 NULL, col2_5 REGTYPE NOT NULL, col2_6 BIT(41) NOT NULL, col2_7 FLOAT8 NOT NULL, col2_8 REGROLE, PRIMARY KEY (col2_7, col2_0, col2_5), col2_9 INT2 NULL GENERATED ALWAYS AS (col2_4 + 11738::INT8) STORED, col2_10 FLOAT8 NOT NULL GENERATED ALWAYS AS (col2_7 + (-0.5641874485151179)::FLOAT8) STORED, col2_11 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_2 IS NULL THEN e'?j\t\x07'::TEXT ELSE e'i\x103V<5'::TEXT END) STORED, col2_12 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_2 IS NULL THEN e'R{7;)\x10u\x05'::TEXT ELSE e'2b0F-\x13\x16!'::TEXT END) STORED, col2_13 INT4 NULL GENERATED ALWAYS AS (col2_0 + col2_4) STORED, col2_14 TEXT GENERATED ALWAYS AS (CASE WHEN col2_8 IS NULL THEN ''::TEXT ELSE '5G'::TEXT END) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_2 DESC, col2_13 DESC, col2_12 DESC, col2_5, col2_0, col2_8);
        test_1        |             CREATE INDEX ON table2 (col2_2, col2_11 ASC, (col2_4 + col2_0) ASC) INCLUDE (col2_3, col2_4, col2_6, col2_8, col2_13);
        test_1        |             CREATE TABLE table3 (col3_0 INT8 NOT NULL, col3_1 INT4 NOT NULL, col3_2 INT4 NOT NULL, col3_3 NAME NOT NULL, col3_4 NAME, col3_5 BYTEA NOT NULL, PRIMARY KEY (col3_5, col3_0, col3_1, col3_2), col3_6 INT8 NOT NULL GENERATED ALWAYS AS ((col3_0 + col3_2) + col3_1) STORED, col3_7 INT4 NOT NULL GENERATED ALWAYS AS (col3_2 + col3_0) STORED, col3_8 TEXT GENERATED ALWAYS AS (lower(col3_4)) STORED, col3_9 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col3_5 IS NULL THEN e'\x16"\\'::TEXT ELSE '%a'::TEXT END) STORED, col3_10 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col3_5 IS NULL THEN '0'::TEXT ELSE e'\''::TEXT END) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table3 ((col3_1 + col3_0) ASC, col3_2);
        test_1        |             CREATE TABLE table4 (col4_0 BYTEA NOT NULL, col4_1 DATE NOT NULL, col4_2 JSONB NOT NULL, col4_3 REGROLE NOT NULL, col4_4 REGPROC NOT NULL, col4_5 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col4_3 IS NULL THEN e'\x00'::TEXT ELSE e'\x12\x112apW\r|k'::TEXT END) STORED);
        test_1        |             CREATE TABLE table5 (col5_0 TIMETZ NOT NULL, col5_1 BYTEA NOT NULL, col5_2 REGCLASS NULL, PRIMARY KEY (col5_0, col5_1));
        test_1        |             CREATE UNIQUE INDEX ON table5 (col5_1 ASC, col5_2 DESC, col5_0 DESC);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('jay', 'tuwucd', 'sepom');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('cscy', 'l', 'gwy', 'jtihu', 'cc');
        test_1        |             CREATE TYPE rand_typ_2 AS ENUM ('nuwo', 'su', 'uewxvz', 'aebg', 'cvlkp');
        test_1        |             CREATE TYPE rand_typ_3 AS ENUM ('zilvh', 'ip', 'vbl', 'zlf');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ ba879c1d5404fb03f1e58616fec407aa9502df7b:

        test_1        |                 )
        test_1        |                     AS tab_15491
        test_1        |             ORDER BY
        test_1        |                 col_25311 NULLS FIRST,
        test_1        |                 col_25312 NULLS FIRST,
        test_1        |                 col_25313 NULLS FIRST,
        test_1        |                 col_25314 NULLS FIRST,
        test_1        |                 col_25315 NULLS FIRST,
        test_1        |                 col_25316 NULLS FIRST,
        test_1        |                 col_25317 NULLS FIRST,
        test_1        |                 col_25318 NULLS FIRST,
        test_1        |                 col_25319 NULLS FIRST,
        test_1        |                 col_25320 NULLS FIRST,
        test_1        |                 col_25321 NULLS FIRST,
        test_1        |                 col_25322 NULLS FIRST,
        test_1        |                 col_25323 NULLS FIRST,
        test_1        |                 col_25324 NULLS FIRST,
        test_1        |                 col_25325 NULLS FIRST,
        test_1        |                 col_25326 NULLS FIRST,
        test_1        |                 col_25327 NULLS FIRST,
        test_1        |                 col_25328 NULLS FIRST,
        test_1        |                 col_25329 NULLS FIRST,
        test_1        |                 col_25330 NULLS FIRST,
        test_1        |                 col_25331 NULLS FIRST,
        test_1        |                 col_25332 NULLS FIRST,
        test_1        |                 col_25333 NULLS FIRST,
        test_1        |                 col_25334 NULLS FIRST,
        test_1        |                 col_25335 NULLS FIRST,
        test_1        |                 col_25336 NULLS FIRST,
        test_1        |                 col_25337 NULLS FIRST,
        test_1        |                 col_25338 NULLS FIRST,
        test_1        |                 col_25339 NULLS FIRST,
        test_1        |                 col_25340 NULLS FIRST,
        test_1        |                 col_25341 NULLS FIRST,
        test_1        |                 col_25342 NULLS FIRST,
        test_1        |                 col_25343 NULLS FIRST,
        test_1        |                 col_25344 NULLS FIRST,
        test_1        |                 col_25345 NULLS FIRST
        test_1        |         compare_test.go:193: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ f63f6d6f7e8b850b3eaf67e7f6920f251c8598f0:

        test_1        |             +               Exp:    -13,
        test_1        |                             Status: 2,
        test_1        |                             NaN:    false,
        test_1        |                         },
        test_1        |                         {Int: s"1", Status: 2},
        test_1        |                     },
        test_1        |                     Dimensions: {{Length: 2, LowerBound: 1}},
        test_1        |                     Status:     2,
        test_1        |                 },
        test_1        |                 []uint8{0x45},
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (exp(7:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || (NULL::DECIMAL[]::DECIMAL[] || 1:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL[]::DECIMAL[])::DECIMAL[]
        test_1        |                             AS col_278191,
        test_1        |                         '\x45':::BYTES::BYTES AS col_278192
        test_1        |                 )
        test_1        |                     AS tab_168933
        test_1        |             ORDER BY
        test_1        |                 col_278191 NULLS FIRST, col_278192 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (exp(7::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || (NULL::DECIMAL[]::DECIMAL[] || 1::DECIMAL::DECIMAL::DECIMAL)::DECIMAL[]::DECIMAL[])::DECIMAL[]
        test_1        |                             AS col_278191,
        test_1        |                         '\x45'::BYTEA::BYTEA AS col_278192
        test_1        |                 )
        test_1        |                     AS tab_168933
        test_1        |             ORDER BY
        test_1        |                 col_278191 NULLS FIRST, col_278192 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 443e0395c03f0d11182f8863a4ef62538c0f8946:

        test_1        |                                 AND (tab_93625.col4_5) = (tab_93626.col4_5)
        test_1        |                                 AND (tab_93623.col3_0) = (tab_93626.col4_7)
        test_1        |                                 AND (tab_93620.col4_0) = (tab_93626.col4_0)
        test_1        |                                 AND (tab_93625.col4_6) = (tab_93626.col4_6)
        test_1        |                                 AND (tab_93624.col2_0) = (tab_93626.col4_7)
        test_1        |                                 AND (tab_93623.col3_5) = (tab_93626.col4_7)
        test_1        |                                 AND (tab_93625.tableoid) = (tab_93626.tableoid)
        test_1        |                                 AND (tab_93620.col4_1) = (tab_93626.col4_1)
        test_1        |                         JOIN postgres.public.table2@table2_col2_0_key2 AS tab_93627 ON (tab_93623.col3_4) = (tab_93627.col2_0),
        test_1        |                         postgres.public.table3@[0] AS tab_93628
        test_1        |                     ORDER BY
        test_1        |                         tab_93628.col3_8
        test_1        |                 )
        test_1        |                     AS tab_93629
        test_1        |             ORDER BY
        test_1        |                 col_141846 NULLS FIRST,
        test_1        |                 col_141847 NULLS FIRST,
        test_1        |                 col_141848 NULLS FIRST,
        test_1        |                 col_141849 NULLS FIRST,
        test_1        |                 col_141850 NULLS FIRST,
        test_1        |                 col_141851 NULLS FIRST,
        test_1        |                 col_141852 NULLS FIRST,
        test_1        |                 col_141853 NULLS FIRST,
        test_1        |                 col_141854 NULLS FIRST,
        test_1        |                 col_141855 NULLS FIRST,
        test_1        |                 col_141856 NULLS FIRST,
        test_1        |                 col_141857 NULLS FIRST,
        test_1        |                 col_141858 NULLS FIRST,
        test_1        |                 col_141859 NULLS FIRST,
        test_1        |                 col_141860 NULLS FIRST,
        test_1        |                 col_141861 NULLS FIRST,
        test_1        |                 col_141862 NULLS FIRST,
        test_1        |                 col_141863 NULLS FIRST,
        test_1        |                 col_141864 NULLS FIRST,
        test_1        |                 col_141865 NULLS FIRST,
        test_1        |                 col_141866 NULLS FIRST,
        test_1        |                 col_141867 NULLS FIRST,
        test_1        |                 col_141868 NULLS FIRST
        test_1        |         compare_test.go:193: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ e9fd200d3567aa542da6cd1f255e4d2971cbdd9e:

        postgres_1    |     
        test_1        | --- FAIL: TestCompare (609.04s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (7.07s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 REGNAMESPACE NOT NULL, col1_1 REGPROC NOT NULL, col1_2 BYTEA NOT NULL, col1_3 REGTYPE NOT NULL, col1_4 NAME NOT NULL, col1_5 DECIMAL NOT NULL, col1_6 INT2 NULL, col1_7 BOOL NOT NULL, PRIMARY KEY (col1_5, col1_3, col1_2, col1_7, col1_1, col1_0), col1_8 DECIMAL NOT NULL GENERATED ALWAYS AS (col1_5 + 1::DECIMAL) STORED, col1_9 DECIMAL NOT NULL GENERATED ALWAYS AS (col1_5 + 5.210496018744441663E+27::DECIMAL) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_9, col1_1 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table1 (lower(CAST(col1_7 AS TEXT)) DESC, col1_8, col1_9 DESC, col1_5, col1_4 DESC);
        test_1        |             CREATE TABLE table2 (col2_0 BOOL NOT NULL, col2_1 DECIMAL, col2_2 GEOGRAPHY NULL, col2_3 DATE NULL, col2_4 TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_2 AS TEXT))) STORED, col2_5 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col2_3 IS NULL THEN e'\x00'::TEXT ELSE e'zt\x0ew+f'::TEXT END) STORED);
        test_1        |             CREATE INDEX ON table2 (col2_4 DESC) INCLUDE (col2_0, col2_1, col2_2, col2_3, col2_5);
        test_1        |             CREATE INDEX ON table2 (col2_1);
        test_1        |             CREATE INDEX ON table2 (col2_0 DESC, col2_5 ASC);
        test_1        |             CREATE TABLE table3 (col3_0 REGTYPE NOT NULL, col3_1 REGNAMESPACE, col3_2 OID NOT NULL, col3_3 FLOAT4, col3_4 TIME, col3_5 DATE NULL, col3_6 REGCLASS NOT NULL, col3_7 "char", col3_8 REGPROCEDURE NOT NULL, col3_9 OID, col3_10 FLOAT8, col3_11 NAME NOT NULL, col3_12 VARCHAR NOT NULL, col3_13 REGCLASS NULL, col3_14 REGPROC NOT NULL, PRIMARY KEY (col3_8, col3_14, col3_11, col3_6), col3_15 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col3_14 IS NULL THEN 'w'::TEXT ELSE e'``\x19j8\x12\x19z\x0e7'::TEXT END) STORED, col3_16 TEXT NOT NULL GENERATED ALWAYS AS (lower(col3_11)) STORED, col3_17 TEXT GENERATED ALWAYS AS (lower(col3_7)) STORED);
        test_1        |             CREATE INDEX ON table3 (col3_12);
        test_1        |             CREATE INDEX ON table3 (col3_16, col3_3 ASC, col3_11 ASC, col3_2);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_3, col3_12 ASC, col3_1 ASC, col3_16 DESC, col3_2 ASC, col3_13 DESC, col3_11 DESC, col3_0 DESC, col3_17, col3_9, col3_10 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_14);
        test_1        |             CREATE INDEX ON table3 (col3_4 ASC, col3_8 DESC, col3_14 ASC, col3_15 DESC, col3_5, col3_6, (col3_10 + col3_3) ASC, col3_17 ASC, col3_0, col3_10, col3_9 DESC, col3_7 DESC, col3_2 ASC, col3_1 DESC, col3_3, col3_11 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_11, col3_4, col3_7, (col3_10 + col3_3) ASC, col3_1 ASC, col3_8 ASC, (col3_3 + 1.6684565544128418::FLOAT8) ASC, col3_14 ASC, col3_9 ASC, col3_5 ASC, col3_3 ASC, col3_12, col3_17 DESC) INCLUDE (col3_0, col3_2, col3_10);
        test_1        |             CREATE INDEX ON table3 (col3_15, col3_6, col3_8 ASC, col3_16 ASC, col3_10 DESC, col3_12 ASC, col3_4, col3_0 ASC, col3_9, col3_5 ASC, (col3_10 + 0.10938695189197922::FLOAT8) DESC, col3_14, col3_1) INCLUDE (col3_7, col3_13);
        test_1        |             CREATE INDEX ON table3 (col3_16 DESC, col3_1 DESC, col3_5, (col3_3 + col3_10), col3_0, col3_17, col3_10 DESC, col3_4, col3_11 DESC, col3_6 ASC, col3_15 ASC, col3_9 ASC, col3_8 ASC, col3_12) INCLUDE (col3_3);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_12 DESC, col3_1 ASC, col3_4, col3_9 ASC, col3_3, col3_5 DESC, col3_17 DESC, col3_14, col3_8 DESC, col3_10, col3_15 DESC, col3_6 ASC, col3_11 DESC, col3_0 ASC) INCLUDE (col3_2, col3_7, col3_13);
        test_1        |             CREATE TABLE table4 (col4_0 FLOAT4 NOT NULL, col4_1 REGTYPE NOT NULL, col4_2 TEXT NOT NULL, col4_3 REGNAMESPACE NOT NULL, PRIMARY KEY (col4_1, col4_3, col4_2, col4_0), col4_4 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col4_1 IS NULL THEN e'y5zq\x1a\x01luD'::TEXT ELSE '}~~V'::TEXT END) STORED, col4_5 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col4_1 IS NULL THEN e'\bvET\x1eodl'::TEXT ELSE ''::TEXT END) STORED);
        test_1        |             CREATE INDEX ON table4 (col4_1 ASC, col4_4 DESC, col4_2 DESC);
        test_1        |             CREATE INDEX ON table4 (col4_2 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_2 ASC, col4_4, col4_3 ASC);
        test_1        |             CREATE INDEX ON table4 (col4_0 ASC, col4_2 DESC, col4_4 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_2 DESC, col4_4, col4_5 ASC, col4_3 DESC, col4_0 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_0, col4_5);
        test_1        |             CREATE INDEX ON table4 (col4_5 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_0 ASC, (col4_0 + (-0.4474965035915375)::FLOAT8) DESC, col4_4 ASC, col4_5 DESC);
        test_1        |             CREATE INDEX ON table4 (col4_3 ASC, col4_2 ASC, col4_1 ASC, (col4_0 + (-0.149380624294281)::FLOAT8) ASC, col4_4, col4_0 ASC);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('e', 'jqjxki', 'xakvl', 'l');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 5afb632f77eee9f09f2adfa2943e1979ec4ebedf:

        test_1        |                     AS tab_107174
        test_1        |             ORDER BY
        test_1        |                 col_179556 NULLS FIRST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.00s)
        test_1        |         compare_test.go:125: starting test: mutators
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 195795 [running]:
        test_1        | testing.tRunner.func1.2(0x1fc3420, 0xc000b63ce0)
        test_1        |     /usr/local/go/src/testing/testing.go:1143 +0x332
        test_1        | testing.tRunner.func1(0xc000e1a180)
        test_1        |     /usr/local/go/src/testing/testing.go:1146 +0x4b6
        test_1        | panic(0x1fc3420, 0xc000b63ce0)
        test_1        |     /usr/local/go/src/runtime/panic.go:965 +0x1b9
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x409afc0, 0x31e0478, 0xc0006b48a0, 0x31e0478, 0xc0006b48a0, 0x6)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:368 +0x5d3
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0xc0006b4600, 0x409afc0, 0x0, 0x0, 0x0, 0x0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:301 +0x17f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc000e1a780)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:220 +0x9e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc0006b4600, 0xc000250c70, 0x1, 0x1, 0x0, 0x0, 0x0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:251 +0xbeb
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0x26bfa00, 0xc0006b4600, 0xc000250c70, 0x1, 0x1, 0x0, 0xc0001ef0e0, 0xe0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:97 +0x4e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc0006b4600, 0x2155a81, 0x5, 0x1, 0xc000bd1a30, 0x3, 0x3, 0xe0, 0x4436d7, 0x8)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:89 +0x163
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0xc0006b4600, 0x1, 0x0, 0x0)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:91 +0x19e
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc0006b4600, 0x4394f8, 0x30)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:77 +0x4f
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.wrapCommonSetup.func1(0xc0006b4600, 0xc6a374973cebce73, 0x11)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:43 +0x44
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000e1a180)
        test_1        |     /go/src/github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:127 +0x113
        test_1        | testing.tRunner(0xc000e1a180, 0xc0006b4570)
        test_1        |     /usr/local/go/src/testing/testing.go:1193 +0xef
        test_1        | created by testing.(*T).Run
        test_1        |     /usr/local/go/src/testing/testing.go:1238 +0x2b3
        compare_test_1 exited with code 2
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 2
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 9b06fffa0e5ffed8aa92cd0d860380dafe993bd2:

        postgres_1    | 2022-02-04 06:14:59.146 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2022-02-04 06:14:59.146 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2022-02-04 06:14:59.150 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2022-02-04 06:14:59.155 UTC [68] LOG:  database system was shut down at 2022-02-04 06:14:59 UTC
        postgres_1    | 2022-02-04 06:14:59.159 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2022-02-04 06:15:02.253 UTC [78] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2022-02-04 06:15:02.253 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 FLOAT8, col1_1 CHAR, col1_2 BOX2D, col1_3 NAME, col1_4 DECIMAL NOT NULL, col1_5 GEOGRAPHY NULL, col1_6 JSONB NOT NULL, col1_7 BIT(45), col1_8 TEXT, col1_9 REGPROC NULL, col1_10 REGPROCEDURE NULL, col1_11 BIT(47) NULL, col1_12 TEXT, col1_13 "char" NOT NULL, col1_14 INET[] NOT NULL, col1_15 REGPROCEDURE NOT NULL, col1_16 REGCLASS);
        postgres_1    |     CREATE INDEX ON table1 (lower(col1_1), col1_11 ASC, col1_9);
        postgres_1    |     CREATE TABLE table2 (col2_0 REGROLE NOT NULL, col2_1 BYTEA NOT NULL, col2_2 CHAR[] NOT NULL, col2_3 INT2 NOT NULL, PRIMARY KEY (col2_0, col2_3));
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_3 DESC);
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_3 DESC, col2_0) INCLUDE (col2_1, col2_2);
        postgres_1    |     CREATE INDEX ON table2 ((CASE WHEN col2_0 IS NULL THEN '{'::TEXT ELSE 'X'::TEXT END) DESC, (CASE WHEN col2_0 IS NULL THEN e'\x00'::TEXT ELSE '='::TEXT END) ASC, col2_0);
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_3 ASC);
        postgres_1    |     CREATE INDEX ON table2 (col2_3 DESC, (col2_3 + (-12209)::INT8)) INCLUDE (col2_2);
        postgres_1    |     CREATE INDEX ON table2 (col2_1, (col2_3 + (-16983)::INT8) ASC) INCLUDE (col2_2);
        postgres_1    |     CREATE TYPE rand_typ_0 AS ENUM ('unmvaq');
        postgres_1    |     CREATE TYPE rand_typ_1 AS ENUM ('tlraz', 'sp');
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (604.35s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (2.67s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:153: CREATE TABLE table1 (col1_0 FLOAT8, col1_1 CHAR, col1_2 BOX2D, col1_3 NAME, col1_4 DECIMAL NOT NULL, col1_5 GEOGRAPHY NULL, col1_6 JSONB NOT NULL, col1_7 BIT(45), col1_8 TEXT, col1_9 REGPROC NULL, col1_10 REGPROCEDURE NULL, col1_11 BIT(47) NULL, col1_12 TEXT, col1_13 "char" NOT NULL, col1_14 INET[] NOT NULL, col1_15 REGPROCEDURE NOT NULL, col1_16 REGCLASS);
        test_1        |             CREATE INDEX ON table1 (lower(col1_1), col1_11 ASC, col1_9);
        test_1        |             CREATE TABLE table2 (col2_0 REGROLE NOT NULL, col2_1 BYTEA NOT NULL, col2_2 CHAR[] NOT NULL, col2_3 INT2 NOT NULL, PRIMARY KEY (col2_0, col2_3));
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_3 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_3 DESC, col2_0) INCLUDE (col2_1, col2_2);
        test_1        |             CREATE INDEX ON table2 ((CASE WHEN col2_0 IS NULL THEN '{'::TEXT ELSE 'X'::TEXT END) DESC, (CASE WHEN col2_0 IS NULL THEN e'\x00'::TEXT ELSE '='::TEXT END) ASC, col2_0);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_3 ASC);
        test_1        |             CREATE INDEX ON table2 (col2_3 DESC, (col2_3 + (-12209)::INT8)) INCLUDE (col2_2);
        test_1        |             CREATE INDEX ON table2 (col2_1, (col2_3 + (-16983)::INT8) ASC) INCLUDE (col2_2);
        test_1        |             CREATE TYPE rand_typ_0 AS ENUM ('unmvaq');
        test_1        |             CREATE TYPE rand_typ_1 AS ENUM ('tlraz', 'sp');
        test_1        |             
        test_1        |         compare_test.go:154: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 0aa40c1edfb9166b169e91eaa19514ba0898e10c:

        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (583.85s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             -   string("0J"),
        test_1        |             +   string("0.0000000000000000J"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (pow(0:::DECIMAL::DECIMAL::DECIMAL, 4:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || 'J':::STRING::STRING::STRING)::STRING
        test_1        |                             AS col_656705
        test_1        |                 )
        test_1        |                     AS tab_388014
        test_1        |             ORDER BY
        test_1        |                 col_656705 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (pow(0::DECIMAL::DECIMAL::DECIMAL, 4::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || 'J'::TEXT::TEXT::TEXT)::TEXT
        test_1        |                             AS col_656705
        test_1        |                 )
        test_1        |                     AS tab_388014
        test_1        |             ORDER BY
        test_1        |                 col_656705 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 79c1f34aa3c91977ed6784338d7383931733d0b6:

        test_1        |                         JOIN postgres.public.table1@[0] AS tab_167002
        test_1        |                             JOIN postgres.public.table2@table2_col2_2_col2_1_expr_col2_0_key AS tab_167003
        test_1        |                                 JOIN postgres.public.table1@table1_col1_0_col1_3_col1_9_col1_2_key AS tab_167004 ON
        test_1        |                                         (tab_167003.col2_3) = (tab_167004.col1_6) AND (tab_167003.col2_1) = (tab_167004.col1_3) ON
        test_1        |                                     (tab_167002.col1_7) = (tab_167004.col1_3) AND (tab_167002.col1_6) = (tab_167003.col2_3) ON
        test_1        |                                 (tab_167001.col1_1) = (tab_167002.col1_1) AND (tab_167001.col1_3) = (tab_167004.col1_9)
        test_1        |                         JOIN postgres.public.table2@primary AS tab_167005
        test_1        |                             INNER JOIN postgres.public.table2@table2_col2_2_col2_1_col2_3_idx AS tab_167006
        test_1        |                                 JOIN postgres.public.table1@table1_col1_6_col1_3_col1_9_col1_8_col1_0_col1_7_expr_key
        test_1        |                                         AS tab_167007 ON
        test_1        |                                         (tab_167006.col2_1) = (tab_167007.col1_3) AND (tab_167006.tableoid) = (tab_167007.col1_0) ON
        test_1        |                                     true::BOOL ON
        test_1        |                                 (tab_167004.col1_8) = (tab_167005.col2_1)
        test_1        |                                 AND (tab_167000.col1_8) = (tab_167007.col1_7)
        test_1        |                                 AND (tab_167001.col1_9) = (tab_167007.col1_7)
        test_1        |                                 AND (tab_167004.col1_6) = (tab_167006.col2_3)
        test_1        |                                 AND (tab_167000.col1_0) = (tab_167007.col1_2)
        test_1        |                                 AND (tab_167002.col1_3) = (tab_167005.col2_1),
        test_1        |                         postgres.public.table2@[0] AS tab_167008
        test_1        |                         JOIN postgres.public.table2@[0] AS tab_167009 ON
        test_1        |                                 (tab_167008.col2_3) = (tab_167009.col2_0) AND (tab_167008.col2_3) = (tab_167009.tableoid)
        test_1        |                     ORDER BY
        test_1        |                         tab_167001.col1_7 ASC
        test_1        |                 )
        test_1        |                     AS tab_167010
        test_1        |             ORDER BY
        test_1        |                 col_278233 NULLS FIRST,
        test_1        |                 col_278234 NULLS FIRST,
        test_1        |                 col_278235 NULLS FIRST,
        test_1        |                 col_278236 NULLS FIRST,
        test_1        |                 CAST(col_278237 AS STRING) NULLS FIRST,
        test_1        |                 col_278238 NULLS FIRST,
        test_1        |                 col_278239 NULLS FIRST,
        test_1        |                 col_278240 NULLS FIRST,
        test_1        |                 col_278241 NULLS FIRST,
        test_1        |                 col_278242 NULLS FIRST,
        test_1        |                 col_278243 NULLS FIRST,
        test_1        |                 col_278244 NULLS FIRST
        test_1        |         compare_test.go:193: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ 92dfb8a4370274257b99cd9bccbe3854e243c268:

        postgres_1    |         col_202007 NULLS FIRST,
        postgres_1    |         col_202008 NULLS FIRST,
        postgres_1    |         col_202009 NULLS FIRST,
        postgres_1    |         col_202010 NULLS FIRST,
        postgres_1    |         col_202011 NULLS FIRST,
        postgres_1    |         col_202012 NULLS FIRST,
        postgres_1    |         col_202013 NULLS FIRST,
        postgres_1    |         col_202014 NULLS FIRST,
        postgres_1    |         col_202015 NULLS FIRST
        test_1        | --- FAIL: TestCompare (773.86s)
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (171.68s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             -   nil,
        test_1        |             +   string("BOX(-90 0,-45 45)"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_box2dfromgeohash('D':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D AS col_202336) AS tab_122853
        test_1        |             ORDER BY
        test_1        |                 CAST(col_202336 AS STRING) NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_box2dfromgeohash('D'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_202336) AS tab_122853
        test_1        |             ORDER BY
        test_1        |                 CAST(col_202336 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ d7a023225d0db89453ebe3193d59678907e464f3:

        test_1        |                         JOIN postgres.public.table1@table1_col1_2_key AS tab_22101
        test_1        |                             JOIN postgres.public.table3@[0] AS tab_22102
        test_1        |                                 JOIN postgres.public.table3@[0] AS tab_22103
        test_1        |                                     JOIN postgres.public.table2@[0] AS tab_22104
        test_1        |                                         JOIN postgres.public.table2@[0] AS tab_22105 ON (tab_22104.col2_8) = (tab_22105.col2_7)
        test_1        |                                         JOIN postgres.public.table3@[0] AS tab_22106 ON
        test_1        |                                                 (tab_22104.col2_0) = (tab_22106.col3_0)
        test_1        |                                                 AND (tab_22105.crdb_internal_mvcc_timestamp)
        test_1        |                                                     = (tab_22106.crdb_internal_mvcc_timestamp)
        test_1        |                                                 AND (tab_22105.col2_5) = (tab_22106.col3_1) ON
        test_1        |                                             (tab_22103.col3_0) = (tab_22106.col3_0) AND (tab_22103.col3_1) = (tab_22104.col2_5) ON
        test_1        |                                         (tab_22102.tableoid) = (tab_22106.col3_0)
        test_1        |                                         AND (tab_22102.col3_1) = (tab_22103.col3_1)
        test_1        |                                         AND (tab_22102.tableoid) = (tab_22103.tableoid)
        test_1        |                                         AND (tab_22102.col3_0) = (tab_22103.tableoid)
        test_1        |                                         AND (tab_22102.col3_0) = (tab_22103.col3_0)
        test_1        |                                         AND (tab_22102.col3_0) = (tab_22105.col2_0)
        test_1        |                                 JOIN postgres.public.table3@[0] AS tab_22107 ON
        test_1        |                                         (tab_22106.col3_0) = (tab_22107.col3_0)
        test_1        |                                         AND (tab_22104.col2_0) = (tab_22107.tableoid)
        test_1        |                                         AND (tab_22102.col3_1) = (tab_22107.col3_1)
        test_1        |                                 JOIN postgres.public.table2@[0] AS tab_22108 ON
        test_1        |                                         (tab_22104.col2_9) = (tab_22108.col2_9)
        test_1        |                                         AND (tab_22105.col2_0) = (tab_22108.tableoid)
        test_1        |                                         AND (tab_22107.col3_0) = (tab_22108.tableoid)
        test_1        |                                         AND (tab_22104.col2_6) = (tab_22108.col2_8) ON
        test_1        |                                     (tab_22101.col1_3) = (tab_22105.col2_1) AND (tab_22101.col1_2) = (tab_22103.col3_1) ON
        test_1        |                                 (tab_22100.col2_7) = (tab_22105.col2_6)
        test_1        |                 )
        test_1        |                     AS tab_22109
        test_1        |             ORDER BY
        test_1        |                 col_34286 NULLS FIRST,
        test_1        |                 col_34287 NULLS FIRST,
        test_1        |                 col_34288 NULLS FIRST,
        test_1        |                 col_34289 NULLS FIRST,
        test_1        |                 col_34290 NULLS FIRST,
        test_1        |                 col_34291 NULLS FIRST,
        test_1        |                 col_34292 NULLS FIRST
        test_1        |         compare_test.go:193: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

compose.TestComposeCompare failed with artifacts on release-21.2 @ c7cfac57476f06e3154b2fc38e77982a8bbc64c2:

        postgres_1    |         col_125530 NULLS FIRST,
        postgres_1    |         col_125531 NULLS FIRST,
        postgres_1    |         col_125532 NULLS FIRST,
        postgres_1    |         col_125533 NULLS FIRST,
        postgres_1    |         col_125534 NULLS FIRST,
        postgres_1    |         col_125535 NULLS FIRST,
        postgres_1    |         col_125536 NULLS FIRST,
        postgres_1    |         col_125537 NULLS FIRST,
        postgres_1    |         col_125538 NULLS FIRST
        test_1        | --- FAIL: TestCompare (686.88s)
        test_1        |     compare_test.go:116: Checking connection to: cockroach2
        test_1        |     compare_test.go:116: Checking connection to: postgres
        test_1        |     compare_test.go:116: Checking connection to: cockroach1
        test_1        |     --- FAIL: TestCompare/postgres (83.53s)
        test_1        |         compare_test.go:125: starting test: postgres
        test_1        |         compare_test.go:132: initializing connection: cockroach1
        test_1        |         compare_test.go:132: initializing connection: postgres
        test_1        |         compare_test.go:183: compare cockroach1 to postgres:
        test_1        |             unexpected diff:
        test_1        |               []interface{}(Inverse(func1, []interface{}{
        test_1        |             -   nil,
        test_1        |             +   string("BOX(0 -90,45 -45)"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_box2dfromgeohash('H':::STRING::STRING::STRING, NULL::INT4::INT4)::BOX2D AS col_125560) AS tab_64626
        test_1        |             ORDER BY
        test_1        |                 CAST(col_125560 AS STRING) NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_box2dfromgeohash('H'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D AS col_125560) AS tab_64626
        test_1        |             ORDER BY
        test_1        |                 CAST(col_125560 AS TEXT) NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:49: exit status 1
Reproduce

To reproduce, try: ```bash make stressrace TESTS=TestComposeCompare PKG=./pkg/compose TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1 ```

Same failure on other branches

- #67844 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.1] - #67791 compose: TestComposeCompare failed [C-test-failure O-robot branch-master]

Internal log

``` mjibson marked as alumn{us/a}; resolving to rafiss instead ```

/cc @cockroachdb/sql-experience rafiss

This test on roachdash | Improve this report!