search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.13k stars 3.81k forks source link

compose: TestComposeCompare failed #115745

Closed cockroach-teamcity closed 8 months ago

cockroach-teamcity commented 11 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 004cb44f70db685052a50afe78bc2df566ad26f9:

        test_1        |             +               Int:              s"10000000000000000",
        test_1        |             -               Exp:              0,
        test_1        |             +               Exp:              -16,
        test_1        |                             Status:           2,
        test_1        |                             NaN:              false,
        test_1        |                             InfinityModifier: s"none",
        test_1        |                         },
        test_1        |                     },
        test_1        |                     Dimensions: {{Length: 1, LowerBound: 1}},
        test_1        |                     Status:     2,
        test_1        |                 },
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         8.0::FLOAT8::FLOAT8 AS "co�l̾53604",
        test_1        |                         (exp(0::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[] AS col53605
        test_1        |                 )
        test_1        |                     AS tab29779
        test_1        |             ORDER BY
        test_1        |                 "co�l̾53604" NULLS FIRST, col53605 ASC;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         8.0:::FLOAT8::FLOAT8 AS "co�l̾53604",
        test_1        |                         (exp(0:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[] AS col53605
        test_1        |                 )
        test_1        |                     AS tab29779
        test_1        |             ORDER BY
        test_1        |                 "co�l̾53604" NULLS FIRST, col53605 ASC;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (668.87s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113814 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2.17-rc] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

/cc @cockroachdb/sql-foundations

This test on roachdash | Improve this report!

Jira issue: CRDB-34276

cockroach-teamcity commented 11 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 35220c8db8c023f9c1b0ebf1cb6442ead16802d6:

        test_1        |     --- FAIL: TestCompare/postgres (405.17s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1296694986/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   s"2",
        test_1        |             +   s"1",
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         width_bucket(2:::DECIMAL::DECIMAL::DECIMAL, (6:::DECIMAL::DECIMAL::DECIMAL % 1:::INT8::INT8::INT8)::DECIMAL::DECIMAL, 6:::DECIMAL::DECIMAL::DECIMAL, 3:::INT8::INT4::INT4)::INT8
        test_1        |                             AS "%vcol643027"
        test_1        |                 )
        test_1        |                     AS "
        test_1        |             tab369064"
        test_1        |             ORDER BY
        test_1        |                 "%vcol643027" ASC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         width_bucket(2::DECIMAL::DECIMAL::DECIMAL, (6::DECIMAL::DECIMAL::DECIMAL % 1::INT8::INT8::INT8)::DECIMAL::DECIMAL, 6::DECIMAL::DECIMAL::DECIMAL, 3::INT8::INT4::INT4)::INT8
        test_1        |                             AS "%vcol643027"
        test_1        |                 )
        test_1        |                     AS "
        test_1        |             tab369064"
        test_1        |             ORDER BY
        test_1        |                 "%vcol643027" ASC;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1035.81s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113814 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2.17-rc] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 11 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 35220c8db8c023f9c1b0ebf1cb6442ead16802d6:

        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (337.53s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare539714479/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("010300000000000000"),
        test_1        |             +   string("010300000001000000050000000000000000001440000000000000000000000000000014400000000000001C4000000000000000400000000000001C400000000000000040000000000000000000000000000014400000000000000000"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         st_makeenvelope(5.0:::FLOAT8::FLOAT8::FLOAT8, 0.0:::FLOAT8::FLOAT8::FLOAT8, 2.0:::FLOAT8::FLOAT8::FLOAT8, 7.0:::FLOAT8::FLOAT8::FLOAT8)::GEOMETRY
        test_1        |                             AS col121329
        test_1        |                 )
        test_1        |                     AS "t ab63096"
        test_1        |             ORDER BY
        test_1        |                 col121329 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         st_makeenvelope(5.0::FLOAT8::FLOAT8::FLOAT8, 0.0::FLOAT8::FLOAT8::FLOAT8, 2.0::FLOAT8::FLOAT8::FLOAT8, 7.0::FLOAT8::FLOAT8::FLOAT8)::GEOMETRY
        test_1        |                             AS col121329
        test_1        |                 )
        test_1        |                     AS "t ab63096"
        test_1        |             ORDER BY
        test_1        |                 col121329 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (965.55s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #113814 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2.17-rc] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 11 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 42ef724f412fb4fc7ca4cf48163f324eaa37a7de:

        test_1        | --- FAIL: TestCompare (777.57s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (172.49s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare4264078690/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare postgres to cockroach1: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("2.645751311064591A"),
        test_1        |             +   string("2.6457513110645905905A"),
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (sqrt(7::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || 'A'::TEXT::TEXT::TEXT)::TEXT AS col203548
        test_1        |                 )
        test_1        |                     AS tab106332
        test_1        |             ORDER BY
        test_1        |                 col203548 ASC NULLS LAST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (sqrt(7:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || 'A':::STRING::STRING::STRING)::STRING AS col203548
        test_1        |                 )
        test_1        |                     AS tab106332
        test_1        |             ORDER BY
        test_1        |                 col203548 ASC NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (804.81s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #113814 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2.17-rc] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 11 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ d6d1d4840b9238b8d7fb120e88ace29cd6dd8912:

        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.00s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 47 [running]:
        test_1        | testing.tRunner.func1.2({0x238cfa0, 0xc000dcef00})
        test_1        |     GOROOT/src/testing/testing.go:1526 +0x24e
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1529 +0x39f
        test_1        | panic({0x238cfa0, 0xc000dcef00})
        test_1        |     GOROOT/src/runtime/panic.go:884 +0x213
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x47c0640?, {0x334f668?, 0xc001127ef0?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:377 +0x445
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x33124c0?, 0x47c0640)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:310 +0x13c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc000f00a80)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:227 +0x96
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc0002c5e00, {0xc000dce980?, 0x2, 0xc0002c5e00?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:260 +0x8b1
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0xc000f1b968?, 0x259faa8?, {0xc000dce980?, 0x21bb200?, 0x44a501?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:98 +0x2e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc000dcc840?, {0x259faa8, 0x5}, 0x2, 0x0?, {0xc000ddfa48, 0x3, 0x456ba5d?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x13d
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0x1?, 0x617ae0?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:118 +0x177
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc000267500?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:98 +0x37
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.wrapCommonSetup.func1(0x278a3f8?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x22
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000f12340)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:143 +0xed
        test_1        | testing.tRunner(0xc000f12340, 0xc0002c5d70)
        test_1        |     GOROOT/src/testing/testing.go:1576 +0x10b
        test_1        | created by testing.(*T).Run
        test_1        |     GOROOT/src/testing/testing.go:1629 +0x3ea
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 2
--- FAIL: TestComposeCompare (18.74s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #113814 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2.17-rc] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

rafiss commented 11 months ago

Let's turn off this postgres-cockroach test. we are never able to prioritize the things it finds, and everything it finds seem like extremely minor edge cases.

cockroach-teamcity commented 11 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ ca2c36f76f16e664addc43f32f2626a366969b4f:

        postgres_1    |                 NULL::TIMETZ AS col441187,
        postgres_1    |                 "'tab238633".col1_0 AS col441188,
        postgres_1    |                 '\x48'::BYTEA::BYTEA AS col441189
        postgres_1    |             FROM
        postgres_1    |                 postgres.public."tab le1" AS "'tab238633"
        postgres_1    |         )
        postgres_1    |             AS "ta!b238634"
        postgres_1    |     ORDER BY
        postgres_1    |         col441180 ASC NULLS LAST,
        postgres_1    |         col441181 NULLS LAST,
        postgres_1    |         col441182 DESC,
        postgres_1    |         col441183 DESC NULLS LAST,
        postgres_1    |         col441184 ASC NULLS FIRST,
        postgres_1    |         col441185 NULLS FIRST,
        postgres_1    |         col441186 ASC,
        postgres_1    |         col441187 ASC,
        postgres_1    |         col441188 NULLS LAST,
        postgres_1    |         col441189 NULLS FIRST
        test_1        | --- FAIL: TestCompare (1220.70s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (615.32s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '{"D": {"A": false, "D": [{"H": {"B": [{"A": true, "E": {"D": null, "F": true}}, {"F": {"E": false, "H": [{"F": {"C": {"D": true}, "E": false}, "G": false, "H": null}], "I": {"C": [9], "H": true, "J": {"C": false, "G": true}}}}, {"D": {"H": null, "J": 0}, "I": "C", "J": {"J": {"A": {"D": {"B": {"C": null}, "D": "C"}}, "G": null}}}], "E": {"B": false, "C": {"E": 8}, "I": [true, {"A": {"C": {"H": {"F": null}, "I": 7}, "G": false}}, {"C": {"F": {"G": 8, "H": null, "J": "I"}, "H": "G"}, "I": false, "J": [{"B": true, "E": false, "F": {"D": 4}}, {"D": null, "E": "E"}, false]}]}, "F": "D"}, "J": 4}, {"A": {"A": "J", "G": false, "I": 5}, "B": 9}, "H"]}, "E": {"C": 4, "H": ["G", {"H": "D"}], "I": false}, "I": {"B": [{"D": {"E": {"G": {"D": {"F": false, "G": {"I": [{"D": {"F": null, "H": {"A": {"D": {"C": {"A": true}, "H": {"A": {"D": true, "F": "H", "I": null}, "B": true, "C": 1}, "I": true}, "G": {"I": null}, "H": 8}, "I": {"E": false}, "J": {"A": [{"A": null, "F": {"A": [false, null, true], "B": 1}, "H": {"A": {"D": true, "H": null}}}, {"C": 7, "D": [[true], 7, 7], "F": {"A": {"H": "J", "J": [{"H": {"D": {"D": {"F": false, "I": 3}, "E": true}, "G": {"J": 8}, "I": null}}, "H", {"F": {"B": {"A": true}, "G": null}}]}, "C": {"A": false, "J": [[{"C": 4, "D": {"A": "J", "D": null, "J": "C"}, "J": 3}, {"J": "B"}, [{"G": null, "I": true}]], {"C": [false, true, {"B": {"B": [null, {"G": {"C": false, "H": {"F": {"A": {"J": {"A": {"C": 5}}}, "C": {"A": {"B": {"C": {"C": {"D": "C"}, "I": null}}, "F": {"E": {"E": {"D": {"C": {"B": null, "J": {"H": 0}}}}}, "J": {"J": false}}}}}, "I": {"B": {"C": {"H": {"B": [9], "D": {"A": {"G": {"A": {"A": true, "G": null}, "D": false}}, "G": false}, "E": 8}}, "F": false, "G": {"A": 1, "I": null}}, "G": {"H": {"B": {"B": {"A": ["J", {"A": {"A": {"D": "J", "E": [{"E": "A", "F": 8}]}}, "C": true, "E": {"J": {"C": true, "E": {"J": [[{"E": "C", "H": null}, {"B": [{"C": [5], "F": {"G": {"E": {"A": false, "E": null}, "I": true, "J": {"I": [{"D": "E"}, true]}}, "H": {"G": {"E": 9}, "I": 4}, "J": true}, "J": {"D": {"A": true, "E": 3, "I": null}, "E": {"A": "B", "H": {"H": null}, "J": {"A": {"B": true, "D": 0}, "F": 9}}}}, [{"A": {"I": {"B": null}}, "H": 5, "J": false}, 4]], "G": {"A": {"G": {"I": null}, "H": true}, "H": {"C": {"B": false, "F": {"G": {"C": [{"C": false}, 9]}}}, "D": {"D": {"H": {"F": {"G": {"F": true, "J": false}}}}, "I": null}}, "J": {"H": {"D": true, "G": {"I": {"H": {"I": {"C": {"C": {"C": 2, "E": true, "G": {"H": "F"}}, "G": {"H": "A", "J": 1}, "J": true}, "E": {"C": null, "G": 1}, "G": {"G": null, "J": false}}}, "J": {"E": [null], "G": true}}}}}}, "J": {"B": {"D": {"A": {"C": true, "H": {"J": {"B": "H", "F": "H", "H": null}}, "I": {"A": {"H": true, "I": {"E": 0, "F": {"H": {"C": {"C": {"B": "J", "C": {"E": false, "I": [[false], {"A": {"I": {"C": {"D": [8], "J": {"G": null, "I": "C"}}, "G": {"C": [true, [false, {"B": false, "I": {"C": true, "G": {"I": null}}}]], "E": "G", "J": [null]}}}, "B": {"E": true, "F": {"C": null, "E": {"B": {"F": false}, "E": {"A": {"A": null, "E": 3}, "H": null}}, "J": {"H": false}}, "G": {"I": null, "J": 6}}, "C": false}, true]}, "D": false}, "E": true, "H": {"C": true, "J": null}}, "I": false}}, "G": false}}}}, "G": {"G": 4}, "J": null}, "G": 5}, "F": [{"B": "J", "I": true}]}}], {"A": {"E": {"E": true, "J": {"C": 4, "D": {"D": {"A": {"I": {"D": false, "E": true}}, "G": {"C": {"H": false, "I": "E", "J": 0}, "H": 1, "J": null}, "J": {"C": true, "E": {"D": [{"E": false, "J": [false, {"J": 2}]}]}, "F": "E"}}, "G": [false, {"B": {"C": {"E": {"C": {"H": {"E": {"G": {"D": {"C": false, "J": 4}, "H": {"B": false, "D": true, "F": false}, "J": true}, "I": {"C": 7, "I": {"F": 8, "I": false}, "J": true}}, "I": null}}, "D": [{"F": [{"E": [false, true, {"B": {"E": {"A": "D", "G": {"H": {"H": 2, "I": null}, "I": {"D": "D"}, "J": {"C": false, "E": null}}, "J": 4}, "I": {"E": {"E": "D", "J": null}, "J": true}, "J": true}, "C": {"D": false, "J": true}, "E": false}], "I": {"A": 8, "H": null}}, null]}], "F": null}}, "H": [null]}, "F": true}, "A"], "J": {"C": 3}}, "H": {"G": true, "H": 2, "I": {"B": {"D": "I", "I": {"D": true}}, "E": {"A": [null, "G", [5]], "H": {"C": false, "G": {"D": false}}}}}}}, "F": {"B": "E"}}, "D": {"E": {"A": [true, false], "C": null, "J": [null, {"C": [false, [false, {"H": true}]], "H": {"A": false}}]}, "J": 7}, "G": {"B": [[{"B": true, "E": {"H": 9}, "G": {"G": null}}, {"A": {"B": true}, "I": true}, [{"A": 9, "D": null, "F": "E"}, {"A": {"C": [{"I": [{"G": true, "I": [{"E": false, "F": {"E": true}, "I": null}], "J": true}, false, {"C": false}]}, {"D": "B", "E": {"G": "B"}, "G": {"C": {"I": [{"B": {"B": null, "F": null, "I": true}, "I": {"J": true}, "J": 7}, 4, {"G": {"E": null, "G": {"E": [3], "F": {"A": {"F": {"C": {"B": {"A": 8, "J": 8}, "D": 0}, "G": [{"A": false, "E": {"J": false}}]}, "G": true}, "D": 9, "I": [{"I": 0}, {"D": {"A": {"I": {"C": true}, "J": [2, {"D": null, "F": {"G": {"A": [{"H": [true, 3, {"D": true}]}]}}}]}, "I": {"E": "G", "H": {"A": 4, "B": null}}, "J": null}, "E": null, "H": [{"C": false}, {"E": {"I": null}, "H": 0}, false]}]}, "J": {"D": 3, "F": null}}}, "I": null}]}, "D": {"D": true, "G": 0}, "E": {"B": true, "D": false, "F": {"B": {"A": {"C": [false, true, {"G": {"B": null, "C": true, "G": null}}]}, "H": {"A": {"E": {"A": 5}, "I": null}, "G": {"B": {"A": [{"H": {"D": false}}, [{"C": false}, {"F": 3, "G": {"G": 1}}, {"A": "F"}]], "C": true}, "I": {"D": "A", "F": true}, "J": null}}}, "C": true}}}}], "I": false}, "C": {"D": {"B": {"B": false, "D": 5, "F": {"A": true, "F": true, "H": {"J": 9}}}}, "J": "B"}}]]], "D": [{"G": {"D": {"C": {"I": {"G": {"B": null, "C": [2, {"B": 2, "C": "E"}], "I": {"D": {"A": {"C": {"B": true, "C": {"G": {"C": true}, "H": false, "J": [8]}, "E": {"I": true}}, "E": {"B": {"A": false, "B": {"A": [null, true, null], "F": {"J": false}, "J": {"E": {"H": {"B": {"G": true, "H": {"C": "D", "H": "I"}}, "J": "C"}}, "H": 8}}, "H": null}, "E": {"C": {"C": 1, "D": ["C", {"E": {"A": {"C": false, "E": false}, "F": true, "I": {"F": true, "J": null}}}]}}, "H": {"F": [0, [{"E": "I"}, null, "C"]]}}, "H": [0, {"E": {"F": true, "H": {"A": {"G": null, "H": false}}}, "J": null}, true]}, "J": {"I": {"D": {"C": {"A": true, "G": 4}, "E": {"F": {"B": true}}}}}}}}}}, "E": {"A": {"B": {"E": false, "H": {"A": {"D": [6, false, {"D": true}]}, "E": {"D": [{"A": 7, "B": {"A": [4]}, "G": {"G": {"I": {"A": 5, "D": {"J": null}}}, "J": {"I": {"A": {"A": {"C": false, "H": {"H": {"D": 6, "E": [{"C": [["G"]], "I": true}, [{"J": [{"B": {"F": 3, "J": null}}, {"A": true}]}, false], null]}}}}, "F": true}, "J": {"I": "F", "J": {"C": false}}}}}, false, {"D": true, "H": "C"}], "G": {"B": true, "C": true, "D": {"G": {"D": {"G": null}, "E": {"B": true}, "H": {"A": null}}}}, "H": true}}}, "G": true}, "H": {"D": {"D": true, "E": true}, "H": false, "J": false}}, "J": "D"}, "I": [false, false]}}, {"D": {"C": [[[{"B": {"B": true, "D": 9}}, false, {"C": {"A": {"C": "H", "D": false}, "B": false, "D": {"A": {"D": {"A": true}, "G": {"C": 5}}}}, "D": {"B": {"D": {"C": null, "G": [{"C": {"A": {"A": {"I": {"A": [1], "G": 8}}, "D": 1}}, "E": true, "I": [{"B": 1, "G": 8}, {"C": [["C", {"B": null}], "F"]}, "J"]}, {"H": 2}], "I": ["D", [null], null]}, "G": [null, 1, true], "J": false}, "D": 5, "I": true}}], "G"], {"B": [null, {"E": {"J": {"D": {"A": null, "D": null}, "E": null}}, "F": {"E": 6}, "G": {"B": {"A": true, "H": [{"B": {"A": {"H": {"B": [{"G": "I"}, 0, false], "F": {"A": "H", "I": {"G": 5}, "J": "D"}, "J": {"F": true}}}, "H": {"B": {"A": [{"A": null, "F": {"A": true, "E": [0, null, {"A": {"I": [[{"B": {"F": true}, "H": [2, [[true, 8, [{"B": "E"}, {"F": {"G": 1}}, [{"G": {"E": {"G": {"I": {"I": null}}}}}, true]]]]], "I": false}, true, true], null, true], "J": {"C": false}}, "C": {"J": false}, "D": true}], "J": {"F": {"J": [{"C": "D", "H": false}, [{"J": false}, {"D": 6}], {"D": false}]}, "G": {"C": {"G": {"A": {"A": {"A": "G", "E": true, "G": {"B": ["D", true, {"J": {"B": true, "C": false, "F": [{"G": {"G": {"J": {"E": {"E": true, "G": "F"}, "J": null}}}}, null, {"A": false}]}}]}}, "B": true, "I": {"B": "H"}}, "G": 3}}}, "H": [false, true]}}}, ["D", {"G": 7, "I": {"B": null, "H": {"B": {"C": 1, "D": true, "J": false}, "I": {"B": {"A": "H", "H": [null], "I": [false, false]}, "F": {"J": [{"C": 9, "E": false}, {"D": true, "J": "A"}, {"A": null, "E": null}]}, "H": true}}}, "J": null}], 0]}, "C": 7, "D": {"E": false}}, "J": "E"}, "G": [{"D": false, "E": {"B": "I", "E": {"A": {"A": null, "G": {"C": {"E": [1], "F": ["C", [{"A": [{"F": 8}, false, "A"]}, {"C": "I", "E": false, "G": false}]], "G": 8}, "F": true}}, "C": "C", "F": {"D": null, "J": true}}, "G": false}, "I": [null]}]}, 7, true]}, "C": [[{"C": {"H": 7}, "J": "E"}]]}}], "D": {"E": "A", "G": "H", "J": true}}, {"G": {"D": {"D": {"H": true}, "G": {"I": true, "J": null}, "I": [[{"C": {"D": false, "E": false, "J": [true, null]}, "J": null}, 2, false], {"F": {"F": {"D": {"A": {"E": {"C": false, "G": {"B": "J", "J": 2}}}, "B": {"J": {"H": null}}}, "G": {"D": 8, "E": false}, "J": "F"}}}, true]}, "F": [{"C": null, "H": {"G": {"C": true, "I": "B"}, "I": "F"}, "I": 8}, "H", false]}}]}, "F": {"G": null, "I": {"A": "B", "D": {"H": "C"}, "I": [{"H": {"B": {"D": 9}, "H": false}}, [null, {"A": null, "F": [2], "G": {"D": false}}], {"B": {"J": 3}, "I": null}]}, "J": [{"E": true}, {"D": true, "H": {"G": false}}, {"D": {"A": true, "B": {"E": null, "G": {"C": "E", "I": {"F": {"E": null, "J": {"I": {"D": [{"A": false, "E": 2, "I": {"H": "I", "I": 9}}], "F": null, "I": {"I": "E"}}}}, "G": false}}, "I": "G"}, "D": {"H": true}}, "G": {"I": 6}}]}}], "J": {"E": {"G": {"F": {"A": null, "E": "G", "G": "H"}}, "I": false}}}}]}, "F": {"B": {"G": false}, "J": false}}}}], "H": "D"}, "F": {"C": {"D": false, "F": {"D": "J", "G": true}}, "H": "D"}, "H": {"A": false, "B": null, "J": {"G": null}}}}}}}}, "H": 2, "J": false}, {"B": [{"A": true, "C": true}, "C"], "G": [[false]], "H": true}], "H": false}, "E": {"C": 1, "F": false, "I": {"F": true, "H": {"C": "F", "E": false, "G": [7, false]}, "I": 9}}}], "E": {"F": "A"}, "H": 2}]}}}, {"D": null, "J": {"F": true, "G": null}}], "G": {"A": "G", "B": "G"}}}, "J": {"A": null, "E": false, "G": {"B": null, "E": true, "H": {"A": true, "J": 2}}}}, "I": true}, [6, false, {"B": null, "D": "B", "J": {"B": "C", "H": [{"H": "A"}]}}]], "J": false}}}}, "I": {"C": true, "E": {"E": null, "F": {"A": "D", "D": {"E": {"B": [4, false]}, "H": true, "I": [{"H": 3}, 0, "G"]}}}, "J": null}}, "H": [7]}, {"C": 4, "E": {"G": {"A": {"A": true, "G": 1}}}, "G": {"D": {"G": "B", "H": null}}}], "C": {"J": {"E": {"F": "H"}}}}}':::JSONB::JSONB
        test_1        |                             AS col441204
        test_1        |                 )
        test_1        |                     AS tab238644
        test_1        |             ORDER BY
        test_1        |                 col441204 ASC NULLS LAST
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1245.21s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116303 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1-merge-v23.1.13] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 11 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 2dad1b655dbc3ca6e9b74bc53f32b9796d982b28:

        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (116.06s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare401513/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   s"-0288-03-25 07:15:43.145224 +0000 UTC",
        test_1        |             +   s"0004-07-04 07:03:00 +0000 UTC",
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         make_timestamp(4:::INT8::INT4::INT4, 7:::INT8::INT4::INT4, 4:::INT8::INT4::INT4, 7:::INT8::INT4::INT4, 3:::INT8::INT4::INT4, 0.0:::FLOAT8::FLOAT8::FLOAT8)::TIMESTAMP
        test_1        |                             AS c̏ol59133
        test_1        |                 )
        test_1        |                     AS tab52072
        test_1        |             ORDER BY
        test_1        |                 c̏ol59133 ASC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         make_timestamp(4::INT8::INT4::INT4, 7::INT8::INT4::INT4, 4::INT8::INT4::INT4, 7::INT8::INT4::INT4, 3::INT8::INT4::INT4, 0.0::FLOAT8::FLOAT8::FLOAT8)::TIMESTAMP
        test_1        |                             AS c̏ol59133
        test_1        |                 )
        test_1        |                     AS tab52072
        test_1        |             ORDER BY
        test_1        |                 c̏ol59133 ASC;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (745.74s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116303 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1-merge-v23.1.13] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 11 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 0f81606066ceb3650a135d43ff25733f0158cd03:

        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (373.31s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1424436166/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |                 s"2000-01-09 00:00:00 +0000 UTC",
        test_1        |             -   int32(1),
        test_1        |             +   int32(2),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '2000-01-09':::DATE::DATE AS "coL414207",
        test_1        |                         int4(asin(1.0:::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::INT4 AS col414208
        test_1        |                 )
        test_1        |                     AS tab219766
        test_1        |             ORDER BY
        test_1        |                 "coL414207" ASC NULLS LAST, col414208 DESC NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '2000-01-09'::DATE::DATE AS "coL414207",
        test_1        |                         int4(asin(1.0::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::INT4 AS col414208
        test_1        |                 )
        test_1        |                     AS tab219766
        test_1        |             ORDER BY
        test_1        |                 "coL414207" ASC NULLS LAST, col414208 DESC NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1004.68s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 11 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ a160fff557abbb5384964a96e35657efcb384e29:

        postgres_1    | 2023-12-18 06:22:24.554 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-12-18 06:22:24.658 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-12-18 06:22:24.658 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-12-18 06:22:24.658 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-12-18 06:22:24.662 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-12-18 06:22:24.668 UTC [68] LOG:  database system was shut down at 2023-12-18 06:22:24 UTC
        postgres_1    | 2023-12-18 06:22:24.676 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-12-18 06:22:26.384 UTC [78] ERROR:  invalid input syntax for type numeric: "-Infinity" at character 283
        postgres_1    | 2023-12-18 06:22:26.384 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 INT8 NOT NULL, col1_1 PG_LSN NOT NULL, "col1 _2" TIMETZ NOT NULL, col1_3 TIMESTAMPTZ NULL, col1_4 INTERVAL NOT NULL, col1_5 TSQUERY, col1_6 TEXT NOT NULL, col1_7 INT8, "cOl1_8" DECIMAL NOT NULL, "(col1_9" DECIMAL NOT NULL GENERATED ALWAYS AS ("cOl1_8" + '-Infinity'::DECIMAL) STORED, "col1_%cf10" INT8 GENERATED ALWAYS AS (col1_0 + col1_7) STORED, col1_11 INT8 GENERATED ALWAYS AS (col1_7 + col1_0) STORED, col1_12 INT8 GENERATED ALWAYS AS (col1_7 + col1_0) STORED, "col1,_\f13" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_4 IS NULL THEN e'\U00002603'::TEXT ELSE e'\''::TEXT END) STORED, "col1%q_14" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_4 IS NULL THEN ''::TEXT ELSE 'Z{N"g8&'::TEXT END) STORED, "col1_\\xf815" INT8 GENERATED ALWAYS AS (col1_7 + col1_0) STORED);
        postgres_1    |     CREATE INDEX ON table1 ("col1_\\xf815", col1_3) INCLUDE (col1_0, col1_1, col1_5, col1_6, col1_7, "(col1_9", "col1_%cf10", col1_11);
        postgres_1    |     CREATE INDEX ON table1 ("cOl1_8", col1_6 DESC, "(col1_9" DESC, col1_3 DESC, col1_4 DESC, col1_0, "col1_\\xf815" DESC, "col1,_\f13" ASC, col1_7, lower(CAST(col1_5 AS TEXT)) DESC, "col1 _2", "col1_%cf10" DESC) INCLUDE (col1_5, "col1%q_14");
        postgres_1    |     CREATE UNIQUE INDEX ON table1 (lower(CAST(col1_6 AS TEXT)));
        postgres_1    |     CREATE UNIQUE INDEX ON table1 (lower(CAST("col1 _2" AS TEXT)) DESC, col1_7 ASC, col1_0 ASC);
        postgres_1    |     CREATE UNIQUE INDEX ON table1 (col1_7 DESC, col1_1);
        postgres_1    |     CREATE UNIQUE INDEX ON table1 (lower(CAST(col1_6 AS TEXT)) DESC, col1_0) INCLUDE (col1_6, col1_7, "cOl1_8", "(col1_9", "col1_%cf10", col1_11);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (606.40s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.00s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:172: CREATE TABLE table1 (col1_0 INT8 NOT NULL, col1_1 PG_LSN NOT NULL, "col1 _2" TIMETZ NOT NULL, col1_3 TIMESTAMPTZ NULL, col1_4 INTERVAL NOT NULL, col1_5 TSQUERY, col1_6 TEXT NOT NULL, col1_7 INT8, "cOl1_8" DECIMAL NOT NULL, "(col1_9" DECIMAL NOT NULL GENERATED ALWAYS AS ("cOl1_8" + '-Infinity'::DECIMAL) STORED, "col1_%cf10" INT8 GENERATED ALWAYS AS (col1_0 + col1_7) STORED, col1_11 INT8 GENERATED ALWAYS AS (col1_7 + col1_0) STORED, col1_12 INT8 GENERATED ALWAYS AS (col1_7 + col1_0) STORED, "col1,_\f13" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_4 IS NULL THEN e'\U00002603'::TEXT ELSE e'\''::TEXT END) STORED, "col1%q_14" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_4 IS NULL THEN ''::TEXT ELSE 'Z{N"g8&'::TEXT END) STORED, "col1_\\xf815" INT8 GENERATED ALWAYS AS (col1_7 + col1_0) STORED);
        test_1        |             CREATE INDEX ON table1 ("col1_\\xf815", col1_3) INCLUDE (col1_0, col1_1, col1_5, col1_6, col1_7, "(col1_9", "col1_%cf10", col1_11);
        test_1        |             CREATE INDEX ON table1 ("cOl1_8", col1_6 DESC, "(col1_9" DESC, col1_3 DESC, col1_4 DESC, col1_0, "col1_\\xf815" DESC, "col1,_\f13" ASC, col1_7, lower(CAST(col1_5 AS TEXT)) DESC, "col1 _2", "col1_%cf10" DESC) INCLUDE (col1_5, "col1%q_14");
        test_1        |             CREATE UNIQUE INDEX ON table1 (lower(CAST(col1_6 AS TEXT)));
        test_1        |             CREATE UNIQUE INDEX ON table1 (lower(CAST("col1 _2" AS TEXT)) DESC, col1_7 ASC, col1_0 ASC);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_7 DESC, col1_1);
        test_1        |             CREATE UNIQUE INDEX ON table1 (lower(CAST(col1_6 AS TEXT)) DESC, col1_0) INCLUDE (col1_6, col1_7, "cOl1_8", "(col1_9", "col1_%cf10", col1_11);
        test_1        |             
        test_1        |         compare_test.go:173: postgres: exec: ERROR: invalid input syntax for type numeric: "-Infinity" (SQLSTATE 22P02)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (631.45s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 11 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 8268a2c61904bae4a5ede0b8a2d9f62f1826047e:

        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (384.14s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1335414083/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("125B"),
        test_1        |             +   string("125.0000000000000000B"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (pow(5:::DECIMAL::DECIMAL::DECIMAL, 3:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || CASE WHEN false::BOOL THEN (NULL::REFCURSOR::REFCURSOR || 'I':::STRING::STRING::STRING)::STRING ELSE 'B':::STRING::STRING END::STRING)::STRING
        test_1        |                             AS col274853
        test_1        |                 )
        test_1        |                     AS "taB167624"
        test_1        |             ORDER BY
        test_1        |                 col274853 ASC NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (pow(5::DECIMAL::DECIMAL::DECIMAL, 3::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || CASE WHEN false::BOOL THEN (NULL::REFCURSOR::REFCURSOR || 'I'::TEXT::TEXT::TEXT)::TEXT ELSE 'B'::TEXT::TEXT END::TEXT)::TEXT
        test_1        |                             AS col274853
        test_1        |                 )
        test_1        |                     AS "taB167624"
        test_1        |             ORDER BY
        test_1        |                 col274853 ASC NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1015.01s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 11 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 3b9a2c70092f33f49cc3532aad60212df389c808:

        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (0.00s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 220 [running]:
        test_1        | testing.tRunner.func1.2({0x225d9e0, 0xc0025e8f60})
        test_1        |     GOROOT/src/testing/testing.go:1545 +0x238
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1548 +0x397
        test_1        | panic({0x225d9e0?, 0xc0025e8f60?})
        test_1        |     GOROOT/src/runtime/panic.go:914 +0x21f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x46ab740?, {0x31ec738?, 0xc0025efd70?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:377 +0x436
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x31ab100?, 0x46ab740)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:310 +0x12c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc0025d1980)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:227 +0x7f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc0025ee990, {0xc0025e86c0?, 0x2, 0xc0025ee990?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:260 +0x89d
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0x205dee0?, 0x245f541?, {0xc0025e86c0?, 0x49ddf68?, 0x2?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:98 +0x28
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc0006c8720?, {0x245f541, 0x5}, 0x2, 0xe0?, {0xc0024c7a40, 0x3, 0x7fbe0b928108?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x131
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0xc0025bdcc8?, 0x1?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:118 +0x15e
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc000130a00?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:98 +0x2f
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.init.wrapCommonSetup.func28(0x2644ba8?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x1b
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc00025fd40)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:143 +0xe2
        test_1        | testing.tRunner(0xc00025fd40, 0xc0025ee900)
        test_1        |     GOROOT/src/testing/testing.go:1595 +0xff
        test_1        | created by testing.(*T).Run in goroutine 53
        test_1        |     GOROOT/src/testing/testing.go:1648 +0x3ad
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 2
--- FAIL: TestComposeCompare (20.21s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 11 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 0b0851f59e6c37706c5df624fa3a579faa46d736:

        postgres_1    | 2023-12-22 06:23:48.472 UTC [78] ERROR:  could not identify an ordering operator for type refcursor at character 271
        postgres_1    | 2023-12-22 06:23:48.472 UTC [78] HINT:  Use an explicit ordering operator or modify the query.
        postgres_1    | 2023-12-22 06:23:48.472 UTC [78] STATEMENT:  SELECT
        postgres_1    |         *
        postgres_1    |     FROM
        postgres_1    |         (
        postgres_1    |             SELECT
        postgres_1    |                 refcursor(refcursor(NULL::REFCURSOR::REFCURSOR)::REFCURSOR::REFCURSOR)::REFCURSOR AS ćol116572
        postgres_1    |             FROM
        postgres_1    |                 postgres.public."table
1" AS tab133779
        postgres_1    |             WHERE
        postgres_1    |                 false::BOOL
        postgres_1    |             ORDER BY
        postgres_1    |                 tab133779.tableoid NULLS LAST
        postgres_1    |         )
        postgres_1    |             AS tab😨133780
        postgres_1    |     ORDER BY
        postgres_1    |         ćol116572 DESC
        test_1        | --- FAIL: TestCompare (975.71s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (370.93s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '{"F": "H", "G": {"A": null, "E": [8, ["G", {"C": [{"B": {"A": 6, "H": false}, "E": {"A": {"J": null}, "D": {"C": {"B": true, "C": {"F": {"E": {"A": {"D": "C", "F": false}, "C": {"G": 5}, "F": {"I": "F"}}, "G": false}}}, "I": "G"}}}, {"B": [true, {"A": 2, "I": {"B": true, "I": false}}, [{"C": {"G": [{"B": 6, "F": {"A": {"A": {"E": true, "J": null}, "E": ["B", "D", false], "I": {"A": false}}, "G": {"G": [false], "H": [false]}, "J": {"C": "I", "J": 9}}, "J": "J"}, null, null], "I": {"B": [0, {"C": 9, "D": "H", "F": 8}], "G": {"C": null, "D": {"F": true}}, "J": 6}}}]], "H": 9, "J": {"A": {"F": 2, "J": false}, "J": null}}, null], "I": true}, 7], {"F": {"A": 5, "J": true}, "I": {"F": null, "J": [{"F": false, "I": false}, [{"J": {"G": {"F": 2, "H": {"A": ["H"], "E": {"D": {"A": [[{"D": {"B": {"I": {"B": null, "D": true, "G": false}}, "H": [null, "C"], "J": false}}, "F", {"A": "I", "C": {"F": {"D": null}}}], [[5, {"D": 9, "H": false}], {"A": null, "I": {"B": {"A": true, "B": {"B": {"A": [{"E": {"F": {"B": ["I"], "E": "G"}, "G": {"A": {"B": {"B": 1}, "J": null}, "F": {"C": {"A": {"D": null, "J": "B"}, "I": "E", "J": 8}, "H": {"D": null, "E": {"D": {"C": {"I": "E"}, "I": {"A": null, "D": {"D": "E", "F": [{"C": {"F": true, "J": ["H", {"D": "H", "E": true, "J": {"C": null, "G": [{"H": null}, false]}}, "A"]}, "D": {"B": false, "D": [8, {"E": {"B": {"C": {"B": {"D": {"I": {"E": {"C": [{"A": null, "C": null, "H": {"A": {"E": false}, "J": {"A": {"D": {"E": null}, "H": [{"D": false}, false], "J": "C"}, "C": [false, false, {"G": {"G": false, "I": "I"}, "H": {"B": false, "E": 9}}], "F": false}}}], "D": false}, "G": [false, 3, {"A": {"D": [{"J": null}, {"D": [{"G": {"H": null}, "I": null}, 0, false]}, {"D": {"F": {"B": "E"}}}], "H": {"F": true}}, "D": {"A": {"D": {"A": 0, "E": "J", "H": {"C": null, "F": 8, "G": {"F": {"H": {"D": {"E": {"H": false}, "F": {"A": true, "F": true}}, "F": {"G": {"A": true, "B": {"C": {"B": 8, "H": 5, "I": {"B": 9, "D": [[6]]}}}}, "H": {"C": "I"}}, "H": {"B": {"H": ["A", {"A": [{"B": {"I": {"B": [{"D": {"B": {"C": {"F": {"A": "E", "F": [{"B": false, "C": {"B": {"B": {"J": "C"}, "J": {"A": [{"C": 5, "F": false}, true], "D": "I", "J": false}}, "D": false}, "H": [{"D": {"H": {"E": ["B"], "G": {"A": {"G": {"F": {"I": false}, "H": "I"}, "I": {"H": [{"I": {"B": null, "E": {"A": {"F": "F", "I": false}}}, "J": {"A": [{"E": [3], "H": {"C": {"D": {"E": "F"}, "J": null}, "J": {"C": {"B": [{"D": {"C": null, "E": null, "F": null}, "G": {"D": 2, "F": false}}], "D": "B", "G": true}, "D": false, "G": "I"}}}, false], "F": true}}, {"D": false}, {"G": {"D": {"A": null, "E": {"C": {"C": {"G": {"C": 4, "F": {"G": {"A": {"G": true}, "E": 7, "I": {"H": null}}, "J": null}}, "J": [[{"H": {"A": null, "I": [{"I": true}]}}, null]]}, "F": {"H": 2, "I": {"I": null}}, "I": null}, "G": false}, "G": {"F": true, "I": {"E": [{"D": {"B": [false, {"C": false, "D": "A", "F": {"E": true}}, {"D": [{"E": {"E": true, "G": false, "J": {"D": [{"B": null, "C": 1, "G": {"F": "A", "H": null, "I": "C"}}]}}, "H": "C"}, 4], "H": {"I": {"H": {"I": null}, "I": false}}, "J": true}], "E": "G"}, "E": {"H": false}, "F": false}, 7], "F": false}}}}}], "I": {"I": [{"B": {"C": true, "D": [true], "H": 7}, "D": {"A": "A", "E": {"D": [{"I": ["D", 1]}, true], "I": false}}, "F": {"E": [true]}}]}, "J": "I"}}, "D": {"A": "A", "C": ["I", {"A": 1}, {"A": {"E": {"G": [true, {"D": null, "H": {"C": 6, "E": 8}}, 8]}, "F": {"G": "D"}}, "I": true, "J": true}], "H": null}}}, "I": null}, "I": null}, false]}, true, [[null, {"C": false, "J": {"J": "J"}}, {"A": "I"}], {"I": false}, 8]]}}, "D": {"B": {"D": null}}}, "D": "H", "J": {"D": true, "F": 2}}, "H": true}, false, true], "I": null, "J": {"I": {"H": "E"}}}}}]}, "E"], "J": true}, "D": true}}}, "H": {"H": true}, "I": {"B": {"B": 6, "D": {"J": {"B": [{"B": false, "F": {"A": {"D": [[{"F": [{"D": null, "I": 5}]}]]}, "E": true, "J": 1}}, 8], "F": 5, "I": {"J": [null, null, true]}}}, "J": {"E": 1, "G": {"A": {"H": {"H": true}}}, "J": {"E": null, "G": false, "I": 0}}}}}}}}, "F": true}}]}}}}, "E": null, "F": false}, "E": null}, "H": {"H": true, "I": [false, [{"F": [[{"D": {"A": 5, "C": null, "E": {"A": true, "C": 5, "J": 1}}}, null], {"C": {"B": true}, "D": {"B": {"G": [{"G": null, "I": "H"}], "I": {"D": false, "E": 7, "J": {"J": {"F": "I", "G": {"C": {"E": true, "H": {"F": "A", "H": {"B": "I"}}, "J": {"B": false}}, "I": {"H": {"F": {"B": true, "J": false}}}}}}}}, "G": false}, "H": {"C": [{"H": 9, "J": {"B": true, "C": 8}}, false, {"H": {"D": {"B": {"H": null, "J": "B"}}, "I": {"C": {"C": 1}, "F": "I", "I": 8}}}], "H": {"E": {"D": [{"A": null, "F": {"B": {"E": {"B": {"F": false}, "G": {"G": [{"F": ["A", [{"C": {"J": [{"B": true, "H": 1, "I": true}]}, "G": null, "I": [{"A": [6, {"G": {"H": {"J": {"B": 6, "I": 5, "J": false}}}, "H": false}, [true]]}]}]], "I": null}, {"E": 9, "G": "G", "I": true}]}}, "H": false}}}, {"A": [{"B": [null, null]}, {"D": true, "H": {"H": 6}}, {"C": null, "E": "B"}], "E": true}, "A"], "G": {"I": {"G": {"E": {"A": false, "D": true}, "H": null}}}, "J": 4}}}}]}, true], {"C": [{"C": true}, [true, 0]], "G": {"A": {"D": null}, "B": null, "J": [true]}, "J": 8}]}}, {"A": {"D": null, "I": {"B": {"C": null}}}, "C": null, "J": {"C": [{"F": false, "G": {"D": null, "J": {"F": {"A": null, "E": {"G": {"E": {"A": true, "I": true}}}, "F": "J"}, "G": {"D": {"C": [{"A": "J", "J": null}], "I": "A"}, "H": {"D": 1, "F": [{"F": {"C": 0, "F": false}, "G": {"F": 4}, "I": {"J": {"C": {"A": "G", "I": 5}, "E": 4, "H": {"J": {"F": true, "H": {"B": {"A": {"B": {"B": false}}}}}}}}}, {"I": {"A": {"D": {"G": {"H": "E", "I": {"E": "D"}}}}, "B": true, "G": {"C": {"F": {"B": ["I"], "F": {"I": [{"J": {"A": {"G": 5}, "H": null}}, [{"G": false}], null], "J": {"A": 0, "C": "B", "H": {"B": 3}}}, "J": "D"}}, "D": 0, "E": false}}}], "H": {"H": {"D": {"E": "D"}, "J": [false, "A", null]}}}, "J": "E"}}}, "H": {"C": {"A": {"F": false}, "C": null}, "F": {"F": {"B": false, "C": null, "J": 2}}}}, {"D": {"A": {"A": false, "B": 8, "J": {"B": {"B": {"A": {"A": {"I": null}, "E": null, "H": null}, "G": {"E": "F", "G": [{"F": null, "J": 2}, false, false], "H": {"A": null, "J": "A"}}}, "I": 1, "J": {"B": {"G": {"I": "I"}}, "G": 3}}}}, "D": {"D": true}}}, {"D": {"A": 0}, "H": true}], "D": {"I": {"G": 6}}}}], "F": true}}]}}}}}}, "H": "J"}, "J": [{"B": {"D": {"D": null, "I": {"H": "I"}}, "E": "G", "F": 7}}, "C"]}, "F": {"F": {"J": {"A": 1}}, "H": true}}], "B": "H"}, "E": {"J": {"F": 0, "G": false, "J": null}}, "G": true}, "G": {"B": {"B": {"C": {"G": null}, "D": "H"}}, "H": 4}}, "C": {"A": {"A": false, "B": {"A": {"I": {"A": {"H": true}, "G": null}}, "H": true, "J": {"C": {"E": [null], "G": null, "I": false}, "J": 3}}, "F": null}, "B": {"B": {"B": true, "G": 3, "H": false}, "F": 1, "H": {"D": 0, "E": [5, {"G": {"B": {"B": true}, "C": {"I": {"D": [{"A": {"E": true, "H": 0, "J": [{"C": {"A": 2, "E": [4], "J": {"F": "C"}}, "H": null}, {"C": 3, "E": {"C": false, "H": true}, "H": true}, {"F": {"A": {"G": 1, "I": 2, "J": true}, "E": {"A": false, "I": false}, "H": "F"}, "G": true}]}, "B": {"B": {"D": {"B": false}, "E": {"A": "E", "H": [{"A": {"C": false, "J": [{"C": [{"C": "F"}, null], "I": {"F": {"D": [null, {"A": [{"B": "A", "H": {"B": null, "H": {"C": {"B": false, "H": {"G": {"B": {"G": {"D": null, "I": {"F": "H", "J": true}}, "H": {"G": 5}}, "C": {"I": {"C": ["E"], "J": {"C": "I"}}}}, "H": {"B": {"A": 6, "C": true, "G": null}, "G": true}, "J": [false, null, null]}, "I": {"B": 3}}, "G": {"B": {"I": {"I": {"D": {"J": "C"}, "G": false}}}}}, "J": false}}, {"B": false}, "A"]}, 1]}}}]}, "I": [null, null, 1]}, true], "I": [{"F": "D", "I": 1}, false, true]}, "G": "A"}, "D": {"C": 2, "E": {"A": false, "F": {"C": null, "D": null, "H": {"J": {"I": true}}}}}, "J": {"A": true, "G": [null, "E"]}}, "G": {"A": false, "F": {"A": {"A": {"C": false, "J": {"E": {"D": {"H": false}, "E": null, "I": [false]}}}, "H": {"B": [{"H": true, "I": "H"}], "D": {"A": 9, "I": {"I": {"F": {"D": true, "G": null}, "J": {"E": {"A": {"B": true}, "I": null}}}}}, "F": null}}}, "J": true}}], "G": "I"}}}}, {"A": null}]}}, "D": true}, "F": {"B": true, "J": true}}}, {"C": null, "G": {"A": {"C": {"C": false}, "F": {"D": null}}}, "H": "D"}], "E"], "H": {"C": "J", "F": {"C": null, "E": "D"}, "G": {"D": true, "H": {"F": true}}}, "I": {"D": true, "F": {"I": true}}}}}}}}, {"B": 0, "F": {"B": null, "D": {"B": {"B": [true, [{"D": [true, {"A": true, "I": {"B": [{"B": {"B": 1}, "H": null, "J": null}, {"G": true, "H": null}], "C": true, "G": {"C": null, "D": "J"}}}], "I": false}, {"D": {"D": "G", "I": {"D": 0}}}], null], "J": 2}, "E": null}, "F": "A"}, "G": {"H": {"A": {"B": "F", "C": null, "H": true}, "E": {"F": {"I": null, "J": "F"}}, "H": {"G": {"C": [{"A": 0, "G": "H"}], "E": {"D": {"A": true, "C": {"C": true, "F": true}, "F": {"B": 1, "E": {"B": 6}, "J": 4}}}, "G": {"C": {"E": {"B": {"C": {"A": {"B": null, "C": false, "J": "A"}, "F": 4, "G": "C"}, "G": {"C": 2, "E": [{"D": {"B": false, "C": null}}, null, false], "G": "H"}}, "C": "H", "D": 5}}, "H": {"H": true, "I": "J", "J": {"F": {"H": true, "J": "H"}, "G": {"B": {"C": null}, "C": {"D": true, "I": true}}}}}}}}}}, false], 4]}}], "F": {"F": {"B": {"C": {"D": {"I": true, "J": "C"}, "G": "E"}, "D": null}, "E": {"E": null, "F": false}, "J": {"C": [{"G": {"I": {"D": {"B": {"F": {"B": 6, "C": {"E": [["D"]]}}, "H": {"D": false, "F": {"B": 2, "E": null, "G": true}, "I": 8}}, "F": "E", "J": true}, "J": false}, "J": {"H": false}}}, "H", "F"], "J": "F"}}, "G": false}}}':::JSONB::JSONB
        test_1        |                             AS col116588
        test_1        |                 )
        test_1        |                     AS tab133796
        test_1        |             ORDER BY
        test_1        |                 col116588 DESC NULLS FIRST
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (999.91s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 10 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 0b0851f59e6c37706c5df624fa3a579faa46d736:

        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare837894306/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   [16]uint8{
        test_1        |             -       0x96, 0x0f, 0x94, 0x58, 0x3c, 0x88, 0x55, 0x50, 0x97, 0xd3, 0x5a, 0xf7, 0xf1,
        test_1        |             -       0x66, 0x9a, 0x41,
        test_1        |             -   },
        test_1        |             +   [16]uint8{
        test_1        |             +       0x7a, 0x41, 0x11, 0xe1, 0x14, 0x41, 0x54, 0x7f, 0xac, 0x57, 0x34, 0x44, 0xd7,
        test_1        |             +       0xa6, 0x4e, 0xc2,
        test_1        |             +   },
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         uuid_generate_v5('00000000-0000-0000-0000-000000000007':::UUID::UUID::UUID, (sqrt(9:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || 'E':::STRING::STRING::STRING)::STRING::STRING)::UUID
        test_1        |                             AS "col""505264"
        test_1        |                 )
        test_1        |                     AS 😠tab276143
        test_1        |             ORDER BY
        test_1        |                 "col""505264" ASC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         uuid_generate_v5('00000000-0000-0000-0000-000000000007'::UUID::UUID::UUID, (sqrt(9::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || 'E'::TEXT::TEXT::TEXT)::TEXT::TEXT)::UUID
        test_1        |                             AS "col""505264"
        test_1        |                 )
        test_1        |                     AS 😠tab276143
        test_1        |             ORDER BY
        test_1        |                 "col""505264" ASC;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1031.37s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 10 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 0b0851f59e6c37706c5df624fa3a579faa46d736:

        test_1        |             +               Int:              s"70680694041998114",
        test_1        |             -               Exp:              -18,
        test_1        |             +               Exp:              -15,
        test_1        |                             Status:           2,
        test_1        |                             NaN:              false,
        test_1        |                             InfinityModifier: s"none",
        test_1        |                         },
        test_1        |                     },
        test_1        |                     Dimensions: {{Length: 1, LowerBound: 1}},
        test_1        |                     Status:     2,
        test_1        |                 },
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ((5:::INT8::INT8::INT8 ^ sqrt(7:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[]
        test_1        |                             AS co̔l͌355494
        test_1        |                 )
        test_1        |                     AS tab217050
        test_1        |             ORDER BY
        test_1        |                 co̔l͌355494 ASC NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ((5::INT8::INT8::INT8 ^ sqrt(7::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[]
        test_1        |                             AS co̔l͌355494
        test_1        |                 )
        test_1        |                     AS tab217050
        test_1        |             ORDER BY
        test_1        |                 co̔l͌355494 ASC NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (922.98s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 10 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 0b0851f59e6c37706c5df624fa3a579faa46d736:

        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare4208938535/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |                 string("001000000000000000000000000000000000000000"),
        test_1        |             -   string("010300000000000000"),
        test_1        |             +   string("010300000001000000050000000000000000001440000000000000224000000000000014400000000000001C4000000000000020400000000000001C400000000000002040000000000000224000000000000014400000000000002240"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         B'0010'::BIT(42) AS col9801,
        test_1        |                         st_makeenvelope(5.0:::FLOAT8::FLOAT8::FLOAT8, 9.0:::FLOAT8::FLOAT8::FLOAT8, 8.0:::FLOAT8::FLOAT8::FLOAT8, 7.0:::FLOAT8::FLOAT8::FLOAT8)::GEOMETRY
        test_1        |                             AS col9802
        test_1        |                 )
        test_1        |                     AS t̽ab5549
        test_1        |             ORDER BY
        test_1        |                 col9801 DESC NULLS FIRST, col9802 NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         B'0010'::BIT(42) AS col9801,
        test_1        |                         st_makeenvelope(5.0::FLOAT8::FLOAT8::FLOAT8, 9.0::FLOAT8::FLOAT8::FLOAT8, 8.0::FLOAT8::FLOAT8::FLOAT8, 7.0::FLOAT8::FLOAT8::FLOAT8)::GEOMETRY
        test_1        |                             AS col9802
        test_1        |                 )
        test_1        |                     AS t̽ab5549
        test_1        |             ORDER BY
        test_1        |                 col9801 DESC NULLS FIRST, col9802 NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (637.64s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 10 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 0b0851f59e6c37706c5df624fa3a579faa46d736:

        postgres_1    |     ORDER BY
        postgres_1    |         CAST(col579662 AS TEXT) NULLS LAST, col579663 DESC
        postgres_1    | 2023-12-28 06:30:37.896 UTC [78] ERROR:  could not identify an ordering operator for type void at character 70
        postgres_1    | 2023-12-28 06:30:37.896 UTC [78] HINT:  Use an explicit ordering operator or modify the query.
        postgres_1    | 2023-12-28 06:30:37.896 UTC [78] STATEMENT:  SELECT * FROM (SELECT NULL::VOID AS col579690) AS tab333936 ORDER BY col579690 DESC NULLS FIRST
        postgres_1    | 2023-12-28 06:30:37.908 UTC [78] ERROR:  could not identify an ordering operator for type void at character 74
        postgres_1    | 2023-12-28 06:30:37.908 UTC [78] HINT:  Use an explicit ordering operator or modify the query.
        postgres_1    | 2023-12-28 06:30:37.908 UTC [78] STATEMENT:  SELECT * FROM (SELECT NULL::VOID AS col579696) AS "ta""b333944" ORDER BY col579696 ASC NULLS FIRST
        test_1        | --- FAIL: TestCompare (1185.55s)
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (580.07s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare4119859870/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   int16(2),
        test_1        |             +   int16(3),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT int2(acosh(9.0:::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::INT2 AS 😗col579822) AS tab334009
        test_1        |             ORDER BY
        test_1        |                 😗col579822 DESC NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT int2(acosh(9.0::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::INT2 AS 😗col579822) AS tab334009
        test_1        |             ORDER BY
        test_1        |                 😗col579822 DESC NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1211.47s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 10 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 8496f8fa0f076f739862b6e9ceace125a8eb2d93:

        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/mutators (0.01s)
        test_1        |         compare_test.go:141: starting test: mutators
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 145 [running]:
        test_1        | testing.tRunner.func1.2({0x225d9e0, 0xc00137db80})
        test_1        |     GOROOT/src/testing/testing.go:1545 +0x238
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1548 +0x397
        test_1        | panic({0x225d9e0?, 0xc00137db80?})
        test_1        |     GOROOT/src/runtime/panic.go:914 +0x21f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x46ab740?, {0x31ec738?, 0xc000e75470?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:377 +0x436
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x31ab100?, 0x46ab740)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:310 +0x12c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc000de8000)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:227 +0x7f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc000c76060, {0xc000c42480?, 0x4, 0xc000c76060?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:260 +0x89d
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0x205dee0?, 0x245f541?, {0xc000c42480?, 0x49ddf68?, 0x2?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:98 +0x28
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc000a82830?, {0x245f541, 0x5}, 0x4, 0xe0?, {0xc000983a40, 0x3, 0x7f477d97d5b8?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x131
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0xc000091cc8?, 0x1?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:118 +0x15e
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc000038a00?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:98 +0x2f
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.init.wrapCommonSetup.func28(0x2644ba8?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x1b
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc0006f6d00)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:143 +0xe2
        test_1        | testing.tRunner(0xc0006f6d00, 0xc000841fb0)
        test_1        |     GOROOT/src/testing/testing.go:1595 +0xff
        test_1        | created by testing.(*T).Run in goroutine 11
        test_1        |     GOROOT/src/testing/testing.go:1648 +0x3ad
        compare_test_1 exited with code 2
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 2
--- FAIL: TestComposeCompare (19.60s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 10 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 8496f8fa0f076f739862b6e9ceace125a8eb2d93:

        postgres_1    | 2024-01-02 06:22:34.135 UTC [78] ERROR:  could not identify an ordering operator for type void at character 258
        postgres_1    | 2024-01-02 06:22:34.135 UTC [78] HINT:  Use an explicit ordering operator or modify the query.
        postgres_1    | 2024-01-02 06:22:34.135 UTC [78] STATEMENT:  SELECT
        postgres_1    |         *
        postgres_1    |     FROM
        postgres_1    |         (
        postgres_1    |             SELECT
        postgres_1    |                 tab83507."\\U0009F141col2_5" AS c̻ol162701, NULL::VOID AS col162702, 'C'::TEXT::TEXT AS col162703
        postgres_1    |             FROM
        postgres_1    |                 postgres.public.table2 AS tab83507
        postgres_1    |             WHERE
        postgres_1    |                 tab83507.c̀ol2_3
        postgres_1    |         )
        postgres_1    |             AS "t͍a b'83508"
        postgres_1    |     ORDER BY
        postgres_1    |         c̻ol162701 NULLS FIRST, col162702 NULLS FIRST, col162703 ASC NULLS LAST
        test_1        | --- FAIL: TestCompare (897.87s)
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     --- FAIL: TestCompare/postgres (293.22s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '{"E": 8, "F": [{"F": 2, "I": [false, 1, {"E": [false, {"A": {"C": [{"D": null, "E": [false], "H": "H"}], "E": null, "J": [true, {"C": [{"A": {"D": {"D": [{"F": {"A": {"C": null, "I": null, "J": {"G": {"A": {"E": 8, "G": {"A": {"G": {"H": null}, "J": true}, "B": "D"}}, "F": [8, true]}, "I": {"A": null, "I": {"B": {"B": 7}, "C": 1, "G": null}}, "J": true}}, "B": {"A": 4, "H": 7, "J": [8]}, "I": {"C": "D", "G": false}}}, 7]}}, "F": {"C": false, "E": {"C": false, "J": false}, "J": "D"}}, {"J": 8}, {"G": {"C": {"D": "G", "H": true, "J": {"F": {"A": ["D", {"E": [[true, "A", [null, {"G": false, "J": true}, null]], {"B": false, "C": [1, [{"A": [false, {"F": [{"A": {"J": false}, "I": null}, "F"], "J": false}], "B": {"A": false, "I": true}, "F": {"A": null, "B": true, "I": {"C": false}}}]]}], "H": false}, false], "C": {"C": null, "E": {"I": {"B": {"C": {"A": {"J": [8]}, "C": true, "E": {"I": null, "J": 0}}, "J": {"J": "F"}}, "D": false}}}, "H": {"B": 8, "C": null}}}}}, "H": {"D": false, "E": {"C": {"C": false, "E": {"A": null, "J": {"B": true, "F": {"A": {"H": true, "I": false}, "C": null}}}, "J": true}, "F": "D", "G": "D"}}, "I": 1}], "J": {"B": {"A": {"C": "A", "H": false}}, "E": false}}, true]}, "C": false}, "J"], "G": true, "I": true}], "J": {"B": {"G": [{"C": {"F": "E"}, "F": 2}]}}}, {"C": {"D": null, "G": {"C": "A", "G": {"F": {"E": {"C": {"J": 2}}, "F": null}}, "J": "D"}}}, 3], "J": [{"B": {"F": {"F": {"D": "G"}}}}, ["D", ["B", {"D": {"F": {"B": {"D": false, "I": true}, "F": {"A": true, "D": [[{"F": null, "J": 5}, true, {"J": {"B": null, "C": [{"G": {"D": false, "E": 1}, "I": "E"}, [{"B": "F", "G": true, "I": [{"D": false}]}], [{"C": null, "H": false}, 6]], "H": {"E": null}}}]], "J": {"C": false, "I": {"C": true}}}, "G": 8}, "J": {"C": {"J": [2, {"J": {"H": {"B": {"F": null, "J": {"I": {"C": false}}}, "E": {"A": {"F": null, "I": 1}, "E": {"H": true, "I": "J"}}, "J": [true, ["G", true, {"D": false, "H": "A", "I": [false, 5]}]]}}}, 9]}}}}], {"E": [[true, [{"B": {"J": null}, "E": [{"A": {"B": null, "E": {"G": [[{"A": 6, "D": false, "H": 9}, {"D": {"D": {"B": {"F": null}, "D": {"J": null}, "G": {"F": [{"A": {"E": null, "G": 4, "J": false}, "F": {"G": 8, "H": {"G": null}}, "J": 3}], "H": {"A": 8, "D": {"D": "D"}, "G": true}}}, "I": true}, "F": true}], {"A": {"J": {"I": {"C": {"A": {"A": "I", "H": {"C": {"B": [{"C": {"E": [{"C": 4, "D": {"D": "H"}, "H": {"D": false, "G": 5, "H": false}}, {"F": {"H": {"A": true, "F": null}}}, null]}, "F": {"G": 9}, "H": [{"F": false, "H": null}, {"A": "E", "C": false}, {"D": {"A": {"F": {"F": null}, "I": true}, "I": false}, "F": {"C": "D", "H": "C"}}]}, {"G": null}, {"B": 9, "G": true, "H": {"A": {"E": true, "H": {"F": [{"D": {"C": {"E": {"B": {"A": 9, "E": {"D": null, "H": [null, "G", {"D": {"I": {"C": false, "I": {"A": {"D": [null, "B"], "G": {"D": {"C": [{"A": [{"E": {"J": [{"B": {"F": true, "J": {"B": {"D": {"D": "A", "F": {"C": {"G": {"C": {"A": {"C": true, "E": 0, "J": {"C": {"B": true, "C": {"I": {"H": ["H", "I"]}}, "F": {"B": {"C": "D", "G": null}, "E": {"E": {"B": {"G": null, "J": {"F": null, "G": 2}}, "D": {"A": {"C": {"A": {"A": null, "G": [0, true], "J": {"A": true, "C": ["E", true, {"E": false}]}}, "I": null}, "D": [false, false, [false, [{"C": "G", "F": null, "G": {"G": {"F": true}}}, "A", "D"], {"A": {"G": 6, "I": {"B": null}}, "E": null}]]}, "E": null, "G": ["I", false, {"F": "A"}]}}}}}}}, "C": [[true, {"B": 8}, {"I": {"G": 6, "H": {"A": {"I": false}}}}], "C", {"A": ["D", {"G": {"D": {"B": {"B": [null, {"H": {"A": true, "B": {"B": true, "E": null, "H": {"A": {"C": {"H": {"F": [{"I": {"I": false}}]}}, "J": true}}}}}], "E": false, "G": false}}}}], "D": [[{"D": null, "H": 3}], {"C": [false, {"A": {"F": false}, "I": {"E": {"C": {"E": {"D": {"G": {"E": [true], "G": false, "H": {"H": {"E": true}, "J": "A"}}}, "H": {"B": "G", "I": 7}}, "F": [{"H": {"A": null, "G": ["D", 9]}, "J": {"I": null}}, false, [{"D": {"C": null, "H": "F"}}]]}, "F": {"F": false, "H": {"C": "D", "D": {"F": 5, "I": 8}}}, "J": [0]}, "I": 7}}]}]}], "J": 6}, "E": false}, "H": null}, "D": true, "G": 9}}, "F": false, "H": true}, "F": {"E": {"E": null, "I": true, "J": {"H": {"F": true, "I": {"A": {"E": {"E": {"A": {"E": "F", "G": {"H": {"A": null, "F": [false, {"C": [{"F": {"D": {"E": {"B": "B", "I": true, "J": null}}, "F": null, "H": 8}}, {"G": null, "I": null, "J": "J"}, false], "I": {"A": "B", "H": 7}}, true]}}}, "C": 5}, "G": true, "I": [true, null, {"D": "G", "E": "E", "F": false}]}}, "J": false}}}}, "F": {"D": null, "F": 0, "J": true}, "J": [{"B": {"E": {"C": false}}, "J": 5}, {"B": {"A": 3, "G": false}, "E": 4}]}}}, "I": {"A": 4, "J": null}}]}}, {"I": {"D": {"C": {"E": {"A": {"B": {"I": 5, "J": {"F": {"B": null, "C": {"F": false, "J": [{"C": true}, {"F": {"D": false, "H": {"C": {"C": 2, "F": {"A": {"A": {"A": null}, "J": 7}, "J": {"D": {"F": true, "H": {"E": 8, "J": "D"}}}}, "H": {"D": true}}, "E": null, "I": true}}}, 7]}, "F": null}}}, "H": false}, "G": ["G", [true]], "J": {"C": {"A": null, "G": {"C": {"C": {"A": false}, "H": 2}, "E": {"A": [9, {"E": {"G": true}, "F": {"B": {"F": false, "J": {"C": true, "J": null}}, "F": true, "I": {"A": {"B": {"C": {"A": 5, "C": false}}}, "C": {"C": false, "J": "G"}}}, "H": {"B": {"A": {"A": "I", "H": 9}, "D": {"D": null, "H": {"D": 4, "I": "D"}, "J": {"C": {"E": {"D": {"G": null}, "E": {"A": null, "E": "G"}, "J": null}, "G": {"E": {"E": 9, "F": 7}, "I": {"H": false}}}, "F": {"A": [5, false], "F": {"D": null, "H": {"C": {"C": 6, "E": {"H": {"C": null, "G": {"C": {"A": 4, "G": {"J": {"A": true, "B": {"F": "A", "G": [null, false], "I": "B"}, "H": "D"}}, "I": [[{"D": {"G": false}, "G": 8, "I": false}]]}, "E": {"F": {"B": true, "C": {"E": [{"B": {"E": null, "I": {"A": {"A": true, "F": 0}, "E": [{"A": {"C": true, "G": ["B", "G"]}}, true, {"B": null, "G": "H"}]}}, "D": true, "F": null}], "J": [null, "F"]}, "G": {"I": {"B": {"E": "H", "F": true, "G": false}, "F": {"A": {"A": 0, "E": true, "H": [[0, {"D": {"B": 4}, "I": {"D": {"B": {"I": {"D": {"I": 6}, "H": 2, "I": 8}}, "J": 1}, "F": true}}, null]]}, "C": true, "G": {"J": {"E": {"B": 2, "I": 2}}}}}}}, "I": null}}}}, "G": {"D": true, "G": {"C": {"B": [[{"F": {"D": 5}}, {"D": false, "G": {"E": {"H": {"C": null}}, "J": "D"}}, {"B": {"B": null}, "E": "G", "H": {"J": true}}], {"J": true}, false], "F": {"C": {"C": {"D": {"D": [true, false], "G": "B"}}, "H": false}, "F": {"H": 3}}, "G": 1}, "F": 4, "H": 4}}}, "F": [null, [false, [null], {"B": false, "F": {"G": [[{"J": {"A": "J", "J": {"I": {"F": null}, "J": 1}}}, {"H": "G"}], {"A": "E", "B": [{"A": [false], "B": 2, "C": {"C": [null]}}, {"D": true}]}]}, "I": true}], {"C": false, "E": [{"E": {"E": {"C": {"A": 6, "F": null, "J": {"B": {"D": 1, "F": 2}, "I": 0}}, "E": {"J": null}}}, "F": {"I": false}}, "H", true], "I": [{"B": true, "I": null}, true, [null, [5, null, "F"], null]]}], "J": [{"C": null, "F": 8}, null]}, "I": 9}, "H": "D"}, "H": 5}}, "H": {"C": null, "E": {"F": "B"}, "I": null}}, "G": null}}], "G": [{"H": null}, {"A": true, "D": true, "E": {"E": "G", "H": false, "J": {"F": null, "G": false}}}, false]}, "G": null}}, "F": {"E": false}}}}}}}, {"D": {"D": null, "F": null}, "E": null, "J": true}], "G": {"C": {"A": true, "C": null}, "D": null, "G": [false]}, "H": {"B": {"A": {"B": false, "G": null}, "B": 1, "E": "D"}}}], "I": {"B": false}}, "H": {"G": true, "J": null}, "I": {"F": {"B": true, "G": [{"B": {"B": {"C": {"C": true, "H": {"J": 2}, "I": false}, "F": {"G": false}, "J": null}, "C": 2}, "F": false}], "H": {"B": null, "E": {"A": "E", "C": {"B": null, "G": "F"}, "I": false}}}}}}, "D": {"A": null, "D": 4}}, "J": true}, "J": "A"}, "E": null}]}, "G": {"J": true}}}, "I": "J"}, "D": {"I": [{"B": "B"}]}}}]}}}}], "C": "E"}}}}, "D": {"B": null, "C": true}, "I": "I"}, "J": "B"}}, "C": {"G": {"J": {"A": "F", "E": 9}}, "H": true, "J": 8}}], "H": "G"}}}, [true]], "G": {"C": false, "H": true}}, {"D": "E"}]], {"J": {"E": null, "J": [{"J": {"A": {"A": 3, "B": {"H": [{"E": "I", "G": [{"B": false, "G": {"I": {"A": "J", "D": true, "F": true}}}]}, 0], "J": {"E": {"G": null}, "H": [[{"B": [[{"B": {"D": [{"A": null, "H": {"C": {"C": "C", "G": {"F": {"H": 3}, "J": [{"I": {"F": [{"I": null}, {"C": null, "D": {"E": {"E": null, "H": 9}}}, true]}}]}}, "E": {"J": {"D": ["B"], "F": {"E": true}, "H": 5}}, "F": true}}, {"D": null, "G": true, "J": 4}, {"E": {"C": true, "F": false}, "F": "A", "G": {"I": "B"}}]}, "E": [{"B": {"A": [{"G": true, "H": {"B": false}, "I": 0}, null]}}, {"G": {"G": [{"G": {"E": [false, [{"C": null, "D": [0, "F"]}]], "G": 1}}, null, true], "H": false}}]}, null], null, {"C": {"A": {"F": {"B": [[null], {"B": {"I": [true, "A"]}, "C": {"G": false}, "D": true}, null], "G": false}}, "C": {"C": false, "H": {"B": {"H": null, "I": [true, false]}, "D": true, "J": {"C": "H", "F": "C"}}, "J": {"B": false}}, "E": {"E": false, "H": false, "J": 6}}}], "G": {"C": {"C": [null, {"G": 0}, 2], "F": {"D": "E"}, "J": [{"A": {"C": {"A": {"F": 1, "J": "E"}}, "D": {"E": {"B": "C"}, "J": true}, "G": "J"}}]}, "D": null, "G": {"B": {"G": {"F": false}}}}}], {"A": null, "E": [null, {"B": 0}, {"E": {"H": {"B": {"B": [0, false], "J": false}, "J": "C"}}, "F": {"E": null, "G": null, "J": 6}, "G": {"A": {"B": false, "C": {"J": {"A": {"B": {"G": {"E": [false, {"D": [[{"I": {"A": {"C": [{"E": [false], "G": {"A": {"C": {"A": null, "H": false}, "D": true}, "J": 6}, "H": null}, {"A": {"C": [true, ["I"]], "J": {"J": {"C": {"B": true, "C": true, "H": [9]}, "F": true, "H": {"C": {"E": null}, "G": false}}}}}, 9]}, "H": "E"}}, 8], 5, true], "I": true, "J": "E"}], "I": false}, "J": null}}, "G": [true, "D", null], "J": {"A": [false, {"F": {"B": null, "C": 2, "F": null}, "I": null, "J": "B"}, null]}}}}, "J": true}}]}]}}, "G": [[[{"F": {"B": {"G": true}, "D": "B", "I": {"C": {"B": {"B": "D", "C": {"A": 2, "D": {"B": [true]}, "J": null}, "G": null}, "I": {"D": {"C": null, "H": null}, "I": {"A": {"C": {"A": {"B": {"B": null, "J": {"E": {"F": {"A": {"A": null, "G": null}, "G": "J"}}}}}}, "D": {"F": null, "J": null}, "I": false}, "G": {"B": null, "E": 3, "J": true}, "H": {"G": true, "I": {"F": "G", "J": true}}}}}, "J": false}}}]], false, null]}, "E": {"B": 0, "G": false, "J": 0}}}]}}, [{"C": null, "E": {"H": {"C": {"F": null}}, "J": {"E": {"B": {"F": null, "H": {"C": [null, "C"], "H": "B"}}, "F": 3, "I": true}, "H": [3, false]}}, "G": [{"I": false, "J": {"A": 1, "D": true, "I": 7}}, {"H": false}]}, true]], "H": [false, {"D": [7, {"D": "I", "G": "J", "J": {"F": true, "H": null, "I": "B"}}], "G": [true]}, false], "I": null}]]}':::JSONB::JSONB
        test_1        |                             AS coĺ162747,
        test_1        |                         B'0101'::BIT(26) AS col162748,
        test_1        |                         NULL::RECORD AS "\\uFC39col%p😈162749"
        test_1        |                 )
        test_1        |                     AS tab83520
        test_1        |             ORDER BY
        test_1        |                 coĺ162747 DESC NULLS LAST, col162748 NULLS LAST, "\\uFC39col%p😈162749"
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (922.62s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 10 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 8496f8fa0f076f739862b6e9ceace125a8eb2d93:

        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.00s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 200 [running]:
        test_1        | testing.tRunner.func1.2({0x225d9e0, 0xc000c49400})
        test_1        |     GOROOT/src/testing/testing.go:1545 +0x238
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1548 +0x397
        test_1        | panic({0x225d9e0?, 0xc000c49400?})
        test_1        |     GOROOT/src/runtime/panic.go:914 +0x21f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x46ab740?, {0x31ec738?, 0xc000c588d0?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:377 +0x436
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x31ab100?, 0x46ab740)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:310 +0x12c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc000939e00)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:227 +0x7f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc000a66570, {0xc000a71720?, 0x5, 0xc000a66570?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:260 +0x89d
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0x205dee0?, 0x245f541?, {0xc000a71720?, 0x49ddf68?, 0x2?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:98 +0x28
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc00077bc50?, {0x245f541, 0x5}, 0x5, 0xe0?, {0xc000a55a40, 0x3, 0x7fea1ea44f18?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x131
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0xc0009c7cc8?, 0x1?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:118 +0x15e
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc000110a00?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:98 +0x2f
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.init.wrapCommonSetup.func28(0x2644ba8?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x1b
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000a2a820)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:143 +0xe2
        test_1        | testing.tRunner(0xc000a2a820, 0xc000a664e0)
        test_1        |     GOROOT/src/testing/testing.go:1595 +0xff
        test_1        | created by testing.(*T).Run in goroutine 9
        test_1        |     GOROOT/src/testing/testing.go:1648 +0x3ad
        compare_test_1 exited with code 2
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 2
--- FAIL: TestComposeCompare (19.45s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 10 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 1159a0f9816f3b4768e4988ad83f8d9eff9a3183:

        postgres_1    | 2024-01-07 06:25:08.828 UTC [78] HINT:  Use an explicit ordering operator or modify the query.
        postgres_1    | 2024-01-07 06:25:08.828 UTC [78] STATEMENT:  SELECT
        postgres_1    |         *
        postgres_1    |     FROM
        postgres_1    |         (
        postgres_1    |             SELECT
        postgres_1    |                 NULL::rand_typ_2 AS col317097,
        postgres_1    |                 tab191011.col5_2 AS col̻317098,
        postgres_1    |                 tab191011."co l5_0" AS "c|ol317099",
        postgres_1    |                 NULL::BOX2D AS col317100
        postgres_1    |             FROM
        postgres_1    |                 postgres.public.table5 AS tab191011
        postgres_1    |             WHERE
        postgres_1    |                 'A'::TEXT::TEXT ~* tab191011.col5_2
        postgres_1    |         )
        postgres_1    |             AS "Tab191012"
        postgres_1    |     ORDER BY
        postgres_1    |         col317097 DESC NULLS FIRST, col̻317098 NULLS LAST, "c|ol317099" ASC, col317100 ASC
        test_1        | --- FAIL: TestCompare (1489.25s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (883.20s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '{"D": "C", "G": {"A": {"G": {"H": false}, "H": false}, "B": [{"E": {"D": {"G": [{"A": {"D": "I", "H": {"F": false}}, "D": {"A": false, "J": true}}, ["F", {"D": null, "H": {"B": null, "E": {"B": {"J": true}, "H": false}, "G": {"E": 4}}}, "C"]], "H": {"E": {"H": {"I": false}}, "F": {"D": false, "I": {"A": true, "F": [true, {"E": {"D": false}, "H": {"B": null, "H": "F"}}, {"B": {"J": true}, "G": null, "H": true}], "H": {"B": {"G": true}, "E": "E", "F": [null]}}}, "I": {"I": [{"A": {"B": {"G": null, "J": {"E": 0, "J": 4}}, "D": "G", "G": {"J": false}}, "E": true}, true], "J": {"D": true, "J": [true, false, {"E": {"C": null}, "F": {"E": {"E": {"A": true}, "G": true}, "F": {"D": {"E": ["B", {"A": {"H": true}}, "I"]}}}, "J": {"B": "C", "D": true, "F": "A"}}]}}}}, "F": {"J": {"B": {"E": ["H", true, true], "H": {"H": 2}}, "C": {"B": {"B": {"C": {"E": null}, "F": {"A": "B", "H": true}, "H": {"B": {"C": {"G": "J"}, "H": {"C": false, "E": true, "H": {"A": "C", "B": {"F": {"E": "H", "G": {"G": {"B": {"C": {"A": {"A": true}, "B": false, "I": {"C": {"B": null, "E": true}, "E": null, "H": {"E": false, "I": {"C": null, "G": false}}}}, "I": 9, "J": {"C": {"H": 7}}}, "H": {"F": {"G": [0]}}, "J": {"E": "I", "I": {"F": {"A": {"D": "E", "H": {"C": 0, "D": "F", "E": "E"}}, "E": "J"}, "G": "D"}}}, "H": {"E": {"B": {"I": "B"}}, "F": {"C": null}, "H": {"A": null, "I": "J"}}, "I": {"C": {"I": "I"}, "D": [true, {"C": {"C": {"A": {"A": true, "H": {"A": [{"B": {"E": {"E": {"D": {"H": "F", "I": false}, "E": true}}, "F": null, "H": false}, "F": true, "I": {"E": {"G": {"C": {"E": {"A": false, "B": {"D": null}, "H": "E"}, "F": {"J": [[{"F": {"E": {"A": [false, 5, null], "B": [{"I": {"A": {"E": "E"}, "E": {"E": {"A": 3, "J": {"D": {"B": {"A": {"G": {"G": "A"}, "J": null}}, "D": "D", "F": {"A": {"D": false, "E": {"C": {"C": null, "D": {"G": "C"}, "H": null}, "F": [{"D": [6, true, [{"B": 3, "F": [6, 6, [null, [9, {"G": false, "H": 7, "J": "E"}]]]}, {"C": {"I": false}, "F": [true, "D"]}, {"A": {"F": null, "I": true}, "F": [{"B": {"C": "J", "J": {"D": {"H": {"I": {"I": false, "J": "D"}}}, "H": "D", "J": [{"C": {"B": {"C": true, "F": [{"F": 9}]}, "J": {"E": {"D": true, "F": null}, "F": {"A": {"B": {"F": {"B": false, "D": null}, "G": {"A": {"H": {"A": {"A": {"D": {"D": {"C": {"A": false, "F": 8}, "E": {"A": {"C": {"A": {"E": {"A": 2, "C": {"C": "D", "J": false}, "D": {"A": null, "D": true}}}, "F": [{"A": true, "J": {"C": 8, "F": true}}, {"A": {"A": null, "I": {"I": {"F": true, "H": {"D": false}}}, "J": {"J": {"A": false}}}, "I": {"D": true, "E": 6}}, true], "I": false}, "E": {"J": null}}, "D": 9}, "G": 1}}, "J": {"B": false, "H": {"J": true}, "I": null}}, "C": 3, "J": {"A": {"C": 4, "D": 3}, "G": {"B": null, "D": "A"}, "H": 7}}, "D": [7, {"J": true}], "J": {"A": true, "G": "J"}}}, "F": "C"}, "I": true}, "H": null}, "C": {"B": false, "E": {"H": null, "I": [[{"A": {"C": {"C": "C", "G": {"G": {"C": {"F": {"F": {"E": [null, {"E": [{"A": "E", "H": null}], "F": {"D": {"C": {"B": {"E": {"A": false, "C": null, "D": {"D": false, "H": {"F": true, "J": [[{"H": true}, false], {"F": 7, "H": {"A": {"J": [{"F": true}, false, [{"F": false}, null, {"B": [0, {"G": [null, {"C": {"G": {"A": null, "E": {"A": false, "G": {"C": {"E": {"C": {"A": null}}, "J": "C"}, "H": true}}}}, "J": {"A": ["B"], "E": null}}], "J": {"B": {"F": {"C": null, "G": {"B": null, "C": true}, "H": {"D": true, "F": ["E", {"E": true}, {"E": "I", "I": true}], "H": [{"E": [{"A": {"H": {"A": null}}, "H": null}, 8, true]}, 7, [[false, null, "F"]]]}}}, "J": true}}, {"F": {"J": {"J": {"B": null, "E": "G", "G": {"A": "C", "E": {"B": {"J": "A"}}}}}}, "J": {"A": null, "F": false}}], "G": [[{"A": null, "F": {"F": [{"D": true}, false], "I": {"A": true, "G": [{"A": true}, true, {"C": {"E": true, "I": {"H": {"H": false}}}}]}, "J": {"H": "D"}}}, true, 9], true], "I": false}]]}, "C": "G"}}]}}}}, "E": "C"}, "J": [{"D": true}, {"D": {"A": "C", "D": {"A": {"D": {"D": "C"}, "E": true}, "D": {"J": {"F": {"C": {"I": [true, false, [{"D": {"H": true, "I": null}, "E": {"E": 2}}]]}, "I": "A"}}}, "J": {"H": "D"}}}}, {"E": true, "G": {"A": "H"}}]}, "E": [true], "J": {"E": [{"F": {"A": 2}, "G": {"A": {"E": [{"F": null, "H": null, "J": "A"}, {"E": false, "G": null}]}}, "I": {"C": true, "D": false, "H": 9}}]}}}], "F": 1, "H": null}, "H": false}}, "G": null}, "H": false, "I": 9}, "I": true}}, "F": {"J": null}, "G": [null]}], {"G": null}, {"A": false, "H": {"H": {"A": null, "G": {"A": {"F": 5, "H": {"B": true, "D": {"F": "I", "G": {"D": {"E": {"B": {"H": [1]}, "F": "C", "J": {"G": true, "I": "I"}}, "I": true}, "E": {"B": 9}, "G": {"E": [true, {"F": true}, null]}}, "I": {"C": {"C": null, "D": [{"I": 8}], "H": null}}}, "I": [{"I": null}]}}, "E": true, "J": null}}, "I": null}}], "J": null}, "I": null}}, "H": {"B": [{"B": [true], "F": 5}], "G": {"D": {"G": {"C": 5}, "J": true}, "E": null}}}}}, {"C": null, "G": 2}, [{"A": 1, "D": {"D": false}}, [false, {"C": 1, "J": {"D": true}}]]]}}}, [false, false], [true, {"A": null}, true]]}]]}, null]}}, "F": {"F": 0, "G": {"A": {"B": true, "C": {"C": {"F": null}, "G": {"D": {"J": 9}}, "H": {"B": false, "D": true, "I": {"B": {"D": "J", "H": {"E": [{"C": false}]}, "I": true}}}}, "J": {"C": {"E": {"F": 5, "J": {"A": true, "C": 6}}, "F": null, "G": {"I": {"C": "I"}}}}}, "J": {"A": null}}}, "G": {"D": {"C": true, "E": {"D": true, "I": {"A": false, "I": 5, "J": [{"H": 6}]}}}}}}}}, "J": [{"F": "J"}, "G"]}, "F": {"E": null}}}], "E": true}, "G": {"A": false, "G": "G", "J": {"B": {"A": [{"F": {"D": {"F": {"C": {"B": true}}}}, "G": true}, {"F": "E"}], "C": "I"}, "J": {"H": [{"A": 6, "C": {"J": true}, "D": false}, {"J": {"A": null, "I": {"F": {"A": [{"E": "C"}, [{"A": true, "C": ["D"], "D": true}], {"E": false, "G": ["F", true, true], "I": {"I": false}}], "B": true}, "I": {"I": {"B": false}}}}}, [4, {"F": 5, "J": true}, ["F", {"A": false, "I": 3}, {"C": [{"B": {"A": {"C": 7, "E": "J"}, "C": [[5, "H"], 8, true]}, "C": [[3, true, [0, [{"B": {"D": "D", "F": ["E", {"J": true}]}, "I": {"D": {"B": [null], "F": true}, "E": true}}, 1], null]]]}], "E": 6}]]]}}}}}, {"H": "D"}], false]}}, "H": {"H": {"G": true}, "I": {"A": "J", "I": true}}}}}}]}, "I": "A"}, "B": "F", "C": {"G": {"F": true, "G": null, "H": "A"}}}, "D": {"C": null, "H": {"G": 9, "H": {"A": true, "C": true, "D": [true, false]}}}}}, "J"]}}, "H": "J"}}}}, "J": false}, "D": {"C": [{"A": {"D": {"C": {"B": true, "D": [{"C": {"F": false, "G": true}}, {"I": true}, [{"I": null}, {"B": "J", "G": ["A", [{"B": {"G": 1, "I": {"A": {"E": false, "H": {"C": {"B": {"B": {"A": 0, "H": "J"}, "G": {"E": [false, true, 7]}, "I": {"D": 0, "I": 4}}, "E": {"D": {"F": [null], "J": {"B": "H", "C": {"F": 2, "J": true}, "H": null}}, "H": {"A": {"I": {"J": {"F": [{"B": {"G": 4, "I": {"D": [null, false, "F"]}}, "I": [{"E": "J", "H": 8}]}, "G", [false, [true]]], "G": {"A": {"G": null, "I": {"D": {"C": true, "E": {"I": 7}}, "E": {"E": false, "H": {"C": "A"}, "I": "J"}}}, "E": "E"}}}}}, "J": [{"B": null}]}, "G": {"F": [[true, "E", "B"], [{"C": null, "F": {"E": {"C": true, "I": true}, "F": true}}]], "G": {"C": {"B": false, "G": true}, "E": {"B": {"A": {"B": [[[[null, {"B": false, "C": {"D": 1, "J": {"C": true, "J": null}}, "G": null}], null]]], "C": false}, "F": {"I": true, "J": [9, {"H": false, "I": false}]}}, "E": {"C": false, "E": {"B": [6, {"H": 3}, "G"]}, "I": null}}, "J": {"D": {"F": {"F": [false, {"B": [null, 9], "J": {"D": 8}}, true]}, "G": {"G": 1, "I": {"A": 1, "F": false}}, "I": {"A": null, "C": {"F": false}, "E": {"D": {"C": "A", "F": null, "J": {"C": true, "E": {"C": null, "E": 3, "H": "E"}}}, "I": null}}}, "F": 7, "J": true}}, "I": {"I": "J"}}}}, "J": {"C": {"G": {"G": false, "J": {"C": false, "E": false, "G": false}}, "H": {"H": {"B": {"A": {"A": 3, "D": [null, false]}, "H": {"C": "H"}}, "D": {"C": {"D": "H", "G": null, "I": false}}}}}, "J": {"I": 6, "J": {"C": true, "D": {"B": {"B": {"C": {"C": true, "G": null, "I": {"A": {"A": {"A": null, "J": "E"}, "G": {"E": {"E": [3, {"B": false, "E": {"A": {"H": 0}, "J": [false]}, "H": false}], "F": "B"}, "J": false}}}}, "I": [2, false, null]}, "E": "J"}, "C": [{"A": {"A": {"D": {"D": true, "E": {"G": 3, "H": true, "I": null}}, "H": "F", "J": "C"}, "F": "J"}, "C": {"A": [3, {"B": {"F": {"D": {"A": "E"}, "G": "H", "J": {"C": false, "H": 0, "J": null}}}, "C": "A", "H": null}], "C": {"C": false, "D": {"H": {"F": true, "G": {"I": {"G": {"B": {"A": true, "B": true}, "D": {"C": {"F": "E"}, "D": "D", "F": {"A": {"G": null}, "D": {"G": true}, "J": true}}, "F": {"I": 2}}}}, "J": "C"}}}, "G": "F"}}, true, 3], "I": true}, "J": true}}}}, "F": [{"I": null}, false, 4]}, "J": true}, "F": null}, {"F": null, "J": 8}, {"E": {"B": {"A": [[5]]}, "F": false, "H": false}, "I": "A"}]]}, {"H": false, "J": {"J": true}}]], "E": "G"}, "E": null}}}, {"C": {"H": {"G": [{"I": true}, false, null], "I": {"C": 9, "D": {"D": true, "G": [null, "F"], "I": {"D": "G", "I": 1, "J": [{"D": {"A": 4, "J": 1}}, "C", false]}}, "J": true}, "J": {"B": false}}}, "D": {"I": false}}], "F": null}, "J": "I"}}, "H": {"B": {"E": [[[{"G": ["A", 2], "J": {"J": {"A": {"D": "G", "I": false, "J": "H"}, "E": {"A": false}, "H": true}}}, "A", "B"], null, [{"H": true}]], {"A": {"C": {"A": {"D": true, "J": "J"}}, "H": false}, "D": "D", "F": {"C": {"C": {"A": {"E": null}}, "J": null}, "G": false}}, "D"]}, "D": {"C": "H", "D": null, "J": false}, "E": "H"}}, "I": false}}}, "J": {"H": [{"I": true, "J": 6}]}}, "F": {"A": {"F": 6, "G": {"I": "F"}}, "C": [{"D": {"A": [[[1], false], {"E": null, "G": null}, 7], "C": "D"}, "H": {"E": false, "J": {"E": true, "G": {"A": "F", "F": false, "H": 2}}}}, {"A": {"D": {"H": [{"B": 8}, {"C": {"B": {"A": false, "F": 5}}, "D": {"C": true, "D": [4], "E": {"F": true}}}]}, "I": {"A": true, "B": {"F": false}, "E": 1}}, "G": {"B": 0, "C": "C"}}]}, "I": {"B": 3, "E": {"C": [1, 3], "G": 3}}}, "H"], "D": null}, "I": 9}':::JSONB::JSONB
        test_1        |                             AS col317104
        test_1        |                 )
        test_1        |                     AS tab191018
        test_1        |             ORDER BY
        test_1        |                 col317104
        test_1        |         compare_test.go:213: postgres: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1514.58s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #117263 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.14-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 10 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 46b3b0714477e34f89ef6ae1bca24f457ae826c7:

        test_1        |             FROM
        test_1        |                 (
        test_1        |                     WITH
        test_1        |                         with31680 ("c)ol178246")
        test_1        |                             AS (
        test_1        |                                 SELECT
        test_1        |                                     *
        test_1        |                                 FROM
        test_1        |                                     (
        test_1        |                                         VALUES
        test_1        |                                             (B'000000100011110011000100001110011010001011110111'),
        test_1        |                                             (B'010001101011000110001011001010100101101111101101'),
        test_1        |                                             (B'110101111000011101000110000100100011000010010101'),
        test_1        |                                             (B'110001010000010110010011101010001110110011111110'),
        test_1        |                                             (B'000001010010111000010011111100111000110100001000')
        test_1        |                                     )
        test_1        |                                         AS tab120710 ("c)ol178246")
        test_1        |                             ),
        test_1        |                         " with31681" ("co͆""l178247")
        test_1        |                             AS (
        test_1        |                                 SELECT
        test_1        |                                     ARRAY[28189:::INT8] AS "co͆""l178247"
        test_1        |                                 FROM
        test_1        |                                     with31680 AS "\\u14B0cte_ref8925", with31680 AS cte_ref8926, with31680 AS cte_ref8927
        test_1        |                             )
        test_1        |                     SELECT
        test_1        |                         ARRAY[13771:::INT8,8955:::INT8] AS col178248,
        test_1        |                         "c te_ref8929"."co͆""l178247" AS col178249,
        test_1        |                         "cte_r ef8930"."c)ol178246" AS "co l178250"
        test_1        |                     FROM
        test_1        |                         " with31681" AS "cte_ref%v8928", " with31681" AS "c te_ref8929", with31680 AS "cte_r ef8930"
        test_1        |                     ORDER BY
        test_1        |                         "cte_r ef8930"."c)ol178246" DESC NULLS FIRST
        test_1        |                 )
        test_1        |                     AS tab120711
        test_1        |             ORDER BY
        test_1        |                 col178248 ASC NULLS LAST, col178249 DESC, "co l178250" DESC NULLS FIRST
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (564.52s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #117263 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.14-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 10 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ c8ffbdc4eeb3f656085edc33d6965b8f30cd7514:

        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (433.03s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1325895228/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |                 string("001100000000000000000000000000"),
        test_1        |             -   nil,
        test_1        |             +   string("0103000000010000000500000000000000008066C0000000000080464000000000008066C000000000008056400000000000E060C000000000008056400000000000E060C0000000000080464000000000008066C00000000000804640"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         B'0011'::BIT(30) AS "Col466355",
        test_1        |                         st_geomfromgeohash('B':::STRING::STRING::STRING, int4(NULL::BOOL::BOOL)::INT4::INT4)::GEOMETRY AS col466356
        test_1        |                 )
        test_1        |                     AS tab296189
        test_1        |             ORDER BY
        test_1        |                 "Col466355" DESC NULLS LAST, col466356 NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         B'0011'::BIT(30) AS "Col466355",
        test_1        |                         st_geomfromgeohash('B'::TEXT::TEXT::TEXT, int4(NULL::BOOL::BOOL)::INT4::INT4)::GEOMETRY AS col466356
        test_1        |                 )
        test_1        |                     AS tab296189
        test_1        |             ORDER BY
        test_1        |                 "Col466355" DESC NULLS LAST, col466356 NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1063.10s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #117263 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.14-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 10 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 8f14432835d667982828b5319cfd130991fbf80c:

        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (0.00s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 224 [running]:
        test_1        | testing.tRunner.func1.2({0x225da20, 0xc000e202a0})
        test_1        |     GOROOT/src/testing/testing.go:1545 +0x238
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1548 +0x397
        test_1        | panic({0x225da20?, 0xc000e202a0?})
        test_1        |     GOROOT/src/runtime/panic.go:914 +0x21f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x46ab740?, {0x31ec798?, 0xc000dfade0?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:377 +0x436
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x31ab160?, 0x46ab740)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:310 +0x12c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc000dd6480)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:227 +0x7f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc000d974d0, {0xc000c85ac0?, 0x2, 0xc000d974d0?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:260 +0x89d
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0x205df20?, 0x245f581?, {0xc000c85ac0?, 0x49ddf68?, 0x2?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:98 +0x28
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc00084e660?, {0x245f581, 0x5}, 0x2, 0x20?, {0xc000e3ba40, 0x3, 0x7ff3adebdf18?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x131
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0xc0004e1cc8?, 0x1?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:118 +0x15e
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc000144a00?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:98 +0x2f
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.init.wrapCommonSetup.func28(0x2644be8?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x1b
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000cfc4e0)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:143 +0xe2
        test_1        | testing.tRunner(0xc000cfc4e0, 0xc000d97440)
        test_1        |     GOROOT/src/testing/testing.go:1595 +0xff
        test_1        | created by testing.(*T).Run in goroutine 11
        test_1        |     GOROOT/src/testing/testing.go:1648 +0x3ad
        compare_test_1 exited with code 2
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 2
--- FAIL: TestComposeCompare (19.05s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #117263 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.14-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 10 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 8f14432835d667982828b5319cfd130991fbf80c:

        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare946341076/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   s"-0284-04-26 08:19:43.145224 +0000 UTC",
        test_1        |             +   s"0008-08-05 08:07:00 +0000 UTC",
        test_1        |                 nil,
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         make_timestamp(8:::INT8::INT4::INT4, 8:::INT8::INT4::INT4, 5:::INT8::INT4::INT4, 8:::INT8::INT4::INT4, 7:::INT8::INT4::INT4, 0.0:::FLOAT8::FLOAT8::FLOAT8)::TIMESTAMP
        test_1        |                             AS col260412,
        test_1        |                         NULL::INT2VECTOR AS "coL260413"
        test_1        |                 )
        test_1        |                     AS t😈ab124576
        test_1        |             ORDER BY
        test_1        |                 col260412 DESC NULLS LAST, "coL260413" NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         make_timestamp(8::INT8::INT4::INT4, 8::INT8::INT4::INT4, 5::INT8::INT4::INT4, 8::INT8::INT4::INT4, 7::INT8::INT4::INT4, 0.0::FLOAT8::FLOAT8::FLOAT8)::TIMESTAMP
        test_1        |                             AS col260412,
        test_1        |                         NULL::INT2VECTOR AS "coL260413"
        test_1        |                 )
        test_1        |                     AS t😈ab124576
        test_1        |             ORDER BY
        test_1        |                 col260412 DESC NULLS LAST, "coL260413" NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (863.59s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #117263 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.14-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 9 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 8f14432835d667982828b5319cfd130991fbf80c:

        postgres_1    |         (
        postgres_1    |             SELECT
        postgres_1    |                 NULL::TEXT AS col628830, 'G'::TEXT::VARCHAR AS " col628831", 'C'::TEXT::TEXT AS col628832
        postgres_1    |             FROM
        postgres_1    |                 postgres.public."ta
        postgres_1    |     blE1" AS tab366594
        postgres_1    |             WHERE
        postgres_1    |                 NULL::BOX2D::BOX2D
        postgres_1    |                 NOT IN (
        postgres_1    |                         NULL::BOX2D,
        postgres_1    |                         st_box2dfromgeohash('I'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::BOX2D,
        postgres_1    |                         NULL::BOX2D,
        postgres_1    |                         st_box2dfromgeohash('I'::TEXT::TEXT::TEXT)::BOX2D
        postgres_1    |                     )
        postgres_1    |         )
        postgres_1    |             AS tab366595
        postgres_1    |     ORDER BY
        postgres_1    |         col628830 NULLS LAST, " col628831" DESC NULLS FIRST, col628832 NULLS LAST
        test_1        | --- FAIL: TestCompare (1276.30s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (672.34s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '[false, {"D": {"E": {"B": null, "E": {"A": {"A": {"B": {"B": 1}, "I": 9}, "D": {"E": true, "F": {"A": [7, true, {"C": {"B": {"C": {"G": true}, "H": {"A": {"A": "C", "H": {"A": 9, "E": false, "F": ["J", false]}}}}, "D": {"F": {"B": true, "G": [true]}, "J": false}}, "D": null, "G": false}], "E": {"G": {"I": {"B": {"E": false, "I": null}, "H": {"D": true, "I": true}}}, "H": {"E": {"C": 9}, "J": "J"}}}, "I": 7}, "G": {"A": {"G": {"H": {"A": {"E": {"C": {"B": null, "E": {"D": 1}}, "G": "C", "J": {"A": "J", "C": true, "D": [8, 0, [[{"C": "I", "E": {"J": [{"A": null}, {"I": true, "J": {"A": [null]}}]}, "I": true}, {"A": [["G", true, null], true]}], {"C": null, "F": "C", "J": {"F": "J", "G": {"J": {"D": {"F": 7, "H": {"H": {"D": {"E": "D", "J": true}, "F": true}}}}}}}, [{"H": {"C": {"C": {"B": {"B": null, "I": {"E": {"G": false, "H": 8}}}, "D": {"F": "D", "G": {"A": {"B": "G", "E": {"D": "G", "E": null}, "I": {"C": {"D": {"B": true}}, "F": "E"}}, "J": {"C": 5, "D": null, "J": null}}}, "I": {"A": {"D": {"A": {"D": false, "E": null, "I": [{"B": {"A": false, "B": {"J": null}}, "F": false, "H": {"D": {"A": {"I": {"D": {"H": {"G": {"A": null, "B": {"E": {"A": false, "I": {"B": [{"E": "C"}]}}, "G": 4}, "F": {"G": [false], "I": "J"}}}}, "G": {"A": [null, null], "E": 9, "J": {"G": false}}, "J": false}}, "E": {"B": {"A": {"B": {"H": null}, "J": 4}, "B": 2}, "E": {"J": 0}}, "G": {"F": {"E": 4}, "I": false}}, "F": {"H": "B"}}}]}}, "G": null, "H": {"J": [{"B": false, "E": null, "I": [8]}, {"E": "E"}, {"E": {"D": [null], "G": true}, "J": {"B": {"E": false, "F": 1, "J": "B"}}}]}}, "H": 1}}, "J": {"H": [{"F": [{"E": {"F": {"B": {"C": ["B"], "G": {"E": {"E": 1}, "G": true}}, "D": {"A": {"E": true}}}, "G": 4}, "F": {"H": {"B": true, "F": true}}}, [{"B": [{"E": false, "F": "I", "I": {"H": 6, "I": "C"}}, null], "F": {"G": false}, "J": [{"B": null, "D": [{"C": [[null]]}, true], "G": {"F": 9}}, {"E": [{"B": {"F": {"A": "H", "D": {"D": {"B": 8, "I": {"B": {"B": false, "G": {"D": false}}, "C": {"C": {"C": {"C": {"C": true, "D": false}}, "F": {"D": {"I": true}, "G": "J", "I": [null, true]}}, "D": null}, "G": false}}, "F": null, "G": true}, "J": [{"A": false, "D": [true, null, [{"A": {"A": false, "B": false, "D": true}, "C": 2}, true, false]]}, "C", {"F": "I"}]}}, "D": {"E": false, "G": [{"F": 5, "J": {"B": {"H": true, "I": {"E": {"B": null, "G": null, "H": false}, "G": {"F": false, "I": {"A": {"J": [{"E": {"A": {"D": {"F": 9, "H": {"B": "H", "C": {"B": {"B": true, "C": "I", "D": false}, "D": [null, null], "F": [[8, 5, "E"], "E"]}, "D": 9}, "I": {"G": {"C": {"G": {"B": [true, null], "D": {"G": false}, "I": true}, "H": false}, "F": {"H": {"B": null, "C": 4, "F": {"E": {"B": {"D": null}}, "F": false, "G": [{"B": {"A": null, "E": {"C": {"D": [[false, null, {"B": false, "C": {"E": {"A": {"E": {"C": {"C": {"A": {"G": false, "J": {"F": [[{"A": true, "F": true, "H": {"C": false, "D": "B", "G": [{"E": {"F": {"C": 4, "G": null}}}, {"E": 9, "F": {"C": null}, "J": {"D": 9, "G": null}}]}}, {"C": "B", "E": 3, "H": {"A": {"G": {"F": "G", "I": null}}, "H": {"C": [[3, {"H": {"C": [false], "G": {"F": "I"}}}, false], "F", {"B": true, "G": true}]}}}, {"F": ["G"]}], {"B": "H", "G": true, "H": false}], "G": {"E": [false]}, "I": {"E": "B", "I": {"J": [3, 1, null]}, "J": {"A": {"D": 8, "H": null}, "H": false, "J": false}}}}, "H": "C"}, "F": "F"}}, "G": {"B": false, "E": false, "H": 0}, "H": false}, "J": false}, "G": [true, {"G": {"D": [true, [null], null], "F": false}, "H": "B"}, 2], "H": "E"}}], {"A": [{"D": {"F": "A", "J": {"F": "A", "G": 6}}, "H": {"F": [null, 0], "J": {"A": false, "J": {"G": null}}}}, 0, {"C": true, "F": false, "J": [6]}], "B": true, "G": [{"D": {"B": {"G": true}, "F": "C", "J": 0}, "H": {"B": {"B": false}, "D": null, "F": null}}, {"H": [null, {"I": {"I": true, "J": {"F": {"B": {"B": false, "C": null, "F": {"I": 7}}, "H": {"C": {"B": [false]}}}}}, "J": {"F": true}}, {"I": {"F": "E", "J": "A"}}]}, {"G": false, "I": {"F": [null, null, {"E": "G"}]}}]}, "C"], "I": {"H": {"B": [{"G": "H"}, {"A": {"A": {"C": false, "F": {"G": {"G": [{"B": {"E": [{"C": true, "D": {"E": false}}, true, {"E": "H"}]}, "D": false}, {"C": 6, "F": null, "J": null}]}}}, "E": {"B": {"B": null, "C": 0, "J": 1}}, "J": [{"J": false}, {"D": false, "I": {"B": "G", "I": "H"}}]}, "F": {"E": false, "G": false}}, {"C": {"D": {"H": "A"}, "J": {"A": null, "H": "G"}}, "H": null, "J": [{"C": true}, true]}], "C": {"B": true}}, "J": 2}}}, "F": [[null, {"C": true, "F": {"B": "E", "I": "D", "J": [{"E": "J", "G": {"B": "G"}}]}}, null], true, "C"]}, "E": {"A": [{"C": {"I": "H"}}, true, true], "G": 8, "I": [{"I": null}, [{"G": [{"C": 5, "G": {"E": {"F": {"G": {"D": null}}, "I": true}, "H": {"B": false, "G": false}}}], "J": true}, {"D": false}, {"F": null}]]}, "G": {"D": "C", "H": {"F": 6}, "J": [{"H": null}]}}, {"A": {"A": "G", "G": "B", "I": 6}, "E": {"F": null, "G": [{"A": "E", "E": {"F": [true, {"E": {"F": {"G": {"E": null, "F": {"B": {"A": true, "C": 7, "I": true}, "C": true, "H": "C"}, "G": true}}}}]}}, true], "I": null}, "F": {"C": {"E": [{"G": {"B": null}}, true], "G": {"C": [[null, {"C": true, "H": {"I": "D"}}, {"B": {"D": {"E": 1, "I": {"A": true, "G": true}}, "J": {"C": true}}}]], "I": {"D": {"I": null, "J": true}}, "J": "J"}, "J": 9}, "E": true, "I": false}}, null]}}, "I": [{"E": {"F": [{"B": {"C": [{"D": {"H": null, "I": {"C": false, "E": {"I": "I"}}}, "F": null}, 4, {"E": true, "F": [5], "I": {"G": 6}}], "D": {"E": {"C": {"J": {"G": 4, "I": "E"}}, "E": {"B": null, "D": {"A": null}}}}, "E": null}, "D": {"B": {"J": {"A": {"A": false, "G": null, "I": 4}, "F": "H"}}, "C": {"A": true, "B": true, "H": {"A": {"D": {"E": [["C", null, "J"]], "F": true}}}}}}, true], "I": "H"}, "H": null}, [{"J": {"F": 1}}, {"G": [null]}, 9], "I"], "J": "G"}, "J": {"J": null}}}}, "E": false}, "I": false}, "F": 0, "G": 9}, {"B": [null], "H": {"C": null}}]}, "F": {"C": {"C": null}, "E": [false, true], "G": {"A": {"B": false, "D": "A", "F": true}}}}}}}, "F": null}}, null]}, "G": {"B": false, "D": {"E": {"I": [{"G": {"A": false}, "H": {"E": false}, "J": null}, {"E": {"D": {"B": "E", "D": {"D": 5}}, "H": {"A": {"E": 5, "G": null}, "D": {"A": false}}, "I": false}}, 3], "J": {"C": "C", "D": {"C": 0}}}, "F": {"F": true}, "G": [{"B": {"B": {"E": [{"A": null, "J": null}]}, "F": {"A": false, "D": 0, "J": {"A": {"G": [{"B": [{"F": [{"G": false, "J": [6]}], "H": [true, "G", {"C": "D", "D": {"J": false}, "E": {"H": {"D": {"B": [{"C": [true, {"A": {"H": true}, "C": {"A": {"B": 5}, "G": "B"}, "F": {"F": {"A": [{"J": false}, "J"]}}}, true]}, null], "D": {"G": true, "H": {"D": {"A": false, "F": {"F": {"H": true}, "G": null}, "H": [2]}, "F": {"D": null}}}, "G": false}, "F": {"A": true, "C": {"B": 9, "C": "I", "E": {"A": {"J": [{"B": true, "F": [4], "I": {"H": [{"E": {"A": {"B": {"G": {"A": {"C": {"B": null, "E": null}, "F": 1}, "J": [null, 4, {"B": {"E": {"B": {"I": {"B": true}}, "C": false, "I": {"D": {"C": true, "E": [{"E": null}], "F": false}, "F": false}}, "J": {"G": true, "I": {"B": {"E": {"A": {"D": 5, "F": 5, "J": false}, "E": true, "I": 1}, "F": null, "J": {"I": 2}}}}}, "I": "A", "J": {"G": null, "H": {"E": {"F": {"H": [{"I": false}, false, null]}}, "I": "G"}, "I": "H"}}]}, "H": "G"}, "F": 1}, "B": "J", "G": null}, "G": null, "H": {"C": [null, {"E": null, "H": ["I"]}], "F": true, "J": [true]}}]}}, 3, {"C": {"A": 5, "I": {"B": 1, "D": 1}}, "E": false}]}}}, "I": {"D": [{"D": {"C": false}}, 2, {"E": true}], "E": "J"}}, "J": {"E": {"B": "H"}, "H": [{"C": true}], "I": 5}}, "J": {"D": 7, "E": false}}}]}, {"B": 5, "D": {"B": false, "J": 7}}, {"E": [false, {"B": true, "F": true}]}]}]}}}}, "J": {"D": true, "E": {"D": false}}}, null]}, "J": {"A": {"H": {"A": {"A": "F", "G": {"C": {"A": {"H": {"D": null, "E": {"A": {"A": true, "G": {"E": {"D": "F", "E": [{"E": {"B": true, "E": {"B": {"E": {"D": {"A": [7, {"C": null, "H": "B"}], "J": {"E": true, "J": {"E": {"A": {"I": null}, "G": false, "H": "D"}, "G": {"H": {"D": false}}}}}, "G": {"A": ["F", "H", false]}, "I": "D"}}, "H": [null, true]}, "G": {"A": true, "I": null}}, "J": true}, {"C": "C", "E": true, "H": {"D": "J"}}], "I": 4}, "F": {"A": true}}}, "E": null}, "I": "B"}}, "D": null}, "G": true}}}, "J": [{"C": "H", "I": "A"}, {"B": [1, {"C": {"I": {"F": {"C": 3, "D": true, "I": true}}}, "D": {"E": {"C": {"D": true, "J": "G"}, "J": {"H": true}}}}], "E": "E"}, "A"]}, "J": "F"}}}]}]}, {"I": false}, {"J": null}]], "H": false}]}}, "D": false}, "I": 9}, 8]]]}}}, "D": null, "H": {"A": true, "F": {"I": {"A": false, "G": "B"}, "J": true}}}, "J": "F"}, "J": true}}}}, "G": {"E": 4, "G": [false, true, {"B": 4, "F": {"C": true, "G": {"C": {"C": "G"}, "H": "E"}}}]}}, "G": {"F": {"A": {"A": 2, "D": true}, "E": "G", "I": null}, "G": "H", "I": [{"D": "D", "G": false, "I": false}, {"E": {"C": false, "H": 9, "I": null}, "G": "J"}, 1]}}, "G": "A"}, 3]':::JSONB::JSONB
        test_1        |                             AS 😘col628875
        test_1        |                 )
        test_1        |                     AS " tab366620"
        test_1        |             ORDER BY
        test_1        |                 😘col628875 DESC
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1301.34s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #117263 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.14-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 9 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 8f14432835d667982828b5319cfd130991fbf80c:

        postgres_1    | 2024-01-26 06:23:34.802 UTC [78] HINT:  Use an explicit ordering operator or modify the query.
        postgres_1    | 2024-01-26 06:23:34.802 UTC [78] STATEMENT:  SELECT
        postgres_1    |         *
        postgres_1    |     FROM
        postgres_1    |         (
        postgres_1    |             SELECT
        postgres_1    |                 tab67128.col1_2 AS col127597,
        postgres_1    |                 "tab.\f67126".col1_14 AS "Col127598",
        postgres_1    |                 NULL::BOX2D AS "c'ol\\U000B3294😦127599"
        postgres_1    |             FROM
        postgres_1    |                 postgres.public."t&able1" AS "tab.\f67126",
        postgres_1    |                 postgres.public."t&able1" AS "t
        postgres_1    |     ab67127",
        postgres_1    |                 postgres.public."t&able1" AS tab67128
        postgres_1    |         )
        postgres_1    |             AS tab67129
        postgres_1    |     ORDER BY
        postgres_1    |         col127597 ASC NULLS FIRST, "Col127598" ASC NULLS FIRST, "c'ol\\U000B3294😦127599" ASC
        test_1        | --- FAIL: TestCompare (1379.56s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (774.64s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '{"G": {"F": {"A": {"H": {"B": null, "F": [{"A": true, "C": 3, "E": null}, {"D": {"B": {"D": "H", "E": 5}, "C": false, "J": {"F": [{"C": {"A": {"C": null, "F": "F"}, "B": {"B": true, "C": true}, "J": {"E": {"D": false, "J": null}, "H": null}}}, false, null], "I": {"B": {"A": null, "E": "A"}, "G": {"F": [{"A": [{"F": 5, "G": true, "I": [{"D": {"A": true, "C": true, "D": {"A": [[null, {"D": "G", "F": [{"C": "F", "E": 4, "H": {"E": 9, "H": {"C": null, "D": {"B": {"B": 8}, "D": {"C": {"B": false, "E": true, "H": [4]}, "I": true, "J": 7}}, "H": 5}}}, {"B": "D"}]}], true]}}, "I": {"F": "A", "G": {"F": false}, "J": null}}, {"D": {"C": {"A": {"H": 0}, "F": {"J": {"A": "E", "C": {"F": {"A": 1, "E": [false], "I": "H"}}}}, "G": {"B": {"G": {"D": null, "G": 1, "J": "I"}}, "C": "B", "I": {"C": {"C": false, "I": {"B": {"D": {"G": false}}, "H": null}}, "D": null, "I": false}}}, "I": {"A": true, "D": 4, "E": false}}, "H": {"A": {"C": [{"B": 0, "I": {"C": [false], "G": {"C": {"A": null, "H": {"C": true}}, "H": {"E": {"D": null, "E": "D"}, "I": [[{"F": [{"A": false, "I": {"F": {"B": {"H": null}, "I": [{"B": {"A": true, "E": "C", "J": true}, "D": {"D": {"A": {"C": "D", "G": true}}, "E": {"B": {"C": null, "H": {"A": "B", "B": {"J": "J"}}}, "D": {"H": {"D": {"F": {"A": "D", "I": [true, {"F": true}], "J": {"B": {"G": 5}, "I": {"B": {"D": {"A": [true, {"G": true, "J": {"A": {"C": 1, "F": true, "I": {"F": {"B": {"A": false, "C": {"G": [{"E": {"F": {"F": {"E": null, "I": {"G": null}}, "H": {"E": 9, "F": 7}}, "H": null, "J": "B"}, "H": 5, "I": [{"H": null}, false, {"A": [{"E": null}, {"E": {"H": {"H": [{"D": [null, null], "G": 2}]}}, "G": true}, {"F": {"A": {"A": {"J": {"H": false}}}, "I": true}, "G": null}], "J": ["G"]}]}, null]}, "E": "D"}, "C": {"B": {"D": [{"A": {"D": 6}, "B": {"E": {"A": false}, "I": {"C": {"C": {"B": {"A": {"G": "H"}, "D": true}, "I": {"A": "E", "J": null}}, "G": true}}}, "H": null}, 2, {"A": {"A": null, "E": "I"}, "H": false}]}, "D": true, "I": 7}, "J": {"F": false, "I": false}}, "H": {"E": null, "J": {"I": {"D": {"E": null}}, "J": [5, {"A": false, "I": 3}]}}}}, "G": [null]}}, 3]}, "E": {"B": {"D": false, "I": {"E": "A", "J": {"B": {"B": {"B": {"G": {"A": {"J": {"G": {"C": {"D": {"C": [6, {"B": 9, "C": false, "E": null}], "H": true}, "I": {"E": null, "H": "H"}}, "J": 5}, "J": false}}, "H": false}}, "F": "J", "I": "H"}, "E": {"D": {"G": {"A": false, "C": true, "F": {"D": null}}}, "I": {"C": {"C": false}, "D": 8, "E": null}, "J": null}, "G": 2}, "G": "H"}}, "J": null}, "E": false, "J": {"C": {"H": {"C": {"A": {"B": {"C": false, "D": true, "E": {"C": false, "G": {"C": 2, "E": {"A": "I", "B": false}, "G": null}}}, "D": 0}, "B": {"A": {"E": {"C": false, "E": {"A": [{"D": null, "F": 5}], "F": [{"A": null, "B": {"D": {"B": "E", "G": {"B": {"D": {"I": null}}, "F": {"D": "D", "G": null, "H": {"D": 4}}}}}, "C": {"F": {"C": {"D": null, "G": [{"H": {"G": [null, false]}}, {"J": {"C": [null, {"E": 6}, true], "H": {"B": {"F": "B", "G": {"E": "J"}}, "C": {"E": true}, "I": {"D": [{"F": true}, false], "J": {"B": {"F": {"J": false}}, "E": true}}}, "I": {"J": {"E": true}}}}, {"J": false}], "I": [0, {"A": "E", "B": {"D": false, "F": [{"A": 5}, {"F": true, "H": {"A": null}}, {"C": 7, "I": {"A": {"A": null, "B": {"B": [{"A": {"F": [{"H": [{"B": [{"A": {"C": null}, "G": {"C": {"E": null, "H": [null, {"F": [true]}, {"A": 0, "I": {"B": {"A": [false], "H": {"A": null, "J": "A"}}, "E": true}}]}, "D": {"H": {"I": {"D": {"F": {"E": "E"}, "I": {"B": true, "C": true, "I": {"C": null, "D": {"B": false}, "F": "H"}}}}, "J": [true, {"F": {"B": {"B": 8, "C": "I"}, "H": {"E": null}}}]}}, "J": {"A": {"B": {"B": null}}, "F": false}}}]}, "I", true]}, {"A": false, "I": {"G": {"G": {"I": {"A": {"E": {"A": {"C": {"J": "C"}}}, "J": true}, "B": 2}, "J": null}}}, "J": {"A": 6, "B": {"A": 8, "F": true, "I": 6}, "J": "E"}}, null]}, "C": true, "E": {"B": null, "C": {"D": {"C": true, "J": "F"}, "G": {"A": {"J": null}}}}}, true], "E": {"B": {"A": {"A": {"B": [{"C": 4}, "G", "B"], "G": "H", "I": {"B": {"C": "C", "J": "E"}}}, "D": {"H": {"D": {"H": {"A": {"A": true, "F": {"B": {"C": {"F": {"G": true}}, "H": {"H": 4}}, "F": {"G": {"H": {"C": {"B": {"C": "I", "F": "D", "H": {"J": {"F": {"B": {"D": {"D": false, "F": null, "G": false}, "G": "G", "H": {"A": {"J": false}}}, "D": "A"}, "J": null}}}, "E": {"G": "E"}, "I": {"A": {"D": [{"D": {"G": {"H": {"C": [{"D": false, "J": {"G": "H", "J": {"I": ["I", false, {"D": [["C"]], "G": "C", "H": {"A": [[{"A": {"F": false, "G": "A"}, "J": {"C": {"B": {"I": null, "J": "J"}, "G": {"G": "C", "I": {"I": {"A": {"A": null, "D": null, "G": null}}}}, "I": {"A": null, "B": {"D": {"C": null, "D": 8}}, "H": 1}}, "J": {"F": {"B": null, "H": {"A": false}}}}}, {"H": {"A": null, "I": [{"B": {"C": {"B": 5}, "E": null}}, null]}, "I": [null, {"A": {"E": false}, "F": false}, true], "J": 0}, {"H": null}], true], "H": "H"}}]}}}, {"A": false}, false], "F": 9, "G": {"J": "F"}}}}, "G": "F"}], "J": {"C": {"A": false, "D": 8, "J": {"I": false}}}}, "E": "J", "J": {"D": {"H": {"D": {"F": {"B": true, "H": {"H": {"F": {"C": null}, "G": {"D": {"H": 8}, "J": {"C": {"E": "B", "G": true}}}, "J": false}, "J": {"A": 8, "B": [{"F": "I"}], "D": true}}, "I": null}, "G": {"A": {"B": {"F": 2, "H": {"C": {"H": true}, "F": {"B": 4, "G": {"F": {"A": false, "F": false, "I": {"J": {"D": null, "J": [false, {"D": "E", "G": "E"}]}}}}, "J": {"C": false}}, "I": "D"}, "I": false}, "G": true}, "I": 4}}}, "I": false}, "H": {"A": {"E": false}, "D": {"F": "E", "J": false}}}}}, "D": true}}}, "G": false}, "J": {"J": true}}, "J": {"B": "I", "E": null, "J": {"C": 6}}}}, "G": {"I": {"C": true, "F": "D", "J": 2}, "J": null}}}}, "I": true}, "G": "A"}, "H": 6}}, "I": "J"}}]}, "C": 0}, [{"E": "J"}]]}, "G": 2}, "G": null}}], "G": {"F": {"G": {"H": {"F": {"G": {"J": {"F": true}}, "I": {"A": "H"}}}}, "J": {"A": {"B": 2}, "G": {"I": 1}, "J": {"C": {"A": 7, "F": 8, "J": {"G": "I"}}}}}, "J": [true]}}}, "I": {"I": 6}, "J": {"B": false}}, "I": 8}, "D": {"A": {"H": {"F": false, "J": {"F": {"C": {"A": false}, "E": [{"J": [{"B": "E"}]}], "G": "H"}}}}, "H": 8}}, "J": {"A": {"F": false}, "B": 9, "I": {"E": null}}}}, "J": {"E": {"E": {"E": "J"}, "F": {"C": false, "F": 1}}, "F": 4, "H": [{"D": null, "F": {"E": 6, "G": {"B": "J"}}}, {"H": {"A": {"A": {"E": true}, "B": true}, "H": {"B": {"E": false, "H": true}, "F": false}}, "J": false}, null]}}}}, "E": 6}, "J": {"H": "D", "I": {"B": {"B": "B"}, "F": {"D": false, "I": 5}}}}}}, "F": {"C": [{"A": [true, false], "B": null, "E": "D"}, true], "E": ["B", false], "H": true}}, "I": [{"A": {"F": 3, "H": false}, "F": null}, {"A": [{"A": false, "I": {"B": {"H": {"C": {"A": {"C": 9, "D": null, "H": true}, "B": [[6]]}, "F": 9}}, "H": null}}, [null]], "C": false, "H": true}, [true, null, "A"]]}}}, "J": {"H": 3}}]}, "I": {"G": {"B": null, "C": true}}}}, false], "H": true, "J": "J"}, [{"J": {"A": {"J": {"A": false, "I": {"B": {"C": {"E": {"B": {"B": {"B": {"C": false, "D": null, "H": {"A": {"C": false}, "E": [{"G": 0}], "J": {"E": "G"}}}, "I": "F"}, "F": {"F": "E", "G": [5, 6]}}, "C": true, "F": 9}}, "H": {"B": true}, "J": null}, "E": true}, "J": {"C": ["G"], "G": {"C": {"E": false, "F": "I"}, "H": "E", "J": {"C": true, "J": "I"}}, "H": true}}}, "C": [{"A": 0, "E": false}, {"D": false, "I": {"B": [[{"F": 0}], false, "E"], "E": "D", "J": null}}, {"C": {"B": "G"}, "H": null, "I": {"B": "H", "F": 7}}], "I": [true, null, "H"]}}, "F", {"B": {"H": [true, {"F": {"F": {"H": "G"}, "G": null}, "J": null}]}, "D": true, "H": {"G": {"D": false, "H": {"C": {"A": {"B": {"A": [{"G": "C", "I": true}, {"D": {"E": {"C": {"A": "F", "C": [{"D": {"G": true, "H": {"C": true, "E": 0, "F": {"B": {"B": 9}, "E": "D"}}, "J": {"H": {"B": {"D": {"C": {"B": {"B": {"B": {"A": [false], "D": {"D": null, "I": {"A": {"D": true, "I": true, "J": "H"}}, "J": {"C": 2, "G": [null]}}, "I": [{"H": 7}, {"A": "E", "G": [{"D": {"G": {"C": false}}, "F": [false, {"D": {"C": 6, "E": {"G": {"F": [true]}}, "J": {"J": {"C": null, "H": {"A": {"B": false}, "D": 7, "J": true}, "J": true}}}, "F": "I"}, true]}, {"F": [false, "F"], "G": 7, "I": false}], "H": {"E": 5, "G": "D"}}, {"B": false, "F": false}]}, "J": {"F": {"C": {"D": "C", "H": true}, "H": {"E": 6}}, "G": false, "J": true}}}}, "I": {"D": 4, "H": {"C": false, "D": false, "E": "C"}, "J": null}}, "J": null}, "E": {"C": true, "G": 5, "I": [{"B": [{"A": 4, "G": 9}, {"C": 7, "D": "G"}, {"J": {"A": {"I": "I"}, "E": {"D": "D"}}}], "G": true, "I": [[null, {"C": 2, "D": "I"}]]}, "A", false]}, "G": {"F": [5]}}}}, "F": {"J": "I"}, "H": [{"F": {"C": {"A": {"B": {"C": [[3]]}, "D": null, "E": false}}, "D": {"G": {"A": {"F": 7}, "E": {"D": {"E": 0, "I": false}, "I": {"E": {"D": {"C": true, "E": null, "H": {"F": "D", "I": {"B": true, "E": false}, "J": null}}, "I": {"C": "B"}}}, "J": {"C": {"B": null}, "E": {"B": [true], "C": true, "E": null}, "G": {"G": 8, "H": {"C": {"B": {"A": 2, "B": {"J": true}}, "H": {"D": false, "F": {"B": {"A": null, "B": null, "H": false}, "E": {"B": {"B": [true, true, 1], "C": false, "H": [[4, {"D": false, "G": {"F": 1, "G": null}}], "H"]}, "D": {"C": false, "G": {"H": 4}, "I": 8}, "I": {"G": null}}, "G": {"D": 0}}}, "J": {"B": {"F": true}, "H": "G"}}, "I": {"C": {"A": {"B": {"B": {"H": 8}, "F": {"F": false, "I": {"I": 0}}, "G": 4}, "D": {"A": {"B": {"I": {"I": false}, "J": false}, "C": 9, "J": false}, "J": 0}}, "B": {"B": null, "G": true}}, "D": true, "E": 4}}}}}, "F": {"F": {"C": "E", "F": 2, "G": [4, {"A": {"C": [7, null, {"A": 9, "C": {"C": {"H": {"B": {"C": 4, "H": [{"A": {"C": "C", "F": {"D": 2, "G": {"C": "B", "F": {"A": false}}, "I": {"A": {"C": 3, "E": true}, "D": 6, "I": {"E": "B", "F": true, "I": [{"C": "C", "F": 5}, false, {"A": true, "C": false, "H": 9}]}}}, "G": false}, "C": 4, "J": false}, "F"]}, "C": "I"}}, "D": "D", "E": 4}}], "D": 6}, "B": [{"C": 7, "G": {"A": {"I": 1}}}, {"E": 9}], "C": {"A": true}}]}, "J": false}}}, "F": [0, {"A": {"J": {"G": null}}, "G": null, "H": 3}, {"C": 0, "F": null}]}, "G": true, "I": false}]}], "G": [{"A": [{"E": [{"E": [{"B": {"H": [{"A": {"A": false, "D": null}, "C": {"A": "F", "I": {"E": 4, "F": "D"}}, "E": {"D": {"A": {"F": "G", "I": [false, {"F": 2}]}, "H": 4, "I": {"E": true, "J": {"A": 8, "C": null}}}, "E": {"H": {"B": {"C": {"E": "B"}, "E": false, "F": true}}}}}]}, "E": {"A": {"E": {"E": 7, "F": {"F": {"H": 7}, "G": {"D": {"F": [{"J": {"A": {"C": {"B": true}, "G": {"C": {"E": true, "G": 2}, "H": "J", "I": {"D": {"H": false}, "F": {"A": false, "C": {"B": {"B": false}, "D": {"H": {"A": {"D": 9, "E": [null, "D", {"B": {"D": {"H": {"G": 8, "I": {"A": 1, "H": {"C": {"I": true, "J": 6}}}}}}, "D": {"A": true, "F": {"E": {"C": {"C": false, "D": false, "H": {"I": {"F": {"B": "C", "E": {"C": {"B": [4, {"A": 5, "E": "A"}], "G": {"B": {"F": {"D": 9, "F": {"D": {"A": true}, "F": {"C": {"F": [{"B": false, "J": {"A": {"F": true, "I": {"E": true, "G": null}}, "C": {"B": null, "J": null}}}, {"D": {"A": null}, "J": {"C": 4, "E": null, "H": "F"}}, {"E": "A"}]}, "D": "C"}, "I": {"E": {"A": {"F": {"A": {"A": false, "C": ["D"]}, "B": true, "F": {"A": {"B": true, "I": {"F": {"F": {"A": {"B": null, "F": [{"I": true}]}}}}}, "C": false, "I": "E"}}}}, "F": "B", "I": true}}, "H": {"G": null, "J": true}}}, "F": null}}, "H": {"A": null, "E": {"C": {"J": {"C": {"G": null}, "E": false}}, "D": {"I": 4, "J": null}}, "G": {"G": "I", "I": {"H": 1}}}}}, "H": {"C": {"A": {"B": {"B": [true, {"H": 1}], "E": {"A": true, "B": false, "H": 5}, "G": false}, "J": {"A": {"I": {"G": [null], "H": null}}, "B": {"A": {"G": 3, "H": null}}}}, "G": [0], "I": true}, "E": false, "G": false}, "I": "C"}}}, "H": null}, "G": {"F": "J", "G": 0, "I": true}}, "J": {"D": false, "H": {"C": "E", "E": {"J": {"C": "F"}}, "F": null}}}, "I": [{"A": 3, "F": {"H": {"C": null, "I": null, "J": {"A": {"A": {"A": "F", "J": {"C": false, "F": "J"}}, "D": {"E": "I", "F": {"E": [[false, false, {"B": 1, "E": [9], "F": "G"}]]}, "I": false}}, "B": true}}}}, null, {"B": true, "C": {"A": {"B": "D", "D": ["A", {"B": [{"E": 6}, "B"], "I": null}, {"E": [{"B": true, "F": {"F": null, "H": false}}, false], "I": {"F": {"B": "A", "H": "J"}, "H": {"F": "J"}}}]}, "H": {"G": true}, "I": 6}}]}], "J": {"C": null}}, "G": {"I": [null]}}}}, "J": {"F": 7}}}}, "H": {"A": false}}}}, false, {"H": {"E": [{"C": null, "I": "H"}, false, {"C": {"G": {"D": null}}, "G": {"A": false, "C": {"A": {"F": {"A": {"F": {"C": {"E": {"B": [{"B": "F", "H": null}], "E": {"I": 6}}, "J": false}, "D": {"J": 4}, "H": {"C": false, "H": {"J": "G"}, "J": {"D": true, "I": "G"}}}, "G": false}, "G": {"D": "D"}, "I": {"F": true, "G": true, "I": [{"G": {"B": {"A": true, "F": "G"}, "D": {"C": "I"}}, "I": {"G": {"F": 0}, "H": [{"H": false, "I": {"I": "F"}}, 2]}}]}}}, "D": {"E": {"A": null, "I": 7}, "F": 9}, "J": {"F": {"G": true, "I": {"I": [false]}}, "H": false, "J": {"A": null}}}, "D": true}, "J": "E"}]}}], "J": {"G": {"E": [[{"J": 9}], false, [{"A": 5, "D": {"B": {"D": {"A": "H", "I": [null, true]}, "G": true}, "I": {"D": {"B": {"F": "C", "J": {"H": {"D": [false], "I": [{"A": true}]}}}, "C": {"E": 2, "I": false}}}}, "I": {"A": true, "D": ["F"], "H": {"G": null, "H": {"H": true, "I": [{"E": {"I": ["C"], "J": {"H": "H"}}, "I": [[1, null]]}]}}}}, null, {"B": {"B": 8}, "J": {"B": {"F": 8}, "D": 8, "G": {"B": {"F": [true, true, {"F": 1}]}, "F": false, "J": {"F": {"D": {"A": 9, "C": null, "G": {"G": {"E": ["D"], "H": {"C": null}, "I": {"I": [[true], null]}}}}, "E": {"I": {"C": null, "F": [{"A": "B", "D": false}, ["A"], true]}, "J": null}}, "H": "G"}}}}]]}}}}}}}}}, 6, "A"], "F": null, "G": false}], "G": 3, "I": {"C": 0}}, {"D": {"A": {"A": null, "D": false, "F": 1}, "F": 3, "G": {"C": null}}, "E": {"D": [[{"E": 6, "H": "F", "I": [true, "G"]}, 0]], "F": {"F": {"C": {"D": 1}, "F": {"E": {"C": {"A": {"H": [4, 0], "J": {"H": {"B": {"H": {"A": {"B": "J", "F": [{"F": null, "G": {"B": null, "C": {"E": {"A": 9, "H": "J"}, "H": null}, "G": {"F": {"F": {"A": {"E": true, "I": "F"}, "H": {"D": [{"A": 0, "B": [[null, [{"C": false, "E": "G"}, {"D": {"B": {"B": {"D": 4, "I": true, "J": true}, "J": "B"}, "J": "G"}, "H": {"F": {"H": false}, "G": {"A": {"G": {"B": "F", "F": null}, "I": "A"}}}}, {"B": 2, "E": 7, "I": 4}]]], "C": null}, {"I": {"F": {"J": null}}}]}}, "J": {"J": 7}}, "I": {"G": true, "J": {"A": null, "D": {"B": true, "D": {"A": {"D": {"B": null, "C": {"B": "C"}, "D": {"A": false, "D": {"I": {"B": {"B": "C", "D": 0, "G": true}, "E": {"I": false}, "I": false}}}}, "F": {"A": null, "I": false}, "H": true}, "I": {"F": {"E": ["A", {"G": {"D": 2}, "J": 7}, {"E": false, "J": true}], "H": null}}}, "E": null}, "F": false}}}}, "I": 3}, {"F": 3}, {"F": {"D": 2, "J": 0}, "H": false}], "H": {"G": "A"}}, "E": {"G": {"B": null, "D": 0}}}}, "D": {"B": {"F": {"B": "E"}, "H": 7, "I": true}, "H": false}}, "I": null}}}, "H": false, "I": {"A": false, "E": null, "H": {"A": "J", "G": "A", "I": {"I": null, "J": [{"G": null}, {"H": null}]}}}}}}, "G": [{"D": {"D": 9, "J": false}, "H": null}, 6, {"C": "D", "F": {"D": false}, "G": null}]}, "H": false}}, {"A": {"B": [{"D": true, "E": [{"E": "A"}, {"A": [true, true], "H": false}]}]}, "E": {"A": null, "C": {"I": {"C": "C", "E": [{"G": {"G": null}, "J": 5}], "G": {"B": {"B": null, "C": {"I": 0}, "I": {"A": false, "B": null, "D": true}}, "E": null}}}}}], "D": {"D": null, "I": true}}, {"A": true, "H": {"B": {"J": {"B": {"F": null, "H": true}, "D": true, "J": {"E": ["J", "J", {"F": 8, "G": true}], "F": false}}}}}]}, "H": {"B": false, "F": [{"G": {"E": [{"D": true}]}, "H": {"G": {"I": {"B": {"C": {"F": {"J": 8}, "H": {"C": null, "E": {"B": {"A": [false, true]}, "J": true}, "F": {"J": "H"}}, "J": true}, "G": "G", "I": {"A": {"F": 1, "J": {"E": null}}, "D": {"C": {"D": {"D": false}, "G": [{"F": {"B": 7, "H": {"C": [[{"C": [[{"B": {"E": {"E": {"H": {"I": "C"}}}}, "I": false, "J": 5}], 0, 4]}, {"A": {"A": true, "E": {"G": "D"}, "J": {"E": 8, "H": {"A": {"A": {"B": true, "G": {"A": {"F": {"H": [{"B": {"A": 9, "B": {"A": [false], "B": {"E": "A", "F": {"B": {"G": false, "I": 4}}, "G": {"D": [{"F": {"D": true, "H": {"B": false, "H": true, "I": ["J", null]}}, "J": {"A": "A", "F": null, "I": false}}]}}}}}], "J": {"G": {"A": 0}}}, "J": 1}, "J": "A"}, "I": {"J": {"F": "I", "G": {"J": false}}}}, "B": {"A": true, "G": {"B": "H", "I": [[{"C": true}, 0]]}}, "C": {"A": "F", "J": {"H": {"D": {"A": {"B": 9, "D": {"H": {"F": {"A": {"G": {"B": {"J": {"G": [null, [{"H": {"B": {"D": {"B": {"A": {"C": false, "G": true, "I": {"A": null, "B": "B", "D": false}}, "B": {"A": true, "D": [{"C": "G", "D": {"F": null, "H": [{"C": {"G": 7}, "J": 4}, true, {"B": {"C": 1, "I": false}, "E": [{"D": false, "E": null}, [{"C": false, "I": [null]}, false, "J"]]}], "J": {"D": true, "H": true}}, "E": {"B": null, "I": [false]}}, [false, {"A": "A", "G": {"A": false, "I": {"F": [2, {"A": "F", "C": "H"}, {"A": null, "J": {"F": true}}]}}}]]}, "H": {"E": {"D": [{"A": [{"C": {"G": 1, "H": ["D"]}, "G": {"H": "A"}, "J": {"B": false, "C": {"D": {"E": 5, "J": 3}, "E": "B"}}}], "C": {"C": {"C": null, "E": {"B": {"A": {"B": true, "I": {"J": true}}, "J": [false, {"E": null, "I": "H", "J": "I"}]}, "C": false, "H": {"G": false}}}, "F": false}, "G": false}, "G"], "H": [null, {"A": false, "C": false, "G": "F"}], "J": 3}}}, "J": true}}}, "I": [7]}]], "I": {"B": {"E": false}, "C": 6}}}, "C": [{"A": [{"C": {"D": 4}, "F": [{"B": {"J": true}, "D": {"A": false, "G": true}}, false, null], "G": "C"}]}, 4, {"C": false, "D": 0}]}}, "H": 7}, "G": "H", "J": "G"}, "I": "H"}}, "E": false}, "J": {"C": true, "D": false}}}}}, "H": true}}}}]], "D": [null]}}, "H": "A", "I": true}]}, "H": {"C": {"A": 0, "D": true, "J": true}, "E": {"E": {"H": "H"}, "I": "A"}, "G": "I"}}}}, "C": {"A": {"C": {"I": "B"}, "J": null}}}}}}, true]}, "J": 8}, "F": {"C": "B", "H": false}, "H": 4}, "I": true}, {"A": false, "F": "H", "G": "C"}], "C": false, "F": {"B": false, "E": 7, "H": {"C": true, "F": {"B": {"F": {"D": null, "H": "D"}, "H": {"A": 2}, "I": {"A": "I"}}, "E": {"B": true, "C": true}}, "H": {"J": null}}}}, "F": {"B": {"A": "J", "B": {"F": "I"}, "C": {"F": 3, "H": {"C": {"B": {"I": "J"}, "D": {"B": [{"A": null}], "D": false}}, "F": {"D": {"C": true, "F": "C"}, "E": "C"}, "G": "A"}}}, "C": {"D": null, "H": {"C": {"D": false, "E": 3}}}}, "G": {"C": "F", "G": {"G": "G", "J": true}}}, "J": ["F", {"H": true}]}}}, "J": {"D": 6, "F": 0, "J": true}}}], {"C": {"B": {"B": 8}}, "G": null, "J": {"A": 5}}], {"B": 8}, {"D": null}]}}}}, 9], "H": "A", "I": "G"}, "E": "G"}, "I": {"G": true, "J": {"C": [{"E": {"G": [{"C": [true], "D": "I", "F": true}, "H"], "I": {"E": false, "F": {"B": false, "G": [{"B": true, "H": {"D": {"F": [[true]], "I": 2}, "E": {"I": {"C": {"C": {"E": {"G": {"C": false, "G": [null], "I": false}, "J": [false, [null, "D", {"F": 8, "H": null, "I": {"B": {"A": true, "G": false}, "J": false}}], "D"]}}}, "F": false}, "J": null}}}, false, {"B": "E", "F": {"F": {"A": {"B": {"G": {"I": {"D": {"E": {"G": true, "I": "G"}, "F": [{"E": 9, "I": null}], "J": false}, "J": {"I": {"B": {"A": "D", "E": 7, "I": null}, "I": true}}}}, "I": {"J": {"A": {"G": true}, "C": 1}}}, "H": {"B": 8, "H": false}}, "B": false}, "I": {"G": [0, true]}}, "H": {"C": {"C": {"D": {"D": true, "H": 0}}, "F": {"C": {"C": "D", "J": 1}}, "G": {"D": {"A": 3}, "F": {"C": false}}}, "D": null, "I": {"F": [{"I": true, "J": {"E": false, "H": true}}, [null, {"G": [false]}, "C"]]}}}], "I": {"B": [["A", {"B": 9}], false], "H": {"B": {"D": false, "G": {"H": {"H": {"G": false, "J": [null]}}}, "I": true}, "H": {"B": "H"}}}}}}, "I": {"A": 0, "G": {"C": [{"B": true, "C": 3, "F": null}, 4, {"I": {"B": "F", "D": "I"}}], "I": true}}}, false, {"D": [9, false, {"B": {"A": {"F": false}, "H": {"F": {"A": 9}}, "J": "E"}}]}], "D": {"B": 6, "H": "E"}}}}, "F"]}, false], "H": "H", "I": {"E": {"B": false, "H": false, "J": true}, "J": "C"}}, true, null], "G": null, "J": 6}, "H": false}}}, "E": null, "H": [{"J": {"A": {"A": {"D": {"B": "F", "E": true, "F": ["E", "D", "F"]}, "F": {"F": {"G": {"B": {"B": "B"}, "D": 2, "E": {"A": 2, "G": false}}, "H": {"A": [{"A": 0, "C": [{"D": {"F": {"B": 1, "G": {"D": false, "E": true}}, "I": 8}}]}]}}, "G": null}, "H": {"C": "A"}}, "B": 9, "D": [null]}, "B": null}}, true, {"C": 1}]}]}}, "E": "F"}, "J": {"C": {"B": [false, {"I": {"F": null, "H": "H"}}], "E": false, "H": {"D": false, "F": 9}}, "E": {"D": null, "G": null}, "H": false}}}':::JSONB::JSONB
        test_1        |                             AS " %pcol127601"
        test_1        |                 )
        test_1        |                     AS tab🙀67132
        test_1        |             ORDER BY
        test_1        |                 " %pcol127601" DESC NULLS FIRST
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1404.27s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #117263 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.14-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 9 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 8f14432835d667982828b5319cfd130991fbf80c:

        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (161.48s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1745920305/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("010300000000000000"),
        test_1        |             +   string("0103000000010000000500000000000000000020400000000000002240000000000000204000000000000010400000000000001C4000000000000010400000000000001C40000000000000224000000000000020400000000000002240"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         st_makeenvelope(8.0:::FLOAT8::FLOAT8::FLOAT8, 9.0:::FLOAT8::FLOAT8::FLOAT8, 7.0:::FLOAT8::FLOAT8::FLOAT8, 4.0:::FLOAT8::FLOAT8::FLOAT8)::GEOMETRY
        test_1        |                             AS col194977
        test_1        |                 )
        test_1        |                     AS "tAb123849"
        test_1        |             ORDER BY
        test_1        |                 col194977 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         st_makeenvelope(8.0::FLOAT8::FLOAT8::FLOAT8, 9.0::FLOAT8::FLOAT8::FLOAT8, 7.0::FLOAT8::FLOAT8::FLOAT8, 4.0::FLOAT8::FLOAT8::FLOAT8)::GEOMETRY
        test_1        |                             AS col194977
        test_1        |                 )
        test_1        |                     AS "tAb123849"
        test_1        |             ORDER BY
        test_1        |                 col194977 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (791.97s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #117263 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.14-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 9 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 8f14432835d667982828b5319cfd130991fbf80c:

        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        test_1        | I240130 06:22:10.912122 6 testutils/soon.go:42  [-] 1  SucceedsSoon: failed to connect to ``host=postgres user=postgres database=postgres``: dial error (dial tcp 172.18.0.4:5432: connect: connection refused)
        postgres_1    | CREATE EXTENSION
        postgres_1    | 
        postgres_1    | waiting for server to shut down...2024-01-30 06:22:10.996 UTC [50] LOG:  received fast shutdown request
        postgres_1    | .2024-01-30 06:22:10.997 UTC [50] LOG:  aborting any active transactions
        postgres_1    | 2024-01-30 06:22:10.999 UTC [50] LOG:  background worker "logical replication launcher" (PID 57) exited with exit code 1
        postgres_1    | 2024-01-30 06:22:11.002 UTC [52] LOG:  shutting down
        postgres_1    | 2024-01-30 06:22:11.114 UTC [50] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2024-01-30 06:22:11.218 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2024-01-30 06:22:11.218 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2024-01-30 06:22:11.218 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2024-01-30 06:22:11.222 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2024-01-30 06:22:11.227 UTC [69] LOG:  database system was shut down at 2024-01-30 06:22:11 UTC
        postgres_1    | 2024-01-30 06:22:11.232 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2024-01-30 06:22:13.104 UTC [79] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2024-01-30 06:22:13.104 UTC [79] STATEMENT:  CREATE TABLE "tabl\\U000E7331e1" (col1͒_0 BOOL NOT NULL, col1_1 TSVECTOR NOT NULL, "   col1_2" INTERVAL NOT NULL, col1_3 TIMESTAMPTZ NOT NULL, "co%vl😤1_4" OID NULL, "col😷1_\n5" REGTYPE NULL, col1_6 GEOGRAPHY NOT NULL, "col1_ 7" UUID NOT NULL, col1_8 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_3 IS NULL THEN e'\x00'::TEXT ELSE 'odu(Kq<'::TEXT END) STORED);
        postgres_1    |     CREATE INDEX ON "tabl\\U000E7331e1" (col1_3);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (606.59s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.18s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:172: CREATE TABLE "tabl\\U000E7331e1" (col1͒_0 BOOL NOT NULL, col1_1 TSVECTOR NOT NULL, "   col1_2" INTERVAL NOT NULL, col1_3 TIMESTAMPTZ NOT NULL, "co%vl😤1_4" OID NULL, "col😷1_\n5" REGTYPE NULL, col1_6 GEOGRAPHY NOT NULL, "col1_ 7" UUID NOT NULL, col1_8 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_3 IS NULL THEN e'\x00'::TEXT ELSE 'odu(Kq<'::TEXT END) STORED);
        test_1        |             CREATE INDEX ON "tabl\\U000E7331e1" (col1_3);
        test_1        |             
        test_1        |         compare_test.go:173: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (631.44s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #117263 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.14-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 9 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.0-rc @ 8f14432835d667982828b5319cfd130991fbf80c:

        postgres_1    |             FROM
        postgres_1    |                 postgres.public.table4 AS "|t\\uACC4ab100241"
        postgres_1    |         )
        postgres_1    |             AS "tab\\U0004EBBF100242"
        postgres_1    |     ORDER BY
        postgres_1    |         "c'ol150757" DESC NULLS LAST, col150758 ASC
        test_1        | --- FAIL: TestCompare (759.52s)
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     --- FAIL: TestCompare/postgres (154.14s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare3164955398/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   nil,
        test_1        |             +   string("0103000000010000000500000000000000008046C0000000000080464000000000008046C00000000000805640000000000000000000000000008056400000000000000000000000000080464000000000008046C00000000000804640"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_geomfromgeohash('G':::STRING::STRING::STRING, NULL::INT4::INT4)::GEOMETRY AS "\rc͉!o%47l150817")
        test_1        |                     AS tab100286
        test_1        |             ORDER BY
        test_1        |                 "\rc͉!o%47l150817" ASC NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_geomfromgeohash('G'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::GEOMETRY AS "\rc͉!o%47l150817")
        test_1        |                     AS tab100286
        test_1        |             ORDER BY
        test_1        |                 "\rc͉!o%47l150817" ASC NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (784.59s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #117263 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.14-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!