search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.13k stars 3.81k forks source link

compose: TestComposeCompare failed #119902

Closed cockroach-teamcity closed 7 months ago

cockroach-teamcity commented 8 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.3-rc @ ff5f4fb2c63a92c655ea0f9a5920c48885831d06:

        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     --- FAIL: TestCompare/postgres (0.00s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 228 [running]:
        test_1        | testing.tRunner.func1.2({0x226ec20, 0xc000e07ac0})
        test_1        |     GOROOT/src/testing/testing.go:1545 +0x238
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1548 +0x397
        test_1        | panic({0x226ec20?, 0xc000e07ac0?})
        test_1        |     GOROOT/src/runtime/panic.go:914 +0x21f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x46c7740?, {0x32013b8?, 0xc000e3fdd0?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:375 +0x436
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x31bfd00?, 0x46c7740)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:308 +0x12c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc000e64600)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:225 +0x7f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc000e3e2a0, {0xc000e3e2d0?, 0x3, 0xc000e3e2a0?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:258 +0x89d
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0x206dcc0?, 0x2471c5a?, {0xc000e3e2d0?, 0x49f9c88?, 0x2?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:96 +0x28
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc00077a000?, {0x2471c5a, 0x5}, 0x3, 0xc0?, {0xc000d8ba40, 0x3, 0x7f8066ec93c8?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x131
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0xc00209acc8?, 0x1?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:118 +0x15e
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc0005b8a00?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:98 +0x2f
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.init.wrapCommonSetup.func28(0x2657be8?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x1b
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000e5e000)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:143 +0xe2
        test_1        | testing.tRunner(0xc000e5e000, 0xc000e3e210)
        test_1        |     GOROOT/src/testing/testing.go:1595 +0xff
        test_1        | created by testing.(*T).Run in goroutine 11
        test_1        |     GOROOT/src/testing/testing.go:1648 +0x3ad
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 2
--- FAIL: TestComposeCompare (17.74s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #118616 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.1-rc] - #118615 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.15-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115745 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.0-rc] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

/cc @cockroachdb/sql-foundations

This test on roachdash | Improve this report!

Jira issue: CRDB-36375

cockroach-teamcity commented 8 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.3-rc @ 34956300dcaac0019d0aa3c9de40ed706a6d5e1c:

        postgres_1    |         col347456 NULLS FIRST,
        postgres_1    |         col347457 ASC NULLS LAST,
        postgres_1    |         "co*l347458" NULLS LAST,
        postgres_1    |         "\\uD49Bc😰ol347459" NULLS LAST,
        postgres_1    |         col347460 DESC NULLS LAST,
        postgres_1    |         "%qcol347461" DESC
        test_1        | --- FAIL: TestCompare (1002.41s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (397.37s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2641451319/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   nil,
        test_1        |             +   string("010100000000000000008036C00000000000803640"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_pointfromgeohash('E':::STRING::STRING::STRING, NULL::INT4::INT4)::GEOMETRY AS "co l347462")
        test_1        |                     AS "t̥aB314549"
        test_1        |             ORDER BY
        test_1        |                 "co l347462" NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_pointfromgeohash('E'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::GEOMETRY AS "co l347462")
        test_1        |                     AS "t̥aB314549"
        test_1        |             ORDER BY
        test_1        |                 "co l347462" NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1028.70s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #119903 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-rc] - #118616 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.1-rc] - #118615 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.15-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115745 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.0-rc] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.3-rc @ 320e36d59a29f6267f95f7944799f7f995e32292:

        postgres_1    |                 "%qtaB154287"."cOl1_5" AS "CoL\\x2c276786",
        postgres_1    |                 tab154288."col""1_2" AS col276787,
        postgres_1    |                 NULL::VOID AS "co%ql276788",
        postgres_1    |                 (tab154288."col1 _0"::FLOAT8 * tab154288."col1 _0"::FLOAT8)::FLOAT8 AS col276789,
        postgres_1    |                 "%qtaB154287".col1_͖😧7 AS "\\U00078886col276790"
        postgres_1    |             FROM
        postgres_1    |                 postgres.public.table1 AS "%qtaB154287", postgres.public.table1 AS tab154288
        postgres_1    |         )
        postgres_1    |             AS tab154289
        postgres_1    |     ORDER BY
        postgres_1    |         "co%qL276784" ASC,
        postgres_1    |         col276785 DESC,
        postgres_1    |         "CoL\\x2c276786" NULLS FIRST,
        postgres_1    |         col276787 DESC NULLS FIRST,
        postgres_1    |         "co%ql276788" ASC NULLS FIRST,
        postgres_1    |         col276789 ASC,
        postgres_1    |         "\\U00078886col276790" DESC
        test_1        | --- FAIL: TestCompare (830.11s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (224.93s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '{"G": {"A": {"F": {"G": [null, true, {"G": {"D": null, "G": {"F": true, "J": true}}}], "H": null}, "I": [[{"B": {"D": {"D": {"E": {"I": {"H": [{"C": true, "E": {"B": [{"C": null, "D": {"G": null, "I": {"A": {"C": {"B": {"A": ["C", {"D": {"A": "G", "B": false}, "J": "A"}], "F": true, "H": {"E": {"E": true, "I": null}}}}, "D": {"D": {"C": ["E", {"A": "A", "I": {"C": "I", "H": false}}, true], "D": true, "F": "B"}}}, "C": 5, "H": {"D": true, "F": {"D": 2, "F": false, "H": 0}, "G": {"C": {"D": null, "F": "C"}, "G": 0, "I": "J"}}}}, "G": 3}], "D": null}}, {"B": {"C": false, "D": {"A": null, "G": {"F": 9}, "H": {"G": {"B": [{"A": {"C": {"C": [{"A": null, "C": "F", "F": [null]}], "D": true, "H": false}, "D": "E"}, "D": {"F": false, "H": true}}, true, {"F": "E"}], "I": "C"}}}, "J": {"F": {"A": 4}}}, "I": "I", "J": [[{"C": 2, "G": {"D": {"B": {"A": false, "H": {"C": true, "E": {"D": {"B": null}}}}, "J": {"B": 2, "E": {"G": {"H": {"H": [{"D": {"C": 7, "I": {"D": {"D": {"F": [{"F": {"A": true, "C": null}}, 8], "I": true}, "G": 8, "I": true}}, "J": null}, "J": "H"}, false]}, "I": {"G": null, "I": {"H": "C", "I": {"B": "C"}}}, "J": {"B": {"A": false, "G": {"H": {"C": 1, "H": {"G": true}}}}, "D": true, "J": true}}, "H": {"E": {"C": 3, "E": {"D": {"H": "E", "I": {"G": 6}}}}, "G": "A", "I": {"A": {"B": true, "H": {"B": {"I": [2]}, "D": {"C": false}}, "J": {"E": {"A": {"D": null, "H": "C"}, "B": {"E": "H", "J": {"F": [true]}}}, "G": 5, "H": {"F": 9, "G": null, "H": "D"}}}, "F": {"E": "B"}, "G": [false]}}, "I": [{"B": false}, false]}, "G": null}}, "H": "J"}, "H": false}, {"B": "H"}, {"B": {"F": {"D": {"B": {"C": {"A": {"B": "E", "E": [[null, true]], "F": "C"}, "C": true}, "F": {"A": [[{"H": {"J": null}}, 6, {"I": {"D": [5, {"C": 8, "E": [{"B": 6, "E": [{"C": false, "H": {"D": 7, "H": true, "I": {"F": "D", "I": {"G": false, "J": {"A": {"C": "B", "H": "G", "J": {"C": 4, "J": "E"}}, "B": [{"B": "J", "F": {"A": 7, "B": false, "I": 1}, "I": "C"}], "I": false}}}}, "I": "D"}, true, {"A": [{"D": 2}]}]}, {"E": {"A": {"A": [null, null, "B"], "D": {"E": {"A": "G", "J": true}, "F": "E", "I": {"E": true, "F": [{"A": {"E": false, "G": {"A": {"H": false}, "F": [[{"D": 7, "I": {"C": {"E": null}, "E": null, "I": null}}, "F"], {"B": [{"F": [{"A": {"H": 9}, "E": [[{"B": null}], [{"B": {"C": [5, {"A": 4, "B": null, "I": {"A": 9, "I": null}}, {"D": true, "E": 2}]}}, [[[null, false]], null, {"F": null}]]]}], "H": [{"J": {"B": null, "H": true, "I": true}}]}], "E": 7}, {"A": true}], "I": false}}, "C": 8}, [{"C": {"A": "F", "E": ["H", {"E": "I", "I": true}], "G": null}, "E": {"E": {"J": "E"}, "G": true, "I": [true, {"A": true, "F": {"D": 4}}, 3]}}, {"B": true, "D": {"A": {"B": 1}, "C": {"B": true, "F": null, "J": {"A": {"A": [{"C": null, "E": ["E"], "I": false}], "J": {"A": 0, "I": false}}, "G": "J"}}}, "G": true}, {"A": false, "E": {"J": true}, "F": {"J": {"B": false, "F": {"E": {"B": {"C": {"D": true, "G": 3, "H": {"A": [4]}}}}, "G": [{"A": {"D": false, "H": false, "J": true}, "C": {"B": [true, {"G": {"B": 1, "H": {"J": {"B": {"H": null}, "C": false}}, "J": null}}, [false]]}}, {"G": true}]}, "G": "E"}}}]]}}, "H": ["G", "D", [{"G": 2}]]}, "E": false}, "J": true}], "G": {"D": ["C", {"B": false, "H": {"E": "D", "J": true}}], "F": 7}}], "H": {"B": false, "I": 5}, "J": false}}], true], "D": "G"}}, "G": {"F": [{"C": "D", "H": "G"}], "H": {"F": {"I": 5}}}}, "E": {"F": {"D": {"I": {"D": false, "H": true}}, "G": {"B": {"B": true, "E": {"B": {"E": "J"}, "F": null}, "F": {"I": {"B": "G"}}}, "E": false, "I": {"A": {"C": true}, "F": {"H": {"D": {"C": null, "D": null, "E": false}, "F": [{"A": true, "C": 5, "E": null}]}}}}, "J": {"B": 1, "F": {"A": null, "C": false}, "J": "E"}}}, "J": "F"}, "H": [null, true, 6]}, "F": {"I": null, "J": {"B": {"E": "J", "I": null}}}, "I": 7}], {"E": "B", "F": true, "G": {"B": "I", "G": false, "I": 7}}]}]}}}, "J": ["I", {"F": [false, [{"B": {"C": {"A": true, "H": true}, "E": {"B": [{"F": "B"}, null], "C": {"C": [{"D": {"I": {"H": {"J": {"E": {"B": "J"}, "G": 8}}, "I": {"G": [{"E": {"B": true, "G": "I"}}]}}}, "H": null}], "F": {"F": 5, "G": {"E": true}, "I": {"E": "I", "F": {"A": 6, "F": {"I": 0}}, "I": {"B": "F", "C": {"D": false, "E": {"E": {"A": false, "E": {"J": "H"}, "F": false}, "F": {"A": {"A": [[{"C": 6, "F": true}, [[null, false, null], true, {"C": [{"D": "C"}, {"H": false}], "F": [{"A": {"A": 2, "B": "D", "H": false}, "H": "C"}]}]], {"B": false, "C": "D", "G": "F"}], "B": {"E": 5, "G": null}}, "C": 5}, "G": true}, "F": {"E": {"E": {"J": {"C": false, "G": {"C": {"D": null, "H": {"B": {"A": "J", "D": [{"A": 3, "F": [{"C": {"H": "B"}}, [null, "F"], false]}, {"B": {"B": {"D": null, "H": 8}, "E": true, "H": 9}, "D": null, "J": {"B": "C", "G": {"A": {"A": {"F": {"F": false}, "I": "B"}, "B": {"G": "F"}}, "C": true, "H": {"H": "J"}}}}], "J": null}, "C": false, "D": {"D": {"H": [true, false, null]}, "F": false}}, "J": {"D": {"A": {"B": {"A": "H", "B": {"C": null, "D": null, "I": {"A": 8, "E": true}}, "H": false}, "C": 4, "E": {"A": {"A": 7, "C": null}, "E": "D", "H": {"E": {"B": [{"D": true, "F": false}, {"D": {"C": [{"A": {"E": null, "J": {"G": {"A": false, "F": {"D": {"A": [false, {"G": false}, {"C": {"B": {"F": [4, "F", null], "I": ["D"]}, "E": {"G": {"I": {"G": {"A": {"I": {"D": 6, "G": false, "H": [true, 8, 3]}}}, "H": {"G": false, "J": {"E": {"A": false, "D": {"I": {"D": {"D": {"A": 7, "E": "J", "I": {"C": false, "F": true}}, "G": null}}, "J": true}, "G": null}, "F": 4, "G": [{"F": {"F": true}}, "A"]}}}}}, "H": {"C": "B", "E": {"B": {"A": "J"}, "E": null}, "F": ["I", {"F": false}, {"B": "F", "E": 8, "J": {"H": {"A": null, "C": {"E": {"F": "E"}}}, "J": false}}]}}, "F": false}], "I": "C"}, "F": false}}, "I": "D"}}}], "D": {"F": {"B": [true, null, {"E": {"B": {"G": 1}, "C": {"E": false, "G": {"A": 7, "E": {"B": {"H": null}, "J": null}, "H": null}}}, "F": null, "H": null}], "D": true}, "H": {"D": true}, "I": true}}, "J": "F"}]}, "I": {"D": true}}}}, "G": false}, "J": {"E": {"I": false}, "I": false}}}, "G": "C"}, "H": 6}}, "G": {"C": {"C": true}, "H": {"B": 0, "D": "H"}, "I": {"H": {"A": "D", "E": {"C": null, "D": false}}}}, "I": true}, "F": {"H": {"J": null}}, "H": {"I": 1}}}, "E": {"C": {"G": {"E": {"H": true}, "I": "J"}, "I": {"H": {"C": false, "F": true, "J": {"C": 8, "D": 5, "I": {"D": {"A": [[{"B": {"E": {"E": "E", "F": [{"A": 5}], "G": {"F": null, "I": true, "J": 2}}, "G": {"D": false, "E": {"B": false, "F": false, "H": {"J": 6}}, "I": {"C": true, "E": ["F", "F"], "F": {"B": "G", "H": {"B": {"B": {"A": true, "H": null}, "E": "D"}}, "I": false}}}, "H": {"A": "E"}}, "G": {"A": [{"J": [7]}, ["E", 3], {"E": null, "G": "H"}]}}, {"I": "J"}], true], "B": true}, "J": {"A": {"E": "D", "G": false, "I": "J"}, "B": {"A": true, "G": {"A": "G", "H": false, "J": true}, "H": true}}}}}}}, "D": {"C": false}}}}}}, "H": {"H": {"A": {"E": {"A": [{"E": {"A": true, "D": {"E": 4, "F": {"C": 1, "F": {"D": 6, "F": {"A": null, "I": [true], "J": {"A": {"E": true}, "B": "C", "J": {"F": {"B": {"B": {"D": 0, "E": [null, null]}, "E": [6, true], "G": {"A": 0, "D": {"F": {"B": {"A": {"A": 1, "C": {"A": ["I"], "E": [false], "I": {"D": {"C": {"F": {"B": 3, "C": false}}, "F": 5}}}, "H": {"D": {"B": {"B": {"A": {"F": {"B": true, "D": false, "I": 3}}, "B": "J"}, "J": ["H", "D"]}, "I": [false, 9, "G"]}, "H": {"A": "G", "C": {"E": {"B": {"A": {"B": false, "H": false}}, "D": "G", "H": {"C": null, "D": false, "G": "E"}}}}, "J": {"H": {"A": {"G": 9}, "C": "H"}}}}, "E": [{"A": {"D": false, "G": true}, "H": {"C": 2, "G": 7}}, "E", {"G": "F", "J": "C"}], "H": {"C": {"B": {"C": {"C": {"D": 1}, "E": 6, "H": {"I": {"C": {"B": true, "H": 4}, "D": {"A": null, "D": {"D": {"B": {"A": {"I": null}, "H": {"B": [{"B": false}, "A"]}}, "D": {"C": {"B": {"A": null, "B": {"C": true, "I": 2}, "E": true}, "J": {"E": {"B": {"C": "G"}, "G": {"B": 9, "G": true, "J": false}, "H": {"H": {"F": null, "G": null, "I": null}}}, "G": "H", "H": "J"}}, "H": {"A": false, "C": {"F": false}}, "J": "A"}, "J": {"B": {"E": {"A": true, "I": {"D": {"I": "A"}}}, "H": {"A": {"A": [[null, false], true], "E": {"B": false, "C": {"D": {"B": null}, "I": {"A": {"B": null, "F": false}, "F": 7, "J": false}}, "I": null}}, "J": [{"C": {"A": {"G": {"G": {"E": {"C": "B", "H": {"J": true}, "I": {"D": true, "E": {"B": {"E": "B"}, "E": false}}}}, "I": false}}, "G": {"E": true, "J": {"I": {"A": {"A": {"C": false, "I": "D"}, "C": 9}, "E": false, "G": {"J": null}}}}}, "D": {"A": {"A": 7, "G": [[[[7], {"A": false, "G": true}], false], null, true], "H": {"E": "E", "I": null}}, "J": {"E": {"F": [{"D": false}, {"G": 0, "H": 0, "I": {"A": {"C": false, "H": null}, "F": [{"F": {"A": false, "C": 8}, "H": {"D": null, "E": 8, "F": "G"}}], "G": 5}}]}, "H": "E"}}, "E": {"D": {"D": [{"A": {"B": {"D": {"A": {"I": {"B": "C", "F": "D", "I": "H"}}, "G": {"C": {"H": 3, "J": 5}, "H": [null, "H", {"D": true}]}, "H": {"C": {"H": {"C": {"A": "G", "H": "J", "I": {"B": false}}, "H": {"C": [{"B": false, "J": {"B": null}}, null, 9], "H": {"C": [{"C": {"E": {"C": false, "F": true, "I": {"J": {"A": {"F": false}, "D": {"B": [[{"A": "A", "C": false, "H": {"D": "H", "J": [{"D": null, "F": "J", "G": true}, false, {"A": false, "C": 3}]}}, false, {"A": true}]], "E": "C", "I": {"A": false, "B": null, "H": {"B": true, "C": [true], "D": {"A": {"B": "A", "I": null}, "B": 7}}}}}}}, "F": ["B", {"J": {"C": "B"}}]}, "E": false, "F": {"E": {"C": {"C": null, "F": 4, "I": false}, "I": {"G": "F"}}, "I": [{"E": {"G": {"B": {"B": [[null, [{"B": {"A": {"H": [true, false]}}, "I": {"D": {"D": null, "H": {"B": null, "I": {"B": false, "F": {"C": null, "I": true, "J": {"B": true, "C": null}}, "G": 7}}, "J": {"G": false}}, "I": true}, "J": true}, [["J"]], {"F": "G", "J": false}]]]}, "C": {"A": null}}, "I": null, "J": null}, "G": false}, false]}}, 6], "F": {"A": {"A": null, "I": 6, "J": "A"}, "G": "J", "J": "E"}, "G": 2}}}}, "F": {"F": null}, "G": {"F": {"C": {"B": {"G": 8, "J": 4}, "F": false, "J": null}, "I": 5}, "G": 7}}}, "H": [null]}, "D": null, "I": {"B": 0, "D": false, "H": null}}, "F": "J", "H": 4}, {"C": null, "G": false}, {"F": 3}], "G": null}}}, {"F": "G"}]}}, "E": {"H": "F"}}}}, "F": false}}}}, "F": [{"B": false}, [true]], "H": "C"}, "E": false, "H": {"J": {"F": [null, {"G": true}], "G": {"B": {"G": false}}, "J": 6}}}, "G": {"A": {"A": {"B": 0, "C": null, "D": "E"}, "G": {"F": {"C": 5, "F": null, "H": {"C": [{"F": null}, {"A": 6, "D": [false]}, "I"]}}, "I": {"D": {"F": 9, "H": [{"B": {"A": null, "I": {"C": "A", "I": null}}, "F": true}, null]}}}}}}}, "I": true}}, "F": {"C": {"A": {"A": [false], "G": false, "I": [null]}, "H": null}, "G": 4, "I": {"C": ["H", false, true]}}}}}, "J": [9]}}}}, "G": false}}, "J": {"F": false, "G": 6, "H": {"A": {"D": {"A": [true, "B", {"B": {"G": false}, "H": "D"}], "D": false}, "G": {"D": [{"E": {"C": 7, "H": {"H": false}}}, ["D", {"C": "B", "E": "C", "F": 6}, {"B": {"A": {"H": null}}}], {"B": {"E": {"F": {"E": true}, "H": false}, "G": false, "H": false}, "D": null}], "F": 1, "H": {"H": 9}}, "J": null}, "B": {"G": "C", "H": null, "I": true}, "F": false}}}}]}, "F": {"E": "J", "G": [{"D": 1, "E": null}], "H": [[{"B": "J", "D": {"B": "B", "D": [true, {"C": 4, "G": {"I": {"B": {"B": {"A": {"A": true}, "H": [{"D": true}, 8]}, "I": null}, "C": {"B": true, "C": true}, "J": {"E": true, "J": {"D": {"A": {"A": {"B": {"G": [3]}, "D": {"B": {"G": {"D": {"F": false, "I": 0, "J": 8}, "H": 8, "J": null}}, "E": {"C": {"B": {"D": 6, "I": {"C": 7, "F": "C", "I": null}}, "D": false, "E": null}, "I": "D"}, "J": false}, "I": {"B": false, "H": {"B": [{"A": true, "H": {"E": {"C": {"C": null}, "H": false}, "H": false}}, {"E": "C", "I": {"D": "I"}}, [null]], "E": true}}}}, "F": null}, "H": [[{"D": {"C": {"I": {"D": true, "F": null}}, "D": true, "J": "D"}}, null, true]]}}}, "J": null}, "H": [true, {"B": "D", "C": "F", "I": [{"J": {"E": true, "F": [{"I": true}, false, {"A": [{"G": {"E": {"D": 3, "F": {"I": {"E": [2, true], "J": "F"}}, "J": "F"}, "H": false}, "I": {"A": ["H", {"A": null, "D": "I", "H": {"A": {"A": {"B": 0, "E": null, "F": 3}, "C": {"I": 0}, "I": [true, true]}, "C": {"D": {"F": "J"}}, "H": [{"A": false, "J": "G"}, true]}}, true], "G": false, "J": {"H": true}}}, {"D": {"B": ["A", [8], "J"]}, "I": "C"}, true], "B": {"E": true, "I": [true, null, 6]}, "G": {"E": true, "H": {"D": false, "I": [true], "J": true}}}], "H": {"A": 2, "D": {"A": "D", "F": {"J": false}}, "E": {"B": true}}}}, {"D": [false, {"G": null}, {"A": {"B": false, "D": null}, "D": "F", "E": {"I": {"C": {"H": [{"C": {"B": {"G": {"E": null, "I": 4}, "H": "J"}, "F": [{"D": {"C": {"F": true}, "E": true, "I": false}}], "H": true}}]}, "E": {"D": true, "F": null}, "J": true}}}], "H": true}, null]}, 8]}], "E": false}, "J": {"E": null}}]]}}}}}, "H": null}, "D": {"B": {"F": 4, "H": null}, "C": [{"D": true, "F": false, "I": 1}, false], "E": true}, "H": {"B": {"A": {"E": {"D": [{"I": null}, "A"]}, "G": false}}}}, "H", false], 2], "J": false}, null]}}, "J": {"G": false}}, {"A": [{"F": false, "H": {"C": {"A": {"E": {"A": true, "C": {"C": false}, "I": {"D": 4, "I": true, "J": "G"}}, "H": {"F": false}, "I": [[{"B": "J", "D": "I"}], [{"C": [{"D": {"D": true}}], "I": false, "J": {"F": [4], "I": [0]}}, {"E": true}, true]]}, "F": {"B": true, "J": false}, "J": {"A": "I", "D": true, "F": {"B": true, "G": {"F": "E", "G": null, "J": null}}}}}}, false], "D": {"J": {"A": true, "G": "C", "H": {"E": {"D": {"E": false, "J": "J"}, "G": {"A": [{"A": null, "F": "E", "G": false}, "H"], "B": false, "F": "C"}, "J": null}, "G": {"I": {"C": false, "G": false, "I": {"A": {"J": null}}}}, "J": {"F": "E"}}}}, "G": [null]}, true]], "J": 7}}, "J": false}':::JSONB::JSONB
        test_1        |                             AS col276791,
        test_1        |                         '::6/0':::INET::INET AS col276792
        test_1        |                 )
        test_1        |                     AS "ta'b154290"
        test_1        |             ORDER BY
        test_1        |                 col276791 ASC NULLS LAST, col276792 ASC NULLS LAST
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (854.97s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #119903 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-rc] - #118616 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.1-rc] - #118615 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.15-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115745 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.0-rc] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.3-rc @ 320e36d59a29f6267f95f7944799f7f995e32292:

        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2024-03-11 05:21:03.348 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2024-03-11 05:21:03.348 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2024-03-11 05:21:03.348 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2024-03-11 05:21:03.352 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2024-03-11 05:21:03.357 UTC [68] LOG:  database system was shut down at 2024-03-11 05:21:03 UTC
        postgres_1    | 2024-03-11 05:21:03.362 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2024-03-11 05:31:06.339 UTC [98] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2024-03-11 05:31:06.339 UTC [98] STATEMENT:  CREATE TABLE "\\uD3C4t able1" (col1_0 REGROLE NULL, "co%cal1_1" TIME NOT NULL, col1_2 PG_LSN NOT NULL, col1_3 INT2 NOT NULL, "co""l1\n_4" DATE NOT NULL, "coL1_5" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_2 AS TEXT))) STORED, PRIMARY KEY (col1_2, "co%cal1_1"));
        postgres_1    |     CREATE INDEX ON "\\uD3C4t   able1" ("coL1_5" ASC) INCLUDE (col1_3);
        postgres_1    |     CREATE UNIQUE INDEX ON "\\uD3C4t    able1" ("coL1_5" DESC, lower(CAST(col1_2 AS TEXT)) ASC) INCLUDE (col1_0);
        postgres_1    |     CREATE UNIQUE INDEX ON "\\uD3C4t    able1" ((CASE WHEN col1_0 IS NULL THEN 'f'::TEXT ELSE e'\x00'::TEXT END) ASC) INCLUDE (col1_0, "co""l1\n_4");
        postgres_1    |     CREATE INDEX ON "\\uD3C4t   able1" ("co""l1\n_4" DESC, col1_2 ASC);
        postgres_1    |     CREATE INDEX ON "\\uD3C4t   able1" (col1_3 DESC);
        postgres_1    |     CREATE UNIQUE INDEX ON "\\uD3C4t    able1" (col1_0 ASC, col1_3 ASC) INCLUDE ("co""l1\n_4");
        postgres_1    |     CREATE UNIQUE INDEX ON "\\uD3C4t    able1" ((col1_3 + 15008::INT8) ASC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (606.36s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.29s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:172: CREATE TABLE "\\uD3C4t able1" (col1_0 REGROLE NULL, "co%cal1_1" TIME NOT NULL, col1_2 PG_LSN NOT NULL, col1_3 INT2 NOT NULL, "co""l1\n_4" DATE NOT NULL, "coL1_5" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_2 AS TEXT))) STORED, PRIMARY KEY (col1_2, "co%cal1_1"));
        test_1        |             CREATE INDEX ON "\\uD3C4t   able1" ("coL1_5" ASC) INCLUDE (col1_3);
        test_1        |             CREATE UNIQUE INDEX ON "\\uD3C4t    able1" ("coL1_5" DESC, lower(CAST(col1_2 AS TEXT)) ASC) INCLUDE (col1_0);
        test_1        |             CREATE UNIQUE INDEX ON "\\uD3C4t    able1" ((CASE WHEN col1_0 IS NULL THEN 'f'::TEXT ELSE e'\x00'::TEXT END) ASC) INCLUDE (col1_0, "co""l1\n_4");
        test_1        |             CREATE INDEX ON "\\uD3C4t   able1" ("co""l1\n_4" DESC, col1_2 ASC);
        test_1        |             CREATE INDEX ON "\\uD3C4t   able1" (col1_3 DESC);
        test_1        |             CREATE UNIQUE INDEX ON "\\uD3C4t    able1" (col1_0 ASC, col1_3 ASC) INCLUDE ("co""l1\n_4");
        test_1        |             CREATE UNIQUE INDEX ON "\\uD3C4t    able1" ((col1_3 + 15008::INT8) ASC);
        test_1        |             
        test_1        |         compare_test.go:173: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (630.69s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #119903 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-rc] - #118616 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.1-rc] - #118615 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.15-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115745 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.0-rc] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.3-rc @ f4c2eb53ede2622071ec05ce72de77da7b4e5a7b:

        test_1        |                 "�co
        test_1        |             l116470" DESC
        test_1        |         compare_test.go:213: postgres: ping: conn closed
        test_1        |     --- FAIL: TestCompare/mutators (0.00s)
        test_1        |         compare_test.go:141: starting test: mutators
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 150629 [running]:
        test_1        | testing.tRunner.func1.2({0x226ec20, 0xc000687060})
        test_1        |     GOROOT/src/testing/testing.go:1545 +0x238
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1548 +0x397
        test_1        | panic({0x226ec20?, 0xc000687060?})
        test_1        |     GOROOT/src/runtime/panic.go:914 +0x21f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x46c7740?, {0x3201398?, 0xc0014b95c0?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:375 +0x436
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x31bfce0?, 0x46c7740)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:308 +0x12c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc000202a80)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:225 +0x7f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc00146dd10, {0xc00146dd40?, 0x3, 0xc00146dd10?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:258 +0x89d
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0x206dcc0?, 0x2471c5a?, {0xc00146dd40?, 0x0?, 0x2?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:96 +0x28
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc001471710?, {0x2471c5a, 0x5}, 0x3, 0xc0?, {0xc0014b7a40, 0x3, 0x7fcbe53aa108?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x131
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0xc0014b7cc8?, 0x1?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:118 +0x15e
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc000c19500?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:98 +0x2f
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.init.wrapCommonSetup.func28(0x2657be8?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x1b
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000b7b860)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:143 +0xe2
        test_1        | testing.tRunner(0xc000b7b860, 0xc00146dc80)
        test_1        |     GOROOT/src/testing/testing.go:1595 +0xff
        test_1        | created by testing.(*T).Run in goroutine 9
        test_1        |     GOROOT/src/testing/testing.go:1648 +0x3ad
        compare_test_1 exited with code 2
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 2
--- FAIL: TestComposeCompare (499.64s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #119903 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-rc] - #118616 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.1-rc] - #118615 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.15-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115745 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.0-rc] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.3-rc @ 03498e5964c0eaa45bb5435b4c600de38d542910:

        postgres_1    |                 false::BOOL
        postgres_1    |             ORDER BY
        postgres_1    |                 tab68334."co\\U00010419l3_16" DESC, tab68334.col3_2 DESC NULLS LAST, tab68334.col3_7 DESC NULLS LAST
        postgres_1    |         )
        postgres_1    |             AS tab68335
        postgres_1    |     ORDER BY
        postgres_1    |         """col%42113115",
        postgres_1    |         "coL113116" ASC NULLS LAST,
        postgres_1    |         col113117 ASC,
        postgres_1    |         col113118 DESC,
        postgres_1    |         "c' ol113119" NULLS LAST,
        postgres_1    |         col113120 ASC,
        postgres_1    |         col113121 ASC,
        postgres_1    |         col̪113122 ASC NULLS LAST,
        postgres_1    |         col😗113123 DESC,
        postgres_1    |         col113124 NULLS FIRST,
        postgres_1    |         col113125 ASC
        test_1        | --- FAIL: TestCompare (773.05s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (167.70s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '00000000-0000-0000-0000-000000000002':::UUID::UUID AS col113151,
        test_1        |                         '{"E": {"E": [{"D": 6}, {"F": 2, "I": "B"}, {"A": {"A": null, "H": {"C": {"A": 4, "F": null, "J": {"C": [{"F": ["G", true, {"C": 4, "D": {"E": true}, "J": {"C": 7, "E": {"C": null, "D": [{"C": true, "H": {"A": ["D", {"C": 7, "D": {"A": {"G": "I", "H": {"B": false}, "I": false}, "C": [[{"F": {"I": {"G": {"D": false, "I": [{"C": false, "D": {"C": 1, "H": 9}}, true, [false, [["A", null], true], {"J": [{"C": {"C": {"F": {"F": "J", "H": "A"}, "H": true}, "D": {"E": {"G": {"I": "J"}, "I": 9}}}, "E": {"A": false, "D": 6, "E": false}, "H": [1, {"D": "I", "I": {"C": {"C": {"D": true}, "F": {"E": false, "F": {"D": {"C": "E", "I": false, "J": {"B": {"C": true, "G": true}, "G": 5}}, "E": {"G": null, "H": {"D": {"B": 0, "C": 0, "J": true}, "H": 5}}, "J": {"A": {"F": {"H": 4}}, "C": {"E": "D"}}}}}}, "J": {"F": 1}}, {"A": {"J": true}, "B": {"G": {"D": 3}}}]}, "J"]}]]}, "I": {"A": true, "D": "F"}}}, "J": null}], "I", {"A": {"B": {"B": true, "F": 0}, "C": {"E": 4}, "H": true}}]}}, {"F": {"B": {"E": true, "H": {"G": {"I": [0]}, "I": {"C": null, "E": {"E": 0, "G": {"C": "H"}}}}}, "I": null, "J": {"D": 1, "E": 3, "H": {"C": {"J": [{"C": [true]}]}, "E": null, "H": null}}}, "G": "I"}], "C": {"A": {"C": {"A": {"A": {"E": 0, "H": {"D": {"A": {"C": false}, "C": {"G": ["F", "A", true], "H": [{"G": "G", "I": {"A": {"E": null}, "H": {"G": {"A": {"G": null}, "I": {"B": null}}, "H": ["H", false, {"F": [true, 9, {"A": false}], "G": {"I": {"B": false}}}], "J": null}}}], "I": 1}, "G": {"A": {"F": true, "J": null}, "G": null}}, "F": "B", "J": 7}, "J": {"F": {"H": 6, "I": {"B": "J", "E": {"C": {"C": {"G": {"A": "F", "D": false, "E": 6}, "I": [false, {"E": {"D": {"B": true}, "F": {"I": {"B": {"B": "C"}, "F": true}}, "J": {"C": false, "E": [{"A": null, "F": null, "I": {"F": "H", "G": false}}]}}, "G": {"G": [{"B": true}, 5, false], "H": [{"G": {"C": null, "G": {"A": {"C": false, "E": false}, "B": "A", "D": [null]}, "J": true}, "J": {"F": {"B": {"E": {"B": [{"E": null}], "D": {"E": null, "G": {"B": null, "E": true}}}, "G": {"D": {"B": true, "I": {"A": {"G": "E", "I": {"G": {"D": false, "G": false}}, "J": 2}, "H": {"A": {"E": {"A": [{"H": {"D": {"C": [[{"E": {"A": {"H": false, "I": null}, "F": true}, "H": true}, [{"E": null, "G": 3, "J": {"G": {"H": {"F": true}, "J": "I"}, "J": {"B": [{"J": true}, 5, {"I": 1}], "E": {"B": {"A": 1}, "C": false, "H": "F"}}}}], null], 8], "G": {"C": true}, "H": {"D": {"B": {"D": {"C": 3}, "E": true}, "C": null}, "F": true, "H": "I"}}, "E": 9}, "J": true}, false, 8], "F": {"G": 4}}, "F": [2]}}}}}, "H": {"G": null, "I": {"D": {"A": true, "B": {"D": [{"A": {"B": null, "D": {"B": "G", "C": null}}, "I": [{"A": [{"E": [{"G": {"A": {"C": {"A": {"J": 6}, "D": null}, "E": {"F": "J", "H": [null, null, null]}, "I": {"C": {"E": false}, "D": {"A": {"E": null, "G": "A", "J": false}, "I": null}}}}}, {"B": "A", "E": true, "F": {"C": "H", "D": false, "F": true}}, {"B": null}]}, [false], {"B": {"B": {"A": "J", "G": {"D": {"C": false, "G": "C", "J": null}, "F": {"I": false}}, "J": {"F": {"E": null}, "G": {"C": {"F": {"A": false, "C": "B", "J": false}}, "F": {"A": false, "B": 3}}}}, "E": {"G": {"F": {"A": {"E": 4, "G": 4, "J": 3}}, "H": null, "J": {"A": {"D": {"A": "B", "E": 0}, "H": true}, "B": {"E": "J"}, "C": {"A": false, "E": null, "J": {"D": 3}}}}}}}], "E": {"C": {"G": null, "I": {"A": null, "F": 6, "I": true}}, "J": {"A": {"F": {"C": {"D": true, "E": 7, "J": {"D": {"E": {"I": {"A": false}, "J": true}, "H": {"H": 6}}, "J": {"A": {"C": {"B": 5, "D": {"B": true, "H": 1}, "F": {"C": [false], "I": {"B": true}}}, "E": {"A": false, "C": true, "G": {"A": null, "I": "G"}}}, "I": false}}}, "D": null, "J": "H"}, "I": [{"A": null, "D": false}]}, "B": "G", "D": null}}, "J": {"H": 5}}, {"A": {"F": 6, "H": false, "J": "A"}, "D": "D"}, true]}], "I": 4}}}}}, "D": {"A": null, "G": [{"D": [[{"C": {"D": {"E": {"A": {"A": {"I": {"D": false}, "J": [4]}}, "E": {"C": [false, null, {"E": null, "J": {"B": [9, null, [[{"A": 7, "G": "C"}, "D"]]], "G": {"D": {"B": {"C": "J", "I": "C"}, "D": null, "H": true}, "E": {"C": [false, {"E": null, "G": 4, "H": [[{"G": 7}, {"B": false, "D": false}, 4], {"D": {"I": {"G": null}}, "F": {"A": {"C": [{"B": false, "H": {"D": "F", "G": {"A": true, "G": 4}, "J": false}, "J": [false]}, false, false], "H": null}, "E": {"H": {"G": {"J": {"A": ["D", false]}}, "I": true}}, "H": {"A": {"B": false, "G": false}, "E": [{"D": {"F": "D"}, "E": true, "I": false}]}}, "I": 0}, true]}], "D": false, "H": true}}, "J": true}}], "D": null}, "H": 9}, "G": null, "H": {"C": false}}}}, {"G": [{"A": [null, [true, {"B": {"G": 1, "I": {"F": {"A": ["G", 6], "I": false}}}, "C": true}]], "G": 1}]}, 3], {"E": {"A": "G", "E": {"I": null}}, "F": {"G": "F", "I": true}, "J": 3}]}, {"B": {"F": 4}, "E": null, "H": {"B": {"A": {"B": [{"A": {"A": {"I": {"J": [0]}}, "I": "B"}, "F": true}], "C": false, "H": [3, {"C": 7, "E": {"B": false, "D": true, "G": [{"G": {"E": 1, "I": true}, "I": {"G": {"F": false, "H": {"B": true, "C": [{"D": {"J": {"E": [false, {"H": [{"A": [3, {"B": true, "F": [true, [true, [{"G": {"C": true, "F": {"C": {"B": {"A": {"D": false, "J": {"E": true, "F": null}}, "C": {"G": true}, "H": "D"}}, "F": true, "G": null}, "G": true}}, {"F": {"D": ["G"], "I": true}, "H": null, "J": 9}, 2]]], "H": {"A": "G", "D": {"F": null}}}, {"B": 0, "D": true}], "C": 8, "G": {"A": {"A": {"J": {"A": [{"H": true, "J": "F"}], "I": {"B": {"E": {"A": {"G": null}, "D": 8, "J": {"G": true}}, "G": false}}}}}, "D": {"A": {"A": null}, "C": true, "F": true}}}]}], "G": "H"}}}]}, "J": [null, true, {"D": null, "G": null}]}, "J": true}, "J": {"A": {"D": [["A", "H"]]}, "C": true, "H": "E"}}, [{"B": {"E": 3}, "F": {"D": true}, "H": false}]]}, "I": false}, {"E": null}]}, "C": "A", "J": false}}}, false]}, "H": {"E": true, "F": ["G", 3, {"C": false}], "J": {"C": {"B": {"A": ["A"]}, "C": null}, "D": 7, "J": {"H": [{"E": {"A": {"A": 2}, "H": true}, "I": {"I": [1]}}, {"E": {"E": [1]}, "G": {"B": null, "C": {"C": {"B": {"J": {"A": {"C": {"A": [{"F": false, "H": "F"}], "B": false, "D": true}}}}}}}, "H": "F"}], "I": "C"}}}}, "G": 2}}, false]}}, [{"A": {"J": "E"}, "I": 9}]]}, "D": {"D": {"F": false, "H": 2}}, "J": "G"}, "I": {"C": "A", "G": 7}}, "J": null}, "J": {"A": 4, "B": {"F": true, "G": null, "H": {"C": {"B": {"B": {"C": "G", "G": false, "J": {"B": true, "J": false}}, "F": null}}, "D": {"F": {"A": {"G": {"H": {"G": "E"}}}, "B": false}, "G": {"D": 0}, "J": 9}, "E": "G"}}}}, "I": 6}}, "E": true}, "D": {"B": {"F": "A"}, "C": {"H": {"B": {"H": {"A": {"H": null, "I": [8, {"H": {"C": {"G": {"C": {"H": [true, false]}, "D": {"C": true, "F": 6}, "E": ["I", {"E": {"C": true}, "J": {"A": null, "E": 6, "I": "F"}}, {"C": false}]}, "H": {"C": {"G": {"H": "G"}, "H": false, "J": {"F": false}}, "D": {"F": null, "J": [{"D": 4, "F": {"B": [[9, 2]], "C": {"B": 7, "D": {"D": false, "E": {"B": ["A", {"A": true}, "E"], "G": {"F": 7, "H": [{"D": [false, {"G": [false]}, false], "I": {"A": {"C": null, "H": [true, {"A": {"D": {"D": {"A": {"G": {"E": {"A": {"E": "A"}, "I": null}, "J": [{"G": {"E": false, "I": {"F": {"B": {"C": false}, "D": {"A": 3, "G": [5], "H": false}}, "I": null}}, "I": true}, true]}}}, "E": {"C": 5}, "I": true}, "G": null}, "H": [{"A": {"I": {"C": "C", "F": false}}, "B": {"A": {"A": 3, "H": {"E": "J", "I": null}}, "I": {"C": true, "D": ["D", {"A": null, "G": 6}, {"F": [false]}], "F": null}}, "J": {"E": 4}}, {"D": {"B": {"H": {"E": {"D": true, "G": "E", "J": {"F": true}}}, "I": {"A": 0, "I": {"A": 4, "D": [true]}}, "J": false}, "C": 1, "I": true}}], "J": {"C": {"A": {"A": {"A": {"J": false}}, "D": null, "I": true}, "D": {"A": "J", "B": 7}}, "G": [{"F": {"D": "D", "I": {"B": false, "D": "F"}}, "J": null}], "H": 1}}]}, "D": 0, "G": false}}, 6]}, "H": [null]}}, "J": false}, "H": 4}}, true, [false, 4, null]]}, "I": true}}, "G": {"A": 1}}, "J": {"D": null, "F": {"F": {"E": [6]}, "I": null}}}, null]}, "C": {"C": true, "F": [null, {"E": {"B": false, "E": {"A": "A", "D": false}, "G": 5}}, {"B": "I", "H": {"C": [{"C": null, "G": {"D": [[{"C": true}, null]], "G": [7, "B"]}}, true], "F": true}}], "I": 7}}, "J": false}, "G": true}}, "J": {"D": true, "H": {"C": {"D": [{"B": 0}, {"D": true, "F": {"F": {"D": {"D": {"D": null, "I": 3}, "H": {"A": "G", "F": [[{"H": {"I": {"G": false, "I": null}}}], "H", [{"C": {"B": {"B": false, "G": true}}, "D": {"B": null}, "J": {"B": null, "C": true}}]]}}, "E": null, "G": true}, "I": true}, "I": ["I"]}, {"F": {"B": {"B": false}, "G": true, "I": null}}]}}}}}, "D": null, "G": {"C": {"I": {"A": true, "J": {"H": {"I": {"D": 5}}}}}, "G": {"D": [[[null, {"G": "J", "J": [9, "B"]}], [1, true, {"B": 4, "J": "F"}], {"F": {"C": {"A": {"A": true, "C": 2, "I": true}, "H": false}}, "G": {"H": 9}}]], "F": {"D": {"C": "I", "H": "H"}, "H": "C"}}}}, "B": {"B": false, "F": null, "H": {"G": {"D": {"H": false}}, "I": {"E": true, "I": {"C": {"G": {"A": true, "E": false}}}, "J": {"G": 1}}, "J": {"J": [2, true, null]}}}, "C": false}}, "J": true}, false], "G": null}, "G": {"E": null, "F": 1}}}], "G": 5}, null, {"F": false, "J": true}], "E": {"D": false}, "I": [{"A": true, "I": {"D": 2, "F": "D", "G": {"E": null, "G": "B"}}}]}}, "G": false}, "J": false}, "E": {"G": null}, "G": {"C": "D", "I": [{"I": false, "J": {"C": null, "I": [true, [2, {"E": true, "I": {"E": true, "J": {"A": false}}}, 0], {"E": {"J": false}, "I": {"G": false}}], "J": true}}, 2, "D"]}}], "H": {"D": 5, "H": "E"}, "J": true}, "I": false}':::JSONB::JSONB
        test_1        |                             AS col113152
        test_1        |                 )
        test_1        |                     AS tab68352
        test_1        |             ORDER BY
        test_1        |                 col113151 NULLS FIRST, col113152 DESC NULLS LAST
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (798.42s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #119903 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-rc] - #118616 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.1-rc] - #118615 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.15-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115745 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.0-rc] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.3-rc @ 03498e5964c0eaa45bb5435b4c600de38d542910:

        cockroach2_1  | storage engine:      pebble
        cockroach2_1  | clusterID:           85d8a2e1-0307-4279-8be4-d579cef4cd38
        cockroach2_1  | status:              initialized new cluster
        cockroach2_1  | nodeID:              1
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | 
        postgres_1    | waiting for server to shut down...2024-03-18 05:21:19.378 UTC [49] LOG:  received fast shutdown request
        postgres_1    | .2024-03-18 05:21:19.379 UTC [49] LOG:  aborting any active transactions
        postgres_1    | 2024-03-18 05:21:19.381 UTC [49] LOG:  background worker "logical replication launcher" (PID 56) exited with exit code 1
        postgres_1    | 2024-03-18 05:21:19.384 UTC [51] LOG:  shutting down
        postgres_1    | 2024-03-18 05:21:19.477 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2024-03-18 05:21:19.500 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2024-03-18 05:21:19.500 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2024-03-18 05:21:19.500 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2024-03-18 05:21:19.504 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2024-03-18 05:21:19.509 UTC [68] LOG:  database system was shut down at 2024-03-18 05:21:19 UTC
        postgres_1    | 2024-03-18 05:21:19.514 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2024-03-18 05:21:20.731 UTC [78] ERROR:  foreign key constraint "table😋4_col4_0_fkey" cannot be implemented
        postgres_1    | 2024-03-18 05:21:20.731 UTC [78] DETAIL:  Key columns "col4_0" and "col3_12" are of incompatible types: text and "char".
        postgres_1    | 2024-03-18 05:21:20.731 UTC [78] STATEMENT:  ALTER TABLE table😋4 ADD FOREIGN KEY (col4_0) REFERENCES table3 (col3_12) ON UPDATE CASCADE
        test_1        | --- FAIL: TestCompare (605.39s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.18s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:172: ALTER TABLE table😋4 ADD FOREIGN KEY (col4_0) REFERENCES table3 (col3_12) ON UPDATE CASCADE
        test_1        |         compare_test.go:173: postgres: exec: ERROR: foreign key constraint "table😋4_col4_0_fkey" cannot be implemented (SQLSTATE 42804)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (629.82s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #119903 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-rc] - #118616 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.1-rc] - #118615 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.15-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115745 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.0-rc] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.3-rc @ 03498e5964c0eaa45bb5435b4c600de38d542910:

        test_1        |                             AS tab146744 (col236959)
        test_1        |                 )
        test_1        |                     AS "t'aB146745"
        test_1        |             ORDER BY
        test_1        |                 col236960 NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         tab146744.col236959 AS col236960
        test_1        |                     FROM
        test_1        |                         (
        test_1        |                             VALUES
        test_1        |                                 (
        test_1        |                                     (NULL::TIMESTAMPTZ[]::TIMESTAMPTZ[] || '2000-01-01 07:00:00+00'::TIMESTAMPTZ::TIMESTAMPTZ::TIMESTAMPTZ)::TIMESTAMPTZ[]
        test_1        |                                 ),
        test_1        |                                 (
        test_1        |                                     (('2000-01-10'::DATE::DATE::DATE + NULL::TIMETZ::TIMETZ)::TIMESTAMPTZ::TIMESTAMPTZ || NULL::TIMESTAMPTZ[]::TIMESTAMPTZ[])::TIMESTAMPTZ[]
        test_1        |                                 ),
        test_1        |                                 (NULL::TIMESTAMPTZ[]),
        test_1        |                                 (
        test_1        |                                     CASE
        test_1        |                                     WHEN false::BOOL
        test_1        |                                     THEN (NULL::TIMESTAMPTZ[]::TIMESTAMPTZ[] || '2000-01-01 01:00:00+00'::TIMESTAMPTZ::TIMESTAMPTZ::TIMESTAMPTZ)::TIMESTAMPTZ[]
        test_1        |                                     ELSE NULL::TIMESTAMPTZ[]
        test_1        |                                     END
        test_1        |                                 ),
        test_1        |                                 (NULL::TIMESTAMPTZ[])
        test_1        |                         )
        test_1        |                             AS tab146744 (col236959)
        test_1        |                 )
        test_1        |                     AS "t'aB146745"
        test_1        |             ORDER BY
        test_1        |                 col236960 NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (813.52s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #119903 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-rc] - #118616 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.1-rc] - #118615 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.15-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115745 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.0-rc] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.3-rc @ 03498e5964c0eaa45bb5435b4c600de38d542910:

        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.01s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 158 [running]:
        test_1        | testing.tRunner.func1.2({0x226ece0, 0xc0010ab680})
        test_1        |     GOROOT/src/testing/testing.go:1545 +0x238
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1548 +0x397
        test_1        | panic({0x226ece0?, 0xc0010ab680?})
        test_1        |     GOROOT/src/runtime/panic.go:914 +0x21f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x46c7740?, {0x3201458?, 0xc000fa0960?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:375 +0x436
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x31bfda0?, 0x46c7740)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:308 +0x12c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc00017b800)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:225 +0x7f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc000fa0540, {0xc000f8f480?, 0x4, 0xc000fa0540?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:258 +0x89d
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0x206dd80?, 0x2471d1a?, {0xc000f8f480?, 0x49f9c88?, 0x2?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:96 +0x28
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc0006b1f50?, {0x2471d1a, 0x5}, 0x4, 0x80?, {0xc0008b9a40, 0x3, 0x7f4097605f18?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x131
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0xc00200fcc8?, 0x1?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:118 +0x15e
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc000034a00?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:98 +0x2f
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.init.wrapCommonSetup.func28(0x2657ca8?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x1b
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc000befd40)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:143 +0xe2
        test_1        | testing.tRunner(0xc000befd40, 0xc000fa04b0)
        test_1        |     GOROOT/src/testing/testing.go:1595 +0xff
        test_1        | created by testing.(*T).Run in goroutine 5
        test_1        |     GOROOT/src/testing/testing.go:1648 +0x3ad
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 2
--- FAIL: TestComposeCompare (18.59s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #119903 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-rc] - #118616 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.1-rc] - #118615 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.15-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115745 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.0-rc] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.3-rc @ 03498e5964c0eaa45bb5435b4c600de38d542910:

        postgres_1    | 2024-03-21 05:22:14.883 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2024-03-21 05:22:14.883 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2024-03-21 05:22:14.883 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2024-03-21 05:22:14.886 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2024-03-21 05:22:14.891 UTC [68] LOG:  database system was shut down at 2024-03-21 05:22:14 UTC
        postgres_1    | 2024-03-21 05:22:14.896 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2024-03-21 05:22:16.840 UTC [78] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2024-03-21 05:22:16.840 UTC [78] STATEMENT:  CREATE TABLE table4 (col4̢_0 VARCHAR NOT NULL, col4_̮1 GEOMETRY, "c%qol4_2" BIT(42)[] NOT NULL, col4_3 REGCLASS NULL, "col4""_'4" TIMESTAMPTZ NOT NULL, "co l4_'5" FLOAT8 NOT NULL, col4_6 VARCHAR NOT NULL, col4_7 BOX2D[] NOT NULL, "coL̲4_8" VARCHAR NOT NULL, col4_9 VARCHAR, col4_10 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col4""_'4" IS NULL THEN e'\x00'::TEXT ELSE e'$e\x19\x1cTcC'::TEXT END) STORED, c😭ol4_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(col4̢_0)) STORED, "col
        postgres_1    |     4_12" TEXT NOT NULL GENERATED ALWAYS AS (lower(col4_6)) STORED, "%qcol4_13" TEXT GENERATED ALWAYS AS (lower(CAST(col4_̮1 AS TEXT))) STORED, "|""col4_14" TEXT NOT NULL GENERATED ALWAYS AS (lower("coL̲4_8")) STORED, col4_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(col4_6)) STORED, PRIMARY KEY ("co l4_'5"));
        postgres_1    |     CREATE INDEX ON table4 ((CASE WHEN col4_3 IS NULL THEN e'-\x1bs\x04\x02\n'::TEXT ELSE e'\x04?X'::TEXT END)) INCLUDE (col4_̮1, col4_3, col4_6, col4_9, "col
        postgres_1    |     4_12", "|""col4_14");
        postgres_1    |     CREATE UNIQUE INDEX ON table4 (col4̢_0 ASC, lower(col4_9) ASC) INCLUDE (col4_7, "coL̲4_8", col4_9);
        postgres_1    |     CREATE INDEX ON table4 ("co l4_'5" DESC, col4_3 DESC) INCLUDE (col4̢_0, "col4""_'4", col4_6, col4_7, "coL̲4_8", col4_9, col4_10, "col
        postgres_1    |     4_12", "|""col4_14");
        postgres_1    |     CREATE UNIQUE INDEX ON table4 ("%qcol4_13" DESC);
        postgres_1    |     CREATE UNIQUE INDEX ON table4 ((CASE WHEN "col4""_'4" IS NULL THEN e'\nh9B5=X'::TEXT ELSE e'"|L<\x0b"S'::TEXT END) ASC, c😭ol4_11 ASC);
        postgres_1    |     CREATE INDEX ON table4 (col4_10 ASC, (CASE WHEN col4_7 IS NULL THEN e'9o^\x0fJ\x0bQ\x02'::TEXT ELSE '~'::TEXT END)) INCLUDE ("c%qol4_2", col4_3, "col4""_'4", col4_6, "coL̲4_8", "|""col4_14");
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (606.36s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.13s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:172: CREATE TABLE table4 (col4̢_0 VARCHAR NOT NULL, col4_̮1 GEOMETRY, "c%qol4_2" BIT(42)[] NOT NULL, col4_3 REGCLASS NULL, "col4""_'4" TIMESTAMPTZ NOT NULL, "co l4_'5" FLOAT8 NOT NULL, col4_6 VARCHAR NOT NULL, col4_7 BOX2D[] NOT NULL, "coL̲4_8" VARCHAR NOT NULL, col4_9 VARCHAR, col4_10 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col4""_'4" IS NULL THEN e'\x00'::TEXT ELSE e'$e\x19\x1cTcC'::TEXT END) STORED, c😭ol4_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(col4̢_0)) STORED, "col
        test_1        |             4_12" TEXT NOT NULL GENERATED ALWAYS AS (lower(col4_6)) STORED, "%qcol4_13" TEXT GENERATED ALWAYS AS (lower(CAST(col4_̮1 AS TEXT))) STORED, "|""col4_14" TEXT NOT NULL GENERATED ALWAYS AS (lower("coL̲4_8")) STORED, col4_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(col4_6)) STORED, PRIMARY KEY ("co l4_'5"));
        test_1        |             CREATE INDEX ON table4 ((CASE WHEN col4_3 IS NULL THEN e'-\x1bs\x04\x02\n'::TEXT ELSE e'\x04?X'::TEXT END)) INCLUDE (col4_̮1, col4_3, col4_6, col4_9, "col
        test_1        |             4_12", "|""col4_14");
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4̢_0 ASC, lower(col4_9) ASC) INCLUDE (col4_7, "coL̲4_8", col4_9);
        test_1        |             CREATE INDEX ON table4 ("co l4_'5" DESC, col4_3 DESC) INCLUDE (col4̢_0, "col4""_'4", col4_6, col4_7, "coL̲4_8", col4_9, col4_10, "col
        test_1        |             4_12", "|""col4_14");
        test_1        |             CREATE UNIQUE INDEX ON table4 ("%qcol4_13" DESC);
        test_1        |             CREATE UNIQUE INDEX ON table4 ((CASE WHEN "col4""_'4" IS NULL THEN e'\nh9B5=X'::TEXT ELSE e'"|L<\x0b"S'::TEXT END) ASC, c😭ol4_11 ASC);
        test_1        |             CREATE INDEX ON table4 (col4_10 ASC, (CASE WHEN col4_7 IS NULL THEN e'9o^\x0fJ\x0bQ\x02'::TEXT ELSE '~'::TEXT END)) INCLUDE ("c%qol4_2", col4_3, "col4""_'4", col4_6, "coL̲4_8", "|""col4_14");
        test_1        |             
        test_1        |         compare_test.go:173: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (631.10s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #119903 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-rc] - #118616 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.1-rc] - #118615 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.15-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #116006 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115907 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #115745 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.0-rc] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #109341 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 8 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.3-rc @ 03498e5964c0eaa45bb5435b4c600de38d542910:

        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare539805200/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   s"106751 days 23:47:16.854776",
        test_1        |             +   s"727869 days 20:57:55",
        test_1        |                 &net.IPNet{IP: s"::2", Mask: s"00000000000000000000000000000000"},
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ((('00:03:00':::TIME::TIME::TIME + '00:00:03':::INTERVAL::INTERVAL::INTERVAL)::TIME::TIME + '2000-01-06':::DATE::DATE::DATE)::TIMESTAMP::TIMESTAMP - make_timestamp(int4(7:::INT8::INT4::INT4)::INT4::INT4, 3:::INT8::INT4::INT4, 5:::INT8::INT4::INT4, 3:::INT8::INT4::INT4, 5:::INT8::INT4::INT4, 8.0:::FLOAT8::FLOAT8::FLOAT8)::TIMESTAMP::TIMESTAMP)::INTERVAL
        test_1        |                             AS "\\U00090D82col314741",
        test_1        |                         '::2/0':::INET::INET AS "co̤l
314742"
        test_1        |                 )
        test_1        |                     AS "tab}203864"
        test_1        |             ORDER BY
        test_1        |                 "\\U00090D82col314741" DESC, "co̤l
314742" ASC NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ((('00:03:00'::TIME::TIME::TIME + '00:00:03'::INTERVAL::INTERVAL::INTERVAL)::TIME::TIME + '2000-01-06'::DATE::DATE::DATE)::TIMESTAMP::TIMESTAMP - make_timestamp(int4(7::INT8::INT4::INT4)::INT4::INT4, 3::INT8::INT4::INT4, 5::INT8::INT4::INT4, 3::INT8::INT4::INT4, 5::INT8::INT4::INT4, 8.0::FLOAT8::FLOAT8::FLOAT8)::TIMESTAMP::TIMESTAMP)::INTERVAL
        test_1        |                             AS "\\U00090D82col314741",
        test_1        |                         '::2/0'::INET::INET AS "co̤l
314742"
        test_1        |                 )
        test_1        |                     AS "tab}203864"
        test_1        |             ORDER BY
        test_1        |                 "\\U00090D82col314741" DESC, "co̤l
314742" ASC NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1029.66s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #120869 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.4-rc] - #120868 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.18-rc] - #119903 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 7 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.3-rc @ 03498e5964c0eaa45bb5435b4c600de38d542910:

        postgres_1    |         col͖30169 ASC,
        postgres_1    |         col30170 NULLS FIRST,
        postgres_1    |         "col(30171" ASC,
        postgres_1    |         "c'ol30172" DESC,
        postgres_1    |         col30173 DESC NULLS LAST,
        postgres_1    |         col30174 NULLS FIRST
        test_1        | --- FAIL: TestCompare (631.70s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (26.64s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare412875892/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare postgres to cockroach1: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("0103000000010000000500000000000000008046C0000000000080464000000000008046C00000000000805640000000000000000000000000008056400000000000000000000000000080464000000000008046C00000000000804640"),
        test_1        |             +   nil,
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_geomfromgeohash('G':::STRING::STRING::STRING, NULL::INT4::INT4)::GEOMETRY AS col̎30175)
        test_1        |                     AS "t\\U0007A5F3ab17076"
        test_1        |             ORDER BY
        test_1        |                 col̎30175 DESC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_geomfromgeohash('G'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::GEOMETRY AS col̎30175)
        test_1        |                     AS "t\\U0007A5F3ab17076"
        test_1        |             ORDER BY
        test_1        |                 col̎30175 DESC;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (656.86s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #120924 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-custom] - #120869 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.4-rc] - #120868 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.18-rc] - #119903 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 7 months ago

compose.TestComposeCompare failed with artifacts on release-23.2.3-rc @ 03498e5964c0eaa45bb5435b4c600de38d542910:

        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (311.02s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare4261733511/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("0A"),
        test_1        |             +   string("0.0000000000000000A"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (pow(COALESCE(0:::DECIMAL::DECIMAL, 6:::DECIMAL::DECIMAL)::DECIMAL, 3:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || 'A':::STRING::STRING::STRING)::STRING
        test_1        |                             AS col̴302483
        test_1        |                 )
        test_1        |                     AS tab199872
        test_1        |             ORDER BY
        test_1        |                 col̴302483 ASC NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (pow(COALESCE(0::DECIMAL::DECIMAL, 6::DECIMAL::DECIMAL)::DECIMAL, 3::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || 'A'::TEXT::TEXT::TEXT)::TEXT
        test_1        |                             AS col̴302483
        test_1        |                 )
        test_1        |                     AS tab199872
        test_1        |             ORDER BY
        test_1        |                 col̴302483 ASC NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (942.44s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #120925 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-custom-v2] - #120924 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-custom] - #120869 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2.4-rc] - #120868 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.18-rc] - #119903 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.17-rc] - #116150 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-master] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

renatolabs commented 7 months ago

rc branch no longer exists. Also, there's an existing issue on an active branch that can be used for tracking instead.