compose: TestComposeCompare failed

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.

https://www.cockroachlabs.com

Other

30.13k stars 3.81k forks source link

compose: TestComposeCompare failed #109341

Closed cockroach-teamcity closed 8 months ago

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 0159e4fd362184e6837b7a704b7b30092d537ea1:

        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1468457765/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("010300000000000000"),
        test_1        |             +   string("0103000000010000000500000000000000000008400000000000001C40000000000000084000000000000014400000000000000840000000000000144000000000000008400000000000001C4000000000000008400000000000001C40"),
        test_1        |                 nil,
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         st_makeenvelope(3.0:::FLOAT8::FLOAT8::FLOAT8, 7.0:::FLOAT8::FLOAT8::FLOAT8, 3.0:::FLOAT8::FLOAT8::FLOAT8, 5.0:::FLOAT8::FLOAT8::FLOAT8)::GEOMETRY
        test_1        |                             AS "'col65529",
        test_1        |                         NULL::INT8 AS col65530
        test_1        |                 )
        test_1        |                     AS "ta%pb35682"
        test_1        |             ORDER BY
        test_1        |                 "'col65529" NULLS LAST, col65530 NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         st_makeenvelope(3.0::FLOAT8::FLOAT8::FLOAT8, 7.0::FLOAT8::FLOAT8::FLOAT8, 3.0::FLOAT8::FLOAT8::FLOAT8, 5.0::FLOAT8::FLOAT8::FLOAT8)::GEOMETRY
        test_1        |                             AS "'col65529",
        test_1        |                         NULL::INT8 AS col65530
        test_1        |                 )
        test_1        |                     AS "ta%pb35682"
        test_1        |             ORDER BY
        test_1        |                 "'col65529" NULLS LAST, col65530 NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (801.95s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #108652 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-23.1.9-rc] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-22.2]

/cc @cockroachdb/sql-foundations

This test on roachdash | Improve this report!

Jira issue: CRDB-30883

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ b24aa96762b06725f6968b4a6129cbcc67818912:

        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | 
        postgres_1    | waiting for server to shut down...2023-08-24 05:17:50.213 UTC [49] LOG:  received fast shutdown request
        postgres_1    | .2023-08-24 05:17:50.214 UTC [49] LOG:  aborting any active transactions
        postgres_1    | 2023-08-24 05:17:50.216 UTC [49] LOG:  background worker "logical replication launcher" (PID 56) exited with exit code 1
        postgres_1    | 2023-08-24 05:17:50.219 UTC [51] LOG:  shutting down
        postgres_1    | 2023-08-24 05:17:50.307 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-08-24 05:17:50.334 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-08-24 05:17:50.335 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-08-24 05:17:50.335 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-08-24 05:17:50.338 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-08-24 05:17:50.342 UTC [68] LOG:  database system was shut down at 2023-08-24 05:17:50 UTC
        postgres_1    | 2023-08-24 05:17:50.347 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-08-24 05:17:51.439 UTC [78] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2023-08-24 05:17:51.439 UTC [78] STATEMENT:  CREATE TABLE table4 ("co l4_0" BIT(46) NOT NULL, col4_1 BIT(22) NOT NULL, " c'ol4_2" BIT(7), "col4_\n3" REGTYPE, col̀4_4 REGCLASS NULL, col4_5 TSVECTOR NOT NULL, col4_6 NAME NOT NULL, col4_7 TSVECTOR NOT NULL, co😫l4_8 PG_LSN NULL);
        postgres_1    |     CREATE INDEX ON table4 (" c'ol4_2" ASC);
        postgres_1    |     CREATE UNIQUE INDEX ON table4 (" c'ol4_2" DESC, "col4_\n3" ASC, col̀4_4 DESC, col4_6 DESC, lower(CAST(col4_1 AS TEXT)) DESC, "co l4_0" ASC, (CASE WHEN "col4_\n3" IS NULL THEN ''::TEXT ELSE e'\x00'::TEXT END)) INCLUDE (col4_1, col4_5);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (605.33s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.01s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:172: CREATE TABLE table4 ("co l4_0" BIT(46) NOT NULL, col4_1 BIT(22) NOT NULL, " c'ol4_2" BIT(7), "col4_\n3" REGTYPE, col̀4_4 REGCLASS NULL, col4_5 TSVECTOR NOT NULL, col4_6 NAME NOT NULL, col4_7 TSVECTOR NOT NULL, co😫l4_8 PG_LSN NULL);
        test_1        |             CREATE INDEX ON table4 (" c'ol4_2" ASC);
        test_1        |             CREATE UNIQUE INDEX ON table4 (" c'ol4_2" DESC, "col4_\n3" ASC, col̀4_4 DESC, col4_6 DESC, lower(CAST(col4_1 AS TEXT)) DESC, "co l4_0" ASC, (CASE WHEN "col4_\n3" IS NULL THEN ''::TEXT ELSE e'\x00'::TEXT END)) INCLUDE (col4_1, col4_5);
        test_1        |             
        test_1        |         compare_test.go:173: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (629.16s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #108652 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.9-rc] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ a900aa218054812b782c0b3d130b25296c0d14e3:

        postgres_1    |         "cO l723364" DESC,
        postgres_1    |         "co'😎l723365" ASC NULLS LAST,
        postgres_1    |         "🙀co
        postgres_1    |     l\\x05723366" DESC NULLS FIRST,
        postgres_1    |         col723367 ASC NULLS LAST,
        postgres_1    |         col723368 DESC NULLS FIRST
        test_1        | --- FAIL: TestCompare (1160.62s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (556.56s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2044093876/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   int32(1),
        test_1        |             +   int32(2),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT int4((8.0:::FLOAT8::FLOAT8::FLOAT8 / 5.0:::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::INT4 AS col723383)
        test_1        |                     AS tab439059
        test_1        |             ORDER BY
        test_1        |                 col723383 ASC NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT int4((8.0::FLOAT8::FLOAT8::FLOAT8 / 5.0::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::INT4 AS col723383)
        test_1        |                     AS tab439059
        test_1        |             ORDER BY
        test_1        |                 col723383 ASC NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1185.19s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #108652 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.9-rc] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 54080dce12ba41c5578a1d1120b572198d884eaa:

        cockroach2_1  | nodeID:              1
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | 
        postgres_1    | waiting for server to shut down...2023-09-01 05:18:20.631 UTC [49] LOG:  received fast shutdown request
        postgres_1    | .2023-09-01 05:18:20.633 UTC [49] LOG:  aborting any active transactions
        postgres_1    | 2023-09-01 05:18:20.635 UTC [49] LOG:  background worker "logical replication launcher" (PID 56) exited with exit code 1
        postgres_1    | 2023-09-01 05:18:20.637 UTC [51] LOG:  shutting down
        postgres_1    | 2023-09-01 05:18:20.726 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-09-01 05:18:20.753 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-09-01 05:18:20.753 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-09-01 05:18:20.753 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-09-01 05:18:20.756 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-09-01 05:18:20.761 UTC [68] LOG:  database system was shut down at 2023-09-01 05:18:20 UTC
        postgres_1    | 2023-09-01 05:18:20.765 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-09-01 05:18:21.769 UTC [78] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2023-09-01 05:18:21.769 UTC [78] STATEMENT:  CREATE TABLE table1 (c😾ol1_0 TSVECTOR NOT NULL, "co!l1_ 1" "char" NOT NULL, "col 1_2" REGROLE, col1_͘3 GEOGRAPHY NOT NULL, col1_4 INTERVAL NULL, "c'ol1_5" BIT(46), "co\\U00013BDDl/1_6" TIMESTAMPTZ NOT NULL, col1_7 REGCLASS, "co\\x13l1_8" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "co\\U00013BDDl/1_6" IS NULL THEN e'*\x18\f'::TEXT ELSE e'\'^\x15'::TEXT END) STORED, col1_9 TEXT GENERATED ALWAYS AS (CASE WHEN "col 1_2" IS NULL THEN 'Ad;vBna'::TEXT ELSE NULL END) STORED, col1_10 TEXT NOT NULL GENERATED ALWAYS AS (lower("co!l1_ 1")) STORED, "\\U00009996col1_11" TEXT GENERATED ALWAYS AS (CASE WHEN "col 1_2" IS NULL THEN e'\x00'::TEXT ELSE e'2\b/5'::TEXT END) STORED, col1_12 TEXT GENERATED ALWAYS AS (lower(CAST("c'ol1_5" AS TEXT))) STORED, col1_13 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(c😾ol1_0 AS TEXT))) STORED, "co�l1_14" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(c😾ol1_0 AS TEXT))) STORED);
        postgres_1    |     CREATE INDEX ON table1 ("co\\U00013BDDl/1_6", "co!l1_ 1", "co\\x13l1_8" DESC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (605.60s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.93s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:172: CREATE TABLE table1 (c😾ol1_0 TSVECTOR NOT NULL, "co!l1_ 1" "char" NOT NULL, "col 1_2" REGROLE, col1_͘3 GEOGRAPHY NOT NULL, col1_4 INTERVAL NULL, "c'ol1_5" BIT(46), "co\\U00013BDDl/1_6" TIMESTAMPTZ NOT NULL, col1_7 REGCLASS, "co\\x13l1_8" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "co\\U00013BDDl/1_6" IS NULL THEN e'*\x18\f'::TEXT ELSE e'\'^\x15'::TEXT END) STORED, col1_9 TEXT GENERATED ALWAYS AS (CASE WHEN "col 1_2" IS NULL THEN 'Ad;vBna'::TEXT ELSE NULL END) STORED, col1_10 TEXT NOT NULL GENERATED ALWAYS AS (lower("co!l1_ 1")) STORED, "\\U00009996col1_11" TEXT GENERATED ALWAYS AS (CASE WHEN "col 1_2" IS NULL THEN e'\x00'::TEXT ELSE e'2\b/5'::TEXT END) STORED, col1_12 TEXT GENERATED ALWAYS AS (lower(CAST("c'ol1_5" AS TEXT))) STORED, col1_13 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(c😾ol1_0 AS TEXT))) STORED, "co�l1_14" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(c😾ol1_0 AS TEXT))) STORED);
        test_1        |             CREATE INDEX ON table1 ("co\\U00013BDDl/1_6", "co!l1_ 1", "co\\x13l1_8" DESC);
        test_1        |             
        test_1        |         compare_test.go:173: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (629.29s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ b994d025c678f495cb8b93044e35a8c59595bd78:

        test_1        |             +               Exp:              -16,
        test_1        |                             Status:           2,
        test_1        |                             NaN:              false,
        test_1        |                             InfinityModifier: s"none",
        test_1        |                         },
        test_1        |                     },
        test_1        |                     Dimensions: {{Length: 1, LowerBound: 1}},
        test_1        |                     Status:     2,
        test_1        |                 },
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (log(1:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[]
        test_1        |                             AS """col218554"
        test_1        |                 )
        test_1        |                     AS "t
        test_1        |             ab120786"
        test_1        |             ORDER BY
        test_1        |                 """col218554" DESC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (log(1::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[]
        test_1        |                             AS """col218554"
        test_1        |                 )
        test_1        |                     AS "t
        test_1        |             ab120786"
        test_1        |             ORDER BY
        test_1        |                 """col218554" DESC;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (779.89s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ b994d025c678f495cb8b93044e35a8c59595bd78:

        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (177.86s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1987994103/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare postgres to cockroach1: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("0.15563025007672872000H"),
        test_1        |             +   string("0.15563025007672872650H"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ((log(6:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL / 5:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || 'H':::STRING::STRING::STRING)::STRING
        test_1        |                             AS "\\U000F8C04col230091"
        test_1        |                 )
        test_1        |                     AS tab122693
        test_1        |             ORDER BY
        test_1        |                 "\\U000F8C04col230091" NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ((log(6::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL / 5::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || 'H'::TEXT::TEXT::TEXT)::TEXT
        test_1        |                             AS "\\U000F8C04col230091"
        test_1        |                 )
        test_1        |                     AS tab122693
        test_1        |             ORDER BY
        test_1        |                 "\\U000F8C04col230091" NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (806.23s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #108652 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.9-rc.FROZEN] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ ad4e53f6b4dda9a76c60d4fe52f6f9d7c6afde2a:

        postgres_1    |         col483052 DESC, col483053 DESC NULLS FIRST, col483054 ASC
        postgres_1    | 2023-09-06 05:24:08.142 UTC [78] ERROR:  function int2(timestamp with time zone) does not exist at character 68
        postgres_1    | 2023-09-06 05:24:08.142 UTC [78] HINT:  No function matches the given name and argument types. You might need to add explicit type casts.
        postgres_1    | 2023-09-06 05:24:08.142 UTC [78] STATEMENT:  SELECT
        postgres_1    |         *
        postgres_1    |     FROM
        postgres_1    |         (
        postgres_1    |             SELECT
        postgres_1    |                 tab279373.col1_1 AS " col483055",
        postgres_1    |                 int2('2000-01-01 00:00:00+00'::TIMESTAMPTZ::TIMESTAMPTZ::TIMESTAMPTZ)::INT2 AS "c%qol   483056",
        postgres_1    |                 'J'::TEXT::TEXT AS col483057,
        postgres_1    |                 ('00:00:06'::INTERVAL::INTERVAL::INTERVAL * 6::INT8::INT8::INT8)::INTERVAL AS "c\\u1AC2ol483058"
        postgres_1    |             FROM
        postgres_1    |                 postgres.public."tab%ple1" AS tab279373
        postgres_1    |         )
        postgres_1    |             AS tab279374
        postgres_1    |     ORDER BY
        postgres_1    |         " col483055" DESC NULLS FIRST, "c%qol   483056" DESC NULLS LAST, col483057 ASC, "c\\u1AC2ol483058" NULLS LAST
        test_1        | --- FAIL: TestCompare (1246.31s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (640.83s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '{"C": {"A": {"H": true}, "B": {"A": {"C": null, "I": true}, "H": {"F": {"B": null, "F": 8}}, "I": ["E", [{"E": {"C": {"E": {"E": {"F": 6}, "H": {"D": {"B": {"D": {"H": true}}, "H": {"A": [{"A": null, "I": [{"E": 8}, {"C": true, "I": {"C": true, "F": {"B": {"A": "J", "C": {"F": {"C": null, "G": true}}}, "I": {"G": ["B"], "H": {"B": null}, "I": {"G": {"E": {"B": [true, "J"]}, "I": 2}, "I": [true, {"A": [{"D": "J", "F": null}, {"C": true, "I": {"D": false, "I": null}}], "B": false, "C": 4}, {"C": true, "I": {"E": "J"}}]}}}}, "J": null}]}, null, {"E": [{"I": {"C": "D", "I": true}}, {"F": {"G": {"H": "J"}, "J": {"G": 3, "H": {"C": null, "F": null, "H": {"I": true}}}}}]}], "F": {"B": [{"A": "F", "B": "J", "F": {"D": null}}], "C": 5, "F": 4}}}, "J": {"C": {"B": true, "I": [{"D": null, "I": {"A": "C", "H": {"D": true, "F": {"B": "J"}, "J": 4}}}], "J": {"F": {"B": {"D": {"D": false, "H": {"B": {"C": {"A": {"A": true, "E": null}}, "E": true, "F": [{"E": {"F": [{"G": true}], "G": false}}, {"J": 2}, {"A": "D", "G": true}]}, "E": "J", "G": null}}}, "I": "J"}, "H": false, "I": {"B": {"A": 2}, "G": {"E": {"B": {"A": null}, "E": 6}, "I": [{"D": null, "E": [{"A": {"E": {"C": {"E": {"F": {"B": {"B": {"G": {"I": 7}, "J": null}}}}, "F": false}, "G": true, "I": "H"}}, "E": [null, {"D": 4, "E": 0}, {"B": {"F": {"A": null, "C": {"D": {"F": {"G": {"E": false}}, "G": false, "I": [true, [[{"G": {"B": {"E": null}, "F": null, "I": true}, "H": false}], "B", true], {"C": {"F": "E", "I": 9}, "D": true, "J": {"E": {"A": {"A": {"I": {"B": {"A": 2, "C": {"C": true, "E": 9}, "F": ["J", 1, null]}, "C": false, "F": 9}, "J": "B"}, "I": {"E": "A", "F": "B", "I": true}}, "B": true, "C": 0}, "F": false}}]}}, "G": null}, "G": 4}}]}]}, 3]}}}}, "I": {"B": {"E": false, "F": {"A": "H", "G": {"D": {"D": "A", "H": true, "I": [true]}, "I": null}, "I": "B"}, "H": true}, "G": false}}}, "I": [null, 4]}, "F": null}, "E": {"A": {"F": "I"}, "B": {"B": "H", "D": [{"A": {"D": false, "H": true}, "J": true}, {"G": {"A": {"F": null, "H": [null, true, false], "J": true}}, "J": {"H": null}}, {"B": {"A": {"B": {"A": true, "H": null}, "C": false, "H": {"A": {"A": 2, "G": [{"J": {"A": {"D": "J"}, "C": {"B": "D", "E": {"B": {"B": true}, "G": [false]}, "J": {"I": [true]}}, "F": {"B": true}}}, {"C": true, "D": false}]}, "C": {"C": "D", "J": true}, "H": {"E": 4, "H": null}}}, "J": {"A": null, "H": {"C": {"A": {"E": [null], "H": [["C", 4, 4], {"C": true, "G": true}, false]}, "D": {"A": "I", "B": null, "D": ["I", [{"A": {"C": "I", "E": [{"F": null, "I": {"C": "D", "H": {"A": {"B": {"A": "J", "E": "F"}}}, "J": false}}, "E"], "F": true}, "C": [{"E": [{"B": 5, "C": null, "G": {"E": {"J": ["B", {"A": {"J": [false, 4, true]}, "F": {"E": 3}}, {"I": false}]}, "F": [null, "C"], "G": {"F": true}}}], "F": null, "H": {"E": {"A": {"A": {"B": {"F": [false, {"C": {"C": {"D": {"E": true, "F": {"C": true}, "I": "A"}, "I": {"D": {"D": "H"}}}}, "D": {"D": {"E": [[{"B": {"A": false, "D": true, "F": {"E": "A"}}, "D": {"C": "E", "D": {"F": false, "I": {"H": {"H": {"C": false, "H": {"C": null, "F": {"F": {"B": {"C": 3, "I": 0}, "D": null}, "I": false, "J": {"D": {"C": null, "I": {"B": 1, "D": {"I": [5, {"A": "H", "F": null, "J": ["F", null]}, "F"], "J": {"C": {"D": true, "E": {"B": "G", "E": [false], "H": null}, "H": {"A": false, "F": {"C": {"G": 7}, "D": [false], "E": {"C": false, "H": {"J": {"A": true, "I": [[{"A": {"A": [["F", {"C": true, "E": "D", "G": {"D": 3, "E": [{"A": true, "C": null, "H": {"C": null, "F": null, "G": {"B": false}}}, {"A": {"D": {"B": {"B": {"I": [{"G": "D", "J": [{"F": 5, "G": true}, {"B": {"A": [{"I": {"A": 1, "B": [{"A": {"I": false, "J": ["D", "A"]}, "I": true}, true, "C"], "D": {"H": {"C": false, "E": "C", "G": {"E": "I"}}, "J": 9}}}, {"E": 0}], "H": {"A": [{"H": {"A": [false, null], "B": null}}], "B": true, "J": false}, "J": {"B": {"C": [{"B": false}, false, "A"]}, "I": 0}}, "C": "C"}, {"A": {"C": false, "D": {"B": {"D": {"A": {"D": null}, "B": true, "J": {"C": null}}}}}, "B": {"E": true}, "J": 9}]}]}, "C": true, "E": {"A": "A", "B": {"D": null, "F": 6, "G": true}}}, "D": {"E": {"C": {"E": null, "H": false, "I": {"C": {"E": "G", "J": "I"}, "E": false}}, "G": {"F": {"H": [[true, 4]]}, "H": [true, false, {"A": false, "G": {"B": {"F": {"A": {"C": true, "I": "F"}, "D": null, "H": {"G": 3}}}}}]}, "J": {"C": {"E": false, "F": ["J", ["C", [null]], [[false, {"D": {"C": {"G": {"F": {"E": {"I": {"C": null}}}, "H": "B"}}, "H": null, "I": false}}], [{"A": 1, "E": 7, "H": [null]}, {"A": {"D": true}, "B": null, "D": [{"C": true, "J": [7, 9, 2]}]}, {"E": null, "H": {"E": [false, true], "F": "D", "H": null}}]]]}}}, "G": true, "H": false}, "J": [{"E": "B", "I": {"A": {"F": {"A": "B"}, "H": {"H": {"D": "G"}, "I": {"B": "G", "G": {"A": true, "E": {"J": {"D": {"I": null}, "J": "A"}}, "J": false}}}}, "H": {"E": [8], "G": null, "H": false}, "J": "G"}, "J": null}]}}, "B": null, "G": false}]}}, {"G": {"H": {"C": [[null, [true, null, "J"], "A"]]}, "J": {"A": "A", "F": [5, {"C": 7, "J": {"B": {"E": {"A": false, "D": {"C": {"B": {"A": {"I": true}, "C": {"G": {"G": "A", "H": {"B": "A", "C": false, "E": false}}}, "I": 0}, "C": "G"}, "E": false, "F": false}}}, "D": 3}}]}}}]], "B": [["D", {"A": "H", "H": false, "J": {"A": {"G": {"A": {"B": ["D", null, [{"D": false, "I": 0}, "H"]], "J": {"J": {"A": 1, "J": false}}}, "C": ["J"], "H": null}, "I": {"B": 2, "G": 8}}, "B": {"C": true, "E": [{"J": {"A": {"I": {"B": 0}}}}, {"I": false}, false]}}}, true], {"B": false, "F": {"A": {"B": {"G": ["G", true, false]}, "C": {"B": [true], "C": [{"D": true, "F": false, "H": {"G": {"F": false, "J": {"A": [{"A": false, "H": {"B": 6}}], "G": null}}}}, {"D": "A", "E": {"J": {"A": {"A": null, "F": {"A": true, "E": "F", "H": {"A": {"D": null}, "F": 4, "G": {"D": ["E", {"A": ["D", {"B": null, "F": false}, 1], "C": false, "I": "G"}], "F": "B"}}}}, "B": null, "D": {"E": {"E": {"C": 2}, "I": ["C"]}, "J": null}}}, "F": {"A": true, "B": {"B": null, "J": {"E": {"B": true}, "F": {"F": false}, "H": true}}}}], "D": false}, "F": [null]}, "B": "A"}, "G": null}, true], "C": {"C": false}}}, [true, 9]]]}}, "J": {"D": 1, "F": null}}}, "H": null}}}}, "H": {"A": {"C": [0, [null, true], {"H": {"I": null}}], "H": 4}, "G": {"B": ["A", {"E": [[false, 0, null]]}, [false]], "F": [false, {"G": 8}, {"C": {"A": [{"B": 6, "D": false}, {"H": true}, "I"], "F": false}, "H": null, "J": {"G": {"B": {"A": false}, "D": null}}}], "I": [{"D": false, "I": {"H": {"H": null}, "J": null}, "J": null}, {"A": null, "F": {"H": false, "I": true}}, {"A": null, "G": {"G": null}, "I": null}]}}}}}}, "H": false}}}}}}, "H": true}]], "F": true, "J": {"A": {"A": {"C": {"A": 7, "F": {"J": 8}, "H": {"A": 9, "D": {"A": true, "B": {"F": null, "G": null}, "J": {"D": false, "H": {"F": {"E": null, "F": 9}, "I": {"D": true, "E": 0, "H": {"J": 4}}}}}, "F": {"C": 6, "D": false, "F": {"I": [[2, [{"D": 9, "G": {"C": false}}, null]]]}}}}}, "G": true, "J": {"B": {"I": null, "J": [{"C": true}, false]}, "D": false}}, "F": true}}, "E": [5, {"J": [{"B": 4}, {"F": {"A": [{"H": false, "J": false}], "E": {"E": null}}, "J": {"F": {"H": "F"}}}, 6]}, [null, {"B": true, "E": {"D": false, "I": null}, "G": "H"}, {"E": "C", "I": null}]], "J": 4}}, "H"], "H": {"A": 3, "G": "J"}, "J": false}, "C": {"C": null}}, "H": {"C": {"B": {"F": null, "G": false}}, "H": true, "J": {"F": 8}}, "J": {"A": {"C": 7, "H": 4}, "B": "G"}}, "E": ["D"], "I": null}, "H": {"B": {"H": [true, {"C": "I", "H": {"G": {"D": {"D": true}}, "J": {"G": {"E": false, "F": {"J": {"D": null, "G": true}}}}}}, {"A": 2, "D": "B", "J": [{"B": null, "D": true, "H": true}, {"G": false}]}], "I": 0}, "G": false}}}]}], null]}}, "J": {"C": 5, "G": [false, null, 0], "I": false}}, "J": null}}, "E": 5}], "E": {"F": 7}}, "C": {"E": {"A": true, "E": [false], "F": {"A": "E", "E": {"J": {"D": {"A": null}, "G": "H"}}, "J": false}}, "H": {"A": {"B": {"G": {"A": null, "B": "A", "C": true}}, "D": true}, "C": true}, "J": {"F": {"B": false, "H": {"I": false}, "I": 6}, "G": null, "J": true}}}}, "G": {"C": false, "H": false}, "H": {"B": {"G": true}}}, {"D": true, "E": true, "H": {"A": {"B": [{"C": {"B": {"A": {"A": {"E": true, "I": [null, {"B": "I", "C": [[{"B": {"A": "B", "D": 1, "I": {"H": {"A": true}, "J": {"B": [true], "G": false, "J": {"C": {"B": [{"H": {"B": null, "C": true, "F": [{"I": false}, [{"D": {"C": {"D": {"A": {"G": {"D": "C", "G": {"H": {"A": [{"A": false, "B": {"F": 4}, "I": {"A": false, "I": {"C": null, "E": {"F": null, "J": "A"}, "J": {"F": {"C": false, "F": 6, "J": false}}}}}], "G": {"B": false, "J": {"G": [true, {"B": [{"E": {"F": ["A"]}, "I": 6, "J": {"A": {"B": true, "C": {"H": {"B": 0, "I": {"B": null}}}, "D": false}}}], "C": true, "E": false}, {"A": [null], "J": {"B": [{"B": {"B": {"C": "D", "J": {"B": 0, "C": {"C": {"G": [false, true]}, "F": {"H": {"E": false, "I": "F"}, "J": [{"C": ["D", 7, false], "H": {"J": true}}, {"J": true}]}, "H": {"A": null, "C": [{"F": {"D": [true], "F": 1}}, {"A": 5, "C": true, "I": 1}], "D": null}}}}}, "H": null}], "E": {"C": true, "E": {"A": {"F": "D"}, "E": {"C": "J"}}, "J": {"D": {"B": {"E": [false, 3, {"F": false, "I": false}], "H": false, "I": {"C": {"E": {"E": {"G": {"B": null, "H": true}}, "I": false}, "J": [[{"C": 8, "D": [true, {"D": [{"B": {"C": {"A": "J", "B": "F", "H": true}, "D": "I", "F": true}, "C": [true], "D": null}, 6], "I": 5, "J": {"B": [false]}}, {"H": "F"}], "F": [{"E": true}, {"F": {"C": {"B": true}, "D": "B"}, "G": {"H": "C"}, "H": 0}]}, 4], {"E": false}]}}}, "J": "J"}}}}}]}}}}, "H": {"D": 3, "H": true}}}}, "H": true}}, "J": [true]}]]}, "I": {"D": {"I": {"D": {"B": {"C": [{"I": {"B": {"C": [{"E": {"D": true, "E": null}}, {"F": {"C": {"C": 7, "F": true}, "F": [false, {"A": 5, "D": {"A": {"C": {"E": {"E": null, "H": false}}, "D": 0, "H": {"B": {"D": true}, "G": "H"}}, "C": "G", "G": false}, "G": {"C": {"A": {"C": {"C": {"E": {"D": false, "G": "I"}, "J": 3}}, "F": 7}, "E": null, "J": 5}, "E": 3, "H": {"G": "D"}}}], "H": false}}]}}}, "J", 6], "I": {"B": {"B": {"A": {"F": {"E": false, "J": {"B": false}}, "G": {"A": null, "E": false}}, "C": {"G": null, "J": {"C": null, "F": [{"G": {"E": false}, "J": true}, "B", "B"]}}, "F": "A"}}, "G": "A", "J": true}}}, "I": 7}}, "I": {"I": {"A": false, "D": {"D": {"B": {"D": false}}, "G": {"C": {"E": {"D": {"D": {"G": 4, "J": "C"}, "G": {"D": true, "F": false, "G": {"D": 9, "E": {"C": false, "I": null}}}, "H": {"B": {"I": true, "J": [false, {"H": true}]}, "I": {"D": true, "G": "G"}}}, "I": 8}}}, "J": {"J": "I"}}, "F": "I"}}, "J": {"F": {"D": null, "E": "J", "F": [true, "I", {"C": 0, "F": null}]}}}}, {"F": true, "H": 9}, "A"], "E": 2, "I": [[{"A": {"C": {"D": {"H": {"H": {"G": {"B": 4}, "I": [4, "D"]}}}}, "G": {"J": {"F": {"B": {"C": 1, "E": {"C": {"D": true, "H": true}}, "I": null}, "E": [true], "F": true}, "H": {"C": [{"I": null}]}}}}, "E": {"E": {"C": true, "D": [[false, {"B": {"F": {"D": [{"C": 8}, true, false], "H": "A"}, "J": null}}]], "G": {"D": false, "J": 5}}, "J": [{"E": {"G": {"D": 1, "G": 4, "H": [1]}, "J": {"C": {"A": true, "E": 1}}}}, false, false]}, "G": null}], "C"]}, "I": null}}}}, "E": {"C": [false, false], "F": {"D": {"F": 6, "G": [{"I": {"A": false}}, false], "J": 6}, "E": null}, "J": false}, "F": {"A": "I", "B": 5}}]]}, null]}, "H": 1, "I": [{"A": 5, "G": [true, null], "J": 3}, {"E": null}, {"H": {"B": {"E": {"E": [[[true, {"E": {"J": false}}, false], 1, "G"]], "F": 4}, "G": 0, "I": {"C": [{"B": false, "D": {"B": "D"}}, {"B": {"A": [{"D": {"B": {"I": {"F": [null, false]}}}, "E": {"I": "J"}, "G": {"E": 8}}, true, {"A": {"C": false, "F": {"A": {"A": null}, "B": [{"F": {"I": "F"}, "H": null}, {"B": {"B": 4, "H": {"C": {"F": {"B": true}, "I": [{"F": [false, {"C": [{"D": {"B": 5, "D": {"E": true, "J": [true, "J"]}, "E": true}, "I": {"E": {"C": [{"E": {"A": false}}, null, {"C": 4, "J": null}], "F": {"B": {"D": {"G": "J", "H": {"F": "B", "I": [null]}}, "F": true, "G": true}, "G": true, "H": null}}, "I": {"G": 1}}}, "A", {"F": {"C": null}}], "I": {"H": 4}}, null], "G": null, "H": "F"}]}, "E": 1, "G": true}, "J": {"J": {"A": {"A": {"F": {"D": ["D", {"A": {"B": null}}, true], "E": [{"C": "G", "F": {"D": 8}, "G": 6}]}}, "B": {"E": true, "G": true}}}}}, "C": [{"C": {"J": {"H": true, "J": "H"}}, "G": "D"}, false, {"B": false}], "D": {"J": {"F": {"G": true, "H": 6, "I": false}, "H": false}}}, {"D": 3}], "I": 2}, "H": "E"}}], "G": {"H": false}}}], "E": {"F": "A"}, "F": {"H": {"E": null, "G": null}, "I": false}}}, "C": null, "E": {"A": "E", "I": false, "J": {"B": {"B": {"D": null}, "H": false, "J": true}, "E": null, "J": true}}}}]}, "C": "H"}, "G": "H", "J": null}, "I": {"B": {"B": false, "E": true, "H": {"A": {"F": null}, "C": 3, "G": 6}}, "H": "B", "I": {"A": 8}}}], "F": false}, "D": {"C": {"B": false, "F": false, "G": [{"D": {"F": null, "I": true}, "E": {"A": [{"E": [null, false, 6], "G": {"A": "D", "E": {"H": {"E": {"D": true, "G": "H"}}}}}], "H": {"B": {"D": false}, "I": {"E": ["J", {"B": {"C": "J", "D": 1, "G": {"C": "F"}}, "F": true}], "I": "A"}}}, "J": [{"A": "H", "B": true}, {"H": "H"}, [{"A": [true, null], "G": "I"}]]}]}, "D": {"E": {"B": false, "D": {"B": {"A": true, "D": false, "H": "I"}, "G": {"B": [{"E": true, "G": {"I": "G", "J": {"I": [{"D": {"B": true, "G": {"D": {"I": {"J": {"H": 9, "I": 4, "J": {"E": false}}}}, "I": true, "J": [{"A": null, "E": {"B": true, "C": [{"A": {"E": [{"A": {"J": null}, "D": true, "G": ["A", {"J": "H"}]}]}, "D": true, "J": false}], "E": {"A": [false]}}, "I": false}, {"C": 2, "J": null}]}}, "J": true}, {"B": null}, 6]}}}]}}}}, "F": "F"}, "I": [false, 6, false]}}, [false, {"B": {"A": [{"D": 9, "E": 7}, [[{"A": {"B": false, "I": {"C": {"B": {"B": true, "H": null}, "C": true, "D": {"F": [{"C": {"A": false}, "I": 0}]}}, "G": {"A": {"B": 3, "D": 1}, "C": null, "F": {"C": {"G": "B", "I": {"B": {"E": 2, "H": {"A": {"A": [1, false], "C": false, "D": 0}}}, "G": {"G": {"B": {"C": 9, "E": {"C": {"G": ["E", {"D": {"C": "I"}}], "H": null}, "D": {"B": null, "D": false, "I": "B"}}}, "H": {"I": {"C": [{"A": false, "D": false, "H": "I"}]}}}}, "J": 8}}, "J": "C"}}}}, "H": 3}], {"E": {"B": null, "H": [null]}}, false]]}, "C": "A", "I": [{"D": {"E": {"E": {"C": 3, "H": [{"C": 3, "D": null, "G": null}, null], "I": null}, "G": {"G": false, "I": null, "J": true}, "H": {"I": false, "J": "J"}}}, "E": 2, "G": {"B": {"B": {"D": {"A": {"E": {"G": {"D": {"H": "I"}}, "H": {"H": false, "J": [null]}}, "H": null, "I": 0}}, "H": {"B": {"B": false, "J": "H"}, "G": 6}}}, "J": 7}}, 6]}]]]}, "E": null}, "G": false}':::JSONB::JSONB
        test_1        |                             AS "co l483147"
        test_1        |                 )
        test_1        |                     AS "%qtab279427"
        test_1        |             ORDER BY
        test_1        |                 "co l483147" ASC NULLS FIRST
        test_1        |         compare_test.go:213: postgres: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1270.86s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #109969 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.10-rc] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #108652 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.9-rc.FROZEN] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 4e79c65617e3f75dd39da5a9cb5544b445ee1c39:

        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (75.60s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2643417789/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |                 nil,
        test_1        |             -   nil,
        test_1        |             +   string("0103000000010000000500000000000000008056C0000000000000000000000000008056C0000000000080464000000000008046C0000000000080464000000000008046C0000000000000000000000000008056C00000000000000000"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         NULL::TIME AS "Col�101798",
        test_1        |                         st_geomfromgeohash('D':::STRING::STRING::STRING, NULL::INT4::INT4)::GEOMETRY AS col101799
        test_1        |                 )
        test_1        |                     AS tab50806
        test_1        |             ORDER BY
        test_1        |                 "Col�101798" ASC NULLS FIRST, col101799 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         NULL::TIME AS "Col�101798",
        test_1        |                         st_geomfromgeohash('D'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::GEOMETRY AS col101799
        test_1        |                 )
        test_1        |                     AS tab50806
        test_1        |             ORDER BY
        test_1        |                 "Col�101798" ASC NULLS FIRST, col101799 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (703.49s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 0fd3da5766a8553fca31bad5af32d9315f5e9bd4:

        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     --- FAIL: TestCompare/postgres (141.94s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2464682793/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("F1.8171205928321396589"),
        test_1        |             +   string("F1.81712059283214"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ('F':::STRING::STRING::STRING || cbrt(6:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::STRING
        test_1        |                             AS "co%ql139089"
        test_1        |                 )
        test_1        |                     AS "Tab82132"
        test_1        |             ORDER BY
        test_1        |                 "co%ql139089" DESC NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ('F'::TEXT::TEXT::TEXT || cbrt(6::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::TEXT
        test_1        |                             AS "co%ql139089"
        test_1        |                 )
        test_1        |                     AS "Tab82132"
        test_1        |             ORDER BY
        test_1        |                 "co%ql139089" DESC NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (771.10s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 0310d119569b59b9efe1b7bbc439c2c604217a4c:

        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (524.01s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare185791593/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("J2.0000000000000000000"),
        test_1        |             +   string("J2.0000000000000000"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ('J':::STRING::STRING::STRING || (4:::DECIMAL::DECIMAL::DECIMAL / 2:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::STRING
        test_1        |                             AS col795640
        test_1        |                 )
        test_1        |                     AS tab395980
        test_1        |             ORDER BY
        test_1        |                 col795640 NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ('J'::TEXT::TEXT::TEXT || (4::DECIMAL::DECIMAL::DECIMAL / 2::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::TEXT
        test_1        |                             AS col795640
        test_1        |                 )
        test_1        |                     AS tab395980
        test_1        |             ORDER BY
        test_1        |                 col795640 NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1155.10s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 556be3437fdba9f3d86126b3896ee68b9903b79e:

        test_1        |             +               Int:              s"29809579870417283",
        test_1        |             -               Exp:              -16,
        test_1        |             +               Exp:              -13,
        test_1        |                             Status:           2,
        test_1        |                             NaN:              false,
        test_1        |                             InfinityModifier: s"none",
        test_1        |                         },
        test_1        |                     },
        test_1        |                     Dimensions: {{Length: 1, LowerBound: 1}},
        test_1        |                     Status:     2,
        test_1        |                 },
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (NULL::DECIMAL[]::DECIMAL[] || exp(8:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::DECIMAL[]
        test_1        |                             AS "'col76624"
        test_1        |                 )
        test_1        |                     AS "tab\n50634"
        test_1        |             ORDER BY
        test_1        |                 "'col76624" DESC NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (NULL::DECIMAL[]::DECIMAL[] || exp(8::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::DECIMAL[]
        test_1        |                             AS "'col76624"
        test_1        |                 )
        test_1        |                     AS "tab\n50634"
        test_1        |             ORDER BY
        test_1        |                 "'col76624" DESC NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (693.20s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #109969 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.11-rc] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #108652 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.9-rc.FROZEN] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 6cbd07ee6fbfb92706e8cdc8c559960b1bc41663:

        postgres_1    |                 (date_trunc('F'::TEXT::TEXT::TEXT, '00:05:00'::TIME::TIME::TIME)::INTERVAL::INTERVAL / 0.0::FLOAT8::FLOAT8::FLOAT8)::INTERVAL
        postgres_1    |                     AS col720273
        postgres_1    |             FROM
        postgres_1    |                 postgres.public.table1 AS "t'ab393447"
        postgres_1    |             ORDER BY
        postgres_1    |                 "t'ab393447".col1_0 DESC NULLS LAST, "t'ab393447".col1_9
        postgres_1    |         )
        postgres_1    |             AS "tab,393448"
        postgres_1    |     ORDER BY
        postgres_1    |         "c ol720265" DESC,
        postgres_1    |         col720266 DESC NULLS LAST,
        postgres_1    |         "col%q720267",
        postgres_1    |         "c�ol720268",
        postgres_1    |         col720269 ASC NULLS LAST,
        postgres_1    |         "c""o
l720270" ASC NULLS FIRST,
        postgres_1    |         col720271 NULLS LAST,
        postgres_1    |         cõl😞720272 ASC,
        postgres_1    |         col720273 ASC NULLS FIRST
        test_1        | --- FAIL: TestCompare (1347.87s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (742.43s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '{"A": {"D": {"A": "C", "C": {"G": 9, "H": {"B": {"B": false, "J": true}, "I": "G", "J": "I"}}}, "J": {"A": 5, "C": {"D": {"J": 1}, "E": [null]}, "F": {"B": false, "H": [{"C": {"A": true, "G": {"B": null, "G": {"G": {"C": 7, "G": true, "J": {"A": {"C": {"G": [[{"A": {"B": {"E": {"C": "E", "J": {"B": "F", "C": {"J": {"E": {"G": {"B": null, "F": "D", "J": 5}}, "J": true}}, "J": {"H": false}}}}, "E": 4}, "D": {"H": "C", "I": [{"A": {"A": null, "D": {"F": {"B": null, "F": "G"}}}, "B": {"D": "G", "E": {"E": true, "G": [true, [{"G": {"J": 2}, "I": {"D": null}}]], "I": {"E": 0}}, "J": [{"E": [{"A": {"H": 0, "I": {"A": [true], "B": null}, "J": null}, "C": {"F": null}, "G": false}, {"F": {"B": "A", "D": [true, {"C": 7, "E": null, "J": false}, {"B": {"D": "C", "I": {"I": false}}, "D": [true, {"F": null, "G": "F", "I": null}], "E": {"E": {"A": {"E": {"D": {"G": {"B": [8, false]}, "I": true}, "I": {"C": null, "I": {"A": "F", "B": [[true, {"I": {"A": {"B": {"D": "I"}, "C": true, "H": ["J", [{"C": 2, "J": null}, {"F": ["F", "D", {"A": {"G": {"C": {"C": "I"}}}, "F": {"F": false}, "I": [null]}]}, true]]}, "C": 1, "E": "D"}}], "H", [false, {"C": {"E": {"D": {"A": [null, "H", "H"], "I": {"I": {"J": 0}, "J": {"D": {"H": "D", "J": [{"A": {"B": 1, "I": {"H": null, "I": false, "J": null}}, "H": true, "J": {"C": "H", "D": {"D": {"J": 2}, "E": {"A": null, "D": 2, "H": true}, "G": ["I", 7, false]}}}]}, "E": [null, false]}}}, "G": {"H": "H"}, "J": {"E": "E", "F": true}}, "F": null, "J": [{"J": false}, [{"A": "I", "B": {"H": {"B": "H", "D": [7, 9, 4], "E": null}}}, false], "E"]}}]], "C": [{"C": {"C": {"B": {"C": true, "J": null}, "F": {"A": {"A": true, "D": {"C": {"C": "D", "H": {"E": false}}, "F": true, "G": "D"}}}, "J": {"B": true, "E": {"E": [[{"E": {"D": {"C": "B", "J": {"H": [{"A": {"H": "G", "J": [{"C": true, "D": [{"D": {"C": "H", "G": {"G": {"F": true, "G": false}}}, "E": 8, "G": true}, {"D": false}]}, {"A": true}]}}], "J": {"F": {"C": false, "F": "A"}, "I": 8}}}}}, {"E": true, "G": {"B": false, "F": [{"A": false, "C": {"B": "E"}, "F": null}, "G"]}}], null, {"B": "B", "I": null, "J": "B"}], "H": false}}}, "J": [{"F": "I"}, {"F": true, "G": {"A": true, "E": {"F": null, "I": 3}}}, ["G", {"A": "J", "B": {"D": {"C": {"F": true}}, "H": true}, "J": {"F": true, "G": "F", "J": 2}}]]}, "I": "E"}, {"C": 1, "D": [{"H": false}, false, "D"], "J": {"C": ["E", {"G": {"D": false}, "I": [false]}]}}, {"G": true}]}}}}}, "H": true}}]}}, true], "G": {"C": 2, "E": "B"}, "I": {"H": true}}]}, "I": [false]}, {"I": {"B": [true], "C": {"A": 1, "D": {"D": {"B": {"A": [7], "C": {"G": [null, false]}}, "G": [false]}}, "H": {"C": false}}, "J": true}}, null]}, "J": {"G": true}}, [["I"], 8], null], [0, [{"I": null}, "E"], "A"], {"E": {"B": {"I": "J", "J": {"D": {"C": {"H": {"B": {"A": [0], "E": 7}, "F": "D", "J": {"A": false, "C": {"C": true, "F": {"B": {"E": true, "G": 2, "H": {"H": 4, "I": true}}, "C": null}, "H": 5}, "J": {"D": true, "E": true}}}, "J": true}}, "F": {"B": "A", "E": true, "G": [{"G": null}, {"I": 4}, null]}}}, "D": {"F": "A"}}, "F": {"D": {"E": null, "F": false}, "E": 5, "J": {"B": false, "H": "B", "I": {"I": {"G": {"D": "G", "E": {"A": 4, "H": "H"}, "J": "C"}, "J": {"A": {"I": true}, "I": {"F": {"C": 7}, "G": {"A": false, "H": [{"B": {"G": true}, "E": {"A": {"A": {"D": {"B": false}, "H": {"D": true, "G": null, "H": "B"}, "I": {"J": null}}, "J": 4}}}, {"C": [[{"C": [{"G": {"A": {"B": true, "C": {"B": {"I": {"C": null, "J": true}}, "F": {"D": {"D": {"A": 6, "F": 5}}, "J": {"D": "C", "E": false}}}, "I": false}, "B": {"I": {"E": {"B": false, "J": 2}}}}}], "E": {"G": {"F": true, "G": {"B": "A", "D": {"I": false}}}}}, {"E": ["C", null, {"E": {"B": 8, "H": [{"H": {"I": "B"}}, {"C": {"D": {"J": true}}}, null]}}], "H": [{"A": {"B": true, "E": {"D": {"D": [{"C": {"B": true, "C": {"A": {"F": "D", "I": true}}}, "G": [{"B": 2, "E": {"B": {"F": true, "I": {"B": [{"D": "B", "F": {"E": [null, {"B": {"E": 3}, "H": {"B": true, "D": {"H": [4, {"B": [null], "I": "H"}, {"E": [5, {"C": null, "G": {"I": 6}}, null], "I": {"A": {"B": null, "G": true, "I": {"F": {"C": {"A": 6, "G": {"G": 7}}, "E": 0}}}, "B": {"A": "C", "D": {"H": [{"G": {"B": false, "F": {"A": false, "E": 3}, "I": "J"}, "H": {"A": "G", "B": [{"J": {"F": [null], "I": null}}]}}, {"G": {"A": {"C": "A", "E": "A", "F": [false, {"G": {"J": {"D": false}}}]}}, "I": "G"}, [9, {"F": ["C", "E", true], "I": {"D": {"A": {"B": 9, "D": null, "G": {"E": {"B": true, "F": {"A": {"G": [{"A": {"G": {"B": {"E": null, "I": 0}, "C": true}, "H": 4}, "E": {"H": null, "I": {"E": null, "H": null}}}, false, [false, 6]], "J": {"D": {"A": {"C": {"H": true}, "E": "G"}, "E": {"B": true, "F": null}, "J": 1}, "E": 5}}, "F": {"B": true, "H": 4, "J": {"J": {"B": {"E": [[{"A": {"A": 4, "F": null}, "G": false, "H": false}], {"E": {"C": {"D": "C"}, "F": "H"}, "F": {"B": false, "C": null, "E": {"G": 8}}, "I": {"E": null, "I": "C", "J": false}}, 0]}, "G": null, "H": true}}}}, "H": {"C": {"A": {"F": {"E": "H", "J": {"E": "H"}}, "I": 0}, "G": 2}, "E": {"C": {"J": 7}}, "I": true}}, "G": {"A": {"C": true, "D": true, "I": false}, "D": true, "F": 7}, "H": {"A": "E", "F": null}}}, "E": 9, "F": 4}, "E": {"E": {"G": false}, "I": {"A": [null, [{"B": {"F": {"F": true, "I": "A"}, "G": null, "H": {"D": {"A": "H", "C": {"B": false, "E": {"A": [true]}, "J": "H"}, "F": "E"}}}}, {"F": [[{"C": {"G": {"F": true, "I": {"C": 7, "G": {"F": {"E": {"C": true, "F": [null]}, "H": false}, "H": {"A": "I"}}}, "J": [{"E": {"F": 1}, "J": [true, {"B": {"C": true}, "I": false}]}, {"D": "C", "F": null}, true]}, "H": 8}}, false, true], {"A": 0, "D": {"G": false}}, {"C": {"H": true}, "H": false}]}, {"F": {"A": null, "B": 4, "G": true}, "G": {"B": null}, "I": true}], {"D": null, "E": {"B": true}}]}}}}, "D"]], "I": [null]}, "F": "E"}}}]}}}, "G"], "H": {"I": {"A": {"A": false, "E": false}, "C": {"J": {"B": ["I", "A"]}}, "H": {"I": null}}}}, "J": 1}, {"D": {"A": {"B": 2}, "H": null}}, 2], "C": "J", "J": {"E": {"G": {"D": {"F": true}, "I": {"C": "G"}}}}}, "J": {"E": {"A": 8, "H": {"D": {"E": {"C": "E", "H": {"H": true}, "I": {"F": {"C": true, "E": false}}}, "G": {"A": 7}}, "G": {"F": "A"}, "H": [{"A": true}, {"B": {"C": false, "F": {"A": null, "B": true, "I": {"F": [true]}}, "H": "I"}, "E": true}, [true]]}}, "F": {"D": {"F": [{"B": {"A": true, "C": null}}, [true, "I"]], "J": {"J": 6}}}}}, "E": {"D": {"I": [false, {"A": true, "C": null, "G": [[{"I": "A", "J": {"I": {"C": {"D": {"A": {"E": ["F", {"I": null}, [{"C": [false], "I": {"B": false, "J": {"E": [{"D": {"H": {"G": {"F": 2}}}, "G": 4}, {"A": 6, "C": {"B": 2, "C": {"F": {"A": null}, "I": {"D": {"C": false, "I": null}}}, "D": {"A": {"B": "B", "C": null, "F": {"J": {"A": "C", "D": {"E": {"C": {"H": {"I": true, "J": false}, "J": true}}}}}}, "F": {"B": true, "H": {"G": {"D": {"G": true}, "F": null, "H": {"A": 3, "I": {"A": true, "C": true, "F": {"B": {"C": "F"}}}}}, "H": [null]}, "J": true}, "J": [{"E": 8}]}}}, {"A": {"A": {"E": 2}}, "J": {"J": null}}]}}}, {"C": {"F": {"F": 2}, "J": true}}]]}, "D": {"A": true, "F": "C", "H": false}}, "F": {"F": false, "G": true}, "I": 6}}, "J": false}}, {"A": null}, "D"], {"F": 0}]}, false]}, "E": true, "H": {"I": {"B": "E", "F": "G"}}}}, "I": null}]}], "G": 5}, "I": false, "J": {"A": 7}}}, "E": false, "I": "C"}, false]}, true], {"C": false, "G": {"H": {"E": 1}, "I": [[true]]}, "I": true}]}]}}}}}}}, "I": true}]}, "H": "B"}, "B": {"C": {"C": null, "D": [null, null]}, "G": false, "J": [{"G": {"E": {"D": {"C": [{"H": {"C": [{"I": {"B": {"C": [{"A": 4, "C": [[null, 3, true], "E", {"C": {"H": null}, "D": {"D": [null, null], "H": 2, "J": null}, "I": {"B": [true], "D": false}}], "E": {"F": null, "H": "D"}}]}, "H": {"C": [7, "F"], "J": 0}}}], "F": null}}, true, {"C": null}], "E": null}, "H": {"G": "D"}}, "G": false}, "H": null, "I": [8]}]}, "E": null}}}}}}, {"A": 6, "F": {"C": {"A": {"A": true}}}, "J": [null, {"F": 3, "H": false, "I": null}, {"F": false}]}]}}}, "C": {"F": [8, {"A": {"A": {"F": 5}, "E": {"G": true}}, "E": [{"A": "J", "B": false, "H": {"C": {"C": {"I": ["I"]}, "E": false, "H": {"E": {"F": false, "H": {"C": true, "F": {"F": ["H"], "G": "D"}}}}}}}]}, {"B": "F", "F": {"A": {"B": 2, "F": {"I": {"F": false, "H": true, "I": [{"D": null, "F": "H", "H": "H"}, {"A": {"B": 2, "F": "B"}}]}}}, "C": 0, "F": 1}}], "G": 2, "J": null}}':::JSONB::JSONB
        test_1        |                             AS "col%v720351"
        test_1        |                 )
        test_1        |                     AS "ta b 393506"
        test_1        |             ORDER BY
        test_1        |                 "col%v720351" NULLS LAST
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1373.12s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #109969 compose: TestComposeCompare failed [FROZEN.branch-release-23.1.11-rc O-robot T-sql-foundations] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #108652 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.9-rc.FROZEN] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ baeffe5fad6f73a3ab838df648f21a59ee32c10e:

        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-09-19 05:20:20.393 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-09-19 05:20:20.394 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-09-19 05:20:20.394 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-09-19 05:20:20.397 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-09-19 05:20:20.403 UTC [68] LOG:  database system was shut down at 2023-09-19 05:20:20 UTC
        postgres_1    | 2023-09-19 05:20:20.408 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-09-19 05:20:22.446 UTC [78] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2023-09-19 05:20:22.446 UTC [78] STATEMENT:  CREATE TABLE table2 (col2_0 DATE NOT NULL, col2_1 CHAR[] NOT NULL, "😮c
        postgres_1    |     ol2_2" JSONB NOT NULL, "%qcol2_3" INT2 NOT NULL, "col2_%544" BIT NOT NULL, "co'l2_""5" DECIMAL NULL, col2_6 REGROLE NOT NULL, col2_7 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("col2_%544" AS TEXT))) STORED, col2_8 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_1 IS NULL THEN ''::TEXT ELSE e';\x05\x1a'::TEXT END) STORED, col2_9 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_1 IS NULL THEN e'2M\bsh['::TEXT ELSE e'\x00'::TEXT END) STORED, col2_10 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_0 IS NULL THEN e'+\x11rX0\x02,'::TEXT ELSE e'\x03sp}\x12^s'::TEXT END) STORED, PRIMARY KEY ("col2_%544", col2_6));
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (lower(CAST("😮c
        postgres_1    |     ol2_2" AS TEXT)), col2_10 ASC, col2_9, lower(CAST("col2_%544" AS TEXT)) DESC);
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_0 ASC, (CASE WHEN col2_1 IS NULL THEN '7K2*``/'::TEXT ELSE e'\x04}'::TEXT END) ASC, col2_6 ASC, (CASE WHEN col2_0 IS NULL THEN e'\x05'::TEXT ELSE 'A'::TEXT END) ASC, "%qcol2_3", lower(CAST("col2_%544" AS TEXT)), col2_7, "co'l2_""5", col2_8, "😮c
        postgres_1    |     ol2_2" ASC);
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_1 ASC, "co'l2_""5" DESC) INCLUDE (col2_0, "😮c
        postgres_1    |     ol2_2", col2_10);
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_6, col2_10, "col2_%544");
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (606.12s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.11s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:172: CREATE TABLE table2 (col2_0 DATE NOT NULL, col2_1 CHAR[] NOT NULL, "😮c
        test_1        |             ol2_2" JSONB NOT NULL, "%qcol2_3" INT2 NOT NULL, "col2_%544" BIT NOT NULL, "co'l2_""5" DECIMAL NULL, col2_6 REGROLE NOT NULL, col2_7 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("col2_%544" AS TEXT))) STORED, col2_8 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_1 IS NULL THEN ''::TEXT ELSE e';\x05\x1a'::TEXT END) STORED, col2_9 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_1 IS NULL THEN e'2M\bsh['::TEXT ELSE e'\x00'::TEXT END) STORED, col2_10 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_0 IS NULL THEN e'+\x11rX0\x02,'::TEXT ELSE e'\x03sp}\x12^s'::TEXT END) STORED, PRIMARY KEY ("col2_%544", col2_6));
        test_1        |             CREATE UNIQUE INDEX ON table2 (lower(CAST("😮c
        test_1        |             ol2_2" AS TEXT)), col2_10 ASC, col2_9, lower(CAST("col2_%544" AS TEXT)) DESC);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_0 ASC, (CASE WHEN col2_1 IS NULL THEN '7K2*``/'::TEXT ELSE e'\x04}'::TEXT END) ASC, col2_6 ASC, (CASE WHEN col2_0 IS NULL THEN e'\x05'::TEXT ELSE 'A'::TEXT END) ASC, "%qcol2_3", lower(CAST("col2_%544" AS TEXT)), col2_7, "co'l2_""5", col2_8, "😮c
        test_1        |             ol2_2" ASC);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_1 ASC, "co'l2_""5" DESC) INCLUDE (col2_0, "😮c
        test_1        |             ol2_2", col2_10);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_6, col2_10, "col2_%544");
        test_1        |             
        test_1        |         compare_test.go:173: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (630.84s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ a499165ea61b1eb5f1d5fec826143126f9ba3258:

        postgres_1    |                 INNER JOIN postgres.public."t\\uA55Dable5" AS tab295717
        postgres_1    |                     INNER JOIN postgres.public."tablE2" AS "t ab295718" ON false::BOOL ON false::BOOL
        postgres_1    |             ORDER BY
        postgres_1    |                 "ta%pb295716".col1_3 NULLS FIRST
        postgres_1    |         )
        postgres_1    |             AS "Ta*b295719"
        postgres_1    |     ORDER BY
        postgres_1    |         co😪l558981 NULLS FIRST, "%pco l558982" ASC NULLS LAST, col558983 ASC NULLS FIRST, "col%p558984" DESC NULLS LAST
        test_1        | --- FAIL: TestCompare (1011.68s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (406.21s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1659356241/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   nil,
        test_1        |             +   string("01010000000000000000B063C00000000000E05040"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_pointfromgeohash('B':::STRING::STRING::STRING, NULL::INT4::INT4)::GEOMETRY AS col558985) AS tab295720
        test_1        |             ORDER BY
        test_1        |                 col558985 ASC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_pointfromgeohash('B'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::GEOMETRY AS col558985) AS tab295720
        test_1        |             ORDER BY
        test_1        |                 col558985 ASC;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1036.86s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 49eef749235f15d57153cb00f48dfd3b27be6c54:

        postgres_1    | 2023-09-21 05:29:39.171 UTC [79] STATEMENT:  SELECT
        postgres_1    |         *
        postgres_1    |     FROM
        postgres_1    |         (
        postgres_1    |             SELECT
        postgres_1    |                 xor_agg('\x47'::BYTEA::BYTEA::BYTEA)::BYTEA AS col614222
        postgres_1    |             FROM
        postgres_1    |                 postgres.public."t%qablE3" AS tab423051, postgres.public."t%qablE3" AS tab423052
        postgres_1    |             WHERE
        postgres_1    |                 NULL::BOOL
        postgres_1    |             GROUP BY
        postgres_1    |                 tab423052.tableoid
        postgres_1    |             HAVING
        postgres_1    |                 every(true::BOOL::BOOL)::BOOL
        postgres_1    |         )
        postgres_1    |             AS " tab423053"
        postgres_1    |     ORDER BY
        postgres_1    |         col614222 NULLS LAST
        test_1        | --- FAIL: TestCompare (1229.31s)
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (624.37s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '{"D": {"I": {"C": [null, {"I": {"F": {"A": null, "D": true, "G": 8}, "H": {"C": {"B": {"B": {"B": {"D": 8}}, "G": [true, [true, {"H": "A"}]], "J": {"H": {"G": [{"F": {"C": [[{"D": [[true, {"F": {"J": null}, "I": [7, {"E": [{"A": {"J": {"C": {"E": true}, "D": {"C": {"J": "J"}}, "H": 5}}, "C": 5, "G": ["I"]}, null], "I": {"E": {"A": false}, "J": {"C": true, "G": true}}, "J": false}]}]], "F": {"E": [{"F": {"E": {"C": {"A": {"I": {"F": {"B": null, "J": "G"}}}, "F": null, "J": null}, "D": "G", "J": ["D"]}, "J": {"A": null, "B": {"G": 8}}}, "I": {"D": {"I": "E"}, "E": {"H": false, "I": "G"}, "H": "J"}}, {"B": {"J": {"I": {"I": {"C": 0, "I": {"B": true}, "J": "C"}, "J": {"A": {"J": true}, "D": false, "E": "D"}}}}}]}, "H": 5}, {"H": {"H": true, "J": null}}, {"B": "G"}], {"B": false, "E": false}, 2]}, "H": [6, {"D": null, "E": {"A": null, "C": "E", "J": true}, "I": true}, {"I": {"D": [null], "J": [{"I": {"C": {"E": {"B": {"D": false}, "C": "D"}}}, "J": null}, [[{"E": null, "G": true}, 7], "H"], 2]}}]}, false, "I"]}}}, "H": null, "J": {"B": {"C": {"C": {"H": false}, "D": {"C": [false, {"J": "C"}]}, "H": 1}, "F": {"B": [1, 5, {"I": false}], "F": "C"}, "I": {"I": {"B": null, "H": null}, "J": ["J", [{"A": [{"F": {"E": {"J": {"A": false, "C": "I", "H": {"C": true, "I": 3}}}, "H": {"H": {"C": {"C": 1, "E": true}}}, "I": {"G": {"H": {"A": {"C": [4, "E", {"B": {"B": false, "F": false, "H": {"F": {"A": [null, {"H": "G"}, {"J": {"B": {"B": {"A": {"B": {"A": false, "B": {"C": 0, "E": 3, "I": 5}, "D": false}, "J": null}, "H": {"H": [null]}, "J": null}, "E": "E", "G": {"H": [true, {"J": true}]}}, "D": {"C": "A", "J": 7}, "J": null}}], "I": {"B": 5, "C": ["H", false, {"B": true, "I": {"D": {"C": {"B": {"G": {"F": {"C": {"I": [{"E": "H"}, {"D": true, "J": {"H": [{"B": {"A": [false, {"A": false, "F": {"B": 1}, "G": null}, [{"H": false, "J": [{"D": {"H": {"E": false, "F": "A"}}, "E": [{"C": {"E": false, "F": false, "J": {"A": ["G", {"D": {"C": false, "H": [null, {"H": [{"A": {"A": true}, "F": {"D": "D", "J": 8}, "I": 6}]}]}}, 5], "D": "B", "J": {"C": 0, "E": 1, "J": 6}}}, "E": false}, {"B": [true], "D": "H", "H": null}], "H": {"G": {"G": true, "H": "H"}}}, null]}, {"D": {"H": false}, "H": "G", "I": {"I": 4}}]], "C": false, "I": null}, "I": {"C": "D", "J": {"H": {"C": "J", "J": {"C": false, "G": {"B": 8}, "I": "A"}}, "I": null, "J": {"C": {"A": {"G": {"C": [{"H": "D"}, 4, {"A": "E", "F": "G", "G": {"C": 6, "G": false, "J": {"B": false, "C": false, "G": null}}}], "D": false, "E": {"B": false}}}, "H": [{"B": {"B": true, "E": {"A": false, "C": {"A": null, "C": true, "I": true}, "D": {"B": {"J": [[{"C": {"C": 1}, "G": 6}, {"A": 3, "E": 6}], {"A": true, "C": false}]}, "E": {"B": ["A"], "I": 1}, "H": false}}, "H": true}, "D": [null]}, {"D": {"F": 3, "H": {"A": {"D": true}}}, "E": "D", "H": 1}, "E"]}, "E": true}}}, "J": false}, false]}}]}, "D": {"B": {"C": {"D": {"B": {"A": {"G": {"B": null, "G": true, "I": null}}, "G": {"B": false, "D": true}}, "J": 0}, "G": null, "J": null}, "I": {"E": {"E": null, "H": {"E": null}}, "G": true, "H": [[{"A": true, "J": true}], "H"]}}, "E": {"F": null, "J": false}}, "F": false}, "G": {"C": {"D": 1}, "E": {"G": "B"}, "F": {"D": {"G": [{"C": {"H": {"D": false, "G": {"H": {"A": {"D": null, "E": false}, "H": [true]}}}, "I": false}, "H": false}, 4], "I": true}, "J": "G"}}}, "H": true}}, "E": [[{"B": {"E": true, "F": 5, "G": true}}, false, {"J": {"B": {"E": {"A": {"A": [{"C": false}, "I", {"A": {"F": {"G": {"H": {"D": true, "I": 5}}, "J": {"B": {"C": {"F": "C", "I": {"F": true, "G": [false]}}, "E": true}}}}, "B": null, "D": {"E": {"F": {"D": false, "J": {"A": "A", "E": null, "G": {"H": 9}}}}, "F": null, "H": {"B": {"D": false, "F": "D", "G": null}, "D": {"C": {"B": "H", "F": false}}}}}], "I": {"J": true}}}, "F": null, "J": {"A": {"B": "A", "G": {"F": {"G": true, "J": null}}}, "J": {"A": {"B": {"J": {"C": [3, true, true], "E": [false, [[{"D": {"C": true, "F": "B"}, "J": 8}]], {"A": {"F": {"E": false, "I": {"H": {"E": false}, "I": true}}, "H": false}, "F": false}]}}, "C": {"G": "C"}}, "D": true, "E": {"G": {"F": false}}}}}, "G": "A"}}]], "I": {"H": "E", "J": null}}, "I": {"I": ["A", "E"]}}}], "I": {"A": false, "C": null}}}}}, "G": false, "I": 4}], "H": [{"A": {"C": null, "H": {"C": false}}}]}, "D": {"A": true, "C": {"E": {"B": {"C": {"J": {"H": {"H": {"H": 1}}}}, "G": {"A": false, "D": false}, "J": {"F": true, "H": {"B": {"A": true}, "I": {"G": {"B": {"B": 7, "E": {"C": "H", "G": false, "H": "A"}, "I": {"A": "J"}}, "C": [null, 6], "J": {"J": null}}}}}}, "D": {"B": {"A": 9, "E": [9]}}, "G": false}, "F": true}, "G": "E"}, "H": false}}, "I": "I"}}}]}, {"B": {"F": {"B": [{"B": {"B": true, "C": false}, "G": 2, "J": 6}]}, "J": "D"}, "F": {"A": 8, "I": {"B": null}, "J": {"D": {"G": {"J": {"C": {"C": {"A": {"B": {"D": 8, "E": {"A": null}}, "D": {"A": {"C": null}, "C": [null]}}, "C": [{"G": {"C": {"D": {"C": "B"}, "G": {"E": false, "G": "A"}, "I": "B"}, "G": ["C", {"C": null, "I": {"D": true, "I": "G"}}, null]}}, "D", true]}, "E": 3, "H": [null, {"I": {"A": {"B": {"F": [false], "G": {"E": {"B": 5, "F": 9, "I": true}, "G": "G", "I": {"F": true}}, "H": {"D": {"B": null, "H": "D", "J": "D"}, "F": false}}, "F": false, "I": {"A": {"A": {"B": null, "E": {"E": true, "J": false}, "F": {"G": {"B": {"E": true, "J": null}, "F": {"D": [7, {"I": "J"}, {"B": {"B": {"B": {"B": 7, "E": null, "J": {"H": ["G"]}}, "D": {"E": "F"}}, "C": {"F": {"A": null, "C": {"B": {"D": "J", "F": null}, "G": true, "I": false}}}, "F": null}, "C": false, "G": {"E": null, "G": [{"B": {"H": {"H": "E", "I": [{"E": [false, {"A": {"F": [null]}, "C": {"F": {"B": {"A": {"C": 5}}}, "H": {"A": [false], "G": {"H": {"B": {"B": {"I": true}, "H": [[true, {"A": {"G": 3, "J": {"A": null, "E": 0, "J": "J"}}}, {"B": true, "C": {"C": "H", "J": {"F": "A"}}}], false, false]}, "D": 8, "I": false}}}}, "D": "H"}, {"J": {"B": "B", "C": {"C": 6}, "G": false}}], "G": true}]}}}, null, {"D": {"C": true, "D": {"A": {"G": false}, "C": {"B": {"A": null, "F": 4}, "G": [{"D": {"C": {"I": {"D": "C", "F": {"D": [{"I": {"J": {"B": false, "C": null, "E": "E"}}}, {"E": {"D": {"I": {"A": {"F": {"B": true, "D": {"G": {"C": false, "D": {"B": [false, {"G": "F"}, "I"], "C": "B", "G": false}}}}, "I": false, "J": null}, "B": true, "D": {"E": null}}}, "E": {"D": 5, "G": false, "I": {"A": null, "J": {"C": {"B": {"C": null, "D": 9, "J": [true, "D", false]}, "C": [false], "I": false}}}}}}, [{"C": false, "F": [true], "G": {"D": 3}}, 6]], "F": {"E": {"D": 7, "I": true}}, "H": false}}}, "H": 1}}, false]}, "E": {"I": 7}}}}], "J": false}}], "E": "H", "H": null}, "I": 0}}}}, "D": false}}, "C": [{"B": {"A": null, "B": [{"C": {"G": {"B": {"G": false, "H": [{"B": "D", "C": {"C": {"I": {"F": {"A": null}}, "J": {"F": {"D": {"A": 5, "C": {"D": false, "H": {"E": {"B": [true], "D": 8}, "F": {"H": [{"I": "D"}, "C"], "I": true}, "I": null}, "J": {"E": false, "I": false}}, "F": {"C": false, "D": [false, {"B": {"F": [7, {"E": null}, "H"], "G": "G", "J": {"F": true}}, "C": {"D": {"E": true}, "F": {"H": "G"}}, "J": {"C": {"J": null}, "F": {"C": {"F": {"C": true, "I": {"J": {"H": {"C": {"A": {"G": [{"B": {"F": true}, "E": {"A": {"F": "B"}, "J": null}}, {"A": true}, {"E": "I"}]}}}}}}, "I": {"F": 6, "I": null}}, "G": 2, "J": true}}}, "F"]}}, "I": null}}}, "F": {"D": {"G": [[true, "F"], {"F": false}]}, "E": 3, "J": false}}, "J": true}, false], "J": [{"F": [[["B", {"A": "J", "B": false, "F": "I"}, null], 1], [null, false, 4], null]}, true]}, "F": false}, "I": {"C": "C", "G": {"F": [null, {"A": {"A": {"E": false}}, "I": [{"B": false, "C": {"C": [true, 8]}}, [{"A": {"C": {"A": null, "B": "J", "D": true}, "G": {"C": false}, "J": 4}, "G": 6}, {"B": null, "G": true, "H": {"A": null}}, false]]}]}, "J": true}}}, false], "E": null}, "F": {"E": {"D": false, "E": [true, false, [false, true, 1]]}, "H": {"I": null}, "J": 0}}, false, true], "H": [{"B": false, "E": {"B": true, "C": {"A": {"F": {"B": {"B": 1}, "D": "F", "J": 5}}, "C": true}, "E": {"A": [{"A": "I", "E": {"A": [false, {"A": {"B": {"A": {"I": [{"G": {"D": false, "H": null, "I": {"B": {"G": {"H": true}, "J": {"B": [[{"C": true}, {"G": false, "H": {"F": {"F": {"B": [false, true], "D": null}}}}, 4], {"C": {"H": 6}, "H": true}, {"F": "J", "G": {"A": [4], "H": true}}], "C": {"A": true, "B": [{"C": {"H": [[{"C": 3, "H": null, "J": 9}], {"A": {"D": {"A": {"A": null, "F": "H"}, "B": {"A": {"A": {"A": 8}, "B": {"G": {"A": ["E"], "E": {"I": null}}, "J": 4}, "I": "G"}}, "J": {"H": false}}, "G": {"A": "G", "D": {"D": {"A": false, "F": "C", "J": {"A": {"H": null, "J": {"E": "H", "G": true}}, "H": {"E": [null, 3], "H": {"I": ["F", {"I": [["I"], 4, true]}, "I"]}, "J": false}}}, "I": null, "J": {"C": null, "J": "B"}}, "F": [{"A": null, "D": "D", "E": {"A": null, "D": 6}}]}}, "G": 5}]}, "J": 6}, {"F": {"A": "A"}, "I": [true], "J": null}], "G": false}}}}}, "H": [{"B": true, "I": {"E": true, "H": [{"A": false, "D": false, "G": {"I": {"B": {"G": {"B": [{"B": {"F": {"A": {"G": [null, {"A": null, "C": {"A": {"H": [true, false, "H"], "I": {"B": {"C": {"B": [null, {"I": "G"}, true], "H": {"H": {"D": {"E": true}, "I": {"B": {"B": 9, "F": true, "G": [{"F": true, "I": [{"J": true}]}, {"I": {"E": {"D": {"G": false, "J": 6}, "F": [null, {"B": true, "C": 5, "D": [{"C": {"C": false, "I": "E"}, "G": {"C": {"A": true, "D": true}, "G": {"G": null}}, "J": 9}, [{"A": null, "G": {"D": "G", "G": 7}}, true, {"I": "I"}], false]}]}, "H": "G"}}]}, "E": 3, "G": "I"}}}, "J": {"B": 2, "G": [{"J": [null, {"A": 6}]}]}}, "E": 0}, "F": 9, "H": {"A": 1, "C": {"E": {"D": ["E", 4]}}}}, "J": {"A": false, "G": true, "H": "B"}}, "C": {"C": null}}, "F": {"H": [null, {"F": {"I": true, "J": {"C": [false, [null, [null], {"E": false}]], "F": 4}}, "H": ["J", 4]}, "I"], "J": {"B": [[7], 8], "F": false}}}, true]}, "D": 6, "E": [{"F": "J"}, [true, false, {"E": false, "F": null, "H": {"F": [null], "J": true}}]]}, "H": [true, true]}}, {"E": true, "J": null}], "C": {"E": {"C": null, "D": null, "J": "C"}, "G": {"A": {"E": false, "H": {"F": {"E": {"B": 5, "I": null}}, "H": {"E": {"F": {"B": false}}}}}, "C": {"A": "G"}}}, "D": true}}, "H": {"E": null, "F": {"C": "C", "F": false}, "I": [[9, [true, 6], true]]}}, "J": false}}, {"F": {"B": null}}]}}, null]}]}, "C": {"I": {"G": false, "H": {"F": {"C": null}}, "J": 7}}, "I": true}, "F": {"D": false, "G": [[{"A": {"B": "H"}, "H": "F"}]], "J": false}}, "E": {"E": {"A": {"H": 1, "J": [null]}, "G": {"A": "G", "B": null, "F": {"D": {"B": {"G": "C"}}}}}, "F": {"A": true, "I": {"F": {"D": [true, true, {"D": true, "H": {"J": {"F": {"A": 6}, "J": false}}, "I": {"C": {"F": false, "I": {"J": {"A": {"I": {"A": {"A": 4, "C": null, "I": {"G": null}}, "D": null}, "J": 6}, "E": "B", "J": false}}}}}]}, "H": false}}, "H": {"A": true}}, "J": {"C": 4, "D": {"B": {"G": [true, 5, "I"]}, "C": 7}, "I": 9}}, false], "D": {"G": {"C": {"C": {"A": "H", "H": {"B": true, "D": false, "J": {"D": {"A": [null, 1, false], "D": {"F": null}, "J": null}, "G": {"D": true, "G": {"B": [false, ["E"]], "C": {"A": {"J": [null, true]}, "H": [{"F": {"B": {"B": {"A": "I"}, "G": {"E": {"F": {"D": {"A": null}, "J": 0}, "I": ["C", "G", [2, false]]}}}, "E": {"H": 7}}, "J": {"B": [{"B": {"B": "I", "F": null}}, false]}}, 0, {"A": {"J": {"I": "E"}}, "G": 0}], "I": "E"}, "D": "G"}}}}}, "J": false}, "D": {"I": {"A": true, "J": [{"F": {"A": null}, "I": {"A": {"E": {"I": {"C": true}}, "F": {"D": {"C": [{"B": {"A": null, "F": {"B": ["G", {"B": false}], "H": 8}}}], "G": {"D": true, "E": "I"}}, "H": {"B": {"C": "F"}}}}, "C": "H", "E": null}}, true, {"I": true, "J": {"E": {"F": {"H": 9, "I": false}}}}]}, "J": {"A": {"D": true, "E": {"C": false, "J": true}}, "F": false}}}}}}, true, false], "C": true, "J": "J"}}, "H": null}, [false, 0, null]]}}]}, "E": null, "F": "D"}}}}}, "G": [3]}, [null, {"B": {"C": {"C": true}, "H": null}, "E": [{"B": true}, 2], "G": [true]}, {"B": [false, {"H": true}]}]], false]}}}}, "G": [6]}, "J": {"F": ["C", {"C": {"A": ["D"], "H": true}, "E": [{"B": {"H": {"C": {"I": [{"A": "G"}, null, false]}, "F": {"H": "F", "I": 4}, "J": {"B": "A", "F": null, "G": {"A": null}}}, "J": {"C": null, "H": [false, {"A": "B", "E": {"F": {"E": {"H": [null, {"H": {"D": 2, "G": {"G": "C"}}, "J": true}, {"E": {"C": {"I": 4}}, "F": {"D": false, "E": "H", "J": {"C": false}}, "H": {"J": null}}]}, "H": {"C": [true], "F": {"A": true, "B": [true], "D": {"I": 9}}, "J": {"F": [{"A": "D", "D": {"D": {"A": [null, 8, true], "C": "B", "E": false}, "E": {"D": {"H": false}}}, "H": true}, {"E": {"A": null, "B": false}, "I": 4}, null]}}, "I": {"G": true}}}, "G": null}]}}, "G": null, "J": "D"}, [{"E": 9, "I": 6}, "D", false], true], "J": 7}], "J": {"C": {"F": "B", "H": false}, "D": {"H": {"B": 8, "G": [{"A": {"A": {"B": {"A": "E", "H": true, "J": 6}, "C": true}, "D": {"D": {"H": null}, "I": {"D": "J"}}, "I": {"B": {"B": {"B": {"H": {"A": [null], "E": 5, "F": null}, "J": [null]}, "F": false, "I": 3}, "E": false}}}, "F": true}, [{"D": null, "E": {"D": {"E": false}}}, false], {"D": {"B": {"B": null, "D": "I"}}, "I": true}], "J": {"E": null, "F": false}}, "J": {"G": {"D": true, "H": true}}}, "G": [{"B": {"D": false}, "D": {"F": 8}, "J": "H"}, false]}}}, "J": {"B": false, "C": {"G": true, "H": {"E": {"B": "I", "D": true, "E": {"D": {"B": [{"I": {"D": {"D": {"B": true}, "E": {"A": {"J": {"G": true, "I": true, "J": [true, true]}}, "B": {"H": 7}, "I": {"I": "E"}}}, "H": {"A": "F", "H": {"F": [null], "G": {"H": false, "I": "H"}}, "I": {"H": {"B": "D", "D": {"C": {"A": "C"}, "G": 2}}}}, "I": null}}, true, false]}, "G": true, "H": {"B": true, "H": {"F": true, "J": {"A": false, "B": [6, [[[7, [{"B": {"A": null, "B": {"D": false, "G": {"A": [null], "C": "J"}}}, "C": true, "F": null}, false, {"C": true}]], true, {"A": false, "C": null}], {"E": {"A": false, "D": {"A": false, "D": {"A": true, "B": 4}}, "G": [{"I": "D"}, false]}}], false], "C": {"H": "E"}}}, "J": 5}}}}}}}], "E": false, "I": {"B": false, "I": {"E": "E", "G": [true], "J": [false]}}}}, "E": false}':::JSONB::JSONB
        test_1        |                             AS col614223
        test_1        |                 )
        test_1        |                     AS tab423054
        test_1        |             ORDER BY
        test_1        |                 col614223 NULLS FIRST
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1254.38s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 43326b23c9057251908704088cbb04854a6c4b57:

        test_1        |                         {
        test_1        |             -               Int:              s"14142135623730950488",
        test_1        |             +               Int:              s"1414213562373095",
        test_1        |             -               Exp:              -19,
        test_1        |             +               Exp:              -15,
        test_1        |                             Status:           2,
        test_1        |                             NaN:              false,
        test_1        |                             InfinityModifier: s"none",
        test_1        |                         },
        test_1        |                     },
        test_1        |                     Dimensions: {{Length: 1, LowerBound: 1}},
        test_1        |                     Status:     2,
        test_1        |                 },
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (sqrt(2:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[] AS col68987
        test_1        |                 )
        test_1        |                     AS tab35058
        test_1        |             ORDER BY
        test_1        |                 col68987 DESC NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (sqrt(2::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[] AS col68987
        test_1        |                 )
        test_1        |                     AS tab35058
        test_1        |             ORDER BY
        test_1        |                 col68987 DESC NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (679.78s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #111157 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.11-rc] - #109969 compose: TestComposeCompare failed [FROZEN.branch-release-23.1.11-rc O-robot T-sql-foundations] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #108652 compose: TestComposeCompare failed [O-robot T-sql-foundations TODO-deprecate.branch-release-23.1.9-rc] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 43326b23c9057251908704088cbb04854a6c4b57:

        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | 
        postgres_1    | waiting for server to shut down...2023-09-25 05:20:23.783 UTC [49] LOG:  received fast shutdown request
        postgres_1    | .2023-09-25 05:20:23.784 UTC [49] LOG:  aborting any active transactions
        postgres_1    | 2023-09-25 05:20:23.786 UTC [49] LOG:  background worker "logical replication launcher" (PID 56) exited with exit code 1
        postgres_1    | 2023-09-25 05:20:23.789 UTC [51] LOG:  shutting down
        postgres_1    | 2023-09-25 05:20:23.885 UTC [49] LOG:  database system is shut down
        test_1        | I230925 05:20:23.932037 9 testutils/soon.go:42  [-] 1  SucceedsSoon: failed to connect to ``host=postgres user=postgres database=postgres``: dial error (dial tcp 172.18.0.3:5432: connect: connection refused)
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-09-25 05:20:24.004 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-09-25 05:20:24.004 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-09-25 05:20:24.004 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-09-25 05:20:24.007 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-09-25 05:20:24.012 UTC [68] LOG:  database system was shut down at 2023-09-25 05:20:23 UTC
        postgres_1    | 2023-09-25 05:20:24.016 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-09-25 05:20:25.932 UTC [78] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2023-09-25 05:20:25.932 UTC [78] STATEMENT:  CREATE TABLE """table1" (col1_0 DECIMAL NOT NULL, col1_1 UUID, col1_2 TSQUERY NULL, col1_3 BOOL NOT NULL, "col1%1c_4" TIMESTAMPTZ NOT NULL, "(col1""_ 5" DATE NOT NULL, col1_6 REGCLASS, col1_7 CHAR NOT NULL, col1_8 TSQUERY NOT NULL, "col1 _9" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col1%1c_4" IS NULL THEN e'o\x1aYd'::TEXT ELSE 'eG>z'::TEXT END) STORED, col1_10 TEXT NOT NULL GENERATED ALWAYS AS (lower(col1_7)) STORED, col1_11 TEXT GENERATED ALWAYS AS (CASE WHEN col1_6 IS NULL THEN '/[nM'::TEXT ELSE e'\x01'::TEXT END) STORED, col1_12 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col1%1c_4" IS NULL THEN '8rH'::TEXT ELSE e'\x0b\x06B\fKASv'::TEXT END) STORED, "co l1_13" TEXT GENERATED ALWAYS AS (CASE WHEN col1_6 IS NULL THEN e'\x0bzJ\nsWis'::TEXT ELSE 'M,YV|h'::TEXT END) STORED, "c ol1_14" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col1%1c_4" IS NULL THEN e'\x1fN'::TEXT ELSE ''::TEXT END) STORED, ")'col1%p_15" TEXT GENERATED ALWAYS AS (lower(CAST(col1_1 AS TEXT))) STORED);
        postgres_1    |     CREATE INDEX ON """table1" (col1_12 ASC, col1_10, col1_1 ASC, col1_0 DESC, lower(CAST(col1_8 AS TEXT)) DESC, (col1_0 + 7.762497085721593048E+35::DECIMAL) ASC, col1_3) INCLUDE (col1_2, "col1%1c_4", "(col1""_ 5", col1_7, col1_8);
        postgres_1    |     CREATE UNIQUE INDEX ON """table1" (col1_6 DESC, col1_11 ASC, (CASE WHEN "(col1""_ 5" IS NULL THEN e'\x00'::TEXT ELSE e'\'\b=\x06\x1b(\x05mo'::TEXT END), col1_12 ASC, "col1%1c_4" DESC, col1_1);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (606.34s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.99s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:172: CREATE TABLE """table1" (col1_0 DECIMAL NOT NULL, col1_1 UUID, col1_2 TSQUERY NULL, col1_3 BOOL NOT NULL, "col1%1c_4" TIMESTAMPTZ NOT NULL, "(col1""_ 5" DATE NOT NULL, col1_6 REGCLASS, col1_7 CHAR NOT NULL, col1_8 TSQUERY NOT NULL, "col1 _9" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col1%1c_4" IS NULL THEN e'o\x1aYd'::TEXT ELSE 'eG>z'::TEXT END) STORED, col1_10 TEXT NOT NULL GENERATED ALWAYS AS (lower(col1_7)) STORED, col1_11 TEXT GENERATED ALWAYS AS (CASE WHEN col1_6 IS NULL THEN '/[nM'::TEXT ELSE e'\x01'::TEXT END) STORED, col1_12 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col1%1c_4" IS NULL THEN '8rH'::TEXT ELSE e'\x0b\x06B\fKASv'::TEXT END) STORED, "co l1_13" TEXT GENERATED ALWAYS AS (CASE WHEN col1_6 IS NULL THEN e'\x0bzJ\nsWis'::TEXT ELSE 'M,YV|h'::TEXT END) STORED, "c ol1_14" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col1%1c_4" IS NULL THEN e'\x1fN'::TEXT ELSE ''::TEXT END) STORED, ")'col1%p_15" TEXT GENERATED ALWAYS AS (lower(CAST(col1_1 AS TEXT))) STORED);
        test_1        |             CREATE INDEX ON """table1" (col1_12 ASC, col1_10, col1_1 ASC, col1_0 DESC, lower(CAST(col1_8 AS TEXT)) DESC, (col1_0 + 7.762497085721593048E+35::DECIMAL) ASC, col1_3) INCLUDE (col1_2, "col1%1c_4", "(col1""_ 5", col1_7, col1_8);
        test_1        |             CREATE UNIQUE INDEX ON """table1" (col1_6 DESC, col1_11 ASC, (CASE WHEN "(col1""_ 5" IS NULL THEN e'\x00'::TEXT ELSE e'\'\b=\x06\x1b(\x05mo'::TEXT END), col1_12 ASC, "col1%1c_4" DESC, col1_1);
        test_1        |             
        test_1        |         compare_test.go:173: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (630.25s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 10d282dc9045ebb8b3faaf891706a13b08177949:

        test_1        |                         },
        test_1        |                     },
        test_1        |                     Dimensions: {{Length: 1, LowerBound: 1}},
        test_1        |                     Status:     2,
        test_1        |                 },
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         COALESCE(
        test_1        |                             (exp(9:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[],
        test_1        |                             NULL::DECIMAL[]
        test_1        |                         )
        test_1        |                             AS col336080
        test_1        |                 )
        test_1        |                     AS "tab%v189612"
        test_1        |             ORDER BY
        test_1        |                 col336080 ASC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         COALESCE(
        test_1        |                             (exp(9::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || NULL::DECIMAL[]::DECIMAL[])::DECIMAL[],
        test_1        |                             NULL::DECIMAL[]
        test_1        |                         )
        test_1        |                             AS col336080
        test_1        |                 )
        test_1        |                     AS "tab%v189612"
        test_1        |             ORDER BY
        test_1        |                 col336080 ASC;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (744.21s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 4b2badd7bc6c11a7646e66b131f5bcaf8328916a:

        postgres_1    |             SELECT
        postgres_1    |                 " %vtab301225".col4_2 AS "coL530570", NULL::BOX2D AS col530571, 5::INT8::INT4 AS "\\uC376col😊530572"
        postgres_1    |             FROM
        postgres_1    |                 postgres.public."t""aBle4" AS " %vtab301225"
        postgres_1    |         )
        postgres_1    |             AS "t%qab301226"
        postgres_1    |     ORDER BY
        postgres_1    |         "coL530570" DESC NULLS LAST, col530571 DESC NULLS FIRST, "\\uC376col😊530572" NULLS FIRST
        test_1        | --- FAIL: TestCompare (970.52s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (365.22s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare3207589023/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   int32(0),
        test_1        |             +   int32(1),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT int4(asinh(1.0:::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::INT4 AS col530635) AS "ta'b301266"
        test_1        |             ORDER BY
        test_1        |                 col530635 DESC NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT int4(asinh(1.0::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::INT4 AS col530635) AS "ta'b301266"
        test_1        |             ORDER BY
        test_1        |                 col530635 DESC NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (995.28s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #111157 compose: TestComposeCompare failed [C-test-failure FROZEN.branch-release-23.1.11-rc O-robot T-sql-queries] - #109969 compose: TestComposeCompare failed [FROZEN.branch-release-23.1.11-rc O-robot T-sql-foundations] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #108652 compose: TestComposeCompare failed [O-robot T-sql-foundations TODO-deprecate.branch-release-23.1.9-rc] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 2111b61b2d7c789bc03b1e9392062df80c779075:

        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-09-28 05:20:56.132 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-09-28 05:20:56.132 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-09-28 05:20:56.132 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-09-28 05:20:56.135 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-09-28 05:20:56.140 UTC [68] LOG:  database system was shut down at 2023-09-28 05:20:56 UTC
        postgres_1    | 2023-09-28 05:20:56.145 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-09-28 05:20:58.043 UTC [78] ERROR:  invalid input syntax for type numeric: "Infinity" at character 1182
        postgres_1    | 2023-09-28 05:20:58.043 UTC [78] STATEMENT:  CREATE TABLE table1 (co😸l1_0 INTERVAL NOT NULL, col1_1 BOOL NOT NULL, col1_2 REGTYPE, "c%pol1_3" DATE NOT NULL, col1_4 PG_LSN, col1_5 DECIMAL NULL, col1_6 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN co😸l1_0 IS NULL THEN e'I\x7fS\x19\x17\x1b'::TEXT ELSE e'p\x06@/.'::TEXT END) STORED);
        postgres_1    |     CREATE INDEX ON table1 (col1_5 ASC, co😸l1_0 ASC, (col1_5 + (-0.1119402431171790351)::DECIMAL) DESC, "c%pol1_3" ASC, col1_2 DESC);
        postgres_1    |     CREATE INDEX ON table1 ("c%pol1_3", col1_2 ASC, col1_1, col1_6 DESC, col1_4 ASC, co😸l1_0) INCLUDE (col1_5);
        postgres_1    |     CREATE INDEX ON table1 (col1_1 ASC, col1_5 ASC, lower(CAST(col1_1 AS TEXT)), "c%pol1_3" DESC, col1_2 DESC) INCLUDE (co😸l1_0, col1_4);
        postgres_1    |     CREATE INDEX ON table1 (col1_1, col1_5 ASC) INCLUDE (col1_2, "c%pol1_3");
        postgres_1    |     CREATE UNIQUE INDEX ON table1 (col1_4 ASC, col1_2 ASC, col1_6 ASC, "c%pol1_3");
        postgres_1    |     CREATE UNIQUE INDEX ON table1 (col1_4 ASC) INCLUDE (co😸l1_0, col1_2, "c%pol1_3", col1_5);
        postgres_1    |     CREATE UNIQUE INDEX ON table1 ((CASE WHEN col1_2 IS NULL THEN e'9"!Wi\x10'::TEXT ELSE e'\x0b'::TEXT END), col1_4, col1_1 DESC, col1_2, "c%pol1_3" DESC, co😸l1_0, col1_5 DESC);
        postgres_1    |     CREATE UNIQUE INDEX ON table1 ("c%pol1_3", col1_6 ASC, co😸l1_0 DESC, col1_1 ASC, col1_5 DESC, (col1_5 + 'Infinity'::DECIMAL) DESC, col1_4);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (606.17s)
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (0.97s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:172: CREATE TABLE table1 (co😸l1_0 INTERVAL NOT NULL, col1_1 BOOL NOT NULL, col1_2 REGTYPE, "c%pol1_3" DATE NOT NULL, col1_4 PG_LSN, col1_5 DECIMAL NULL, col1_6 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN co😸l1_0 IS NULL THEN e'I\x7fS\x19\x17\x1b'::TEXT ELSE e'p\x06@/.'::TEXT END) STORED);
        test_1        |             CREATE INDEX ON table1 (col1_5 ASC, co😸l1_0 ASC, (col1_5 + (-0.1119402431171790351)::DECIMAL) DESC, "c%pol1_3" ASC, col1_2 DESC);
        test_1        |             CREATE INDEX ON table1 ("c%pol1_3", col1_2 ASC, col1_1, col1_6 DESC, col1_4 ASC, co😸l1_0) INCLUDE (col1_5);
        test_1        |             CREATE INDEX ON table1 (col1_1 ASC, col1_5 ASC, lower(CAST(col1_1 AS TEXT)), "c%pol1_3" DESC, col1_2 DESC) INCLUDE (co😸l1_0, col1_4);
        test_1        |             CREATE INDEX ON table1 (col1_1, col1_5 ASC) INCLUDE (col1_2, "c%pol1_3");
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_4 ASC, col1_2 ASC, col1_6 ASC, "c%pol1_3");
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_4 ASC) INCLUDE (co😸l1_0, col1_2, "c%pol1_3", col1_5);
        test_1        |             CREATE UNIQUE INDEX ON table1 ((CASE WHEN col1_2 IS NULL THEN e'9"!Wi\x10'::TEXT ELSE e'\x0b'::TEXT END), col1_4, col1_1 DESC, col1_2, "c%pol1_3" DESC, co😸l1_0, col1_5 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table1 ("c%pol1_3", col1_6 ASC, co😸l1_0 DESC, col1_1 ASC, col1_5 DESC, (col1_5 + 'Infinity'::DECIMAL) DESC, col1_4);
        test_1        |             
        test_1        |         compare_test.go:173: postgres: exec: ERROR: invalid input syntax for type numeric: "Infinity" (SQLSTATE 22P02)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (630.86s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 27e7c166b5591b0e05bb2fd23780309b490d7af9:

        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.00s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 174 [running]:
        test_1        | testing.tRunner.func1.2({0x23c8900, 0xc0007d29e0})
        test_1        |     GOROOT/src/testing/testing.go:1526 +0x24e
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1529 +0x39f
        test_1        | panic({0x23c8900, 0xc0007d29e0})
        test_1        |     GOROOT/src/runtime/panic.go:884 +0x213
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x481b780?, {0x337f268?, 0xc0010aacf0?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:377 +0x445
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x3341a20?, 0x481b780)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:310 +0x13c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc001298000)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:227 +0x96
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc0010aaf00, {0xc0010aaf30?, 0x3, 0xc0010aaf00?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:260 +0x8b1
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0xc0007b5968?, 0x25e08b8?, {0xc0010aaf30?, 0x21f3d80?, 0x44a501?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:98 +0x2e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc0007c4c80?, {0x25e08b8, 0x5}, 0x3, 0x80?, {0xc000ab9a48, 0x3, 0x45c6e5d?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x13d
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0x1?, 0x618160?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:118 +0x177
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc000263500?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:98 +0x37
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.wrapCommonSetup.func1(0x27e7fc0?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x22
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc0007f6680)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:143 +0xed
        test_1        | testing.tRunner(0xc0007f6680, 0xc0010aae70)
        test_1        |     GOROOT/src/testing/testing.go:1576 +0x10b
        test_1        | created by testing.(*T).Run
        test_1        |     GOROOT/src/testing/testing.go:1629 +0x3ea
        compare_test_1 exited with code 2
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 2
--- FAIL: TestComposeCompare (18.05s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ fed4d7afad0aeb89359a7265751cbb97428f2ec4:

        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1321521017/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("1.5849625007211561815F"),
        test_1        |             +   string("1.5849625007211562F"),
        test_1        |                 nil,
        test_1        |                 s"2000-01-01 06:00:00 +0000 UTC",
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (log(2:::DECIMAL::DECIMAL::DECIMAL, 3:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || 'F':::STRING::STRING::STRING)::STRING
        test_1        |                             AS "c
ol97068",
        test_1        |                         NULL::VARCHAR[] AS col̦97069,
        test_1        |                         '2000-01-01 06:00:00':::TIMESTAMP::TIMESTAMP AS "Col97070"
        test_1        |                 )
        test_1        |                     AS tab75044
        test_1        |             ORDER BY
        test_1        |                 "c
ol97068" ASC NULLS FIRST, col̦97069 NULLS LAST, "Col97070" DESC NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         (log(2::DECIMAL::DECIMAL::DECIMAL, 3::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL || 'F'::TEXT::TEXT::TEXT)::TEXT
        test_1        |                             AS "c
ol97068",
        test_1        |                         NULL::VARCHAR[] AS col̦97069,
        test_1        |                         '2000-01-01 06:00:00'::TIMESTAMP::TIMESTAMP AS "Col97070"
        test_1        |                 )
        test_1        |                     AS tab75044
        test_1        |             ORDER BY
        test_1        |                 "c
ol97068" ASC NULLS FIRST, col̦97069 NULLS LAST, "Col97070" DESC NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (730.85s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 1b83c04ed0106dd0d3380821707861008ec32b73:

        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (350.90s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2883069169/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("010300000000000000"),
        test_1        |             +   string("010300000001000000050000000000000000000040000000000000F03F00000000000000400000000000000040000000000000000000000000000000400000000000000000000000000000F03F0000000000000040000000000000F03F"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         st_makeenvelope(2.0:::FLOAT8::FLOAT8::FLOAT8, 1.0:::FLOAT8::FLOAT8::FLOAT8, 0.0:::FLOAT8::FLOAT8::FLOAT8, 2.0:::FLOAT8::FLOAT8::FLOAT8)::GEOMETRY
        test_1        |                             AS cơl492750
        test_1        |                 )
        test_1        |                     AS "t   ab261753"
        test_1        |             ORDER BY
        test_1        |                 cơl492750 DESC NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         st_makeenvelope(2.0::FLOAT8::FLOAT8::FLOAT8, 1.0::FLOAT8::FLOAT8::FLOAT8, 0.0::FLOAT8::FLOAT8::FLOAT8, 2.0::FLOAT8::FLOAT8::FLOAT8)::GEOMETRY
        test_1        |                             AS cơl492750
        test_1        |                 )
        test_1        |                     AS "t   ab261753"
        test_1        |             ORDER BY
        test_1        |                 cơl492750 DESC NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (981.32s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #111157 compose: TestComposeCompare failed [C-test-failure FROZEN.branch-release-23.1.11-rc O-robot O-rsg T-sql-queries] - #109969 compose: TestComposeCompare failed [FROZEN.branch-release-23.1.11-rc O-robot T-sql-foundations] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #108652 compose: TestComposeCompare failed [O-robot T-sql-foundations TODO-deprecate.branch-release-23.1.9-rc] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ d926f1e51e23d477bcf3027adc6beac11513e58a:

        postgres_1    | 2023-10-06 05:21:09.867 UTC [51] LOG:  shutting down
        test_1        | I231006 05:21:09.912753 11 testutils/soon.go:42  [-] 1  SucceedsSoon: failed to connect to ``host=postgres user=postgres database=postgres``: dial error (dial tcp 172.18.0.4:5432: connect: connection refused)
        postgres_1    | 2023-10-06 05:21:09.975 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-10-06 05:21:10.083 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-10-06 05:21:10.083 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-10-06 05:21:10.083 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-10-06 05:21:10.086 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-10-06 05:21:10.091 UTC [68] LOG:  database system was shut down at 2023-10-06 05:21:09 UTC
        postgres_1    | 2023-10-06 05:21:10.096 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-10-06 05:31:12.907 UTC [98] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2023-10-06 05:31:12.907 UTC [98] STATEMENT:  CREATE TABLE table3 ("col3_ 0" INET, col3_1 REGROLE, "col3""_2" NAME NULL, " col3_\\U000622963" TIME NOT NULL, "c
        postgres_1    |     ol3_4" PG_LSN NOT NULL, col3_5 INTERVAL, col3_6 TSQUERY NOT NULL, col3_7 REGCLASS NULL, col3_8 BIT(22) NOT NULL, "col%ce3_9" VARCHAR, 😪col3_10 BIT(45) NOT NULL, col3_11 "char" NOT NULL, "c ol3_12" TEXT NULL GENERATED ALWAYS AS (CASE WHEN col3_7 IS NULL THEN '}m-o:a<'::TEXT ELSE e'\x00'::TEXT END) STORED, "col!3_13" TEXT NULL GENERATED ALWAYS AS (lower("col3""_2")) STORED);
        postgres_1    |     CREATE UNIQUE INDEX ON table3 ("c
        postgres_1    |     ol3_4" ASC, col3_11 DESC, 😪col3_10 ASC, "col3""_2" DESC, "col%ce3_9" DESC, "col!3_13");
        postgres_1    |     CREATE INDEX ON table3 (col3_5, col3_7, "c ol3_12", "c
        postgres_1    |     ol3_4" ASC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (606.12s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.27s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:172: CREATE TABLE table3 ("col3_ 0" INET, col3_1 REGROLE, "col3""_2" NAME NULL, " col3_\\U000622963" TIME NOT NULL, "c
        test_1        |             ol3_4" PG_LSN NOT NULL, col3_5 INTERVAL, col3_6 TSQUERY NOT NULL, col3_7 REGCLASS NULL, col3_8 BIT(22) NOT NULL, "col%ce3_9" VARCHAR, 😪col3_10 BIT(45) NOT NULL, col3_11 "char" NOT NULL, "c ol3_12" TEXT NULL GENERATED ALWAYS AS (CASE WHEN col3_7 IS NULL THEN '}m-o:a<'::TEXT ELSE e'\x00'::TEXT END) STORED, "col!3_13" TEXT NULL GENERATED ALWAYS AS (lower("col3""_2")) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table3 ("c
        test_1        |             ol3_4" ASC, col3_11 DESC, 😪col3_10 ASC, "col3""_2" DESC, "col%ce3_9" DESC, "col!3_13");
        test_1        |             CREATE INDEX ON table3 (col3_5, col3_7, "c ol3_12", "c
        test_1        |             ol3_4" ASC);
        test_1        |             
        test_1        |         compare_test.go:173: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (630.89s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 76a8d1077d3d29bcf020a48972efd1f77aa892c2:

        postgres_1    | 2023-10-08 05:22:22.315 UTC [78] ERROR:  collation "de_de" for encoding "UTF8" does not exist at character 81
        postgres_1    | 2023-10-08 05:22:22.315 UTC [78] STATEMENT:  SELECT
        postgres_1    |         *
        postgres_1    |     FROM
        postgres_1    |         (
        postgres_1    |             SELECT
        postgres_1    |                 'B'::TEXT::TEXT AS "%c7 col146270",
        postgres_1    |                 NULL::TEXT COLLATE de_DE AS co̡l146271,
        postgres_1    |                 'null'::JSONB::JSONB AS c😻ol146272
        postgres_1    |             FROM
        postgres_1    |                 postgres.public."\\U000A3201table1" AS t😒ab72173
        postgres_1    |         )
        postgres_1    |             AS tab72174
        postgres_1    |     ORDER BY
        postgres_1    |         "%c7    col146270", co̡l146271 ASC, c😻ol146272 NULLS LAST
        postgres_1    | 2023-10-08 05:22:22.519 UTC [78] ERROR:  could not identify an ordering operator for type refcursor at character 80
        postgres_1    | 2023-10-08 05:22:22.519 UTC [78] HINT:  Use an explicit ordering operator or modify the query.
        postgres_1    | 2023-10-08 05:22:22.519 UTC [78] STATEMENT:  SELECT * FROM (SELECT NULL::REFCURSOR AS col146544) AS """%vtab72363" ORDER BY col146544 NULLS LAST
        test_1        | --- FAIL: TestCompare (799.13s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (195.26s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '{"D": "G", "G": {"G": {"I": {"C": [false], "H": [{"I": 2, "J": {"E": {"D": {"A": {"D": [{"D": {"D": {"C": {"F": [{"A": false, "G": {"G": 4}}, false, {"D": {"C": {"H": {"D": [{"G": "J"}, {"C": false, "J": {"D": {"G": {"A": {"E": {"B": {"E": 3}}}}, "J": [{"C": false}, true]}, "E": {"A": 3, "F": {"A": null, "C": [null]}, "G": {"E": null, "F": {"F": {"H": [null, {"C": 9, "E": true, "G": {"J": null}}]}}, "I": 0}}}}], "I": {"C": {"G": {"A": {"A": "E", "B": {"C": true, "H": "F"}, "E": false}, "B": {"A": 5}, "F": false}}, "G": {"I": {"A": ["J", {"D": [null], "G": {"E": true, "H": true}}, "H"], "D": 4, "F": true}}}}}, "F": {"A": [{"A": {"G": {"C": 4}, "H": {"I": false, "J": {"A": {"E": [9, [false, false]], "H": null, "J": {"H": null}}, "C": true, "F": [{"A": {"B": {"G": ["D"]}, "D": "E"}, "D": true, "H": null}, {"D": 2, "I": 4}, false]}}, "J": false}, "C": {"C": 9, "D": {"D": {"C": true, "D": {"E": {"C": {"B": 6}, "E": {"I": {"H": "D"}}}}, "I": 5}, "J": [{"F": {"B": {"H": 9}, "I": {"B": {"B": 9, "C": {"C": {"A": {"D": 5, "E": true, "J": {"C": null, "G": {"C": 0, "G": {"B": {"B": {"A": "F", "G": {"E": ["D", "I"]}}, "I": {"C": {"D": true, "G": false}, "J": 2}, "J": true}, "C": {"J": true}}}, "J": 9}}, "E": null}, "H": "C"}, "G": {"D": {"D": ["A", false]}, "E": "J", "H": null}}}}}, true, {"B": 7, "G": {"C": ["B"], "D": true}, "I": "A"}]}, "H": true}, "G": {"B": null, "E": {"D": [5], "E": {"J": "B"}, "G": {"B": "G", "C": true}}}}], "D": null}}, "E": {"B": false, "F": false}, "I": 5}]}, "H": {"H": {"H": {"C": {"H": true, "I": {"G": {"E": [{"E": null, "G": {"A": true, "E": 4, "F": false}, "I": {"B": false}}, null, "E"]}, "I": {"D": "B", "F": {"D": null, "G": [{"D": 1, "I": {"G": [null, null], "I": {"A": false, "B": {"A": {"A": false, "B": false, "C": null}, "E": {"H": [1]}}, "E": {"C": 3, "H": {"E": {"F": {"G": {"E": {"D": true, "F": {"C": {"E": {"B": {"F": [{"A": {"G": null, "J": {"B": {"H": [null, {"B": true, "E": [{"F": [true], "H": "H"}, [{"H": {"B": {"I": false}, "D": {"A": null, "B": 1, "C": true}}, "I": null}, true, 7], {"J": {"A": 2, "F": {"B": ["D", {"C": {"H": [{"A": null, "F": ["C", true], "J": null}, [false]]}}], "E": [false, [false, {"E": {"C": {"G": {"B": 2, "F": {"J": [{"H": {"A": {"A": 4, "F": {"B": false, "H": true}}, "E": {"D": {"C": [[{"G": 5, "I": "E"}, true, {"A": [4, [true]], "D": {"C": [null, null]}, "G": null}], true]}, "H": true, "I": null}}}, 0]}, "G": {"G": true}}, "I": false}, "G": {"E": "A", "H": false}}}, false]], "F": "G"}, "I": "C"}}]}], "J": {"B": {"A": {"E": {"H": "A", "I": {"H": {"B": {"A": null, "H": {"D": [null, 2, true]}}, "G": null}, "J": null}}}, "F": null, "G": 4}, "D": {"F": "E"}}}, "J": false}}}, null], "H": {"C": null, "F": null}}, "F": "J", "G": {"A": {"B": null, "C": 7}, "J": {"A": {"F": false}, "E": {"A": false, "E": [[["F"], "B"], true]}, "H": 9}}}, "G": false, "J": false}, "E": true}, "H": {"B": 1, "E": null, "F": {"B": true}}}, "H": true}, "H": {"A": 9, "E": {"C": [{"A": {"A": 5, "I": {"B": {"C": false}, "C": null, "D": false}}, "B": {"B": {"C": {"I": {"E": {"E": {"C": {"C": false}}}, "H": {"D": [{"C": {"B": {"E": [{"B": {"G": true}, "C": true, "F": null}, "B", true]}}}, true, false], "H": "A"}, "J": true}}, "E": 2}, "D": null, "H": {"D": {"D": {"B": {"A": {"C": true}}, "E": false, "G": {"H": {"F": {"B": "H", "F": 7}}}}}}}, "C": true}], "D": true}, "F": {"B": null}}, "J": "D"}, "I": {"B": [{"E": null}, false], "E": {"A": null}, "H": [{"I": {"D": false}}, true]}}}, "J": {"H": false, "J": "A"}}}}}, null]}, "I": 8}}}, "G": false, "I": {"J": {"A": {"J": {"H": "B"}}, "F": true}}}}}}, "F": "B"}, "G": true, "J": [{"E": false, "F": [{"B": "D", "D": null, "E": null}, {"G": [8], "H": 4}, false]}, null, {"E": "D", "H": {"C": {"A": {"E": 5, "F": [null], "H": false}}, "E": "D", "I": [{"H": true, "J": {"B": {"A": false}, "C": {"D": {"D": null}, "F": "F", "H": {"E": {"C": 2, "D": [{"B": {"B": false, "C": {"E": {"E": {"C": {"F": [{"D": [{"F": {"D": {"F": [[{"A": {"F": {"F": {"B": {"F": [{"C": {"I": 1, "J": {"A": null, "H": {"F": {"B": null, "E": true}, "G": null, "I": true}}}, "D": null}, {"E": {"D": {"I": {"E": "G", "F": [true, {"H": ["G", {"F": 9, "G": false, "I": {"I": {"E": {"H": "E"}, "I": {"C": {"A": [9, ["J"], false], "C": "D", "J": null}}}}}]}]}, "J": {"D": null, "G": false}}, "G": {"D": {"F": {"F": false}, "J": {"F": {"C": null, "J": false}}}, "J": false}, "I": {"D": {"C": null, "I": {"A": "D", "F": 9, "G": {"B": "C", "H": {"C": {"A": false, "B": [[{"A": null, "D": "G", "E": "H"}, null], {"H": {"I": true}}], "E": {"C": "I"}}, "J": false}}}}, "I": {"I": {"C": true, "F": [true, false], "J": [{"C": 0, "I": false, "J": [6]}, false, {"C": {"A": null, "B": {"F": 8}, "J": [{"G": {"B": {"C": null, "G": null}}}, true, {"B": {"J": true}, "H": {"A": {"D": null, "F": {"E": "E", "I": {"A": true, "I": "I"}}, "G": 7}, "E": {"A": {"A": null, "D": {"E": {"D": [{"J": {"E": [null, null, true], "F": false}}, {"E": true, "H": {"C": false, "E": {"C": "E", "F": {"F": 8, "H": {"G": {"A": null, "D": true}}}, "J": {"C": [null], "H": {"C": false, "E": 1}}}}}]}}}, "H": {"I": [[4, 1, "B"], {"A": true, "B": 3}, null], "J": ["D", true, 1]}}}, "I": {"C": 6, "I": {"C": null, "D": {"C": [5], "D": {"G": "G"}, "H": true}}}}]}, "D": {"D": false, "F": {"C": true, "D": {"D": [6], "H": false, "J": {"F": "G"}}, "E": [{"F": {"A": {"G": null, "I": {"E": "B", "F": {"D": {"G": {"F": {"F": 7}, "H": {"E": [null]}}}}, "H": false}}}, "H": {"G": {"E": false, "H": {"B": {"C": {"A": null}}, "E": true, "I": {"B": {"B": [5], "F": "H"}, "C": null, "D": "C"}}}}}]}}, "H": false}]}}, "J": null}}, "F": 8, "G": "B"}, [{"D": {"H": true}}, {"B": "D", "E": {"E": {"D": "I", "H": false}, "F": 3}, "G": {"D": [9], "H": true}}]], "J": true}, "D": true}, "I": {"E": {"F": {"B": [{"C": {"G": {"B": null, "E": {"B": null, "D": "E"}, "G": [null]}}, "F": true, "H": false}, 8, false], "H": true}}}}}, "B": {"C": null, "D": "B", "I": null}}], [1, [{"B": {"A": true, "B": {"D": true}, "D": {"G": {"B": {"E": true, "H": "C"}}}}, "F": "B", "I": {"B": null, "H": false}}, "B", 8]], {"I": false, "J": false}], "G": [false, {"C": false}]}, "F": true, "H": {"A": [null], "D": {"E": {"G": [6, {"A": 2, "B": false, "G": ["A", false]}, null], "H": {"C": true, "J": null}, "I": {"G": {"A": "G", "E": {"D": {"G": {"E": {"C": null, "D": null, "I": {"E": null}}}}, "G": 7, "H": {"D": {"E": {"D": {"A": false, "D": {"B": {"E": {"A": {"B": 0, "F": null}, "G": false}, "F": {"B": false, "G": "B"}}}}, "F": {"A": "C", "D": true, "H": 4}, "H": 5}}, "I": {"F": {"H": 8}}}}}, "I": {"B": "E", "E": null, "H": null}}}, "H": true, "I": {"I": "H"}}}}, "G": true, "H": {"F": "B", "H": true}}, {"A": null, "D": true}, {"D": {"A": 9}, "E": true, "F": [{"B": null, "F": null, "J": {"B": false, "H": 7, "I": [{"C": {"A": {"D": false, "F": {"C": {"C": {"D": null}}, "D": false, "E": false}, "I": {"G": null, "H": {"J": true}}}, "D": "G", "I": 3}, "E": {"C": true, "H": "A", "J": null}}, {"B": {"H": {"E": {"B": {"A": true}}, "I": 2, "J": 2}, "J": {"B": "G", "F": false, "I": null}}}, null]}}, {"E": true}, true]}], "E": {"E": [false, {"A": 8, "C": false, "H": [{"F": false}, [{"D": {"A": false, "D": false, "I": {"A": true}}, "G": [{"C": {"B": "G", "E": true, "J": {"A": {"B": {"B": "C", "D": true, "E": "I"}, "J": "G"}, "E": null, "G": true}}, "I": "E"}, null, true], "J": 9}, true, [["B", {"A": {"B": {"D": {"D": "F"}, "J": "A"}}}], {"F": "B", "H": false, "J": {"B": [{"F": true, "J": {"B": 1}}, {"E": [{"C": {"F": {"C": false, "H": true}, "G": false, "I": 1}, "J": {"D": [{"A": {"F": "E", "G": {"C": [[false, {"A": {"E": 5}, "E": 8}]], "F": {"C": true, "G": true}}, "J": {"C": {"I": null}, "D": 8, "H": {"I": null}}}, "H": true, "J": {"B": false, "F": {"D": {"G": null}}}}, {"D": {"C": null, "G": [true], "H": {"A": {"F": {"C": {"F": {"G": 8}}, "F": {"D": {"F": 9, "J": {"C": false, "D": 3}}, "E": "J", "J": {"H": [false]}}}}, "B": [true]}}, "E": false}]}}, {"F": [{"D": [3, {"E": {"C": {"A": {"F": {"E": [{"B": {"B": 3, "D": {"A": {"H": null}, "D": "E", "J": {"G": {"D": 4, "E": {"F": false}, "F": false}, "I": null}}, "F": {"C": 7}}, "C": "F", "E": "J"}, 1]}}, "C": {"G": false, "I": 9, "J": true}, "D": false}, "D": {"B": 5, "H": null, "J": {"A": {"D": {"C": {"C": [{"D": true}], "F": false}, "D": {"C": {"F": {"E": [{"C": {"I": {"F": {"B": {"C": "D", "F": 0}}, "G": false}}, "F": false}], "I": null}}, "F": {"B": {"A": {"A": false, "C": true, "D": false}, "B": [{"G": null, "H": 5}, [{"H": {"D": null}}], 4], "H": true}, "G": {"F": {"F": "A"}}}, "J": {"D": [false, {"E": {"B": false, "C": {"B": {"E": false, "J": [{"E": "J"}]}, "E": false, "F": [{"C": false}, "D", {"F": null, "H": null}]}}, "F": false}], "I": {"B": true, "C": {"B": [2], "D": null, "H": 9}}}}}, "H": [false, {"I": {"B": null, "C": null, "D": ["F", [false, {"A": {"B": {"E": null, "H": {"D": 8, "F": true}}, "C": 2}, "E": 7}, 9], {"I": {"I": {"E": true}}}]}}, {"A": "J", "G": {"C": [true, true, false], "D": 9, "E": {"C": {"F": {"A": {"I": {"C": {"A": false, "I": true}}}, "B": null, "G": {"C": {"B": true, "F": 9, "J": 8}, "E": "H"}}}, "D": false, "G": {"B": true, "E": {"C": false, "D": "F"}, "I": null}}}}]}, "D": {"F": false}, "G": true}}}, "I": false}], "E": {"G": false, "J": null}, "F": 2}], "G": null}, {"A": false, "D": {"B": {"B": {"D": [false, {"A": "H", "B": true}], "F": false, "I": [{"A": [{"A": {"H": {"G": {"C": {"H": false, "I": false}}, "H": {"B": {"B": "C", "D": null, "G": 3}}}}}], "D": {"E": "B", "G": "E", "J": {"B": {"B": {"A": "J"}, "G": {"B": {"H": {"B": true, "I": {"A": {"D": "F", "E": "A"}}, "J": {"C": null, "D": [true, {"A": false, "I": {"F": 8, "G": "B", "J": true}}, false]}}}, "C": [[[5], false, "J"]], "H": true}}}}, "G": null}, 7, {"C": {"B": false, "F": 5, "H": {"C": {"B": {"B": {"F": null, "H": true}, "I": {"I": "E", "J": null}}, "E": true, "G": null}, "E": 0, "I": 9}}}]}}, "C": {"B": {"C": 2}}, "G": {"G": false}}, "E": false}], "G": true}, "D"], "F": {"F": {"B": {"C": {"C": true}, "H": [{"H": false}, false, {"A": {"H": null, "J": [{"G": "F"}]}, "H": [[{"J": ["C", null]}, {"J": {"B": {"A": "D", "F": {"A": {"I": false}}}, "I": {"D": null, "E": true}}}]]}]}}, "H": "G"}, "J": false}}, {"C": true, "G": 0}]], 0]}], "J": {"H": false}}, "G": {"F": {"F": true}, "J": {"E": {"A": "F", "G": {"J": {"C": {"J": null}, "H": {"H": [[{"E": null, "I": null, "J": true}, false, null], {"D": null, "I": 8}, [[3, null]]], "J": "A"}, "J": {"E": {"B": null, "C": "E", "H": {"G": [5, {"F": [{"C": {"B": true, "C": {"G": null, "I": false, "J": {"D": null, "H": [{"B": [null, {"G": false}], "G": null}, "I", {"J": [[{"A": "E", "E": "B"}, null, [{"F": 2, "G": {"F": "B", "J": {"A": 5, "E": {"G": {"F": "A", "G": {"D": {"I": null, "J": null}, "G": {"A": {"J": true}, "E": false}}, "J": {"B": false, "I": "I"}}, "J": {"A": [0, null, ["B", {"B": "C"}, "A"]]}}, "I": 2}}}, [true, {"E": ["E", [false, "G"]]}]]], {"C": 3}, 7]}]}}}, "G": [null, 2, false], "J": {"D": {"B": false, "C": {"B": {"D": null}, "F": "J"}}, "H": {"D": true, "F": 8}}}, {"E": false, "G": false}]}]}}}}}}}}}, 8], "I": false}, "H": "E", "J": 1}}, "H": false}, "F": {"D": null, "I": [8, [true, {"G": {"I": true}}]]}}}]}}}, "I": {"I": false}}}]}}]}], "I": {"A": null, "G": {"C": {"A": [false, {"A": [{"G": "J", "J": {"H": false}}], "E": {"E": 8, "G": 7}, "J": {"D": null, "G": true}}, {"A": {"B": {"G": {"G": {"A": 5, "D": 1, "G": "F"}, "I": {"A": {"B": {"F": null, "H": null, "J": "A"}, "D": {"B": {"A": false, "D": [false, [null, false, {"F": 8}]], "F": true}, "H": 5}, "J": true}, "G": {"F": {"A": true, "F": {"B": {"B": 9, "F": [{"F": {"J": true}}]}, "F": {"A": "B", "J": true}}, "H": {"B": [[null, {"A": "A", "I": true}], {"B": [false], "D": {"B": true, "C": {"B": true, "I": null, "J": {"A": {"C": null, "E": "G"}, "C": null}}, "F": {"G": [8], "H": "D", "J": [false]}}}], "E": null}}, "H": {"B": {"I": {"H": {"B": false, "D": {"C": {"F": ["C", null, null], "H": 3, "J": false}, "I": false}, "F": {"C": {"H": "C"}, "E": 5}}, "J": {"F": [{"F": {"E": "G"}, "G": ["D", null, [null]], "H": null}]}}}, "I": {"B": false, "J": 5}}, "I": [{"A": {"H": 7}}, "B", "E"]}, "I": [{"B": {"I": null}, "E": {"E": true, "I": null}}, {"J": "F"}]}}, "I": 0}}, "C": false, "G": 2}], "I": null}, "H": {"C": {"A": false, "I": {"B": true}}, "D": 2}}}}}, "G": {"C": null}}, "F": {"C": 0, "E": {"C": true, "G": {"C": 7, "G": {"I": {"F": {"D": 0}}}, "H": ["D", {"G": false}, [[[null, 7, false], {"J": [true, {"G": 0, "H": 6}, {"B": {"H": {"G": {"E": 9}}}, "G": {"B": "D"}, "H": {"B": {"A": {"E": {"C": null, "D": {"D": 7, "F": {"J": null}}, "H": {"A": "A", "D": {"J": [5, {"D": null}, "G"]}}}}, "H": "D", "I": true}, "I": "J"}}]}, {"B": 4, "G": {"I": {"B": {"H": null, "J": false}, "C": {"B": 2, "E": {"A": [9, [{"C": {"D": null}, "D": true, "J": true}, {"G": "H", "H": null, "I": 7}, {"C": {"J": {"E": {"D": false, "G": true}}}, "I": {"C": {"F": false, "G": "D"}}}], true], "D": {"A": {"G": null, "H": 4}, "B": [{"B": true, "F": {"E": [{"B": 8}], "H": {"E": {"A": {"A": 5, "G": "H", "H": null}}}}, "G": false}, true], "H": null}, "G": "F"}, "J": {"A": {"D": {"E": {"A": {"I": "G"}, "F": 2, "J": [{"A": true, "F": false}, true]}, "I": 8}}}}, "D": {"A": [6, null, {"B": true, "H": 7, "I": "C"}], "E": {"E": {"B": true}, "J": true}, "I": {"C": {"A": {"F": {"D": true, "F": 0, "I": null}, "G": {"D": {"C": {"A": false, "C": 9, "F": {"A": {"B": {"A": {"B": {"E": null}, "G": {"C": false, "H": true}, "J": {"A": {"B": true}, "I": {"A": false}}}, "D": true, "H": false}, "D": [true, {"D": "E", "J": {"B": {"C": [true, {"D": "F"}]}, "E": false}}], "I": {"A": true, "I": ["C", true, null]}}}}, "I": ["E", true, "H"]}, "G": "D"}, "H": null}, "G": {"B": "F", "H": "F", "I": {"F": {"D": {"F": {"H": [{"G": null, "H": true}], "J": {"A": true}}}, "I": {"G": [{"D": 4, "G": [false, {"G": null, "I": null, "J": null}, {"J": true}]}, {"E": {"C": true, "E": "I"}}]}}}}, "H": false}, "D": [false, {"C": {"A": null, "G": {"B": "E", "E": {"C": false, "E": {"G": {"A": null, "F": true}, "I": {"B": 3, "H": true}}}}, "I": null}, "I": {"G": true}}, {"E": [{"E": {"F": {"F": null, "H": "I", "J": 0}, "I": {"G": {"D": false}, "H": {"I": {"C": null, "F": false, "J": null}}}}, "G": null}], "F": {"B": true}}]}}}}}], [[false, 4], true, {"E": [[{"E": true, "J": true}, [{"G": true}, {"E": 4}, {"B": 6}]]]}]]]}, "I": "B"}}}}], "I": true}}, "I": false}, "H": "H"}':::JSONB::JSONB
        test_1        |                             AS "%9dc ol146633"
        test_1        |                 )
        test_1        |                     AS ta😡b72403
        test_1        |             ORDER BY
        test_1        |                 "%9dc ol146633" NULLS FIRST
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (823.70s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 7e1f909e9f2ddcef2e418d6c2df11f3139a2b85a:

        postgres_1    |     ORDER BY
        postgres_1    |         col274988 DESC NULLS LAST, "C\\x60ol274989" ASC NULLS FIRST
        postgres_1    | 2023-10-10 05:35:11.990 UTC [99] ERROR:  could not identify an ordering operator for type refcursor at character 239
        postgres_1    | 2023-10-10 05:35:11.990 UTC [99] HINT:  Use an explicit ordering operator or modify the query.
        postgres_1    | 2023-10-10 05:35:11.990 UTC [99] STATEMENT:  SELECT
        postgres_1    |         *
        postgres_1    |     FROM
        postgres_1    |         (
        postgres_1    |             SELECT
        postgres_1    |                 tab163129."c
        postgres_1    |     ol3_0" AS col275035, NULL::PG_LSN AS "c""ol'275036", NULL::REFCURSOR AS col275037
        postgres_1    |             FROM
        postgres_1    |                 postgres.public.table3 AS tab163129
        postgres_1    |         )
        postgres_1    |             AS tab163130
        postgres_1    |     ORDER BY
        postgres_1    |         col275035, "c""ol'275036" NULLS FIRST, col275037 DESC NULLS FIRST
        test_1        | --- FAIL: TestCompare (1076.33s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (471.40s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '{"I": {"E": {"G": {"G": {"E": {"G": {"C": null, "F": {"C": {"A": {"B": null, "F": [{"F": {"A": "I", "H": {"F": {"E": false}, "I": {"D": 6, "G": [{"I": {"F": {"A": null, "G": [null, {"A": "G"}, {"C": {"F": "A"}, "H": null}], "H": {"A": [null, {"I": "A"}, true], "B": "D"}}}}], "I": {"A": {"D": false}, "H": null, "I": [{"H": {"F": null, "G": {"C": {"D": {"D": true}}, "E": "B", "G": {"D": null}}}, "I": 3}]}}}}}]}, "C": "I", "F": {"H": false}}}}, "H": true, "J": {"G": {"H": [false, {"A": {"C": [{"I": null, "J": null}], "D": "J", "H": null}, "B": 4, "C": 0}], "J": {"A": {"B": {"D": {"D": {"H": 2}}}, "D": {"A": "A", "H": [{"A": false, "D": {"C": {"B": {"A": {"A": {"D": {"D": {"J": 3}, "H": {"E": 8, "G": {"G": {"F": "F", "H": {"F": {"C": true, "F": true, "J": {"E": {"J": [1, false, null]}}}, "I": null}}}}}, "E": null, "G": true}, "E": {"B": null, "D": {"F": {"A": {"B": null}}}}}, "D": true}, "J": 2}, "E": {"B": "H", "I": [false]}, "J": [{"E": {"B": "C", "G": {"A": [{"A": true}, true], "B": null, "D": 3}, "I": "B"}}, false]}, "J": true}, {"D": ["C", false, "J"], "I": 7}, null], "J": "D"}}, "F": {"A": false, "D": 3, "I": {"F": {"C": {"A": {"C": ["B"], "D": 0, "F": null}, "B": "A", "I": 8}, "G": [{"A": {"D": true, "E": {"B": {"A": {"B": {"B": 3, "D": {"G": {"C": null, "D": false}}, "F": true}}, "J": null}}, "F": {"A": false, "E": false}}, "B": {"B": {"B": {"C": {"A": [{"G": {"F": 5}}], "E": {"E": false, "J": ["G", null, null]}}}}}, "I": [null, [[{"C": [{"H": 5}, ["A"]], "H": 3}, "A", {"D": {"D": {"B": {"B": {"D": true, "F": {"D": "A", "E": {"A": false, "E": "H"}, "I": 6}}, "H": 3}, "I": {"B": {"A": {"B": {"G": "F", "I": {"E": "A", "J": [{"D": "J"}, 8, {"D": {"G": "F"}}]}, "J": {"E": null, "G": null}}, "G": {"D": {"E": ["C", true]}, "G": 7, "I": [{"F": {"E": 3, "F": false, "I": {"J": {"A": 8, "F": {"C": 6, "H": 8, "I": 8}}}}, "G": {"C": true, "J": [{"F": [false, {"C": {"F": 5}}, 6]}, {"B": {"A": "A", "E": null, "I": 1}, "H": null}]}, "I": {"D": false, "E": [{"A": 4, "E": null}, {"B": {"B": null, "C": [{"E": 5}, null], "I": null}, "E": [{"B": true, "G": {"B": "I", "E": {"F": [{"F": null, "J": {"B": {"A": "F", "B": {"A": {"F": true, "H": null}, "G": true, "H": true}, "C": ["D", {"H": {"G": null, "H": "I"}, "I": [{"C": 3, "H": true}, {"B": {"H": "G", "I": null}, "C": null}]}, {"D": {"D": null, "F": "I"}, "H": true, "J": {"A": {"D": {"D": {"F": [{"A": [7, ["B", [{"E": [{"B": 1, "G": 4, "J": {"B": {"B": [{"J": 5}, {"A": false}, 1], "I": [{"B": null}, null, [{"A": {"C": false}, "C": false}, 3, 2]]}}}, 6, ["J", {"C": {"J": [[false], {"H": {"G": {"H": {"F": {"B": true, "E": {"B": [{"D": {"G": "I", "H": {"A": "J"}}}, null], "C": {"C": 4, "H": null}}, "I": true}}}, "H": {"G": [{"A": false, "I": [9, false, {"D": [false], "H": null, "I": null}]}, {"C": true, "J": {"E": null, "F": true}}], "H": 4}, "J": null}}]}, "G": true}, 4]], "F": {"A": {"E": "I"}}, "G": true}, [[[null, {"F": {"A": {"E": 7, "H": {"J": {"I": {"F": 8, "I": [[{"A": {"G": {"H": {"H": false, "J": {"D": false}}}, "I": "I"}, "G": false, "I": [false]}, null, {"D": {"B": 5}, "G": null, "H": true}]]}}}}, "B": null, "E": "C"}}, {"J": {"B": {"H": null}, "G": 1}}], 1, [false]], null], 6], {"E": true, "G": [true, "G", true]}]], "J": 2}, {"G": {"B": null}, "I": {"I": false, "J": {"F": {"C": {"A": true, "H": false}, "H": {"B": null, "F": {"D": false}, "I": {"A": "G", "D": true}}, "J": 9}, "G": true, "I": null}}}], "H": {"B": {"D": {"A": [true], "D": {"F": {"C": {"F": null, "J": true}}, "G": 2}}, "F": {"B": {"B": false, "G": {"C": {"C": {"A": {"A": [{"A": "C", "B": {"C": 7}, "F": false}, true, false], "B": {"A": true, "C": null, "E": null}, "D": 3}, "B": null, "I": [false, {"A": {"E": 1}}, {"F": [true, {"E": false, "F": {"D": [true, 4, "F"]}, "H": 1}], "G": {"E": {"C": "H", "J": 3}, "J": false}, "J": {"F": 1, "H": {"C": "A", "E": null}}}]}, "G": null}, "F": "B", "I": "A"}, "H": {"D": true}}, "I": ["A"]}, "J": true}}, "J": true}}, "J": {"G": {"I": false, "J": 1}, "H": {"H": false}}}, "D": true, "F": {"B": false, "C": 8}}}]}, "D": {"F": {"I": {"J": [{"A": {"C": [{"I": 4, "J": false}, 5], "D": {"A": 7, "F": true, "I": true}, "G": true}, "D": true}]}}, "I": {"A": {"B": "J", "I": {"G": {"B": true, "C": {"E": {"B": null}}}, "I": {"E": false, "I": null}}}, "H": false, "J": {"B": 4, "E": true}}}}}, {"B": {"F": null, "H": false}, "H": null, "J": {"F": false}}]}}, "J": {"A": {"C": false, "E": {"C": {"A": {"A": true, "I": {"A": {"C": {"B": {"J": {"B": [true, "F"], "H": true}}, "C": false, "G": "H"}, "G": {"I": {"D": {"A": {"G": "D"}}}}, "H": ["F"]}, "G": {"D": null, "F": {"E": {"I": {"J": [{"A": {"B": null, "D": "C", "F": {"G": {"B": {"A": {"C": false, "F": {"A": [{"I": 1}, null, {"C": null, "D": {"E": true, "I": null, "J": {"B": null}}}], "G": {"A": [[{"E": {"A": [{"A": false, "B": "F"}, false, {"G": 9}], "I": true}}]], "E": false, "I": {"F": {"D": {"A": "A", "I": "E", "J": 9}, "F": {"B": 5}}, "J": {"C": false, "E": {"G": "I", "I": 7}}}}, "I": null}}}, "E": {"H": [{"G": false, "I": {"B": {"C": false, "D": {"E": true}, "H": {"C": false, "G": [2]}}, "D": [{"E": null, "F": {"H": null}, "H": {"B": [3, true], "D": {"A": null, "C": {"C": true, "G": {"J": [{"H": null}]}, "I": {"G": {"E": null, "I": {"G": {"H": {"E": {"B": null, "J": {"D": true}}}}, "H": "E"}}, "I": null}}, "J": null}, "I": {"A": {"A": false, "B": [{"A": [{"B": false, "E": null}, {"C": {"D": {"G": "C"}, "E": "J", "F": {"C": {"D": "E", "J": {"B": true, "E": 6, "J": {"A": {"E": null}, "C": true}}}, "H": false}}, "J": {"A": {"A": true, "D": {"G": true, "J": false}, "H": "E"}, "C": true}}], "B": true}, "F", {"F": true, "G": {"E": {"C": "A", "D": {"A": false, "G": {"A": true, "B": {"D": null, "F": false, "J": false}, "F": "J"}}}}, "I": false}]}, "F": {"G": true}}}}], "H": true}}, {"H": 0}]}, "F": null}}}, "G": {"D": {"A": {"A": {"C": 8}, "F": null}, "C": true, "G": {"C": {"A": {"B": false, "H": true}, "F": {"J": null}}, "H": "A"}}, "G": {"C": {"F": {"G": null}, "I": 8, "J": 1}}, "H": [{"C": [{"D": {"D": 9}, "G": null, "J": true}]}, {"B": {"B": {"D": {"I": 6, "J": null}, "H": {"E": {"C": "G", "H": "H"}, "I": false}}}, "G": true, "H": null}, {"A": true, "H": {"C": {"B": "I"}, "J": 5}, "I": {"E": 0}}]}}, {"D": null, "H": [null]}]}}}, "J": false}}, "J": {"E": "J", "G": false}}}, "F": null, "J": {"A": [true, {"A": {"G": true}, "G": {"A": {"J": {"B": "J", "C": false, "F": 0}}, "G": false}, "H": true}, null], "D": false}}}, "B": 4, "I": "B"}}, {"C": [{"F": 3, "H": {"C": {"D": [null, {"J": null}, {"D": false, "F": null}]}, "D": {"C": {"G": {"A": {"F": false, "G": {"D": "C", "H": {"A": {"D": 5, "I": {"A": "H", "D": {"A": true}, "E": {"C": {"G": {"A": {"B": 5, "D": {"H": {"H": {"B": 4, "E": {"E": true, "F": {"D": true}}, "G": [true, {"D": [1, [{"E": true, "H": {"G": {"H": "H"}}}, true]]}]}}, "I": {"A": {"C": {"A": 1, "F": {"A": {"F": "B"}, "B": [[{"C": {"G": "D", "J": {"A": {"J": {"H": true}}, "F": 0}}, "I": {"H": {"B": null}}}]]}}}}}}, "J": null}, "I": {"H": null}}, "G": {"C": [{"F": "J", "G": true, "H": 8}, null], "H": null}, "J": {"C": {"B": {"H": 4}, "H": {"F": {"F": {"I": 2}, "J": "C"}}}, "D": false, "J": 0}}}, "J": {"G": {"D": true, "J": [8, null, [{"F": ["C"], "G": {"E": true, "H": [false, ["F", "C"]]}}, [true]]]}}}, "D": [true, {"C": "B", "F": "J"}]}}, "I": {"F": null}}, "E": {"A": {"J": {"A": true, "H": false}}, "D": {"J": [6, false, {"B": {"A": true, "I": "B", "J": 6}, "D": true}]}}}, "J": null}, "D": ["J", {"D": {"H": [{"E": null}, true]}, "I": true}]}, "E": "J"}}, false, {"H": {"F": null, "G": [{"B": {"A": {"D": "C", "I": false}}, "E": {"F": null, "H": 4}}, false, {"D": [{"H": null}, {"I": true}], "F": true}], "J": {"J": {"E": "J", "I": {"A": {"F": {"D": {"D": null, "G": {"I": "G"}, "I": "A"}, "F": false, "I": {"A": null, "F": false, "J": true}}}, "B": {"A": {"I": {"G": [{"I": 0}], "H": true}}, "B": [2, "F"], "C": {"C": true, "G": [{"J": {"J": 6}}, null]}}}}}}, "I": {"D": "I", "I": {"D": 7, "G": {"C": [false, {"C": 4, "D": {"B": false}, "J": 6}, null], "D": 7}, "J": [true]}}}]}], "H": false}, [null]], "G": {"B": null, "C": "H"}}}, null, false]}}, "F": {"C": {"C": false, "F": {"F": false, "I": {"H": 7}}}}}, "H": {"D": 2}}}, "J": null}}], {"A": false, "E": {"D": 7}}, false]]}, null], "J": {"D": 0, "F": false}}}}, "G": false}}, "H": [{"A": [{"H": {"C": "C"}}, {"C": 4, "E": {"A": true, "D": {"B": true, "D": {"D": 2}, "G": {"D": {"D": {"E": {"B": {"C": "A", "D": true}, "H": [{"B": {"D": {"F": {"E": 8, "I": {"A": [{"D": {"G": true, "H": true}, "G": null, "H": {"E": {"H": [{"D": null, "J": 7}, 6], "I": false, "J": {"E": {"H": 6}}}}}, null, null], "C": {"A": null, "F": {"A": {"A": 0}, "G": false}, "H": {"A": {"A": false}}}}}}, "H": null, "I": {"G": {"I": null}, "H": null}}}, {"C": false, "G": {"A": [{"G": 9}, {"G": {"I": 1}, "J": {"E": {"D": null, "I": false, "J": {"B": null, "H": {"A": null}}}, "J": {"A": 2, "F": null, "G": {"B": {"C": null, "E": {"D": {"A": {"E": null}}}}, "C": 4, "E": null}}}}, true], "F": null, "I": {"C": true, "H": {"E": {"C": "I", "F": true, "G": true}, "F": 0}}}}, {"B": [{"A": {"A": {"G": false, "I": {"E": {"J": {"F": {"A": {"B": {"A": 6, "C": {"C": true, "E": null, "G": null}, "G": [null, [null, null]]}, "C": {"F": {"F": [9, ["A", {"F": 4}]], "I": {"G": null, "I": "E"}}, "G": {"A": [null]}, "I": {"B": "G", "G": 0}}, "F": {"J": false}}, "D": false}, "H": [{"F": false, "I": false}, 0], "J": null}}, "G": {"A": null, "F": [true, false], "H": {"C": 0}}}}, "H": [{"D": true, "H": {"H": "F", "I": ["I", "G", {"D": {"A": "F", "B": {"A": "E", "F": {"G": {"D": null, "F": {"H": [{"B": {"I": true}}, null, {"B": "J", "E": 5, "H": false}]}, "I": {"D": 9, "G": false}}, "I": 4, "J": ["C"]}}}, "E": {"E": 8}}]}, "I": {"I": 4}}, {"H": {"D": null, "I": 8}, "J": "C"}], "J": {"E": false, "H": {"H": "J"}, "I": "I"}}, "H": {"A": {"A": {"A": null, "H": 7, "J": "G"}, "F": {"G": {"A": "A"}}, "H": 7}, "E": true, "J": 7}}, [null, "D"]], "C": true}]}}, "H": "B"}, "E": null, "I": true}}}}], "D": "J", "J": 6}, [{"G": {"C": {"H": null}}}, 7], null]}}}}}, "G": [null, {"F": "I"}, 0]}}':::JSONB::JSONB
        test_1        |                             AS col275040
        test_1        |                 )
        test_1        |                     AS tab163135
        test_1        |             ORDER BY
        test_1        |                 col275040 ASC NULLS FIRST
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        postgres_1    | 2023-10-10 05:38:31.537 UTC [99] LOG:  could not receive data from client: Connection reset by peer
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1101.36s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 5af56c0ecd701d452c19fb89908012294b5336aa:

        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2589287117/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare postgres to cockroach1: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |                 strings.Join({
        test_1        |                     "01010000000000000000001040E",
        test_1        |             -       "4",
        test_1        |             +       "3",
        test_1        |                     "A1498FE7321BC0",
        test_1        |                 }, ""),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         st_makepoint(4.0:::FLOAT8::FLOAT8::FLOAT8, tan(8.0:::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::GEOMETRY
        test_1        |                             AS "�col38903"
        test_1        |                 )
        test_1        |                     AS "| tab35109"
        test_1        |             ORDER BY
        test_1        |                 "�col38903";
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         st_makepoint(4.0::FLOAT8::FLOAT8::FLOAT8, tan(8.0::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::GEOMETRY
        test_1        |                             AS "�col38903"
        test_1        |                 )
        test_1        |                     AS "| tab35109"
        test_1        |             ORDER BY
        test_1        |                 "�col38903";
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (676.34s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #111157 compose: TestComposeCompare failed [C-test-failure FROZEN.branch-release-23.1.11-rc O-robot O-rsg T-sql-queries] - #109969 compose: TestComposeCompare failed [FROZEN.branch-release-23.1.11-rc O-robot T-sql-foundations] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #108652 compose: TestComposeCompare failed [O-robot T-sql-foundations TODO-deprecate.branch-release-23.1.9-rc] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 619aa6edad0269f75d12cb7d4b88b52f09825c7b:

        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1307192502/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |                 s"2000-01-01 07:00:00 +0000 UTC",
        test_1        |             -   string("010300000000000000"),
        test_1        |             +   string("01030000000100000005000000000000000000184000000000000014400000000000001840000000000000F03F0000000000000040000000000000F03F0000000000000040000000000000144000000000000018400000000000001440"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '2000-01-01 07:00:00':::TIMESTAMP::TIMESTAMP AS "c ol347634",
        test_1        |                         st_makeenvelope(6.0:::FLOAT8::FLOAT8::FLOAT8, 5.0:::FLOAT8::FLOAT8::FLOAT8, 2.0:::FLOAT8::FLOAT8::FLOAT8, 1.0:::FLOAT8::FLOAT8::FLOAT8)::GEOMETRY
        test_1        |                             AS c̴ol347635
        test_1        |                 )
        test_1        |                     AS "%vtab199690"
        test_1        |             ORDER BY
        test_1        |                 "c ol347634" NULLS LAST, c̴ol347635 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '2000-01-01 07:00:00'::TIMESTAMP::TIMESTAMP AS "c ol347634",
        test_1        |                         st_makeenvelope(6.0::FLOAT8::FLOAT8::FLOAT8, 5.0::FLOAT8::FLOAT8::FLOAT8, 2.0::FLOAT8::FLOAT8::FLOAT8, 1.0::FLOAT8::FLOAT8::FLOAT8)::GEOMETRY
        test_1        |                             AS c̴ol347635
        test_1        |                 )
        test_1        |                     AS "%vtab199690"
        test_1        |             ORDER BY
        test_1        |                 "c ol347634" NULLS LAST, c̴ol347635 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (861.03s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 8637692f77d69cda6052fef8e063cdac53870d3c:

        cockroach1_1  | status:              initialized new cluster
        cockroach1_1  | nodeID:              1
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | 
        postgres_1    | waiting for server to shut down...2023-10-13 05:19:53.239 UTC [49] LOG:  received fast shutdown request
        postgres_1    | .2023-10-13 05:19:53.240 UTC [49] LOG:  aborting any active transactions
        postgres_1    | 2023-10-13 05:19:53.242 UTC [49] LOG:  background worker "logical replication launcher" (PID 56) exited with exit code 1
        postgres_1    | 2023-10-13 05:19:53.244 UTC [51] LOG:  shutting down
        postgres_1    | 2023-10-13 05:19:53.341 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-10-13 05:19:53.460 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-10-13 05:19:53.460 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-10-13 05:19:53.460 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-10-13 05:19:53.464 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-10-13 05:19:53.468 UTC [68] LOG:  database system was shut down at 2023-10-13 05:19:53 UTC
        postgres_1    | 2023-10-13 05:19:53.473 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-10-13 05:19:54.629 UTC [78] ERROR:  data type refcursor has no default operator class for access method "btree"
        postgres_1    | 2023-10-13 05:19:54.629 UTC [78] HINT:  You must specify an operator class for the index or define a default operator class for the data type.
        postgres_1    | 2023-10-13 05:19:54.629 UTC [78] STATEMENT:  CREATE TABLE "tab%vle1" (col1_0 INT8 NOT NULL, col1_1 REFCURSOR NOT NULL, col1_͆2 TIME NOT NULL, PRIMARY KEY (col1_1));
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (605.81s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.94s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:172: CREATE TABLE "tab%vle1" (col1_0 INT8 NOT NULL, col1_1 REFCURSOR NOT NULL, col1_͆2 TIME NOT NULL, PRIMARY KEY (col1_1));
        test_1        |             
        test_1        |         compare_test.go:173: postgres: exec: ERROR: data type refcursor has no default operator class for access method "btree" (SQLSTATE 42704)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (630.44s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 96ab72f95759b6a40c5c2bc67c37101f3590ddd3:

        postgres_1    | CREATE EXTENSION
        postgres_1    | 
        postgres_1    | waiting for server to shut down....2023-10-15 05:20:53.515 UTC [49] LOG:  received fast shutdown request
        postgres_1    | 2023-10-15 05:20:53.516 UTC [49] LOG:  aborting any active transactions
        postgres_1    | 2023-10-15 05:20:53.518 UTC [49] LOG:  background worker "logical replication launcher" (PID 56) exited with exit code 1
        postgres_1    | 2023-10-15 05:20:53.520 UTC [51] LOG:  shutting down
        postgres_1    | 2023-10-15 05:20:53.611 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-10-15 05:20:53.635 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-10-15 05:20:53.635 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-10-15 05:20:53.635 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-10-15 05:20:53.638 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-10-15 05:20:53.643 UTC [68] LOG:  database system was shut down at 2023-10-15 05:20:53 UTC
        postgres_1    | 2023-10-15 05:20:53.647 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-10-15 05:20:54.903 UTC [78] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2023-10-15 05:20:54.903 UTC [78] STATEMENT:  CREATE TABLE table2 ("col2""_0" PG_LSN NOT NULL, "co�l2_1" REGTYPE NULL, "col
        postgres_1    |     2_2" FLOAT8 NULL, col😉2_3 REGROLE, "col2_%914" BYTEA NULL, "col%p2_5" INT2 NOT NULL, col2_6 PG_LSN, col2_7 TSVECTOR NOT NULL, col2_😉8 TSQUERY NULL, col2_9 INT4, col2_10 BOOL NOT NULL, "co\\xc3l͞2_11" TEXT GENERATED ALWAYS AS (lower(CAST(col2_6 AS TEXT))) STORED, "col2%p_12" TEXT GENERATED ALWAYS AS (CASE WHEN col😉2_3 IS NULL THEN '"'::TEXT ELSE 's'::TEXT END) STORED, "col2_ 13" INT8 GENERATED ALWAYS AS (col2_9 + "col%p2_5") STORED);
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_6, col2_10 DESC, "col%p2_5", "col2_ 13" DESC, "col2""_0" DESC);
        postgres_1    |     CREATE INDEX ON table2 (col2_10, (CASE WHEN col😉2_3 IS NULL THEN e'z?\'\x129\f'::TEXT ELSE e'\x00'::TEXT END), ("col%p2_5" + col2_9) DESC) INCLUDE ("co�l2_1", "co\\xc3l͞2_11");
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (605.25s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.98s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:172: CREATE TABLE table2 ("col2""_0" PG_LSN NOT NULL, "co�l2_1" REGTYPE NULL, "col
        test_1        |             2_2" FLOAT8 NULL, col😉2_3 REGROLE, "col2_%914" BYTEA NULL, "col%p2_5" INT2 NOT NULL, col2_6 PG_LSN, col2_7 TSVECTOR NOT NULL, col2_😉8 TSQUERY NULL, col2_9 INT4, col2_10 BOOL NOT NULL, "co\\xc3l͞2_11" TEXT GENERATED ALWAYS AS (lower(CAST(col2_6 AS TEXT))) STORED, "col2%p_12" TEXT GENERATED ALWAYS AS (CASE WHEN col😉2_3 IS NULL THEN '"'::TEXT ELSE 's'::TEXT END) STORED, "col2_ 13" INT8 GENERATED ALWAYS AS (col2_9 + "col%p2_5") STORED);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_6, col2_10 DESC, "col%p2_5", "col2_ 13" DESC, "col2""_0" DESC);
        test_1        |             CREATE INDEX ON table2 (col2_10, (CASE WHEN col😉2_3 IS NULL THEN e'z?\'\x129\f'::TEXT ELSE e'\x00'::TEXT END), ("col%p2_5" + col2_9) DESC) INCLUDE ("co�l2_1", "co\\xc3l͞2_11");
        test_1        |             
        test_1        |         compare_test.go:173: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (628.88s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 45f6344a2fc7d2d52f410e1ecad98f8c928cfeea:

        cockroach1_1  | clusterID:           382964a7-6a47-4bba-858e-c6719c10a6a6
        cockroach1_1  | status:              initialized new cluster
        cockroach1_1  | nodeID:              1
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | 
        postgres_1    | waiting for server to shut down....2023-10-17 05:20:17.577 UTC [49] LOG:  received fast shutdown request
        postgres_1    | 2023-10-17 05:20:17.579 UTC [49] LOG:  aborting any active transactions
        postgres_1    | 2023-10-17 05:20:17.581 UTC [49] LOG:  background worker "logical replication launcher" (PID 56) exited with exit code 1
        postgres_1    | 2023-10-17 05:20:17.583 UTC [51] LOG:  shutting down
        postgres_1    | 2023-10-17 05:20:17.678 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-10-17 05:20:17.799 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-10-17 05:20:17.799 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-10-17 05:20:17.799 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-10-17 05:20:17.803 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-10-17 05:20:17.808 UTC [68] LOG:  database system was shut down at 2023-10-17 05:20:17 UTC
        postgres_1    | 2023-10-17 05:20:17.812 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-10-17 05:20:19.306 UTC [78] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2023-10-17 05:20:19.306 UTC [78] STATEMENT:  CREATE TABLE table2 (col2_0 REFCURSOR NOT NULL, "col2_""😖1" BYTEA NOT NULL, col2_2 BYTEA, "col\g2_3" FLOAT4, 😗col2_4 REGROLE NULL, "%vcol2_5" TSVECTOR NOT NULL, "col2%p_6" INTERVAL NOT NULL, col2_7 INT2 NOT NULL, "co😿l2_?8" TIME NOT NULL, "%qcol2_9" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_0 AS TEXT))) STORED, "Col2_10" FLOAT8 GENERATED ALWAYS AS ("col\g2_3" + 0.6793595552444458::FLOAT8) STORED, "c%qoL2_11" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col2%p_6" IS NULL THEN e'AdD8L2^]\x12'::TEXT ELSE '%.CMX'::TEXT END) STORED, col2_12 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col2_""😖1" IS NULL THEN e':oocb\x01@}I'::TEXT ELSE e'\x00'::TEXT END) STORED, "'c%qol2_13" TEXT NULL GENERATED ALWAYS AS (CASE WHEN 😗col2_4 IS NULL THEN e'P\x12\t\tSBO'::TEXT ELSE e'=[\x1b'::TEXT END) STORED);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (605.83s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.38s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:172: CREATE TABLE table2 (col2_0 REFCURSOR NOT NULL, "col2_""😖1" BYTEA NOT NULL, col2_2 BYTEA, "col\g2_3" FLOAT4, 😗col2_4 REGROLE NULL, "%vcol2_5" TSVECTOR NOT NULL, "col2%p_6" INTERVAL NOT NULL, col2_7 INT2 NOT NULL, "co😿l2_?8" TIME NOT NULL, "%qcol2_9" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_0 AS TEXT))) STORED, "Col2_10" FLOAT8 GENERATED ALWAYS AS ("col\g2_3" + 0.6793595552444458::FLOAT8) STORED, "c%qoL2_11" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col2%p_6" IS NULL THEN e'AdD8L2^]\x12'::TEXT ELSE '%.CMX'::TEXT END) STORED, col2_12 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col2_""😖1" IS NULL THEN e':oocb\x01@}I'::TEXT ELSE e'\x00'::TEXT END) STORED, "'c%qol2_13" TEXT NULL GENERATED ALWAYS AS (CASE WHEN 😗col2_4 IS NULL THEN e'P\x12\t\tSBO'::TEXT ELSE e'=[\x1b'::TEXT END) STORED);
        test_1        |             
        test_1        |         compare_test.go:173: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (630.61s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ fbee0764a4a2953a1178ea8c3edd352545caa227:

        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.00s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 153 [running]:
        test_1        | testing.tRunner.func1.2({0x2384d20, 0xc001405520})
        test_1        |     GOROOT/src/testing/testing.go:1526 +0x24e
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1529 +0x39f
        test_1        | panic({0x2384d20, 0xc001405520})
        test_1        |     GOROOT/src/runtime/panic.go:884 +0x213
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x47a6660?, {0x3339308?, 0xc0013f1560?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:377 +0x445
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x32fc1a0?, 0x47a6660)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:310 +0x13c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc0010f9980)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:227 +0x96
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc0010bb410, {0xc0010d64c0?, 0x4, 0xc0010bb410?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:260 +0x8b1
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0xc000093968?, 0x2596ca6?, {0xc0010d64c0?, 0x21b3620?, 0x44a501?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:98 +0x2e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc000ec1ab0?, {0x2596ca6, 0x5}, 0x4, 0x20?, {0xc000e85a48, 0x3, 0x455195d?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x13d
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0x1?, 0x617ae0?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:118 +0x177
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc00026f500?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:98 +0x37
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.wrapCommonSetup.func1(0x2780548?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x22
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc0010b0680)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:143 +0xed
        test_1        | testing.tRunner(0xc0010b0680, 0xc0010bb380)
        test_1        |     GOROOT/src/testing/testing.go:1576 +0x10b
        test_1        | created by testing.(*T).Run
        test_1        |     GOROOT/src/testing/testing.go:1629 +0x3ea
        compare_test_1 exited with code 2
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 2
--- FAIL: TestComposeCompare (17.94s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #111157 compose: TestComposeCompare failed [C-test-failure FROZEN.branch-release-23.1.11-rc O-robot O-rsg T-sql-queries] - #109969 compose: TestComposeCompare failed [FROZEN.branch-release-23.1.11-rc O-robot T-sql-foundations] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #108652 compose: TestComposeCompare failed [O-robot T-sql-foundations TODO-deprecate.branch-release-23.1.9-rc] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ cacb4f39d1f88cde17d1abffcbbeb611adc440f8:

        postgres_1    |     ORDER BY
        postgres_1    |         "Col1958" ASC NULLS FIRST,
        postgres_1    |         col1959 ASC,
        postgres_1    |         col1960 ASC NULLS LAST,
        postgres_1    |         col1961,
        postgres_1    |         col1962 NULLS FIRST,
        postgres_1    |         "col%p1963" ASC,
        postgres_1    |         col1964 DESC,
        postgres_1    |         "col\r1965" ASC NULLS FIRST,
        postgres_1    |         "}col1966" ASC NULLS LAST,
        postgres_1    |         col1967 ASC,
        postgres_1    |         col1968 ASC,
        postgres_1    |         col1969,
        postgres_1    |         co😆l1970 DESC NULLS FIRST,
        postgres_1    |         col1971 NULLS LAST,
        postgres_1    |         col1972 ASC
        test_1        | --- FAIL: TestCompare (837.61s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (232.47s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         8:::INT8::INT2 AS "co͋L2007",
        test_1        |                         '{"A": {"J": [6, {"B": 2, "F": true, "G": null}, {"A": {"G": "H", "I": true}, "E": {"B": true}, "J": {"G": {"F": {"D": {"B": "F", "C": true, "G": {"F": {"D": [{"C": "A", "I": null}, [{"C": "G", "H": {"J": 6}}, null]], "H": {"B": true, "E": 3}, "J": {"B": {"F": [[{"E": [null], "F": {"I": null}}], 1], "I": {"C": null, "J": 3}}, "J": {"A": {"H": {"B": {"A": [0], "D": false}, "C": true}, "I": [[[{"C": {"A": true, "F": null}}, {"F": {"B": true, "F": {"D": 7, "E": "D"}, "G": {"E": {"A": null, "C": {"D": "J", "G": 0, "J": {"A": {"C": {"H": {"D": {"A": {"C": false, "H": {"C": null}}, "B": false, "E": 8}, "H": 4}}, "I": 1}, "B": {"A": {"B": {"D": {"C": {"B": ["J", 9], "F": "J", "H": "E"}, "E": {"B": true}}, "F": {"A": {"D": {"D": "G"}, "E": {"A": {"B": {"B": 4, "G": {"B": {"B": null}, "G": 6, "I": [[null, {"E": {"G": true}}, {"D": {"J": {"A": 0, "I": 4}}, "I": true}], {"A": "E", "B": 8, "I": {"A": true}}]}, "J": {"F": {"B": false, "D": {"A": [4], "E": false, "G": {"J": 9}}, "G": null}}}, "G": {"C": 7}, "H": "F"}, "I": false, "J": [{"E": {"A": true, "H": 7}}, [null, "C", {"A": "I", "J": [6, {"H": {"J": {"G": null, "I": {"A": null, "I": 3}, "J": null}}}, {"D": false, "F": {"A": 9, "B": "D", "C": 5}}]}]]}, "J": {"H": "I", "J": "E"}}, "B": false, "C": {"D": false, "G": true, "H": null}}}, "I": null}, "F": {"F": 5}}, "H": {"F": true}}}}, "J": {"A": [{"F": {"E": {"J": null}, "J": ["A", {"F": {"G": true}, "H": {"B": false, "D": "H", "G": null}}, "D"]}, "J": "A"}, {"A": {"E": {"F": "D", "G": "C"}}, "E": null, "F": {"A": null}}], "G": 4, "J": {"D": {"B": {"A": [{"A": false, "F": {"B": {"B": {"I": {"E": {"D": [1, {"E": ["F", null, [true]], "F": {"D": {"E": 9, "G": 7}, "I": {"A": {"C": {"E": {"C": {"B": true}, "H": null}, "F": [null, {"E": [{"B": true, "D": {"C": null, "G": true}, "J": {"E": null, "G": ["C"]}}, 3, false]}, {"E": {"B": ["E", 5, {"D": false}], "D": false}, "H": "G"}], "J": 5}, "G": [{"A": {"C": {"F": null, "G": null, "J": false}, "G": false, "I": "I"}, "B": {"D": {"E": [null], "G": {"J": {"C": {"F": {"B": {"B": false, "I": 7, "J": false}}, "G": [{"A": 5, "B": [{"B": [false], "H": 6, "I": 0}, null, {"B": {"A": "J", "H": [{"C": "G", "E": {"A": null, "C": 5, "I": {"B": {"A": {"G": "B", "H": {"C": "A", "E": 3}}, "G": "H"}, "F": false, "H": "H"}}}, false, {"H": null}], "I": {"B": {"C": 2, "F": {"B": false, "D": {"D": {"H": false}}, "J": true}}}}, "I": {"H": {"B": {"B": {"B": true}, "D": 0, "I": null}, "G": {"B": [false, "G", false], "D": "G", "I": false}, "J": [{"J": null}, "H", {"D": null, "E": "E"}]}, "J": true}, "J": {"E": {"F": {"A": [{"H": true}]}}}}], "J": 4}, {"J": {"A": {"B": true}}}], "J": {"E": {"D": {"D": [{"A": {"H": {"B": {"G": {"C": {"H": {"B": "I", "D": {"I": {"B": [{"B": true, "F": {"A": null, "F": {"B": 9, "F": false, "I": false}, "G": 0}, "I": true}], "J": 1}}, "H": {"C": {"B": [{"F": {"C": {"A": false, "D": true, "I": {"A": null, "B": [{"C": {"A": {"H": 1, "J": {"F": {"E": 5, "F": false, "H": false}, "G": {"E": {"F": null, "G": null, "I": {"G": false}}, "H": false}}}, "B": {"B": [{"E": {"F": 0, "J": [9]}, "H": {"H": {"D": {"G": true, "I": {"E": {"E": "H", "F": "D", "J": {"I": "H"}}}}}}}, {"F": {"E": {"I": {"J": {"I": false}}}}, "H": false, "J": {"B": {"D": true}, "H": {"B": "I", "D": null, "H": null}}}]}, "C": null}, "J": false}, {"C": null, "F": [[{"B": null, "D": {"G": {"C": null}}}, [false, false, false], {"H": [true, {"A": "G", "H": {"A": {"B": null, "C": [false, false]}}}, false]}], 9, null], "H": "I"}]}}, "E": {"D": 7}}, "G": 5, "H": "E"}, {"E": [{"F": false, "J": {"F": {"B": {"A": {"D": {"A": [[{"D": false, "G": {"E": [{"E": {"A": [{"G": "F", "H": [true]}]}, "J": {"J": {"F": 2, "H": {"B": 5}}}}, true, {"F": "F"}]}}, "B", true], null, {"E": true, "F": {"B": {"B": true, "G": {"F": {"A": "B", "H": {"C": true, "E": {"A": "H", "E": {"H": true, "J": true}, "H": {"F": false}}, "J": {"D": null, "F": {"G": {"F": true}, "J": false}}}}}}, "J": true}}], "C": null, "J": {"A": {"B": null, "G": {"E": "D"}}, "C": {"I": true}}}, "I": {"A": [{"C": null, "E": ["J", {"B": "G"}], "G": {"E": ["I"], "F": "I", "H": {"C": {"C": null, "D": {"A": true, "B": 6, "D": {"A": {"J": "E"}, "D": null, "E": {"E": true, "F": "B", "H": true}}}}}}}, {"D": [{"B": null}]}], "D": {"J": {"B": "D"}}}}, "E": false, "H": true}, "D": [[[{"G": {"D": {"A": "I"}, "G": false, "I": {"F": {"E": {"A": 6, "D": false}}}}, "H": true}, {"A": null}], "A", true], {"I": null, "J": {"F": false}}], "I": {"D": {"A": null, "I": {"D": {"E": [{"G": {"A": null, "D": "B"}, "H": {"B": false, "G": null, "J": 1}, "I": {"A": [null, {"E": {"D": {"C": null, "D": "G", "J": {"B": {"F": {"E": {"H": {"E": 3, "J": false}, "I": {"D": {"E": {"E": {"B": false, "D": {"A": {"A": {"F": true, "G": {"A": false, "H": {"B": {"D": {"J": false}, "G": false}}, "I": {"E": {"A": 3}, "J": {"E": false, "F": [true], "I": {"C": true, "J": [[null, {"F": [{"E": false, "G": null}, null], "H": [true, {"B": {"A": {"E": 4, "F": {"H": 6, "J": [true, null]}}}, "E": {"G": {"C": false, "H": null}, "H": true}, "J": {"E": {"A": null, "D": {"B": true, "C": null, "J": {"B": {"J": false}, "I": false}}, "G": [false, {"B": "E", "H": "E"}, false]}}}, {"D": {"E": true, "G": null}, "E": [{"G": {"A": 6, "D": true, "G": [{"H": null}, null, false]}, "H": "B"}, {"A": {"B": null, "J": "J"}, "E": {"A": {"H": [null], "J": {"A": {"B": false, "H": 2}, "I": 4}}, "G": "I"}}, ["C", true, null]], "G": {"A": [{"E": {"G": {"B": 9, "F": 5, "G": 2}}, "F": {"B": 2, "H": [{"B": 8, "G": {"A": {"G": null}}, "I": true}, {"H": {"A": [null, null, null], "D": {"D": null, "F": null, "J": null}}}, "C"], "I": {"F": {"B": [true], "D": null}, "G": true}}, "J": {"B": 9}}, {"F": {"A": {"B": {"C": true}, "F": {"H": null, "J": "G"}}, "F": null, "J": 6}}, [true]]}}], "J": null}]]}}}}}}, "F": false, "I": {"D": false, "F": {"D": false, "F": {"H": 6, "J": {"B": false, "I": {"B": {"E": {"F": [{"F": true, "H": [null, ["I", null, "F"]], "J": true}, null, 8], "G": {"E": {"D": null, "H": false}}, "I": true}, "G": "J", "J": {"B": {"I": {"D": {"A": 8, "H": "F", "J": "G"}, "H": {"B": true, "E": {"B": {"I": false}, "H": 0, "I": [4]}, "I": 9}}}, "C": null, "G": {"B": {"A": {"A": 1, "G": {"A": {"E": true, "H": {"C": {"F": "C", "J": {"J": "E"}}}}, "D": null}}, "H": {"G": 1}}, "C": {"A": [{"D": {"D": "I", "E": {"H": null}, "G": {"B": {"G": false}, "G": {"A": {"A": [{"C": 4}, 4, true], "B": {"F": {"G": {"E": 4, "F": "E", "H": {"G": null}}}, "I": 8}}, "H": 1}, "J": false}}, "E": {"G": {"A": {"A": {"F": 7}, "B": {"J": true}, "I": true}, "H": {"C": false, "G": {"F": 5}}}, "H": true}}, "D", [{"J": null}, {"A": "F", "G": {"G": true}, "H": {"H": {"F": null}}}]], "C": {"A": {"A": {"C": null, "J": {"D": {"I": {"F": {"A": {"B": {"B": {"A": null, "D": null}, "F": 6, "J": false}}}, "J": null}}}}, "I": {"A": {"D": 2}}}, "J": [{"C": {"C": true, "F": {"A": true, "I": {"A": true, "G": {"D": false, "E": true}}}, "H": 1}, "H": false}, true, 8]}, "H": "A"}}}}, "E": true}, "J": [{"I": false}, 9, {"A": false, "G": {"F": {"B": {"J": true}, "F": null}}, "J": [{"D": {"F": {"H": false, "J": false}, "I": {"I": true}}}, [{"G": false}, 7, "I"]]}]}}, "J": true}}}}, "G": {"H": 4}, "I": false}}, "E": true, "G": [true, {"E": false, "G": "H"}]}}, "H": {"E": {"G": {"B": true, "D": {"E": "D"}, "E": "C"}}, "F": true}}, "J": {"C": {"E": true}, "F": [false, {"A": "J", "H": {"C": true}}, {"B": [{"A": false, "C": null, "H": [true]}, null], "G": {"A": [[null], {"A": {"E": 6}, "I": true}, null], "F": true, "H": [5, false, [{"G": {"E": null, "J": "B"}, "I": {"A": true, "D": false}}, [7, 9, false], "F"]]}, "H": false}], "H": [true, {"D": {"G": [false], "I": {"B": {"H": [[{"C": {"E": false, "H": {"G": null, "H": false}, "I": {"A": true, "H": {"F": [{"J": 6}], "G": "H", "I": 7}, "J": {"A": [{"J": {"H": {"I": false}}}], "F": {"C": {"C": {"F": [{"A": {"C": [[["J", {"A": {"A": 0, "F": "A"}, "D": true, "I": null}], {"A": {"I": 5}, "G": "E", "I": true}, 6]], "I": true, "J": {"C": true, "D": "F", "I": null}}}, false, {"H": {"E": "I", "F": true, "I": {"D": null}}, "I": false}]}, "F": {"B": "B", "I": true}}}}}}}], {"B": "H", "H": [null, false]}]}}}}]}}}}, "I": null}}]}}], "F": true}, "H": 4}}}}}}, {"B": true, "I": "I"}, true], "F": "F"}, [false]], "J": {"D": "C", "E": [{"A": {"G": null, "H": {"B": true, "D": null, "F": true}}}, true, {"A": "E", "H": 6}], "I": 6}}, "I": {"B": null}}}, "J": "J"}}, "H": [{"E": true, "G": false, "J": [2, 6]}, [false]]}, "D": [{"J": [{"C": false, "E": null}, {"G": {"A": {"G": {"I": "F"}, "H": {"J": {"I": null}}, "J": {"E": {"D": true, "H": {"D": {"C": true, "E": {"J": [false, {"J": {"G": {"J": false}}}]}, "F": {"H": null}}, "E": {"A": false, "C": [{"I": {"J": {"J": {"G": {"B": {"C": 3}, "I": false}}}}}, [1, 7], false], "F": [false, [{"B": {"D": 7, "I": {"C": {"A": {"I": null}, "C": "D", "G": true}}}, "J": "C"}, true], "D"]}}}, "H": {"D": null, "E": 6, "H": 2}}}, "H": true}}, null]}], "H": false}}, "I": {"C": false, "D": ["G"], "E": false}}], "F": 1, "G": null}}, "H": {"G": {"J": {"C": null}}}}}}}}, "F": false, "J": false}, "F": true}]}, "F": true}, "J": {"E": {"B": {"C": false, "I": 7}, "J": null}, "F": {"C": [{"A": {"E": {"B": {"C": {"E": {"B": {"I": true}, "F": "F", "I": 9}}, "H": {"B": false, "G": "C"}, "I": {"B": {"F": 0}}}, "E": 3, "F": {"C": {"D": null}, "G": [{"G": {"H": null}}, {"B": {"A": {"C": true, "F": 5}, "B": {"I": ["C", [true, {"B": "E", "C": null}], false]}}, "I": false}, false]}}, "J": {"B": [true, {"A": {"F": {"G": true, "J": {"A": null, "C": "H", "F": [{"G": null, "I": [{"B": 7, "H": {"C": true, "G": 1, "J": [[{"D": true}, {"G": false}], "A", null]}}, 1]}, {"B": false}]}}, "G": null}, "C": true, "G": true}], "G": {"H": null, "J": true}, "H": {"C": [false], "E": {"A": true, "B": false}, "G": null}}}, "I": {"E": null, "G": {"F": {"D": {"E": {"C": {"C": {"I": "H", "J": true}, "D": [{"I": {"D": true, "H": {"D": {"F": 7}}}}], "G": "I"}, "G": 4}, "I": {"J": 2}}, "E": "H", "J": {"B": null, "C": true}}, "I": {"G": [null], "J": [true, {"A": false}]}}, "H": {"G": {"B": 1, "J": 7}, "H": {"B": "J", "F": true, "G": {"B": {"E": "H", "F": [null, "D", false]}}}, "I": false}}}, {"D": {"B": false}, "F": 1, "G": {"A": {"E": {"H": {"E": {"I": "H"}, "F": {"B": {"C": {"A": true, "C": {"A": {"A": [true, false], "G": null, "I": {"C": null, "G": {"E": 4, "F": false, "J": {"B": true, "H": null, "J": false}}}}, "I": {"H": {"C": {"A": "I", "D": {"G": 4}, "I": {"B": null, "J": true}}}}, "J": [{"E": "J", "J": "G"}, {"A": false}]}}}, "C": "B", "H": [false, {"C": false}, {"A": {"B": false, "G": null, "J": false}, "F": [{"G": false, "I": {"B": {"C": {"A": {"G": {"D": [[6], "I"]}}, "D": "H"}}, "D": true}}], "I": [{"G": 8}, [false, true, {"D": {"D": [false, {"D": "G", "G": {"C": false}}], "I": false, "J": true}}]]}]}}, "I": {"H": true}}, "H": true}}}, null]}}}}]}, "I": {"C": 4}}}, "E": {"A": "E", "E": {"C": {"B": 5, "C": [{"B": {"E": 2}}, "D"]}, "E": 5}}}, "E": 7}}], "F": 5}}, "E": {"A": "B", "E": false, "G": null}, "J": 0}}}}}]], {"B": {"F": 8}, "F": [2], "H": true}, {"H": "E", "J": null}]}, "D": "G", "I": {"D": {"B": {"C": "C", "E": {"D": false, "F": {"A": {"A": [false, "I"], "I": [[false]]}, "D": {"F": false, "H": true}, "H": null}}}, "D": null}}}}}}}}, "H": "E", "J": {"B": {"C": {"H": null}}}}}}]}}':::JSONB::JSONB
        test_1        |                             AS c͎ol2008,
        test_1        |                         NULL::GEOGRAPHY AS " col2009"
        test_1        |                 )
        test_1        |                     AS "ta%vb986"
        test_1        |             ORDER BY
        test_1        |                 "co͋L2007" DESC, c͎ol2008 ASC NULLS FIRST, " col2009" ASC NULLS LAST
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (862.59s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 07915532f9a7def000127029c667c3a91ce90e47:

        test_1        |             ORDER BY
        test_1        |                 col😃18042 ASC, col_18043 NULLS FIRST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.00s)
        test_1        |         compare_test.go:141: starting test: mutators
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 25429 [running]:
        test_1        | testing.tRunner.func1.2({0x2387dc0, 0xc00154d680})
        test_1        |     GOROOT/src/testing/testing.go:1526 +0x24e
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1529 +0x39f
        test_1        | panic({0x2387dc0, 0xc00154d680})
        test_1        |     GOROOT/src/runtime/panic.go:884 +0x213
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x47ed6c0?, {0x337e4a8?, 0xc000fa83c0?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:377 +0x445
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x3341260?, 0x47ed6c0)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:310 +0x13c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc001171680)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:227 +0x96
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc0022a0690, {0xc000f95f40?, 0x4, 0xc0022a0690?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:260 +0x8b1
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0xc001472968?, 0x2599feb?, {0xc000f95f40?, 0x21b6340?, 0x44a501?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:98 +0x2e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc0011c7610?, {0x2599feb, 0x5}, 0x4, 0x40?, {0xc0005dba48, 0x3, 0x459875d?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x13d
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0x1?, 0x617ae0?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:118 +0x177
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc0015d4ea0?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:98 +0x37
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.wrapCommonSetup.func1(0x27be460?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x22
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc0015d4ea0)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:143 +0xed
        test_1        | testing.tRunner(0xc0015d4ea0, 0xc0022a0600)
        test_1        |     GOROOT/src/testing/testing.go:1576 +0x10b
        test_1        | created by testing.(*T).Run
        test_1        |     GOROOT/src/testing/testing.go:1629 +0x3ea
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 2
--- FAIL: TestComposeCompare (44.43s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 4f26bd1b3f90c4f1c9dd530f9692e8125207b4c8:

        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare3322797029/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("H3125"),
        test_1        |             +   string("H3125.0000000000000000"),
        test_1        |                 nil,
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ('H':::STRING::STRING::STRING || (5:::DECIMAL::DECIMAL::DECIMAL ^ 5:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::STRING
        test_1        |                             AS col389761,
        test_1        |                         NULL::GEOMETRY AS col389762
        test_1        |                 )
        test_1        |                     AS 😑tab203833
        test_1        |             ORDER BY
        test_1        |                 col389761 DESC NULLS LAST, col389762 DESC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ('H'::TEXT::TEXT::TEXT || (5::DECIMAL::DECIMAL::DECIMAL ^ 5::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::TEXT
        test_1        |                             AS col389761,
        test_1        |                         NULL::GEOMETRY AS col389762
        test_1        |                 )
        test_1        |                     AS 😑tab203833
        test_1        |             ORDER BY
        test_1        |                 col389761 DESC NULLS LAST, col389762 DESC;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (924.61s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ f3c7285d89afd63b2f7cae762638b86f237c1d72:

        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (413.81s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare3698646110/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare postgres to cockroach1: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("H2.2924316695611777"),
        test_1        |             +   string("H2.29243166956118"),
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ('H'::TEXT::TEXT::TEXT || acosh(5.0::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::TEXT
        test_1        |                             AS 😺col😝500746
        test_1        |                 )
        test_1        |                     AS tab😾332659
        test_1        |             ORDER BY
        test_1        |                 😺col😝500746 DESC NULLS LAST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ('H':::STRING::STRING::STRING || acosh(5.0:::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::STRING
        test_1        |                             AS 😺col😝500746
        test_1        |                 )
        test_1        |                     AS tab😾332659
        test_1        |             ORDER BY
        test_1        |                 😺col😝500746 DESC NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1042.83s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 8315a4bc997fb8b8d679079e14d6d7ca94d53bc6:

        postgres_1    | 2023-10-25 05:24:01.175 UTC [78] ERROR:  could not identify an equality operator for type refcursor at character 107
        postgres_1    | 2023-10-25 05:24:01.175 UTC [78] STATEMENT:  SELECT
        postgres_1    |         *
        postgres_1    |     FROM
        postgres_1    |         (SELECT tab̽136532.col1_8 AS col259395 FROM postgres.public.table1 AS tab̽136532 GROUP BY tab̽136532.col1_8)
        postgres_1    |             AS "ta""b136533"
        postgres_1    |     ORDER BY
        postgres_1    |         col259395 DESC
        test_1        | --- FAIL: TestCompare (801.82s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (196.73s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1877378579/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare postgres to cockroach1: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("01010000000000000000B063C00000000000E05040"),
        test_1        |             +   nil,
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_pointfromgeohash('B'::TEXT::TEXT::TEXT, NULL::INT4::INT4)::GEOMETRY AS col259396) AS tab136534
        test_1        |             ORDER BY
        test_1        |                 col259396 DESC NULLS LAST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT st_pointfromgeohash('B':::STRING::STRING::STRING, NULL::INT4::INT4)::GEOMETRY AS col259396) AS tab136534
        test_1        |             ORDER BY
        test_1        |                 col259396 DESC NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (828.47s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ aa85c69776da942b4d539891725b780ba995401e:

        postgres_1    |     ORDER BY
        postgres_1    |         col230822 NULLS FIRST,
        postgres_1    |         col230823 DESC NULLS LAST,
        postgres_1    |         "c😅o
        postgres_1    |     l230824" DESC NULLS LAST,
        postgres_1    |         col230825 NULLS LAST,
        postgres_1    |         col230826 DESC NULLS FIRST,
        postgres_1    |         col_230827 DESC,
        postgres_1    |         "c\\x92ȍl230828" DESC NULLS LAST,
        postgres_1    |         col230829 ASC NULLS LAST,
        postgres_1    |         "Col230830",
        postgres_1    |         "co\\u171Dl230831" DESC NULLS LAST,
        postgres_1    |         col230832 NULLS FIRST,
        postgres_1    |         col230833,
        postgres_1    |         col😉230834 ASC,
        postgres_1    |         col230835 NULLS FIRST,
        postgres_1    |         col230836 NULLS LAST
        test_1        | --- FAIL: TestCompare (929.94s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (324.77s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '{"E": {"E": 5, "G": {"E": {"B": {"A": null, "F": {"J": true}}, "C": null, "J": true}}}, "F": {"A": [{"F": 8, "I": [0, [{"G": {"B": true, "D": "J", "J": 4}}, "C", {"B": false, "F": null, "J": true}], {"A": null}]}, 2, [{"A": true, "B": {"C": "C", "D": {"C": {"H": 6}, "I": {"G": {"B": "E", "D": {"B": [{"E": {"F": 6, "G": {"A": [{"B": true, "E": {"C": "H", "G": {"C": {"E": {"B": {"A": 2, "C": 6, "G": {"A": true, "J": {"C": [{"D": {"B": false, "D": {"D": {"B": {"E": ["F"]}, "H": true}}, "G": {"F": true, "G": false}}, "E": {"J": 7}, "F": {"D": 3, "E": 9, "H": {"H": [null, {"C": {"E": [{"C": {"A": {"B": {"A": ["I", {"A": 3, "H": {"I": "D"}, "I": "B"}], "B": 4, "I": [{"D": null, "F": [true], "I": {"B": {"C": true, "D": 2}}}, 8, [{"F": {"A": 2, "D": true, "I": ["A", 2, {"E": true, "J": true}]}, "I": false}]]}, "D": {"B": {"H": "A", "I": {"I": {"D": false, "E": {"E": [true]}}}}, "H": {"C": {"A": [["E", {"B": {"A": [{"F": true, "J": null}, "A", true], "B": {"A": {"G": null}, "H": false}, "F": true}, "H": {"C": "E", "D": "F"}, "J": {"D": null, "G": [0], "I": {"A": 2, "E": {"D": "G"}}}}, {"A": 7, "D": {"I": {"C": {"D": true}, "J": true}, "J": "J"}}], {"I": [null, {"C": {"F": {"C": "B", "D": true, "J": true}, "G": "E"}, "D": {"H": {"A": null, "F": null, "G": false}}, "I": [[{"B": true, "J": true}], false, false]}]}]}, "I": {"D": {"A": {"A": 4, "I": {"H": {"E": [6, null, 1]}}}, "B": "J"}, "I": 7}, "J": "E"}}}, "I": "G"}, "D": true, "J": {"B": null}}, [{"C": {"B": {"C": {"A": {"A": ["F", 0, {"A": {"E": 8, "I": {"B": "G"}}, "B": {"B": null, "I": [6, "C"], "J": {"B": {"F": true, "I": [false, true], "J": {"D": 8, "H": {"A": ["A", null]}}}, "G": [{"F": {"D": false}}, {"D": null, "G": 2, "H": null}, true]}}}], "C": true, "F": [{"B": {"B": null}, "H": [false, [{"C": [{"H": {"H": {"C": null}}, "J": false}, {"C": {"B": null, "H": false}, "I": false}], "H": {"E": {"D": null, "H": null}}, "J": "D"}, "G"], 5]}, {"J": [{"B": true, "F": true}, "I"]}]}, "B": true, "H": null}, "J": "B"}, "H": true}, "D": {"H": [[[{"A": null, "B": ["A"], "D": false}], "A"]]}, "H": {"A": null}}, {"H": false}], {"A": false, "F": null}], "G": [2, true], "I": "I"}, "E": {"F": 2, "G": {"F": {"E": {"C": {"A": {"C": {"D": {"F": false, "H": true, "J": {"B": {"B": null, "F": true}}}}, "G": 2, "J": "F"}, "D": true, "F": false}, "E": "I", "J": null}, "J": "H"}}}}, [{"E": true, "I": ["H", 9, {"A": "A", "J": 3}], "J": false}]]}}}]}}}}, "H": 8}, "D": false, "F": true}, "J": {"B": {"F": 3}, "F": {"B": null, "E": false}}}}], "B": {"B": {"A": 0, "B": "C", "I": {"G": true}}, "I": {"D": {"B": [[{"A": [{"E": {"B": "B", "E": {"B": "I", "C": false, "J": true}}, "I": null, "J": {"B": {"E": {"A": {"C": {"H": false}, "G": {"D": null}, "I": {"G": true, "H": {"A": "A", "J": [null, false, false]}, "I": "G"}}}, "G": 7}, "G": [false, {"C": true}, null]}}], "D": false}], {"C": false, "E": {"C": {"H": 4, "I": {"D": 2, "H": "J"}, "J": {"H": {"F": true, "G": [{"B": {"B": {"B": false, "E": [true, {"B": {"A": true, "G": {"A": {"D": true, "J": null}, "J": {"F": true, "G": false}}}, "H": {"F": [true, null, [false]]}, "I": true}], "F": false}, "J": false}, "C": false, "F": {"A": null, "B": null, "G": [false]}}, {"J": [{"C": true}, [{"A": true, "I": {"B": ["D"], "I": 6}}, {"I": "I"}, true], {"E": [[{"A": null, "J": "B"}, [{"A": true, "D": {"I": {"C": "C"}}, "E": {"C": {"C": {"F": null}, "E": {"C": {"F": 0}, "G": {"C": [[[{"D": {"D": [{"F": 5}], "G": "F"}, "F": {"D": "G", "I": {"E": {"F": {"E": 4, "G": "F"}}, "G": null}}, "G": [{"A": 4, "C": {"H": null, "I": true}, "I": [{"C": {"A": {"A": {"B": "D", "G": 1}, "J": {"E": 6, "H": [false, null], "I": {"F": {"F": {"A": {"H": null, "I": {"B": true, "C": true, "I": "F"}}, "I": "J"}, "H": true}}}}, "C": 1, "E": {"B": {"G": 9}, "E": 0}}}]}, {"A": "B", "G": [true]}, null]}], "I", 2]], "E": false}}}, "D": {"B": [true, {"D": 7, "F": 2, "I": true}, {"F": {"D": 7, "E": {"J": 0}, "G": {"A": {"A": "J", "B": null}, "C": false, "D": {"G": "D", "I": [false, "C"]}}}, "J": {"I": null}}]}, "G": "I"}}]], false], "H": {"F": 1, "H": false, "J": {"B": null, "I": true}}}]}]}, "I": 7}}, "D": [9, 8, 9], "F": {"A": [{"A": {"H": false, "I": {"F": {"B": null, "D": {"C": false, "G": {"A": false, "C": [{"A": "B", "D": 9}]}}, "H": null}}}, "D": 9}, {"D": {"A": "J"}}], "F": {"C": {"B": {"C": {"B": {"E": true, "J": "F"}, "F": false, "I": {"B": {"J": true}, "E": 9}}, "E": false, "F": true}, "H": {"B": null}}}}}}], "E": false}, "I": [{"B": [[{"D": null, "E": {"F": "G", "J": {"E": {"C": [{"C": {"A": {"C": 6}, "I": {"C": [{"B": {"A": true, "E": [[true, [null, {"F": "J", "G": null, "J": true}, [{"A": {"C": {"B": {"E": {"A": "J", "I": [4, true]}}, "H": {"A": null, "B": true}}, "H": false}, "C": true}, [1, "E"], "J"]]], {"J": true}], "H": 4}, "C": [{"B": {"B": "D", "D": {"B": "F", "C": {"H": {"F": null}, "I": null}, "F": {"A": {"A": [false, "A"], "B": false, "H": [["I", [{"A": {"A": [{"C": {"G": [true, {"B": null, "F": {"D": true}}, {"A": {"D": false, "J": false}, "F": {"C": true, "F": false}}], "J": {"B": {"A": {"A": {"D": null}, "D": {"H": null, "J": [{"A": null, "C": {"C": {"G": 8, "H": null}}, "H": {"A": 7, "F": "D", "I": {"B": {"B": {"B": {"A": null, "C": {"I": [true, {"B": [{"F": {"E": {"G": true}}, "G": {"D": {"E": {"A": true, "B": {"D": {"D": 0, "H": null}, "I": null}, "E": {"A": null}}, "I": {"F": {"E": {"G": true}, "G": false}, "J": true}}}}], "G": {"E": true}}, false]}, "E": [1]}, "H": {"D": {"C": {"E": {"F": {"B": [null], "E": {"A": 8, "F": {"H": false}}}}, "F": null, "G": {"E": {"C": true, "E": "H"}, "G": 4}}}, "G": {"F": false}}}}, "D": null}}}]}}, "I": {"A": "C", "G": "J"}}, "C": "G", "D": {"A": {"H": {"E": "I", "H": false}}, "B": 4, "F": "J"}}}, "I": 2}], "C": [[false], {"D": false, "E": {"C": {"H": false}, "G": {"C": true, "G": 3}}}, "A"]}, "C": null}, {"E": [null, {"E": {"C": {"F": true}, "H": null}}]}, {"C": {"G": {"A": {"E": {"A": true}}, "E": true, "G": true}}, "J": {"F": {"A": 6}, "G": 7}}]], "A", 3]}, "F": {"G": {"F": true, "H": false, "I": {"A": {"F": {"E": null, "F": true}}, "B": "D", "C": null}}}}}}}], "G": 1}], "G": null, "H": null}}, "G": {"E": "E", "H": null, "I": "J"}}, null, [{"I": [{"B": true, "C": "A", "E": false}, {"F": "F"}, [{"B": null, "F": true, "G": "A"}, {"D": {"B": 2}, "E": null}]]}]]}, "G": "B", "J": false}}, "I": [null]}, [{"B": 2}, "H"], null]], "F": false, "I": 7}, false, false]}}, "I": true}, "I": {"D": {"B": {"B": null, "G": null}, "H": {"E": {"F": false}, "F": [true]}}}}, "F": {"A": {"A": {"A": {"C": {"A": {"B": false}, "D": {"G": 1}}, "J": {"D": {"B": {"E": "E", "G": {"B": {"A": [["B", {"C": false, "E": [1, {"F": [null, 5], "H": {"A": {"B": {"E": {"F": "F", "I": false}, "H": true}, "G": {"G": "F"}}, "H": [true]}}]}, false], [{"A": {"C": [null, 1, false], "F": {"D": {"B": {"F": [{"F": 2, "G": {"D": null, "E": false}}], "G": {"I": {"J": false}, "J": {"H": "J"}}}, "C": {"D": 8, "E": "F"}, "G": null}}, "G": [false, {"A": "C", "G": [{"C": [[{"B": "G", "D": null}]], "G": false}, [true], null]}, true]}, "C": {"G": false}}], null], "C": null, "F": {"D": {"A": 7, "I": null}}}, "E": "E"}}, "I": {"D": null, "I": 8}}}}, "J": true}, "I": [true, 2, "A"]}}}, {"E": {"C": {"C": [{"D": [{"D": true, "J": {"D": {"C": 4, "I": null}, "G": {"F": 1}, "H": null}}, {"A": null}], "G": {"C": true, "G": 9, "J": [false, [false, 9]]}}, [false]]}}}, {"B": [[false]]}], "C": {"A": {"D": false, "H": {"A": {"C": [{"B": "D", "C": 2, "F": {"A": {"A": {"E": 3, "G": {"E": {"A": 8, "E": false, "F": null}, "F": {"C": 9, "E": true, "J": null}, "H": {"C": true, "H": ["A"]}}}, "G": {"E": false, "G": [{"A": 6, "F": null}], "I": {"E": {"C": false, "E": null}, "J": {"D": null, "H": {"H": {"A": null, "B": {"E": 1, "H": [{"D": {"A": {"H": "E"}, "G": false}, "G": 1}], "J": {"C": {"A": {"B": {"G": "D"}, "F": {"A": "D", "E": [[{"D": {"A": 0, "B": {"I": false}}, "F": "A"}, {"C": 7, "F": true, "G": true}], false], "I": "G"}}, "C": {"C": {"H": false}, "E": {"F": {"D": "E"}, "J": "D"}}, "J": {"B": [{"H": {"G": "G"}}], "F": 7}}, "D": null}}, "G": false}}, "I": {"D": {"E": true, "I": "C", "J": {"A": null, "B": {"E": {"A": false, "I": {"C": [{"D": null, "H": [{"D": {"C": [["A"], {"A": 2, "C": [{"F": false, "H": {"D": 4, "G": 8, "H": {"B": {"I": "C"}, "D": false, "J": {"A": "G"}}}}]}], "H": [false]}, "E": [false, "D"], "F": {"I": [{"D": true, "G": {"F": true}}, 2], "J": null}}]}], "D": [true, {"I": {"A": {"B": [{"A": {"B": null, "C": false, "D": {"B": [{"E": [{"A": 0, "E": null, "H": [true, false, null]}, {"C": true}], "H": "E"}], "F": false, "G": "D"}}}, true, true], "D": null, "I": null}}}, {"D": 3, "F": "D"}]}}}, "D": 6}}, "J": {"E": null, "F": [{"F": {"G": {"E": false, "F": {"B": {"C": 8, "D": "J", "H": {"A": false}}, "D": null}}, "J": 5}, "G": [8], "H": "C"}, "H", 2], "I": false}}}}}}, "E": {"D": 8, "E": 1, "J": null}}}, {"C": {"E": {"B": null}, "F": null}, "D": "J", "H": {"E": null, "H": {"A": {"A": null}, "E": 9}}}, null], "F": {"H": 8}, "I": 4}, "F": true}}, "J": {"C": {"F": [null], "G": false, "H": [{"A": {"H": {"B": true, "I": false, "J": "B"}, "J": 2}}, 0]}}}, "G": {"C": {"B": false, "E": true}, "G": {"A": [{"A": {"B": {"J": true}}, "D": "B", "E": null}], "D": false}}}}}}, "I": null}, "J": [{"A": false, "H": 0, "J": {"C": false, "E": 7, "I": true}}, 2]}]], "C": {"A": null, "D": [9, null, {"G": "G", "H": {"E": ["H", 9], "G": false, "I": {"A": {"D": "H", "G": "C"}, "I": 5}}}]}, "F": false}}':::JSONB::JSONB
        test_1        |                             AS col230918
        test_1        |                 )
        test_1        |                     AS "\\uDD18t""Ab122065"
        test_1        |             ORDER BY
        test_1        |                 col230918
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        postgres_1    | 2023-10-30 05:36:21.611 UTC [98] LOG:  could not receive data from client: Connection reset by peer
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (954.33s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #111157 compose: TestComposeCompare failed [C-test-failure FROZEN.branch-release-23.1.11-rc O-robot O-rsg T-sql-queries] - #109969 compose: TestComposeCompare failed [FROZEN.branch-release-23.1.11-rc O-robot T-sql-foundations] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #108652 compose: TestComposeCompare failed [O-robot T-sql-foundations TODO-deprecate.branch-release-23.1.9-rc] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 71aaf665b6348b9b6e40f38a669bb68f83ea97cd:

        postgres_1    |         col270506 DESC NULLS FIRST,
        postgres_1    |         col😸270507 NULLS FIRST,
        postgres_1    |         col270508 ASC NULLS FIRST,
        postgres_1    |         col270509 ASC NULLS LAST,
        postgres_1    |         col270510,
        postgres_1    |         col270511 NULLS FIRST
        test_1        | --- FAIL: TestCompare (883.09s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (278.99s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1225189266/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("'Ad':530A,532B,902B"),
        test_1        |             +   string("'Ad':530a,532b,902b"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT initcap(text('''AD'':530A,532B,902B':::TSVECTOR::TSVECTOR::TSVECTOR)::STRING::STRING)::STRING AS col270614)
        test_1        |                     AS tab146270
        test_1        |             ORDER BY
        test_1        |                 col270614 NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT initcap(text('''AD'':530A,532B,902B'::TSVECTOR::TSVECTOR::TSVECTOR)::TEXT::TEXT)::TEXT AS col270614)
        test_1        |                     AS tab146270
        test_1        |             ORDER BY
        test_1        |                 col270614 NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (907.94s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ bfc5c35b112fe612d837ef247b2c61e532e8184d:

        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (432.07s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2476040027/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("A-6.79971145522038"),
        test_1        |             +   string("A-6.799711455220379"),
        test_1        |                 []uint8("C"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ('A':::STRING::STRING::STRING || tan(8.0:::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::STRING AS col571614,
        test_1        |                         '\x43':::BYTES::BYTES AS c_ol571615
        test_1        |                 )
        test_1        |                     AS "t ab326688"
        test_1        |             ORDER BY
        test_1        |                 col571614, c_ol571615 ASC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         ('A'::TEXT::TEXT::TEXT || tan(8.0::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::TEXT AS col571614,
        test_1        |                         '\x43'::BYTEA::BYTEA AS c_ol571615
        test_1        |                 )
        test_1        |                     AS "t ab326688"
        test_1        |             ORDER BY
        test_1        |                 col571614, c_ol571615 ASC;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1064.18s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 414cb46513079bb8869bd776f045ed6c96ad6d26:

        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare3157566653/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   s"-0291-04-22 09:12:43.145224 +0000 UTC",
        test_1        |             +   s"0001-08-01 09:00:00 +0000 UTC",
        test_1        |                 nil,
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         make_timestamp(int4(true::BOOL::BOOL)::INT4::INT4, 8::INT8::INT4::INT4, 1::INT8::INT4::INT4, 9::INT8::INT4::INT4, 0::INT8::INT4::INT4, 0.0::FLOAT8::FLOAT8::FLOAT8)::TIMESTAMP
        test_1        |                             AS col219248,
        test_1        |                         NULL::rand_typ_3 AS col219249
        test_1        |                 )
        test_1        |                     AS "tAb120960"
        test_1        |             ORDER BY
        test_1        |                 col219248 ASC NULLS LAST, col219249 DESC NULLS FIRST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         make_timestamp(int4(true::BOOL::BOOL)::INT4::INT4, 8:::INT8::INT4::INT4, 1:::INT8::INT4::INT4, 9:::INT8::INT4::INT4, 0:::INT8::INT4::INT4, 0.0:::FLOAT8::FLOAT8::FLOAT8)::TIMESTAMP
        test_1        |                             AS col219248,
        test_1        |                         NULL::rand_typ_3 AS col219249
        test_1        |                 )
        test_1        |                     AS "tAb120960"
        test_1        |             ORDER BY
        test_1        |                 col219248 ASC NULLS LAST, col219249 DESC NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (827.52s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #113814 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2.17-rc] - #112510 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1.12-rc.FROZEN] - #112154 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.2] - #109969 compose: TestComposeCompare failed [FROZEN.branch-release-23.1.11-rc O-robot T-sql-foundations] - #109400 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-23.1] - #108652 compose: TestComposeCompare failed [O-robot T-sql-foundations TODO-deprecate.branch-release-23.1.9-rc] - #89361 compose: TestComposeCompare failed [O-robot T-sql-foundations branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ dfbc963e79751f0edf63b9e178a098b5d37ba0dd:

        postgres_1    |     ORDER BY
        postgres_1    |         col324252 DESC NULLS LAST,
        postgres_1    |         _col324253 ASC NULLS LAST,
        postgres_1    |         "col}324254" ASC NULLS FIRST,
        postgres_1    |         "c\gol324255" ASC NULLS LAST,
        postgres_1    |         "c  ol324256" ASC NULLS FIRST,
        postgres_1    |         col324257,
        postgres_1    |         co̞l324258 NULLS FIRST
        test_1        | --- FAIL: TestCompare (921.57s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (316.40s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1970152222/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   s"1969-12-31 23:59:57.789155 +0000 UTC",
        test_1        |             +   s"1969-12-31 23:59:57.789154 +0000 UTC",
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT to_timestamp(cot(9.0:::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::TIMESTAMPTZ AS col324259) AS tab175186
        test_1        |             ORDER BY
        test_1        |                 col324259 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT to_timestamp(cot(9.0::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::TIMESTAMPTZ AS col324259) AS tab175186
        test_1        |             ORDER BY
        test_1        |                 col324259 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (948.24s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ e174990dd5015a38b1e9bc6723f270dbe647c3a3:

        cockroach2_1  | logs:                /cockroach-data/logs
        cockroach2_1  | temp dir:            /cockroach-data/cockroach-temp2105021824
        cockroach2_1  | external I/O path:   /cockroach-data/extern
        cockroach2_1  | store[0]:            path=/cockroach-data
        cockroach2_1  | storage engine:      pebble
        cockroach2_1  | clusterID:           c3f2fd57-a62a-4551-ab31-53ebbe11b6ef
        cockroach2_1  | status:              initialized new cluster
        cockroach2_1  | nodeID:              1
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | CREATE EXTENSION
        postgres_1    | 
        postgres_1    | waiting for server to shut down...2023-11-09 06:20:35.741 UTC [51] LOG:  received fast shutdown request
        postgres_1    | .2023-11-09 06:20:35.742 UTC [51] LOG:  aborting any active transactions
        postgres_1    | 2023-11-09 06:20:35.744 UTC [51] LOG:  background worker "logical replication launcher" (PID 58) exited with exit code 1
        postgres_1    | 2023-11-09 06:20:35.746 UTC [53] LOG:  shutting down
        postgres_1    | 2023-11-09 06:20:35.841 UTC [51] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-11-09 06:20:35.962 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-11-09 06:20:35.962 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-11-09 06:20:35.963 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-11-09 06:20:35.965 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-11-09 06:20:35.970 UTC [70] LOG:  database system was shut down at 2023-11-09 06:20:35 UTC
        postgres_1    | 2023-11-09 06:20:35.974 UTC [1] LOG:  database system is ready to accept connections
        test_1        | --- FAIL: TestCompare (604.88s)
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (0.34s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:172: ALTER TABLE table1 ADD FOREIGN KEY (col1_5) REFERENCES table3 ("col3}�_6")
        test_1        |         compare_test.go:173: cockroach1: exec: ERROR: there is no unique constraint matching given keys for referenced table table3 (SQLSTATE 23503)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (629.29s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ aa7c33840bc881704e0b39de8e513a07cc4fa457:

        postgres_1    |             FROM
        postgres_1    |                 postgres.public.table1 AS tab107689, postgres.public.table3 AS "%vtab107690"
        postgres_1    |         )
        postgres_1    |             AS tab107691
        postgres_1    |     ORDER BY
        postgres_1    |         "c ol\\u5B97182773" ASC, col182774 NULLS FIRST
        test_1        | --- FAIL: TestCompare (747.36s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (143.52s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2575656452/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("D1.79175946922805"),
        test_1        |             +   string("D1.791759469228055"),
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT ('D'::TEXT::TEXT::TEXT || ln(6.0::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::TEXT AS "col""182775")
        test_1        |                     AS "t\\u0DD6ab107692"
        test_1        |             ORDER BY
        test_1        |                 "col""182775" DESC NULLS FIRST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT ('D':::STRING::STRING::STRING || ln(6.0:::FLOAT8::FLOAT8::FLOAT8)::FLOAT8::FLOAT8)::STRING AS "col""182775")
        test_1        |                     AS "t\\u0DD6ab107692"
        test_1        |             ORDER BY
        test_1        |                 "col""182775" DESC NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (771.96s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ cdf92626a841423e6a22fe204475235875883f61:

        postgres_1    |         col705586 NULLS LAST,
        postgres_1    |         "co%ql705587" ASC,
        postgres_1    |         "co 😛l705588" DESC,
        postgres_1    |         """col705589" NULLS LAST,
        postgres_1    |         "Col%v705590" DESC NULLS FIRST,
        postgres_1    |         "co|l705591" DESC NULLS LAST
        test_1        | --- FAIL: TestCompare (1117.51s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (511.66s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:201: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare393780172/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:203: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("F2.0794415416798359283"),
        test_1        |             +   string("F2.0794415416798359"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT ('F':::STRING::STRING::STRING || ln(8:::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::STRING AS col705648)
        test_1        |                     AS ta̺b373258
        test_1        |             ORDER BY
        test_1        |                 col705648 ASC NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT ('F'::TEXT::TEXT::TEXT || ln(8::DECIMAL::DECIMAL::DECIMAL)::DECIMAL::DECIMAL)::TEXT AS col705648)
        test_1        |                     AS ta̺b373258
        test_1        |             ORDER BY
        test_1        |                 col705648 ASC NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1142.98s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 1f280feba9f673687ce76362f1db3746bc7df2ee:

        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/mutators (0.00s)
        test_1        |         compare_test.go:141: starting test: mutators
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 806685 [running]:
        test_1        | testing.tRunner.func1.2({0x2279060, 0xc003bdaa40})
        test_1        |     GOROOT/src/testing/testing.go:1545 +0x238
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1548 +0x397
        test_1        | panic({0x2279060?, 0xc003bdaa40?})
        test_1        |     GOROOT/src/runtime/panic.go:914 +0x21f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x472e8c0?, {0x3260bd8?, 0xc003ca8120?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:377 +0x436
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x321f3c0?, 0x472e8c0)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:310 +0x12c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc000f8ea80)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:227 +0x7f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc0010b7ad0, {0xc002e017c0?, 0x4, 0xc0010b7ad0?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:260 +0x89d
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0x2076c40?, 0x247c981?, {0xc002e017c0?, 0x4a62028?, 0x2?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:98 +0x28
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc0037682c0?, {0x247c981, 0x5}, 0x4, 0x40?, {0xc004903a40, 0x3, 0x7f6938c52f18?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x131
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0xc00306bcc8?, 0x1?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:118 +0x15e
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc0001f8a00?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:98 +0x2f
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.init.wrapCommonSetup.func28(0x269d068?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x1b
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc001c49040)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:143 +0xe2
        test_1        | testing.tRunner(0xc001c49040, 0xc0010b7a40)
        test_1        |     GOROOT/src/testing/testing.go:1595 +0xff
        test_1        | created by testing.(*T).Run in goroutine 28
        test_1        |     GOROOT/src/testing/testing.go:1648 +0x3ad
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 2
--- FAIL: TestComposeCompare (632.55s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on master @ 1baa5c9a075ff0791490092898d610df70998fd3:

Fatal error:

panic: test timed out after 29m57s
running tests:
    TestComposeCompare (29m57s)

Stack:

goroutine 11 [running]:
testing.(*M).startAlarm.func1()
    GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
    GOROOT/src/time/sleep.go:176 +0x2d

Log preceding fatal error

``` === RUN TestComposeCompare ```

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 12 months ago

compose.TestComposeCompare failed with artifacts on master @ 14733120c08ba1a0a050bb5442c3311090206566:

Fatal error:

panic: test timed out after 29m57s
running tests:
    TestComposeCompare (29m57s)

Stack:

goroutine 11 [running]:
testing.(*M).startAlarm.func1()
    GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
    GOROOT/src/time/sleep.go:176 +0x2d

Log preceding fatal error

``` === RUN TestComposeCompare ```

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 12 months ago

compose.TestComposeCompare failed with artifacts on master @ 14733120c08ba1a0a050bb5442c3311090206566:

        test_1        |             ORDER BY
        test_1        |                 "co%pl71387" DESC NULLS LAST
        test_1        |         compare_test.go:213: postgres: ping: conn closed
        test_1        |     --- FAIL: TestCompare/mutators (0.00s)
        test_1        |         compare_test.go:141: starting test: mutators
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 86777 [running]:
        test_1        | testing.tRunner.func1.2({0x2280ca0, 0xc001262560})
        test_1        |     GOROOT/src/testing/testing.go:1545 +0x238
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1548 +0x397
        test_1        | panic({0x2280ca0?, 0xc001262560?})
        test_1        |     GOROOT/src/runtime/panic.go:914 +0x21f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x473c8c0?, {0x32698f8?, 0xc001181f80?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:377 +0x436
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x3228120?, 0x473c8c0)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:310 +0x12c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc000e92a80)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:227 +0x7f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc000f4e180, {0xc000f494c0?, 0x4, 0xc000f4e180?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:260 +0x89d
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0x207e320?, 0x2484dc1?, {0xc000f494c0?, 0x4a6fb48?, 0x2?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:98 +0x28
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0xc000f4d870?, {0x2484dc1, 0x5}, 0x4, 0x20?, {0xc000aa5a40, 0x3, 0x7f6ec2d5d108?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x131
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0xc002745cc8?, 0x1?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:118 +0x15e
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc000032a00?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:98 +0x2f
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.init.wrapCommonSetup.func28(0x26a5658?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x1b
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc0007a9a00)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:143 +0xe2
        test_1        | testing.tRunner(0xc0007a9a00, 0xc000f4e0f0)
        test_1        |     GOROOT/src/testing/testing.go:1595 +0xff
        test_1        | created by testing.(*T).Run in goroutine 9
        test_1        |     GOROOT/src/testing/testing.go:1648 +0x3ad
        compare_test_1 exited with code 2
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 2
--- FAIL: TestComposeCompare (202.92s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 12 months ago

compose.TestComposeCompare failed with artifacts on master @ 64dacab2808c5420e3fd99d2562e8ecb97b7742b:

        postgres_1    |                 "t""%1cab81380".col3_1 AS "co\vl143638",
        postgres_1    |                 NULL::TEXT COLLATE de_DE AS col143639,
        postgres_1    |                 (9::INT8::INT8::INT8 * "t""%1cab81380"."co%ql3_ 0"::INTERVAL)::INTERVAL AS "c ol143640",
        postgres_1    |                 'A'::TEXT::TEXT AS "co%vl143641",
        postgres_1    |                 "t""%1cab81380".col3_2 AS col143642
        postgres_1    |             FROM
        postgres_1    |                 postgres.public."tabl e3" AS "t""%1cab81380"
        postgres_1    |             ORDER BY
        postgres_1    |                 "t""%1cab81380".col3_1 NULLS LAST, "t""%1cab81380".col3_2 DESC
        postgres_1    |         )
        postgres_1    |             AS "tab""81381"
        postgres_1    |     ORDER BY
        postgres_1    |         col143637 ASC NULLS FIRST,
        postgres_1    |         "co\vl143638" ASC NULLS FIRST,
        postgres_1    |         col143639 NULLS LAST,
        postgres_1    |         "c ol143640" NULLS LAST,
        postgres_1    |         "co%vl143641" ASC,
        postgres_1    |         col143642 ASC NULLS FIRST
        test_1        | --- FAIL: TestCompare (1632.93s)
        test_1        |     compare_test.go:132: Checking connection to: postgres
        test_1        |     compare_test.go:132: Checking connection to: cockroach1
        test_1        |     compare_test.go:132: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1027.21s)
        test_1        |         compare_test.go:141: starting test: postgres
        test_1        |         compare_test.go:150: initializing connection: cockroach1
        test_1        |         compare_test.go:150: initializing connection: postgres
        test_1        |         compare_test.go:212: SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '{"A": {"B": {"E": true, "I": {"A": {"C": {"A": {"E": [{"D": [5, {"F": {"G": {"I": {"F": false, "H": false, "J": true}}}, "I": true}, {"E": "B", "H": {"B": true, "D": false, "I": false}, "J": true}], "E": {"D": [null], "G": null, "H": {"E": {"B": {"C": {"A": true, "J": "G"}, "H": [false, 6], "I": {"B": null, "G": null}}, "D": {"D": false, "J": {"B": [4, {"F": "F", "J": {"E": 2, "G": "C", "J": {"B": {"F": "F"}, "J": true}}}, {"E": {"C": {"B": false, "E": null, "H": false}, "E": false}}], "F": false}}, "G": 8}}}, "I": {"B": {"E": {"A": null}}}}, [{"C": {"A": {"H": {"B": null, "D": 5, "E": [{"H": {"I": false}}]}}, "G": {"B": {"E": {"A": null, "E": 7, "I": false}, "H": {"C": [6, true], "D": true}}, "D": false}}, "I": {"D": "D", "F": false, "H": {"C": 4, "E": {"B": null, "D": {"E": true, "F": [1, [{"A": true}], false], "J": 8}, "G": {"F": true}}, "F": {"A": null, "F": {"B": null, "E": true}}}}}, false, {"D": "I"}]], "J": {"I": 8}}}, "G": true}, "E": {"B": [[false, true], {"J": false}], "D": [{"B": true}], "J": {"D": 3, "E": 0, "F": false}}}}, "C": {"B": [false, {"C": true, "D": false}, true], "F": {"C": null, "F": false}}, "E": false}, "D": 4, "I": [[[true, {"B": {"E": null, "G": {"D": {"D": false, "J": false}}}}, {"A": false, "E": {"G": {"D": {"B": {"C": {"B": {"A": {"E": 7}, "H": null}}, "G": "E", "I": [[{"I": {"B": "G", "I": [{"C": 2}, "C", {"B": {"I": "F", "J": {"F": true, "H": [[[{"A": true, "C": [{"E": null}, ["C", false, [{"D": 0}, {"I": {"A": false, "F": [{"I": {"B": [7, false], "D": {"B": true, "C": false}, "G": "E"}}, {"G": false, "H": [null, {"E": {"F": false, "J": [true, {"B": {"H": {"E": "I", "J": {"A": 3, "J": null}}}, "E": {"A": ["D", null, {"F": false}], "E": [{"A": {"F": {"C": [{"B": [{"C": false, "F": {"A": {"B": 5}, "C": true, "D": [{"G": null}]}}], "J": [true]}, false, {"B": true, "C": {"A": false, "B": true, "H": {"I": {"B": 0, "D": [true, {"C": {"C": "I", "D": [8, true, {"B": true, "D": null, "J": null}]}, "J": [null, 3, 8]}, true], "E": {"C": {"C": 4, "E": "F", "J": "I"}, "D": false}}}}}]}}, "B": false, "I": 4}]}}]}, "I": {"J": [{"C": null}, false]}}, {"B": null, "D": {"B": null, "E": null, "F": {"G": {"E": null, "H": {"B": {"B": [{"D": {"A": "D", "H": "A"}, "G": {"D": true, "E": null, "H": {"C": 1, "D": true, "I": true}}}], "F": {"I": 0}}, "G": "D"}, "I": false}, "J": true}}, "J": false}], "J": {"D": "I", "I": {"E": false}}}]}}]]], "F": {"D": {"E": "I"}, "J": true}}], null, true], false], "J": true}}, "J": {"B": 5}}], "J": [{"E": {"D": {"D": {"D": null, "G": {"C": {"D": "F", "H": false}, "D": false}, "J": "I"}, "G": true, "I": [{"F": false, "G": null}, {"A": [{"C": {"A": true, "G": {"H": {"C": true, "G": {"G": [{"D": false, "F": null}], "H": 5}, "H": [false, {"C": {"J": {"C": false, "I": [{"A": {"A": null, "C": null, "F": false}, "E": {"A": null, "J": {"H": {"C": 4}, "I": [[true]]}}}, "A"], "J": {"A": {"F": [[{"F": null, "H": false}, [{"D": {"D": {"G": {"E": true}, "H": {"A": {"G": false, "H": null, "J": {"C": {"I": null}, "G": {"J": {"I": null}}}}, "D": {"A": {"F": [null, {"J": null}, "I"], "G": {"E": {"B": false, "F": [[{"D": true}, [[[false], [{"F": true}, {"C": [{"C": 8}, {"F": null, "J": true}, [true, 9, "F"]]}]], false, [null]]], [{"F": 1, "H": {"D": null, "F": "A"}}, [null, {"A": [{"G": "F"}, 7]}, true], [{"A": null, "C": false, "D": false}]], false], "I": {"C": 4}}, "F": {"D": true}, "G": [{"G": {"G": [true, false]}, "J": {"H": {"A": {"H": 0}, "B": "A", "H": {"E": null}}}}, true]}}, "J": {"E": false, "F": {"B": true, "I": 1}}}, "F": null}}}, "G": {"D": false}}, "J", true]], [{"I": {"C": true, "E": {"B": {"D": null, "G": 2}, "J": {"G": {"E": null, "G": {"A": "A", "F": "C"}, "J": true}}}, "J": null}}, null, {"B": null, "C": {"I": {"D": {"H": {"H": 6}}, "H": {"H": true}}}, "H": "I"}]], "H": false, "I": null}, "E": true}}}, "G": true, "J": true}, null]}}, "H": {"F": 4}}, "D": {"B": "E", "F": {"B": null, "I": null, "J": {"E": {"H": null, "J": {"I": [9]}}}}}, "J": {"D": false}}, {"A": null, "E": true, "I": false}, 4], "C": {"G": "B", "H": {"E": null, "G": [{"B": ["D"], "C": [{"A": {"G": 0}}, {"J": {"I": [{"H": "E"}, "A", 9]}}]}, false], "H": {"C": {"B": 0, "C": null, "I": true}, "G": {"A": {"B": true, "F": {"A": null, "E": [{"B": false, "C": {"C": {"C": "G", "H": "D"}, "D": false, "F": [[null, null, {"A": null, "E": {"G": {"B": [[false], true], "H": {"D": false, "F": false, "J": "E"}}, "I": {"B": {"B": "B", "H": false}, "D": {"A": {"E": "J"}, "H": true}, "J": "E"}, "J": null}}], false, true]}, "E": "D"}], "J": {"A": null, "B": false, "H": {"F": [[{"A": false}, true, {"F": {"A": {"C": {"B": {"A": {"D": [{"C": {"D": {"F": true}, "E": 2}, "G": "I"}, {"B": [5, true, null]}, {"G": {"A": null, "C": {"C": "I", "J": false}, "G": {"A": null, "G": [0, null, null]}}, "H": [false]}]}, "D": {"E": {"D": {"C": "H", "D": [true, {"C": true, "G": {"D": {"F": {"A": true, "H": "C", "J": {"C": true}}, "J": {"H": null}}, "F": {"H": {"B": null}}}}, [{"A": null, "F": 5}, [{"B": null, "D": {"D": {"A": 6, "B": {"D": {"D": "C", "E": 2, "F": {"J": "I"}}}, "H": null}, "F": {"J": {"D": null, "H": 8}}, "G": null}, "J": {"C": [[{"G": "A"}, {"D": {"J": {"A": [7, 6], "B": 6, "H": {"E": {"B": {"B": true, "G": {"D": "H", "H": {"I": false}, "I": {"C": 2, "G": false}}, "J": {"I": {"B": 1, "C": null}}}, "C": "G"}, "H": {"H": false}}}}, "E": true, "G": {"C": {"A": 1}, "D": true, "J": {"B": {"C": "H", "E": [true, [{"B": {"A": {"C": "C", "G": true}, "E": true}, "D": false, "G": false}]]}, "C": {"I": [null, false, {"C": null, "H": false, "J": {"D": {"D": {"D": 6}, "G": false}}}]}, "D": true}}}, null]], "I": "H"}}, [null], {"C": {"C": {"D": {"B": true, "E": "J"}, "I": [{"B": {"E": {"G": {"B": {"E": {"B": 9}, "G": {"C": true, "D": {"J": {"H": 3}}}}}}, "H": 0, "I": {"D": false}}, "G": {"A": {"E": {"D": null, "I": {"C": {"A": 8}, "G": [false]}}, "F": null}, "G": {"A": true, "D": {"A": [7], "J": true}, "H": {"C": "C", "I": {"F": 4}}}}, "J": false}, 7]}, "J": {"C": true, "D": ["H"], "J": true}}}]]]}, "E": {"B": [false, {"E": null}], "I": [["C", true], {"A": {"H": {"B": {"F": {"A": {"D": "C", "F": null}}, "H": true, "J": 7}, "G": "F"}, "I": null}, "B": {"J": {"A": {"B": {"B": {"C": 0}, "J": [false, true]}, "E": null, "G": {"H": {"C": {"I": "B", "J": {"B": false, "E": "E"}}, "D": 4, "H": [{"A": {"C": null, "H": false}, "D": {"F": null, "J": 3}}, {"C": [6, true, {"B": null}]}, false]}}}, "J": {"C": {"I": [{"A": 3, "J": {"D": {"E": true, "J": [{"C": null}]}}}, true, {"D": {"B": null, "J": [{"F": {"C": {"B": false, "J": true}, "H": {"B": {"B": {"F": false, "I": 9}}, "G": true}}, "G": "B", "I": 3}, [{"D": {"F": {"D": 1, "J": {"I": [{"F": 9}, {"A": true, "D": "B"}]}}}, "G": "I"}, {"H": {"B": true}}, {"G": {"A": {"H": true, "J": {"E": {"B": {"E": {"I": true}, "I": "E"}, "J": [null, {"E": true}, 9]}, "F": [{"A": false}, {"F": {"C": {"G": {"A": {"A": {"I": {"B": {"C": {"A": true}, "D": true, "G": {"A": true, "F": {"E": false, "I": [{"A": {"A": null, "B": [null, 8]}, "D": {"C": "I", "F": {"D": {"E": {"F": false, "G": false, "I": null}}, "F": false, "J": {"B": "J", "C": false}}, "J": {"F": [{"A": 3, "I": {"E": null}}, {"D": "B", "F": {"D": true, "F": false}}], "G": {"D": {"E": null, "F": {"C": null, "E": 3, "I": [{"B": [{"E": false, "J": "I"}], "H": null}]}, "H": {"A": [0, {"E": null}], "B": {"F": [[false, {"D": {"G": "I"}, "E": {"E": {"B": {"B": false, "E": {"A": null, "I": 7}}, "I": true}, "H": [false]}, "J": ["C", {"J": [{"H": false}]}, {"A": {"B": null}, "E": {"A": null, "E": true, "I": {"B": null, "I": "E"}}, "I": {"B": {"A": "J", "B": 2, "J": 9}, "J": true}}]}, {"D": {"I": false}, "J": {"D": {"A": {"I": true}, "D": null, "F": [[{"A": false, "B": {"B": [false, {"D": {"A": {"A": {"C": {"F": "C", "G": {"A": false}}, "E": true}, "B": null, "F": 2}}, "G": false}, null], "F": {"C": false, "E": true, "J": {"F": {"G": {"C": false, "H": {"J": {"C": "H", "I": {"D": true}}}}, "H": [{"B": false, "E": false, "G": 0}, {"A": [{"D": null, "E": false, "J": "I"}, null]}, {"F": "G"}]}, "G": false, "H": {"C": {"E": "G"}, "G": "E"}}}}}, true, [{"F": 8}]], {"B": "A"}]}, "J": true}}]], "H": false}, "G": true}}}}}, "E": "C"}]}, "J": [6]}}, "E": {"C": {"A": 3, "B": false}}, "H": 1}}, "F": {"B": {"G": null, "J": 4}, "F": 2}, "G": {"C": {"B": 4, "I": {"E": {"G": {"D": true}, "H": "D"}}}}}}, "I": {"B": [{"F": true, "H": 9}, false, {"G": {"C": 9, "G": 9}, "J": {"E": {"B": {"I": false, "J": {"E": "J"}}, "I": false}}}]}}}, "H": "C"}]}}, "B": false}, "H": {"E": 5, "I": "G"}}]]}, "F": false}]}, "F": 7}}}, "E": [[3], [{"C": true, "E": [[3]], "J": false}, true]]}, {"C": false}]}, "J": [{"F": {"A": false}, "J": null}]}, "H": false}, "I": {"A": 4, "E": [{"G": true, "J": {"I": false}}]}}, "G": 3}, "F": "I"}, "F": null}}], [{"B": {"F": true, "I": {"E": false, "F": false, "H": {"F": {"J": {"A": true}}}}}, "J": {"G": {"G": {"G": false}, "I": null, "J": 1}, "H": {"E": [true]}}}], "H"]}}}}, "I": {"F": "B", "J": "D"}}}}}, "F": [{"B": false, "D": {"G": null, "I": [{"F": "B", "G": {"A": {"B": {"E": {"A": {"E": {"E": ["D", {"D": 1}, {"F": {"A": {"C": {"B": false}}, "B": 3, "H": {"A": "H", "I": null}}, "G": "B"}], "H": 7, "I": true}, "I": 9}, "G": {"A": false}}}, "F": {"C": {"H": null}, "I": 5}, "G": {"H": 3, "J": "I"}}, "J": "I"}, "J": true}, "H", "B"]}}, {"D": {"B": null, "I": {"A": {"H": {"I": 1}}, "B": {"F": {"B": 9, "D": {"B": "E"}, "F": false}}, "D": {"A": {"D": "F", "E": {"C": false}}, "C": false, "D": 8}}}, "F": {"G": true}}]}]}}, "J": null}, 5]}, "J": 5}, 2, {"D": {"B": {"F": [{"E": {"E": true}}, null, {"G": null}]}, "D": {"F": [{"D": 7, "G": {"D": 2, "E": {"D": null, "F": "B"}}}, {"B": {"B": "J", "E": {"A": {"H": {"C": 1, "I": {"J": false}, "J": true}}, "C": "G", "H": null}, "J": "F"}, "D": null}, 9]}, "H": null}, "E": {"F": "D"}, "F": 0}], {"G": 9}, null]}, "C": false, "E": 1}, "E": true}}, "G": {"A": {"C": {"I": {"H": 3}, "J": null}, "D": "J"}, "I": "H", "J": "I"}}], 3], true]}':::JSONB::JSONB
        test_1        |                             AS "co"" l143648"
        test_1        |                 )
        test_1        |                     AS tab81385
        test_1        |             ORDER BY
        test_1        |                 "co"" l143648" NULLS LAST
        test_1        |         compare_test.go:213: cockroach1: ping: conn closed
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:125: exit status 1
--- FAIL: TestComposeCompare (1658.24s)

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!

cockroach-teamcity commented 12 months ago

compose.TestComposeCompare failed with artifacts on master @ 4bb5fd1acb8309b5c9c1c74baecbf04b1e70e653:

Fatal error:

panic: test timed out after 29m57s
running tests:
    TestComposeCompare (29m57s)

Stack:

goroutine 35 [running]:
testing.(*M).startAlarm.func1()
    GOROOT/src/testing/testing.go:2259 +0x3b9
created by time.goFunc
    GOROOT/src/time/sleep.go:176 +0x2d

Log preceding fatal error

``` === RUN TestComposeCompare ```

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

This test on roachdash | Improve this report!