search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.09k stars 3.8k forks source link

compose: TestComposeCompare failed #101271

Closed cockroach-teamcity closed 1 year ago

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ f1921dbd499fd258a606c4e7180aff7b82b6f900:

        postgres_1    | 2023-04-12 05:29:24.134 UTC [51] LOG:  shutting down
        postgres_1    | 2023-04-12 05:29:24.227 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-12 05:29:24.249 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-12 05:29:24.249 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-12 05:29:24.249 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-12 05:29:24.252 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-12 05:29:24.256 UTC [68] LOG:  database system was shut down at 2023-04-12 05:29:24 UTC
        postgres_1    | 2023-04-12 05:29:24.261 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-12 05:29:25.859 UTC [78] ERROR:  collation "de" for encoding "UTF8" does not exist at character 151
        postgres_1    | 2023-04-12 05:29:25.859 UTC [78] STATEMENT:  CREATE TABLE "table|3" (col3_0 VARCHAR NOT NULL, "col\\x3e3_1" FLOAT8 NOT NULL, col3_2 INT4 NOT NULL, "c\\u3CE6ol3_ 3" BIT(36) NOT NULL, col3_̔4 TEXT COLLATE de NOT NULL, col3_5 OID NOT NULL, "c,ol3_6" TEXT COLLATE de NOT NULL, col3_7 INT8 NOT NULL, col3_8 INT2 NOT NULL, "co l3_9" FLOAT8 NOT NULL GENERATED ALWAYS AS ("col\\x3e3_1" + 2.0697046585581953::FLOAT8) STORED, "?col3_10" INT8 NOT NULL GENERATED ALWAYS AS (col3_8 + 4321::INT8) STORED, PRIMARY KEY (col3_7, col3_5, col3_2, col3_0, col3_8, col3_̔4, "?col3_10", "co l3_9", "c\\u3CE6ol3_ 3"));
        postgres_1    |     CREATE UNIQUE INDEX ON "table|3" (col3_2 ASC, col3_0 DESC, "co l3_9" ASC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.13s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.17s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "table|3" (col3_0 VARCHAR NOT NULL, "col\\x3e3_1" FLOAT8 NOT NULL, col3_2 INT4 NOT NULL, "c\\u3CE6ol3_ 3" BIT(36) NOT NULL, col3_̔4 TEXT COLLATE de NOT NULL, col3_5 OID NOT NULL, "c,ol3_6" TEXT COLLATE de NOT NULL, col3_7 INT8 NOT NULL, col3_8 INT2 NOT NULL, "co l3_9" FLOAT8 NOT NULL GENERATED ALWAYS AS ("col\\x3e3_1" + 2.0697046585581953::FLOAT8) STORED, "?col3_10" INT8 NOT NULL GENERATED ALWAYS AS (col3_8 + 4321::INT8) STORED, PRIMARY KEY (col3_7, col3_5, col3_2, col3_0, col3_8, col3_̔4, "?col3_10", "co l3_9", "c\\u3CE6ol3_ 3"));
        test_1        |             CREATE UNIQUE INDEX ON "table|3" (col3_2 ASC, col3_0 DESC, "co l3_9" ASC);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "de" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.84s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "t    able😦1" ("c%40ol1 _0" OID NOT NULL, col1_1 TIMESTAMP NOT NULL, "_coL1_2" REGTYPE NOT NULL, col1_3 STRING COLLATE da NOT NULL, "c\\x2eo̟l1_4" BYTES NOT NULL, col1_5 BIT(43) NOT NULL, 😹col😘1_6 VARCHAR NOT NULL, col1_7 INTERVAL NOT NULL, col1_8 TIMESTAMP NOT NULL, col1_9 STRING NOT NULL AS (lower(😹col😘1_6)) STORED, col1_10 STRING NOT NULL AS (lower(CAST(col1_3 AS STRING))) VIRTUAL, "col1""_11" STRING NOT NULL AS (CASE WHEN col1_7 IS NULL THEN '':::STRING ELSE e'\x18\x1fYq\x0fN.,\x0e':::STRING END) VIRTUAL, col😑1_12 STRING NOT NULL AS (CASE WHEN col1_7 IS NULL THEN e'>\x1d\x10\x18':::STRING ELSE 'f{':::STRING END) VIRTUAL, "😃col 1_13" STRING NULL AS (CASE WHEN "c\\x2eo̟l1_4" IS NULL THEN 'gj-':::STRING ELSE e':\tS\x14\'Ei':::STRING END) VIRTUAL, PRIMARY KEY (col1_1 DESC, col1_7, "c%40ol1 _0", col1_3, "c\\x2eo̟l1_4", "_coL1_2", col1_8, col1_10 ASC, "col1""_11"), UNIQUE ("😃col 1_13" ASC, col1_1 ASC, col1_5 DESC) STORING (😹col😘1_6) WHERE ((((((("t  able😦1".col1_8 < '3000-01-01 00:00:00':::TIMESTAMP) OR ("t  able😦1".col1_10 <= e'\x00':::STRING)) AND ("t   able😦1"."c\\x2eo̟l1_4" < e'\\xff':::BYTES)) AND ("t able😦1".col1_9 < e'\x00':::STRING)) AND ("t able😦1".col😑1_12 >= e'\x00':::STRING)) OR ("t   able😦1".😹col😘1_6 >= e'\U00002603':::STRING)) OR ("t able😦1"."😃col 1_13" = '"':::STRING)) OR ("t able😦1".col1_1 != '0001-01-01 00:00:00':::TIMESTAMP), FAMILY (col1_7, "c\\x2eo̟l1_4", "_coL1_2", col1_3), FAMILY (col1_8), FAMILY (col1_9, col1_1), FAMILY ("c%40ol1 _0", 😹col😘1_6), FAMILY (col1_5));
        test_1        |             ALTER TABLE "t  able😦1" INJECT STATISTICS e'[{"avg_size": 15, "columns": ["\\"_coL1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5917620, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 25, "columns": ["\U0001F639col\U0001F6181_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5891459, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 19, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5318005, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 0, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 845779, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 16, "columns": ["col\U0001F6111_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6449594, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 8, "columns": ["\\"\U0001F603col 1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2530964, "histo_col_type": "", "name": "__auto__", "null_count": 4397176, "row_count": 7000000}, {"avg_size": 25, "columns": ["\\"c%40ol1 _0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6218484, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 16, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 172835, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 17, "columns": ["\\"col1\\"\\"_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6166890, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 10, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4810880, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 26, "columns": ["\\"c\\\\\\\\x2eo\u031Fl1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 273696, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 2, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5740578, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 4, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4115456, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 11, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2283510, "histo_buckets": [{"distinct_range": 0, "num_eq": 9000, "num_range": 0, "upper_bound": "2032-05-07 21:27:00.000502"}], "histo_col_type": "TIMESTAMP", "name": "__auto__", "null_count": 0, "row_count": 7000000}]':::JSONB;
        test_1        |             ALTER TABLE "t  able😦1" INJECT STATISTICS e'[{"avg_size": 4, "columns": ["\\"c%40ol1 _0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 73659884, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 30, "columns": ["\\"c\\\\\\\\x2eo\u031Fl1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 40140995, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 5, "columns": ["\\"col1\\"\\"_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1462735, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 19, "columns": ["col\U0001F6111_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 30594314, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 29, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 39159028, "histo_buckets": [{"distinct_range": 0, "num_eq": 90000000000, "num_range": 0, "upper_bound": "1973-12-23 19:07:58.000236"}, {"distinct_range": 2492825666417201000, "num_eq": 3715318907476708785, "num_range": 2492825666417200952, "upper_bound": "1982-03-28 20:37:45.00059"}, {"distinct_range": 67836.83049466627, "num_eq": 40000000000, "num_range": 200000, "upper_bound": "1990-12-29 09:02:03.000739"}, {"distinct_range": 793.0631492391099, "num_eq": 6865192484954621706, "num_range": 1000, "upper_bound": "1996-10-04 22:11:33.000631"}, {"distinct_range": 3497169088160838000, "num_eq": 400, "num_range": 3497169088160838122, "upper_bound": "2015-05-09 15:53:25.000544"}, {"distinct_range": 1479682661883901200, "num_eq": 8904679389951259166, "num_range": 2691499332976122287, "upper_bound": "2032-05-11 17:31:14.000028"}], "histo_col_type": "TIMESTAMP", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 29, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 85334166, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 24, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 84087530, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 18, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 33986532, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 28, "columns": ["\\"_coL1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 63451741, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 10, "columns": ["\U0001F639col\U0001F6181_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 15641658, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 1, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 99123948, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 24, "columns": ["\\"\U0001F603col 1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 21459424, "histo_buckets": [{"distinct_range": 0, "num_eq": 6598988962168885798, "num_range": 0, "upper_bound": "HG\\""}, {"distinct_range": 1242735481620957400, "num_eq": 50000000000, "num_range": 7263232485078915727, "upper_bound": "d\\u001f\\u001b|%\\tn"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 73449466, "row_count": 100000000}, {"avg_size": 1, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 59613823, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 23, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 44261089, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (19.72s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

/cc @cockroachdb/sql-sessions

This test on roachdash | Improve this report!

Jira issue: CRDB-27024

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ ada9871ea92cfc467b045a6a1b8ed2783a243c2f:

        postgres_1    | 2023-04-13 05:18:40.818 UTC [51] LOG:  shutting down
        postgres_1    | 2023-04-13 05:18:40.920 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-13 05:18:41.035 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-13 05:18:41.035 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-13 05:18:41.035 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-13 05:18:41.038 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-13 05:18:41.043 UTC [68] LOG:  database system was shut down at 2023-04-13 05:18:40 UTC
        postgres_1    | 2023-04-13 05:18:41.049 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-13 05:18:42.179 UTC [78] ERROR:  collation "de" for encoding "UTF8" does not exist at character 93
        postgres_1    | 2023-04-13 05:18:42.179 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 INT8, col1_1 UUID, "col1_\\U000F117A2" REGROLE, "😞col�1_3" TEXT COLLATE de NOT NULL, col1_4 GEOMETRY NOT NULL);
        postgres_1    |     CREATE UNIQUE INDEX ON table1 (lower(CAST(col1_1 AS TEXT)) DESC, col1_0 DESC, "col1_\\U000F117A2" DESC, "😞col�1_3" ASC, col1_1) INCLUDE (col1_4);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (4.88s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.98s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 INT8, col1_1 UUID, "col1_\\U000F117A2" REGROLE, "😞col�1_3" TEXT COLLATE de NOT NULL, col1_4 GEOMETRY NOT NULL);
        test_1        |             CREATE UNIQUE INDEX ON table1 (lower(CAST(col1_1 AS TEXT)) DESC, col1_0 DESC, "col1_\\U000F117A2" DESC, "😞col�1_3" ASC, col1_1) INCLUDE (col1_4);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "de" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.77s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "tab\\u6225le1" (col1_0 BYTES NULL, col1_1 BYTES, "coL1_2" BIT(47) NULL, col1_3 UUID NOT NULL, col1_ͬ4 JSONB NOT NULL, col1_5 STRING NOT NULL AS (lower(CAST(col1_ͬ4 AS STRING))) STORED, "col1
_6" STRING AS (CASE WHEN col1_1 IS NULL THEN '':::STRING ELSE e'\x16%M55':::STRING END) VIRTUAL, "col1%q_7" STRING NULL AS (CASE WHEN col1_0 IS NULL THEN e'\x1cA\x02d\x17V':::STRING ELSE e'<{\x1d\x15\x1e':::STRING END) VIRTUAL, UNIQUE ("col1
_6" ASC, col1_3 DESC) STORING (col1_ͬ4) WHERE (((("tab\\u6225le1".col1_5 <= '':::STRING) AND ("tab\\u6225le1"."col1
_6" <= '':::STRING)) OR ("tab\\u6225le1"."col1%q_7" < 'X':::STRING)) OR ("tab\\u6225le1".col1_1 < e'\\xff':::BYTES)) OR ("tab\\u6225le1".col1_0 <= e'\\x00':::BYTES), FAMILY (col1_ͬ4, col1_1, "coL1_2", col1_3, col1_5, col1_0));
        test_1        |             ALTER TABLE "tab\\u6225le1" INJECT STATISTICS e'[{"avg_size": 7, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 23, "histo_col_type": "", "name": "__auto__", "null_count": 10, "row_count": 40}, {"avg_size": 31, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 20, "histo_col_type": "", "name": "__auto__", "null_count": 29, "row_count": 40}, {"avg_size": 1, "columns": ["\\"coL1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 34, "histo_col_type": "", "name": "__auto__", "null_count": 31, "row_count": 40}, {"avg_size": 19, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 18, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40}, {"avg_size": 12, "columns": ["col1_\u036C4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 39, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40}, {"avg_size": 25, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40}, {"avg_size": 30, "columns": ["\\"col1\\r_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1, "histo_col_type": "", "name": "__auto__", "null_count": 39, "row_count": 40}, {"avg_size": 27, "columns": ["\\"col1%q_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 17, "histo_col_type": "", "name": "__auto__", "null_count": 21, "row_count": 40}]':::JSONB;
        test_1        |             ALTER TABLE "tab\\u6225le1" INJECT STATISTICS e'[{"avg_size": 2, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 23877671610, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70000000000}, {"avg_size": 15, "columns": ["col1_\u036C4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 36993395871, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70000000000}, {"avg_size": 0, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 24309838198, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70000000000}, {"avg_size": 23, "columns": ["\\"col1\\r_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 29513871861, "histo_buckets": [{"distinct_range": 0, "num_eq": 1000000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 0, "num_eq": 4000000000, "num_range": 400, "upper_bound": "\\u0008~"}, {"distinct_range": 6446.732679457291, "num_eq": 5535216818895120956, "num_range": 100000, "upper_bound": "r|\\u0002U\\u00184&%h"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 15618398533, "row_count": 70000000000}, {"avg_size": 20, "columns": ["\\"col1%q_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2637065821, "histo_col_type": "", "name": "__auto__", "null_count": 49928317943, "row_count": 70000000000}, {"avg_size": 12, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 48980788361, "histo_col_type": "", "name": "__auto__", "null_count": 40561246564, "row_count": 70000000000}, {"avg_size": 18, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 10595453802, "histo_col_type": "", "name": "__auto__", "null_count": 22104090189, "row_count": 70000000000}, {"avg_size": 16, "columns": ["\\"coL1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1685197698, "histo_col_type": "", "name": "__auto__", "null_count": 47181363557, "row_count": 70000000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.09s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 5e9f0c062e6b166b76148f7a6e10c2f509658d37:

        postgres_1    |             FROM
        postgres_1    |                 postgres.public."ta'bLͦe1"@"ta'bLͦe1_col1_0_col1_1_expr_idx" AS "t aB3007"
        postgres_1    |                 LEFT JOIN postgres.public."ta'bLͦe1" AS "Tab3008" ON true::BOOL
        postgres_1    |             GROUP BY
        postgres_1    |                 "t aB3007".tableoid
        postgres_1    |         )
        postgres_1    |             AS " tab3009"
        postgres_1    |     ORDER BY
        postgres_1    |         col3999 DESC NULLS LAST
        test_1        | --- FAIL: TestCompare (9.59s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (4.87s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2380525572/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("heap_tableam_handler(internal)"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT * FROM (SELECT regprocedure(3:::OID::OID::OID)::REGPROCEDURE AS "co!l4005") AS "ta/b3013" ORDER BY "co!l4005";
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT * FROM (SELECT regprocedure(3::OID::OID::OID)::REGPROCEDURE AS "co!l4005") AS "ta/b3013" ORDER BY "co!l4005";
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.58s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "ta%cable1" ("col1%p_0" BOX2D NOT NULL, col1_1 TIME NULL, col1_2 BYTES NULL, col1_3 GEOMETRY NOT NULL, col1_4 INET NOT NULL, col1_5 TIMESTAMPTZ NOT NULL, "c ol1_6" BYTES NOT NULL, "co'l1_7" JSONB, col1_8 TSQUERY NOT NULL, col1_😕9 REGTYPE NULL, col1_10 TIMETZ NOT NULL, "col1_ 11" REGROLE, col1_12 JSONB NOT NULL, c̺ol1_13 BIT(48) NOT NULL, col1_14 TSQUERY NULL, "col 1|_15" "char" NOT NULL, "c!o😳l1_16" STRING NOT NULL AS (lower(CAST(col1_10 AS STRING))) STORED, col1_17 STRING NOT NULL AS (lower(CAST(col1_12 AS STRING))) STORED, col1_ͩ18 STRING AS (CASE WHEN "col1_ 11" IS NULL THEN '"':::STRING ELSE e'\n\x7f&\x0e\x1eK':::STRING END) STORED, FAMILY (col1_8, col1_14, col1_😕9), FAMILY (col1_10), FAMILY ("col1%p_0", col1_2), FAMILY ("c!o😳l1_16", "co'l1_7"), FAMILY (c̺ol1_13), FAMILY (col1_1), FAMILY ("c ol1_6"), FAMILY ("col1_ 11", "col 1|_15", col1_4, col1_ͩ18), FAMILY (col1_5), FAMILY (col1_3, col1_17, col1_12));
        test_1        |             ALTER TABLE "ta%cable1" INJECT STATISTICS e'[{"avg_size": 22, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1482741253869718731, "histo_col_type": "", "name": "__auto__", "null_count": 1104805001094258248, "row_count": 4797947392312301915}, {"avg_size": 18, "columns": ["col1_17"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4586491050100473562, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4797947392312301915}, {"avg_size": 9, "columns": ["col1_\U0001F6159"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3273234940170244103, "histo_col_type": "", "name": "__auto__", "null_count": 4385067757318801814, "row_count": 4797947392312301915}, {"avg_size": 31, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 215426860408799442, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4797947392312301915}, {"avg_size": 20, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1539354496698173197, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4797947392312301915}, {"avg_size": 16, "columns": ["c\u033Aol1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4677773572101840500, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4797947392312301915}, {"avg_size": 19, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3963128904497939401, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4797947392312301915}, {"avg_size": 22, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 768269170594610446, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4797947392312301915}, {"avg_size": 0, "columns": ["\\"c ol1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3802870952124245231, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4797947392312301915}, {"avg_size": 27, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4496422493109515581, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4797947392312301915}, {"avg_size": 0, "columns": ["\\"col1_ 11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3469439011614886938, "histo_col_type": "", "name": "__auto__", "null_count": 1133298254660359470, "row_count": 4797947392312301915}, {"avg_size": 14, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2823796681940629584, "histo_col_type": "", "name": "__auto__", "null_count": 3706838122789278135, "row_count": 4797947392312301915}, {"avg_size": 6, "columns": ["\\"col 1|_15\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1067254797957810847, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4797947392312301915}, {"avg_size": 7, "columns": ["\\"col1%p_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4750727191439529017, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4797947392312301915}, {"avg_size": 0, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 572723716714878963, "histo_col_type": "", "name": "__auto__", "null_count": 950921985260165403, "row_count": 4797947392312301915}, {"avg_size": 6, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2406243298241178540, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4797947392312301915}, {"avg_size": 25, "columns": ["\\"co\'l1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3648342166699590699, "histo_col_type": "", "name": "__auto__", "null_count": 510171855705043704, "row_count": 4797947392312301915}, {"avg_size": 16, "columns": ["\\"c!o\U0001F633l1_16\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2547078422627017290, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4797947392312301915}, {"avg_size": 16, "columns": ["col1_\u036918"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1620925109549881464, "histo_col_type": "", "name": "__auto__", "null_count": 1130181238567404653, "row_count": 4797947392312301915}]':::JSONB;
        test_1        |             ALTER TABLE "ta%cable1" INJECT STATISTICS e'[{"avg_size": 5, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3074, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 11, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 62, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 17, "columns": ["c\u033Aol1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 497, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 28, "columns": ["\\"col1%p_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1396, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 19, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3050, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 26, "columns": ["\\"co\'l1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3474, "histo_col_type": "", "name": "__auto__", "null_count": 2765, "row_count": 5000}, {"avg_size": 5, "columns": ["col1_\U0001F6159"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2587, "histo_col_type": "", "name": "__auto__", "null_count": 4353, "row_count": 5000}, {"avg_size": 4, "columns": ["\\"c!o\U0001F633l1_16\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1230, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 22, "columns": ["col1_\u036918"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4122, "histo_col_type": "", "name": "__auto__", "null_count": 1799, "row_count": 5000}, {"avg_size": 9, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1067, "histo_col_type": "", "name": "__auto__", "null_count": 2565, "row_count": 5000}, {"avg_size": 20, "columns": ["\\"col1_ 11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3771, "histo_col_type": "", "name": "__auto__", "null_count": 2733, "row_count": 5000}, {"avg_size": 21, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2407, "histo_col_type": "", "name": "__auto__", "null_count": 1027, "row_count": 5000}, {"avg_size": 22, "columns": ["\\"col 1|_15\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2260, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 11, "columns": ["col1_17"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3519, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 1, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1486, "histo_col_type": "", "name": "__auto__", "null_count": 2096, "row_count": 5000}, {"avg_size": 25, "columns": ["\\"c ol1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 141, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 11, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3854, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 10, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3339, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 20, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 387, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (32.89s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 3c51a373e8c272c5fd3fef0179321df51cbf401e:

        postgres_1    | 
        postgres_1    | waiting for server to shut down...2023-04-15 05:21:06.260 UTC [49] LOG:  received fast shutdown request
        postgres_1    | .2023-04-15 05:21:06.262 UTC [49] LOG:  aborting any active transactions
        postgres_1    | 2023-04-15 05:21:06.264 UTC [49] LOG:  background worker "logical replication launcher" (PID 56) exited with exit code 1
        postgres_1    | 2023-04-15 05:21:06.267 UTC [51] LOG:  shutting down
        postgres_1    | 2023-04-15 05:21:06.391 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-15 05:21:06.485 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-15 05:21:06.485 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-15 05:21:06.485 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-15 05:21:06.491 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-15 05:21:06.497 UTC [68] LOG:  database system was shut down at 2023-04-15 05:21:06 UTC
        postgres_1    | 2023-04-15 05:21:06.503 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-15 05:21:07.991 UTC [78] ERROR:  collation "da" for encoding "UTF8" does not exist at character 171
        postgres_1    | 2023-04-15 05:21:07.991 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 "char" NOT NULL, col1_1 "char"[] NULL, col1_2 TIMETZ, col1_3 INT8 NOT NULL, "col1_ 4" GEOGRAPHY NOT NULL, col1_5 "char" NULL, "�col/1_6" TEXT COLLATE da NOT NULL, col1_7 TIMESTAMP NOT NULL, col1_8 DATE NULL, col1_9 TSVECTOR NOT NULL, col1_10 INT4 NOT NULL, "col1_""11" CHAR NOT NULL, col1_12 BIT(29) NOT NULL, co😫l1_͐13 INT8 NOT NULL GENERATED ALWAYS AS (col1_10 + col1_3) STORED)
        test_1        | --- FAIL: TestCompare (5.92s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.97s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 "char" NOT NULL, col1_1 "char"[] NULL, col1_2 TIMETZ, col1_3 INT8 NOT NULL, "col1_ 4" GEOGRAPHY NOT NULL, col1_5 "char" NULL, "�col/1_6" TEXT COLLATE da NOT NULL, col1_7 TIMESTAMP NOT NULL, col1_8 DATE NULL, col1_9 TSVECTOR NOT NULL, col1_10 INT4 NOT NULL, "col1_""11" CHAR NOT NULL, col1_12 BIT(29) NOT NULL, co😫l1_͐13 INT8 NOT NULL GENERATED ALWAYS AS (col1_10 + col1_3) STORED)
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "da" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.81s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "tabl""%qe1" (col1_0 BIT(47) NOT NULL, col😮1_1 REGCLASS NULL, "col-1_2" INTERVAL NULL, col1_3 REGCLASS, col1_̮😭4 GEOMETRY NOT NULL, col1_5 NAME NOT NULL, cől😡1_6 BIT(19) NOT NULL, col̾1_7 STRING NOT NULL AS (lower(col1_5)) STORED, INDEX (cől😡1_6, col1_5) STORING (col1_0, "col-1_2", col̾1_7) PARTITION BY LIST (cől😡1_6) (PARTITION "tabḻ""%p%qe͍1_part0" VALUES IN ((B'0000001001101101110',), (B'0111111111111111111',), (B'0110010101011111101',), (B'1110010011000111001',)), PARTITION "�tabl""%qe1_part1" VALUES IN ((B'1100010111000101010',), (B'1101011000000101100',), (B'1000110010111111001',)), PARTITION "tabl""😬%qe1_part%p2" VALUES IN ((B'0001000010000111001',), (B'0000011100100011000',), (B'0001011001111101100',), (B'1100111100000110110',))) WHERE ("tabl""%qe1".col̾1_7 >= '"':::STRING) OR ("tabl""%qe1".col1_5 <= e'\'':::STRING:::NAME) NOT VISIBLE, INVERTED INDEX (col̾1_7 ASC, col1_5 DESC, lower(CAST(cől😡1_6 AS STRING)) DESC, cől😡1_6 ASC, col😮1_1, col1_3, col1_̮😭4) WHERE ("tabl""%qe1".col1_5 <= e'\x00':::STRING:::NAME) AND ("tabl""%qe1".col̾1_7 = e'\'':::STRING), UNIQUE (cől😡1_6 DESC) WHERE ("tabl""%qe1".col1_5 >= e'\U00002603':::STRING:::NAME) OR ("tabl""%qe1".col̾1_7 >= 'X':::STRING), FAMILY (col😮1_1, "col-1_2"), FAMILY (col̾1_7, col1_0), FAMILY (col1_̮😭4, col1_5, col1_3, cől😡1_6));
        test_1        |             ALTER TABLE "tabl""%qe1" INJECT STATISTICS e'[{"avg_size": 29, "columns": ["col\u033E1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1436789, "histo_buckets": [{"distinct_range": 0, "num_eq": 6000000000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 5876.127899293612, "num_eq": 2205919592781272701, "num_range": 8000, "upper_bound": "\\u0003A\\u000b["}, {"distinct_range": 795254315611196300, "num_eq": 5067023949345877038, "num_range": 4262693199569136780, "upper_bound": "\\u0013qFX?"}, {"distinct_range": 0, "num_eq": 10000000, "num_range": 9000, "upper_bound": "$s]|z"}, {"distinct_range": 0, "num_eq": 90000, "num_range": 0, "upper_bound": "5"}, {"distinct_range": 0, "num_eq": 0, "num_range": 1000, "upper_bound": "7K"}, {"distinct_range": 7525089830062891000, "num_eq": 6722649142179235701, "num_range": 7525089830062890810, "upper_bound": ">Y3\\u0001$b\\u000c;"}, {"distinct_range": 0, "num_eq": 2292253189346121874, "num_range": 0, "upper_bound": "hSd\\u001dM"}, {"distinct_range": 0, "num_eq": 4000000000, "num_range": 30, "upper_bound": "\x7f\\u0002P\\u0007^"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 3000000}, {"avg_size": 0, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 853789, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000000}, {"avg_size": 5, "columns": ["col\U0001F62E1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 304266, "histo_col_type": "", "name": "__auto__", "null_count": 897441, "row_count": 3000000}, {"avg_size": 29, "columns": ["\\"col-1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 668239, "histo_col_type": "", "name": "__auto__", "null_count": 1389181, "row_count": 3000000}, {"avg_size": 21, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1367078, "histo_col_type": "", "name": "__auto__", "null_count": 1626224, "row_count": 3000000}, {"avg_size": 19, "columns": ["col1_\u032E\U0001F62D4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1256602, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000000}, {"avg_size": 5, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1995948, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000000}, {"avg_size": 1, "columns": ["c\u0151l\U0001F6211_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1294829, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "0101000001100001000"}, {"distinct_range": 0, "num_eq": 60000000000, "num_range": 3263760024176192995, "upper_bound": "0110011001010010010"}, {"distinct_range": 0, "num_eq": 7430796396530390781, "num_range": 9000, "upper_bound": "0111010101101010100"}], "histo_col_type": "BIT(19)", "name": "__auto__", "null_count": 0, "row_count": 3000000}]':::JSONB;
        test_1        |             ALTER TABLE "tabl""%qe1" INJECT STATISTICS e'[{"avg_size": 3, "columns": ["col\U0001F62E1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4953427413046918478, "histo_col_type": "", "name": "__auto__", "null_count": 371875836798745057, "row_count": 5136580001226681267}, {"avg_size": 31, "columns": ["\\"col-1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3743603389752405732, "histo_col_type": "", "name": "__auto__", "null_count": 1939508279342323728, "row_count": 5136580001226681267}, {"avg_size": 27, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4634530628982386821, "histo_col_type": "", "name": "__auto__", "null_count": 2755836771471107544, "row_count": 5136580001226681267}, {"avg_size": 31, "columns": ["col1_\u032E\U0001F62D4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2643624641170543282, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5136580001226681267}, {"avg_size": 1, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3475180231876203193, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5136580001226681267}, {"avg_size": 11, "columns": ["c\u0151l\U0001F6211_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1189678729432270970, "histo_buckets": [{"distinct_range": 0, "num_eq": 2954507483922046377, "num_range": 0, "upper_bound": "0000000000000000000"}, {"distinct_range": 20000, "num_eq": 8341816815681271900, "num_range": 20000, "upper_bound": "0001101111011000100"}, {"distinct_range": 8202192102712791000, "num_eq": 349670131044669722, "num_range": 8202192102712791166, "upper_bound": "0101101010000011000"}, {"distinct_range": 3422.7116793717787, "num_eq": 6000000000, "num_range": 20000, "upper_bound": "0111111111111111111"}, {"distinct_range": 0, "num_eq": 6438662311627965970, "num_range": 800, "upper_bound": "1001011001010010111"}, {"distinct_range": 35734292.27016915, "num_eq": 3739388416362519879, "num_range": 50000000, "upper_bound": "1001100100011000011"}, {"distinct_range": 0, "num_eq": 1000, "num_range": 700000, "upper_bound": "1111011101001011010"}, {"distinct_range": 0, "num_eq": 3489390837738935104, "num_range": 10000, "upper_bound": "1111110010000011011"}], "histo_col_type": "BIT(19)", "name": "__auto__", "null_count": 0, "row_count": 5136580001226681267}, {"avg_size": 9, "columns": ["col\u033E1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 317553014368541735, "histo_buckets": [{"distinct_range": 0, "num_eq": 381271481463560141, "num_range": 0, "upper_bound": ""}, {"distinct_range": 7468938333123781000, "num_eq": 4907477316815423281, "num_range": 7468938333123780174, "upper_bound": "\\u000btDpT\\r\\u00070"}, {"distinct_range": 0, "num_eq": 4846365290700148646, "num_range": 400000, "upper_bound": "\\r\\u0004G\\u0012\\"Q%G%"}, {"distinct_range": 0, "num_eq": 300000, "num_range": 1262563294988938343, "upper_bound": "\\r&B0"}, {"distinct_range": 1949017694466782700, "num_eq": 500000, "num_range": 7551368136202668582, "upper_bound": "\\u0017Q\\u0016b"}, {"distinct_range": 0, "num_eq": 3000, "num_range": 8930808328213934736, "upper_bound": "\\u001e"}, {"distinct_range": 0, "num_eq": 2958553784857873377, "num_range": 5912043157246266111, "upper_bound": "$\\u0018"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 5136580001226681267}, {"avg_size": 30, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1581169750262406092, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5136580001226681267}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (22.06s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ d9427da31576a61b9390d86258fd7ad4c35c88d5:

        postgres_1    |     
        test_1        | --- FAIL: TestCompare (4.62s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.92s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table1 ("%pcol1_0" FLOAT8 NOT NULL, " col1_1" "char", col1_2 TIME NOT NULL, col1_3 UUID NOT NULL, "c ol1_4" FLOAT8 NOT NULL, col1_5 BYTEA NOT NULL, "col1*_6" DATE NOT NULL, "c-ol1_7" TIME NULL, "col1_
        test_1        |             8" TEXT COLLATE da NOT NULL, "co l̉1_9" FLOAT8 NOT NULL GENERATED ALWAYS AS ("%pcol1_0" + "c ol1_4") STORED, col1_10 FLOAT8 NOT NULL GENERATED ALWAYS AS ("c ol1_4" + "%pcol1_0") STORED, "co,l1_�11" TEXT GENERATED ALWAYS AS (lower(" col1_1")) STORED, col1_12 FLOAT8 NOT NULL GENERATED ALWAYS AS ("%pcol1_0" + "c ol1_4") STORED, PRIMARY KEY ("col1_
        test_1        |             8"));
        test_1        |             CREATE INDEX ON table1 ("%pcol1_0", "col1*_6" DESC, "col1_
        test_1        |             8" ASC, col1_3, col1_2 ASC, " col1_1" DESC, "c ol1_4" DESC, "co,l1_�11", col1_5 ASC, col1_12);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "da" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.57s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE tab😸le1 ("c}ol1_0" BIT(7), col1_1 BOX2D NOT NULL, col1_2 TIMESTAMPTZ[] NOT NULL, """c😅ol1_3" NAME NOT NULL, """c😗ol1_
        test_1        |             4" TIMESTAMPTZ NOT NULL, col1_5 FLOAT4 NULL, "%col'1_6" STRING NOT NULL AS (lower("""c😅ol1_3")) VIRTUAL, col1_7 STRING NOT NULL AS (CASE WHEN col1_2 IS NULL THEN e'M\x0e\x02SP>':::STRING ELSE e']y\x11':::STRING END) VIRTUAL, "col1 _8" STRING NOT NULL AS (lower("""c😅ol1_3")) VIRTUAL, col1_9 STRING NOT NULL AS (lower("""c😅ol1_3")) STORED, PRIMARY KEY ("col1 _8" DESC), UNIQUE ("""c😅ol1_3" ASC, "col1 _8", col1_9, (CASE WHEN col1_2 IS NULL THEN e'@^\x17\n\x1awwsF':::STRING ELSE e'\x16\'?@':::STRING END) DESC, col1_5 ASC, col1_7 DESC, "%col'1_6", "c}ol1_0" DESC, (CASE WHEN """c😗ol1_
        test_1        |             4" IS NULL THEN '':::STRING ELSE e'!f=6\x1cl^\x1b':::STRING END) DESC, col1_1 DESC) WHERE tab😸le1."""c😗ol1_
        test_1        |             4" <= '4714-11-24 00:00:00+00 BC':::TIMESTAMPTZ, INDEX (col1_2 ASC, col1_9 DESC, """c😗ol1_
        test_1        |             4" DESC, col1_5, """c😅ol1_3", "c}ol1_0", "col1 _8" DESC, col1_1, col1_7 ASC) WHERE ((((((tab😸le1."%col'1_6" >= e'\x00':::STRING) AND (tab😸le1."""c😗ol1_
        test_1        |             4" = '294276-12-31 23:59:59.999999+00':::TIMESTAMPTZ)) AND (tab😸le1.col1_7 >= e'\x00':::STRING)) AND (tab😸le1.col1_9 >= e'\'':::STRING)) OR (tab😸le1."col1 _8" <= 'X':::STRING)) OR (tab😸le1.col1_5 >= 0.0:::FLOAT8)) OR (tab😸le1."""c😅ol1_3" > '':::STRING:::NAME), UNIQUE (lower("""c😅ol1_3"), "%col'1_6", col1_9 ASC, col1_1 ASC, lower(CAST("c}ol1_0" AS STRING)) DESC) STORING ("""c😅ol1_3", """c😗ol1_
        test_1        |             4") WHERE ((((((tab😸le1."""c😅ol1_3" != e'\'':::STRING:::NAME) OR (tab😸le1."""c😗ol1_
        test_1        |             4" >= '2001-01-01 00:00:00+00 BC':::TIMESTAMPTZ)) AND (tab😸le1."%col'1_6" > '"':::STRING)) OR (tab😸le1."col1 _8" >= e'\x00':::STRING)) AND (tab😸le1.col1_9 > e'\'':::STRING)) OR (tab😸le1.col1_5 = (-1.0):::FLOAT8)) OR (tab😸le1.col1_7 < e'\U00002603':::STRING), UNIQUE (col1_7, col1_9 ASC, "%col'1_6", """c😅ol1_3" DESC, col1_1 DESC) STORING ("""c😗ol1_
        test_1        |             4"), UNIQUE ("col1 _8", col1_1, """c😅ol1_3", col1_2, "%col'1_6" DESC) STORING ("c}ol1_0", col1_9), INDEX ("c}ol1_0" DESC, col1_5, col1_2 DESC, col1_7 ASC, col1_9 ASC, """c😅ol1_3" DESC, "col1 _8", col1_1 DESC) WHERE ((((((tab😸le1."""c😅ol1_3" = '"':::STRING:::NAME) OR (tab😸le1.col1_9 > e'\x00':::STRING)) OR (tab😸le1."%col'1_6" = 'X':::STRING)) AND (tab😸le1.col1_7 = 'X':::STRING)) OR (tab😸le1."""c😗ol1_
        test_1        |             4" != '3000-01-01 00:00:00+00':::TIMESTAMPTZ)) OR (tab😸le1.col1_5 >= 3.4028234663852886e+38:::FLOAT8)) OR (tab😸le1."col1 _8" < e'\'':::STRING), UNIQUE (col1_2 DESC, col1_7 DESC, col1_1, """c😗ol1_
        test_1        |             4" ASC, col1_5, "c}ol1_0", col1_9, lower(CAST("c}ol1_0" AS STRING)), "%col'1_6" ASC, "col1 _8" ASC), UNIQUE (col1_9, col1_2, "%col'1_6" ASC, col1_1, """c😗ol1_
        test_1        |             4") WHERE tab😸le1.col1_9 < '"':::STRING, UNIQUE (col1_9, "%col'1_6", col1_7, col1_2, col1_1 ASC, """c😅ol1_3" ASC, """c😗ol1_
        test_1        |             4" ASC, "col1 _8" DESC, col1_5 ASC, "c}ol1_0" DESC), FAMILY (col1_9), FAMILY ("""c😅ol1_3"), FAMILY (col1_1, "c}ol1_0", """c😗ol1_
        test_1        |             4"), FAMILY (col1_5), FAMILY (col1_2));
        test_1        |             ALTER TABLE tab😸le1 INJECT STATISTICS e'[{"avg_size": 6, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 66339, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000}, {"avg_size": 23, "columns": ["\\"\\"\\"c\U0001F605ol1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 46, "histo_buckets": [{"distinct_range": 0, "num_eq": 800000, "num_range": 0, "upper_bound": "\\u0018(njz9\\u0018W"}, {"distinct_range": 0, "num_eq": 599279515490664292, "num_range": 3032482385535625475, "upper_bound": "\\u001f]cg\\u0001"}, {"distinct_range": 0, "num_eq": 7146074544725192761, "num_range": 100000, "upper_bound": "b\\u000547t\\u0004\\u0019>\\u0016"}, {"distinct_range": 0, "num_eq": 161702623653320514, "num_range": 70000000, "upper_bound": "\x7fJET~B"}], "histo_col_type": "NAME", "name": "__auto__", "null_count": 0, "row_count": 80000}, {"avg_size": 15, "columns": ["\\"\\"\\"c\U0001F617ol1_\\n4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 48404, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000}, {"avg_size": 18, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 56301, "histo_col_type": "", "name": "__auto__", "null_count": 57624, "row_count": 80000}, {"avg_size": 12, "columns": ["\\"%col\'1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 16651, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000}, {"avg_size": 19, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 67245, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000}, {"avg_size": 17, "columns": ["\\"c}ol1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 20130, "histo_col_type": "", "name": "__auto__", "null_count": 4293, "row_count": 80000}, {"avg_size": 23, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 55850, "histo_buckets": [{"distinct_range": 0, "num_eq": 4000, "num_range": 0, "upper_bound": "ARRAY[]"}, {"distinct_range": 596.1491253744105, "num_eq": 7141635409504757825, "num_range": 4000, "upper_bound": "ARRAY[\'1981-08-12 00:34:49.000475+00\':::TIMESTAMPTZ,\'2018-06-13 13:52:05.000599+00\':::TIMESTAMPTZ,\'2021-06-09 02:08:04.000311+00\':::TIMESTAMPTZ,\'1991-07-24 10:27:44.000869+00\':::TIMESTAMPTZ]"}, {"distinct_range": 30000, "num_eq": 6965273475039176420, "num_range": 30000, "upper_bound": "ARRAY[\'1986-05-11 06:11:20.000289+00\':::TIMESTAMPTZ,\'2025-06-22 15:00:24.000193+00\':::TIMESTAMPTZ,\'2008-01-12 20:43:48.000272+00\':::TIMESTAMPTZ]"}, {"distinct_range": 1000000000, "num_eq": 50, "num_range": 1000000000, "upper_bound": "ARRAY[\'1989-01-09 05:24:57.00024+00\':::TIMESTAMPTZ,\'2006-09-01 14:35:31.00084+00\':::TIMESTAMPTZ,\'2001-01-01 00:00:00+00 BC\':::TIMESTAMPTZ,\'1978-10-12 11:42:42.000697+00\':::TIMESTAMPTZ]"}, {"distinct_range": 1000000000, "num_eq": 200000, "num_range": 1000000000, "upper_bound": "ARRAY[\'1989-12-17 06:30:08.000594+00\':::TIMESTAMPTZ,\'2019-10-07 00:59:10.000372+00\':::TIMESTAMPTZ,\'3000-01-01 00:00:00+00\':::TIMESTAMPTZ]"}, {"distinct_range": 5.241991508452499, "num_eq": 1688739762761869997, "num_range": 30, "upper_bound": "ARRAY[\'1992-12-31 01:37:54.000684+00\':::TIMESTAMPTZ]"}, {"distinct_range": 2511925862940922000, "num_eq": 800000, "num_range": 4330763209531275064, "upper_bound": "ARRAY[\'2006-09-04 11:57:51.000253+00\':::TIMESTAMPTZ,\'2015-03-07 11:37:28.00075+00\':::TIMESTAMPTZ]"}, {"distinct_range": 156036561.01479867, "num_eq": 0, "num_range": 2000000000, "upper_bound": "ARRAY[\'2029-11-07 23:23:37.00008+00\':::TIMESTAMPTZ,\'2001-01-01 00:00:00+00 BC\':::TIMESTAMPTZ,\'2004-10-18 08:27:14.000793+00\':::TIMESTAMPTZ,\'1996-04-15 11:58:54.000353+00\':::TIMESTAMPTZ,\'2001-01-01 00:00:00+00 BC\':::TIMESTAMPTZ,\'2008-02-05 06:53:00.000233+00\':::TIMESTAMPTZ]"}], "histo_col_type": "TIMESTAMPTZ[]", "name": "__auto__", "null_count": 0, "row_count": 80000}, {"avg_size": 1, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 77482, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": ""}, {"distinct_range": 8757206370162136000, "num_eq": 6533016250444478962, "num_range": 8905935863404848559, "upper_bound": "\\u0012\\u0005\\u0005\'2y\\u0017%"}, {"distinct_range": 27288213.007653847, "num_eq": 60000000, "num_range": 6000000000, "upper_bound": "\\u001c&"}, {"distinct_range": 0, "num_eq": 7834135464069722012, "num_range": 5000000, "upper_bound": "+\\u0003S\\u0012\\u000c~0"}, {"distinct_range": 0, "num_eq": 652274093765007008, "num_range": 40, "upper_bound": "OD"}, {"distinct_range": 5542550577316162000, "num_eq": 30000, "num_range": 6680517078158127949, "upper_bound": "l."}, {"distinct_range": 8185246374223398000, "num_eq": 300, "num_range": 8185246374223398303, "upper_bound": "o\\n"}, {"distinct_range": 504445840.7386743, "num_eq": 857011800128676244, "num_range": 1000000000, "upper_bound": "\U00002603"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 80000}, {"avg_size": 3, "columns": ["\\"col1 _8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 40108, "histo_buckets": [{"distinct_range": 0, "num_eq": 1498745815962539669, "num_range": 0, "upper_bound": ""}, {"distinct_range": 3.5389543239133325, "num_eq": 5018195950210509082, "num_range": 400, "upper_bound": "@"}, {"distinct_range": 40652.81374078277, "num_eq": 3309344114023239724, "num_range": 50000, "upper_bound": "@e\\u0014t"}, {"distinct_range": 456517731468606200, "num_eq": 600, "num_range": 4260938513490231036, "upper_bound": "wFg"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 80000}]':::JSONB;
        test_1        |             ALTER TABLE tab😸le1 INJECT STATISTICS e'[{"avg_size": 14, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1918690301841360825, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6866246743813755038}, {"avg_size": 5, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4766230704249749075, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6866246743813755038}, {"avg_size": 10, "columns": ["\\"c}ol1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6290158691606774055, "histo_buckets": [{"distinct_range": 0, "num_eq": 9000000000, "num_range": 0, "upper_bound": "0000000"}, {"distinct_range": 0, "num_eq": 90000000, "num_range": 100, "upper_bound": "0001100"}, {"distinct_range": 0, "num_eq": 30000, "num_range": 2151408232675202282, "upper_bound": "0110111"}, {"distinct_range": 0, "num_eq": 4000000000, "num_range": 10000000, "upper_bound": "1000000"}, {"distinct_range": 7812685806355926000, "num_eq": 7275656593483901117, "num_range": 7812685806355926303, "upper_bound": "1000101"}, {"distinct_range": 3712300846475573000, "num_eq": 1453284933720603684, "num_range": 9066249156767279379, "upper_bound": "1011011"}, {"distinct_range": 0, "num_eq": 700000, "num_range": 2606167934635246230, "upper_bound": "1100010"}, {"distinct_range": 0, "num_eq": 10, "num_range": 6788632645733617893, "upper_bound": "1111100"}], "histo_col_type": "BIT(7)", "name": "__auto__", "null_count": 303455528985330465, "row_count": 6866246743813755038}, {"avg_size": 21, "columns": ["\\"\\"\\"c\U0001F605ol1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6075825688098832216, "histo_buckets": [{"distinct_range": 0, "num_eq": 1000000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 1825035161925998800, "num_eq": 2690271570290156383, "num_range": 2499391170756516197, "upper_bound": "\\u0016]xe%B~\\n"}, {"distinct_range": 23755487813.369286, "num_eq": 3861774608257217589, "num_range": 100000000000, "upper_bound": "$y``*O"}], "histo_col_type": "NAME", "name": "__auto__", "null_count": 0, "row_count": 6866246743813755038}, {"avg_size": 24, "columns": ["\\"\\"\\"c\U0001F617ol1_\\n4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4612071361952641330, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6866246743813755038}, {"avg_size": 10, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6267824903478149336, "histo_col_type": "", "name": "__auto__", "null_count": 5153637767352940128, "row_count": 6866246743813755038}, {"avg_size": 26, "columns": ["\\"%col\'1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1549286657660494473, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6866246743813755038}, {"avg_size": 2, "columns": ["\\"col1 _8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3473707510493436820, "histo_buckets": [{"distinct_range": 0, "num_eq": 90000000000, "num_range": 0, "upper_bound": "b\\u0016\\u0016}=\\u0017[\\u00055"}, {"distinct_range": 117994723161306190, "num_eq": 20000, "num_range": 242301585280490998, "upper_bound": "\U00002603"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 6866246743813755038}, {"avg_size": 14, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4989723569335294112, "histo_buckets": [{"distinct_range": 0, "num_eq": 3000000000, "num_range": 0, "upper_bound": "\\u000f\\u0004c\\u0014m"}, {"distinct_range": 7000000, "num_eq": 70000000000, "num_range": 7000000, "upper_bound": "\\u000fsfmU\\u0016"}, {"distinct_range": 267043486.8028721, "num_eq": 3254614680598448497, "num_range": 600000000, "upper_bound": "\\""}, {"distinct_range": 3097188490269886000, "num_eq": 900000, "num_range": 6085532228318671095, "upper_bound": "/\\u001c\\u000e*\\u0008o"}, {"distinct_range": 62042.07148114941, "num_eq": 4814324642339595112, "num_range": 70000, "upper_bound": "~NWg\\u0012\\rT9"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 6866246743813755038}, {"avg_size": 18, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6824203238356738220, "histo_buckets": [{"distinct_range": 0, "num_eq": 7422969632508187547, "num_range": 0, "upper_bound": "ARRAY[]"}, {"distinct_range": 1280797594823356400, "num_eq": 9000, "num_range": 1280797594823356359, "upper_bound": "ARRAY[\'1984-11-20 18:35:09.000816+00\':::TIMESTAMPTZ,\'2024-10-11 00:27:13.00004+00\':::TIMESTAMPTZ]"}, {"distinct_range": 0, "num_eq": 8000000, "num_range": 4052547972332280156, "upper_bound": "ARRAY[\'1988-10-31 02:20:26.000131+00\':::TIMESTAMPTZ,\'2024-09-26 07:29:09.000033+00\':::TIMESTAMPTZ,\'1970-03-08 20:29:37.000839+00\':::TIMESTAMPTZ]"}, {"distinct_range": 5622358.113245238, "num_eq": 400000000, "num_range": 50000000, "upper_bound": "ARRAY[\'2000-11-16 02:21:02.000266+00\':::TIMESTAMPTZ,\'2001-09-22 18:21:22.000777+00\':::TIMESTAMPTZ,\'2018-05-25 01:04:19.000585+00\':::TIMESTAMPTZ]"}, {"distinct_range": 8335679.783999031, "num_eq": 8000, "num_range": 10000000, "upper_bound": "ARRAY[\'2012-12-24 02:55:47.000891+00\':::TIMESTAMPTZ,\'1996-07-10 02:06:17.000337+00\':::TIMESTAMPTZ]"}], "histo_col_type": "TIMESTAMPTZ[]", "name": "__auto__", "null_count": 0, "row_count": 6866246743813755038}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (19.74s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ d9427da31576a61b9390d86258fd7ad4c35c88d5:

        postgres_1    | 2023-04-17 05:17:57.336 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-17 05:17:57.340 UTC [68] LOG:  database system was shut down at 2023-04-17 05:17:57 UTC
        postgres_1    | 2023-04-17 05:17:57.345 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-17 05:17:58.686 UTC [78] ERROR:  collation "da" for encoding "UTF8" does not exist at character 59
        postgres_1    | 2023-04-17 05:17:58.686 UTC [78] STATEMENT:  CREATE TABLE table3 (col3_0 DECIMAL NOT NULL, col3_1 TEXT COLLATE da NOT NULL, "c%qol3_2" BIT(21) NOT NULL, col3_3 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col3_1 AS TEXT))) STORED, PRIMARY KEY (col3_3, col3_1));
        postgres_1    |     CREATE INDEX ON table3 ("c%qol3_2" ASC, col3_1);
        postgres_1    |     CREATE UNIQUE INDEX ON table3 (col3_3 ASC, col3_0 ASC);
        postgres_1    |     CREATE INDEX ON table3 (col3_1, col3_0 DESC);
        postgres_1    |     CREATE UNIQUE INDEX ON table3 (col3_0, col3_3 DESC);
        postgres_1    |     CREATE UNIQUE INDEX ON table3 (col3_3, col3_0) INCLUDE ("c%qol3_2");
        postgres_1    |     CREATE UNIQUE INDEX ON table3 (col3_1 DESC) INCLUDE (col3_0);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.10s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.19s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table3 (col3_0 DECIMAL NOT NULL, col3_1 TEXT COLLATE da NOT NULL, "c%qol3_2" BIT(21) NOT NULL, col3_3 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col3_1 AS TEXT))) STORED, PRIMARY KEY (col3_3, col3_1));
        test_1        |             CREATE INDEX ON table3 ("c%qol3_2" ASC, col3_1);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_3 ASC, col3_0 ASC);
        test_1        |             CREATE INDEX ON table3 (col3_1, col3_0 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_0, col3_3 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_3, col3_0) INCLUDE ("c%qol3_2");
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_1 DESC) INCLUDE (col3_0);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "da" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.78s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "ta\\U000CA29Bble1" ("col1_|0" REGTYPE NOT NULL, col1_1 UUID NULL, col1_2 FLOAT8 NOT NULL, col1_3 REGROLE NOT NULL, col1_4 JSONB NOT NULL, col1_5 STRING NOT NULL AS (lower(CAST(col1_4 AS STRING))) STORED, PRIMARY KEY ("col1_|0" DESC, col1_3 DESC), UNIQUE (col1_2 DESC, "col1_|0" ASC, col1_5 DESC) STORING (col1_1), UNIQUE (col1_5 ASC, col1_3 ASC) STORING (col1_1, col1_2), FAMILY (col1_5), FAMILY (col1_3), FAMILY ("col1_|0"), FAMILY (col1_1, col1_4, col1_2));
        test_1        |             ALTER TABLE "ta\\U000CA29Bble1" INJECT STATISTICS e'[{"avg_size": 4, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 5000000000, "num_range": 0, "upper_bound": "-Inf"}, {"distinct_range": 0, "num_eq": 5000, "num_range": 0, "upper_bound": "0.20814286956385863"}, {"distinct_range": 4000, "num_eq": 305921982731897521, "num_range": 4000, "upper_bound": "0.35298003919975823"}, {"distinct_range": 0, "num_eq": 2715672711258067970, "num_range": 9000, "upper_bound": "0.5461046424619154"}, {"distinct_range": 89269888094910930, "num_eq": 20000000000, "num_range": 164517002240022305, "upper_bound": "0.7018989261863007"}, {"distinct_range": 461439250821791170, "num_eq": 543864775913792191, "num_range": 2921903416546164404, "upper_bound": "0.9948801521132802"}], "histo_col_type": "FLOAT8", "name": "__auto__", "null_count": 0, "row_count": 10}, {"avg_size": 19, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 10}, {"avg_size": 27, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 10}, {"avg_size": 15, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3, "histo_buckets": [{"distinct_range": 0, "num_eq": 60000, "num_range": 0, "upper_bound": "7T^L"}, {"distinct_range": 60, "num_eq": 200, "num_range": 60, "upper_bound": ">"}, {"distinct_range": 50000000, "num_eq": 3692336577967081386, "num_range": 50000000, "upper_bound": "I\\u0015"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 10}, {"avg_size": 24, "columns": ["\\"col1_|0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 10}, {"avg_size": 0, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8, "histo_col_type": "", "name": "__auto__", "null_count": 4, "row_count": 10}]':::JSONB;
        test_1        |             ALTER TABLE "ta\\U000CA29Bble1" INJECT STATISTICS e'[{"avg_size": 14, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1741565396, "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 6000000000}, {"avg_size": 26, "columns": ["\\"col1_|0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1929074558, "histo_col_type": "REGTYPE", "name": "__auto__", "null_count": 0, "row_count": 6000000000}, {"avg_size": 29, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2691812290, "histo_col_type": "", "name": "__auto__", "null_count": 4746043091, "row_count": 6000000000}, {"avg_size": 1, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2425247111, "histo_buckets": [{"distinct_range": 0, "num_eq": 10000000, "num_range": 0, "upper_bound": "-1.4996054580358713"}, {"distinct_range": 6912.952478201125, "num_eq": 3515204476848172279, "num_range": 10000, "upper_bound": "-0.7788576823196323"}, {"distinct_range": 38430790545.54876, "num_eq": 4200556974347225887, "num_range": 100000000000, "upper_bound": "0.2894973418740425"}, {"distinct_range": 211177616580813220, "num_eq": 8535030766950094300, "num_range": 985314724959219880, "upper_bound": "0.29951958613109164"}, {"distinct_range": 907918028857193600, "num_eq": 1176488490822891536, "num_range": 2999937078970852005, "upper_bound": "0.4988400105960593"}, {"distinct_range": 1922286838.9902768, "num_eq": 587317893245441601, "num_range": 9000000000, "upper_bound": "0.7585100147472621"}], "histo_col_type": "FLOAT8", "name": "__auto__", "null_count": 0, "row_count": 6000000000}, {"avg_size": 12, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5008940910, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6000000000}, {"avg_size": 8, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4909967348, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6000000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.00s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ c7f71068d537c2f82f06f000299144c31d9ddf7a:

        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-18 05:18:27.894 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-18 05:18:27.894 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-18 05:18:27.894 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-18 05:18:27.897 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-18 05:18:27.901 UTC [68] LOG:  database system was shut down at 2023-04-18 05:18:27 UTC
        postgres_1    | 2023-04-18 05:18:27.902 UTC [70] FATAL:  the database system is starting up
        postgres_1    | 2023-04-18 05:18:27.906 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-18 05:18:29.833 UTC [80] ERROR:  collation "da" for encoding "UTF8" does not exist at character 38
        postgres_1    | 2023-04-18 05:18:29.833 UTC [80] STATEMENT:  CREATE TABLE "t̅(able1" (col1_0 TEXT COLLATE da NOT NULL, col1_1 TEXT COLLATE de NOT NULL, col1_2 TEXT NOT NULL, col1_3 NAME NULL, " col1_4" BOOL NOT NULL, col1_5 NAME NOT NULL, col1_6 TIME NOT NULL, col1_7 INT4 NOT NULL, c̸ol1😸_8 FLOAT4 NOT NULL, col1_9 INT8 NOT NULL, col1_10 "char" NOT NULL, "c""ol1_11" REGTYPE NOT NULL, PRIMARY KEY (col1_10, col1_0, col1_5, c̸ol1😸_8, col1_6, col1_2, col1_1, "c""ol1_11", col1_7));
        postgres_1    |     CREATE INDEX ON "t̅(able1" (col1_3 DESC, col1_2, col1_6, col1_9 ASC, " col1_4" ASC, col1_7 DESC, "c""ol1_11", col1_5 ASC);
        postgres_1    |     CREATE INDEX ON "t̅(able1" (col1_10 DESC, col1_3 ASC, " col1_4", lower(col1_5) DESC);
        postgres_1    |     CREATE UNIQUE INDEX ON "t̅(able1" (col1_6 DESC, col1_5 DESC, " col1_4", c̸ol1😸_8 ASC) INCLUDE (col1_9);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.61s)
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     --- FAIL: TestCompare/postgres (0.92s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "t̅(able1" (col1_0 TEXT COLLATE da NOT NULL, col1_1 TEXT COLLATE de NOT NULL, col1_2 TEXT NOT NULL, col1_3 NAME NULL, " col1_4" BOOL NOT NULL, col1_5 NAME NOT NULL, col1_6 TIME NOT NULL, col1_7 INT4 NOT NULL, c̸ol1😸_8 FLOAT4 NOT NULL, col1_9 INT8 NOT NULL, col1_10 "char" NOT NULL, "c""ol1_11" REGTYPE NOT NULL, PRIMARY KEY (col1_10, col1_0, col1_5, c̸ol1😸_8, col1_6, col1_2, col1_1, "c""ol1_11", col1_7));
        test_1        |             CREATE INDEX ON "t̅(able1" (col1_3 DESC, col1_2, col1_6, col1_9 ASC, " col1_4" ASC, col1_7 DESC, "c""ol1_11", col1_5 ASC);
        test_1        |             CREATE INDEX ON "t̅(able1" (col1_10 DESC, col1_3 ASC, " col1_4", lower(col1_5) DESC);
        test_1        |             CREATE UNIQUE INDEX ON "t̅(able1" (col1_6 DESC, col1_5 DESC, " col1_4", c̸ol1😸_8 ASC) INCLUDE (col1_9);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "da" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.72s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "t�able1" (col1_0 INT4 NOT NULL, "�col1_1" CHAR NOT NULL, " col1_2" INT2 NOT NULL, "col'1_3" REGTYPE NOT NULL, "🙄co-l 1̜_4" NAME NOT NULL, "col&\\x591_5" TIME NOT NULL, col1_6 INTERVAL NOT NULL, col1_7 NAME, col1_8 REGCLASS NOT NULL, col1_9 INT8 NOT NULL AS (" col1_2" + col1_0) VIRTUAL, col1_10 INT8 AS (" col1_2" + col1_0) VIRTUAL, col1_11 STRING NULL AS (CASE WHEN col1_6 IS NULL THEN 'YG=':::STRING ELSE e'\rAR0':::STRING END) VIRTUAL, cöl1_12 STRING NOT NULL AS (lower(col1_7)) VIRTUAL, "c ol1_13" INT8 AS (col1_0 + " col1_2") STORED, "cOl1_14" STRING NOT NULL AS (CASE WHEN col1_6 IS NULL THEN e'?:\x14}':::STRING ELSE e'l+|#G\\RuS':::STRING END) VIRTUAL, PRIMARY KEY ("col'1_3", col1_9 ASC, "cOl1_14", cöl1_12 DESC, col1_8 ASC, " col1_2", "�col1_1", "col&\\x591_5" ASC, col1_0, col1_6, "🙄co-l   1̜_4" DESC), UNIQUE ("�col1_1" DESC, "col'1_3", lower("�col1_1") ASC, col1_0, col1_11 ASC, " col1_2" ASC, col1_9 DESC, col1_6) WHERE (("t�able1"."�col1_1" <= 'X':::STRING) OR ("t�able1".col1_7 > e'\'':::STRING:::NAME)) AND ("t�able1"."col&\\x591_5" != '24:00:00':::TIME), UNIQUE ("c ol1_13" DESC, "col'1_3" ASC, col1_11 ASC, "🙄co-l 1̜_4" DESC, col1_7, (" col1_2" + col1_0), (CASE WHEN col1_8 IS NULL THEN e'\x107':::STRING ELSE '':::STRING END), col1_6 DESC, "�col1_1" DESC) WHERE ((((((((((("t�able1".col1_11 > 'X':::STRING) AND ("t�able1"."�col1_1" <= e'\U00002603':::STRING)) OR ("t�able1".col1_9 <= 127:::INT8)) AND ("t�able1".cöl1_12 < e'\x00':::STRING)) AND ("t�able1".col1_0 != (-1):::INT8)) AND ("t�able1"."🙄co-l    1̜_4" = 'X':::STRING:::NAME)) AND ("t�able1"." col1_2" < (-128):::INT8)) AND ("t�able1"."cOl1_14" < '"':::STRING)) OR ("t�able1"."col&\\x591_5" >= '24:00:00':::TIME)) AND ("t�able1"."c ol1_13" != 2147483647:::INT8)) OR ("t�able1".col1_10 > 9223372036854775807:::INT8)) OR ("t�able1".col1_7 >= '"':::STRING:::NAME), INDEX (col1_9 DESC, "col&\\x591_5" DESC, "col'1_3" ASC, col1_6 DESC, col1_0 ASC, "c ol1_13" ASC, "�col1_1" ASC, (col1_0 + 511583964:::INT8) ASC, col1_8 ASC, " col1_2", "🙄co-l   1̜_4" DESC, "cOl1_14" DESC, cöl1_12 DESC, col1_11 ASC) WHERE (((((((("t�able1".col1_10 > 1:::INT8) AND ("t�able1".cöl1_12 > e'\U00002603':::STRING)) AND ("t�able1"."�col1_1" != 'X':::STRING)) OR ("t�able1".col1_7 >= 'X':::STRING:::NAME)) AND ("t�able1".col1_11 = '':::STRING)) OR ("t�able1"."cOl1_14" != '"':::STRING)) AND ("t�able1".col1_0 <= (-1):::INT8)) OR ("t�able1"."col&\\x591_5" > '24:00:00':::TIME)) AND ("t�able1"."c ol1_13" != 1:::INT8), INDEX (col1_7 DESC, col1_8 DESC, col1_6 ASC, "c ol1_13" ASC, (CASE WHEN col1_8 IS NULL THEN '':::STRING ELSE '6':::STRING END) DESC, col1_10, "col'1_3" DESC, cöl1_12 ASC) WHERE ((((((((((("t�able1"."col&\\x591_5" != '24:00:00':::TIME) AND ("t�able1".col1_10 > (-9223372036854775807):::INT8)) AND ("t�able1".cöl1_12 = '"':::STRING)) AND ("t�able1".col1_11 < e'\'':::STRING)) OR ("t�able1"."�col1_1" = e'\U00002603':::STRING)) AND ("t�able1"."cOl1_14" <= e'\'':::STRING)) AND ("t�able1"." col1_2" = 32767:::INT8)) AND ("t�able1".col1_9 != 0:::INT8)) OR ("t�able1"."🙄co-l   1̜_4" >= '"':::STRING:::NAME)) OR ("t�able1".col1_7 >= '':::STRING:::NAME)) AND ("t�able1"."c ol1_13" >= 2147483647:::INT8)) AND ("t�able1".col1_0 < 0:::INT8), UNIQUE ("c ol1_13" DESC, col1_10 DESC, (" col1_2" + col1_0) DESC, "🙄co-l    1̜_4", "cOl1_14" ASC, col1_9 ASC, "col&\\x591_5", " col1_2" ASC, col1_11, cöl1_12, "col'1_3") STORING (col1_7), UNIQUE (" col1_2", "cOl1_14" DESC, col1_11, col1_10 DESC, "col'1_3", "c ol1_13" ASC, col1_6, col1_9 DESC, col1_7, "�col1_1" DESC, cöl1_12, col1_8 ASC) WHERE ((((((((((("t�able1".col1_7 = e'\'':::STRING:::NAME) AND ("t�able1".col1_0 != (-1):::INT8)) OR ("t�able1"." col1_2" != 32767:::INT8)) AND ("t�able1".col1_11 > '"':::STRING)) OR ("t�able1"."�col1_1" = e'\U00002603':::STRING)) AND ("t�able1"."col&\\x591_5" >= '00:00:00':::TIME)) OR ("t�able1"."🙄co-l 1̜_4" <= 'X':::STRING:::NAME)) OR ("t�able1".col1_9 <= (-32768):::INT8)) OR ("t�able1"."cOl1_14" = e'\x00':::STRING)) AND ("t�able1".cöl1_12 <= e'\x00':::STRING)) OR ("t�able1"."c ol1_13" >= (-128):::INT8)) AND ("t�able1".col1_10 <= 9223372036854775807:::INT8), UNIQUE ("cOl1_14" DESC, lower(col1_7) ASC, "�col1_1" ASC, "🙄co-l  1̜_4", (" col1_2" + col1_0) ASC, col1_11 ASC, "col&\\x591_5" ASC, "c ol1_13"), INDEX (col1_11, "c ol1_13" DESC, col1_6 DESC, col1_8, " col1_2" ASC, col1_0 ASC, "cOl1_14" DESC, (col1_0 + " col1_2") DESC, col1_7 ASC, cöl1_12 ASC, "col&\\x591_5" DESC, "col'1_3" ASC) WHERE ((((((((((("t�able1"."�col1_1" >= e'\U00002603':::STRING) OR ("t�able1".col1_11 <= '':::STRING)) OR ("t�able1"."col&\\x591_5" >= '24:00:00':::TIME)) AND ("t�able1"." col1_2" = 1:::INT8)) OR ("t�able1".col1_10 < (-9223372036854775807):::INT8)) AND ("t�able1"."cOl1_14" < e'\x00':::STRING)) AND ("t�able1"."🙄co-l    1̜_4" >= '"':::STRING:::NAME)) AND ("t�able1".col1_9 >= (-128):::INT8)) AND ("t�able1".cöl1_12 <= '"':::STRING)) AND ("t�able1".col1_0 > 1:::INT8)) AND ("t�able1".col1_7 != '"':::STRING:::NAME)) OR ("t�able1"."c ol1_13" < 0:::INT8), UNIQUE (col1_8 ASC, "col'1_3" ASC, "col&\\x591_5" ASC, col1_11, col1_7 ASC) WHERE "t�able1"." col1_2" >= 1:::INT8, FAMILY ("🙄co-l  1̜_4"), FAMILY (col1_8), FAMILY ("col&\\x591_5", col1_6), FAMILY ("c ol1_13", col1_7), FAMILY (col1_0, " col1_2", "col'1_3"), FAMILY ("�col1_1"));
        test_1        |             ALTER TABLE "t�able1" INJECT STATISTICS e'[{"avg_size": 13, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 501864868657780041, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 939869689845470670}, {"avg_size": 20, "columns": ["\\"\U0001F644co-l\\t1\u031C_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 769932414531513699, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 939869689845470670}, {"avg_size": 5, "columns": ["c\u00F6l1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 848095737348588793, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 939869689845470670}, {"avg_size": 9, "columns": ["\\"\\u000ccol1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 760886093053006738, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 939869689845470670}, {"avg_size": 24, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 558179701110703110, "histo_buckets": [{"distinct_range": 0, "num_eq": 3503265722286827067, "num_range": 0, "upper_bound": "2630808283"}, {"distinct_range": 90000000000, "num_eq": 887740219318483024, "num_range": 90000000000, "upper_bound": "3287857007"}, {"distinct_range": 0, "num_eq": 40000000, "num_range": 4811057771859858795, "upper_bound": "4266678570"}], "histo_col_type": "REGCLASS", "name": "__auto__", "null_count": 0, "row_count": 939869689845470670}, {"avg_size": 9, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 832393604856138992, "histo_col_type": "", "name": "__auto__", "null_count": 927572794106579419, "row_count": 939869689845470670}, {"avg_size": 4, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 31293954426237844, "histo_buckets": [{"distinct_range": 0, "num_eq": 5000, "num_range": 0, "upper_bound": "-8973726966689060537"}, {"distinct_range": 80000, "num_eq": 100000, "num_range": 80000, "upper_bound": "7466631782591683189"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 939869689845470670}, {"avg_size": 25, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 279602457610192921, "histo_col_type": "", "name": "__auto__", "null_count": 847315296156754382, "row_count": 939869689845470670}, {"avg_size": 31, "columns": ["\\"c ol1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 568235697455173780, "histo_buckets": [{"distinct_range": 0, "num_eq": 100, "num_range": 0, "upper_bound": "-8597896211093324938"}, {"distinct_range": 4964.0578544498785, "num_eq": 800000, "num_range": 5000, "upper_bound": "-7113201519895768989"}, {"distinct_range": 9066880313923695000, "num_eq": 6000000, "num_range": 9066880313923694869, "upper_bound": "-6146377875112715520"}, {"distinct_range": 5174927977953992000, "num_eq": 800000000, "num_range": 5174927977953992073, "upper_bound": "1788781179895095528"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 909040334999629391, "row_count": 939869689845470670}, {"avg_size": 12, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 731296296059267144, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 939869689845470670}, {"avg_size": 17, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 695034758683422778, "histo_col_type": "NAME", "name": "__auto__", "null_count": 203407453504383083, "row_count": 939869689845470670}, {"avg_size": 6, "columns": ["\\"cOl1_14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 847683626859596834, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 939869689845470670}, {"avg_size": 17, "columns": ["\\" col1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 584866481792010954, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "-9342"}, {"distinct_range": 10000, "num_eq": 100000000, "num_range": 10000, "upper_bound": "12269"}, {"distinct_range": 0, "num_eq": 649910938253572712, "num_range": 70, "upper_bound": "31760"}], "histo_col_type": "INT2", "name": "__auto__", "null_count": 0, "row_count": 939869689845470670}, {"avg_size": 1, "columns": ["\\"col\'1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 426481449796683221, "histo_buckets": [{"distinct_range": 0, "num_eq": 9040316746741545352, "num_range": 0, "upper_bound": "597044523"}], "histo_col_type": "REGTYPE", "name": "__auto__", "null_count": 0, "row_count": 939869689845470670}, {"avg_size": 29, "columns": ["\\"col&\\\\\\\\x591_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 157667583664998256, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 939869689845470670}]':::JSONB;
        test_1        |             ALTER TABLE "t�able1" INJECT STATISTICS e'[{"avg_size": 0, "columns": ["\\"\\u000ccol1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "CHAR", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\" col1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 10000000000, "num_range": 0, "upper_bound": "2552"}], "histo_col_type": "INT2", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 1540593078402902007, "num_range": 0, "upper_bound": "\\u0005\\u001a"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col\'1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col&\\\\\\\\x591_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"c ol1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 7000000000, "num_range": 0, "upper_bound": "-3917421910721514322"}, {"distinct_range": 5000000, "num_eq": 782060832353472515, "num_range": 5000000, "upper_bound": "-3189297023201053899"}, {"distinct_range": 7000000000, "num_eq": 8282033091962010265, "num_range": 7000000000, "upper_bound": "-1280584547648320761"}, {"distinct_range": 38.72888842105886, "num_eq": 6222425504026714669, "num_range": 60, "upper_bound": "2323376857450045492"}, {"distinct_range": 502274793663923000, "num_eq": 10000000, "num_range": 502274793663923005, "upper_bound": "6872845869181831798"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"cOl1_14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 2827869041950693810, "num_range": 0, "upper_bound": ""}, {"distinct_range": 3801043531448986600, "num_eq": 5980919575333061076, "num_range": 3801043531448986606, "upper_bound": "\\u0010"}, {"distinct_range": 0, "num_eq": 2628893451257396897, "num_range": 7000000, "upper_bound": "\\u001fN@i"}, {"distinct_range": 700000, "num_eq": 123807298401262683, "num_range": 700000, "upper_bound": "\\u001fmc\\u0010a]|T"}, {"distinct_range": 660767942606022500, "num_eq": 6000, "num_range": 660767942606022570, "upper_bound": "L7F"}, {"distinct_range": 0, "num_eq": 3044499394678292971, "num_range": 313516002767046682, "upper_bound": "YP"}, {"distinct_range": 3257878767318076400, "num_eq": 6660325179548402301, "num_range": 4194222264942315694, "upper_bound": "h\\u00050\\u0008Ui"}, {"distinct_range": 90000000000, "num_eq": 60000000, "num_range": 90000000000, "upper_bound": "zCe?["}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"\U0001F644co-l\\t1\u031C_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 7344293407199389048, "num_range": 0, "upper_bound": "782708269"}, {"distinct_range": 114249191.56508708, "num_eq": 80000, "num_range": 200000000, "upper_bound": "912618355"}, {"distinct_range": 4765169964901690000, "num_eq": 7000, "num_range": 8343222567618910267, "upper_bound": "3304292990"}], "histo_col_type": "REGCLASS", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 7915180958707055937, "num_range": 0, "upper_bound": "-7013362225333154309"}, {"distinct_range": 0, "num_eq": 8543857152970562628, "num_range": 20000, "upper_bound": "-4510857149663528176"}, {"distinct_range": 303781384704964030, "num_eq": 0, "num_range": 303781384704964037, "upper_bound": "2622083157916161782"}, {"distinct_range": 0, "num_eq": 900000000, "num_range": 6975075911171561025, "upper_bound": "3103877367051327263"}, {"distinct_range": 126666386614455790, "num_eq": 10000000, "num_range": 126666386614455797, "upper_bound": "4542377583676352253"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["c\u00F6l1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.11s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ dc5c429acb69496f1f7678bf41e608c05f1062d8:

        postgres_1    | 2023-04-19 05:18:42.468 UTC [49] LOG:  background worker "logical replication launcher" (PID 56) exited with exit code 1
        postgres_1    | 2023-04-19 05:18:42.471 UTC [51] LOG:  shutting down
        postgres_1    | 2023-04-19 05:18:42.574 UTC [49] LOG:  database system is shut down
        test_1        | I230419 05:18:42.650896 14 testutils/soon.go:41  [-] 1  SucceedsSoon: dial tcp 172.18.0.3:5432: connect: connection refused
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-19 05:18:42.688 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-19 05:18:42.688 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-19 05:18:42.688 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-19 05:18:42.692 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-19 05:18:42.697 UTC [68] LOG:  database system was shut down at 2023-04-19 05:18:42 UTC
        postgres_1    | 2023-04-19 05:18:42.702 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-19 05:18:44.634 UTC [78] ERROR:  collation "en" for encoding "UTF8" does not exist at character 88
        postgres_1    | 2023-04-19 05:18:44.634 UTC [78] STATEMENT:  CREATE TABLE table1 ("col1 _0" INT4 NOT NULL, col1_1 JSONB NOT NULL, "c ol�1_%q2" TEXT COLLATE en NOT NULL, col1_3 REGROLE, col1_4 TSQUERY NOT NULL, col1_5 TEXT NOT NULL, "col1 _6" BIT(9) NOT NULL, "co%ql1_7" BIT(19) NOT NULL, col1_8 DATE NOT NULL, "c""ol1_̖'9" REGCLASS, col1_10 "char" NOT NULL, col1_11 TEXT COLLATE de NOT NULL, col1_12 TIMESTAMP NOT NULL, col1_13 TIMESTAMP NOT NULL, col1_14 "char" NOT NULL, "co!l1_15" TSQUERY NOT NULL, col1😲_16 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_11 AS TEXT))) STORED, col1_17 TEXT NOT NULL GENERATED ALWAYS AS (lower(col1_10)) STORED, col1_18 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_1 AS TEXT))) STORED);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.83s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.97s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table1 ("col1 _0" INT4 NOT NULL, col1_1 JSONB NOT NULL, "c ol�1_%q2" TEXT COLLATE en NOT NULL, col1_3 REGROLE, col1_4 TSQUERY NOT NULL, col1_5 TEXT NOT NULL, "col1 _6" BIT(9) NOT NULL, "co%ql1_7" BIT(19) NOT NULL, col1_8 DATE NOT NULL, "c""ol1_̖'9" REGCLASS, col1_10 "char" NOT NULL, col1_11 TEXT COLLATE de NOT NULL, col1_12 TIMESTAMP NOT NULL, col1_13 TIMESTAMP NOT NULL, col1_14 "char" NOT NULL, "co!l1_15" TSQUERY NOT NULL, col1😲_16 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_11 AS TEXT))) STORED, col1_17 TEXT NOT NULL GENERATED ALWAYS AS (lower(col1_10)) STORED, col1_18 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_1 AS TEXT))) STORED);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "en" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.72s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (" col1_0" FLOAT4 NOT NULL, "Col1�_1" INTERVAL NOT NULL, col1_2 BIT(27) NOT NULL, "%qcol%v1_""3" TSVECTOR, " col1_4" GEOMETRY NOT NULL, col1_5 GEOMETRY NULL, col1_6 INTERVAL NOT NULL, col1_7 FLOAT8 NOT NULL AS (" col1_0" + 0.10706980526447296:::FLOAT8) VIRTUAL, INDEX (lower(CAST("%qcol%v1_""3" AS STRING)), col1_2 ASC), FAMILY ("%qcol%v1_""3", " col1_0"), FAMILY (col1_6), FAMILY (col1_5, col1_2), FAMILY (" col1_4"), FAMILY ("Col1�_1"));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 15, "columns": ["\\" col1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5439964965265488884, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8840279199997603469}, {"avg_size": 5, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4148397799887222019, "histo_col_type": "", "name": "__auto__", "null_count": 3031464977692252601, "row_count": 8840279199997603469}, {"avg_size": 28, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7449566454269817569, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8840279199997603469}, {"avg_size": 4, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6193346127526135981, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8840279199997603469}, {"avg_size": 20, "columns": ["\\" col1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1262384072152252027, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8840279199997603469}, {"avg_size": 17, "columns": ["\\"Col1\\u000c_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 336345233610973891, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8840279199997603469}, {"avg_size": 9, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1854740274330020971, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8840279199997603469}, {"avg_size": 2, "columns": ["\\"%qcol%v1_\\"\\"3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6923015344647987730, "histo_col_type": "", "name": "__auto__", "null_count": 3227977176860855598, "row_count": 8840279199997603469}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 23, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3705462501346076615, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8002099361157377415}, {"avg_size": 27, "columns": ["\\" col1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3888347309124699328, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8002099361157377415}, {"avg_size": 1, "columns": ["\\"Col1\\u000c_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 573015930778142014, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8002099361157377415}, {"avg_size": 18, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6512287279137857018, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8002099361157377415}, {"avg_size": 12, "columns": ["\\"%qcol%v1_\\"\\"3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3231214508845109736, "histo_col_type": "", "name": "__auto__", "null_count": 5806501192330750606, "row_count": 8002099361157377415}, {"avg_size": 18, "columns": ["\\" col1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 834064814373947487, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8002099361157377415}, {"avg_size": 9, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2262794673751588831, "histo_col_type": "", "name": "__auto__", "null_count": 2319902914658823345, "row_count": 8002099361157377415}, {"avg_size": 22, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 340904449950624267, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8002099361157377415}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (21.08s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 4524616140097c0f6b921e5d1e94ebd405f0809f:

        postgres_1    | .2023-04-20 05:18:21.178 UTC [50] LOG:  aborting any active transactions
        postgres_1    | 2023-04-20 05:18:21.180 UTC [50] LOG:  background worker "logical replication launcher" (PID 57) exited with exit code 1
        postgres_1    | 2023-04-20 05:18:21.182 UTC [52] LOG:  shutting down
        test_1        | I230420 05:18:21.270180 25 testutils/soon.go:41  [-] 1  SucceedsSoon: dial tcp 172.18.0.2:5432: connect: connection refused
        postgres_1    | 2023-04-20 05:18:21.284 UTC [50] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-20 05:18:21.398 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-20 05:18:21.399 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-20 05:18:21.399 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-20 05:18:21.402 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-20 05:18:21.407 UTC [69] LOG:  database system was shut down at 2023-04-20 05:18:21 UTC
        postgres_1    | 2023-04-20 05:18:21.412 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-20 05:18:23.859 UTC [79] ERROR:  collation "de" for encoding "UTF8" does not exist at character 152
        postgres_1    | 2023-04-20 05:18:23.859 UTC [79] STATEMENT:  CREATE TABLE "ta'ble1" (col1_0 NAME NOT NULL, col1_1 INET, col1_2 REGCLASS, "col%331_3" REGTYPE, "co|l1_4" INET, col1_5 VARCHAR NOT NULL, col1_͈6 TEXT COLLATE de, "c(ol1_7" TSVECTOR NOT NULL, "co%vl1_8" INT2 NOT NULL, "co😹L1_9" GEOGRAPHY, col1_10 REGCLASS, col1_11 FLOAT4 NOT NULL, col1_12 TEXT COLLATE da NOT NULL, "co*l1_13" INT8 NOT NULL, col😟1_14 UUID NOT NULL, col1_15 INET NOT NULL, "%qcol1_16" OID NULL, col1́_17 INT8 NOT NULL GENERATED ALWAYS AS ("co*l1_13" + "co%vl1_8") STORED)
        test_1        | --- FAIL: TestCompare (5.71s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/mutators (0.48s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "tAble1" (col1_͕0 GEOMETRY NOT NULL, "c%vol1_1" OID NULL, col1_2 INT2 NOT NULL, col1_3 VARCHAR NOT NULL, col1_4 DECIMAL NOT NULL, ".col1_5" DECIMAL NOT NULL AS (col1_4 + (-1.234E+401):::DECIMAL) VIRTUAL, INDEX (col1_2, col1_4 ASC) STORING ("c%vol1_1") WHERE ((("tAble1".col1_2 != (-1):::INT8) OR ("tAble1".col1_4 = '-Infinity':::DECIMAL)) AND ("tAble1".col1_3 < '"':::STRING)) OR ("tAble1".".col1_5" > (-1.234E+401):::DECIMAL), UNIQUE (col1_3, lower(CAST(col1_͕0 AS STRING))) STORING (col1_͕0, "c%vol1_1", col1_2, col1_4) WHERE ((("tAble1".col1_2 > 0:::INT8) AND ("tAble1".".col1_5" = 1:::DECIMAL)) OR ("tAble1".col1_3 > e'\x00':::STRING)) OR ("tAble1".col1_4 < (-1.234E+401):::DECIMAL), UNIQUE (col1_3 DESC, lower(CAST("c%vol1_1" AS STRING)) ASC, col1_4 DESC, col1_2, ".col1_5" ASC, "c%vol1_1") PARTITION BY LIST (col1_3) (PARTITION "tAble1_part0" VALUES IN ((e'F"\x14':::STRING,), (e'\x0e<\x1f':::STRING,), ('-':::STRING,)), PARTITION "tA-ble1_part1" VALUES IN ((e'8\\f,':::STRING,), ('a4 E':::STRING,), (e'i\'\x1b':::STRING,)), PARTITION "tAble1_part2" VALUES IN ((e' ?\x01\x1f@$WM':::STRING,), ('':::STRING,)), PARTITION "tAble1_part3" VALUES IN ((e'W\x04N\na]``N':::STRING,), ('|':::STRING,), (e'\x02f>br\x04\x0bx@':::STRING,)), PARTITION " tAble1_part4" VALUES IN ((e'W z>\x12@#':::STRING,), ('O':::STRING,)), PARTITION "t Able1_part 5" VALUES IN ((e':``\x14N7\x06\bB':::STRING,), (e'f\x7f|\x01r':::STRING,), ('u':::STRING,)), PARTITION "tAble1_part6" VALUES IN ((e'w\x19Ip$#2~':::STRING,), (e'L\r=@"':::STRING,), (e'\x06':::STRING,)), PARTITION "
        test_1        |             tAble1_""part7" VALUES IN ((e'P+N\x7fdcv\x15':::STRING,), (e'\x00':::STRING,), ('X':::STRING,)), PARTITION "tAble 1_part8" VALUES IN ((e'\nHRNh\x12"-':::STRING,), (e'\x04\x12<dVG#E':::STRING,), ('Q':::STRING,)), PARTITION "tAble1_part  9" VALUES IN ((e'u\x1aS\x0bGN:``':::STRING,), ('"':::STRING,), (e'XYA\x1e\x166Wp':::STRING,)), PARTITION "DEFAULT" VALUES IN ((DEFAULT,))), INVERTED INDEX ("c%vol1_1", col1_4, ".col1_5" ASC, col1_3 ASC, col1_2, col1_͕0) PARTITION BY LIST ("c%vol1_1", col1_4, ".col1_5", col1_3) (PARTITION "tAble1_pa😥rt0" VALUES IN ((3916820045:::OID, (-6.6588124268043265E+21):::DECIMAL, 862232346251754124.5:::DECIMAL, e'\x1c\x123\x11D:':::STRING), (1222994434:::OID, 4.337262310289526693E+36:::DECIMAL, (-7.958195623104988411E+34):::DECIMAL, 'X':::STRING), (234193045:::OID, (-1):::DECIMAL, 710111.9634651902137:::DECIMAL, '#~f,':::STRING), (543538416:::OID, 5.478864223490300854:::DECIMAL, (-1.234E+401):::DECIMAL, e'\'Z4$\'!!I':::STRING)), PARTITION "tAble1_part1" VALUES IN ((0:::OID, 5.631012470374861311E+36:::DECIMAL, 42454830554374531.82:::DECIMAL, e'\x02\x7fBW':::STRING), (3816652296:::OID, 6.110399545056061383E+30:::DECIMAL, 28.12712400800895976:::DECIMAL, e':i``r\x10t7':::STRING), (284403919:::OID, 5.119415888576724003E+27:::DECIMAL, (-4.016046325870420070E+36):::DECIMAL, '':::STRING), (3864776175:::OID, (-4.744923866449949577E+32):::DECIMAL, (-6.4951975696221494E+30):::DECIMAL, e'\x00':::STRING)), PARTITION " tAble1_part2" VALUES IN ((3707819609:::OID, 3.786191518406882288E+29:::DECIMAL, 257035703674460483.2:::DECIMAL, e'7jhC\x01{':::STRING), (2415980262:::OID, 24038487213608620.9:::DECIMAL, 6.121386456938492615E+19:::DECIMAL, '"':::STRING), (3435148875:::OID, (-8.722843424721889399E+26):::DECIMAL, (-67.24526531173678977):::DECIMAL, 'g"':::STRING), (4017130967:::OID, (-1.234E+401):::DECIMAL, 7179750593.571005559:::DECIMAL, e'S\x10d@\f':::STRING)), PARTITION "tAble1_part3" VALUES IN ((3708070746:::OID, 5220111172.666856471:::DECIMAL, 8.020706251498392349E+19:::DECIMAL, e'\x17':::STRING), (776072905:::OID, 1:::DECIMAL, 0.1500840454307146937:::DECIMAL, e'\x0bwv\x7f5s':::STRING), (651863987:::OID, (-59051938470.87000144):::DECIMAL, 6.050435587012087715E+36:::DECIMAL, e'6\b)M5\x068E{':::STRING), (3448042582:::OID, (-27695922.52437827838):::DECIMAL, (-2.150428002724896860E+34):::DECIMAL, e'?Jp \x02\x155?M':::STRING)), PARTITION "tAble1_part4" VALUES IN ((2819783200:::OID, (-22423875238612.28583):::DECIMAL, (-4.108642010391111504E+19):::DECIMAL, e'C+{\x1f-<[ ':::STRING), (3210887682:::OID, 5.883444150654660104E+24:::DECIMAL, 3.570368957366379957E+37:::DECIMAL, e'\x1f|\x076^':::STRING), (402428132:::OID, 7086594733.193258798:::DECIMAL, 6.68008745290445696:::DECIMAL, e'\x1e\x1cz?\\':::STRING), (258705214:::OID, (-253009.1764094698762):::DECIMAL, 1.445323585660505167E+29:::DECIMAL, e'\x12 N|c':::STRING)), PARTITION "tAble1_part5" VALUES IN ((482341623:::OID, (-4.420288153438015410E+32):::DECIMAL, 5.379543507150589550E+31:::DECIMAL, e'\x1a\x1e\x13':::STRING), (0:::OID, 4025029246960.376661:::DECIMAL, (-0.7875334045822388041):::DECIMAL, e'qJ}\x1e\x19#(2\x10':::STRING), (3745876504:::OID, 9002.12567315783617:::DECIMAL, 8.930048452246161210E+28:::DECIMAL, e'\tpJ':::STRING), (3003025664:::OID, (-8.241828236396265885E+37):::DECIMAL, (-259893713.1391988397):::DECIMAL, e'\x02mH':::STRING)), PARTITION "tAb le1_part6" VALUES IN ((2234184415:::OID, 9.193486764526188632E+37:::DECIMAL, (-6.124365456270811160E+20):::DECIMAL, e'\U00002603':::STRING), (0:::OID, 6.001990993576757064E+33:::DECIMAL, (-5.293168008757786280E+29):::DECIMAL, e'R\x11\x16':::STRING), (594928963:::OID, 7.275976456277430959E+33:::DECIMAL, 3.730809252719584299E+19:::DECIMAL, e'\x14``Pz':::STRING), (709357660:::OID, 23593655957717.88421:::DECIMAL, (-8416844363248.480537):::DECIMAL, e'\x19Z;\x03={<ms':::STRING)), PARTITION "tAble1_part7" VALUES IN ((820209164:::OID, (-180.0186105162798646):::DECIMAL, (-5.273218477087646755E+28):::DECIMAL, 'rQ.[T&v9':::STRING), (2833039352:::OID, (-4.278980190844017064E+35):::DECIMAL, 0:::DECIMAL, 'x$':::STRING), (0:::OID, 1:::DECIMAL, (-4587.741015698728683):::DECIMAL, '"':::STRING), (712087566:::OID, 6.059217696297789408E+24:::DECIMAL, (-4236230101355.940160):::DECIMAL, e'\x1d*o6\x18Q':::STRING)), PARTITION "tAble1_parT%p8" VALUES IN ((1132581328:::OID, (-8.816168816056851621E+19):::DECIMAL, (-1466131869.757827852):::DECIMAL, e'\f1e7=\n3':::STRING), (2492201359:::OID, (-1.9180403452781918E+29):::DECIMAL, 6.033377094389541087E+19:::DECIMAL, e'\x01\x18op\x1b':::STRING), (0:::OID, 0:::DECIMAL, (-1.481166893177881995E+20):::DECIMAL, '?':::STRING), (1079953524:::OID, 1:::DECIMAL, 59035154093772.26832:::DECIMAL, e'\x1a@V\x14]x-,b':::STRING)), PARTITION "tAble1_part9" VALUES IN ((1118533872:::OID, (-880893.179288834017):::DECIMAL, 778926.0947047422109:::DECIMAL, '"':::STRING), (3003949726:::OID, (-8.181185336837666208E+33):::DECIMAL, (-0.08426132774775832982):::DECIMAL, e'\U00002603':::STRING), (3594144400:::OID, 7.164821805926624839E+26:::DECIMAL, 75280480819.97126867:::DECIMAL, e'L_\x04\x011':::STRING), (708794591:::OID, 8.037410382252766879E+26:::DECIMAL, (-5111290966907030.128):::DECIMAL, e'\x1f}\x19.XMe\x1c':::STRING))), INDEX ("c%vol1_1" ASC, ".col1_5" ASC) STORING (col1_͕0, col1_4) WHERE ("tAble1".col1_4 != 'NaN':::DECIMAL) AND ("tAble1".col1_2 = 1:::INT8), FAMILY (col1_2, col1_͕0, "c%vol1_1", col1_3), FAMILY (col1_4));
        test_1        |             ALTER TABLE "tAble1" INJECT STATISTICS e'[{"avg_size": 0, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4312056288, "histo_buckets": [{"distinct_range": 0, "num_eq": 10000000, "num_range": 0, "upper_bound": "-31198"}, {"distinct_range": 24892108.309083782, "num_eq": 80000000000, "num_range": 70000000, "upper_bound": "-24398"}, {"distinct_range": 0, "num_eq": 4861652130791970353, "num_range": 400000000, "upper_bound": "-23097"}, {"distinct_range": 390085764182164500, "num_eq": 1817869875867857261, "num_range": 576797688146039801, "upper_bound": "-5614"}, {"distinct_range": 0, "num_eq": 4816954771585152790, "num_range": 2416753455526685421, "upper_bound": "16605"}, {"distinct_range": 900, "num_eq": 6474292344902335092, "num_range": 900, "upper_bound": "20545"}, {"distinct_range": 0, "num_eq": 300000000, "num_range": 2000, "upper_bound": "25200"}, {"distinct_range": 6182955525127458000, "num_eq": 1000000000, "num_range": 6182955525127457997, "upper_bound": "25444"}, {"distinct_range": 1568.0488294757797, "num_eq": 2680194249466913117, "num_range": 3000, "upper_bound": "26980"}], "histo_col_type": "INT2", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 30, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6402207405, "histo_buckets": [{"distinct_range": 0, "num_eq": 70, "num_range": 0, "upper_bound": "\\u001al_?"}, {"distinct_range": 0, "num_eq": 2421615889041551695, "num_range": 900000, "upper_bound": "b;p-d{"}], "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 6, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7275962498, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 5, "columns": ["\\".col1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 331160277, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 25, "columns": ["col1_\u03550"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1920563988, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 19, "columns": ["\\"c%vol1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6402962774, "histo_col_type": "OID", "name": "__auto__", "null_count": 3464871004, "row_count": 9000000000}]':::JSONB;
        test_1        |             ALTER TABLE "tAble1" INJECT STATISTICS e'[{"avg_size": 7, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4405272495325754440, "histo_buckets": [{"distinct_range": 0, "num_eq": 4396136126734377648, "num_range": 0, "upper_bound": "-14543"}, {"distinct_range": 0, "num_eq": 7742637251639319835, "num_range": 9000000, "upper_bound": "6793"}, {"distinct_range": 393.10551758700484, "num_eq": 0, "num_range": 700, "upper_bound": "18730"}, {"distinct_range": 30, "num_eq": 2772547328115967448, "num_range": 30, "upper_bound": "23343"}, {"distinct_range": 10, "num_eq": 900, "num_range": 10, "upper_bound": "26361"}, {"distinct_range": 2236507929063089400, "num_eq": 8000, "num_range": 2273935387790829896, "upper_bound": "29834"}], "histo_col_type": "INT2", "name": "__auto__", "null_count": 0, "row_count": 6071348926274800653}, {"avg_size": 8, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2207595055308522672, "histo_buckets": [{"distinct_range": 0, "num_eq": 500000000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 100446925298413020, "num_eq": 3000000, "num_range": 1694150161091279839, "upper_bound": "\\u0016*l30-\\u0010"}, {"distinct_range": 908480477428849200, "num_eq": 5422045153234336965, "num_range": 1198397818278777628, "upper_bound": "\'\\u0006&\\u001dZ``"}, {"distinct_range": 9000000000, "num_eq": 50000000000, "num_range": 9000000000, "upper_bound": "\'6"}, {"distinct_range": 1712096149690939600, "num_eq": 1467074417551472223, "num_range": 1712096149690939586, "upper_bound": "A{R="}], "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 0, "row_count": 6071348926274800653}, {"avg_size": 1, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2069351680822255596, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6071348926274800653}, {"avg_size": 7, "columns": ["\\".col1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5057605294783533519, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6071348926274800653}, {"avg_size": 3, "columns": ["col1_\u03550"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2664047570954930618, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6071348926274800653}, {"avg_size": 26, "columns": ["\\"c%vol1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5408483199482248349, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 5658453731481520000, "num_eq": 5407168898396951290, "num_range": 5658453731481519741, "upper_bound": "81742632"}, {"distinct_range": 9068815850099709000, "num_eq": 20, "num_range": 9068815850099708613, "upper_bound": "1255623061"}, {"distinct_range": 1634800252613219800, "num_eq": 0, "num_range": 7044636003108237857, "upper_bound": "2862511888"}, {"distinct_range": 14.208961437797717, "num_eq": 10000000, "num_range": 30, "upper_bound": "2916376198"}, {"distinct_range": 9577294115.365417, "num_eq": 8000, "num_range": 80000000000, "upper_bound": "3749899478"}, {"distinct_range": 0, "num_eq": 5000000, "num_range": 7830848054657617267, "upper_bound": "4288232774"}], "histo_col_type": "OID", "name": "__auto__", "null_count": 991008986724566017, "row_count": 6071348926274800653}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        |     --- FAIL: TestCompare/postgres (1.10s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "ta'ble1" (col1_0 NAME NOT NULL, col1_1 INET, col1_2 REGCLASS, "col%331_3" REGTYPE, "co|l1_4" INET, col1_5 VARCHAR NOT NULL, col1_͈6 TEXT COLLATE de, "c(ol1_7" TSVECTOR NOT NULL, "co%vl1_8" INT2 NOT NULL, "co😹L1_9" GEOGRAPHY, col1_10 REGCLASS, col1_11 FLOAT4 NOT NULL, col1_12 TEXT COLLATE da NOT NULL, "co*l1_13" INT8 NOT NULL, col😟1_14 UUID NOT NULL, col1_15 INET NOT NULL, "%qcol1_16" OID NULL, col1́_17 INT8 NOT NULL GENERATED ALWAYS AS ("co*l1_13" + "co%vl1_8") STORED)
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "de" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.76s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 06fea49dd3b665758ff016a38622e3ce0f1ccfc5:

        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.00s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 15 [running]:
        test_1        | testing.tRunner.func1.2({0x2268460, 0xc00207b680})
        test_1        |     GOROOT/src/testing/testing.go:1396 +0x24e
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1399 +0x39f
        test_1        | panic({0x2268460, 0xc00207b680})
        test_1        |     GOROOT/src/runtime/panic.go:884 +0x212
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x4509120?, {0x3154348?, 0xc0023fe870?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:377 +0x445
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x311a300?, 0x4509120)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:310 +0x13c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc000847800)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:227 +0x96
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc0020670e0, {0xc002079950?, 0x5, 0xc0020670e0?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:260 +0x71f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0xc002091968?, 0x246399f?, {0xc002079950?, 0x20a89e0?, 0x1?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:98 +0x2e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0x20a89e0?, {0x246399f, 0x5}, 0x5, 0x0?, {0xc001ed3a48, 0x3, 0xc002054190?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x16a
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0x1?, 0x60a200?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:104 +0x194
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc00028f500?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:84 +0x37
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.wrapCommonSetup.func1(0x263c1d0?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x22
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc0002fdd40)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:141 +0xed
        test_1        | testing.tRunner(0xc0002fdd40, 0xc002067050)
        test_1        |     GOROOT/src/testing/testing.go:1446 +0x10b
        test_1        | created by testing.(*T).Run
        test_1        |     GOROOT/src/testing/testing.go:1493 +0x35f
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 2
--- FAIL: TestComposeCompare (18.76s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ ca2fae8b11a761af8ac7e5334aa5642c15dfb42f:

        postgres_1    | 
        postgres_1    | 2023-04-22 05:20:03.323 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-22 05:20:03.323 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-22 05:20:03.323 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-22 05:20:03.328 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-22 05:20:03.333 UTC [68] LOG:  database system was shut down at 2023-04-22 05:20:03 UTC
        postgres_1    | 2023-04-22 05:20:03.334 UTC [70] FATAL:  the database system is starting up
        test_1        | I230422 05:20:03.335102 6 testutils/soon.go:41  [-] 1  SucceedsSoon: FATAL: the database system is starting up (SQLSTATE 57P03)
        postgres_1    | 2023-04-22 05:20:03.341 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-22 05:20:05.575 UTC [80] ERROR:  collation "de" for encoding "UTF8" does not exist at character 37
        postgres_1    | 2023-04-22 05:20:05.575 UTC [80] STATEMENT:  CREATE TABLE table4 ("col4_!0" TEXT COLLATE de NOT NULL, c😁ol4_1 REGTYPE, "\\U000FD14Ccol4_2" REGTYPE NULL, "c
        postgres_1    |     ol  4_3" TSQUERY NOT NULL, "'c.ol4_4" GEOMETRY, col4_5 TIMETZ NULL, "co̠l4_""6" REGTYPE NULL, "col 4_7" TSQUERY NOT NULL, "col4\\U00029C53_8" OID, "col4_ 9" TEXT COLLATE en, col4_10 TEXT GENERATED ALWAYS AS (lower(CAST("'c.ol4_4" AS TEXT))) STORED, "&col4😬_11" TEXT NULL GENERATED ALWAYS AS (CASE WHEN "\\U000FD14Ccol4_2" IS NULL THEN e'\x19\x01Rtp'::TEXT ELSE e'\''::TEXT END) STORED, "c""ol4_12" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("col 4_7" AS TEXT))) STORED, "col4_%p13" TEXT NULL GENERATED ALWAYS AS (lower(CAST(col4_5 AS TEXT))) STORED, col4_14 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("col 4_7" AS TEXT))) STORED, col4_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("c
        postgres_1    |     ol  4_3" AS TEXT))) STORED, col4_16 TEXT GENERATED ALWAYS AS (lower(CAST("col4_ 9" AS TEXT))) STORED, "col4_'17" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("c
        postgres_1    |     ol  4_3" AS TEXT))) STORED);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (6.28s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.23s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table4 ("col4_!0" TEXT COLLATE de NOT NULL, c😁ol4_1 REGTYPE, "\\U000FD14Ccol4_2" REGTYPE NULL, "c
        test_1        |             ol  4_3" TSQUERY NOT NULL, "'c.ol4_4" GEOMETRY, col4_5 TIMETZ NULL, "co̠l4_""6" REGTYPE NULL, "col 4_7" TSQUERY NOT NULL, "col4\\U00029C53_8" OID, "col4_ 9" TEXT COLLATE en, col4_10 TEXT GENERATED ALWAYS AS (lower(CAST("'c.ol4_4" AS TEXT))) STORED, "&col4😬_11" TEXT NULL GENERATED ALWAYS AS (CASE WHEN "\\U000FD14Ccol4_2" IS NULL THEN e'\x19\x01Rtp'::TEXT ELSE e'\''::TEXT END) STORED, "c""ol4_12" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("col 4_7" AS TEXT))) STORED, "col4_%p13" TEXT NULL GENERATED ALWAYS AS (lower(CAST(col4_5 AS TEXT))) STORED, col4_14 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("col 4_7" AS TEXT))) STORED, col4_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("c
        test_1        |             ol  4_3" AS TEXT))) STORED, col4_16 TEXT GENERATED ALWAYS AS (lower(CAST("col4_ 9" AS TEXT))) STORED, "col4_'17" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("c
        test_1        |             ol  4_3" AS TEXT))) STORED);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "de" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.90s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 TSQUERY, "c%pol1_1" CHAR NULL, "%vcol1_2" DECIMAL NOT NULL, "col�1͊_3" INT2 NOT NULL, "co_'l1_4" GEOGRAPHY NULL, "col-1_5" NAME NOT NULL, "co l1̗_6" DATE NOT NULL, "col1{_7" TIMESTAMP NOT NULL, col1_8 REGTYPE, "col1_'😸9" BOX2D NOT NULL, "col 1_10" TIMETZ NULL, "col,1_11" STRING NULL AS (lower("c%pol1_1")) STORED, col1_12 STRING NULL AS (lower(CAST("co_'l1_4" AS STRING))) VIRTUAL, col1_13 STRING NOT NULL AS (CASE WHEN "col1{_7" IS NULL THEN e'\x14&\x17\x02u':::STRING ELSE e'}\x0f\x1d\x15\x14\x06':::STRING END) STORED, "co\\U0003C299l1-""_14" STRING AS (CASE WHEN col1_8 IS NULL THEN e'Y\x1b\x13T\x1dD\x13\x06':::STRING ELSE e'\x13d*\x15J':::STRING END) VIRTUAL, col1_15 STRING AS (lower(CAST(col1_0 AS STRING))) VIRTUAL, FAMILY (col1_0), FAMILY ("col,1_11"), FAMILY ("%vcol1_2", "co_'l1_4"), FAMILY ("co l1̗_6", "col1_'😸9", "col-1_5", "c%pol1_1"), FAMILY ("col 1_10", col1_8), FAMILY ("col1{_7", "col�1͊_3", col1_13));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 4, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 18281, "histo_col_type": "", "name": "__auto__", "null_count": 4176, "row_count": 40000}, {"avg_size": 15, "columns": ["\\"col1_\'\U0001F6389\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1430, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000}, {"avg_size": 6, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 28892, "histo_col_type": "", "name": "__auto__", "null_count": 29544, "row_count": 40000}, {"avg_size": 7, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 12201, "histo_col_type": "", "name": "__auto__", "null_count": 263, "row_count": 40000}, {"avg_size": 17, "columns": ["\\"col\\u000b1\u034A_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2243, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000}, {"avg_size": 8, "columns": ["\\"col-1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 20963, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000}, {"avg_size": 28, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 23297, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000}, {"avg_size": 0, "columns": ["\\"co\\\\\\\\U0003C299l1-\\"\\"_14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 26550, "histo_col_type": "", "name": "__auto__", "null_count": 10187, "row_count": 40000}, {"avg_size": 18, "columns": ["\\"c%pol1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7458, "histo_col_type": "", "name": "__auto__", "null_count": 14590, "row_count": 40000}, {"avg_size": 16, "columns": ["\\"co_\'l1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7324, "histo_col_type": "", "name": "__auto__", "null_count": 13369, "row_count": 40000}, {"avg_size": 30, "columns": ["\\"col1{_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 13757, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000}, {"avg_size": 18, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 20877, "histo_col_type": "", "name": "__auto__", "null_count": 1640, "row_count": 40000}, {"avg_size": 5, "columns": ["\\"col 1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 22263, "histo_col_type": "", "name": "__auto__", "null_count": 10140, "row_count": 40000}, {"avg_size": 0, "columns": ["\\"col,1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2491, "histo_col_type": "", "name": "__auto__", "null_count": 14372, "row_count": 40000}, {"avg_size": 28, "columns": ["\\"%vcol1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 13440, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000}, {"avg_size": 11, "columns": ["\\"co l1\u0317_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 36516, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 5, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2488440110, "histo_col_type": "", "name": "__auto__", "null_count": 1722471961, "row_count": 3000000000}, {"avg_size": 10, "columns": ["\\"%vcol1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1493373342, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000000000}, {"avg_size": 29, "columns": ["\\"co_\'l1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 819458447, "histo_col_type": "", "name": "__auto__", "null_count": 957104747, "row_count": 3000000000}, {"avg_size": 20, "columns": ["\\"col-1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 906065679, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000000000}, {"avg_size": 23, "columns": ["\\"col,1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 957486811, "histo_col_type": "", "name": "__auto__", "null_count": 110221534, "row_count": 3000000000}, {"avg_size": 27, "columns": ["\\"col\\u000b1\u034A_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 282174736, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000000000}, {"avg_size": 24, "columns": ["\\"co l1\u0317_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2017170309, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000000000}, {"avg_size": 21, "columns": ["\\"col 1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 257588088, "histo_col_type": "", "name": "__auto__", "null_count": 1789138907, "row_count": 3000000000}, {"avg_size": 18, "columns": ["\\"co\\\\\\\\U0003C299l1-\\"\\"_14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1691845246, "histo_col_type": "", "name": "__auto__", "null_count": 1275464143, "row_count": 3000000000}, {"avg_size": 27, "columns": ["\\"col1{_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2770318852, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000000000}, {"avg_size": 25, "columns": ["\\"col1_\'\U0001F6389\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2097969756, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000000000}, {"avg_size": 6, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 890558771, "histo_col_type": "", "name": "__auto__", "null_count": 446253988, "row_count": 3000000000}, {"avg_size": 10, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1324482445, "histo_col_type": "", "name": "__auto__", "null_count": 1620976835, "row_count": 3000000000}, {"avg_size": 5, "columns": ["\\"c%pol1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 359221974, "histo_col_type": "", "name": "__auto__", "null_count": 1182116549, "row_count": 3000000000}, {"avg_size": 7, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 44152617, "histo_col_type": "", "name": "__auto__", "null_count": 472006793, "row_count": 3000000000}, {"avg_size": 30, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1073774468, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (21.98s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 25a0174fb8e259fd3fdfbc2587a546d4433d1224:

        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.51s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1449903531/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare postgres to cockroach1: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("heap_tableam_handler"),
        test_1        |             +   string("array_agg"),
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regproc(3::INT8::INT4::INT4)::REGPROC AS 😩col713) AS tab356
        test_1        |             ORDER BY
        test_1        |                 😩col713 ASC NULLS FIRST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regproc(3:::INT8::INT4::INT4)::REGPROC AS 😩col713) AS tab356
        test_1        |             ORDER BY
        test_1        |                 😩col713 ASC NULLS FIRST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.61s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 STRING COLLATE de NOT NULL, col1_1 INT2 NOT NULL, col1_2 TIMETZ NOT NULL, col1_3 TIMETZ NOT NULL, col1_4 STRING NOT NULL, col1_5 "char" NOT NULL, col1_6 DECIMAL[] NOT NULL, "col1""_7" TIMETZ NOT NULL, col1_8 TIMESTAMP NOT NULL, col1_9 TIMETZ NOT NULL, "  col🙄1_10" REGROLE NOT NULL, col1_11 BOX2D NOT NULL, col1_12 STRING NOT NULL AS (lower(CAST(col1_9 AS STRING))) VIRTUAL, col1_😺13 STRING NOT NULL AS (lower(CAST(col1_0 AS STRING))) STORED, col1_14 STRING NOT NULL AS (lower(col1_5)) VIRTUAL, col1_15 STRING NOT NULL AS (lower(CAST(col1_11 AS STRING))) STORED, c̀ol1_16 INT8 NOT NULL AS (col1_1 + (-32383):::INT8) VIRTUAL, FAMILY (col1_3), FAMILY (col1_4), FAMILY (col1_8, col1_11), FAMILY ("col1""_7"), FAMILY (col1_0), FAMILY (col1_6), FAMILY (col1_1, col1_9, col1_15, col1_😺13), FAMILY ("  col🙄1_10", col1_5), FAMILY (col1_2));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 20, "columns": ["\\"col1\\"\\"_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2652635924813582542, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 20, "columns": ["\\"\\tcol\U0001F6441_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2464826226149645797, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 8, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 530219272983437089, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 24, "columns": ["c\u0300ol1_16"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2705744856783789243, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 7, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1112695737194167687, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 18, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 190531080743871297, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 19, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1549795591568296317, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 16, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2395161406850729856, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 25, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1270219573949857073, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 24, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 649129848146845566, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 12, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2330064910856936291, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 9, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 568851118117926360, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 0, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2573958711746581686, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 19, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1307363798632709699, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 31, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1396429558056114818, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 21, "columns": ["col1_\U0001F63A13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3014943641096305780, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}, {"avg_size": 28, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2067199207531014563, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3094773047366929775}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 8, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 137086341348062218, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 12, "columns": ["\\"col1\\"\\"_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 540055091142508028, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 6, "columns": ["col1_\U0001F63A13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 678183935015139181, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 13, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 278510225998901369, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 18, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 243248022383031421, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 12, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 494610566817725610, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 29, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 374510363781941766, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 21, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 162634139947630737, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 24, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 348038174014432013, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 27, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 122743385891475556, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 12, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 702044188878868241, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 11, "columns": ["c\u0300ol1_16"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 760584148836247644, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 18, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 611753504526993897, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 31, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 753287881767443132, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 12, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 360970932764974883, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 20, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 450363909736553535, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}, {"avg_size": 27, "columns": ["\\"\\tcol\U0001F6441_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 248384890249463538, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 774674855200199250}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.01s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ f23e5bca28bf8529d8afaea0aec072f9c0f000d1:

        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (3.46s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1152341998/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("4"),
        test_1        |                 nil,
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regproc(4::OID::OID::OID)::REGPROC AS cọl͊4177, NULL::OIDVECTOR AS col4178) AS tab1996
        test_1        |             ORDER BY
        test_1        |                 cọl͊4177 NULLS LAST, col4178 ASC;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regproc(4:::OID::OID::OID)::REGPROC AS cọl͊4177, NULL::OIDVECTOR AS col4178) AS tab1996
        test_1        |             ORDER BY
        test_1        |                 cọl͊4177 NULLS LAST, col4178 ASC;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.57s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 UUID NOT NULL, col1_1 TSVECTOR NOT NULL, "c%v ol1'_2" INT8 NULL, "%pcol1_3" CHAR NOT NULL, "col1 _4" TIMESTAMP NOT NULL, """col1_5" BOX2D NOT NULL, "coL1_6" INTERVAL NULL, "co%pl1_7" GEOMETRY NOT NULL, "co l1_8" STRING NOT NULL AS (lower(CAST("co%pl1_7" AS STRING))) VIRTUAL, col1_9 STRING NOT NULL AS (CASE WHEN "col1 _4" IS NULL THEN e'\'':::STRING ELSE e'\x01=8:':::STRING END) STORED, "col�1_10" STRING NOT NULL AS (lower(CAST(col1_1 AS STRING))) STORED, col1_11 STRING NOT NULL AS (lower(CAST("""col1_5" AS STRING))) VIRTUAL, INDEX ("coL1_6" DESC) WHERE (((table1."col1 _4" >= '4714-11-24 00:00:00 BC':::TIMESTAMP) AND (table1."%pcol1_3" >= '':::STRING)) OR (table1.col1_11 >= e'\U00002603':::STRING)) AND (table1."c%v ol1'_2" = 127:::INT8), INVERTED INDEX (col1_9 ASC, "col1 _4" DESC, "c%v ol1'_2" ASC, col1_1) WHERE ((((((table1."%pcol1_3" <= '"':::STRING) OR (table1."c%v ol1'_2" <= 0:::INT8)) OR (table1.col1_9 = e'\U00002603':::STRING)) OR (table1."col1 _4" >= '4714-11-24 00:00:00 BC':::TIMESTAMP)) AND (table1."col�1_10" <= e'\U00002603':::STRING)) AND (table1.col1_11 >= '':::STRING)) AND (table1."co l1_8" = '':::STRING), INVERTED INDEX (col1_0 ASC, """col1_5", col1_11 ASC, "c%v ol1'_2", "co l1_8" DESC, lower(CAST(col1_0 AS STRING)) ASC, col1_1) WHERE ((((((table1."col�1_10" >= e'\'':::STRING) OR (table1.col1_11 = e'\'':::STRING)) OR (table1.col1_9 <= '"':::STRING)) OR (table1."col1 _4" >= '294276-12-31 23:59:59.999999':::TIMESTAMP)) OR (table1."co l1_8" < 'X':::STRING)) AND (table1."c%v ol1'_2" = 0:::INT8)) AND (table1."%pcol1_3" <= '"':::STRING) NOT VISIBLE, INVERTED INDEX (col1_0 DESC, col1_11 ASC, col1_1), FAMILY (col1_0, "col�1_10", col1_9, "coL1_6", "c%v ol1'_2"), FAMILY ("col1 _4"), FAMILY ("""col1_5"), FAMILY (col1_1), FAMILY ("%pcol1_3"), FAMILY ("co%pl1_7"));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 21, "columns": ["\\"\\"\\"col1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 39903, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70000}, {"avg_size": 17, "columns": ["\\"coL1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 40581, "histo_col_type": "INTERVAL", "name": "__auto__", "null_count": 61116, "row_count": 70000}, {"avg_size": 2, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 40141, "histo_buckets": [{"distinct_range": 0, "num_eq": 7741668794236942649, "num_range": 0, "upper_bound": "\\n\\u0014z)"}, {"distinct_range": 178.50916270154616, "num_eq": 20000, "num_range": 600, "upper_bound": "\\u001e\\u0004\\u0018\\u0013$U"}, {"distinct_range": 0, "num_eq": 8011324926106311081, "num_range": 90000, "upper_bound": "L\\"\x7f,"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 70000}, {"avg_size": 12, "columns": ["\\"c%v ol1\'_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 64599, "histo_col_type": "", "name": "__auto__", "null_count": 48687, "row_count": 70000}, {"avg_size": 14, "columns": ["\\"%pcol1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 13320, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70000}, {"avg_size": 6, "columns": ["\\"col1 _4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 9468, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70000}, {"avg_size": 25, "columns": ["\\"co%pl1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 46788, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70000}, {"avg_size": 13, "columns": ["\\"co l1_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3600, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70000}, {"avg_size": 30, "columns": ["\\"col\\u000c1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 23238, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70000}, {"avg_size": 19, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 34305, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70000}, {"avg_size": 27, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 45769, "histo_buckets": [{"distinct_range": 0, "num_eq": 600000000, "num_range": 0, "upper_bound": "b149ae00-89a1-4913-a5f4-2d54865d60e9"}], "histo_col_type": "UUID", "name": "__auto__", "null_count": 0, "row_count": 70000}, {"avg_size": 13, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 9406, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70000}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 21, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4412801266365790088, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8408337038141316710}, {"avg_size": 6, "columns": ["\\"c%v ol1\'_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1239613612038631301, "histo_col_type": "", "name": "__auto__", "null_count": 755544413512298818, "row_count": 8408337038141316710}, {"avg_size": 16, "columns": ["\\"col1 _4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3992225558558789217, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8408337038141316710}, {"avg_size": 12, "columns": ["\\"\\"\\"col1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6165616377149361281, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8408337038141316710}, {"avg_size": 24, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1194126212548632500, "histo_buckets": [{"distinct_range": 0, "num_eq": 2019721572192658303, "num_range": 0, "upper_bound": "\\""}, {"distinct_range": 60, "num_eq": 20000, "num_range": 60, "upper_bound": ")5OORI\\n"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 8408337038141316710}, {"avg_size": 0, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7726857255174174109, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8408337038141316710}, {"avg_size": 11, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 114936643656456926, "histo_buckets": [{"distinct_range": 0, "num_eq": 50, "num_range": 0, "upper_bound": "00000000-0000-0000-0000-000000000000"}, {"distinct_range": 6852730616485514000, "num_eq": 4981147679711732514, "num_range": 7572340721839920879, "upper_bound": "c19e9604-fdad-423d-ba9f-13a2b5e1e074"}, {"distinct_range": 90, "num_eq": 5139591164543083379, "num_range": 90, "upper_bound": "d14ec9aa-1479-437e-9e94-0fc2d6f9be73"}], "histo_col_type": "UUID", "name": "__auto__", "null_count": 0, "row_count": 8408337038141316710}, {"avg_size": 26, "columns": ["\\"%pcol1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4753717049646727990, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8408337038141316710}, {"avg_size": 18, "columns": ["\\"coL1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3059432248990764777, "histo_buckets": [{"distinct_range": 0, "num_eq": 4000, "num_range": 0, "upper_bound": "-72 years -11 mons -51 days -23:03:48.744003"}, {"distinct_range": 0, "num_eq": 9215659891982781460, "num_range": 0, "upper_bound": "-64 years -1 mons -702 days -23:42:53.387889"}, {"distinct_range": 349213274848276000, "num_eq": 2178756748811069310, "num_range": 5702889680284315224, "upper_bound": "-53 years -22 days -01:34:16.656506"}, {"distinct_range": 14.027788091113518, "num_eq": 4886333516733411104, "num_range": 40, "upper_bound": "-51 years -2 mons -337 days -14:50:29.69475"}, {"distinct_range": 0, "num_eq": 119294331138825504, "num_range": 3571954254835802423, "upper_bound": "-44 years -453 days -01:34:12.877971"}, {"distinct_range": 953157203749609100, "num_eq": 300000, "num_range": 953157203749609148, "upper_bound": "-41 years -11 mons -486 days -15:12:15.246336"}, {"distinct_range": 200000, "num_eq": 6000, "num_range": 200000, "upper_bound": "-1 years -2 mons -16:52:46.423289"}, {"distinct_range": 152994852.41349274, "num_eq": 7000000, "num_range": 700000000, "upper_bound": "18 years 4 mons 130 days 13:05:57.492741"}, {"distinct_range": 219589718395044640, "num_eq": 4289974924866160713, "num_range": 9093396048077169997, "upper_bound": "22 years 6 mons 998 days 13:27:10.910566"}], "histo_col_type": "INTERVAL", "name": "__auto__", "null_count": 1160305792363534584, "row_count": 8408337038141316710}, {"avg_size": 3, "columns": ["\\"co%pl1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8379040674737448910, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8408337038141316710}, {"avg_size": 29, "columns": ["\\"co l1_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2383814806627498649, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8408337038141316710}, {"avg_size": 9, "columns": ["\\"col\\u000c1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6557579563769413621, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8408337038141316710}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (25.75s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ afba2c1e66d787a39e0a13a125b33d940b2e1c54:

        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2815497646/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |                 nil,
        test_1        |                 s"2000-01-01 06:00:00 +0000 UTC",
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("6"),
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         NULL::RECORD AS col13490,
        test_1        |                         '2000-01-01 06:00:00'::TIMESTAMP::TIMESTAMP AS c😐ol13491,
        test_1        |                         regproc(6::OID::OID::OID)::REGPROC AS "col 13492"
        test_1        |                 )
        test_1        |                     AS "ta
b8186"
        test_1        |             ORDER BY
        test_1        |                 col13490 NULLS FIRST, c😐ol13491 ASC, "col 13492" ASC NULLS LAST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         NULL::RECORD AS col13490,
        test_1        |                         '2000-01-01 06:00:00':::TIMESTAMP::TIMESTAMP AS c😐ol13491,
        test_1        |                         regproc(6:::OID::OID::OID)::REGPROC AS "col 13492"
        test_1        |                 )
        test_1        |                     AS "ta
b8186"
        test_1        |             ORDER BY
        test_1        |                 col13490 NULLS FIRST, c😐ol13491 ASC, "col 13492" ASC NULLS LAST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (38.59s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 053c8840acc20191ffa05ba42af0fc213d627915:

        postgres_1    |     ORDER BY
        postgres_1    |         "co l7210",
        postgres_1    |         "c ol'7211" ASC,
        postgres_1    |         col7212 NULLS FIRST,
        postgres_1    |         col7213 NULLS FIRST,
        postgres_1    |         col7214 NULLS FIRST,
        postgres_1    |         col7215 NULLS LAST,
        postgres_1    |         col7216 DESC NULLS LAST,
        postgres_1    |         col😹7217 ASC
        test_1        | --- FAIL: TestCompare (9.95s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/mutators (0.58s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "{table1" ("col1%v_ 0" INT8 NOT NULL, col1_1 STRING COLLATE da NOT NULL, col1_2 FLOAT4 NOT NULL, col1_3 REGCLASS NOT NULL, col1_4 BIT(45) NOT NULL, PRIMARY KEY (col1_2 DESC, "col1%v_ 0" ASC, col1_3 ASC, col1_4 DESC, col1_1 DESC), INDEX ("col1%v_ 0") WHERE ("{table1".col1_2 != 1.401298464324817e-45:::FLOAT8) AND ("{table1"."col1%v_ 0" < 2147483647:::INT8), UNIQUE (col1_3 DESC, col1_2, "col1%v_ 0" ASC) WHERE ("{table1"."col1%v_ 0" = (-9223372036854775807):::INT8) OR ("{table1".col1_2 < '+Inf':::FLOAT8), INDEX (col1_2 DESC, col1_1 ASC, col1_3 ASC, lower(CAST(col1_4 AS STRING)) ASC, "col1%v_ 0" ASC) WHERE ("{table1".col1_2 > 0.0:::FLOAT8) AND ("{table1"."col1%v_ 0" >= 2147483647:::INT8), UNIQUE (col1_4 DESC, ("col1%v_ 0" + 7200272035788452860:::INT8) DESC, col1_3 DESC), UNIQUE (col1_4 ASC, col1_2 DESC, col1_3, "col1%v_ 0" DESC, col1_1), FAMILY ("col1%v_ 0"), FAMILY (col1_1, col1_2), FAMILY (col1_3, col1_4));
        test_1        |             ALTER TABLE "{table1" INJECT STATISTICS e'[{"avg_size": 14, "columns": ["\\"col1%v_ 0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 29380907, "histo_buckets": [{"distinct_range": 0, "num_eq": 10000000, "num_range": 0, "upper_bound": "-9101709789375958436"}, {"distinct_range": 5890075694295951000, "num_eq": 8424108957054115787, "num_range": 8523110402539370316, "upper_bound": "-8277124378343972618"}, {"distinct_range": 600000, "num_eq": 2000, "num_range": 600000, "upper_bound": "-1824223320578088288"}, {"distinct_range": 1341014410542724900, "num_eq": 700000000, "num_range": 2068983514715697329, "upper_bound": "6380690204833768829"}, {"distinct_range": 0, "num_eq": 4567948557898644454, "num_range": 8169717055551344160, "upper_bound": "8299752226959827895"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 14, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 33246902, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 14, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 29544245, "histo_buckets": [{"distinct_range": 0, "num_eq": 20000000000, "num_range": 0, "upper_bound": "-0.7078725099563599"}, {"distinct_range": 3770993304186937300, "num_eq": 70000, "num_range": 5260353121990788375, "upper_bound": "0.5988180041313171"}, {"distinct_range": 3167803588673929000, "num_eq": 0, "num_range": 3982922675155877189, "upper_bound": "0.7563174962997437"}, {"distinct_range": 60000, "num_eq": 3253656106509150662, "num_range": 60000, "upper_bound": "0.9333555698394775"}, {"distinct_range": 0, "num_eq": 80000000000, "num_range": 3000000, "upper_bound": "1.1560983657836914"}, {"distinct_range": 2931049449.0166063, "num_eq": 300000, "num_range": 80000000000, "upper_bound": "1.4890408515930176"}, {"distinct_range": 0, "num_eq": 1000, "num_range": 200000, "upper_bound": "1.8457311391830444"}], "histo_col_type": "FLOAT4", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 5, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 30447397, "histo_buckets": [{"distinct_range": 0, "num_eq": 6000000000, "num_range": 0, "upper_bound": "1209559558"}, {"distinct_range": 2402351833664707000, "num_eq": 4000000, "num_range": 4529620333641621394, "upper_bound": "1282078633"}, {"distinct_range": 4257943875125481500, "num_eq": 8000, "num_range": 4257943875125481511, "upper_bound": "1424961884"}, {"distinct_range": 343394612160032400, "num_eq": 1000, "num_range": 994998548078258821, "upper_bound": "2314455045"}, {"distinct_range": 0, "num_eq": 3000, "num_range": 70, "upper_bound": "2456441006"}, {"distinct_range": 20000, "num_eq": 10000, "num_range": 20000, "upper_bound": "2623178125"}, {"distinct_range": 0, "num_eq": 3000000000, "num_range": 60000000, "upper_bound": "2729878009"}, {"distinct_range": 2340460580213683700, "num_eq": 1000000000, "num_range": 4209853987297813970, "upper_bound": "4144462753"}], "histo_col_type": "REGCLASS", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 4, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 529987, "histo_buckets": [{"distinct_range": 0, "num_eq": 100000, "num_range": 0, "upper_bound": "001101100010111101111101010100101001111011101"}, {"distinct_range": 4790123018945506000, "num_eq": 3765429535722217181, "num_range": 7250001321116091786, "upper_bound": "110011010111001011100001110011011111011111000"}, {"distinct_range": 0, "num_eq": 5554871035889738191, "num_range": 700000000, "upper_bound": "110100110001100101010001100110111000101001100"}, {"distinct_range": 3565712302845130000, "num_eq": 0, "num_range": 3565712302845130489, "upper_bound": "111010010110100010110100000011101101101001001"}], "histo_col_type": "BIT(45)", "name": "__auto__", "null_count": 0, "row_count": 40000000}]':::JSONB;
        test_1        |             ALTER TABLE "{table1" INJECT STATISTICS e'[{"avg_size": 22, "columns": ["\\"col1%v_ 0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 765, "histo_buckets": [{"distinct_range": 0, "num_eq": 500, "num_range": 0, "upper_bound": "-9089461658109727284"}, {"distinct_range": 1000000000, "num_eq": 5000000, "num_range": 1000000000, "upper_bound": "-1844950236778925346"}, {"distinct_range": 5612730641314966000, "num_eq": 8000000000, "num_range": 5612730641314965481, "upper_bound": "-128"}, {"distinct_range": 0, "num_eq": 1100183177875733597, "num_range": 700000000, "upper_bound": "910981225638399969"}, {"distinct_range": 0, "num_eq": 7262204702373944992, "num_range": 2217892298079389973, "upper_bound": "3664905180017976562"}, {"distinct_range": 48980.108463999204, "num_eq": 6491164122733443393, "num_range": 200000, "upper_bound": "7416984397571017565"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 6, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 867, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 25, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 94, "histo_buckets": [{"distinct_range": 0, "num_eq": 100000, "num_range": 0, "upper_bound": "-1.0736500024795532"}, {"distinct_range": 2136735598230374000, "num_eq": 200, "num_range": 3935224753672147336, "upper_bound": "-1.0"}, {"distinct_range": 8000000, "num_eq": 1090490355353513853, "num_range": 8000000, "upper_bound": "-0.47839659452438354"}, {"distinct_range": 0, "num_eq": 2031659650735082323, "num_range": 0, "upper_bound": "-0.4295627772808075"}, {"distinct_range": 9931274652.286816, "num_eq": 1538142583731438047, "num_range": 10000000000, "upper_bound": "0.0"}, {"distinct_range": 4900391520372564000, "num_eq": 40, "num_range": 5923726837983038494, "upper_bound": "1.401298464324817e-45"}, {"distinct_range": 3335867500492783000, "num_eq": 2889637707034794081, "num_range": 3335867500492782970, "upper_bound": "0.12239775061607361"}, {"distinct_range": 4504923548409146400, "num_eq": 30000, "num_range": 4504923548409146485, "upper_bound": "0.44724005460739136"}, {"distinct_range": 18871.535114932798, "num_eq": 1000000000, "num_range": 40000, "upper_bound": "1.3659495115280151"}], "histo_col_type": "FLOAT4", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 23, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 109, "histo_buckets": [{"distinct_range": 0, "num_eq": 8477270100923845963, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 8162051492023726000, "num_eq": 1527320495556868976, "num_range": 8162051492023725919, "upper_bound": "115223733"}, {"distinct_range": 2614503852015819000, "num_eq": 10, "num_range": 2614503852015818572, "upper_bound": "261719071"}, {"distinct_range": 6035582675043592000, "num_eq": 5000000000, "num_range": 6035582675043592117, "upper_bound": "688282707"}, {"distinct_range": 0, "num_eq": 1449903076588665940, "num_range": 9000, "upper_bound": "2112883848"}, {"distinct_range": 0, "num_eq": 6435901436453225916, "num_range": 0, "upper_bound": "2621785831"}, {"distinct_range": 0, "num_eq": 667509251790070489, "num_range": 100000000, "upper_bound": "2696050009"}, {"distinct_range": 20000000, "num_eq": 300000000, "num_range": 20000000, "upper_bound": "4235465982"}], "histo_col_type": "REGCLASS", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 22, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 699, "histo_buckets": [{"distinct_range": 0, "num_eq": 2000, "num_range": 0, "upper_bound": "100110001011001010001011011011110010001010011"}], "histo_col_type": "BIT(45)", "name": "__auto__", "null_count": 0, "row_count": 900}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        |     --- FAIL: TestCompare/postgres (6.25s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare735823408/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare postgres to cockroach1: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("9"),
        test_1        |             +   string("array_agg"),
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT * FROM (SELECT regprocedure(9::OID::OID::OID)::REGPROCEDURE AS col7259) AS tab3649 ORDER BY col7259 ASC;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT * FROM (SELECT regprocedure(9:::OID::OID::OID)::REGPROCEDURE AS col7259) AS tab3649 ORDER BY col7259 ASC;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (32.94s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ f1a130b93c47ddd9a11408d23f48cb6ee96eb38e:

        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-27 05:18:29.820 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-27 05:18:29.820 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-27 05:18:29.820 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-27 05:18:29.823 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-27 05:18:29.828 UTC [68] LOG:  database system was shut down at 2023-04-27 05:18:29 UTC
        postgres_1    | 2023-04-27 05:18:29.833 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-27 05:18:32.453 UTC [78] ERROR:  collation "da" for encoding "UTF8" does not exist at character 58
        postgres_1    | 2023-04-27 05:18:32.453 UTC [78] STATEMENT:  CREATE TABLE "ta ble2" (col2_0 VARCHAR NULL, col2_1 TEXT COLLATE da, "c'ol2_2" TEXT COLLATE de NOT NULL, col2_3 TSVECTOR NOT NULL, "col2_%q4" TEXT NULL GENERATED ALWAYS AS (lower(col2_0)) STORED, col2_5 TEXT NULL GENERATED ALWAYS AS (lower(col2_0)) STORED);
        postgres_1    |     CREATE UNIQUE INDEX ON "ta ble2" ("c'ol2_2" DESC) INCLUDE (col2_1, col2_3);
        postgres_1    |     CREATE INDEX ON "ta ble2" (lower(CAST(col2_1 AS TEXT)) ASC, col2_0, "c'ol2_2" ASC, lower(CAST("c'ol2_2" AS TEXT)), lower(col2_0) ASC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.88s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/mutators (0.51s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 REGCLASS, "col\\U000FEF671_1" REGROLE NULL, " col1_2" TIME NOT NULL, "col1_%q3" DECIMAL, col1_4 TIMETZ NOT NULL, col1_5 NAME NULL, col1_6 TIMESTAMP NOT NULL, col1_7 BYTES, "c̲😩ol1'_8" TIMETZ NULL, "col1%bc_😼9" GEOGRAPHY NOT NULL, "col 1_10" GEOGRAPHY NOT NULL, col1_11 INET NOT NULL, col1_12 BIT(26) NOT NULL, "c\rol1_13" STRING AS (CASE WHEN col1_0 IS NULL THEN 'Bst':::STRING ELSE e'\x16\x18"2g':::STRING END) VIRTUAL, col1_14 DECIMAL AS ("col1_%q3" + (-5294952227260724615):::DECIMAL) VIRTUAL, "col1_ 15" STRING NOT NULL AS (lower(CAST(col1_11 AS STRING))) STORED, INDEX ("col1_%q3" DESC, col1_6, "col\\U000FEF671_1" DESC, col1_7, (CASE WHEN col1_7 IS NULL THEN e'\x01':::STRING ELSE e'\x12i \x1fMtb':::STRING END) ASC, col1_11) WHERE (((((((((table1.col1_6 != '3000-01-01 00:00:00':::TIMESTAMP) AND (table1." col1_2" >= '00:00:00':::TIME)) AND (table1."col1_%q3" >= (-1.234E+401):::DECIMAL)) AND (table1.col1_5 >= 'X':::STRING:::NAME)) AND (table1."c̲😩ol1'_8" < '00:00:00+15:59':::TIMETZ)) OR (table1.col1_7 <= e'\\x22':::BYTES)) AND (table1.col1_4 != '24:00:00-15:59':::TIMETZ)) OR (table1.col1_14 > 'NaN':::DECIMAL)) AND (table1."col1_ 15" < 'X':::STRING)) OR (table1."c\rol1_13" >= '"':::STRING), INVERTED INDEX ("col1_ 15" ASC, "col 1_10" ASC), INDEX (col1_14 DESC, col1_7 ASC, "col1_%q3", col1_12, col1_5 ASC, lower(CAST(" col1_2" AS STRING)), col1_11 ASC, ("col1_%q3" + 2.948485456025249244:::DECIMAL), col1_0 DESC, "c\rol1_13" DESC) STORING ("col\\U000FEF671_1", " col1_2", "col1%bc_😼9", "col 1_10", "col1_ 15") WHERE (((((((((table1."c\rol1_13" != e'\x00':::STRING) OR (table1."col1_ 15" = e'\x00':::STRING)) AND (table1.col1_5 < '':::STRING:::NAME)) AND (table1."c̲😩ol1'_8" < '24:00:00-15:59':::TIMETZ)) OR (table1.col1_7 <= '\x00':::BYTES)) AND (table1.col1_14 <= (-1.234E+401):::DECIMAL)) AND (table1." col1_2" <= '24:00:00':::TIME)) OR (table1."col1_%q3" < (-1.234E+401):::DECIMAL)) OR (table1.col1_6 != '294276-12-31 23:59:59.999999':::TIMESTAMP)) AND (table1.col1_4 >= '00:00:00+15:59':::TIMETZ), FAMILY (col1_5, " col1_2", col1_7), FAMILY ("col 1_10", col1_11, "c̲😩ol1'_8"), FAMILY ("col1_%q3", col1_4, col1_6, col1_0, "col\\U000FEF671_1"), FAMILY ("col1_ 15"), FAMILY ("col1%bc_😼9", col1_12));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 31, "columns": ["\\"col\\\\\\\\U000FEF671_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 774608466478838289, "histo_col_type": "", "name": "__auto__", "null_count": 879362488608801214, "row_count": 1458118234753887546}, {"avg_size": 30, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 511002050786141626, "histo_col_type": "", "name": "__auto__", "null_count": 171416372646349688, "row_count": 1458118234753887546}, {"avg_size": 8, "columns": ["\\"col1%bc_\U0001F63C9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 864706603090294570, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1458118234753887546}, {"avg_size": 29, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 78292712166489036, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1458118234753887546}, {"avg_size": 16, "columns": ["\\"col1_ 15\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1017201946262155744, "histo_buckets": [{"distinct_range": 0, "num_eq": 500000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 1069972592470220300, "num_eq": 40000, "num_range": 3062437286073677049, "upper_bound": "%"}, {"distinct_range": 0, "num_eq": 90000, "num_range": 10000, "upper_bound": "3"}, {"distinct_range": 100000000, "num_eq": 200, "num_range": 100000000, "upper_bound": "H4A"}, {"distinct_range": 0, "num_eq": 4594482279187237504, "num_range": 1373626059771926411, "upper_bound": "IL%YR"}, {"distinct_range": 0, "num_eq": 50, "num_range": 7935958880905097774, "upper_bound": "]2#\\u001f\\\\,w#"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 1458118234753887546}, {"avg_size": 23, "columns": ["\\"col1_%q3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1287897043624151537, "histo_buckets": [{"distinct_range": 0, "num_eq": 80000000000, "num_range": 0, "upper_bound": "-8.238708785862897061E+32"}], "histo_col_type": "DECIMAL", "name": "__auto__", "null_count": 989891229364534578, "row_count": 1458118234753887546}, {"avg_size": 6, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 818159505363479254, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1458118234753887546}, {"avg_size": 25, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 808434360600498060, "histo_col_type": "", "name": "__auto__", "null_count": 230518760834955456, "row_count": 1458118234753887546}, {"avg_size": 1, "columns": ["\\" col1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 465556946161429230, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1458118234753887546}, {"avg_size": 19, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 749221847349547592, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1458118234753887546}, {"avg_size": 18, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1330723427053269861, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1458118234753887546}, {"avg_size": 31, "columns": ["\\"c\\\\rol1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1120333758295698981, "histo_col_type": "", "name": "__auto__", "null_count": 678837505915331963, "row_count": 1458118234753887546}, {"avg_size": 12, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 474273397251681493, "histo_buckets": [{"distinct_range": 0, "num_eq": 417571166394557047, "num_range": 0, "upper_bound": "-1.234E+401"}, {"distinct_range": 564956750323486140, "num_eq": 5015856511815272722, "num_range": 2142031644749337817, "upper_bound": "-6.293508603763205449E+19"}, {"distinct_range": 914136653774155800, "num_eq": 8318210266615885086, "num_range": 914136653774155751, "upper_bound": "-5352500660815.153503"}, {"distinct_range": 700000, "num_eq": 2693162868292064730, "num_range": 700000, "upper_bound": "-5796931.827991622365"}, {"distinct_range": 13451715.073419675, "num_eq": 9000000000, "num_range": 30000000, "upper_bound": "83.470228697300387"}, {"distinct_range": 12.68454913774272, "num_eq": 300000, "num_range": 40, "upper_bound": "3.859538359233744747E+30"}, {"distinct_range": 2088622675714961400, "num_eq": 8640925030547157762, "num_range": 2088622675714961286, "upper_bound": "1.849436574157567426E+35"}, {"distinct_range": 700000, "num_eq": 7673267858324020686, "num_range": 700000, "upper_bound": "7.804560050968279007E+35"}], "histo_col_type": "DECIMAL", "name": "__auto__", "null_count": 619677325017376554, "row_count": 1458118234753887546}, {"avg_size": 25, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 196386448690793217, "histo_col_type": "", "name": "__auto__", "null_count": 189290012857342839, "row_count": 1458118234753887546}, {"avg_size": 30, "columns": ["\\"c\u0332\U0001F629ol1\'_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 446984059958704159, "histo_col_type": "", "name": "__auto__", "null_count": 407433013636388057, "row_count": 1458118234753887546}, {"avg_size": 19, "columns": ["\\"col 1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 976765755588125342, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1458118234753887546}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 21, "columns": ["\\" col1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 1, "columns": ["\\"col1_ 15\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 41, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 12, "columns": ["\\"col1_%q3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 64, "histo_buckets": [{"distinct_range": 0, "num_eq": 70, "num_range": 0, "upper_bound": "-87184787001251.7146"}, {"distinct_range": 455.8145419570192, "num_eq": 5677179521067564245, "num_range": 500, "upper_bound": "0"}, {"distinct_range": 0, "num_eq": 5497655217141542088, "num_range": 1000000, "upper_bound": "332.4419144862145006"}, {"distinct_range": 0, "num_eq": 6000000, "num_range": 2375114298286663694, "upper_bound": "2717.559139380133602"}, {"distinct_range": 0, "num_eq": 6000000000, "num_range": 0, "upper_bound": "57294763164548622.45"}, {"distinct_range": 204.27221431571863, "num_eq": 8648919305341690083, "num_range": 300, "upper_bound": "8.494170695205370711E+20"}], "histo_col_type": "DECIMAL", "name": "__auto__", "null_count": 66, "row_count": 70}, {"avg_size": 4, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 26, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 8, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 69, "histo_col_type": "", "name": "__auto__", "null_count": 35, "row_count": 70}, {"avg_size": 7, "columns": ["\\"col 1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 49, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 25, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 12, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 49, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 12, "columns": ["\\"c\\\\rol1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 66, "histo_col_type": "", "name": "__auto__", "null_count": 2, "row_count": 70}, {"avg_size": 6, "columns": ["\\"col\\\\\\\\U000FEF671_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 69, "histo_col_type": "", "name": "__auto__", "null_count": 19, "row_count": 70}, {"avg_size": 29, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 43, "histo_col_type": "", "name": "__auto__", "null_count": 36, "row_count": 70}, {"avg_size": 8, "columns": ["\\"col1%bc_\U0001F63C9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 44, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 17, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 44, "histo_buckets": [{"distinct_range": 0, "num_eq": 600, "num_range": 0, "upper_bound": "-7.263119848180368192E+37"}, {"distinct_range": 167081.30654764216, "num_eq": 4610497988249659188, "num_range": 1000000, "upper_bound": "-9.25359003434440755E+33"}, {"distinct_range": 4052244536.746827, "num_eq": 90000000000, "num_range": 7000000000, "upper_bound": "1"}, {"distinct_range": 19.34098538532064, "num_eq": 10000000000, "num_range": 90, "upper_bound": "8489918522.852680498"}, {"distinct_range": 0, "num_eq": 2000, "num_range": 8088429719889758698, "upper_bound": "49315381441326.89914"}, {"distinct_range": 100000, "num_eq": 7573407401643840874, "num_range": 100000, "upper_bound": "8.354103462181130772E+32"}], "histo_col_type": "DECIMAL", "name": "__auto__", "null_count": 20, "row_count": 70}, {"avg_size": 5, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 10, "histo_col_type": "", "name": "__auto__", "null_count": 18, "row_count": 70}, {"avg_size": 8, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 24, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 17, "columns": ["\\"c\u0332\U0001F629ol1\'_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 9, "histo_col_type": "", "name": "__auto__", "null_count": 69, "row_count": 70}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        |     --- FAIL: TestCompare/postgres (1.24s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "ta ble2" (col2_0 VARCHAR NULL, col2_1 TEXT COLLATE da, "c'ol2_2" TEXT COLLATE de NOT NULL, col2_3 TSVECTOR NOT NULL, "col2_%q4" TEXT NULL GENERATED ALWAYS AS (lower(col2_0)) STORED, col2_5 TEXT NULL GENERATED ALWAYS AS (lower(col2_0)) STORED);
        test_1        |             CREATE UNIQUE INDEX ON "ta ble2" ("c'ol2_2" DESC) INCLUDE (col2_1, col2_3);
        test_1        |             CREATE INDEX ON "ta ble2" (lower(CAST(col2_1 AS TEXT)) ASC, col2_0, "c'ol2_2" ASC, lower(CAST("c'ol2_2" AS TEXT)), lower(col2_0) ASC);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "da" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.74s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ c227c00ea38887929aecdeb400a4d1104eb9d7a8:

        test_1        |             postgres:
        test_1        |             SELECT * FROM (SELECT regproc(3::INT8::INT4::INT4)::REGPROC AS col478) AS tab313 ORDER BY col478 NULLS FIRST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (1.02s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "ta
        test_1        |             ble1" ("cOl1_͐0" VARCHAR NOT NULL, col1_1 TIMESTAMPTZ NULL, "col1_%ec2" INT4 NOT NULL, col̄1_3 STRING COLLATE da NOT NULL, col1_4 INT4, "co�l1_5" CHAR NOT NULL, col1_6 DATE NOT NULL, col1_7 TSQUERY NOT NULL, col1_8 BIT(7) NOT NULL, "col1%v_9" STRING NOT NULL AS (lower(CAST(col̄1_3 AS STRING))) STORED, col1_10 INT8 NOT NULL AS ("col1_%ec2" + 2048977439:::INT8) STORED, "col%q1_11" INT8 AS (col1_4 + (-669598653):::INT8) VIRTUAL, col1_12 STRING NOT NULL AS (lower("co�l1_5")) VIRTUAL, c😭ol1_13 INT8 NOT NULL AS ("col1_%ec2" + (-943773815):::INT8) VIRTUAL, INDEX (col1_8) STORING ("cOl1_͐0", col1_1, col̄1_3, col1_4, "co�l1_5", col1_6, "col1%v_9") WHERE (((((((((("ta
        test_1        |             ble1".col1_1 != '0001-01-01 00:00:00+00':::TIMESTAMPTZ) OR ("ta
        test_1        |             ble1".col1_12 >= e'\x00':::STRING)) AND ("ta
        test_1        |             ble1"."col1_%ec2" != (-1):::INT8)) AND ("ta
        test_1        |             ble1".c😭ol1_13 > (-9223372036854775807):::INT8)) AND ("ta
        test_1        |             ble1".col1_10 > (-32768):::INT8)) AND ("ta
        test_1        |             ble1"."co�l1_5" != '':::STRING)) OR ("ta
        test_1        |             ble1"."col%q1_11" > (-32768):::INT8)) OR ("ta
        test_1        |             ble1"."cOl1_͐0" = 'X':::STRING)) AND ("ta
        test_1        |             ble1".col1_4 < 1:::INT8)) AND ("ta
        test_1        |             ble1".col1_6 >= '1970-01-01':::DATE)) OR ("ta
        test_1        |             ble1"."col1%v_9" = '':::STRING), INDEX ("col1_%ec2" ASC, (col1_4 + "col1_%ec2"), "col%q1_11" ASC, col1_8, col̄1_3 ASC, "col1%v_9" DESC, col1_6 DESC), INDEX (c😭ol1_13 DESC, "col%q1_11" ASC, lower("co�l1_5") ASC, col̄1_3) STORING (col1_1, "col1_%ec2", col1_8) WHERE (((((((((("ta
        test_1        |             ble1".col1_6 != '5874897-12-31':::DATE) AND ("ta
        test_1        |             ble1"."cOl1_͐0" = 'X':::STRING)) OR ("ta
        test_1        |             ble1".c😭ol1_13 >= (-1):::INT8)) AND ("ta
        test_1        |             ble1"."col1%v_9" <= '"':::STRING)) AND ("ta
        test_1        |             ble1".col1_4 = 0:::INT8)) OR ("ta
        test_1        |             ble1"."co�l1_5" = '"':::STRING)) AND ("ta
        test_1        |             ble1"."col%q1_11" >= 2147483647:::INT8)) OR ("ta
        test_1        |             ble1".col1_1 > '3000-01-01 00:00:00+00':::TIMESTAMPTZ)) OR ("ta
        test_1        |             ble1"."col1_%ec2" != (-1):::INT8)) AND ("ta
        test_1        |             ble1".col1_12 >= e'\'':::STRING)) OR ("ta
        test_1        |             ble1".col1_10 >= (-2147483648):::INT8), UNIQUE (col1_8, col1_1, col1_10 ASC, col1_12, col1_4, "cOl1_͐0" ASC, "col%q1_11", (col1_4 + "col1_%ec2"), "col1%v_9" ASC, c😭ol1_13 ASC) STORING (col̄1_3, "co�l1_5") WHERE "ta
        test_1        |             ble1".col1_10 < 2147483647:::INT8, FAMILY ("co�l1_5"), FAMILY (col1_8), FAMILY (col1_4), FAMILY (col1_10), FAMILY ("cOl1_͐0", col1_7), FAMILY ("col1_%ec2", col1_6, "col1%v_9", col1_1), FAMILY (col̄1_3));
        test_1        |             ALTER TABLE "ta
        test_1        |             ble1" INJECT STATISTICS e'[{"avg_size": 0, "columns": ["\\"cOl1_\u03500\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col\u03041_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 200, "num_range": 0, "upper_bound": "0010101"}, {"distinct_range": 10000000000, "num_eq": 800000, "num_range": 10000000000, "upper_bound": "0010110"}, {"distinct_range": 8872830796128078000, "num_eq": 5000000, "num_range": 8872830796128078223, "upper_bound": "0111111"}, {"distinct_range": 700000, "num_eq": 700, "num_range": 700000, "upper_bound": "1001010"}, {"distinct_range": 0, "num_eq": 30000, "num_range": 3722264433879533310, "upper_bound": "1010100"}, {"distinct_range": 2074311563.1569607, "num_eq": 700000000, "num_range": 6000000000, "upper_bound": "1011010"}, {"distinct_range": 0, "num_eq": 1000000, "num_range": 800000, "upper_bound": "1011101"}, {"distinct_range": 3672661026735080400, "num_eq": 0, "num_range": 8948816225366646155, "upper_bound": "1011111"}], "histo_col_type": "BIT(7)", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["c\U0001F62Dol1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 6739108653554448389, "num_range": 0, "upper_bound": "-8842743545537420560"}, {"distinct_range": 0, "num_eq": 300, "num_range": 1000000000, "upper_bound": "-5505581580303815578"}, {"distinct_range": 1371184653983353600, "num_eq": 30000, "num_range": 3416743461232304547, "upper_bound": "-4525643776210400041"}, {"distinct_range": 596607.7385870357, "num_eq": 4164486471859457054, "num_range": 1000000, "upper_bound": "-2575253253609223956"}, {"distinct_range": 2075201652356578000, "num_eq": 900000000, "num_range": 2075201652356578019, "upper_bound": "47569470895018676"}, {"distinct_range": 1945901.6153999593, "num_eq": 5690063766438613143, "num_range": 8000000, "upper_bound": "226801327690048200"}, {"distinct_range": 1492952108490186800, "num_eq": 20000000, "num_range": 5456086746445412759, "upper_bound": "2935090719102357447"}, {"distinct_range": 0, "num_eq": 50000000000, "num_range": 600000, "upper_bound": "8569586025198907819"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col1_%ec2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 40, "num_range": 0, "upper_bound": "-1978490865"}, {"distinct_range": 0, "num_eq": 300, "num_range": 6753941787159768379, "upper_bound": "-1639638367"}, {"distinct_range": 2378035306605044700, "num_eq": 70000000000, "num_range": 7451282502645569264, "upper_bound": "-1051582601"}, {"distinct_range": 94041.23231750108, "num_eq": 0, "num_range": 100000, "upper_bound": "-750724157"}, {"distinct_range": 0, "num_eq": 8810650619954745221, "num_range": 6323915386688208786, "upper_bound": "391638171"}, {"distinct_range": 40000000, "num_eq": 2201310246362040037, "num_range": 40000000, "upper_bound": "921563326"}, {"distinct_range": 0, "num_eq": 4251202824085231739, "num_range": 0, "upper_bound": "1762813044"}], "histo_col_type": "INT4", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"co\\u000cl1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col1%v_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col%q1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}]':::JSONB;
        test_1        |             ALTER TABLE "ta
        test_1        |             ble1" INJECT STATISTICS e'[{"avg_size": 1, "columns": ["\\"cOl1_\u03500\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2789214105639874767, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4136817293612055948}, {"avg_size": 21, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1253433198832344580, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4136817293612055948}, {"avg_size": 12, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 936686136143038239, "histo_col_type": "BIT(7)", "name": "__auto__", "null_count": 0, "row_count": 4136817293612055948}, {"avg_size": 18, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3505411182583159023, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4136817293612055948}, {"avg_size": 3, "columns": ["c\U0001F62Dol1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 934308874861971112, "histo_buckets": [{"distinct_range": 0, "num_eq": 4290305597570315083, "num_range": 0, "upper_bound": "-8467605276874659500"}, {"distinct_range": 100000, "num_eq": 5000000000, "num_range": 100000, "upper_bound": "-8386473398424073224"}, {"distinct_range": 4909087143200291000, "num_eq": 400000000, "num_range": 4909087143200290376, "upper_bound": "-7641840086005004504"}, {"distinct_range": 2443890746787941400, "num_eq": 70000000, "num_range": 2712111614023778855, "upper_bound": "-6799756109875086937"}, {"distinct_range": 9023987230551269000, "num_eq": 40000, "num_range": 9023987230551269256, "upper_bound": "-6372498583974980759"}, {"distinct_range": 0, "num_eq": 1814376896805077626, "num_range": 1782488905682666235, "upper_bound": "-5834577669685868862"}, {"distinct_range": 0, "num_eq": 100000, "num_range": 60000000, "upper_bound": "3206516741186869350"}, {"distinct_range": 1033893222504558500, "num_eq": 7000, "num_range": 3462936654000385663, "upper_bound": "3753320278619961015"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 4136817293612055948}, {"avg_size": 26, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3335111009459302556, "histo_col_type": "", "name": "__auto__", "null_count": 3154039920140336918, "row_count": 4136817293612055948}, {"avg_size": 13, "columns": ["\\"col1_%ec2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3143359943338327758, "histo_buckets": [{"distinct_range": 0, "num_eq": 8000000000, "num_range": 0, "upper_bound": "-1116192361"}, {"distinct_range": 7000000000, "num_eq": 2580987545116044814, "num_range": 7000000000, "upper_bound": "782271601"}, {"distinct_range": 3319628364.3786583, "num_eq": 8213902348134075434, "num_range": 4000000000, "upper_bound": "1014624535"}], "histo_col_type": "INT4", "name": "__auto__", "null_count": 0, "row_count": 4136817293612055948}, {"avg_size": 18, "columns": ["col\u03041_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1985415983369619509, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4136817293612055948}, {"avg_size": 16, "columns": ["\\"co\\u000cl1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 38214190220227840, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4136817293612055948}, {"avg_size": 6, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1941410455185693704, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4136817293612055948}, {"avg_size": 12, "columns": ["\\"col1%v_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2793363672021148619, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4136817293612055948}, {"avg_size": 2, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3321146714524624229, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4136817293612055948}, {"avg_size": 21, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2500821405422162170, "histo_col_type": "", "name": "__auto__", "null_count": 1363588406763790172, "row_count": 4136817293612055948}, {"avg_size": 5, "columns": ["\\"col%q1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1516262456939456491, "histo_col_type": "", "name": "__auto__", "null_count": 211187533179481376, "row_count": 4136817293612055948}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (23.02s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 344d752c483d39dedf7e2282932aa83b30301607:

        postgres_1    | 2023-04-29 05:18:35.278 UTC [77] ERROR:  collation "de" for encoding "UTF8" does not exist at character 89
        postgres_1    | 2023-04-29 05:18:35.278 UTC [77] STATEMENT:  CREATE TABLE table3 ("col%v3\r🙂_0" INT8 NOT NULL, "col�3_1" TIME NOT NULL, col3😟_2 TEXT COLLATE de NOT NULL, " col3_3" CHAR NOT NULL, col3_4 INT2 NOT NULL, "col3_%v5" INT8 NOT NULL GENERATED ALWAYS AS (col3_4 + "col%v3\r🙂_0") STORED, PRIMARY KEY (" col3_3", "col%v3\r🙂_0", "col�3_1"));
        postgres_1    |     CREATE UNIQUE INDEX ON table3 ((col3_4 + "col%v3\r🙂_0") DESC, "col�3_1" ASC, " col3_3" ASC, "col3_%v5" ASC, col3_4 ASC, lower(CAST(col3😟_2 AS TEXT)));
        postgres_1    |     CREATE INDEX ON table3 (col3_4 ASC, "col3_%v5" DESC, "col�3_1", col3😟_2 ASC, "col%v3\r🙂_0" DESC);
        postgres_1    |     CREATE INDEX ON table3 ("col�3_1" ASC, col3😟_2 ASC, " col3_3", "col%v3\r🙂_0", lower(CAST(col3😟_2 AS TEXT)) DESC, col3_4 DESC);
        postgres_1    |     CREATE UNIQUE INDEX ON table3 (col3_4 DESC, "col�3_1" ASC, "col%v3\r🙂_0", " col3_3", "col3_%v5" DESC, lower(" col3_3") ASC) INCLUDE (col3😟_2);
        postgres_1    |     CREATE UNIQUE INDEX ON table3 (col3_4, " col3_3", "col3_%v5" ASC) INCLUDE (col3😟_2);
        postgres_1    |     CREATE UNIQUE INDEX ON table3 ("col3_%v5", " col3_3" DESC, "col%v3\r🙂_0" DESC, "col�3_1" DESC, col3😟_2 ASC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.87s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.02s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table3 ("col%v3\r🙂_0" INT8 NOT NULL, "col�3_1" TIME NOT NULL, col3😟_2 TEXT COLLATE de NOT NULL, " col3_3" CHAR NOT NULL, col3_4 INT2 NOT NULL, "col3_%v5" INT8 NOT NULL GENERATED ALWAYS AS (col3_4 + "col%v3\r🙂_0") STORED, PRIMARY KEY (" col3_3", "col%v3\r🙂_0", "col�3_1"));
        test_1        |             CREATE UNIQUE INDEX ON table3 ((col3_4 + "col%v3\r🙂_0") DESC, "col�3_1" ASC, " col3_3" ASC, "col3_%v5" ASC, col3_4 ASC, lower(CAST(col3😟_2 AS TEXT)));
        test_1        |             CREATE INDEX ON table3 (col3_4 ASC, "col3_%v5" DESC, "col�3_1", col3😟_2 ASC, "col%v3\r🙂_0" DESC);
        test_1        |             CREATE INDEX ON table3 ("col�3_1" ASC, col3😟_2 ASC, " col3_3", "col%v3\r🙂_0", lower(CAST(col3😟_2 AS TEXT)) DESC, col3_4 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_4 DESC, "col�3_1" ASC, "col%v3\r🙂_0", " col3_3", "col3_%v5" DESC, lower(" col3_3") ASC) INCLUDE (col3😟_2);
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_4, " col3_3", "col3_%v5" ASC) INCLUDE (col3😟_2);
        test_1        |             CREATE UNIQUE INDEX ON table3 ("col3_%v5", " col3_3" DESC, "col%v3\r🙂_0" DESC, "col�3_1" DESC, col3😟_2 ASC);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "de" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.72s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 ("col1
        test_1        |             _0" REGROLE NULL, "c\\x63ol1_1" INTERVAL NOT NULL, col1_2 VARCHAR NOT NULL, cͅol1̏_3 JSONB NOT NULL, col1_4 VARCHAR NOT NULL, col1_5 STRING NOT NULL AS (CASE WHEN "c\\x63ol1_1" IS NULL THEN '':::STRING ELSE e',\b<?v_':::STRING END) STORED, col1_6 STRING NULL AS (CASE WHEN "col1
        test_1        |             _0" IS NULL THEN e'"QZ\x7f\nc(x{':::STRING ELSE e'D\x07':::STRING END) STORED, col1_ͅ7 STRING NOT NULL AS (lower(col1_4)) STORED, INVERTED INDEX (col1_5 ASC, cͅol1̏_3 ASC) WHERE ((table1.col1_4 != e'\U00002603':::STRING) AND (table1.col1_2 <= e'\x00':::STRING)) OR (table1.col1_ͅ7 = e'\x00':::STRING), INVERTED INDEX (cͅol1̏_3), FAMILY (col1_2, col1_5, "col1
        test_1        |             _0"), FAMILY (col1_ͅ7), FAMILY (cͅol1̏_3), FAMILY (col1_4), FAMILY (col1_6, "c\\x63ol1_1"));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 22, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 72118313, "histo_col_type": "", "name": "__auto__", "null_count": 174699637, "row_count": 400000000}, {"avg_size": 22, "columns": ["col1_\u03457"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 317538737, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000000}, {"avg_size": 6, "columns": ["\\"col1\\n_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 80534425, "histo_col_type": "", "name": "__auto__", "null_count": 375192743, "row_count": 400000000}, {"avg_size": 30, "columns": ["\\"c\\\\\\\\x63ol1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 26017126, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000000}, {"avg_size": 29, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 40203568, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000000}, {"avg_size": 31, "columns": ["c\u0345ol1\u030F_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5502662, "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 400000000}, {"avg_size": 12, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 60301585, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000000}, {"avg_size": 17, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 388505592, "histo_buckets": [{"distinct_range": 0, "num_eq": 8835995400446217765, "num_range": 0, "upper_bound": ""}, {"distinct_range": 73750470795.83334, "num_eq": 9100563352754722569, "num_range": 100000000000, "upper_bound": "\\""}, {"distinct_range": 0, "num_eq": 900000, "num_range": 8000000000, "upper_bound": "+$.\\u0006\\n&\\u0007O"}, {"distinct_range": 10, "num_eq": 50899487784496852, "num_range": 10, "upper_bound": "3\\u0010"}, {"distinct_range": 0, "num_eq": 90000000000, "num_range": 4000, "upper_bound": "="}, {"distinct_range": 0, "num_eq": 50, "num_range": 6067154587449166834, "upper_bound": "Kw\\u001f;<"}, {"distinct_range": 5000, "num_eq": 3021630114503093786, "num_range": 5000, "upper_bound": "S\\u0018Rg"}, {"distinct_range": 0, "num_eq": 4921446446867780182, "num_range": 3939069324603702534, "upper_bound": "khX<\\u0019IV\\u0012"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 400000000}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 22, "columns": ["\\"col1\\n_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 169955516, "histo_col_type": "", "name": "__auto__", "null_count": 91666223, "row_count": 200000000}, {"avg_size": 3, "columns": ["\\"c\\\\\\\\x63ol1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 83888717, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 200000000}, {"avg_size": 9, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 159795010, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 200000000}, {"avg_size": 6, "columns": ["c\u0345ol1\u030F_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 103862670, "histo_buckets": [{"distinct_range": 0, "num_eq": 300000000, "num_range": 0, "upper_bound": "\\\\x37000300010b"}, {"distinct_range": 511989380206891600, "num_eq": 8635783639657275957, "num_range": 3027123814651887239, "upper_bound": "\\\\x370003000112354f6c4459790001"}, {"distinct_range": 41308591.09960311, "num_eq": 1735896923827924296, "num_range": 100000000, "upper_bound": "\\\\x37000300012887fe4167016d33119b9000"}, {"distinct_range": 0, "num_eq": 2224286723579152328, "num_range": 6132472962555440577, "upper_bound": "\\\\x3700030001294377930bad730f6600"}, {"distinct_range": 20000, "num_eq": 3463220615412918694, "num_range": 20000, "upper_bound": "\\\\x370003000129616763410d9d958d6400"}, {"distinct_range": 0.4135757876001533, "num_eq": 400000000, "num_range": 40, "upper_bound": "\\\\x3700030003000100"}, {"distinct_range": 5256458461360686000, "num_eq": 2641344252596298723, "num_range": 5256458461360686237, "upper_bound": "\\\\x370003000300010b"}, {"distinct_range": 0, "num_eq": 8239117269097712037, "num_range": 0, "upper_bound": "\\\\x37000300030001126d6f72510001"}, {"distinct_range": 4825907024429198000, "num_eq": 6331912774702084720, "num_range": 6243984927504355007, "upper_bound": "\\\\x3700030003000129219583116b5ba77f8c00"}, {"distinct_range": 19412523.46536141, "num_eq": 7460736151183825283, "num_range": 30000000, "upper_bound": "\\\\x3700030003000129610545c33b75294d3c00"}, {"distinct_range": 61183.24687003246, "num_eq": 1000000000, "num_range": 100000, "upper_bound": "\\\\x37000300030001297f57bfab8f8f572c00"}, {"distinct_range": 36904910464.402374, "num_eq": 1739958182917882882, "num_range": 60000000000, "upper_bound": "\\\\x37000300030003000100"}, {"distinct_range": 0, "num_eq": 1000, "num_range": 60, "upper_bound": "\\\\x37000300033355477200012989b52f4f3fa3559800"}, {"distinct_range": 0, "num_eq": 415664140235339823, "num_range": 6000000, "upper_bound": "\\\\x37000300036100012a033115117b4d35732800"}, {"distinct_range": 6000000000, "num_eq": 4000, "num_range": 6000000000, "upper_bound": "\\\\x37000300036300010b"}, {"distinct_range": 5167320771917633000, "num_eq": 800000, "num_range": 5167320771917632768, "upper_bound": "\\\\x3700030003666f6f000112610001"}, {"distinct_range": 500000000, "num_eq": 6456011201219561469, "num_range": 500000000, "upper_bound": "\\\\x3700030003666f6f0002000300010b"}, {"distinct_range": 0, "num_eq": 472956858696978628, "num_range": 0, "upper_bound": "\\\\x3700030003666f6f00020003000112666f6f0001"}, {"distinct_range": 20000000000, "num_eq": 4438027904932062755, "num_range": 20000000000, "upper_bound": "\\\\x37000300036871513131597a3200010a"}, {"distinct_range": 0, "num_eq": 8029092721843706555, "num_range": 0, "upper_bound": "\\\\x370003000372464b4f6a705241490001127078760001"}, {"distinct_range": 100000000, "num_eq": 7482743272591492067, "num_range": 100000000, "upper_bound": "\\\\x370003426100027a6e4e53000100"}, {"distinct_range": 0, "num_eq": 16710796529790148, "num_range": 9000000000, "upper_bound": "\\\\x37000362000100"}, {"distinct_range": 20000, "num_eq": 579037768518189155, "num_range": 20000, "upper_bound": "\\\\x3700036300010a"}, {"distinct_range": 2191645887476849200, "num_eq": 10000000, "num_range": 2191645887476849172, "upper_bound": "\\\\x3700036337375151663200010b"}, {"distinct_range": 80, "num_eq": 0, "num_range": 80, "upper_bound": "\\\\x3700036a546d7a79000200030001294d3707119735354a00"}, {"distinct_range": 0, "num_eq": 5594794668416982435, "num_range": 40000000, "upper_bound": "\\\\x37000373556379666b000200030001293bb97d7d89897f2d6400"}, {"distinct_range": 49407.67578463304, "num_eq": 7000000000, "num_range": 60000, "upper_bound": "\\\\x37344a386b4800010b"}, {"distinct_range": 6744842353051469000, "num_eq": 4729451881731575360, "num_range": 6744842353051468895, "upper_bound": "\\\\x3744537000012a0347376521250d27a200"}, {"distinct_range": 0, "num_eq": 6628061362759777006, "num_range": 400000000, "upper_bound": "\\\\x376100010a"}, {"distinct_range": 0, "num_eq": 600000000, "num_range": 8128149273295886596, "upper_bound": "\\\\x3762000100"}, {"distinct_range": 0, "num_eq": 4130260352737420481, "num_range": 481227271016484362, "upper_bound": "\\\\x3762617a000100"}, {"distinct_range": 2000000000, "num_eq": 3260651026029266505, "num_range": 2000000000, "upper_bound": "\\\\x3762617a000251325862716c47557200010b"}, {"distinct_range": 6046711790433155000, "num_eq": 70000000000, "num_range": 6046711790433154889, "upper_bound": "\\\\x3762617a0002610002000300010b"}, {"distinct_range": 0, "num_eq": 8812477257227811579, "num_range": 7700497555555913743, "upper_bound": "\\\\x3762617a000262617a0002000300010a"}, {"distinct_range": 0, "num_eq": 6933014602199766089, "num_range": 426913439286801927, "upper_bound": "\\\\x3762617a000262617a0002000300012a038553892179ab7f4200"}, {"distinct_range": 6599126.628069087, "num_eq": 200000000, "num_range": 7000000, "upper_bound": "\\\\x37630001126261720001"}, {"distinct_range": 949402445629832200, "num_eq": 7580260274281306332, "num_range": 4219106426125743478, "upper_bound": "\\\\x3763000112646c7058620001"}, {"distinct_range": 606785204.6995399, "num_eq": 20, "num_range": 2000000000, "upper_bound": "\\\\x37630002000300010a"}, {"distinct_range": 2342370.5831420156, "num_eq": 30, "num_range": 7000000, "upper_bound": "\\\\x37630002000300010b"}, {"distinct_range": 0, "num_eq": 174803687663281342, "num_range": 10000000, "upper_bound": "\\\\x376300020003000112344a4b736e6d636b730001"}, {"distinct_range": 0, "num_eq": 837087927464112039, "num_range": 30, "upper_bound": "\\\\x37666f6f0002000300010a"}, {"distinct_range": 900, "num_eq": 5672082153526396374, "num_range": 900, "upper_bound": "\\\\x37666f6f000200030001124e336668587a630001"}, {"distinct_range": 7000, "num_eq": 80000000, "num_range": 7000, "upper_bound": "\\\\x37666f6f626172000100"}, {"distinct_range": 0, "num_eq": 7826847961987847046, "num_range": 0, "upper_bound": "\\\\x37745249380002347934000100"}, {"distinct_range": 90000, "num_eq": 5916383121048565201, "num_range": 90000, "upper_bound": "\\\\x377452493800025674000100"}, {"distinct_range": 1784.53494189947, "num_eq": 80000000000, "num_range": 7000, "upper_bound": "\\\\x3774524938000262617a00010a"}, {"distinct_range": 1306408937786184200, "num_eq": 0, "num_range": 1306408937786184098, "upper_bound": "\\\\x37745249380002666f6f62617200020003000100"}, {"distinct_range": 0, "num_eq": 70000000, "num_range": 0, "upper_bound": "\\\\x37745249380002666f6f6261720002000300010b"}, {"distinct_range": 4091985427002553300, "num_eq": 7402453952680588473, "num_range": 4091985427002553383, "upper_bound": "\\\\x37745249380002666f6f62617200020003666f6f0001290dab273f5fb1bd173c00"}, {"distinct_range": 5695.518662991331, "num_eq": 600000000, "num_range": 10000, "upper_bound": "\\\\x3774524938000270514d00010b"}, {"distinct_range": 8983655737530042000, "num_eq": 100000000000, "num_range": 8983655737530042788, "upper_bound": "\\\\x37746573740001126a736f6e0001"}, {"distinct_range": 4989786825870267000, "num_eq": 4000, "num_range": 4989786825870267342, "upper_bound": "\\\\x377471000100"}, {"distinct_range": 185797812469954080, "num_eq": 40, "num_range": 647963426125222230, "upper_bound": "\\\\x3775757933000112620001"}, {"distinct_range": 6249233953939768000, "num_eq": 41509062387907936, "num_range": 6249233953939768216, "upper_bound": "\\\\x377652760002000300010a"}, {"distinct_range": 0, "num_eq": 429755227737328281, "num_range": 307447323586081575, "upper_bound": "\\\\x37765276000200030001126261720001"}, {"distinct_range": 500000000, "num_eq": 752626192038257547, "num_range": 500000000, "upper_bound": "\\\\x3776527600020003000300010b"}, {"distinct_range": 0, "num_eq": 3321869417746875157, "num_range": 0, "upper_bound": "\\\\x37765276000200030003000129a77fc19d9f13a92400"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 200000000}, {"avg_size": 31, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 78569529, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 200000000}, {"avg_size": 27, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 47448916, "histo_buckets": [{"distinct_range": 0, "num_eq": 1000, "num_range": 0, "upper_bound": "\\u0006J"}, {"distinct_range": 0, "num_eq": 10000000, "num_range": 3354068597228064956, "upper_bound": "\\u0011\\u0011"}, {"distinct_range": 0, "num_eq": 1414491197057741907, "num_range": 8063014281155948017, "upper_bound": "\\""}, {"distinct_range": 0, "num_eq": 10000000000, "num_range": 1364531193783995676, "upper_bound": "@rW"}, {"distinct_range": 0, "num_eq": 6618063165062416783, "num_range": 0, "upper_bound": "KHuZ@"}, {"distinct_range": 1424362.682154638, "num_eq": 10, "num_range": 5000000, "upper_bound": "X"}, {"distinct_range": 2653139252685612000, "num_eq": 4885977570772189566, "num_range": 5978218793925111547, "upper_bound": "^o=J\\n\\\\"}, {"distinct_range": 1415740538834148400, "num_eq": 900, "num_range": 4087273356417973145, "upper_bound": "\U00002603"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 200000000}, {"avg_size": 30, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 85786731, "histo_col_type": "", "name": "__auto__", "null_count": 174443080, "row_count": 200000000}, {"avg_size": 22, "columns": ["col1_\u03457"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 21906260, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 200000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.62s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 36ee6c802b18ab8a544b20d03dec68d82d99604b:

        postgres_1    |                 "Tab\\u25667596".col2_0 AS col13640,
        postgres_1    |                 2::INT8::INT8 AS c🙃ol13641
        postgres_1    |             FROM
        postgres_1    |                 postgres.public."'table2"@"'table2_expr_idx" AS "Tab\\u25667596"
        postgres_1    |             ORDER BY
        postgres_1    |                 "Tab\\u25667596".tableoid DESC NULLS LAST
        postgres_1    |         )
        postgres_1    |             AS "ta%pb7597"
        postgres_1    |     ORDER BY
        postgres_1    |         col13637 ASC NULLS FIRST, col13638 NULLS LAST, col13639 DESC NULLS LAST, col13640 DESC NULLS LAST, c🙃ol13641 DESC
        test_1        | --- FAIL: TestCompare (13.39s)
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     --- FAIL: TestCompare/postgres (9.48s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare387033635/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("false"),
        test_1        |             +   string("f"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT * FROM (SELECT name(false::BOOL::BOOL)::NAME AS col13642) AS ta😃b7598 ORDER BY col13642 ASC;
        test_1        |             
        test_1        |             postgres: [same as previous]
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.65s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 TIMESTAMP NOT NULL, col1_1 DECIMAL NOT NULL, col1_2 BOOL NOT NULL, "col1_&3" GEOGRAPHY NULL, col1_4 BIT(29) NULL, "col1_\\U000BC77A5" FLOAT8 NOT NULL, co͙l1_6 STRING COLLATE da NOT NULL, col1_7 CHAR NOT NULL, PRIMARY KEY (col1_0, "col1_\\U000BC77A5" ASC, col1_7), INVERTED INDEX (col1_2 ASC, col1_1 ASC, co͙l1_6 ASC, col1_0 ASC, col1_4, col1_7 ASC, "col1_&3") WHERE ((((NOT table1.col1_2) AND (table1.col1_7 > '"':::STRING)) AND (table1."col1_\\U000BC77A5" < 1.401298464324817e-45:::FLOAT8)) OR (table1.col1_1 >= 1:::DECIMAL)) AND (table1.col1_0 < '4714-11-24 00:00:00 BC':::TIMESTAMP), INVERTED INDEX ("col1_&3" ASC) WHERE (((table1."col1_\\U000BC77A5" >= '+Inf':::FLOAT8) OR (table1.col1_0 <= '2001-01-01 00:00:00 BC':::TIMESTAMP)) AND (table1.col1_1 != 'NaN':::DECIMAL)) AND (NOT table1.col1_2), UNIQUE (col1_1 DESC, "col1_\\U000BC77A5" ASC, col1_2 DESC, col1_4 DESC) WHERE (((table1.col1_2 OR (table1.col1_1 < 1:::DECIMAL)) AND (table1."col1_\\U000BC77A5" < 1.401298464324817e-45:::FLOAT8)) OR (table1.col1_0 != '294276-12-31 23:59:59.999999':::TIMESTAMP)) OR (table1.col1_7 = e'\x00':::STRING), FAMILY (col1_2, co͙l1_6), FAMILY ("col1_\\U000BC77A5"), FAMILY (col1_1, "col1_&3"), FAMILY (col1_4), FAMILY (col1_0, col1_7));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 21, "columns": ["\\"col1_&3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6114767955860315519, "histo_buckets": [{"distinct_range": 0, "num_eq": 6122241792836537731, "num_range": 0, "upper_bound": "\\\\x42fd0330c59a5a6f939f00c00163e3772694f7bfeb0cb1ba6cf0673fecf851b76dbfd73fdcc53da00afeb5"}, {"distinct_range": 0, "num_eq": 5918764784587020282, "num_range": 50000000000, "upper_bound": "\\\\x42fd100000000000000000c008f24b9044b705bff2e0c9f59f14803feb4af071d206713ff5182e2ce161c1"}, {"distinct_range": 3259310317032905700, "num_eq": 1000000000, "num_range": 7867544780542537049, "upper_bound": "\\\\x42fd100000000000000000c00921fb54442d18bff8bfee6423bf45400921fb54442d183ff7fea65b3e7ca0"}, {"distinct_range": 306367390868867900, "num_eq": 2104917435068099243, "num_range": 5430709832745759915, "upper_bound": "\\\\x42fd100000000000000000c00921fb54442d18bff8ec294ed779e9400921fb54442d183ff8f24113e8099e"}, {"distinct_range": 65686103.2343369, "num_eq": 90, "num_range": 700000000, "upper_bound": "\\\\x42fd22c000000000000000c008f24b9044b705bff2e0c9f59f14803feb4af071d206713ff5182e2ce161c1"}, {"distinct_range": 0, "num_eq": 7000, "num_range": 3311943408348295055, "upper_bound": "\\\\x42fd240000000000000000bfe28f1e18b165d6bff88349ba21b441bff59df8a7c5ff373ff91b6651881948"}, {"distinct_range": 0, "num_eq": 800000, "num_range": 700000, "upper_bound": "\\\\x42fd2c0000000000000000bfe28f1e18b165d6bff88349ba21b441bff59df8a7c5ff373ff91b6651881948"}, {"distinct_range": 0, "num_eq": 3844273440366959297, "num_range": 30, "upper_bound": "\\\\x42fd300000000000000000c00921fb54442d18bff8bfee6423bf45400921fb54442d183ff7fea65b3e7ca0"}, {"distinct_range": 88778683.94126645, "num_eq": 1016303780520233391, "num_range": 3000000000, "upper_bound": "\\\\x42fd300000000000000000c00921fb54442d18bff8ec294ed779e9400921fb54442d183ff8f24113e8099e"}, {"distinct_range": 0, "num_eq": 2022947825729937170, "num_range": 80, "upper_bound": "\\\\x42fd340000000000000000bfe28f1e18b165d6bff88349ba21b441bff59df8a7c5ff373ff91b6651881948"}, {"distinct_range": 4863451836538024000, "num_eq": 60, "num_range": 4863451836538023499, "upper_bound": "\\\\x42fd3ab000000000000000bfe28f1e18b165d6bff88349ba21b441bff59df8a7c5ff373ff91b6651881948"}, {"distinct_range": 142552997544702800, "num_eq": 7482670047054970521, "num_range": 335986203408600857, "upper_bound": "\\\\x42fd455fb4e45de79ecf013fbf4530704ba8e13ff7d0ed0bdbb839"}, {"distinct_range": 489159027442565060, "num_eq": 5000, "num_range": 909441038360401429, "upper_bound": "\\\\x42fd500000000000000000bfe28f1e18b165d6bff88349ba21b441bff59df8a7c5ff373ff91b6651881948"}, {"distinct_range": 1809878809641647600, "num_eq": 400000000, "num_range": 1809878809641647615, "upper_bound": "\\\\x42fd500000000000000000c008f24b9044b705bff2e0c9f59f14803feb4af071d206713ff5182e2ce161c1"}, {"distinct_range": 1187047008588341800, "num_eq": 8000, "num_range": 1187047008588341776, "upper_bound": "\\\\x42fd500000000000000000c00921fb54442d18bff8bfee6423bf45400921fb54442d183ff7fea65b3e7ca0"}, {"distinct_range": 0, "num_eq": 5000000, "num_range": 4491886651799065087, "upper_bound": "\\\\x42fd500000000000000000c00921fb54442d18bff8ec294ed779e9400921fb54442d183ff8f24113e8099e"}, {"distinct_range": 80261381390.7695, "num_eq": 7851417484890963683, "num_range": 100000000000, "upper_bound": "\\\\x42fd700000000000000000bfe28f1e18b165d6bff88349ba21b441bff59df8a7c5ff373ff91b6651881948"}, {"distinct_range": 1045877406696902000, "num_eq": 10000000, "num_range": 1707446957453633549, "upper_bound": "\\\\x42fd700000000000000000c008f24b9044b705bff2e0c9f59f14803feb4af071d206713ff5182e2ce161c1"}, {"distinct_range": 0, "num_eq": 10000000, "num_range": 100000000, "upper_bound": "\\\\x42fd700000000000000000c00921fb54442d18bff8bfee6423bf45400921fb54442d183ff7fea65b3e7ca0"}, {"distinct_range": 100, "num_eq": 1066017963509464633, "num_range": 100, "upper_bound": "\\\\x42fd700000000000000000c00921fb54442d18bff8ec294ed779e9400921fb54442d183ff8f24113e8099e"}, {"distinct_range": 2896996.401536644, "num_eq": 2395261820679779334, "num_range": 5000000, "upper_bound": "\\\\x42fd81a758340f6dd76d00c00163e3772694f7bfeb0cb1ba6cf0673fecf851b76dbfd73fdcc53da00afeb5"}, {"distinct_range": 0, "num_eq": 10000000, "num_range": 7000000000, "upper_bound": "\\\\x42fd900000000000000000c008f24b9044b705bff2e0c9f59f14803feb4af071d206713ff5182e2ce161c1"}, {"distinct_range": 1632561642517448400, "num_eq": 0, "num_range": 3913144076355102997, "upper_bound": "\\\\x42fd900000000000000000c00921fb54442d18bff8bfee6423bf45400921fb54442d183ff7fea65b3e7ca0"}, {"distinct_range": 0, "num_eq": 9169730823139130245, "num_range": 40000000, "upper_bound": "\\\\x42fd900000000000000000c00921fb54442d18bff8ec294ed779e9400921fb54442d183ff8f24113e8099e"}, {"distinct_range": 0, "num_eq": 2711437238454088321, "num_range": 40000000, "upper_bound": "\\\\x42fdac0000000000000000bfe28f1e18b165d6bff88349ba21b441bff59df8a7c5ff373ff91b6651881948"}, {"distinct_range": 0, "num_eq": 100, "num_range": 8510322578369384234, "upper_bound": "\\\\x42fdb00000000000000000c008f24b9044b705bff2e0c9f59f14803feb4af071d206713ff5182e2ce161c1"}, {"distinct_range": 430284805440577800, "num_eq": 3000000, "num_range": 552663350097702354, "upper_bound": "\\\\x42fdb00000000000000000c00921fb54442d18bff8bfee6423bf45400921fb54442d183ff7fea65b3e7ca0"}, {"distinct_range": 0, "num_eq": 4304816705133061132, "num_range": 3000, "upper_bound": "\\\\x42fdb00000000000000000c00921fb54442d18bff8ec294ed779e9400921fb54442d183ff8f24113e8099e"}, {"distinct_range": 0, "num_eq": 60000, "num_range": 3048747322370768694, "upper_bound": "\\\\x42fdb4f5351b9525f2fb00c00163e3772694f7bfeb0cb1ba6cf0673fecf851b76dbfd73fdcc53da00afeb5"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 4046387868701816701, "row_count": 7012997404739775601}, {"avg_size": 27, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2612497005243702153, "histo_col_type": "", "name": "__auto__", "null_count": 5590180153225430259, "row_count": 7012997404739775601}, {"avg_size": 13, "columns": ["\\"col1_\\\\\\\\U000BC77A5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3448757386998469828, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7012997404739775601}, {"avg_size": 15, "columns": ["co\u0359l1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4710611970510056998, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7012997404739775601}, {"avg_size": 27, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4967598434530416940, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7012997404739775601}, {"avg_size": 7, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5919868244482024861, "histo_buckets": [{"distinct_range": 0, "num_eq": 800000000, "num_range": 0, "upper_bound": "2010-01-16 20:52:28.000936"}], "histo_col_type": "TIMESTAMP", "name": "__auto__", "null_count": 0, "row_count": 7012997404739775601}, {"avg_size": 8, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6082837266931055158, "histo_buckets": [{"distinct_range": 0, "num_eq": 400, "num_range": 0, "upper_bound": "-1.807660275968812074E+25"}, {"distinct_range": 0, "num_eq": 8772326352628369950, "num_range": 800000, "upper_bound": "-3.835257027755423726E+21"}, {"distinct_range": 0, "num_eq": 80000000, "num_range": 8424699504341629568, "upper_bound": "-788056.4379575768338"}, {"distinct_range": 3096423382395186000, "num_eq": 70000, "num_range": 3096423382395186348, "upper_bound": "496261878.225296245"}, {"distinct_range": 553449403.4729877, "num_eq": 10000, "num_range": 900000000, "upper_bound": "3.041106173575938439E+24"}, {"distinct_range": 0, "num_eq": 80, "num_range": 5196387592804355254, "upper_bound": "Infinity"}], "histo_col_type": "DECIMAL", "name": "__auto__", "null_count": 0, "row_count": 7012997404739775601}, {"avg_size": 16, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1918488239802569328, "histo_buckets": [{"distinct_range": 0, "num_eq": 4366179300862072594, "num_range": 0, "upper_bound": "false"}, {"distinct_range": 0, "num_eq": 6000000000, "num_range": 5257378304373265655, "upper_bound": "true"}], "histo_col_type": "BOOL", "name": "__auto__", "null_count": 0, "row_count": 7012997404739775601}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 31, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 46, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80}, {"avg_size": 13, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 33, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80}, {"avg_size": 11, "columns": ["\\"col1_&3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1, "histo_buckets": [{"distinct_range": 0, "num_eq": 4600452632972012716, "num_range": 0, "upper_bound": "\\\\x42fd030000000000000000c00921fb54442d18bff91eee0705caf8400921fb54442d183ff7d5b03837f1b3"}, {"distinct_range": 0, "num_eq": 1088324999776877385, "num_range": 6809567527998927016, "upper_bound": "\\\\x42fd100000000000000000c00921fb54442d18bff86c0f5e53bed3400921fb54442d183ff8dbcaede2ba22"}, {"distinct_range": 2299404878577052000, "num_eq": 1741749619246929056, "num_range": 3192624400853742361, "upper_bound": "\\\\x42fd100000000000000000c00921fb54442d18bff8d369389d0297400921fb54442d183ff8dfb185ca5f2e"}, {"distinct_range": 1331964398322939100, "num_eq": 800, "num_range": 2353745458394842068, "upper_bound": "\\\\x42fd300000000000000000c00921fb54442d18bff86c0f5e53bed3400921fb54442d183ff8dbcaede2ba22"}, {"distinct_range": 0, "num_eq": 8000000, "num_range": 60000, "upper_bound": "\\\\x42fd300000000000000000c00921fb54442d18bff8d369389d0297400921fb54442d183ff8dfb185ca5f2e"}, {"distinct_range": 4207393347898777600, "num_eq": 1130122003494563481, "num_range": 4207393347898777414, "upper_bound": "\\\\x42fd439000000000000000c00921fb54442d18bff91eee0705caf8400921fb54442d183ff7d5b03837f1b3"}, {"distinct_range": 0, "num_eq": 8000000, "num_range": 60, "upper_bound": "\\\\x42fd450000000000000000c00921fb54442d18bff91eee0705caf8400921fb54442d183ff7d5b03837f1b3"}, {"distinct_range": 0, "num_eq": 100, "num_range": 900, "upper_bound": "\\\\x42fd4d000000000000000040056dbc8e7572783fec26e1cab845c6bff214fe5c977e0a3ff4877696002072"}, {"distinct_range": 2351166734651068000, "num_eq": 10000, "num_range": 3987240231805538513, "upper_bound": "\\\\x42fd4d0000000000000000c00921fb54442d18bff91eee0705caf8400921fb54442d183ff7d5b03837f1b3"}, {"distinct_range": 1780797676748778800, "num_eq": 60000000000, "num_range": 3298454343273703324, "upper_bound": "\\\\x42fd4d5b84133f7e6b3301bff894c2edf362bf3feb25221829c4c3"}, {"distinct_range": 0, "num_eq": 5427268922616088498, "num_range": 4210538622970365768, "upper_bound": "\\\\x42fd4f0000000000000000c00921fb54442d18bff91eee0705caf8400921fb54442d183ff7d5b03837f1b3"}, {"distinct_range": 34620459483.15539, "num_eq": 5936586732698006091, "num_range": 40000000000, "upper_bound": "\\\\x42fd500000000000000000c00921fb54442d18bff86c0f5e53bed3400921fb54442d183ff8dbcaede2ba22"}, {"distinct_range": 183595.75988574434, "num_eq": 30000, "num_range": 400000, "upper_bound": "\\\\x42fd500000000000000000c00921fb54442d18bff8d369389d0297400921fb54442d183ff8dfb185ca5f2e"}, {"distinct_range": 0, "num_eq": 3000000000, "num_range": 2817207675550378362, "upper_bound": "\\\\x42fd54000000000000000040056dbc8e7572783fec26e1cab845c6bff214fe5c977e0a3ff4877696002072"}, {"distinct_range": 5000000, "num_eq": 9222966966984398101, "num_range": 5000000, "upper_bound": "\\\\x42fd59000000000000000040056dbc8e7572783fec26e1cab845c6bff214fe5c977e0a3ff4877696002072"}, {"distinct_range": 90, "num_eq": 0, "num_range": 90, "upper_bound": "\\\\x42fd5a040000000000000040056dbc8e7572783fec26e1cab845c6bff214fe5c977e0a3ff4877696002072"}, {"distinct_range": 328988.3171796082, "num_eq": 60000000000, "num_range": 500000, "upper_bound": "\\\\x42fd700000000000000000c00921fb54442d18bff8d369389d0297400921fb54442d183ff8dfb185ca5f2e"}, {"distinct_range": 10000000, "num_eq": 9078214674118400985, "num_range": 10000000, "upper_bound": "\\\\x42fd7ffc00000000000000c00921fb54442d18bff86c0f5e53bed3400921fb54442d183ff8dbcaede2ba22"}, {"distinct_range": 0, "num_eq": 638248965384212334, "num_range": 0, "upper_bound": "\\\\x42fd8d4000000000000000c00921fb54442d18bff91eee0705caf8400921fb54442d183ff7d5b03837f1b3"}, {"distinct_range": 3435523486065311000, "num_eq": 9000, "num_range": 6594864933428655806, "upper_bound": "\\\\x42fd900000000000000000c00921fb54442d18bff86c0f5e53bed3400921fb54442d183ff8dbcaede2ba22"}, {"distinct_range": 0, "num_eq": 3494565475587043963, "num_range": 50000000, "upper_bound": "\\\\x42fd900000000000000000c00921fb54442d18bff8d369389d0297400921fb54442d183ff8dfb185ca5f2e"}, {"distinct_range": 0, "num_eq": 60, "num_range": 2810470234361511343, "upper_bound": "\\\\x42fd940000000000000000c00921fb54442d18bff91eee0705caf8400921fb54442d183ff7d5b03837f1b3"}, {"distinct_range": 21.2226367610248, "num_eq": 968039466974866477, "num_range": 30, "upper_bound": "\\\\x42fdb00000000000000000c00921fb54442d18bff86c0f5e53bed3400921fb54442d183ff8dbcaede2ba22"}, {"distinct_range": 5486923732979525000, "num_eq": 5920177213005414565, "num_range": 5486923732979524710, "upper_bound": "\\\\x42fdb00000000000000000c00921fb54442d18bff8d369389d0297400921fb54442d183ff8dfb185ca5f2e"}, {"distinct_range": 336111235530058500, "num_eq": 476658854192989585, "num_range": 692372656379665224, "upper_bound": "\\\\x42fdb00000000000000000c00921fb54442d18bff91eee0705caf8400921fb54442d183ff7d5b03837f1b3"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 15, "row_count": 80}, {"avg_size": 28, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4, "histo_col_type": "", "name": "__auto__", "null_count": 71, "row_count": 80}, {"avg_size": 22, "columns": ["\\"col1_\\\\\\\\U000BC77A5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 52, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80}, {"avg_size": 3, "columns": ["co\u0359l1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 24, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80}, {"avg_size": 20, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 78, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80}, {"avg_size": 6, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 73, "histo_buckets": [{"distinct_range": 0, "num_eq": 9000000000, "num_range": 0, "upper_bound": "4714-11-24 00:00:00 BC"}, {"distinct_range": 7335322643517395000, "num_eq": 70000, "num_range": 7335322643517394787, "upper_bound": "1973-05-22 20:08:26.000236"}, {"distinct_range": 2910003466861840400, "num_eq": 10000000, "num_range": 2910003466861840152, "upper_bound": "1993-07-17 06:02:26.000542"}, {"distinct_range": 0, "num_eq": 3897522855278712104, "num_range": 90, "upper_bound": "2008-05-04 14:26:25.000538"}, {"distinct_range": 7919355660166520000, "num_eq": 0, "num_range": 7919355660166520274, "upper_bound": "2012-01-03 16:22:16.000216"}, {"distinct_range": 4298542197517643000, "num_eq": 200, "num_range": 4679303580450595674, "upper_bound": "2027-01-06 13:55:53.00083"}, {"distinct_range": 4001239640397702000, "num_eq": 1000000, "num_range": 4001239640397702328, "upper_bound": "294276-12-31 23:59:59.999999"}], "histo_col_type": "TIMESTAMP", "name": "__auto__", "null_count": 0, "row_count": 80}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (36.88s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 360923fbbf41db7a30e0b5af66b7b2fbf04fd290:

        postgres_1    |                 postgres.public.table3@"table3_col3_1_col3_3_col3 _4_col3_2_col3_0_idx" AS "ta'b1989"
        postgres_1    |             WHERE
        postgres_1    |                 true::BOOL
        postgres_1    |             GROUP BY
        postgres_1    |                 "ta'b1989".col3_0, "ta'b1989".tableoid
        postgres_1    |         )
        postgres_1    |             AS tab1990
        postgres_1    |     ORDER BY
        postgres_1    |         "c\\u7BAFol3303" NULLS FIRST
        test_1        | --- FAIL: TestCompare (6.41s)
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     --- FAIL: TestCompare/mutators (0.37s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "table\\u3B1F1" (col1_0 VARCHAR NOT NULL, "Col1_1" TIME NOT NULL, col1_😵2 REGROLE NULL, col1_3 FLOAT8 NOT NULL, col1_4 INET NOT NULL, " col1_5" GEOMETRY NOT NULL, INVERTED INDEX (col1_4 ASC, col1_0, col1_3, " col1_5" ASC), UNIQUE (col1_0) STORING ("Col1_1", col1_😵2, col1_4) WHERE (("table\\u3B1F1"."Col1_1" < '00:00:00':::TIME) AND ("table\\u3B1F1".col1_3 <= 'NaN':::FLOAT8)) AND ("table\\u3B1F1".col1_0 >= e'\'':::STRING), UNIQUE (col1_😵2 ASC, col1_0, lower(col1_0), col1_4 ASC, "Col1_1" DESC) STORING (col1_3, " col1_5") WHERE (("table\\u3B1F1".col1_0 >= '':::STRING) AND ("table\\u3B1F1".col1_3 < 0.0:::FLOAT8)) AND ("table\\u3B1F1"."Col1_1" = '24:00:00':::TIME), FAMILY (col1_😵2, "Col1_1", col1_0, col1_3), FAMILY (" col1_5"), FAMILY (col1_4));
        test_1        |             ALTER TABLE "table\\u3B1F1" INJECT STATISTICS e'[{"avg_size": 2, "columns": ["\\"Col1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5770160627229194179, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9026390161616347576}, {"avg_size": 22, "columns": ["col1_\U0001F6352"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3590914244480853867, "histo_buckets": [{"distinct_range": 0, "num_eq": 70000000, "num_range": 0, "upper_bound": "2815271856"}, {"distinct_range": 0, "num_eq": 100000000000, "num_range": 5000000, "upper_bound": "3292118002"}], "histo_col_type": "REGROLE", "name": "__auto__", "null_count": 4413272674275938793, "row_count": 9026390161616347576}, {"avg_size": 19, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3379454158285202110, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9026390161616347576}, {"avg_size": 12, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6051608392332659343, "histo_buckets": [{"distinct_range": 0, "num_eq": 30000, "num_range": 0, "upper_bound": "224.122.30.250/10"}, {"distinct_range": 7000000, "num_eq": 3000, "num_range": 7000000, "upper_bound": "208.89.186.10/27"}, {"distinct_range": 0, "num_eq": 1172111680033986052, "num_range": 7000000, "upper_bound": "105.162.139.192"}, {"distinct_range": 9000000000, "num_eq": 900, "num_range": 9000000000, "upper_bound": "8f48:ad82:29ec:7a65:628a:88e9:2b6:b41d/19"}, {"distinct_range": 0, "num_eq": 9170180002042654768, "num_range": 3000, "upper_bound": "11c9:b870:f4eb:b5c:5450:1f5b:f8bb:442f/36"}, {"distinct_range": 0, "num_eq": 600000000, "num_range": 10000000000, "upper_bound": "17f9:3b22:4898:ac83:5692:5870:9956:b0b6/79"}, {"distinct_range": 0, "num_eq": 300000000, "num_range": 0, "upper_bound": "b9e1:d534:7e5a:3493:3014:7c17:3acc:bbb8/82"}], "histo_col_type": "INET", "name": "__auto__", "null_count": 0, "row_count": 9026390161616347576}, {"avg_size": 11, "columns": ["\\" col1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5257460804765851809, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9026390161616347576}, {"avg_size": 31, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3813336940802837070, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9026390161616347576}]':::JSONB;
        test_1        |             ALTER TABLE "table\\u3B1F1" INJECT STATISTICS e'[{"avg_size": 20, "columns": ["\\"Col1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7499980605855321657, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8037135615471713711}, {"avg_size": 0, "columns": ["col1_\U0001F6352"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5827124517244708678, "histo_buckets": [{"distinct_range": 0, "num_eq": 2038215161532704732, "num_range": 0, "upper_bound": "1938262533"}, {"distinct_range": 638331520762248800, "num_eq": 8099064084772302271, "num_range": 1370969315254482372, "upper_bound": "2787333338"}, {"distinct_range": 5982979233249284000, "num_eq": 1669339809811238085, "num_range": 5982979233249284106, "upper_bound": "3603689833"}], "histo_col_type": "REGROLE", "name": "__auto__", "null_count": 6479057831055354457, "row_count": 8037135615471713711}, {"avg_size": 31, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5598659895480241186, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8037135615471713711}, {"avg_size": 25, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6481885236328422813, "histo_buckets": [{"distinct_range": 0, "num_eq": 60, "num_range": 0, "upper_bound": "1.37.222.13/0"}, {"distinct_range": 0, "num_eq": 20000000000, "num_range": 688707887732538723, "upper_bound": "44.122.250.48/1"}, {"distinct_range": 3389523142164451300, "num_eq": 5817526041069778757, "num_range": 3389523142164451122, "upper_bound": "129.190.55.174/9"}, {"distinct_range": 1878973495583506400, "num_eq": 4329333749836972503, "num_range": 1878973495583506376, "upper_bound": "72.190.237.63/17"}, {"distinct_range": 5831128.439026667, "num_eq": 5349986354934374506, "num_range": 6000000, "upper_bound": "176.243.213.218/19"}, {"distinct_range": 0, "num_eq": 200, "num_range": 800000000, "upper_bound": "8d0:5519:5b3c:9694:a1d8:6481:7828:de5e/119"}, {"distinct_range": 0, "num_eq": 200000, "num_range": 100000000, "upper_bound": "ffff:ffff:ffff:ffff:ffff:ffff:ffff:ffff"}], "histo_col_type": "INET", "name": "__auto__", "null_count": 0, "row_count": 8037135615471713711}, {"avg_size": 29, "columns": ["\\" col1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6823505901881053186, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8037135615471713711}, {"avg_size": 25, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4732022024792817803, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "\\u000fFD76en\\u00187"}, {"distinct_range": 7068726145660062000, "num_eq": 400000, "num_range": 7068726145660061717, "upper_bound": "\\u0013CFb\\u0001s?B\\u000b"}, {"distinct_range": 49.497078227226716, "num_eq": 6391137503948155808, "num_range": 50, "upper_bound": "\\u001b=9\\u00125"}, {"distinct_range": 6451.014959186757, "num_eq": 1000, "num_range": 9000, "upper_bound": ".C} 6\\u0018lC"}, {"distinct_range": 4283988874530539000, "num_eq": 7708349127132049334, "num_range": 4726382953311092620, "upper_bound": ":L"}, {"distinct_range": 0, "num_eq": 700000000, "num_range": 7671166466277001772, "upper_bound": "{EL\\u0012z\\u0005\\u001b"}], "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 0, "row_count": 8037135615471713711}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        |     --- FAIL: TestCompare/postgres (3.26s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2279063160/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("9"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT * FROM (SELECT regproc(9:::INT8::INT4::INT4)::REGPROC AS "{co%pl3305") AS tab1993 ORDER BY "{co%pl3305" ASC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT * FROM (SELECT regproc(9::INT8::INT4::INT4)::REGPROC AS "{co%pl3305") AS tab1993 ORDER BY "{co%pl3305" ASC;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (23.57s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 5efa6ff20f56d2ce8111b710190d1b378adb26d9:

        test_1        |             postgres:
        test_1        |             SELECT * FROM (SELECT regproc(7::INT8::INT4::INT4)::REGPROC AS col1) AS tab1 ORDER BY col1 NULLS LAST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.00s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 69 [running]:
        test_1        | testing.tRunner.func1.2({0x22712e0, 0xc001f37220})
        test_1        |     GOROOT/src/testing/testing.go:1396 +0x24e
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1399 +0x39f
        test_1        | panic({0x22712e0, 0xc001f37220})
        test_1        |     GOROOT/src/runtime/panic.go:884 +0x212
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x451a1c0?, {0x315f528?, 0xc000e47380?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:377 +0x445
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x3125320?, 0x451a1c0)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:310 +0x13c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc001f63500)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:227 +0x96
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc000d64a50, {0xc001f361c0?, 0x2, 0xc000d64a50?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:260 +0x71f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0xc000cc1968?, 0x246d51f?, {0xc001f361c0?, 0x20b0ec0?, 0x1?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:98 +0x2e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0x20b0ec0?, {0x246d51f, 0x5}, 0x2, 0x0?, {0xc001ecfa48, 0x3, 0xc00049e190?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x16a
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0x1?, 0x60a200?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:104 +0x194
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc0002e89c0?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:84 +0x37
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.wrapCommonSetup.func1(0x2646630?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x22
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc0002e89c0)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:141 +0xed
        test_1        | testing.tRunner(0xc0002e89c0, 0xc000d649f0)
        test_1        |     GOROOT/src/testing/testing.go:1446 +0x10b
        test_1        | created by testing.(*T).Run
        test_1        |     GOROOT/src/testing/testing.go:1493 +0x35f
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 2
--- FAIL: TestComposeCompare (19.05s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 5efa6ff20f56d2ce8111b710190d1b378adb26d9:

        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (5.18s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare4281141377/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare postgres to cockroach1: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("5"),
        test_1        |             +   string("array_agg"),
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regproc(5::INT8::INT4::INT4)::REGPROC AS "\\uA447cOl6300") AS "ta%vb3955"
        test_1        |             ORDER BY
        test_1        |                 "\\uA447cOl6300" DESC;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regproc(5:::INT8::INT4::INT4)::REGPROC AS "\\uA447cOl6300") AS "ta%vb3955"
        test_1        |             ORDER BY
        test_1        |                 "\\uA447cOl6300" DESC;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.80s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 ("Col1'_}0" JSONB NOT NULL, "co""l1_1" TIME NOT NULL, ".col1_2" OID, col1_3 INT2 NOT NULL, "col1 _4" BYTES NOT NULL, col1_5 BIT(23) NOT NULL, col1_6 BIT(30) NOT NULL, "col%q1_7" STRING NOT NULL AS (CASE WHEN "col1 _4" IS NULL THEN e'o\x03r':::STRING ELSE 'X':::STRING END) STORED, INDEX ("col%q1_7" DESC, col1_5, (col1_3 + (-32728):::INT8), col1_3 DESC) STORING ("co""l1_1", ".col1_2") WHERE ((table1."col%q1_7" < e'\'':::STRING) AND (table1."co""l1_1" >= '00:00:00':::TIME)) AND (table1.col1_3 != 1:::INT8), UNIQUE ("co""l1_1" ASC, col1_3 ASC, "col%q1_7") STORING ("Col1'_}0", col1_5) WHERE (((table1."co""l1_1" >= '24:00:00':::TIME) OR (table1."col%q1_7" > '"':::STRING)) OR (table1.col1_3 = (-1):::INT8)) AND (table1."col1 _4" <= e'\\x58':::BYTES), INVERTED INDEX (col1_3 ASC, "Col1'_}0") WHERE (table1."col%q1_7" <= '"':::STRING) OR (table1.col1_3 != (-1):::INT8), INVERTED INDEX ("Col1'_}0" ASC) WHERE table1.col1_3 < (-1):::INT8, FAMILY ("col1 _4"), FAMILY (".col1_2", col1_3, "co""l1_1"), FAMILY ("col%q1_7", col1_5, "Col1'_}0"), FAMILY (col1_6), UNIQUE (col1_3, ".col1_2") WHERE (table1."co""l1_1" < '24:00:00':::TIME) OR (table1.col1_3 <= (-32768):::INT8), UNIQUE (".col1_2") STORING (col1_3, "col1 _4", col1_6) WHERE (table1."co""l1_1" <= '00:00:00':::TIME) OR (table1.col1_3 > (-1):::INT8));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 16, "columns": ["\\"col%q1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3035207705742231876, "histo_buckets": [{"distinct_range": 0, "num_eq": 90000000, "num_range": 0, "upper_bound": "#\':7jL|J"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 5610468287202693043}, {"avg_size": 29, "columns": ["\\"Col1\'_}0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2244135745446576476, "histo_buckets": [{"distinct_range": 0, "num_eq": 4000000000, "num_range": 0, "upper_bound": "\\\\x3700010b"}, {"distinct_range": 0, "num_eq": 200, "num_range": 1699601955061824662, "upper_bound": "\\\\x37000139"}, {"distinct_range": 6762584142160561000, "num_eq": 1001271738956068352, "num_range": 7603977649168785761, "upper_bound": "\\\\x370003000100"}, {"distinct_range": 0, "num_eq": 1015112664428297168, "num_range": 27105338738118347, "upper_bound": "\\\\x37000300010a"}, {"distinct_range": 0, "num_eq": 74665729141881095, "num_range": 7000000000, "upper_bound": "\\\\x370003000112620001"}, {"distinct_range": 0, "num_eq": 400, "num_range": 2283542448460375697, "upper_bound": "\\\\x373077783568646400026100010a"}, {"distinct_range": 70000, "num_eq": 10000000000, "num_range": 70000, "upper_bound": "\\\\x3730777835686464000262617a00011256560001"}, {"distinct_range": 0, "num_eq": 4325836720391805163, "num_range": 0, "upper_bound": "\\\\x3730777835686464000263000100"}, {"distinct_range": 54500315392092504, "num_eq": 8522695118791958315, "num_range": 644996942668899666, "upper_bound": "\\\\x3739566e00010b"}, {"distinct_range": 859112202961658400, "num_eq": 4063230147522506352, "num_range": 859112202961658341, "upper_bound": "\\\\x374842713100011253590001"}, {"distinct_range": 0, "num_eq": 10000, "num_range": 3745067645192202876, "upper_bound": "\\\\x374e7344794c624374000129374b05632dc75f1a00"}, {"distinct_range": 8478509913743935000, "num_eq": 5244775597089763521, "num_range": 9178660787674018559, "upper_bound": "\\\\x374f3953000100"}, {"distinct_range": 0, "num_eq": 80, "num_range": 534264548723057265, "upper_bound": "\\\\x375637443856000256776638000112630001"}, {"distinct_range": 0, "num_eq": 30, "num_range": 0, "upper_bound": "\\\\x375637443856000258727936720002000300010b"}, {"distinct_range": 10, "num_eq": 700000, "num_range": 10, "upper_bound": "\\\\x375637443856000258727936720002000300012a03297f1b799157578c00"}, {"distinct_range": 14827.686070424646, "num_eq": 30000000000, "num_range": 80000, "upper_bound": "\\\\x375637443856000258727936720002000300030001296701a35d9181031400"}, {"distinct_range": 7104347380205524000, "num_eq": 10000, "num_range": 7104347380205524037, "upper_bound": "\\\\x37563744385600027469556c00010a"}, {"distinct_range": 0, "num_eq": 9198528868426127632, "num_range": 900, "upper_bound": "\\\\x376261720002000300010a"}, {"distinct_range": 2479523081404459500, "num_eq": 400000000, "num_range": 3884245710534522244, "upper_bound": "\\\\x376261720002000300010b"}, {"distinct_range": 10000000, "num_eq": 8690132492837826956, "num_range": 10000000, "upper_bound": "\\\\x3762617a000100"}, {"distinct_range": 0, "num_eq": 30000, "num_range": 50000000000, "upper_bound": "\\\\x376e345800012925bd6b99a77f23aa00"}, {"distinct_range": 7341805715435800000, "num_eq": 30000, "num_range": 7341805715435799844, "upper_bound": "\\\\x377661596f00010a"}, {"distinct_range": 0, "num_eq": 30000000000, "num_range": 2887770700184586893, "upper_bound": "\\\\x377756305400010b"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 5610468287202693043}, {"avg_size": 7, "columns": ["\\"co\\"\\"l1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3888234438492200433, "histo_buckets": [{"distinct_range": 0, "num_eq": 2000, "num_range": 0, "upper_bound": "00:05:45.431195"}, {"distinct_range": 60000, "num_eq": 40, "num_range": 60000, "upper_bound": "00:19:43.010961"}, {"distinct_range": 50000000, "num_eq": 90000000, "num_range": 50000000, "upper_bound": "00:55:49.054734"}, {"distinct_range": 0, "num_eq": 2977950015565204227, "num_range": 2597225761783595468, "upper_bound": "06:57:12.372883"}, {"distinct_range": 0, "num_eq": 7083019460290680851, "num_range": 4446896323318751139, "upper_bound": "12:13:59.802057"}, {"distinct_range": 0, "num_eq": 9066596968137906667, "num_range": 7732734782200458747, "upper_bound": "13:53:43.4131"}, {"distinct_range": 398659.42554670747, "num_eq": 50000000, "num_range": 400000, "upper_bound": "18:09:49.381564"}, {"distinct_range": 6000000, "num_eq": 7000, "num_range": 6000000, "upper_bound": "21:22:06.972028"}, {"distinct_range": 0, "num_eq": 3970581864840970177, "num_range": 8629922139905346771, "upper_bound": "22:21:07.773699"}], "histo_col_type": "TIME", "name": "__auto__", "null_count": 0, "row_count": 5610468287202693043}, {"avg_size": 28, "columns": ["\\".col1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 593310185153711402, "histo_col_type": "", "name": "__auto__", "null_count": 2635168238619818445, "row_count": 5610468287202693043}, {"avg_size": 12, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 247882143892592764, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "21521"}, {"distinct_range": 929830936086566900, "num_eq": 3760680215720269190, "num_range": 929830936086566858, "upper_bound": "23609"}], "histo_col_type": "INT2", "name": "__auto__", "null_count": 0, "row_count": 5610468287202693043}, {"avg_size": 18, "columns": ["\\"col1 _4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1571378485231360322, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5610468287202693043}, {"avg_size": 22, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3768343292069782836, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5610468287202693043}, {"avg_size": 17, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1892602048933949184, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5610468287202693043}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 6, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 596129, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000}, {"avg_size": 23, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 923537, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000}, {"avg_size": 12, "columns": ["\\"col%q1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 896499, "histo_buckets": [{"distinct_range": 0, "num_eq": 275511623003462787, "num_range": 0, "upper_bound": "{y"}, {"distinct_range": 0, "num_eq": 40000, "num_range": 700, "upper_bound": "\U00002603"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 1000000}, {"avg_size": 17, "columns": ["\\"Col1\'_}0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 453938, "histo_buckets": [{"distinct_range": 0, "num_eq": 90, "num_range": 0, "upper_bound": "\\\\x370003000112610001"}, {"distinct_range": 0, "num_eq": 0, "num_range": 5505144910875274072, "upper_bound": "\\\\x370003000129097f73433d2d438f0a00"}, {"distinct_range": 907976720365055200, "num_eq": 9213545500093868074, "num_range": 907976720365055258, "upper_bound": "\\\\x3700030003000100"}, {"distinct_range": 0, "num_eq": 30, "num_range": 10000, "upper_bound": "\\\\x3700030003000112620001"}, {"distinct_range": 0, "num_eq": 60000000000, "num_range": 9203364103507959290, "upper_bound": "\\\\x37000300030003000100"}, {"distinct_range": 4593909671827221500, "num_eq": 0, "num_range": 4593909671827221554, "upper_bound": "\\\\x37000341364e00012a0323770da17d5d0f8200"}, {"distinct_range": 90, "num_eq": 2395201010697907454, "num_range": 90, "upper_bound": "\\\\x3700034c304d594f7965000100"}, {"distinct_range": 2112547007379329500, "num_eq": 3414175026200575087, "num_range": 2112547007379329587, "upper_bound": "\\\\x37000362617a000100"}, {"distinct_range": 840364413527949700, "num_eq": 50, "num_range": 1281527789489133320, "upper_bound": "\\\\x3700037636624d35344f75000129b7714f531f85b16600"}, {"distinct_range": 20851810093.354465, "num_eq": 80000, "num_range": 40000000000, "upper_bound": "\\\\x375a39697a4a374b00020003000100"}, {"distinct_range": 0, "num_eq": 4731328441512309929, "num_range": 4000000000, "upper_bound": "\\\\x375a39697a4a374b0002000300010a"}, {"distinct_range": 0, "num_eq": 8484753295365134050, "num_range": 800000, "upper_bound": "\\\\x375a39697a4a374b0002000300010b"}, {"distinct_range": 0, "num_eq": 5051231774334173462, "num_range": 0, "upper_bound": "\\\\x3762617a00011262617a0001"}, {"distinct_range": 0, "num_eq": 5116404051812421733, "num_range": 40000000, "upper_bound": "\\\\x3763000100"}, {"distinct_range": 0, "num_eq": 1412288048413227226, "num_range": 70, "upper_bound": "\\\\x37666f6f00010a"}, {"distinct_range": 1125693.870620813, "num_eq": 80000, "num_range": 4000000, "upper_bound": "\\\\x37666f6f626172000232660001125974326c5356544b0001"}, {"distinct_range": 0, "num_eq": 1000, "num_range": 113200295097788465, "upper_bound": "\\\\x37666f6f6261720002336e74744376000200030001126d71794b540001"}, {"distinct_range": 638059826816012700, "num_eq": 148215543270460812, "num_range": 638059826816012723, "upper_bound": "\\\\x37666f6f6261720002336e7474437600020003000300010a"}, {"distinct_range": 3672857434377043500, "num_eq": 7000, "num_range": 3672857434377043572, "upper_bound": "\\\\x37666f6f62617200026100010a"}, {"distinct_range": 20000000000, "num_eq": 7092361934589926797, "num_range": 20000000000, "upper_bound": "\\\\x37666f6f6261720002666f6f62617200010b"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 1000000}, {"avg_size": 28, "columns": ["\\"co\\"\\"l1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 618317, "histo_buckets": [{"distinct_range": 0, "num_eq": 50, "num_range": 0, "upper_bound": "00:00:00"}, {"distinct_range": 40000000000, "num_eq": 3978745027135412048, "num_range": 40000000000, "upper_bound": "02:44:49.877774"}, {"distinct_range": 81646771.4576948, "num_eq": 1279535689196698448, "num_range": 100000000, "upper_bound": "05:28:28.909772"}, {"distinct_range": 0, "num_eq": 3000000, "num_range": 1453788584537990226, "upper_bound": "06:29:24.20359"}, {"distinct_range": 115426575472575520, "num_eq": 3027214967519445075, "num_range": 1497185153035581465, "upper_bound": "08:08:33.116173"}, {"distinct_range": 100000, "num_eq": 2010000021599562567, "num_range": 100000, "upper_bound": "13:17:56.105443"}, {"distinct_range": 0, "num_eq": 20000000, "num_range": 0, "upper_bound": "16:24:08.704922"}, {"distinct_range": 0, "num_eq": 700000000, "num_range": 3889422192740279757, "upper_bound": "16:37:43.972914"}], "histo_col_type": "TIME", "name": "__auto__", "null_count": 0, "row_count": 1000000}, {"avg_size": 14, "columns": ["\\".col1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 726862, "histo_buckets": [{"distinct_range": 0, "num_eq": 1989167685648297665, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 0, "num_eq": 6000000000, "num_range": 2421377546199937658, "upper_bound": "981370850"}, {"distinct_range": 0, "num_eq": 6342988372833743024, "num_range": 8525769463107261542, "upper_bound": "1024830144"}], "histo_col_type": "OID", "name": "__auto__", "null_count": 205516, "row_count": 1000000}, {"avg_size": 17, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 941158, "histo_buckets": [{"distinct_range": 0, "num_eq": 3354465212497054579, "num_range": 0, "upper_bound": "-32644"}], "histo_col_type": "INT2", "name": "__auto__", "null_count": 0, "row_count": 1000000}, {"avg_size": 1, "columns": ["\\"col1 _4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 242641, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (31.49s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 5efa6ff20f56d2ce8111b710190d1b378adb26d9:

        postgres_1    |         col11122 DESC,
        postgres_1    |         col11123,
        postgres_1    |         CAST(col11124 AS TEXT) NULLS LAST,
        postgres_1    |         col11125 DESC,
        postgres_1    |         "co%vL11126" ASC NULLS LAST,
        postgres_1    |         col11127 NULLS FIRST,
        postgres_1    |         col11128 ASC NULLS FIRST,
        postgres_1    |         col11129 DESC,
        postgres_1    |         "'co%ql!%8e11130" NULLS FIRST
        test_1        | --- FAIL: TestCompare (11.55s)
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     --- FAIL: TestCompare/postgres (8.34s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1679460631/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("8"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT * FROM (SELECT regproc(8:::INT8::INT4::INT4)::REGPROC AS "col""11163") AS "ta b5769" ORDER BY "col""11163" DESC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT * FROM (SELECT regproc(8::INT8::INT4::INT4)::REGPROC AS "col""11163") AS "ta b5769" ORDER BY "col""11163" DESC;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.71s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "tablE1" (col1_̊0 VARCHAR NOT NULL, col1_1 INT4 NOT NULL, col1_2 "char" NOT NULL, col1_3 BIT(19) NOT NULL, "�col😔1_4" BOOL NOT NULL, "c)ol1_5" DATE NOT NULL, col1_6 INET NOT NULL, "co\fl1_7" STRING NOT NULL AS (lower(CAST("�col😔1_4" AS STRING))) VIRTUAL, col1_8 STRING NOT NULL AS (lower(CAST(col1_3 AS STRING))) VIRTUAL, col1_9 STRING NOT NULL AS (lower(col1_̊0)) VIRTUAL, col1_10 STRING NOT NULL AS (lower(CAST("�col😔1_4" AS STRING))) VIRTUAL, c😓ol1_11 STRING NOT NULL AS (CASE WHEN "c)ol1_5" IS NULL THEN 't&"S':::STRING ELSE 'X':::STRING END) VIRTUAL, col1_12 STRING NOT NULL AS (CASE WHEN "c)ol1_5" IS NULL THEN NULL ELSE e'C&r\'LMLH':::STRING END) VIRTUAL, PRIMARY KEY (col1_12 DESC, col1_8 ASC, "�col😔1_4", c😓ol1_11 DESC, col1_9, col1_1 ASC, "co\fl1_7" ASC, col1_̊0 ASC, "c)ol1_5" DESC, col1_10 DESC), UNIQUE (col1_8 ASC, col1_9 ASC, col1_10 ASC, c😓ol1_11, col1_̊0 ASC, col1_2, "�col😔1_4" DESC, col1_6 DESC) STORING (col1_3), UNIQUE (col1_10 ASC, col1_6 DESC, col1_8 DESC) WHERE (("tablE1".col1_10 < '"':::STRING) OR ("tablE1".col1_8 >= e'\'':::STRING)) OR ("tablE1".c😓ol1_11 < 'X':::STRING), INDEX (col1_6, "c)ol1_5" ASC, "co\fl1_7", col1_2 DESC, c😓ol1_11 ASC, col1_9 DESC, col1_̊0 DESC, col1_8, col1_3), UNIQUE (col1_12 ASC, col1_3 ASC, col1_6, c😓ol1_11, "c)ol1_5", "�col😔1_4", col1_8 ASC, col1_2 DESC, col1_10, lower(CAST(col1_3 AS STRING)), col1_1, "co\fl1_7" ASC) WHERE ((((((((NOT "tablE1"."�col😔1_4") AND ("tablE1".col1_12 = '"':::STRING)) OR ("tablE1".col1_8 = e'\'':::STRING)) OR ("tablE1"."co\fl1_7" > e'\'':::STRING)) AND ("tablE1"."c)ol1_5" >= '-infinity':::DATE)) OR ("tablE1".col1_1 > 0:::INT8)) OR ("tablE1".col1_2 < e'\x00':::STRING)) OR ("tablE1".col1_9 = 'X':::STRING)) OR ("tablE1".c😓ol1_11 = '"':::STRING), INDEX (col1_10 ASC, col1_12 DESC, col1_9 ASC, col1_6 ASC, col1_8 ASC, c😓ol1_11 DESC, col1_1 ASC, "co\fl1_7", lower(col1_̊0) DESC, col1_̊0 ASC), UNIQUE (col1_1 ASC, "�col😔1_4" ASC, c😓ol1_11 ASC, col1_8 ASC, "co\fl1_7", lower(col1_̊0)) WHERE ((((("tablE1".col1_1 > 2147483647:::INT8) AND ("tablE1".col1_9 < '':::STRING)) AND ("tablE1".c😓ol1_11 > '':::STRING)) AND ("tablE1"."c)ol1_5" < 'infinity':::DATE)) OR ("tablE1".col1_8 >= 'X':::STRING)) AND ("tablE1".col1_2 != 'X':::STRING), INDEX (col1_6 ASC, "c)ol1_5" ASC, "co\fl1_7", c😓ol1_11, col1_2 ASC, col1_8 ASC, col1_12) WHERE (((((((((("tablE1"."co\fl1_7" < 'X':::STRING) AND ("tablE1".col1_1 < (-32768):::INT8)) AND ("tablE1".col1_̊0 >= e'\U00002603':::STRING)) AND ("tablE1".col1_2 >= e'\U00002603':::STRING)) OR ("tablE1".c😓ol1_11 != '':::STRING)) AND ("tablE1"."c)ol1_5" = 'infinity':::DATE)) OR ("tablE1".col1_8 <= e'\x00':::STRING)) AND (NOT "tablE1"."�col😔1_4")) OR ("tablE1".col1_9 != e'\U00002603':::STRING)) OR ("tablE1".col1_10 < '':::STRING)) OR ("tablE1".col1_12 > 'X':::STRING), FAMILY (col1_6), FAMILY ("�col😔1_4"), FAMILY (col1_3), FAMILY (col1_2), FAMILY ("c)ol1_5"), FAMILY (col1_1, col1_̊0));
        test_1        |             ALTER TABLE "tablE1" INJECT STATISTICS e'[{"avg_size": 27, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 568336943, "histo_buckets": [{"distinct_range": 0, "num_eq": 6989215090515177581, "num_range": 0, "upper_bound": "\\u0000"}, {"distinct_range": 30000000000, "num_eq": 7904504478894883057, "num_range": 30000000000, "upper_bound": "\\""}, {"distinct_range": 8951180745272776000, "num_eq": 5413966532508461959, "num_range": 9008407335273969333, "upper_bound": "$"}, {"distinct_range": 4000, "num_eq": 8832957363395228564, "num_range": 4000, "upper_bound": "3S\\":"}, {"distinct_range": 5000, "num_eq": 441836233563365873, "num_range": 5000, "upper_bound": "MV<&/?\\u0002\\u001c("}, {"distinct_range": 5248318718192984000, "num_eq": 30000000000, "num_range": 5248318718192984450, "upper_bound": "\\\\\\u0004\\u00144\\u0005I,"}, {"distinct_range": 2474660463449645600, "num_eq": 2104158753076590978, "num_range": 3728888359144251393, "upper_bound": "w"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 600000000}, {"avg_size": 8, "columns": ["col1_\u030A0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 478824849, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 600000000}, {"avg_size": 23, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 83654327, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 600000000}, {"avg_size": 2, "columns": ["\\"c)ol1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 280380642, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 600000000}, {"avg_size": 22, "columns": ["\\"co\\\\fl1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 42997704, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 600000000}, {"avg_size": 7, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 13520547, "histo_buckets": [{"distinct_range": 0, "num_eq": 5222091980483226478, "num_range": 0, "upper_bound": "e\\\\Kx\\u0007VjFw"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 600000000}, {"avg_size": 2, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 475197965, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 600000000}, {"avg_size": 2, "columns": ["c\U0001F613ol1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 470608141, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 600000000}, {"avg_size": 6, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 274044422, "histo_buckets": [{"distinct_range": 0, "num_eq": 4000000000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 7897379799824314000, "num_eq": 3945967057045018544, "num_range": 7897379799824314437, "upper_bound": "\\u0000"}, {"distinct_range": 700000000, "num_eq": 1000, "num_range": 700000000, "upper_bound": "\\u0012uXmx\\n\\u0001T"}, {"distinct_range": 132809044995974340, "num_eq": 7029101595691375590, "num_range": 9078703403980992374, "upper_bound": " *\\u0013P"}, {"distinct_range": 80000, "num_eq": 1000000000, "num_range": 80000, "upper_bound": "\\"c~a.P"}, {"distinct_range": 371088040865456400, "num_eq": 8000, "num_range": 1406464482437467559, "upper_bound": "5\\u001a"}, {"distinct_range": 7058756794322606000, "num_eq": 6112062540207384341, "num_range": 7890749973549885070, "upper_bound": "8(lO4}"}, {"distinct_range": 0, "num_eq": 3944816887216318413, "num_range": 0, "upper_bound": "=OMi@I@H"}, {"distinct_range": 0, "num_eq": 6937645489650002420, "num_range": 5103106238056470443, "upper_bound": "~?jKw"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 600000000}, {"avg_size": 7, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 319672078, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "-1388468355"}, {"distinct_range": 7620437542392906000, "num_eq": 700000000, "num_range": 7620437542392906103, "upper_bound": "-1235857108"}, {"distinct_range": 50000000, "num_eq": 2055949892304751656, "num_range": 50000000, "upper_bound": "-24830668"}, {"distinct_range": 7052618473201340000, "num_eq": 40, "num_range": 7052618473201340316, "upper_bound": "32767"}, {"distinct_range": 0, "num_eq": 7331771208413320447, "num_range": 1999991518136931488, "upper_bound": "323950551"}, {"distinct_range": 0, "num_eq": 6000000, "num_range": 6000, "upper_bound": "1373910479"}], "histo_col_type": "INT4", "name": "__auto__", "null_count": 0, "row_count": 600000000}, {"avg_size": 12, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 106081975, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 600000000}, {"avg_size": 10, "columns": ["\\"\\u000ccol\U0001F6141_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 508993286, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 600000000}, {"avg_size": 29, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 237915442, "histo_buckets": [{"distinct_range": 0, "num_eq": 4083849290249800220, "num_range": 0, "upper_bound": "74.124.20.73/29"}, {"distinct_range": 3253074169051795000, "num_eq": 3171024811326151626, "num_range": 3253074169051795147, "upper_bound": "104f:965b:c5f8:d033:2fe5:2fa2:d512:4767/56"}, {"distinct_range": 10000000000, "num_eq": 7063201846532727327, "num_range": 10000000000, "upper_bound": "c3ef:5f15:9a79:a7ba:5069:2603:b76b:1706/61"}, {"distinct_range": 3249765952127477000, "num_eq": 4000000000, "num_range": 4115430838897677007, "upper_bound": "b06a:7b6e:cae9:130c:7c75:2524:6ec2:182e/99"}, {"distinct_range": 0, "num_eq": 6807731292660887917, "num_range": 0, "upper_bound": "ffff:ffff:ffff:ffff:ffff:ffff:ffff:ffff"}], "histo_col_type": "INET", "name": "__auto__", "null_count": 0, "row_count": 600000000}]':::JSONB;
        test_1        |             ALTER TABLE "tablE1" INJECT STATISTICS e'[{"avg_size": 21, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2983265954294119534, "histo_buckets": [{"distinct_range": 0, "num_eq": 8231772146461946244, "num_range": 0, "upper_bound": ""}, {"distinct_range": 260.7445080968781, "num_eq": 4550404475601876654, "num_range": 300, "upper_bound": "\\u0002"}, {"distinct_range": 153440.5144459171, "num_eq": 90000000000, "num_range": 400000, "upper_bound": "\\u0012Y$"}, {"distinct_range": 1669123024598108000, "num_eq": 500, "num_range": 7679604775611700337, "upper_bound": "\'"}, {"distinct_range": 0, "num_eq": 90000000, "num_range": 80000000000, "upper_bound": "Zk*.$"}, {"distinct_range": 0, "num_eq": 300, "num_range": 3700596132099459815, "upper_bound": "e\\u0001|u\\t\\u000c@"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 9044295531394253869}, {"avg_size": 26, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3835423500654486533, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9044295531394253869}, {"avg_size": 1, "columns": ["c\U0001F613ol1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3024510603604839725, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9044295531394253869}, {"avg_size": 19, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7327920260613240262, "histo_buckets": [{"distinct_range": 0, "num_eq": 2293525704580398410, "num_range": 0, "upper_bound": "$"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 9044295531394253869}, {"avg_size": 27, "columns": ["\\"c)ol1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8352429715731846810, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9044295531394253869}, {"avg_size": 14, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 119674004997531278, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9044295531394253869}, {"avg_size": 18, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 914448372159651873, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9044295531394253869}, {"avg_size": 27, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8491658008881750600, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9044295531394253869}, {"avg_size": 20, "columns": ["\\"\\u000ccol\U0001F6141_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1307194172621454655, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9044295531394253869}, {"avg_size": 31, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7418507887351241566, "histo_col_type": "INET", "name": "__auto__", "null_count": 0, "row_count": 9044295531394253869}, {"avg_size": 6, "columns": ["\\"co\\\\fl1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8128351998865122867, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9044295531394253869}, {"avg_size": 31, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2830900965967988702, "histo_buckets": [{"distinct_range": 0, "num_eq": 10000000000, "num_range": 0, "upper_bound": "W\\u0015\\u0014sF"}, {"distinct_range": 0, "num_eq": 100000000000, "num_range": 3820520210940617572, "upper_bound": "p[Rb\\u0010\\u001c\\u0012nw"}, {"distinct_range": 85267724945383550, "num_eq": 1000000000, "num_range": 283904994169378371, "upper_bound": "z.(\\u0017"}, {"distinct_range": 143.2604982165453, "num_eq": 8000000000, "num_range": 700, "upper_bound": "z\x7fhNo"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 9044295531394253869}, {"avg_size": 4, "columns": ["col1_\u030A0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7759751075514144721, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9044295531394253869}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (34.02s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 5efa6ff20f56d2ce8111b710190d1b378adb26d9:

        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-05-05 05:15:59.093 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-05-05 05:15:59.093 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-05-05 05:15:59.093 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-05-05 05:15:59.096 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-05-05 05:15:59.100 UTC [67] LOG:  database system was shut down at 2023-05-05 05:15:59 UTC
        postgres_1    | 2023-05-05 05:15:59.104 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-05-05 05:16:00.799 UTC [77] ERROR:  collation "en" for encoding "UTF8" does not exist at character 154
        postgres_1    | 2023-05-05 05:16:00.799 UTC [77] STATEMENT:  CREATE TABLE table2 (col2_0 REGTYPE, col2_1 INET NOT NULL, col2_2 INT2 NOT NULL, "co\\uF9F2l2😈_3" FLOAT8 NOT NULL, col2_4 TIMESTAMPTZ, "c̘'ol2%q_5" TEXT COLLATE en NOT NULL, col2_6 VARCHAR NULL, col2_7 VARCHAR, col2_8 TSVECTOR NOT NULL, col2_9 FLOAT4 NOT NULL, "co%ql2_10" TIMESTAMP NOT NULL, col2_11 REGCLASS, PRIMARY KEY ("c̘'ol2%q_5"));
        postgres_1    |     CREATE INDEX ON table2 (col2_0 ASC, "co\\uF9F2l2😈_3", "c̘'ol2%q_5" DESC, col2_1, col2_4 ASC, col2_11 DESC, col2_7 ASC, col2_6, ("co\\uF9F2l2😈_3" + col2_9) DESC, col2_2, col2_9 DESC);
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_0);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (4.96s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.12s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table2 (col2_0 REGTYPE, col2_1 INET NOT NULL, col2_2 INT2 NOT NULL, "co\\uF9F2l2😈_3" FLOAT8 NOT NULL, col2_4 TIMESTAMPTZ, "c̘'ol2%q_5" TEXT COLLATE en NOT NULL, col2_6 VARCHAR NULL, col2_7 VARCHAR, col2_8 TSVECTOR NOT NULL, col2_9 FLOAT4 NOT NULL, "co%ql2_10" TIMESTAMP NOT NULL, col2_11 REGCLASS, PRIMARY KEY ("c̘'ol2%q_5"));
        test_1        |             CREATE INDEX ON table2 (col2_0 ASC, "co\\uF9F2l2😈_3", "c̘'ol2%q_5" DESC, col2_1, col2_4 ASC, col2_11 DESC, col2_7 ASC, col2_6, ("co\\uF9F2l2😈_3" + col2_9) DESC, col2_2, col2_9 DESC);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_0);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "en" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.72s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "ta%vble1" ("co😞l1_%p0" BOX2D NULL, col1_1 STRING COLLATE da NOT NULL, "co\\uAD77l1_2" GEOMETRY NOT NULL, col1_3 INT2 NOT NULL, " col͏1_4" NAME, col1_5 INTERVAL NOT NULL, "col1_'6" TSQUERY NOT NULL, "c!ol1_7" STRING NOT NULL AS (lower(CAST(col1_1 AS STRING))) STORED, col1_8 INT8 NOT NULL AS (col1_3 + 15939:::INT8) STORED, col1_9 STRING NOT NULL AS (lower(CAST("co\\uAD77l1_2" AS STRING))) STORED, "c)o""l1_10" STRING NOT NULL AS (lower(CAST("co\\uAD77l1_2" AS STRING))) STORED, col1_11 STRING AS (lower(" col͏1_4")) VIRTUAL, UNIQUE (col1_9 DESC, col1_5 DESC, col1_3) STORING (col1_1, col1_8) WHERE ("ta%vble1"."c)o""l1_10" > e'\U00002603':::STRING) AND ("ta%vble1".col1_3 < (-128):::INT8), FAMILY (col1_3), FAMILY (col1_1), FAMILY (col1_8, "c)o""l1_10"), FAMILY ("c!ol1_7"), FAMILY ("col1_'6"), FAMILY ("co😞l1_%p0"), FAMILY (col1_5), FAMILY (" col͏1_4", "co\\uAD77l1_2"), FAMILY (col1_9));
        test_1        |             ALTER TABLE "ta%vble1" INJECT STATISTICS e'[{"avg_size": 10, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7702, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8000}, {"avg_size": 16, "columns": ["\\"co\U0001F61El1_%p0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1659, "histo_col_type": "", "name": "__auto__", "null_count": 6321, "row_count": 8000}, {"avg_size": 22, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7315, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8000}, {"avg_size": 23, "columns": ["\\" col\u034F1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5503, "histo_col_type": "", "name": "__auto__", "null_count": 3606, "row_count": 8000}, {"avg_size": 17, "columns": ["\\"col1_\'6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1798, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8000}, {"avg_size": 30, "columns": ["\\"c!ol1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2058, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8000}, {"avg_size": 21, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4967, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8000}, {"avg_size": 20, "columns": ["\\"c)o\\"\\"l1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7366, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8000}, {"avg_size": 9, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4613, "histo_col_type": "", "name": "__auto__", "null_count": 7937, "row_count": 8000}, {"avg_size": 4, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5191, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8000}, {"avg_size": 2, "columns": ["\\"co\\\\\\\\uAD77l1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6700, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8000}, {"avg_size": 24, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4143, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8000}]':::JSONB;
        test_1        |             ALTER TABLE "ta%vble1" INJECT STATISTICS e'[{"avg_size": 0, "columns": ["\\"c)o\\"\\"l1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2140, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6000}, {"avg_size": 11, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1800, "histo_col_type": "", "name": "__auto__", "null_count": 937, "row_count": 6000}, {"avg_size": 6, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2541, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6000}, {"avg_size": 29, "columns": ["\\"co\\\\\\\\uAD77l1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5163, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6000}, {"avg_size": 30, "columns": ["\\"col1_\'6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3106, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6000}, {"avg_size": 7, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 401, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6000}, {"avg_size": 30, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4695, "histo_buckets": [{"distinct_range": 0, "num_eq": 5650872838125772833, "num_range": 0, "upper_bound": "\\u0002L\\u0015S"}, {"distinct_range": 4796215667594496000, "num_eq": 1000000000, "num_range": 4796215667594495593, "upper_bound": "\\u0003b\\u0015\\u0003c6j"}, {"distinct_range": 2927066926563013000, "num_eq": 5556625975816950347, "num_range": 3620243897761348933, "upper_bound": "@\\\\)E8s\\"BS"}, {"distinct_range": 0, "num_eq": 70000000000, "num_range": 7635205662650927800, "upper_bound": "HdY\\u0002\\u000c"}, {"distinct_range": 2537070095717063000, "num_eq": 7264042685236353995, "num_range": 6713529063503678876, "upper_bound": "]494N@\\r6{"}, {"distinct_range": 4343227280988672000, "num_eq": 4157548950053252685, "num_range": 5961068998234517332, "upper_bound": "jAs%pk\\u0013"}, {"distinct_range": 0, "num_eq": 90000000, "num_range": 8780155490827928272, "upper_bound": "pyMMc\\u001e$2"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 6000}, {"avg_size": 29, "columns": ["\\"co\U0001F61El1_%p0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 383, "histo_col_type": "", "name": "__auto__", "null_count": 2970, "row_count": 6000}, {"avg_size": 9, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1058, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6000}, {"avg_size": 4, "columns": ["\\" col\u034F1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 423, "histo_col_type": "", "name": "__auto__", "null_count": 1826, "row_count": 6000}, {"avg_size": 9, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3786, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6000}, {"avg_size": 17, "columns": ["\\"c!ol1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3273, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (18.72s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 29ed08a512389e42ccccdde0906e34a301c28b4a:

        postgres_1    |         col10314 NULLS FIRST,
        postgres_1    |         " c%9ao%pl10315" DESC NULLS FIRST,
        postgres_1    |         col10316,
        postgres_1    |         col10317 ASC NULLS LAST,
        postgres_1    |         "cͨ%vol10318" ASC NULLS LAST,
        postgres_1    |         co😆l10319
        postgres_1    | 2023-05-06 05:20:11.121 UTC [78] ERROR:  could not identify an ordering operator for type void at character 67
        postgres_1    | 2023-05-06 05:20:11.121 UTC [78] HINT:  Use an explicit ordering operator or modify the query.
        postgres_1    | 2023-05-06 05:20:11.121 UTC [78] STATEMENT:  SELECT * FROM (SELECT NULL::VOID AS col10320) AS tab5903 ORDER BY col10320 ASC
        test_1        | --- FAIL: TestCompare (13.70s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (8.95s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2698665433/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("6"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT * FROM (SELECT regproc(6:::INT8::INT4::INT4)::REGPROC AS "col 10321") AS tab5904 ORDER BY "col 10321" NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT * FROM (SELECT regproc(6::INT8::INT4::INT4)::REGPROC AS "col 10321") AS tab5904 ORDER BY "col 10321" NULLS LAST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.61s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 ("c/ol1_0" TIME, "'%vcol1_1" VARCHAR NOT NULL, col1_2 GEOGRAPHY NOT NULL, UNIQUE ("c/ol1_0" ASC) STORING ("'%vcol1_1") PARTITION BY LIST ("c/ol1_0") (PARTITION table1͉_part0 VALUES IN (('01:35:39.061588':::TIME,), ('07:42:14.013555':::TIME,), ('17:19:24.555803':::TIME,), ('00:00:00':::TIME,), ('07:10:50.547104':::TIME,), ('24:00:00':::TIME,)), PARTITION ťabl😺e1_part1 VALUES IN (('03:30:44.651182':::TIME,), ('19:57:01.251158':::TIME,), ('05:16:23.983906':::TIME,), ('18:26:44.67527':::TIME,), ('04:23:23.749358':::TIME,)), PARTITION table1_part2 VALUES IN (('11:41:26.287128':::TIME,), ('19:39:39.956301':::TIME,), ('18:29:37.672382':::TIME,), ('16:38:39.562261':::TIME,), ('14:44:10.587494':::TIME,), ('18:14:27.651582':::TIME,))), INVERTED INDEX ("'%vcol1_1" DESC, "c/ol1_0" DESC, col1_2 ASC) WHERE table1."'%vcol1_1" != e'\U00002603':::STRING, INVERTED INDEX (col1_2), INDEX (lower("'%vcol1_1") DESC, "'%vcol1_1") STORING ("c/ol1_0") WHERE (table1."c/ol1_0" > '00:00:00':::TIME) OR (table1."'%vcol1_1" >= e'\U00002603':::STRING), INDEX ("'%vcol1_1" DESC, lower("'%vcol1_1") ASC) WHERE (table1."'%vcol1_1" != '':::STRING) OR (table1."c/ol1_0" < '24:00:00':::TIME), INVERTED INDEX ("'%vcol1_1" gin_trgm_ops) WHERE (table1."'%vcol1_1" >= e'\'':::STRING) AND (table1."c/ol1_0" = '24:00:00':::TIME), INVERTED INDEX ("c/ol1_0", col1_2) WHERE table1."c/ol1_0" = '00:00:00':::TIME, INDEX ("c/ol1_0") WHERE (table1."'%vcol1_1" != '':::STRING) OR (table1."c/ol1_0" <= '24:00:00':::TIME), FAMILY (col1_2, "c/ol1_0"), FAMILY ("'%vcol1_1"));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 6, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 24622, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "\\\\x42fd100000000000000000bfe289d5656154cebff290f382fb460dbfffb1fe76a01c303ff7b129a2d41235"}, {"distinct_range": 0, "num_eq": 80000000, "num_range": 2000, "upper_bound": "\\\\x42fd100000000000000000c00921fb54442d18bff8968a5f3ee1d6400921fb54442d183ff8fc4cc65f7a31"}, {"distinct_range": 201590267.3502774, "num_eq": 241708402728807442, "num_range": 2000000000, "upper_bound": "\\\\x42fd100000000000000000c00921fb54442d18bff8b9c8afaf7d1f400921fb54442d183ff8e5da4d190dd8"}, {"distinct_range": 3187801093800084500, "num_eq": 9135809301828310147, "num_range": 4150261655569874266, "upper_bound": "\\\\x42fd100000000000000000c00921fb54442d18bff8e6002a35ac39400921fb54442d183ff85b6c031f90be"}, {"distinct_range": 10163.767229475263, "num_eq": 700000000, "num_range": 40000, "upper_bound": "\\\\x42fd2d0000000000000000bfe289d5656154cebff290f382fb460dbfffb1fe76a01c303ff7b129a2d41235"}, {"distinct_range": 0, "num_eq": 8000, "num_range": 5239399843322718763, "upper_bound": "\\\\x42fd300000000000000000c00921fb54442d18bff8968a5f3ee1d6400921fb54442d183ff8fc4cc65f7a31"}, {"distinct_range": 2171458675621185500, "num_eq": 60000, "num_range": 4141988276974448026, "upper_bound": "\\\\x42fd300000000000000000c00921fb54442d18bff8b9c8afaf7d1f400921fb54442d183ff8e5da4d190dd8"}, {"distinct_range": 0, "num_eq": 7125201048986344218, "num_range": 3391765264881218761, "upper_bound": "\\\\x42fd300000000000000000c00921fb54442d18bff8e6002a35ac39400921fb54442d183ff85b6c031f90be"}, {"distinct_range": 4661598340594991000, "num_eq": 3000000000, "num_range": 7439752838483468047, "upper_bound": "\\\\x42fd3100000000000000003ff3ccef8feaa900bfef91e83329962840076868497818253ff73572f9f4927e"}, {"distinct_range": 0, "num_eq": 7227254666544900590, "num_range": 0, "upper_bound": "\\\\x42fd3540000000000000003ff3ccef8feaa900bfef91e83329962840076868497818253ff73572f9f4927e"}, {"distinct_range": 0, "num_eq": 80, "num_range": 8000000000, "upper_bound": "\\\\x42fd3700000000000000003ff3ccef8feaa900bfef91e83329962840076868497818253ff73572f9f4927e"}, {"distinct_range": 60000000000, "num_eq": 4782247240071225574, "num_range": 60000000000, "upper_bound": "\\\\x42fd492c8adeb0589c1101bfde3437d5eeb2e13ff1ea2a6a98da41"}, {"distinct_range": 200000, "num_eq": 700000000, "num_range": 200000, "upper_bound": "\\\\x42fd5000000000000000003ff3ccef8feaa900bfef91e83329962840076868497818253ff73572f9f4927e"}, {"distinct_range": 0, "num_eq": 100000, "num_range": 100000000, "upper_bound": "\\\\x42fd500000000000000000bfe289d5656154cebff290f382fb460dbfffb1fe76a01c303ff7b129a2d41235"}, {"distinct_range": 1262674921226809600, "num_eq": 8362396595449980602, "num_range": 3163521056153345206, "upper_bound": "\\\\x42fd500000000000000000c00921fb54442d18bff8968a5f3ee1d6400921fb54442d183ff8fc4cc65f7a31"}, {"distinct_range": 47140.55482352138, "num_eq": 40000000000, "num_range": 100000, "upper_bound": "\\\\x42fd500000000000000000c00921fb54442d18bff8b9c8afaf7d1f400921fb54442d183ff8e5da4d190dd8"}, {"distinct_range": 199748157767562900, "num_eq": 9000000000, "num_range": 2763413643363698251, "upper_bound": "\\\\x42fd500000000000000000c00921fb54442d18bff8e6002a35ac39400921fb54442d183ff85b6c031f90be"}, {"distinct_range": 0, "num_eq": 0, "num_range": 70, "upper_bound": "\\\\x42fd640000000000000000bfe289d5656154cebff290f382fb460dbfffb1fe76a01c303ff7b129a2d41235"}, {"distinct_range": 1996698089431071500, "num_eq": 7761252262654484290, "num_range": 1996698089431071431, "upper_bound": "\\\\x42fd6c0000000000000000bfe289d5656154cebff290f382fb460dbfffb1fe76a01c303ff7b129a2d41235"}, {"distinct_range": 400000000, "num_eq": 900000000, "num_range": 400000000, "upper_bound": "\\\\x42fd7000000000000000003ff3ccef8feaa900bfef91e83329962840076868497818253ff73572f9f4927e"}, {"distinct_range": 1867313151644028700, "num_eq": 4747266632836593993, "num_range": 4455242523762022730, "upper_bound": "\\\\x42fd700000000000000000c00921fb54442d18bff8968a5f3ee1d6400921fb54442d183ff8fc4cc65f7a31"}, {"distinct_range": 0, "num_eq": 300, "num_range": 1191332527049989630, "upper_bound": "\\\\x42fd700000000000000000c00921fb54442d18bff8b9c8afaf7d1f400921fb54442d183ff8e5da4d190dd8"}, {"distinct_range": 0, "num_eq": 8508301453791106451, "num_range": 6085743018446049422, "upper_bound": "\\\\x42fd700000000000000000c00921fb54442d18bff8e6002a35ac39400921fb54442d183ff85b6c031f90be"}, {"distinct_range": 0, "num_eq": 6836850328132439021, "num_range": 400000000, "upper_bound": "\\\\x42fd900000000000000000c00921fb54442d18bff8968a5f3ee1d6400921fb54442d183ff8fc4cc65f7a31"}, {"distinct_range": 0, "num_eq": 4000, "num_range": 4941921145619368238, "upper_bound": "\\\\x42fd900000000000000000c00921fb54442d18bff8b9c8afaf7d1f400921fb54442d183ff8e5da4d190dd8"}, {"distinct_range": 2735.729903413328, "num_eq": 50000000000, "num_range": 3000, "upper_bound": "\\\\x42fd900000000000000000c00921fb54442d18bff8e6002a35ac39400921fb54442d183ff85b6c031f90be"}, {"distinct_range": 0, "num_eq": 4000, "num_range": 600, "upper_bound": "\\\\x42fdb000000000000000003ff3ccef8feaa900bfef91e83329962840076868497818253ff73572f9f4927e"}, {"distinct_range": 1380688.3431177018, "num_eq": 700000000, "num_range": 2000000, "upper_bound": "\\\\x42fdb00000000000000000c00921fb54442d18bff8968a5f3ee1d6400921fb54442d183ff8fc4cc65f7a31"}, {"distinct_range": 0, "num_eq": 6327331907784697701, "num_range": 9000, "upper_bound": "\\\\x42fdb00000000000000000c00921fb54442d18bff8b9c8afaf7d1f400921fb54442d183ff8e5da4d190dd8"}, {"distinct_range": 107842.88525713173, "num_eq": 8000000, "num_range": 600000, "upper_bound": "\\\\x42fdb00000000000000000c00921fb54442d18bff8e6002a35ac39400921fb54442d183ff85b6c031f90be"}, {"distinct_range": 7762262.351229391, "num_eq": 10000, "num_range": 600000000, "upper_bound": "\\\\x42fdb90000000000000000bfe289d5656154cebff290f382fb460dbfffb1fe76a01c303ff7b129a2d41235"}, {"distinct_range": 0, "num_eq": 1631029827829787726, "num_range": 600000, "upper_bound": "\\\\x42fdbbd400000000000000bfe289d5656154cebff290f382fb460dbfffb1fe76a01c303ff7b129a2d41235"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 80000}, {"avg_size": 16, "columns": ["\\"c/ol1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 64736, "histo_buckets": [{"distinct_range": 0, "num_eq": 6000, "num_range": 0, "upper_bound": "00:00:00"}, {"distinct_range": 2821104416245390300, "num_eq": 40000, "num_range": 3619993147817687978, "upper_bound": "00:16:26.338941"}, {"distinct_range": 1587298119699662800, "num_eq": 575294333313814483, "num_range": 1587298119699662887, "upper_bound": "03:45:46.356569"}, {"distinct_range": 4354879730856381400, "num_eq": 10000, "num_range": 4354879730856381461, "upper_bound": "08:27:17.848491"}], "histo_col_type": "TIME", "name": "__auto__", "null_count": 6098, "row_count": 80000}, {"avg_size": 5, "columns": ["\\"\'%vcol1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 47946, "histo_buckets": [{"distinct_range": 0, "num_eq": 400, "num_range": 0, "upper_bound": ""}, {"distinct_range": 0, "num_eq": 0, "num_range": 8000000, "upper_bound": "\\u0015R>"}], "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 0, "row_count": 80000}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 13, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 352641, "histo_buckets": [{"distinct_range": 0, "num_eq": 1000000, "num_range": 0, "upper_bound": "\\\\x42fd092ce78e960784eb00c007a428ea102f23bff2e980522b35753feac98ecf5c12bd3ff86b539f33aea4"}, {"distinct_range": 0, "num_eq": 3610187895371150986, "num_range": 6180646462203746122, "upper_bound": "\\\\x42fd1831203578aeb6e9003fe46c85507afe02bfd4ad6e5c92e325c0007e32627060ca3ff35d24dd7d6ec5"}, {"distinct_range": 0, "num_eq": 7147351771096345166, "num_range": 0, "upper_bound": "\\\\x42fd4558046cb66ab69f00c007a428ea102f23bff2e980522b35753feac98ecf5c12bd3ff86b539f33aea4"}, {"distinct_range": 0, "num_eq": 3265560947022632261, "num_range": 8155812372450499277, "upper_bound": "\\\\x42fd519dc877729b54f9003fe46c85507afe02bfd4ad6e5c92e325c0007e32627060ca3ff35d24dd7d6ec5"}, {"distinct_range": 90, "num_eq": 776083121478565878, "num_range": 90, "upper_bound": "\\\\x42fd60ca296561e2b0e7003fe46c85507afe02bfd4ad6e5c92e325c0007e32627060ca3ff35d24dd7d6ec5"}, {"distinct_range": 0, "num_eq": 4000, "num_range": 70000, "upper_bound": "\\\\x42fd6e979871bf981b9b003fe46c85507afe02bfd4ad6e5c92e325c0007e32627060ca3ff35d24dd7d6ec5"}, {"distinct_range": 0, "num_eq": 4000000, "num_range": 8631742987751706395, "upper_bound": "\\\\x42fd732803dc023142af00c007a428ea102f23bff2e980522b35753feac98ecf5c12bd3ff86b539f33aea4"}, {"distinct_range": 0, "num_eq": 5376773836390075730, "num_range": 80, "upper_bound": "\\\\x42fdb16b6a72f0d0a98500c007a428ea102f23bff2e980522b35753feac98ecf5c12bd3ff86b539f33aea4"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 30, "columns": ["\\"c/ol1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 370029, "histo_col_type": "TIME", "name": "__auto__", "null_count": 398549, "row_count": 400000}, {"avg_size": 16, "columns": ["\\"\'%vcol1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 91223, "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 0, "row_count": 400000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (37.05s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 29ed08a512389e42ccccdde0906e34a301c28b4a:

        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (3.22s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1889369333/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("6"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(6:::OID::OID::OID)::REGPROCEDURE AS "c\\uE79Aol3462") AS "ta%q�b%p1867"
        test_1        |             ORDER BY
        test_1        |                 "c\\uE79Aol3462" DESC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(6::OID::OID::OID)::REGPROCEDURE AS "c\\uE79Aol3462") AS "ta%q�b%p1867"
        test_1        |             ORDER BY
        test_1        |                 "c\\uE79Aol3462" DESC;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.54s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "t\\U000A9212able1" (col1_0 STRING NOT NULL, "col1%q_1" GEOMETRY NOT NULL, col1_2 INT4 NOT NULL, col1_3 INT8 NOT NULL, "col|1_4" REGTYPE, "col1)_5" CHAR NOT NULL, UNIQUE (col1_0, "col|1_4") STORING ("col1%q_1", col1_3, "col1)_5") WHERE ("t\\U000A9212able1".col1_2 != (-2147483648):::INT8) AND ("t\\U000A9212able1"."col1)_5" <= '"':::STRING), INDEX (col1_2 DESC, "col1)_5" ASC, col1_0 ASC, col1_3 ASC) WHERE ("t\\U000A9212able1"."col1)_5" = e'\U00002603':::STRING) OR ("t\\U000A9212able1".col1_0 > e'\U00002603':::STRING), UNIQUE (col1_0 DESC) WHERE (("t\\U000A9212able1".col1_2 <= (-1):::INT8) AND ("t\\U000A9212able1"."col1)_5" <= e'\U00002603':::STRING)) OR ("t\\U000A9212able1".col1_0 = '':::STRING), UNIQUE (col1_0 DESC, "col1)_5" ASC, col1_3, lower(col1_0)) STORING ("col1%q_1", "col|1_4") WHERE ((("t\\U000A9212able1".col1_0 != '"':::STRING) OR ("t\\U000A9212able1"."col1)_5" = '':::STRING)) OR ("t\\U000A9212able1".col1_2 >= 32767:::INT8)) OR ("t\\U000A9212able1".col1_3 = 127:::INT8), UNIQUE ("col|1_4", "col1)_5" ASC, col1_2 DESC, col1_0 ASC) STORING ("col1%q_1", col1_3) WHERE ((("t\\U000A9212able1".col1_3 > (-32768):::INT8) OR ("t\\U000A9212able1"."col1)_5" != e'\x00':::STRING)) AND ("t\\U000A9212able1".col1_2 >= 32767:::INT8)) AND ("t\\U000A9212able1".col1_0 >= '':::STRING), FAMILY ("col1)_5"), FAMILY (col1_2, "col1%q_1", "col|1_4"), FAMILY (col1_0), FAMILY (col1_3));
        test_1        |             ALTER TABLE "t\\U000A9212able1" INJECT STATISTICS e'[{"avg_size": 2, "columns": ["\\"col|1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 50319580218728791, "histo_buckets": [{"distinct_range": 0, "num_eq": 50, "num_range": 0, "upper_bound": "1319477002"}, {"distinct_range": 700, "num_eq": 10000000, "num_range": 700, "upper_bound": "1975285335"}, {"distinct_range": 6105587181.844139, "num_eq": 1000, "num_range": 7000000000, "upper_bound": "2476667953"}, {"distinct_range": 0, "num_eq": 6572625027974310383, "num_range": 4607136377554097085, "upper_bound": "3146657464"}, {"distinct_range": 0, "num_eq": 20000000, "num_range": 4234175988128619424, "upper_bound": "3768377682"}, {"distinct_range": 0, "num_eq": 6876454587205452004, "num_range": 0, "upper_bound": "4139723861"}], "histo_col_type": "REGTYPE", "name": "__auto__", "null_count": 179893584688664944, "row_count": 326809764463362997}, {"avg_size": 26, "columns": ["\\"col1)_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 228210746301913543, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 326809764463362997}, {"avg_size": 12, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 61084212366262221, "histo_buckets": [{"distinct_range": 0, "num_eq": 10000000, "num_range": 0, "upper_bound": "I*\\u0014_\'\\"\\u000c;C"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 326809764463362997}, {"avg_size": 7, "columns": ["\\"col1%q_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 200906787907572310, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 326809764463362997}, {"avg_size": 24, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 234881402263995941, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 326809764463362997}, {"avg_size": 9, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 172661194766891865, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 326809764463362997}]':::JSONB;
        test_1        |             ALTER TABLE "t\\U000A9212able1" INJECT STATISTICS e'[{"avg_size": 13, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 772391056842823269, "histo_buckets": [{"distinct_range": 0, "num_eq": 40000000000, "num_range": 0, "upper_bound": "\\n"}, {"distinct_range": 0, "num_eq": 2357900800313485948, "num_range": 20000, "upper_bound": "\\""}, {"distinct_range": 50000, "num_eq": 5845659043956808621, "num_range": 50000, "upper_bound": "i\\u0016[.."}, {"distinct_range": 466035574.49342006, "num_eq": 3490763754876048050, "num_range": 900000000, "upper_bound": "ytmR"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 1700826103358593179}, {"avg_size": 10, "columns": ["\\"col1%q_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 238892950933907558, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1700826103358593179}, {"avg_size": 16, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1612366276835826438, "histo_buckets": [{"distinct_range": 0, "num_eq": 30000000, "num_range": 0, "upper_bound": "-2147483648"}, {"distinct_range": 0, "num_eq": 40000, "num_range": 0, "upper_bound": "-32768"}, {"distinct_range": 8673738.882209018, "num_eq": 0, "num_range": 400000000, "upper_bound": "32767"}, {"distinct_range": 8149966505689783000, "num_eq": 500000000, "num_range": 8149966505689783537, "upper_bound": "93134872"}, {"distinct_range": 5585388027026660000, "num_eq": 80, "num_range": 5585388027026660342, "upper_bound": "300366138"}, {"distinct_range": 9000, "num_eq": 20000000, "num_range": 9000, "upper_bound": "322546371"}, {"distinct_range": 3309842038328041500, "num_eq": 7720753550456987528, "num_range": 6028543821198470450, "upper_bound": "862433682"}, {"distinct_range": 700, "num_eq": 8000000, "num_range": 700, "upper_bound": "1084538633"}, {"distinct_range": 1000000000, "num_eq": 3685637556400762411, "num_range": 1000000000, "upper_bound": "1366782062"}], "histo_col_type": "INT4", "name": "__auto__", "null_count": 0, "row_count": 1700826103358593179}, {"avg_size": 14, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1187720411803835755, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1700826103358593179}, {"avg_size": 3, "columns": ["\\"col|1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 890287708689867355, "histo_buckets": [{"distinct_range": 0, "num_eq": 635642134421312901, "num_range": 0, "upper_bound": "370108493"}, {"distinct_range": 0, "num_eq": 48913672825709486, "num_range": 4432639826059974379, "upper_bound": "744215132"}, {"distinct_range": 90000000, "num_eq": 9110713329570235660, "num_range": 90000000, "upper_bound": "1196282495"}, {"distinct_range": 10917246.29884691, "num_eq": 90000, "num_range": 90000000, "upper_bound": "2875897033"}, {"distinct_range": 4144793124445966300, "num_eq": 10000, "num_range": 7625208507587857660, "upper_bound": "3860548815"}, {"distinct_range": 0, "num_eq": 866353816915183837, "num_range": 700000, "upper_bound": "4147852039"}], "histo_col_type": "REGTYPE", "name": "__auto__", "null_count": 1157746229117971860, "row_count": 1700826103358593179}, {"avg_size": 16, "columns": ["\\"col1)_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1649752377979456851, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1700826103358593179}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (24.51s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 29ed08a512389e42ccccdde0906e34a301c28b4a:

        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("100000000000000000000000000000000000000000000"),
        test_1        |             +   nil,
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         "taB4668".c_ol6840 AS "co""l6841"
        test_1        |                     FROM
        test_1        |                         (VALUES (B'0000'::BIT(45)), (B'1000'::BIT(45)), (B'0110'::BIT(45)), (NULL::BIT(45))) AS "taB4668" (c_ol6840)
        test_1        |                     ORDER BY
        test_1        |                         "taB4668".c_ol6840 ASC NULLS FIRST,
        test_1        |                         "taB4668".c_ol6840,
        test_1        |                         "taB4668".c_ol6840 ASC NULLS FIRST,
        test_1        |                         "taB4668".c_ol6840 NULLS FIRST,
        test_1        |                         "taB4668".c_ol6840 DESC,
        test_1        |                         "taB4668".c_ol6840 DESC NULLS LAST,
        test_1        |                         "taB4668".c_ol6840 DESC NULLS FIRST
        test_1        |                 )
        test_1        |                     AS tab4669
        test_1        |             ORDER BY
        test_1        |                 "co""l6841" DESC;
        test_1        |             
        test_1        |             postgres: [same as previous]
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.79s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 BIT(4) NULL, col1_1 TSQUERY NOT NULL, _col1_2 BYTES NULL, col1_3 STRING COLLATE de NOT NULL, UNIQUE (col1_0 DESC, _col1_2) WHERE table1._col1_2 != '\x00':::BYTES, FAMILY (col1_0, col1_1), FAMILY (_col1_2), FAMILY (col1_3));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS '[{"avg_size": 4, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3586860454997408409, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8274757704674153221}, {"avg_size": 24, "columns": ["_col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5298016040983728726, "histo_col_type": "", "name": "__auto__", "null_count": 7278188759069440322, "row_count": 8274757704674153221}, {"avg_size": 24, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4865307145407719207, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8274757704674153221}, {"avg_size": 4, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3771146469705807671, "histo_col_type": "", "name": "__auto__", "null_count": 1965547482262368737, "row_count": 8274757704674153221}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS '[{"avg_size": 0, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 3094837944336121735, "num_range": 0, "upper_bound": "0000"}], "histo_col_type": "BIT(4)", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["_col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (35.89s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

        postgres_1    |     ORDER BY
        postgres_1    |         "'col20041",
        postgres_1    |         col20042 ASC,
        postgres_1    |         "?col20043" NULLS FIRST,
        postgres_1    |         ".col20044" NULLS FIRST,
        postgres_1    |         "\\U000A6AC8😅col""20045" ASC NULLS FIRST,
        postgres_1    |         col20046 ASC NULLS LAST,
        postgres_1    |         col😎20047 ASC NULLS LAST,
        postgres_1    |         col20048 DESC NULLS FIRST
        test_1        | --- FAIL: TestCompare (24.27s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (19.33s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2989343022/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("6"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT * FROM (SELECT regproc(6:::INT8::INT4::INT4)::REGPROC AS col20049) AS "ta\vb11377" ORDER BY col20049 DESC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT * FROM (SELECT regproc(6::INT8::INT4::INT4)::REGPROC AS col20049) AS "ta\vb11377" ORDER BY col20049 DESC;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.80s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 BOOL NOT NULL, ".col1(_1" GEOGRAPHY NOT NULL, "co l1_'2" TIME NOT NULL, PRIMARY KEY ("co l1_'2" ASC), UNIQUE (col1_0 DESC, "co l1_'2" ASC) WHERE table1.col1_0 AND (table1."co l1_'2" < '00:00:00':::TIME), INDEX (col1_0, "co l1_'2" DESC) WHERE table1."co l1_'2" < '24:00:00':::TIME, UNIQUE (col1_0 ASC) STORING (".col1(_1") WHERE NOT table1.col1_0, UNIQUE ("co l1_'2" ASC, col1_0 ASC, lower(CAST(col1_0 AS STRING)) ASC), FAMILY (col1_0, ".col1(_1", "co l1_'2"));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 18, "columns": ["\\"co l1_\'2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 36086356163340771, "histo_col_type": "TIME", "name": "__auto__", "null_count": 0, "row_count": 62974699819317115}, {"avg_size": 0, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 62413057709748158, "histo_buckets": [{"distinct_range": 0, "num_eq": 300, "num_range": 0, "upper_bound": "false"}], "histo_col_type": "BOOL", "name": "__auto__", "null_count": 0, "row_count": 62974699819317115}, {"avg_size": 28, "columns": ["\\".col1(_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 18724617979307397, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 62974699819317115}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 27, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3600162855556600103, "histo_buckets": [{"distinct_range": 0, "num_eq": 90, "num_range": 0, "upper_bound": "false"}], "histo_col_type": "BOOL", "name": "__auto__", "null_count": 0, "row_count": 6132427026178038078}, {"avg_size": 29, "columns": ["\\".col1(_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2077748876818609280, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6132427026178038078}, {"avg_size": 25, "columns": ["\\"co l1_\'2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5574345291001796336, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "00:00:00"}, {"distinct_range": 102313156220914960, "num_eq": 900000000, "num_range": 686308047400450697, "upper_bound": "03:23:29.569928"}, {"distinct_range": 88501604863414660, "num_eq": 70000000, "num_range": 1607869001528629584, "upper_bound": "17:17:43.913634"}, {"distinct_range": 0, "num_eq": 509638085134599801, "num_range": 1000000, "upper_bound": "19:12:48.774856"}, {"distinct_range": 1920877926091338800, "num_eq": 20000000, "num_range": 3677232861193379017, "upper_bound": "20:46:06.445736"}, {"distinct_range": 0, "num_eq": 5790077331426215866, "num_range": 8216747432036048916, "upper_bound": "24:00:00"}], "histo_col_type": "TIME", "name": "__auto__", "null_count": 0, "row_count": 6132427026178038078}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (47.99s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

        postgres_1    |     1" (col1_14 DESC, lower(CAST(col1_5 AS TEXT)), col1_13 DESC, " coL1_17", col1_5 ASC, col1̖_3, col1_8 DESC, col1_9 DESC, col1_10 ASC, "col1%91_7" DESC, "�col1_0") INCLUDE ("cO l1_1", " col1_2", col1__11, col1_12, col1_16);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.92s)
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     --- FAIL: TestCompare/postgres (1.28s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "ta
        test_1        |             ble
        test_1        |             1" ("�col1_0" TIMESTAMPTZ NOT NULL, "cO l1_1" JSONB NOT NULL, " col1_2" TIME NOT NULL, col1̖_3 TEXT COLLATE da NOT NULL, "'%vcol1)_4" OID, col1_5 TEXT COLLATE de NULL, col1_6 BOX2D, "col1%91_7" REGCLASS, col1_8 TEXT COLLATE en NOT NULL, col1_9 TIMETZ NOT NULL, col1_10 REGCLASS, col1__11 CHAR NOT NULL, col1_12 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_8 AS TEXT))) STORED, col1_13 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_8 AS TEXT))) STORED, col1_14 TEXT GENERATED ALWAYS AS (CASE WHEN "col1%91_7" IS NULL THEN '6X+LOzl('::TEXT ELSE e'\''::TEXT END) STORED, col1_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_9 AS TEXT))) STORED, col1_16 TEXT GENERATED ALWAYS AS (CASE WHEN "col1%91_7" IS NULL THEN '#cU['::TEXT ELSE ')i?do>'::TEXT END) STORED, " coL1_17" TEXT GENERATED ALWAYS AS (lower(CAST(col1_6 AS TEXT))) STORED);
        test_1        |             CREATE INDEX ON "ta
        test_1        |             ble
        test_1        |             1" (" col1_2" DESC, col1_5) INCLUDE ("cO l1_1", "'%vcol1)_4", col1_6, "col1%91_7", col1_8, col1_9, col1__11);
        test_1        |             CREATE UNIQUE INDEX ON "ta
        test_1        |             ble
        test_1        |             1" (col1_13 ASC, col1̖_3, "col1%91_7" DESC, col1_12 DESC, "�col1_0" DESC, col1_10) INCLUDE ("cO l1_1", col1_6, col1_9, col1__11, col1_16);
        test_1        |             CREATE UNIQUE INDEX ON "ta
        test_1        |             ble
        test_1        |             1" (col1_12 DESC, col1_5 ASC, "col1%91_7" ASC);
        test_1        |             CREATE UNIQUE INDEX ON "ta
        test_1        |             ble
        test_1        |             1" (col1_14 DESC, lower(CAST(col1_5 AS TEXT)), col1_13 DESC, " coL1_17", col1_5 ASC, col1̖_3, col1_8 DESC, col1_9 DESC, col1_10 ASC, "col1%91_7" DESC, "�col1_0") INCLUDE ("cO l1_1", " col1_2", col1__11, col1_12, col1_16);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "da" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (1.00s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "\\u9FF8table1" ("c
        test_1        |             ol1_0" BOX2D, "col(1_1" BIT(15) NOT NULL, col1_2 GEOMETRY, col1_3 TIMESTAMP NOT NULL, "Col1_4" JSONB NOT NULL, col1_͎5 VARCHAR NOT NULL, "co}l1_6" JSONB NOT NULL, "'col1_7" STRING NOT NULL, "c ol1_8" TIMESTAMP NOT NULL, col1_9 TIME NULL, "col1_%6f10" STRING NOT NULL AS (lower(CAST("Col1_4" AS STRING))) VIRTUAL, "col1_ 11" STRING NOT NULL AS (lower(CAST("col(1_1" AS STRING))) VIRTUAL, col1_12 STRING NOT NULL AS (lower("'col1_7")) VIRTUAL, col1_13 STRING NOT NULL AS (CASE WHEN col1_3 IS NULL THEN e'\x11Q\x06L()\x13':::STRING ELSE e'\'':::STRING END) VIRTUAL, " col1_14" STRING NOT NULL AS (lower(CAST("co}l1_6" AS STRING))) VIRTUAL, "col1_\n15" STRING NOT NULL AS (CASE WHEN "c ol1_8" IS NULL THEN 'X':::STRING ELSE 'gP{':::STRING END) STORED, FAMILY (col1_3, "Col1_4"), FAMILY ("c
        test_1        |             ol1_0"), FAMILY (col1_͎5, "co}l1_6", "col1_\n15", "'col1_7"), FAMILY ("c ol1_8"), FAMILY (col1_9), FAMILY ("col(1_1", col1_2));
        test_1        |             ALTER TABLE "\\u9FF8table1" INJECT STATISTICS e'[{"avg_size": 8, "columns": ["\\"Col1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6614, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000}, {"avg_size": 27, "columns": ["col1_\u034E5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6727, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000}, {"avg_size": 20, "columns": ["\\"\'col1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6602, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000}, {"avg_size": 5, "columns": ["\\"col1_ 11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3049, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000}, {"avg_size": 7, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 937, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000}, {"avg_size": 17, "columns": ["\\"col1_\\\\n15\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4555, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000}, {"avg_size": 14, "columns": ["\\"c\\nol1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3221, "histo_col_type": "", "name": "__auto__", "null_count": 2316, "row_count": 7000}, {"avg_size": 28, "columns": ["\\" col1_14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5293, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000}, {"avg_size": 25, "columns": ["\\"col1_%6f10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5160, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000}, {"avg_size": 23, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4740, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000}, {"avg_size": 23, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 366, "histo_col_type": "", "name": "__auto__", "null_count": 1471, "row_count": 7000}, {"avg_size": 21, "columns": ["\\"co}l1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3617, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000}, {"avg_size": 18, "columns": ["\\"c ol1_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2226, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000}, {"avg_size": 0, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2866, "histo_col_type": "", "name": "__auto__", "null_count": 5459, "row_count": 7000}, {"avg_size": 5, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5574, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000}, {"avg_size": 17, "columns": ["\\"col(1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4312, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000}]':::JSONB;
        test_1        |             ALTER TABLE "\\u9FF8table1" INJECT STATISTICS e'[{"avg_size": 22, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 725409865, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 29, "columns": ["\\" col1_14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 266302665, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 0, "columns": ["\\"col1_\\\\n15\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 910257468, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 4, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 961108223, "histo_col_type": "", "name": "__auto__", "null_count": 240069394, "row_count": 1000000000}, {"avg_size": 22, "columns": ["\\"col1_%6f10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 126164559, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 15, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 251286613, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 23, "columns": ["\\"col1_ 11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 239682116, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 29, "columns": ["\\"c\\nol1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 384628040, "histo_col_type": "", "name": "__auto__", "null_count": 395151551, "row_count": 1000000000}, {"avg_size": 11, "columns": ["\\"Col1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 885275632, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 28, "columns": ["\\"\'col1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 92900551, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 12, "columns": ["\\"c ol1_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 350202174, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 25, "columns": ["\\"co}l1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 50090128, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 31, "columns": ["\\"col(1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 631302732, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 15, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 360612243, "histo_col_type": "", "name": "__auto__", "null_count": 497295512, "row_count": 1000000000}, {"avg_size": 23, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 344385115, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 15, "columns": ["col1_\u034E5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 490827890, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (21.65s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

        postgres_1    | 2023-05-11 05:18:49.884 UTC [50] LOG:  database system is shut down
        test_1        | I230511 05:18:49.931813 14 testutils/soon.go:41  [-] 1  SucceedsSoon: dial tcp 172.18.0.3:5432: connect: connection refused
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-05-11 05:18:50.002 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-05-11 05:18:50.003 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-05-11 05:18:50.003 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-05-11 05:18:50.006 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-05-11 05:18:50.011 UTC [69] LOG:  database system was shut down at 2023-05-11 05:18:49 UTC
        postgres_1    | 2023-05-11 05:18:50.016 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-05-11 05:18:52.702 UTC [79] ERROR:  invalid input syntax for type numeric: "-Infinity" at character 932
        postgres_1    | 2023-05-11 05:18:52.702 UTC [79] STATEMENT:  CREATE TABLE table1 (col1_0 TIMETZ NOT NULL, "�col1_1" OID, "co'l1_2" TSQUERY NULL, col1_3 DECIMAL NOT NULL, col1_4 INT8 NOT NULL, col1_😨5 BIT(11) NOT NULL, col1_6 DATE NOT NULL, col1_7 BOX2D NOT NULL, "Col1_\\xd88" VARCHAR NOT NULL, col1_9 TIME NULL, "col1_'10" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_6 IS NULL THEN e'\x1b\n7\x10'::TEXT ELSE e',\x18\x1c>Gc\x0f>'::TEXT END) STORED, "col1_""11" TEXT GENERATED ALWAYS AS (lower(CAST(col1_0 AS TEXT))) STORED, """col1_12" DECIMAL NOT NULL GENERATED ALWAYS AS (col1_3 + 186.0833182839767752::DECIMAL) STORED, col1_13 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_6 IS NULL THEN '>~>x<A*4|'::TEXT ELSE e'Z\x1a'::TEXT END) STORED, "col1_%14" DECIMAL NOT NULL GENERATED ALWAYS AS (col1_3 + (-518878030.7898827574)::DECIMAL) STORED, "col1_'15" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_😨5 AS TEXT))) STORED, col1_̒16 DECIMAL NOT NULL GENERATED ALWAYS AS (col1_3 + '-Infinity'::DECIMAL) STORED, "col1%p_17" TEXT NULL GENERATED ALWAYS AS (lower(CAST(col1_7 AS TEXT))) STORED, PRIMARY KEY (col1_0, """col1_12", col1_̒16, col1_3, col1_😨5, "col1_'10", col1_4, "Col1_\\xd88", "col1_%14"));
        postgres_1    |     CREATE UNIQUE INDEX ON table1 ("�col1_1" ASC, "Col1_\\xd88" ASC, "col1_""11", "col1_%14" ASC, col1_13 ASC, """col1_12" DESC, col1_9);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.89s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/mutators (0.52s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "t̿ a\\u7A62ble1" ("co
l1_0" BOX2D NOT NULL, col1_1 STRING NOT NULL, "co}l1_2" TIMESTAMPTZ NOT NULL, col1_3 STRING NOT NULL, col1_4 BYTES NOT NULL, "c%qol1_5" BIT(21) NOT NULL, col1_6 STRING NOT NULL, "c'ol1_7" STRING NOT NULL AS (lower(CAST("c%qol1_5" AS STRING))) VIRTUAL, col1_8 STRING NOT NULL AS (lower(CAST("c%qol1_5" AS STRING))) STORED, UNIQUE ("co
l1_0" DESC, col1_3 ASC, col1_1, col1_8 ASC, col1_6 ASC) STORING ("co}l1_2", col1_4, "c%qol1_5") WHERE "t̿ a\\u7A62ble1".col1_4 <= e'\\x':::BYTES, UNIQUE ("c%qol1_5", col1_8, "c'ol1_7", col1_4 DESC, "co
l1_0" ASC) STORING (col1_3, col1_6) WHERE (((((("t̿ a\\u7A62ble1".col1_8 >= e'\U00002603':::STRING) OR ("t̿ a\\u7A62ble1".col1_1 != '':::STRING)) AND ("t̿ a\\u7A62ble1"."co}l1_2" <= '0001-01-01 00:00:00+00':::TIMESTAMPTZ)) AND ("t̿ a\\u7A62ble1".col1_4 >= '\x22':::BYTES)) OR ("t̿ a\\u7A62ble1"."c'ol1_7" = 'X':::STRING)) AND ("t̿ a\\u7A62ble1".col1_6 < '"':::STRING)) AND ("t̿ a\\u7A62ble1".col1_3 = 'X':::STRING), INDEX (col1_3 DESC, col1_4 DESC, "co
l1_0" ASC, col1_8 ASC, col1_1 ASC) PARTITION BY LIST (col1_3, col1_4) (PARTITION "t̿ a\\u7A62ble1_pArt0" VALUES IN ((e'\x1a.1U_{\x1fH0':::STRING, e'\\xe3':::BYTES), ('h':::STRING, e'\\x5abc':::BYTES), (e'\x00':::STRING, e'\\xfdafbe37':::BYTES), (e'rEM\t5@':::STRING, e'\\x1fd3aa':::BYTES)), PARTITION "t̿ a\\u7A62ble1_part1" VALUES IN (('':::STRING, e'\\x04d1e3d8f4dc7103':::BYTES), (e'\x11-_=':::STRING, e'\\x697559de':::BYTES), ('PKM|':::STRING, e'\\xa7429f8e':::BYTES), ('"':::STRING, e'\\x220bbdcdc036789e68':::BYTES)), PARTITION "t̿ a'\\u7A62ble1_part2" VALUES IN ((e'.\x1dT\x0e}\x1b?K':::STRING, e'\\x':::BYTES), (e'}\x04T\b\x02z\x13D':::STRING, e'\\x8541':::BYTES), (e'\b%_r':::STRING, e'\\x':::BYTES), (e'z\x04F\x15':::STRING, e'\\xd8bf2b4a0af77be268':::BYTES)), PARTITION "t̿ a\\u7A62ble1_part3" VALUES IN ((e'2\n\x13':::STRING, e'\\x00':::BYTES), ('Ut&fa@6C,':::STRING, e'\\x':::BYTES), ('D?9':::STRING, e'\\xe29883':::BYTES), ('':::STRING, e'\\x0703ec':::BYTES)), PARTITION "t̿ a\\u7A62ble1_part4" VALUES IN (('=':::STRING, e'\\x':::BYTES), (e'[_\x05S,Z+F':::STRING, e'\\x00a3b9c75f4c':::BYTES), (e'\\q(7\r\n':::STRING, e'\\xe67341':::BYTES), (e'\U00002603':::STRING, e'\\x3d':::BYTES)), PARTITION "t̿ a\%p\u7A62ble1_p%daart5" VALUES IN ((e'P[;\x1eWD\x7fT':::STRING, e'\\x40':::BYTES), ('*u~':::STRING, e'\\x':::BYTES), (e'\U00002603':::STRING, e'\\x619d830cb7fb':::BYTES), (e'9PRnW\x13':::STRING, e'\\x08a65ed2dd':::BYTES)), PARTITION "t̿ a\\u7A62😓ble1_part6" VALUES IN ((e'\x0b>}':::STRING, e'\\x23fb':::BYTES), ('Q16ZF':::STRING, e'\\x5dc2f9e4f9dfa2':::BYTES), ('':::STRING, e'\\xe5da5f96b700':::BYTES), (e'+\x18\bxXm.Z':::STRING, e'\\x19e2f475':::BYTES)), PARTITION "t̿ a\\u7A62ble1_part7" VALUES IN ((e'*\n8w|':::STRING, e'\\x16':::BYTES), ('3iR':::STRING, e'\\x929989':::BYTES), (e'\x01':::STRING, e'\\x4e81280f5367c414e2':::BYTES), ('"':::STRING, e'\\x75':::BYTES)), PARTITION "DEFAULT" VALUES IN ((DEFAULT, DEFAULT))) WHERE (((((("t̿ a\\u7A62ble1".col1_1 != e'\x00':::STRING) OR ("t̿ a\\u7A62ble1".col1_8 > e'\'':::STRING)) AND ("t̿ a\\u7A62ble1".col1_4 > '\x':::BYTES)) OR ("t̿ a\\u7A62ble1"."co}l1_2" = '3000-01-01 00:00:00+00':::TIMESTAMPTZ)) AND ("t̿ a\\u7A62ble1"."c'ol1_7" = e'\x00':::STRING)) OR ("t̿ a\\u7A62ble1".col1_3 != e'\'':::STRING)) AND ("t̿ a\\u7A62ble1".col1_6 < '"':::STRING), UNIQUE (col1_6 ASC, (CASE WHEN col1_4 IS NULL THEN ']':::STRING ELSE 'QZ':::STRING END), col1_3 DESC, "co
l1_0", col1_8 ASC, "co}l1_2" DESC) STORING (col1_1, col1_4, "c%qol1_5") WHERE ((((("t̿ a\\u7A62ble1".col1_8 != e'\x00':::STRING) AND ("t̿ a\\u7A62ble1".col1_1 <= 'X':::STRING)) OR ("t̿ a\\u7A62ble1".col1_6 >= '':::STRING)) AND ("t̿ a\\u7A62ble1"."co}l1_2" < '0001-01-01 00:00:00+00':::TIMESTAMPTZ)) AND ("t̿ a\\u7A62ble1".col1_4 <= e'\\x58':::BYTES)) OR ("t̿ a\\u7A62ble1".col1_3 < e'\'':::STRING), INDEX ("c%qol1_5" DESC, col1_1, col1_8 DESC, (CASE WHEN col1_4 IS NULL THEN e'R\x1fF\x06b':::STRING ELSE 'qV':::STRING END) ASC) STORING ("co
l1_0", "co}l1_2", col1_6) WHERE ((((("t̿ a\\u7A62ble1".col1_1 <= 'X':::STRING) OR ("t̿ a\\u7A62ble1".col1_3 <= e'\'':::STRING)) OR ("t̿ a\\u7A62ble1".col1_8 != 'X':::STRING)) AND ("t̿ a\\u7A62ble1"."c'ol1_7" <= e'\x00':::STRING)) OR ("t̿ a\\u7A62ble1"."co}l1_2" > '0001-01-01 00:00:00+00':::TIMESTAMPTZ)) OR ("t̿ a\\u7A62ble1".col1_6 >= '':::STRING), INDEX (lower(col1_3), col1_6 ASC, lower(CAST("co
l1_0" AS STRING)) DESC, col1_1 ASC, "c%qol1_5", col1_4 DESC) STORING ("co
l1_0", "co}l1_2", col1_3, col1_8) NOT VISIBLE, INDEX ((CASE WHEN "co}l1_2" IS NULL THEN e'9<\x1dP YJl':::STRING ELSE 'a':::STRING END), "co}l1_2" DESC, "c%qol1_5" DESC, lower(CAST("co
l1_0" AS STRING)) DESC, col1_1 DESC, col1_6) STORING (col1_3) WHERE (("t̿ a\\u7A62ble1".col1_1 != e'\U00002603':::STRING) OR ("t̿ a\\u7A62ble1"."c'ol1_7" > '"':::STRING)) AND ("t̿ a\\u7A62ble1".col1_3 != e'\x00':::STRING), FAMILY ("c%qol1_5"), FAMILY (col1_3, "co}l1_2"), FAMILY ("co
l1_0"), FAMILY (col1_6, col1_4), FAMILY (col1_8), FAMILY (col1_1));
        test_1        |             ALTER TABLE "t̿ a\\u7A62ble1" INJECT STATISTICS e'[{"avg_size": 0, "columns": ["\\"co\\rl1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 8414140082780917293, "num_range": 0, "upper_bound": "BOX(-1.541662323524164 -0.7868344910102979,0.11123331338336917 -0.5913812165324263)"}, {"distinct_range": 8000, "num_eq": 8548410813817821449, "num_range": 8000, "upper_bound": "BOX(-1.3638641464046566 -1.0928728290117897,-0.2166956044044982 -0.15273045379734868)"}, {"distinct_range": 0, "num_eq": 3374804846652986291, "num_range": 40000, "upper_bound": "BOX(-1.2895697956557783 -1.2616608217958918,-0.9184086082321308 -0.07152916787085128)"}, {"distinct_range": 2231309746622099700, "num_eq": 3757190023449127129, "num_range": 3976090749033339115, "upper_bound": "BOX(-1.2262125858417554 -0.6645990622977092,1.6800246733699846 -0.3760120219327503)"}, {"distinct_range": 39896.24860363874, "num_eq": 10000000000, "num_range": 90000, "upper_bound": "BOX(-0.8930871494993459 -0.7810609279988834,1.2012672161278983 -0.5423644570162383)"}, {"distinct_range": 5856643604719483, "num_eq": 2861068244011029354, "num_range": 205574876139550715, "upper_bound": "BOX(-0.7255642010193477 -0.7706644388824022,2.2150202377475567 0.46440381189236907)"}, {"distinct_range": 0, "num_eq": 10000000000, "num_range": 0, "upper_bound": "BOX(-0.705625836758913 -0.859213123471719,-0.6913051773988307 0.10580325193764534)"}, {"distinct_range": 8670494150956435000, "num_eq": 10000, "num_range": 8670494150956435774, "upper_bound": "BOX(-0.30485453322432077 -0.5993299070828101,-0.10372641249714643 -0.5405205705629156)"}, {"distinct_range": 341096494535030140, "num_eq": 0, "num_range": 3310685821965201445, "upper_bound": "BOX(0.20987328218919465 -2.450024527985107,0.9729929950752387 0.30970937450163993)"}], "histo_col_type": "BOX2D", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"c%qol1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 5254452058919529002, "num_range": 0, "upper_bound": "000100010111111111010"}, {"distinct_range": 1804402634440129000, "num_eq": 0, "num_range": 1848936853112030834, "upper_bound": "101011000011010101001"}], "histo_col_type": "BIT(21)", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 9064297644538829690, "num_range": 0, "upper_bound": "KB\\u000bGWgI*T"}, {"distinct_range": 3319574354791948300, "num_eq": 8082509014342637024, "num_range": 3600882751754920741, "upper_bound": "M\\\\\\u0017 \\u0006fKa|"}, {"distinct_range": 1669957326778492000, "num_eq": 60000000, "num_range": 1669957326778491825, "upper_bound": "p"}, {"distinct_range": 10000000, "num_eq": 6441843582853303027, "num_range": 10000000, "upper_bound": "~\\u0003"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"c\'ol1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"co}l1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 1002314622316084611, "num_range": 0, "upper_bound": ""}, {"distinct_range": 0, "num_eq": 60000, "num_range": 100000, "upper_bound": "\\u0001"}, {"distinct_range": 0, "num_eq": 10000, "num_range": 6000000, "upper_bound": "\'RS\\u0004b\\u00059\\u0010 "}, {"distinct_range": 18376.264154420165, "num_eq": 5472062660013494679, "num_range": 70000, "upper_bound": "6\\u0008Q|ZJ"}, {"distinct_range": 31718528491.522697, "num_eq": 1000000000, "num_range": 80000000000, "upper_bound": "9q\\u000c"}, {"distinct_range": 0, "num_eq": 4054723837163001708, "num_range": 20000000000, "upper_bound": "=7\'\\t"}, {"distinct_range": 0, "num_eq": 70000000, "num_range": 40000000000, "upper_bound": "X"}, {"distinct_range": 3391538800119857700, "num_eq": 600, "num_range": 3391538800119857436, "upper_bound": "nIU\\\\"}, {"distinct_range": 0, "num_eq": 0, "num_range": 800000000, "upper_bound": "{2[-a"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 0}]':::JSONB;
        test_1        |             ALTER TABLE "t̿ a\\u7A62ble1" INJECT STATISTICS e'[{"avg_size": 17, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 72703985083294505, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6601589316741206809}, {"avg_size": 28, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2030637184011964627, "histo_buckets": [{"distinct_range": 0, "num_eq": 1000000000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 1000000, "num_eq": 700000000, "num_range": 1000000, "upper_bound": "\\u0006\\u0017J"}, {"distinct_range": 0, "num_eq": 5000000, "num_range": 6000000, "upper_bound": "\\u000b"}, {"distinct_range": 5502531020451316000, "num_eq": 7307795511273141167, "num_range": 5502531020451315695, "upper_bound": "\\u001c\\u001d$~E%.\\u0011"}, {"distinct_range": 0, "num_eq": 4478070286561715123, "num_range": 2000000, "upper_bound": ".$\\u001c"}, {"distinct_range": 45481858.04987158, "num_eq": 200, "num_range": 500000000, "upper_bound": "GNo+\\u0012cD=9"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 6601589316741206809}, {"avg_size": 16, "columns": ["\\"c\'ol1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3604873625560575635, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6601589316741206809}, {"avg_size": 16, "columns": ["\\"co}l1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2389458989184184147, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6601589316741206809}, {"avg_size": 2, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6055773990308623553, "histo_buckets": [{"distinct_range": 0, "num_eq": 300, "num_range": 0, "upper_bound": "\\u000c.\\u00110w\\u0008"}, {"distinct_range": 0, "num_eq": 4258508921901838921, "num_range": 90, "upper_bound": "X"}, {"distinct_range": 0, "num_eq": 200000000, "num_range": 0, "upper_bound": "``T"}, {"distinct_range": 0, "num_eq": 0, "num_range": 3841842294303303646, "upper_bound": "}Y\\u0016.\\u001a"}, {"distinct_range": 4216932539517546500, "num_eq": 200000000, "num_range": 4274895819781994529, "upper_bound": "~["}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 6601589316741206809}, {"avg_size": 17, "columns": ["\\"c%qol1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4430484435673592351, "histo_buckets": [{"distinct_range": 0, "num_eq": 2921505637822429442, "num_range": 0, "upper_bound": "000000000000000000000"}, {"distinct_range": 0, "num_eq": 4000222822036974017, "num_range": 50000000, "upper_bound": "000111101001110010010"}, {"distinct_range": 3741818315786869000, "num_eq": 4710987823459580743, "num_range": 3869707818166655390, "upper_bound": "010000111000110111101"}, {"distinct_range": 3834789093450799000, "num_eq": 7568946170340804393, "num_range": 3834789093450799143, "upper_bound": "010001101010100010011"}, {"distinct_range": 75171537.76889673, "num_eq": 4000000, "num_range": 200000000, "upper_bound": "011111000011010111010"}, {"distinct_range": 70, "num_eq": 10000, "num_range": 70, "upper_bound": "011111111111111111111"}, {"distinct_range": 0, "num_eq": 3392298333617516834, "num_range": 0, "upper_bound": "110100111111001100111"}], "histo_col_type": "BIT(21)", "name": "__auto__", "null_count": 0, "row_count": 6601589316741206809}, {"avg_size": 17, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1211286416014579497, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6601589316741206809}, {"avg_size": 17, "columns": ["\\"co\\rl1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6530766182153970858, "histo_buckets": [{"distinct_range": 0, "num_eq": 1701716566378944356, "num_range": 0, "upper_bound": "BOX(-10 -10,10 10)"}, {"distinct_range": 10000000000, "num_eq": 6895080397958033934, "num_range": 10000000000, "upper_bound": "BOX(-0.9543570533053511 -0.016239413590991125,0.48698660511329295 1.6650740381140121)"}, {"distinct_range": 6300886466725133000, "num_eq": 0, "num_range": 6300886466725133099, "upper_bound": "BOX(-0.5095716628351658 -0.7699404226365096,0.9773435838926355 0.0030957922679542005)"}, {"distinct_range": 6185042723379948000, "num_eq": 8928000839801694337, "num_range": 8704655040745928298, "upper_bound": "BOX(-0.2936737777542664 -1.6487856290177807,1.729214580499296 0.03193857290260116)"}, {"distinct_range": 1059082035334998100, "num_eq": 10000, "num_range": 1059082035334998131, "upper_bound": "BOX(0.10589119311393017 -1.7736366455289057,1.382302268828218 0.4763311290978651)"}, {"distinct_range": 0, "num_eq": 1000000000, "num_range": 50000000000, "upper_bound": "BOX(0.4394440662010257 0.4423071720776883,1.3995947828989719 0.5076650639986019)"}, {"distinct_range": 142893967986156260, "num_eq": 400000, "num_range": 142893967986156248, "upper_bound": "BOX(0.5575900532723513 -0.19031418054334903,2.1380607198265618 0.9656782751043451)"}], "histo_col_type": "BOX2D", "name": "__auto__", "null_count": 0, "row_count": 6601589316741206809}, {"avg_size": 29, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5000668782228759044, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6601589316741206809}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        |     --- FAIL: TestCompare/postgres (1.24s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 TIMETZ NOT NULL, "�col1_1" OID, "co'l1_2" TSQUERY NULL, col1_3 DECIMAL NOT NULL, col1_4 INT8 NOT NULL, col1_😨5 BIT(11) NOT NULL, col1_6 DATE NOT NULL, col1_7 BOX2D NOT NULL, "Col1_\\xd88" VARCHAR NOT NULL, col1_9 TIME NULL, "col1_'10" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_6 IS NULL THEN e'\x1b\n7\x10'::TEXT ELSE e',\x18\x1c>Gc\x0f>'::TEXT END) STORED, "col1_""11" TEXT GENERATED ALWAYS AS (lower(CAST(col1_0 AS TEXT))) STORED, """col1_12" DECIMAL NOT NULL GENERATED ALWAYS AS (col1_3 + 186.0833182839767752::DECIMAL) STORED, col1_13 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col1_6 IS NULL THEN '>~>x<A*4|'::TEXT ELSE e'Z\x1a'::TEXT END) STORED, "col1_%14" DECIMAL NOT NULL GENERATED ALWAYS AS (col1_3 + (-518878030.7898827574)::DECIMAL) STORED, "col1_'15" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_😨5 AS TEXT))) STORED, col1_̒16 DECIMAL NOT NULL GENERATED ALWAYS AS (col1_3 + '-Infinity'::DECIMAL) STORED, "col1%p_17" TEXT NULL GENERATED ALWAYS AS (lower(CAST(col1_7 AS TEXT))) STORED, PRIMARY KEY (col1_0, """col1_12", col1_̒16, col1_3, col1_😨5, "col1_'10", col1_4, "Col1_\\xd88", "col1_%14"));
        test_1        |             CREATE UNIQUE INDEX ON table1 ("�col1_1" ASC, "Col1_\\xd88" ASC, "col1_""11", "col1_%14" ASC, col1_13 ASC, """col1_12" DESC, col1_9);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: invalid input syntax for type numeric: "-Infinity" (SQLSTATE 22P02)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (21.09s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

        postgres_1    | 2023-05-12 05:19:11.965 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-05-12 05:19:13.832 UTC [78] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2023-05-12 05:19:13.832 UTC [78] STATEMENT:  CREATE TABLE ta😎ble1 ("'col1_0" BOOL, col1_1 BIT(2) NOT NULL, col1_2 UUID NOT NULL, "co%vl1_3" TIME NOT NULL, co̿l1_4 INTERVAL, "%qcol1_5" BYTEA NOT NULL, col1_6 BIT NULL, "col1_""7" NAME, col1_8 TIMETZ NOT NULL, col1_9 BOOL NOT NULL, "col%v1""_10" REGROLE NOT NULL, col1_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_2 AS TEXT))) STORED, col1_12 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_2 AS TEXT))) STORED, col1_13 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col%v1""_10" IS NULL THEN e'4_;\x07[d2w{'::TEXT ELSE ''::TEXT END) STORED, "co�l1_14" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_9 AS TEXT))) STORED, "cOl😟1_15" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_1 AS TEXT))) STORED, col1_16 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("'col1_0" AS TEXT))) STORED, "col1�_17" TEXT NOT NULL GENERATED ALWAYS AS (lower("col1_""7")) STORED, PRIMARY KEY (col1_13, col1_11, "co�l1_14", "col%v1""_10", "col1�_17", col1_16, col1_8, "co%vl1_3", col1_1, col1_12, "cOl😟1_15"));
        postgres_1    |     CREATE UNIQUE INDEX ON ta😎ble1 ("co%vl1_3" ASC, col1_6 DESC, col1_9 ASC, (CASE WHEN co̿l1_4 IS NULL THEN 'k'::TEXT ELSE e'\x00'::TEXT END) DESC, col1_16, "%qcol1_5", "'col1_0" ASC, col1_8, "co�l1_14" DESC, "col1_""7" ASC, col1_11 DESC, col1_2 DESC, "col%v1""_10" DESC, col1_12 DESC, "cOl😟1_15", col1_1);
        postgres_1    |     CREATE INDEX ON ta😎ble1 (col1_16, col1_6, col1_12 ASC, "%qcol1_5" DESC, co̿l1_4 DESC, lower("col1_""7"), "col1_""7" ASC, col1_8 DESC, "'col1_0", col1_13 DESC, "co�l1_14" DESC, "co%vl1_3", col1_9 ASC, "cOl😟1_15" DESC, "col%v1""_10", col1_2 DESC);
        postgres_1    |     CREATE UNIQUE INDEX ON ta😎ble1 ("'col1_0", "cOl😟1_15", "col%v1""_10" ASC, col1_6 ASC, col1_1 ASC, col1_16, col1_12, col1_11, col1_13, lower(CAST(col1_9 AS TEXT)) DESC, lower(CAST(col1_8 AS TEXT)), col1_8, co̿l1_4 ASC, lower(CAST("'col1_0" AS TEXT)) DESC, col1_2, "%qcol1_5" DESC, lower("col1_""7"), "co�l1_14" DESC) INCLUDE (col1_9);
        postgres_1    |     CREATE UNIQUE INDEX ON ta😎ble1 (co̿l1_4 DESC, "col%v1""_10", "co�l1_14" ASC, col1_2 DESC, col1_1 ASC, "%qcol1_5", col1_11, col1_9 ASC, "cOl😟1_15", "co%vl1_3", col1_13 ASC, col1_6 ASC);
        postgres_1    |     CREATE UNIQUE INDEX ON ta😎ble1 ("co%vl1_3" DESC, "col%v1""_10" ASC, "co�l1_14", col1_12, col1_1, co̿l1_4 ASC, "cOl😟1_15" DESC, col1_8 ASC, col1_2, "'col1_0", col1_11 ASC, col1_6 DESC, "%qcol1_5" DESC, col1_9);
        postgres_1    |     CREATE INDEX ON ta😎ble1 (co̿l1_4, col1_16, "col%v1""_10", col1_2, lower(CAST("'col1_0" AS TEXT)), col1_13 ASC) INCLUDE ("'col1_0", "%qcol1_5", "col1_""7");
        postgres_1    |     CREATE UNIQUE INDEX ON ta😎ble1 (col1_13 ASC, col1_8 ASC, "'col1_0" DESC, co̿l1_4 ASC, "col%v1""_10" ASC, col1_1 DESC, col1_16 ASC, "col1�_17" DESC, col1_6 ASC, lower(CAST("'col1_0" AS TEXT)) DESC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (6.11s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.03s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE ta😎ble1 ("'col1_0" BOOL, col1_1 BIT(2) NOT NULL, col1_2 UUID NOT NULL, "co%vl1_3" TIME NOT NULL, co̿l1_4 INTERVAL, "%qcol1_5" BYTEA NOT NULL, col1_6 BIT NULL, "col1_""7" NAME, col1_8 TIMETZ NOT NULL, col1_9 BOOL NOT NULL, "col%v1""_10" REGROLE NOT NULL, col1_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_2 AS TEXT))) STORED, col1_12 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_2 AS TEXT))) STORED, col1_13 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col%v1""_10" IS NULL THEN e'4_;\x07[d2w{'::TEXT ELSE ''::TEXT END) STORED, "co�l1_14" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_9 AS TEXT))) STORED, "cOl😟1_15" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_1 AS TEXT))) STORED, col1_16 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("'col1_0" AS TEXT))) STORED, "col1�_17" TEXT NOT NULL GENERATED ALWAYS AS (lower("col1_""7")) STORED, PRIMARY KEY (col1_13, col1_11, "co�l1_14", "col%v1""_10", "col1�_17", col1_16, col1_8, "co%vl1_3", col1_1, col1_12, "cOl😟1_15"));
        test_1        |             CREATE UNIQUE INDEX ON ta😎ble1 ("co%vl1_3" ASC, col1_6 DESC, col1_9 ASC, (CASE WHEN co̿l1_4 IS NULL THEN 'k'::TEXT ELSE e'\x00'::TEXT END) DESC, col1_16, "%qcol1_5", "'col1_0" ASC, col1_8, "co�l1_14" DESC, "col1_""7" ASC, col1_11 DESC, col1_2 DESC, "col%v1""_10" DESC, col1_12 DESC, "cOl😟1_15", col1_1);
        test_1        |             CREATE INDEX ON ta😎ble1 (col1_16, col1_6, col1_12 ASC, "%qcol1_5" DESC, co̿l1_4 DESC, lower("col1_""7"), "col1_""7" ASC, col1_8 DESC, "'col1_0", col1_13 DESC, "co�l1_14" DESC, "co%vl1_3", col1_9 ASC, "cOl😟1_15" DESC, "col%v1""_10", col1_2 DESC);
        test_1        |             CREATE UNIQUE INDEX ON ta😎ble1 ("'col1_0", "cOl😟1_15", "col%v1""_10" ASC, col1_6 ASC, col1_1 ASC, col1_16, col1_12, col1_11, col1_13, lower(CAST(col1_9 AS TEXT)) DESC, lower(CAST(col1_8 AS TEXT)), col1_8, co̿l1_4 ASC, lower(CAST("'col1_0" AS TEXT)) DESC, col1_2, "%qcol1_5" DESC, lower("col1_""7"), "co�l1_14" DESC) INCLUDE (col1_9);
        test_1        |             CREATE UNIQUE INDEX ON ta😎ble1 (co̿l1_4 DESC, "col%v1""_10", "co�l1_14" ASC, col1_2 DESC, col1_1 ASC, "%qcol1_5", col1_11, col1_9 ASC, "cOl😟1_15", "co%vl1_3", col1_13 ASC, col1_6 ASC);
        test_1        |             CREATE UNIQUE INDEX ON ta😎ble1 ("co%vl1_3" DESC, "col%v1""_10" ASC, "co�l1_14", col1_12, col1_1, co̿l1_4 ASC, "cOl😟1_15" DESC, col1_8 ASC, col1_2, "'col1_0", col1_11 ASC, col1_6 DESC, "%qcol1_5" DESC, col1_9);
        test_1        |             CREATE INDEX ON ta😎ble1 (co̿l1_4, col1_16, "col%v1""_10", col1_2, lower(CAST("'col1_0" AS TEXT)), col1_13 ASC) INCLUDE ("'col1_0", "%qcol1_5", "col1_""7");
        test_1        |             CREATE UNIQUE INDEX ON ta😎ble1 (col1_13 ASC, col1_8 ASC, "'col1_0" DESC, co̿l1_4 ASC, "col%v1""_10" ASC, col1_1 DESC, col1_16 ASC, "col1�_17" DESC, col1_6 ASC, lower(CAST("'col1_0" AS TEXT)) DESC);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        |     --- FAIL: TestCompare/mutators (0.95s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 BOX2D, col1_1 OID NOT NULL, "col1%q_2" UUID NOT NULL, col1_3 REGCLASS NULL, col1_4 BIT(8) NOT NULL, "co l1_5" INTERVAL NOT NULL, col1_6 VARCHAR NOT NULL, col1_̹7 TIMESTAMPTZ NOT NULL, col1_8 UUID NOT NULL, "col 1_9" BOOL NOT NULL, col1_10 STRING NOT NULL AS (lower(CAST(col1_0 AS STRING))) STORED, col1_11 STRING NOT NULL AS (lower(CAST(col1_1 AS STRING))) VIRTUAL, "c\vol1_'12" STRING NOT NULL AS (lower(col1_6)) VIRTUAL, col1_13 STRING NOT NULL AS (lower(CAST("col1%q_2" AS STRING))) STORED, col1_14 STRING NOT NULL AS (lower(col1_6)) VIRTUAL, col1_15 STRING NULL AS (CASE WHEN col1_3 IS NULL THEN e'\x0e\x0b|+fR\x19v':::STRING ELSE e'\x03J+\x1fa\r\x01':::STRING END) STORED, col1_16 STRING NOT NULL AS (CASE WHEN "co l1_5" IS NULL THEN e'A<\b^Z\x1a_':::STRING ELSE '':::STRING END) VIRTUAL, c͕ol1_17 STRING NOT NULL AS (lower(CAST("col1%q_2" AS STRING))) VIRTUAL, "co\\U00021D43l1_ͯ18" STRING NOT NULL AS (CASE WHEN "co l1_5" IS NULL THEN e'\x1a\tT\x14R%W$2':::STRING ELSE 'r':::STRING END) VIRTUAL, PRIMARY KEY (col1_̹7 ASC, col1_11 ASC, col1_14 DESC, col1_1, "col 1_9", col1_13 ASC, col1_10 DESC, "co\\U00021D43l1_ͯ18", col1_6 DESC, "col1%q_2", "co l1_5", c͕ol1_17 DESC, col1_4), INDEX (col1_4) STORING (col1_0, col1_15), INDEX (col1_1 DESC, "col 1_9", (CASE WHEN col1_3 IS NULL THEN ';XQc$35':::STRING ELSE e'a(\x15texx?':::STRING END) DESC, "co l1_5", col1_4, col1_13 ASC, col1_10 DESC) STORING (col1_15) WHERE ((((((((table1.c͕ol1_17 != '':::STRING) OR (table1.col1_11 <= e'\x00':::STRING)) OR (table1."co\\U00021D43l1_ͯ18" >= '':::STRING)) OR (table1.col1_̹7 <= '0001-01-01 00:00:00+00':::TIMESTAMPTZ)) AND (table1.col1_10 != '':::STRING)) OR (table1.col1_14 != 'X':::STRING)) OR (table1.col1_6 = '':::STRING)) AND (table1.col1_13 != '':::STRING)) AND (table1.col1_16 = '':::STRING), INDEX ("c\vol1_'12" ASC, col1_10, lower(CAST(col1_8 AS STRING)) DESC, lower(CAST(col1_1 AS STRING)) DESC, (CASE WHEN "co l1_5" IS NULL THEN 'H)y':::STRING ELSE e'\x19UD&v':::STRING END) ASC, (CASE WHEN col1_̹7 IS NULL THEN 'Y#E<.|Tf{':::STRING ELSE e'Y@G!Y,\x19 ':::STRING END), col1_̹7, lower(col1_6) DESC, "col 1_9" DESC, "co l1_5" DESC, col1_14, col1_13 DESC, col1_11 DESC, col1_16 ASC) STORING (col1_0) WHERE (((((((table1.col1_13 = '':::STRING) OR table1."col 1_9") OR (table1.col1_11 != '':::STRING)) OR (table1.col1_15 != e'\U00002603':::STRING)) AND (table1."c\vol1_'12" <= 'X':::STRING)) OR (table1.col1_16 != e'\'':::STRING)) AND (table1."co\\U00021D43l1_ͯ18" <= 'X':::STRING)) AND (table1.col1_14 < e'\'':::STRING), FAMILY (col1_4, col1_1, col1_0), FAMILY (col1_15), FAMILY (col1_3), FAMILY ("co l1_5"), FAMILY (col1_8, "col1%q_2"), FAMILY (col1_10), FAMILY (col1_13), FAMILY (col1_6, col1_̹7), FAMILY ("col 1_9"));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 25, "columns": ["\\"co l1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 120222083962223077, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 27, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1816519819332810663, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 15, "columns": ["\\"c\\\\vol1_\'12\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2433798719475078880, "histo_buckets": [{"distinct_range": 0, "num_eq": 8232163945396561979, "num_range": 0, "upper_bound": "\\u000b"}, {"distinct_range": 0, "num_eq": 5334809067613685924, "num_range": 7172593161457291804, "upper_bound": "0"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 20, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5301247789689642198, "histo_col_type": "", "name": "__auto__", "null_count": 3568923938798556637, "row_count": 8283451965637793542}, {"avg_size": 27, "columns": ["col1_16"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7855783395154312355, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 23, "columns": ["\\"col1%q_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6039408568611297400, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 17, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6575290187311449932, "histo_col_type": "", "name": "__auto__", "null_count": 3178980702777177022, "row_count": 8283451965637793542}, {"avg_size": 25, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 533636862233803245, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 0, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7664786120119302658, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 4, "columns": ["\\"co\\\\\\\\U00021D43l1_\u036F18\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6690400587653442390, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 27, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7135119902839675780, "histo_col_type": "", "name": "__auto__", "null_count": 4302418696186332608, "row_count": 8283451965637793542}, {"avg_size": 25, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6221093095328488503, "histo_buckets": [{"distinct_range": 0, "num_eq": 906983825079055167, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 90, "num_eq": 90, "num_range": 90, "upper_bound": "1101218226"}, {"distinct_range": 1966186810979037200, "num_eq": 1000000000, "num_range": 5013768131298730216, "upper_bound": "2730775116"}, {"distinct_range": 700000, "num_eq": 100000, "num_range": 700000, "upper_bound": "3457302011"}, {"distinct_range": 70, "num_eq": 8320205683510218315, "num_range": 70, "upper_bound": "3599896581"}, {"distinct_range": 0, "num_eq": 1000, "num_range": 3098610252290547841, "upper_bound": "4226704463"}], "histo_col_type": "OID", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 3, "columns": ["col1_\u03397"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1550973015075080274, "histo_buckets": [{"distinct_range": 0, "num_eq": 80000000, "num_range": 0, "upper_bound": "2009-08-29 08:46:35.000656+00"}, {"distinct_range": 0, "num_eq": 80000000, "num_range": 90000, "upper_bound": "2023-05-19 16:32:33.000027+00"}, {"distinct_range": 4431478169154278000, "num_eq": 90000000000, "num_range": 7216083145603995716, "upper_bound": "3000-01-01 00:00:00+00"}], "histo_col_type": "TIMESTAMPTZ", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 29, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5299829943706690094, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 20, "columns": ["c\u0355ol1_17"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5867370538454353105, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 9, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3013625562822284353, "histo_buckets": [{"distinct_range": 0, "num_eq": 8814554773584004409, "num_range": 0, "upper_bound": "00000000"}, {"distinct_range": 6662628937259270000, "num_eq": 80000, "num_range": 7023138507335806652, "upper_bound": "00011011"}, {"distinct_range": 0, "num_eq": 5281326921883972093, "num_range": 1096875587610956797, "upper_bound": "01000101"}, {"distinct_range": 0, "num_eq": 50000, "num_range": 50000000, "upper_bound": "01111011"}, {"distinct_range": 0, "num_eq": 1177190768633779069, "num_range": 300000, "upper_bound": "11110010"}], "histo_col_type": "BIT(8)", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 16, "columns": ["\\"col 1_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8037766317014537021, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 5, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1349022600560493036, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}, {"avg_size": 12, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7060096503907609033, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8283451965637793542}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 8, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 313479919579314972, "histo_col_type": "", "name": "__auto__", "null_count": 4768238980835831408, "row_count": 6236685666928141093}, {"avg_size": 20, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 553963886403956065, "histo_buckets": [{"distinct_range": 0, "num_eq": 8093729936048687682, "num_range": 0, "upper_bound": "00000001"}, {"distinct_range": 679393325483607800, "num_eq": 5335802476808081082, "num_range": 679393325483607848, "upper_bound": "00101011"}, {"distinct_range": 4071453833349503000, "num_eq": 7013442509785396018, "num_range": 7807561930267140909, "upper_bound": "01111111"}, {"distinct_range": 773336137.4345707, "num_eq": 400000, "num_range": 3000000000, "upper_bound": "10000000"}, {"distinct_range": 0, "num_eq": 8089862566830312730, "num_range": 2813647495487291307, "upper_bound": "10000100"}, {"distinct_range": 147621502907975400, "num_eq": 8442369407839807817, "num_range": 147621502907975377, "upper_bound": "11010011"}], "histo_col_type": "BIT(8)", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 19, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1540152197364731483, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 30, "columns": ["\\"col 1_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3655257291351970303, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 29, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5934947892149781288, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 23, "columns": ["\\"col1%q_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2845800065718578139, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 9, "columns": ["col1_\u03397"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3986418440664167897, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 3, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3563122704416586123, "histo_buckets": [{"distinct_range": 0, "num_eq": 10, "num_range": 0, "upper_bound": "331959963"}, {"distinct_range": 5811363958043428, "num_eq": 1000000000, "num_range": 3751501021754666471, "upper_bound": "719478122"}, {"distinct_range": 0, "num_eq": 1016731954067274124, "num_range": 100000, "upper_bound": "2403818721"}, {"distinct_range": 0, "num_eq": 2000, "num_range": 30, "upper_bound": "2738380312"}, {"distinct_range": 9000000000, "num_eq": 719269302176769440, "num_range": 9000000000, "upper_bound": "3326390407"}, {"distinct_range": 0, "num_eq": 3852182285310529555, "num_range": 50000000, "upper_bound": "3346672039"}, {"distinct_range": 0, "num_eq": 4393399867117265416, "num_range": 2082550744785911060, "upper_bound": "3941919531"}, {"distinct_range": 3929511341391955000, "num_eq": 1000000000, "num_range": 4499656148649457249, "upper_bound": "4104504244"}, {"distinct_range": 0, "num_eq": 4268710787398368244, "num_range": 6330500907381675720, "upper_bound": "4243743217"}], "histo_col_type": "OID", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 2, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5596471044897620016, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 13, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4140735797748957065, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 5, "columns": ["c\u0355ol1_17"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1401772906960624135, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 9, "columns": ["\\"co\\\\\\\\U00021D43l1_\u036F18\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2041873602569274733, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 13, "columns": ["col1_16"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1274059360751809539, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 8, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4371368553743359411, "histo_col_type": "", "name": "__auto__", "null_count": 1726829464142654995, "row_count": 6236685666928141093}, {"avg_size": 8, "columns": ["\\"co l1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5451651966072555519, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 28, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2222516780785029051, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 2, "columns": ["\\"c\\\\vol1_\'12\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 319670817131589004, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 6, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3850613118120305251, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6236685666928141093}, {"avg_size": 2, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1392413941274821287, "histo_col_type": "", "name": "__auto__", "null_count": 5612275972675273775, "row_count": 6236685666928141093}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (21.55s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

        postgres_1    | 
        postgres_1    | 2023-05-13 05:18:29.654 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-05-13 05:18:29.654 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-05-13 05:18:29.654 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-05-13 05:18:29.658 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-05-13 05:18:29.663 UTC [68] LOG:  database system was shut down at 2023-05-13 05:18:29 UTC
        postgres_1    | 2023-05-13 05:18:29.668 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-05-13 05:18:31.870 UTC [78] ERROR:  collation "en" for encoding "UTF8" does not exist at character 168
        postgres_1    | 2023-05-13 05:18:31.870 UTC [78] STATEMENT:  CREATE TABLE "tab lE2" (col2_0 REGROLE NULL, col2_1 OID NULL, col2_2 REGROLE NULL, col2_3 INT8 NOT NULL, "'c)ol2_4" INET NOT NULL, col2_5 FLOAT4 NOT NULL, col2_6 TEXT COLLATE en NOT NULL, 😳col2_7 BIT(42) NOT NULL, "col2%v_8" INET NOT NULL, col2_͆9 FLOAT4 NOT NULL, "co}l2_10" TSVECTOR NOT NULL, col2_11 INT4 NOT NULL, col2_12 REGCLASS NOT NULL, col2_13 DECIMAL NOT NULL, col2_14 INT2[] NOT NULL);
        postgres_1    |     CREATE UNIQUE INDEX ON "tab lE2" (col2_3 ASC, col2_12, col2_6 ASC, col2_0 ASC, 😳col2_7, col2_5 DESC, col2_13, col2_11 ASC, "col2%v_8" DESC, (col2_5 + (-0.10457934439182281)::FLOAT8) DESC, "'c)ol2_4" ASC, col2_2 ASC, col2_͆9 ASC, col2_14 DESC) INCLUDE ("co}l2_10");
        postgres_1    |     CREATE UNIQUE INDEX ON "tab lE2" ("col2%v_8", col2_5 ASC, col2_0 DESC, col2_6 DESC) INCLUDE (col2_1, col2_3, "'c)ol2_4", col2_11, col2_13);
        postgres_1    |     CREATE UNIQUE INDEX ON "tab lE2" (😳col2_7);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (6.11s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.28s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "tab lE2" (col2_0 REGROLE NULL, col2_1 OID NULL, col2_2 REGROLE NULL, col2_3 INT8 NOT NULL, "'c)ol2_4" INET NOT NULL, col2_5 FLOAT4 NOT NULL, col2_6 TEXT COLLATE en NOT NULL, 😳col2_7 BIT(42) NOT NULL, "col2%v_8" INET NOT NULL, col2_͆9 FLOAT4 NOT NULL, "co}l2_10" TSVECTOR NOT NULL, col2_11 INT4 NOT NULL, col2_12 REGCLASS NOT NULL, col2_13 DECIMAL NOT NULL, col2_14 INT2[] NOT NULL);
        test_1        |             CREATE UNIQUE INDEX ON "tab lE2" (col2_3 ASC, col2_12, col2_6 ASC, col2_0 ASC, 😳col2_7, col2_5 DESC, col2_13, col2_11 ASC, "col2%v_8" DESC, (col2_5 + (-0.10457934439182281)::FLOAT8) DESC, "'c)ol2_4" ASC, col2_2 ASC, col2_͆9 ASC, col2_14 DESC) INCLUDE ("co}l2_10");
        test_1        |             CREATE UNIQUE INDEX ON "tab lE2" ("col2%v_8", col2_5 ASC, col2_0 DESC, col2_6 DESC) INCLUDE (col2_1, col2_3, "'c)ol2_4", col2_11, col2_13);
        test_1        |             CREATE UNIQUE INDEX ON "tab lE2" (😳col2_7);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "en" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.70s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 BYTES NOT NULL, 😠col1_1 TIMETZ NOT NULL, "Col1_2" BOOL NOT NULL, col1_3 INT4 NOT NULL, col1_4 REGCLASS, col1_5 GEOGRAPHY NOT NULL, "c😿o
        test_1        |             l1_6" REGROLE NULL, col1_7 JSONB NOT NULL, col1_8 DECIMAL NOT NULL, col1_9 GEOGRAPHY NOT NULL, col1_10 INT2 NULL, "\\x86col1_11" INTERVAL NOT NULL, col1_12 FLOAT8 NULL, "col\\xc51_13" INT2, col1_14 FLOAT4, col1_15 BIT(29) NULL, col1_16 REGROLE, col1̀_17 INT8 AS ("col\\xc51_13" + col1_3) STORED, "co%ql1_18" FLOAT8 AS (col1_14 + 1.3336272239685059:::FLOAT8) VIRTUAL, FAMILY (col1̀_17, col1_5), FAMILY (col1_16), FAMILY ("c😿o
        test_1        |             l1_6", col1_12, col1_14, "\\x86col1_11", 😠col1_1, col1_4), FAMILY (col1_3), FAMILY (col1_10), FAMILY (col1_7, col1_15), FAMILY (col1_0, "col\\xc51_13", col1_8), FAMILY ("Col1_2"), FAMILY (col1_9));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 23, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2907137919811615383, "histo_col_type": "", "name": "__auto__", "null_count": 2329318326614689392, "row_count": 4128701922322292015}, {"avg_size": 30, "columns": ["col1_16"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 393053513367799655, "histo_col_type": "", "name": "__auto__", "null_count": 589387866604810219, "row_count": 4128701922322292015}, {"avg_size": 21, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2622268479569649546, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4128701922322292015}, {"avg_size": 9, "columns": ["\\"Col1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 653366744704635469, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4128701922322292015}, {"avg_size": 18, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1740891235276556502, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4128701922322292015}, {"avg_size": 17, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1828942799200769770, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4128701922322292015}, {"avg_size": 20, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 965217482156461392, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4128701922322292015}, {"avg_size": 1, "columns": ["\\"col\\\\\\\\xc51_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2652951334124266854, "histo_col_type": "", "name": "__auto__", "null_count": 56494309759502458, "row_count": 4128701922322292015}, {"avg_size": 22, "columns": ["\U0001F620col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3695834457568151885, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4128701922322292015}, {"avg_size": 27, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2516206007652477619, "histo_col_type": "", "name": "__auto__", "null_count": 2598187737342942273, "row_count": 4128701922322292015}, {"avg_size": 0, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3382098690553456643, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4128701922322292015}, {"avg_size": 26, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4004664587586564380, "histo_col_type": "", "name": "__auto__", "null_count": 3001066614927179406, "row_count": 4128701922322292015}, {"avg_size": 15, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2574836001706538036, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4128701922322292015}, {"avg_size": 27, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1647910611761282680, "histo_col_type": "", "name": "__auto__", "null_count": 1648879699513822716, "row_count": 4128701922322292015}, {"avg_size": 12, "columns": ["\\"\\\\\\\\x86col1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 709430836308916245, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4128701922322292015}, {"avg_size": 2, "columns": ["\\"co%ql1_18\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3850885885657401475, "histo_col_type": "", "name": "__auto__", "null_count": 841619718330952954, "row_count": 4128701922322292015}, {"avg_size": 10, "columns": ["\\"c\U0001F63Fo\\nl1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1970125800661415727, "histo_col_type": "", "name": "__auto__", "null_count": 3752277457565617263, "row_count": 4128701922322292015}, {"avg_size": 12, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1009618238606474484, "histo_col_type": "", "name": "__auto__", "null_count": 3338124764526497130, "row_count": 4128701922322292015}, {"avg_size": 6, "columns": ["col1\u0300_17"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2862661369779593743, "histo_col_type": "", "name": "__auto__", "null_count": 3641854694955288870, "row_count": 4128701922322292015}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 16, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2480572281520746810, "histo_col_type": "", "name": "__auto__", "null_count": 3137589222542259455, "row_count": 5081342907924982775}, {"avg_size": 10, "columns": ["col1\u0300_17"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1537006388725986777, "histo_col_type": "", "name": "__auto__", "null_count": 4663195662301191376, "row_count": 5081342907924982775}, {"avg_size": 13, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2248196887217293808, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5081342907924982775}, {"avg_size": 30, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1365609187884620270, "histo_col_type": "", "name": "__auto__", "null_count": 1889177249382600056, "row_count": 5081342907924982775}, {"avg_size": 10, "columns": ["\\"co%ql1_18\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3239227544881460222, "histo_col_type": "", "name": "__auto__", "null_count": 4482562842237630510, "row_count": 5081342907924982775}, {"avg_size": 10, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1923798433717838503, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5081342907924982775}, {"avg_size": 30, "columns": ["col1_16"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3735261980762819634, "histo_col_type": "", "name": "__auto__", "null_count": 4628084510834970302, "row_count": 5081342907924982775}, {"avg_size": 6, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3360173519513012395, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5081342907924982775}, {"avg_size": 10, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4487903278216586178, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5081342907924982775}, {"avg_size": 11, "columns": ["\\"col\\\\\\\\xc51_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2411274558345570772, "histo_col_type": "", "name": "__auto__", "null_count": 225573645382120330, "row_count": 5081342907924982775}, {"avg_size": 24, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3191496014821120422, "histo_col_type": "", "name": "__auto__", "null_count": 4987936439364472836, "row_count": 5081342907924982775}, {"avg_size": 31, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4751386206852809924, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5081342907924982775}, {"avg_size": 18, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1082820444009788713, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5081342907924982775}, {"avg_size": 8, "columns": ["\\"c\U0001F63Fo\\nl1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 21325282295012621, "histo_col_type": "", "name": "__auto__", "null_count": 3972828741111285888, "row_count": 5081342907924982775}, {"avg_size": 14, "columns": ["\\"\\\\\\\\x86col1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 649117084184877658, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5081342907924982775}, {"avg_size": 12, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4625044717545890323, "histo_col_type": "", "name": "__auto__", "null_count": 967580523529178369, "row_count": 5081342907924982775}, {"avg_size": 21, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 957383754665088557, "histo_col_type": "", "name": "__auto__", "null_count": 1732045249861515854, "row_count": 5081342907924982775}, {"avg_size": 6, "columns": ["\U0001F620col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2549516721912978512, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5081342907924982775}, {"avg_size": 18, "columns": ["\\"Col1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3544374218784959273, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5081342907924982775}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.98s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("8"),
        test_1        |                 &net.IPNet{IP: s"::8", Mask: s"00000000000000000000000000000000"},
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         COALESCE(regproc(8:::INT8::INT4::INT4)::REGPROC, 5:::OID::OID) AS col12666, '::8/0':::INET::INET AS col12667
        test_1        |                 )
        test_1        |                     AS tab8883
        test_1        |             ORDER BY
        test_1        |                 col12666 NULLS LAST, col12667 DESC NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         COALESCE(regproc(8::INT8::INT4::INT4)::REGPROC, 5::OID::OID) AS col12666, '::8/0'::INET::INET AS col12667
        test_1        |                 )
        test_1        |                     AS tab8883
        test_1        |             ORDER BY
        test_1        |                 col12666 NULLS LAST, col12667 DESC NULLS LAST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.58s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 BOOL NOT NULL, PRIMARY KEY (col1_0 DESC), INDEX (col1_0 DESC) WHERE NOT table1.col1_0, UNIQUE (col1_0 DESC));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS '[{"avg_size": 24, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1090, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS '[{"avg_size": 19, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4079149, "histo_buckets": [{"distinct_range": 0, "num_eq": 3066545481694032448, "num_range": 0, "upper_bound": "false"}, {"distinct_range": 114564613255945200, "num_eq": 90, "num_range": 2015131168263781172, "upper_bound": "true"}], "histo_col_type": "BOOL", "name": "__auto__", "null_count": 0, "row_count": 8000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (42.66s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1.0 @ 358e0d87912365b8976c55ab9b3292e999cf720d:

        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         "tab{5401".c͈ol7661 AS col7662
        test_1        |                     FROM
        test_1        |                         (
        test_1        |                             VALUES
        test_1        |                                 (int2(5::DECIMAL::DECIMAL::DECIMAL)::INT2),
        test_1        |                                 (7::INT8::INT2),
        test_1        |                                 (5::INT8::INT2),
        test_1        |                                 (NULL::INT2),
        test_1        |                                 (6::INT8::INT2),
        test_1        |                                 (st_zmflag(NULL::GEOMETRY::GEOMETRY)::INT2)
        test_1        |                         )
        test_1        |                             AS "tab{5401" (c͈ol7661)
        test_1        |                     WHERE
        test_1        |                         true::BOOL
        test_1        |                     ORDER BY
        test_1        |                         "tab{5401".c͈ol7661 NULLS FIRST,
        test_1        |                         "tab{5401".c͈ol7661 DESC,
        test_1        |                         "tab{5401".c͈ol7661 DESC,
        test_1        |                         "tab{5401".c͈ol7661 ASC NULLS FIRST,
        test_1        |                         "tab{5401".c͈ol7661 ASC NULLS LAST,
        test_1        |                         "tab{5401".c͈ol7661 ASC NULLS LAST
        test_1        |                 )
        test_1        |                     AS "ta%pb5402"
        test_1        |             ORDER BY
        test_1        |                 col7662 ASC;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.63s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "t�able1" (col1_0 STRING NOT NULL, col͓1_1 INT4 NOT NULL, col1_2 TIMETZ NOT NULL, col1_3 NAME NOT NULL, col1_4 GEOMETRY NOT NULL, "col\v1_5" INT8 NOT NULL AS (col͓1_1 + (-35292300):::INT8) STORED, "%02col1_6" STRING NOT NULL AS (lower(col1_0)) STORED, "c͛ol""1_7" STRING NOT NULL AS (lower(col1_3)) STORED, INDEX (col1_0 ASC, "col\v1_5" DESC, col͓1_1) STORING (col1_2, col1_3, col1_4, "c͛ol""1_7") WHERE ((("t�able1"."col\v1_5" <= 32767:::INT8) AND ("t�able1".col͓1_1 >= 127:::INT8)) AND ("t�able1".col1_0 >= '':::STRING)) OR ("t�able1"."c͛ol""1_7" != '':::STRING) NOT VISIBLE, INDEX ("c͛ol""1_7" DESC, col͓1_1 DESC, col1_3 DESC) STORING (col1_0, col1_2, col1_4, "col\v1_5") WHERE ((((("t�able1".col͓1_1 > (-1):::INT8) AND ("t�able1".col1_3 <= e'\x00':::STRING:::NAME)) OR ("t�able1".col1_2 >= '00:00:00+15:59':::TIMETZ)) OR ("t�able1"."col\v1_5" != (-9223372036854775807):::INT8)) AND ("t�able1".col1_0 != e'\x00':::STRING)) OR ("t�able1"."c͛ol""1_7" > 'X':::STRING), FAMILY (col͓1_1, col1_3, col1_4, "c͛ol""1_7", col1_0), FAMILY ("%02col1_6"), FAMILY ("col\v1_5", col1_2));
        test_1        |             ALTER TABLE "t�able1" INJECT STATISTICS e'[{"avg_size": 0, "columns": ["col\u03531_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 592, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 9, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 291, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 20, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 884, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 5, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 281, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 29, "columns": ["\\"col\\\\v1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 408, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 26, "columns": ["\\"%02col1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 201, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 14, "columns": ["\\"c\u035Bol\\"\\"1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 205, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 31, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 536, "histo_buckets": [{"distinct_range": 0, "num_eq": 1579402023080824197, "num_range": 0, "upper_bound": "\\""}, {"distinct_range": 1885121593.716516, "num_eq": 50000000000, "num_range": 3000000000, "upper_bound": ">"}, {"distinct_range": 1166114228092103000, "num_eq": 100000, "num_range": 1474785976668441650, "upper_bound": "?"}, {"distinct_range": 0, "num_eq": 7893617172727897632, "num_range": 6970793216472473207, "upper_bound": "loC\\u0017l"}, {"distinct_range": 0, "num_eq": 900000, "num_range": 70000000000, "upper_bound": "nB~\\u000e2\\u0007s\\u001e"}, {"distinct_range": 435117560811910340, "num_eq": 80000, "num_range": 4090443296140692998, "upper_bound": "pMAw``\\u0006rz"}, {"distinct_range": 1034817272907801600, "num_eq": 7646200445381511738, "num_range": 1046777997074274914, "upper_bound": "{Dw"}, {"distinct_range": 400000, "num_eq": 5138569569870465792, "num_range": 400000, "upper_bound": "~"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 900}]':::JSONB;
        test_1        |             ALTER TABLE "t�able1" INJECT STATISTICS e'[{"avg_size": 22, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 262335, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000}, {"avg_size": 31, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 281695, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000}, {"avg_size": 24, "columns": ["\\"col\\\\v1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 26357, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000}, {"avg_size": 9, "columns": ["\\"%02col1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 624308, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000}, {"avg_size": 3, "columns": ["\\"c\u035Bol\\"\\"1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 232138, "histo_buckets": [{"distinct_range": 0, "num_eq": 4000000000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 1774520384561582600, "num_eq": 8869248256015233710, "num_range": 1774520384561582718, "upper_bound": "\\u0019I\\u0012*l?"}, {"distinct_range": 2858.2190870711606, "num_eq": 4713012740752094052, "num_range": 8000, "upper_bound": "1"}, {"distinct_range": 1500164441308877600, "num_eq": 7000000, "num_range": 2968262578135365554, "upper_bound": "VHi"}, {"distinct_range": 0, "num_eq": 7000, "num_range": 1884226626778256222, "upper_bound": "W"}, {"distinct_range": 1726404339188750000, "num_eq": 5075144351611722408, "num_range": 1726404339188750087, "upper_bound": "_\\u0001\\u001e\\u000b2\\u0019"}, {"distinct_range": 1814768512127559400, "num_eq": 4601934720817244508, "num_range": 2728625038678576569, "upper_bound": "|gLL\\u0014*3"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 800000}, {"avg_size": 27, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 30957, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000}, {"avg_size": 17, "columns": ["col\u03531_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 572713, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000}, {"avg_size": 29, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 514734, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (36.56s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #99181 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-23.1] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!