search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
29.86k stars 3.77k forks source link

compose: TestComposeCompare failed #99181

Closed cockroach-teamcity closed 1 year ago

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 80c4895c566a7eaa6f16c4098980509dd3795ad7:

        test_1        | I230322 05:17:35.632019 7 testutils/soon.go:41  [-] 1  SucceedsSoon: dial tcp 172.18.0.4:5432: connect: connection refused
        postgres_1    | 2023-03-22 05:17:35.650 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-03-22 05:17:35.650 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-03-22 05:17:35.650 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-03-22 05:17:35.656 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-03-22 05:17:35.660 UTC [69] LOG:  database system was shut down at 2023-03-22 05:17:35 UTC
        postgres_1    | 2023-03-22 05:17:35.665 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-03-22 05:17:37.574 UTC [79] ERROR:  collation "de" for encoding "UTF8" does not exist at character 254
        postgres_1    | 2023-03-22 05:17:37.574 UTC [79] STATEMENT:  CREATE TABLE "t\\x9a able2" (col2_0 REGNAMESPACE NULL, "col|2_1" REGNAMESPACE NULL, col2_2 GEOGRAPHY NOT NULL, "col2
_3" INT4 NOT NULL, col2_4 UUID NOT NULL, col2_5 GEOGRAPHY NOT NULL, col2_6 DECIMAL NOT NULL, "col�2_7" TIMETZ NOT NULL, "col2_%q8" TEXT COLLATE de NOT NULL, "col2😋_ 9" UUID NOT NULL, col2_10 TIME NOT NULL, "col2\n_11" REGTYPE NOT NULL, col2_12 BOOL NOT NULL, col2_13 BIT(45) NOT NULL, "
col2_14" BOX2D NOT NULL, "co    l2_15" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_4 AS TEXT))) STORED, col2_16 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_2 AS TEXT))) STORED, ",col2_17" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_5 AS TEXT))) STORED, col2_͜18 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("col2😋_ 9" AS TEXT))) STORED, PRIMARY KEY ("col�2_7", "col2\n_11"));
        postgres_1    |     CREATE INDEX ON "t\\x9a able2" (lower(CAST("
col2_14" AS TEXT)), col2_12 DESC, "col2_%q8" ASC, "col2
_3") INCLUDE (col2_0, col2_4, col2_6, "col2😋_ 9");
        postgres_1    |     CREATE INDEX ON "t\\x9a able2" (col2_6);
        postgres_1    |     CREATE INDEX ON "t\\x9a able2" ("co l2_15" DESC, "col2_%q8" DESC, lower(CAST("col2😋_ 9" AS TEXT)), col2_4, col2_6, ",col2_17" DESC, col2_16 ASC, col2_12 ASC, col2_10 ASC, "col2😋_ 9" DESC, col2_0 ASC, "col2
_3", "col�2_7" DESC, "col|2_1", "col2\n_11" DESC) INCLUDE (col2_2, col2_5, col2_13);
        postgres_1    |     CREATE INDEX ON "t\\x9a able2" ("co l2_15", "col|2_1" DESC, "col�2_7", "col2😋_ 9", "col2
_3" ASC, lower(CAST("col2_%q8" AS TEXT)), col2_͜18 ASC, col2_16, col2_0 ASC, ",col2_17" ASC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.88s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.93s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "t\\x9a able2" (col2_0 REGNAMESPACE NULL, "col|2_1" REGNAMESPACE NULL, col2_2 GEOGRAPHY NOT NULL, "col2
_3" INT4 NOT NULL, col2_4 UUID NOT NULL, col2_5 GEOGRAPHY NOT NULL, col2_6 DECIMAL NOT NULL, "col�2_7" TIMETZ NOT NULL, "col2_%q8" TEXT COLLATE de NOT NULL, "col2😋_ 9" UUID NOT NULL, col2_10 TIME NOT NULL, "col2\n_11" REGTYPE NOT NULL, col2_12 BOOL NOT NULL, col2_13 BIT(45) NOT NULL, "
col2_14" BOX2D NOT NULL, "co    l2_15" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_4 AS TEXT))) STORED, col2_16 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_2 AS TEXT))) STORED, ",col2_17" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_5 AS TEXT))) STORED, col2_͜18 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("col2😋_ 9" AS TEXT))) STORED, PRIMARY KEY ("col�2_7", "col2\n_11"));
        test_1        |             CREATE INDEX ON "t\\x9a able2" (lower(CAST("
col2_14" AS TEXT)), col2_12 DESC, "col2_%q8" ASC, "col2
_3") INCLUDE (col2_0, col2_4, col2_6, "col2😋_ 9");
        test_1        |             CREATE INDEX ON "t\\x9a able2" (col2_6);
        test_1        |             CREATE INDEX ON "t\\x9a able2" ("co l2_15" DESC, "col2_%q8" DESC, lower(CAST("col2😋_ 9" AS TEXT)), col2_4, col2_6, ",col2_17" DESC, col2_16 ASC, col2_12 ASC, col2_10 ASC, "col2😋_ 9" DESC, col2_0 ASC, "col2
_3", "col�2_7" DESC, "col|2_1", "col2\n_11" DESC) INCLUDE (col2_2, col2_5, col2_13);
        test_1        |             CREATE INDEX ON "t\\x9a able2" ("co l2_15", "col|2_1" DESC, "col�2_7", "col2😋_ 9", "col2
_3" ASC, lower(CAST("col2_%q8" AS TEXT)), col2_͜18 ASC, col2_16, col2_0 ASC, ",col2_17" ASC);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "de" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.82s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "ta�blẹ1" ("col1!_0" TIMETZ NOT NULL, "col1-_1" BIT(41), col1_2 STRING NOT NULL, "col1_ 3" INTERVAL NOT NULL, col1_4 TIMESTAMPTZ NOT NULL, "col1%d7_5" JSONB NOT NULL, 😣col1_6 INT4 NOT NULL, " col😯1_7" REGCLASS NULL, col1_8 TIMETZ NOT NULL, col1̴_9 REGNAMESPACE NULL, col1_10 TIMESTAMP NOT NULL, col1_11 INET NULL, col1_12 FLOAT4 NOT NULL, "co l1_13" STRING NULL AS (CASE WHEN col1̴_9 IS NULL THEN e'O\n':::STRING ELSE 'A(Xx4':::STRING END) STORED, col1_14 STRING NULL AS (CASE WHEN " col😯1_7" IS NULL THEN '':::STRING ELSE e'\U00002603':::STRING END) STORED, UNIQUE (" col😯1_7", col1_11 ASC, col1_2 DESC, col1_10 ASC, (CASE WHEN col1_4 IS NULL THEN e'g\x0f':::STRING ELSE 'DOY':::STRING END) ASC, 😣col1_6 ASC, "col1_ 3" DESC, col1_14 DESC, "col1!_0" ASC) WHERE ((((((("ta�blẹ1".col1_4 = '2001-01-01 00:00:00+00 BC':::TIMESTAMPTZ) OR ("ta�blẹ1"."co l1_13" >= e'\x00':::STRING)) AND ("ta�blẹ1".col1_14 >= 'X':::STRING)) OR ("ta�blẹ1".col1_10 != '0001-01-01 00:00:00':::TIMESTAMP)) OR ("ta�blẹ1".col1_2 = 'X':::STRING)) AND ("ta�blẹ1".😣col1_6 <= (-32768):::INT8)) AND ("ta�blẹ1"."col1!_0" != '24:00:00-15:59':::TIMETZ)) AND ("ta�blẹ1".col1_12 <= 'NaN':::FLOAT8), INDEX (col1_8 DESC, " col😯1_7" ASC, col1_10) STORING (col1_2, col1_4, "col1%d7_5", col1_12, "co l1_13", col1_14) WHERE (((((((("ta�blẹ1".col1_12 > 1.0:::FLOAT8) AND ("ta�blẹ1".col1_2 != e'\'':::STRING)) AND ("ta�blẹ1".col1_4 >= '0001-01-01 00:00:00+00':::TIMESTAMPTZ)) AND ("ta�blẹ1"."col1!_0" > '00:00:00+15:59':::TIMETZ)) OR ("ta�blẹ1".col1_14 >= e'\x00':::STRING)) AND ("ta�blẹ1".😣col1_6 <= 2147483647:::INT8)) OR ("ta�blẹ1".col1_10 <= '3000-01-01 00:00:00':::TIMESTAMP)) AND ("ta�blẹ1".col1_8 <= '24:00:00-15:59':::TIMETZ)) OR ("ta�blẹ1"."co l1_13" > e'\U00002603':::STRING), UNIQUE (col1_12 DESC, col1̴_9 ASC, col1_11 ASC) STORING (col1_4, "col1%d7_5", 😣col1_6, " col😯1_7", col1_8, "co l1_13") WHERE (("ta�blẹ1".col1_12 < 'NaN':::FLOAT8) OR ("ta�blẹ1".col1_14 >= e'\'':::STRING)) OR ("ta�blẹ1".col1_4 >= '2001-01-01 00:00:00+00 BC':::TIMESTAMPTZ), INDEX (😣col1_6, lower(CAST("col1%d7_5" AS STRING)), "co l1_13", col1_12 DESC, "col1-_1" DESC, col1̴_9 ASC, (CASE WHEN "col1_ 3" IS NULL THEN e'\'':::STRING ELSE e'\x12#g@':::STRING END) DESC, col1_14 DESC, col1_10) WHERE (((((((("ta�blẹ1"."co l1_13" > 'X':::STRING) OR ("ta�blẹ1"."col1!_0" > '00:00:00+15:59':::TIMETZ)) AND ("ta�blẹ1".col1_8 >= '00:00:00+15:59':::TIMETZ)) AND ("ta�blẹ1".😣col1_6 != (-128):::INT8)) AND ("ta�blẹ1".col1_2 = e'\U00002603':::STRING)) OR ("ta�blẹ1".col1_10 = '2001-01-01 00:00:00 BC':::TIMESTAMP)) OR ("ta�blẹ1".col1_14 <= e'\U00002603':::STRING)) AND ("ta�blẹ1".col1_4 = '4714-11-24 00:00:00+00 BC':::TIMESTAMPTZ)) OR ("ta�blẹ1".col1_12 <= 1.401298464324817e-45:::FLOAT8), UNIQUE (col1_12, col1_8 ASC, col1_11 DESC, 😣col1_6, col1̴_9 DESC, col1_10 DESC, "col1-_1", col1_4 DESC) STORING ("col1!_0", "col1%d7_5", " col😯1_7", col1_14), FAMILY ("col1%d7_5", "col1-_1"), FAMILY ("col1_ 3", 😣col1_6), FAMILY ("col1!_0", " col😯1_7", col1_14, col1_8), FAMILY (col1_12, col1_2), FAMILY (col1_4), FAMILY (col1_11), FAMILY (col1_10), FAMILY ("co l1_13", col1̴_9), UNIQUE (" col😯1_7") STORING (col1_4, "col1%d7_5", col1_8, col1_10, col1_11, "co l1_13", col1_14));
        test_1        |             ALTER TABLE "ta�blẹ1" INJECT STATISTICS e'[{"avg_size": 14, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 25394966, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 20, "columns": ["\\"col1%d7_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 19949886, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 3, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 36109719, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 10, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2247535, "histo_buckets": [{"distinct_range": 0, "num_eq": 8000000000, "num_range": 0, "upper_bound": "02:38:13.832333+09:16"}, {"distinct_range": 0, "num_eq": 800, "num_range": 7000, "upper_bound": "12:46:18.087297+04:28"}], "histo_col_type": "TIMETZ", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 1, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 29305653, "histo_buckets": [{"distinct_range": 0, "num_eq": 7010938436538558363, "num_range": 0, "upper_bound": "-Inf"}, {"distinct_range": 0, "num_eq": 20000000, "num_range": 2000, "upper_bound": "-1.0249327421188354"}, {"distinct_range": 0, "num_eq": 8480483510643368000, "num_range": 0, "upper_bound": "-0.983762800693512"}, {"distinct_range": 60000000000, "num_eq": 100000, "num_range": 60000000000, "upper_bound": "-0.03694360703229904"}, {"distinct_range": 2000000, "num_eq": 2130761247113259162, "num_range": 2000000, "upper_bound": "0.34569036960601807"}, {"distinct_range": 0, "num_eq": 5351873099627141556, "num_range": 0, "upper_bound": "0.3871581554412842"}, {"distinct_range": 69.1836264669059, "num_eq": 0, "num_range": 70, "upper_bound": "0.4983958601951599"}, {"distinct_range": 800000, "num_eq": 3915296036258719005, "num_range": 800000, "upper_bound": "0.561275839805603"}], "histo_col_type": "FLOAT4", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 8, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6707318, "histo_col_type": "", "name": "__auto__", "null_count": 1480382, "row_count": 40000000}, {"avg_size": 22, "columns": ["\\"co l1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 38726300, "histo_col_type": "", "name": "__auto__", "null_count": 37794451, "row_count": 40000000}, {"avg_size": 9, "columns": ["\\"col1!_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 18857271, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 13, "columns": ["\\"col1_ 3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 34957465, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 5, "columns": ["\U0001F623col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 28775846, "histo_buckets": [{"distinct_range": 0, "num_eq": 6784073600130794875, "num_range": 0, "upper_bound": "-1931195488"}, {"distinct_range": 555335894520771200, "num_eq": 100000000, "num_range": 555335894520771213, "upper_bound": "-486487034"}, {"distinct_range": 3346120.48435007, "num_eq": 30000000, "num_range": 4000000, "upper_bound": "-199382368"}, {"distinct_range": 251770096348671420, "num_eq": 10, "num_range": 3828066497795813448, "upper_bound": "216262561"}], "histo_col_type": "INT4", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 14, "columns": ["\\" col\U0001F62F1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 31903921, "histo_buckets": [{"distinct_range": 0, "num_eq": 2109619573931772233, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 0, "num_eq": 3000, "num_range": 700000, "upper_bound": "1767204692"}, {"distinct_range": 2809119342579447000, "num_eq": 7867384931785233664, "num_range": 4515771172546551171, "upper_bound": "1976752686"}, {"distinct_range": 0, "num_eq": 80000, "num_range": 20, "upper_bound": "2669323629"}, {"distinct_range": 0, "num_eq": 4000000, "num_range": 7551492227655154048, "upper_bound": "3388137226"}, {"distinct_range": 6074690.654376435, "num_eq": 5000000, "num_range": 8000000, "upper_bound": "3476536077"}, {"distinct_range": 0, "num_eq": 100, "num_range": 70000000, "upper_bound": "3515197722"}, {"distinct_range": 50000000000, "num_eq": 3178963988972762467, "num_range": 50000000000, "upper_bound": "3545531074"}], "histo_col_type": "REGCLASS", "name": "__auto__", "null_count": 9351922, "row_count": 40000000}, {"avg_size": 5, "columns": ["col1\u0334_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 16304025, "histo_col_type": "", "name": "__auto__", "null_count": 38238009, "row_count": 40000000}, {"avg_size": 0, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 615023, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 27, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 10858404, "histo_col_type": "", "name": "__auto__", "null_count": 13502806, "row_count": 40000000}, {"avg_size": 2, "columns": ["\\"col1-_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 32229091, "histo_col_type": "", "name": "__auto__", "null_count": 27564707, "row_count": 40000000}]':::JSONB;
        test_1        |             ALTER TABLE "ta�blẹ1" INJECT STATISTICS e'[{"avg_size": 19, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 571446347359081480, "histo_buckets": [{"distinct_range": 0, "num_eq": 6000, "num_range": 0, "upper_bound": "11:11:54.884977+05:22"}, {"distinct_range": 5567523667698670000, "num_eq": 6678979209265736922, "num_range": 5567523667698669339, "upper_bound": "04:57:54.855417-09:03"}, {"distinct_range": 231323171742471550, "num_eq": 4303737044014195896, "num_range": 284682855202562505, "upper_bound": "21:55:34.310656+00:40"}], "histo_col_type": "TIMETZ", "name": "__auto__", "null_count": 0, "row_count": 1045728435526683687}, {"avg_size": 2, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 51986975012731791, "histo_buckets": [{"distinct_range": 0, "num_eq": 4714335556334991866, "num_range": 0, "upper_bound": "-1.2845820188522339"}, {"distinct_range": 0, "num_eq": 6777144939015069170, "num_range": 100000000000, "upper_bound": "-0.7066513299942017"}, {"distinct_range": 0, "num_eq": 8567535904146781383, "num_range": 6621254151589034138, "upper_bound": "-0.4180809259414673"}, {"distinct_range": 2486265147096646000, "num_eq": 3382524227266973876, "num_range": 6673268180508188090, "upper_bound": "-0.2519383430480957"}, {"distinct_range": 0, "num_eq": 8965937842919586147, "num_range": 3477422848101434137, "upper_bound": "-0.06394058465957642"}, {"distinct_range": 3987637601410387000, "num_eq": 0, "num_range": 5171822276756425260, "upper_bound": "0.0"}, {"distinct_range": 639060218.2694572, "num_eq": 40000, "num_range": 1000000000, "upper_bound": "0.36619868874549866"}, {"distinct_range": 4773458313788416000, "num_eq": 500000, "num_range": 6911375800162024036, "upper_bound": "0.6663993000984192"}], "histo_col_type": "FLOAT4", "name": "__auto__", "null_count": 0, "row_count": 1045728435526683687}, {"avg_size": 19, "columns": ["\\"col1-_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 912642154710816860, "histo_col_type": "", "name": "__auto__", "null_count": 541800077248586898, "row_count": 1045728435526683687}, {"avg_size": 3, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 291992955874115750, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1045728435526683687}, {"avg_size": 19, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 469410591263403749, "histo_col_type": "", "name": "__auto__", "null_count": 651707526819680627, "row_count": 1045728435526683687}, {"avg_size": 12, "columns": ["\\" col\U0001F62F1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 704393009074730796, "histo_buckets": [{"distinct_range": 0, "num_eq": 60, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 0, "num_eq": 20000, "num_range": 0, "upper_bound": "269823384"}, {"distinct_range": 5154241938876317000, "num_eq": 1073861277118570790, "num_range": 5154241938876316635, "upper_bound": "484869341"}, {"distinct_range": 0, "num_eq": 900000, "num_range": 40, "upper_bound": "1055574698"}, {"distinct_range": 300000, "num_eq": 60000, "num_range": 300000, "upper_bound": "2427962536"}], "histo_col_type": "REGCLASS", "name": "__auto__", "null_count": 755778793217521550, "row_count": 1045728435526683687}, {"avg_size": 1, "columns": ["col1\u0334_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 597289787014537804, "histo_col_type": "", "name": "__auto__", "null_count": 480409062863734704, "row_count": 1045728435526683687}, {"avg_size": 13, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 287285734564435948, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1045728435526683687}, {"avg_size": 0, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 930016635759761534, "histo_col_type": "", "name": "__auto__", "null_count": 274871676469800399, "row_count": 1045728435526683687}, {"avg_size": 23, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1028457596295707022, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1045728435526683687}, {"avg_size": 26, "columns": ["\\"col1_ 3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 726081256126550615, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1045728435526683687}, {"avg_size": 9, "columns": ["\\"col1%d7_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 718926036905078139, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1045728435526683687}, {"avg_size": 18, "columns": ["\U0001F623col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 165558455808256018, "histo_buckets": [{"distinct_range": 0, "num_eq": 6562943676540944948, "num_range": 0, "upper_bound": "-1236836662"}, {"distinct_range": 0, "num_eq": 5476584162122665628, "num_range": 2431171491899742264, "upper_bound": "0"}, {"distinct_range": 2694039102675948000, "num_eq": 541818505876841540, "num_range": 2694039102675947792, "upper_bound": "1473815836"}, {"distinct_range": 0, "num_eq": 7577247010852682438, "num_range": 1000000000, "upper_bound": "2002685839"}], "histo_col_type": "INT4", "name": "__auto__", "null_count": 0, "row_count": 1045728435526683687}, {"avg_size": 27, "columns": ["\\"co l1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 145757256501484589, "histo_col_type": "", "name": "__auto__", "null_count": 791175453081815192, "row_count": 1045728435526683687}, {"avg_size": 25, "columns": ["\\"col1!_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 533160467914008557, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1045728435526683687}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.57s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

/cc @cockroachdb/sql-sessions

This test on roachdash | Improve this report!

Jira issue: CRDB-25737

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 751b17200b6026b73351c57cab734415d2c4b02a:

        postgres_1    | 
        postgres_1    | 2023-03-23 05:17:37.680 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-03-23 05:17:37.680 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-03-23 05:17:37.680 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-03-23 05:17:37.683 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-03-23 05:17:37.688 UTC [68] LOG:  database system was shut down at 2023-03-23 05:17:37 UTC
        postgres_1    | 2023-03-23 05:17:37.692 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-03-23 05:17:39.352 UTC [78] ERROR:  collation "da" for encoding "UTF8" does not exist at character 100
        postgres_1    | 2023-03-23 05:17:39.352 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 TSVECTOR NOT NULL, col1_1 TIMESTAMPTZ NULL, c😔ol1_2 TEXT, col1_😆3 TEXT COLLATE da NOT NULL, "col 1_4" CHAR NOT NULL, "col1_%p5" BYTEA NOT NULL, col1_6 DECIMAL NOT NULL, "col
        postgres_1    |     1_7" TEXT COLLATE de NOT NULL, "c
ol1_😔8" REGCLASS NOT NULL, col̘1_9 INT2 NOT NULL, col1_10 FLOAT4 NOT NULL, col1_11 CHAR, "col1_\\u0B6E12" BIT(36)[] NOT NULL, "cOl1%p_13" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_0 AS TEXT))) STORED, col1_14 TEXT NOT NULL GENERATED ALWAYS AS (lower("col 1_4")) STORED, "col1_ 15" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_😆3 AS TEXT))) STORED, PRIMARY KEY ("c
ol1_😔8", "col 1_4", col1_6, "col
        postgres_1    |     1_7", "col1_%p5", "cOl1%p_13", "col1_\\u0B6E12"));
        postgres_1    |     CREATE INDEX ON table1 (col1_10 ASC, col̘1_9 ASC, col1_14 ASC, col1_1 ASC, lower(c😔ol1_2) DESC, "col1_\\u0B6E12" DESC, "col
        postgres_1    |     1_7", (col1_6 + (-331677141599015136.8)::DECIMAL), "col 1_4" DESC, col1_11 DESC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (4.50s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/mutators (0.41s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE ta😏b😰le1 ("'col1_0" TIME NOT NULL, col1_̷1 TSQUERY NOT NULL, "co.l1_2" INT4 NOT NULL, col1_3 JSONB NOT NULL, "col%v1_4" BOX2D NOT NULL, "co%pl""1_\g5" VARCHAR NOT NULL, "c\\x74ol1_6" STRING NOT NULL AS (lower(CAST("col%v1_4" AS STRING))) STORED, "cͮol1'_7" STRING NOT NULL AS (lower(CAST(col1_3 AS STRING))) VIRTUAL, "c\vol1_8" STRING NOT NULL AS (lower(CAST("col%v1_4" AS STRING))) VIRTUAL, col1_9 STRING NOT NULL AS (lower(CAST(col1_̷1 AS STRING))) STORED, "col%v\f1_10" STRING NOT NULL AS (lower(CAST("col%v1_4" AS STRING))) STORED, INDEX ("'col1_0" DESC, "c\vol1_8" ASC, col1_9 DESC) WHERE ta😏b😰le1."'col1_0" < '24:00:00':::TIME NOT VISIBLE, UNIQUE ("co%pl""1_\g5" DESC) STORING ("'col1_0", col1_3, "col%v1_4", "c\\x74ol1_6", col1_9, "col%v\f1_10"), FAMILY ("col%v1_4", "co%pl""1_\g5"), FAMILY (col1_3), FAMILY ("'col1_0"), FAMILY ("col%v\f1_10"), FAMILY (col1_̷1), FAMILY ("c\\x74ol1_6", "co.l1_2", col1_9));
        test_1        |             ALTER TABLE ta😏b😰le1 INJECT STATISTICS e'[{"avg_size": 0, "columns": ["col1_\u03371"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col%v1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"c\\\\\\\\x74ol1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"c\u036Eol1\'_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"\'col1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 10000, "num_range": 0, "upper_bound": "00:00:00"}, {"distinct_range": 20.785909537518116, "num_eq": 30000000000, "num_range": 100, "upper_bound": "06:36:01.640385"}, {"distinct_range": 405517261373520600, "num_eq": 164045906293110866, "num_range": 883521733039681073, "upper_bound": "07:27:50.42003"}, {"distinct_range": 161040.87513827696, "num_eq": 600000000, "num_range": 2000000, "upper_bound": "10:28:48.409916"}, {"distinct_range": 0, "num_eq": 4376341303851220724, "num_range": 0, "upper_bound": "13:00:38.272056"}], "histo_col_type": "TIME", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"co.l1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"co%pl\\"\\"1_\\\\g5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"c\\\\vol1_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col%v\\\\f1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}]':::JSONB;
        test_1        |             ALTER TABLE ta😏b😰le1 INJECT STATISTICS e'[{"avg_size": 12, "columns": ["\\"\'col1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 87365166902376167, "histo_col_type": "TIME", "name": "__auto__", "null_count": 0, "row_count": 636823055861548079}, {"avg_size": 20, "columns": ["\\"co.l1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 340245270540791988, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 636823055861548079}, {"avg_size": 18, "columns": ["\\"col%v1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 485408936843438900, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 636823055861548079}, {"avg_size": 6, "columns": ["\\"c\\\\\\\\x74ol1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 369707609389535652, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 636823055861548079}, {"avg_size": 24, "columns": ["\\"col%v\\\\f1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 441105763149284126, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 636823055861548079}, {"avg_size": 20, "columns": ["col1_\u03371"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 523040024670972109, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 636823055861548079}, {"avg_size": 5, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 548734965135057389, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 636823055861548079}, {"avg_size": 10, "columns": ["\\"co%pl\\"\\"1_\\\\g5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 423726362789795202, "histo_buckets": [{"distinct_range": 0, "num_eq": 6340637425886231432, "num_range": 0, "upper_bound": ""}, {"distinct_range": 65.7138485536498, "num_eq": 900000000, "num_range": 90, "upper_bound": "\\u0016\\u0017g\\u0008O."}, {"distinct_range": 0, "num_eq": 70000, "num_range": 0, "upper_bound": "\\u001eJt\\u001a\\\\G?dO"}, {"distinct_range": 4036006959.418845, "num_eq": 326887310673781932, "num_range": 8000000000, "upper_bound": "\\""}, {"distinct_range": 1828063728617295400, "num_eq": 3096129644036588739, "num_range": 1828063728617295258, "upper_bound": "\'"}], "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 0, "row_count": 636823055861548079}, {"avg_size": 15, "columns": ["\\"c\u036Eol1\'_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 113288922005279945, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 636823055861548079}, {"avg_size": 9, "columns": ["\\"c\\\\vol1_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 530004107637324315, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 636823055861548079}, {"avg_size": 29, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 440433453425110568, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 636823055861548079}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        |     --- FAIL: TestCompare/postgres (0.97s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 TSVECTOR NOT NULL, col1_1 TIMESTAMPTZ NULL, c😔ol1_2 TEXT, col1_😆3 TEXT COLLATE da NOT NULL, "col 1_4" CHAR NOT NULL, "col1_%p5" BYTEA NOT NULL, col1_6 DECIMAL NOT NULL, "col
        test_1        |             1_7" TEXT COLLATE de NOT NULL, "c
ol1_😔8" REGCLASS NOT NULL, col̘1_9 INT2 NOT NULL, col1_10 FLOAT4 NOT NULL, col1_11 CHAR, "col1_\\u0B6E12" BIT(36)[] NOT NULL, "cOl1%p_13" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_0 AS TEXT))) STORED, col1_14 TEXT NOT NULL GENERATED ALWAYS AS (lower("col 1_4")) STORED, "col1_ 15" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_😆3 AS TEXT))) STORED, PRIMARY KEY ("c
ol1_😔8", "col 1_4", col1_6, "col
        test_1        |             1_7", "col1_%p5", "cOl1%p_13", "col1_\\u0B6E12"));
        test_1        |             CREATE INDEX ON table1 (col1_10 ASC, col̘1_9 ASC, col1_14 ASC, col1_1 ASC, lower(c😔ol1_2) DESC, "col1_\\u0B6E12" DESC, "col
        test_1        |             1_7", (col1_6 + (-331677141599015136.8)::DECIMAL), "col 1_4" DESC, col1_11 DESC);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "da" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (19.06s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 52e55d2ef172b7cfec14e8a0a954f8864b2be779:

        postgres_1    |             FROM
        postgres_1    |                 postgres.public."tabl\\u34A3e2"@"tabl\\u34A3e2_pkey" AS tab2225,
        postgres_1    |                 postgres.public.table1 AS t̹ab2226
        postgres_1    |             WHERE
        postgres_1    |                 tab2225.col2_̈́1
        postgres_1    |         )
        postgres_1    |             AS "t   ab2227"
        postgres_1    |     ORDER BY
        postgres_1    |         col3427 NULLS LAST, col3428 DESC NULLS FIRST
        test_1        | --- FAIL: TestCompare (8.24s)
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     --- FAIL: TestCompare/postgres (3.85s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2600522677/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("6"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT * FROM (SELECT regproc(6:::INT8::INT4::INT4)::REGPROC AS col3452) AS "tAb2242" ORDER BY col3452 ASC NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT * FROM (SELECT regproc(6::INT8::INT4::INT4)::REGPROC AS col3452) AS "tAb2242" ORDER BY col3452 ASC NULLS FIRST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.67s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "ta'ble1" (col1_0 REGCLASS NOT NULL, "|🙂col1_1" NAME NOT NULL, "Col1_2" INTERVAL NULL, col1_3 FLOAT4 NOT NULL, col1_4 "char" NULL, col1_5 FLOAT8 NOT NULL, col1_6 REGNAMESPACE NULL, col1_7 BIT(38) NOT NULL, col1_8 BOOL NOT NULL, col1_9 STRING NOT NULL AS (CASE WHEN col1_0 IS NULL THEN e'}\bz':::STRING ELSE e'e\x1eI-]FF ':::STRING END) STORED, col1_10 FLOAT8 NULL AS (col1_5 + col1_3) STORED, "col\\U0005DD7D1_11" STRING NOT NULL AS (lower(CAST(col1_8 AS STRING))) STORED, "col1_ 12" FLOAT8 NOT NULL AS (col1_5 + 0.895912050323241:::FLOAT8) STORED, col1_13 STRING NULL AS (CASE WHEN col1_6 IS NULL THEN e'Fa\x05Tc':::STRING ELSE e'g8\x14\x11#':::STRING END) VIRTUAL, col1_14 STRING NOT NULL AS (lower("|🙂col1_1")) VIRTUAL, col1_15 FLOAT8 NOT NULL AS (col1_3 + col1_5) STORED, PRIMARY KEY (col1_0 ASC, col1_7, "|🙂col1_1" DESC, col1_3, col1_15, col1_9 DESC), UNIQUE (col1_10 DESC, col1_0 DESC, "|🙂col1_1" DESC, col1_4 ASC, col1_14, col1_7 DESC, col1_15, col1_9 ASC, col1_13 DESC, col1_3) STORING ("col\\U0005DD7D1_11") WHERE ((((((("ta'ble1".col1_4 < e'\'':::STRING) AND ("ta'ble1".col1_5 > 1.0:::FLOAT8)) OR ("ta'ble1"."|🙂col1_1" <= e'\'':::STRING:::NAME)) OR ("ta'ble1".col1_14 = e'\'':::STRING)) OR "ta'ble1".col1_8) AND ("ta'ble1"."col\\U0005DD7D1_11" >= e'\U00002603':::STRING)) AND ("ta'ble1".col1_13 <= '':::STRING)) AND ("ta'ble1".col1_15 = 1.0:::FLOAT8), UNIQUE (col1_0) STORING ("Col1_2", col1_6, "col1_ 12") WHERE ((((((((((("ta'ble1".col1_14 != '':::STRING) AND ("ta'ble1".col1_10 != '+Inf':::FLOAT8)) AND "ta'ble1".col1_8) OR ("ta'ble1".col1_15 <= '-Inf':::FLOAT8)) OR ("ta'ble1".col1_5 > 1.7976931348623157e+308:::FLOAT8)) AND ("ta'ble1"."col\\U0005DD7D1_11" != 'X':::STRING)) AND ("ta'ble1".col1_9 > '':::STRING)) AND ("ta'ble1"."col1_ 12" < 1.0:::FLOAT8)) OR ("ta'ble1".col1_3 > 3.4028234663852886e+38:::FLOAT8)) AND ("ta'ble1".col1_13 < e'\x00':::STRING)) OR ("ta'ble1".col1_4 = '':::STRING)) OR ("ta'ble1"."|🙂col1_1" < '"':::STRING:::NAME), UNIQUE (col1_13, col1_8 ASC, (col1_5 + col1_3) DESC, (CASE WHEN col1_0 IS NULL THEN '"':::STRING ELSE 'h':::STRING END) DESC, lower("|🙂col1_1") ASC, "Col1_2" DESC, col1_7) STORING (col1_4, col1_5, col1_6, col1_10), UNIQUE (col1_6, col1_15, col1_7 ASC, col1_0, "|🙂col1_1", "col\\U0005DD7D1_11", col1_10, col1_8 DESC, "Col1_2", "col1_ 12", col1_13 DESC, col1_5 DESC, (col1_5 + 1.0:::FLOAT8), col1_9 ASC) WHERE (((((((((("ta'ble1".col1_8 OR ("ta'ble1".col1_15 <= 0.0:::FLOAT8)) OR ("ta'ble1".col1_5 > (-1.0):::FLOAT8)) OR ("ta'ble1".col1_14 = e'\x00':::STRING)) OR ("ta'ble1"."col\\U0005DD7D1_11" <= e'\U00002603':::STRING)) OR ("ta'ble1".col1_4 = '"':::STRING)) OR ("ta'ble1".col1_9 < e'\U00002603':::STRING)) AND ("ta'ble1".col1_13 != '"':::STRING)) AND ("ta'ble1"."|🙂col1_1" > e'\U00002603':::STRING:::NAME)) AND ("ta'ble1".col1_10 != 1.7976931348623157e+308:::FLOAT8)) AND ("ta'ble1"."col1_ 12" != 3.4028234663852886e+38:::FLOAT8)) AND ("ta'ble1".col1_3 != (-1.0):::FLOAT8), INDEX (col1_0, col1_7 ASC, col1_14, (CASE WHEN col1_0 IS NULL THEN e'F\x0b\'':::STRING ELSE e'\x06N 4xZ':::STRING END), "Col1_2", "col1_ 12" ASC) STORING (col1_4, col1_5, col1_6), UNIQUE (col1_4 DESC, (CASE WHEN "Col1_2" IS NULL THEN 'X':::STRING ELSE e'|5@\x10$H@^':::STRING END), col1_14 DESC, col1_5 DESC, col1_6 ASC, (col1_3 + col1_5) DESC, col1_10, "Col1_2", "col1_ 12", col1_7, lower(col1_4) ASC, col1_15 DESC, col1_9 DESC) STORING (col1_8), INDEX ("col\\U0005DD7D1_11" ASC, col1_0 DESC, col1_13 DESC, "Col1_2" ASC, col1_7 DESC, col1_3, lower("|🙂col1_1"), col1_15) STORING (col1_4, col1_5, col1_6, col1_10) WHERE (((((((("ta'ble1".col1_3 <= 3.4028234663852886e+38:::FLOAT8) AND ("ta'ble1"."col1_ 12" <= (-1.0):::FLOAT8)) AND ("ta'ble1".col1_14 = e'\'':::STRING)) AND ("ta'ble1".col1_13 != e'\U00002603':::STRING)) OR "ta'ble1".col1_8) OR ("ta'ble1"."|🙂col1_1" <= '':::STRING:::NAME)) AND ("ta'ble1".col1_5 = '-Inf':::FLOAT8)) AND ("ta'ble1".col1_9 = e'\x00':::STRING)) AND ("ta'ble1".col1_10 != 0.0:::FLOAT8) NOT VISIBLE, UNIQUE (col1_15 ASC, col1_3 ASC) STORING ("Col1_2", col1_4, col1_8) WHERE (((((("ta'ble1"."|🙂col1_1" > e'\'':::STRING:::NAME) AND ("ta'ble1".col1_9 <= '':::STRING)) AND ("ta'ble1".col1_10 >= '-Inf':::FLOAT8)) OR ("ta'ble1".col1_5 < 0.0:::FLOAT8)) AND ("ta'ble1"."col\\U0005DD7D1_11" >= '':::STRING)) AND ("ta'ble1"."col1_ 12" > 1.401298464324817e-45:::FLOAT8)) AND ("ta'ble1".col1_4 = 'X':::STRING), UNIQUE (col1_10 DESC, "col1_ 12" DESC, "|🙂col1_1", "Col1_2" DESC, col1_5 DESC) WHERE NOT "ta'ble1".col1_8, FAMILY (col1_15), FAMILY ("col1_ 12"), FAMILY (col1_6), FAMILY (col1_3, col1_0, col1_9), FAMILY (col1_5, "col\\U0005DD7D1_11"), FAMILY ("Col1_2"), FAMILY (col1_8), FAMILY ("|🙂col1_1", col1_7, col1_4), FAMILY (col1_10));
        test_1        |             ALTER TABLE "ta'ble1" INJECT STATISTICS e'[{"avg_size": 8, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 542, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 10000}, {"avg_size": 7, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5833, "histo_buckets": [{"distinct_range": 0, "num_eq": 40, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 0, "num_eq": 6381975441670799625, "num_range": 1000000, "upper_bound": "192750684"}, {"distinct_range": 695871803960940800, "num_eq": 8109056472573025946, "num_range": 1533652922327759083, "upper_bound": "199125691"}, {"distinct_range": 514484114754987100, "num_eq": 60000000000, "num_range": 7023640890722521191, "upper_bound": "524292766"}, {"distinct_range": 0, "num_eq": 70000, "num_range": 1356078556668286820, "upper_bound": "662500263"}], "histo_col_type": "REGNAMESPACE", "name": "__auto__", "null_count": 5628, "row_count": 10000}, {"avg_size": 3, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1848, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 10000}, {"avg_size": 17, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5647, "histo_buckets": [{"distinct_range": 0, "num_eq": 1000000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 0, "num_eq": 7000000, "num_range": 50000000000, "upper_bound": "\\u0011"}, {"distinct_range": 4833389785521611000, "num_eq": 2606080353463245245, "num_range": 4833389785521610626, "upper_bound": "\\u001aC"}, {"distinct_range": 0, "num_eq": 40, "num_range": 0, "upper_bound": "n7\\n\\u001e\\u0017"}, {"distinct_range": 0, "num_eq": 1000000, "num_range": 200000000, "upper_bound": "q8s\\u0014/"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 5262, "row_count": 10000}, {"avg_size": 14, "columns": ["\\"|\U0001F642col1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6086, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 10000}, {"avg_size": 26, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8104, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 10000}, {"avg_size": 14, "columns": ["\\"col\\\\\\\\U0005DD7D1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 667, "histo_buckets": [{"distinct_range": 0, "num_eq": 2969411037921037214, "num_range": 0, "upper_bound": "\\u00191$q"}, {"distinct_range": 130930065380822160, "num_eq": 6000, "num_range": 5955293254457975757, "upper_bound": "\'=(\\u000f"}, {"distinct_range": 700000, "num_eq": 2251979151907426166, "num_range": 700000, "upper_bound": "X"}, {"distinct_range": 9048.920063922582, "num_eq": 7670777028145249779, "num_range": 10000, "upper_bound": "vF"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 10000}, {"avg_size": 21, "columns": ["\\"col1_ 12\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7696, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 10000}, {"avg_size": 8, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5897, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 10000}, {"avg_size": 7, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 9033, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 10000}, {"avg_size": 14, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4878, "histo_col_type": "\\"char\\"", "name": "__auto__", "null_count": 3439, "row_count": 10000}, {"avg_size": 25, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 9208, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 10000}, {"avg_size": 18, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5834, "histo_col_type": "FLOAT8", "name": "__auto__", "null_count": 8246, "row_count": 10000}, {"avg_size": 18, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5847, "histo_buckets": [{"distinct_range": 0, "num_eq": 1000, "num_range": 0, "upper_bound": "-1.2792593825911276"}, {"distinct_range": 30000, "num_eq": 6000000, "num_range": 30000, "upper_bound": "1.2630589326164468"}, {"distinct_range": 0, "num_eq": 3000000, "num_range": 5604409951541426897, "upper_bound": "1.3672712026687102"}], "histo_col_type": "FLOAT8", "name": "__auto__", "null_count": 0, "row_count": 10000}, {"avg_size": 15, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6749, "histo_buckets": [{"distinct_range": 0, "num_eq": 3884529139519381244, "num_range": 0, "upper_bound": "0"}], "histo_col_type": "REGCLASS", "name": "__auto__", "null_count": 0, "row_count": 10000}, {"avg_size": 4, "columns": ["\\"Col1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1355, "histo_col_type": "", "name": "__auto__", "null_count": 9748, "row_count": 10000}]':::JSONB;
        test_1        |             ALTER TABLE "ta'ble1" INJECT STATISTICS e'[{"avg_size": 25, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2461, "histo_buckets": [{"distinct_range": 0, "num_eq": 6556725172952000276, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 1000000000, "num_eq": 0, "num_range": 1000000000, "upper_bound": "733059910"}, {"distinct_range": 6000000000, "num_eq": 10000000, "num_range": 6000000000, "upper_bound": "940138005"}, {"distinct_range": 2681770234072021000, "num_eq": 100000, "num_range": 4039597882495384922, "upper_bound": "1181486983"}, {"distinct_range": 0, "num_eq": 106867728570297407, "num_range": 5515842298212537480, "upper_bound": "1335651295"}, {"distinct_range": 4556292212207534000, "num_eq": 1567444221316817158, "num_range": 4556292212207533974, "upper_bound": "1935751491"}, {"distinct_range": 18378178.256830547, "num_eq": 10000000, "num_range": 40000000, "upper_bound": "2595864802"}], "histo_col_type": "REGCLASS", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 17, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1844, "histo_buckets": [{"distinct_range": 0, "num_eq": 900000, "num_range": 0, "upper_bound": "\\u0003"}, {"distinct_range": 733157904934932200, "num_eq": 100, "num_range": 733157904934932203, "upper_bound": "-"}, {"distinct_range": 0, "num_eq": 7821052977504471516, "num_range": 600000000, "upper_bound": "L"}, {"distinct_range": 0, "num_eq": 4961781802910033600, "num_range": 400000, "upper_bound": "P"}, {"distinct_range": 3100014720357878300, "num_eq": 20000, "num_range": 3100014720357878451, "upper_bound": "S"}, {"distinct_range": 600000, "num_eq": 6879958523096695946, "num_range": 600000, "upper_bound": "g"}, {"distinct_range": 344353614017596400, "num_eq": 80, "num_range": 7013193476282362694, "upper_bound": "\U00002603"}], "histo_col_type": "\\"char\\"", "name": "__auto__", "null_count": 401, "row_count": 5000}, {"avg_size": 27, "columns": ["\\"col\\\\\\\\U0005DD7D1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 37, "histo_buckets": [{"distinct_range": 0, "num_eq": 5621288433712059043, "num_range": 0, "upper_bound": "C|*}$~!M\\u0004"}, {"distinct_range": 3499.046901500357, "num_eq": 400000, "num_range": 5000, "upper_bound": "D\\u0002Bof\\u0011>"}, {"distinct_range": 187.5166034301886, "num_eq": 10000, "num_range": 200, "upper_bound": "y\\u0008_\\u0001i\\u001c_"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 16, "columns": ["\\"Col1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1704, "histo_col_type": "", "name": "__auto__", "null_count": 787, "row_count": 5000}, {"avg_size": 20, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3544, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 9, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2804, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 29, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 708, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 27, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3755, "histo_col_type": "", "name": "__auto__", "null_count": 938, "row_count": 5000}, {"avg_size": 2, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2026, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 21, "columns": ["\\"|\U0001F642col1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2274, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 19, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4959, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 8, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 128, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 29, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2218, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}, {"avg_size": 31, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2914, "histo_buckets": [{"distinct_range": 0, "num_eq": 4425535887015225003, "num_range": 0, "upper_bound": "855929502"}, {"distinct_range": 40000000, "num_eq": 0, "num_range": 40000000, "upper_bound": "1013677403"}], "histo_col_type": "REGNAMESPACE", "name": "__auto__", "null_count": 2297, "row_count": 5000}, {"avg_size": 14, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2537, "histo_buckets": [{"distinct_range": 0, "num_eq": 100, "num_range": 0, "upper_bound": "-1.4954822752516421"}, {"distinct_range": 6923283.189311495, "num_eq": 60, "num_range": 40000000, "upper_bound": "-0.9911369050503422"}, {"distinct_range": 0, "num_eq": 80000, "num_range": 3654477281479693262, "upper_bound": "-0.9433620705329802"}, {"distinct_range": 0, "num_eq": 800000, "num_range": 800000, "upper_bound": "-0.4439559429437858"}, {"distinct_range": 31449922656.3527, "num_eq": 2000000000, "num_range": 90000000000, "upper_bound": "0.43131997871020644"}, {"distinct_range": 0, "num_eq": 20, "num_range": 1057956861997356678, "upper_bound": "0.7840860926033596"}, {"distinct_range": 0, "num_eq": 300000000, "num_range": 10000, "upper_bound": "3.4028234663852886e+38"}], "histo_col_type": "FLOAT8", "name": "__auto__", "null_count": 3385, "row_count": 5000}, {"avg_size": 27, "columns": ["\\"col1_ 12\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2874, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (27.92s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ f351747ed97862fc037717cadec23f18073fb6be:

        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (4.20s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1278319945/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare postgres to cockroach1: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("4"),
        test_1        |             +   string("array_agg"),
        test_1        |                 s"7",
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regproc(4:::INT8::INT4::INT4)::REGPROC AS "co 😃l5361", 7:::DECIMAL::DECIMAL AS col5362) AS tab2516
        test_1        |             ORDER BY
        test_1        |                 "co 😃l5361" NULLS FIRST, col5362 ASC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regproc(4::INT8::INT4::INT4)::REGPROC AS "co 😃l5361", 7::DECIMAL::DECIMAL AS col5362) AS tab2516
        test_1        |             ORDER BY
        test_1        |                 "co 😃l5361" NULLS FIRST, col5362 ASC;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.63s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (co̎l1_0 BOX2D, col1_1 BIT(7), col1_2 GEOGRAPHY NOT NULL, col1_3 DECIMAL, c😲ol1_4 "char" NOT NULL, INVERTED INDEX (col1_2) WHERE (table1.col1_3 >= (-1.234E+401):::DECIMAL) AND (table1.c😲ol1_4 > '"':::STRING), INVERTED INDEX (co̎l1_0, col1_2 ASC) WHERE (table1.col1_3 = 1:::DECIMAL) OR (table1.c😲ol1_4 <= e'\U00002603':::STRING), UNIQUE (c😲ol1_4 DESC) WHERE (table1.c😲ol1_4 <= e'\U00002603':::STRING) OR (table1.col1_3 != 1:::DECIMAL), UNIQUE (c😲ol1_4 ASC, col1_1 ASC, co̎l1_0 ASC) STORING (col1_3) WHERE (table1.col1_3 >= (-1.234E+401):::DECIMAL) OR (table1.c😲ol1_4 > '':::STRING), INVERTED INDEX (lower(CAST(col1_1 AS STRING)) ASC, co̎l1_0 ASC, lower(CAST(col1_2 AS STRING)) ASC, col1_3 DESC, col1_2 ASC), FAMILY (col1_2), FAMILY (col1_1), FAMILY (col1_3), FAMILY (c😲ol1_4), FAMILY (co̎l1_0));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 24, "columns": ["co\u030El1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2247880133967882430, "histo_buckets": [{"distinct_range": 0, "num_eq": 6168928917561024761, "num_range": 0, "upper_bound": "BOX(-2.3885812921477485 -1.0935038952295972,-0.2963689253681523 0.8980607520424765)"}, {"distinct_range": 0, "num_eq": 60000000, "num_range": 9000000, "upper_bound": "BOX(-1.1011319321553321 0.8286657456821044,0.9476777578807649 1.3665118972938162)"}, {"distinct_range": 56388312103.37997, "num_eq": 800, "num_range": 70000000000, "upper_bound": "BOX(-0.37907760995472917 -0.09776989657584972,-0.33358383462293006 0.2808872413411173)"}, {"distinct_range": 5764400050471364000, "num_eq": 230541367676033478, "num_range": 5764400050471363134, "upper_bound": "BOX(-0.16205228046454118 0.0002353273658623617,2.082925807948474 0.09262821776529151)"}, {"distinct_range": 0, "num_eq": 500000000, "num_range": 5392257069150794548, "upper_bound": "BOX(0.578172228261634 -0.833979352372913,0.7141285048735502 -0.2905250549041515)"}], "histo_col_type": "BOX2D", "name": "__auto__", "null_count": 2869306591973740741, "row_count": 3476029083483036458}, {"avg_size": 5, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1453355394262090971, "histo_col_type": "", "name": "__auto__", "null_count": 2310180571419830706, "row_count": 3476029083483036458}, {"avg_size": 9, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1576616230884693469, "histo_buckets": [{"distinct_range": 0, "num_eq": 190497957771675390, "num_range": 0, "upper_bound": "\\\\x42fd040000000000000000bfda0cc2ed613665bff5dea3cbcf78fe3ff707e18255f7963fe02d700c53efec"}, {"distinct_range": 15674924631.195055, "num_eq": 1983852815271561059, "num_range": 30000000000, "upper_bound": "\\\\x42fd0c0000000000000000bfda0cc2ed613665bff5dea3cbcf78fe3ff707e18255f7963fe02d700c53efec"}, {"distinct_range": 0, "num_eq": 40000000000, "num_range": 0, "upper_bound": "\\\\x42fd19121061891d069700c0060b99b2e7be80bff76998f9090a7f3fe0bb1901e0812f3ff12799d2c8a6ea"}, {"distinct_range": 0, "num_eq": 6000, "num_range": 3858312518738456674, "upper_bound": "\\\\x42fd300000000000000000c00921fb54442d18bff63302cad2e161400921fb54442d183ff777efe18ad47d"}, {"distinct_range": 10000000000, "num_eq": 7237113918627970026, "num_range": 10000000000, "upper_bound": "\\\\x42fd300000000000000000c00921fb54442d18bff910f1f8d9b5c0400921fb54442d183ff7ef2282c56847"}, {"distinct_range": 0, "num_eq": 0, "num_range": 100, "upper_bound": "\\\\x42fd4578795ec0c83e45004008f03248440649bff7252d14ceede43fe9f76d3b76b57c3ff62502667b27a4"}, {"distinct_range": 70000, "num_eq": 5381415407754364055, "num_range": 70000, "upper_bound": "\\\\x42fd4d3d9a7cc95b9e7900c0060b99b2e7be80bff76998f9090a7f3fe0bb1901e0812f3ff12799d2c8a6ea"}, {"distinct_range": 300000, "num_eq": 2417744596024385091, "num_range": 300000, "upper_bound": "\\\\x42fd500000000000000000c00921fb54442d18bff63302cad2e161400921fb54442d183ff777efe18ad47d"}, {"distinct_range": 1933876313944665900, "num_eq": 8000, "num_range": 1933876313944665836, "upper_bound": "\\\\x42fd500000000000000000c00921fb54442d18bff910f1f8d9b5c0400921fb54442d183ff7ef2282c56847"}, {"distinct_range": 0, "num_eq": 7087909732265938494, "num_range": 700000, "upper_bound": "\\\\x42fd520cb62ecebdfadb00c0060b99b2e7be80bff76998f9090a7f3fe0bb1901e0812f3ff12799d2c8a6ea"}, {"distinct_range": 2305842733478494200, "num_eq": 30000000000, "num_range": 2305842733478494299, "upper_bound": "\\\\x42fd549139334527519f004008f03248440649bff7252d14ceede43fe9f76d3b76b57c3ff62502667b27a4"}, {"distinct_range": 1971034070389518600, "num_eq": 7000000000, "num_range": 6189579152139597996, "upper_bound": "\\\\x42fd56e7653b95f69fa700c0060b99b2e7be80bff76998f9090a7f3fe0bb1901e0812f3ff12799d2c8a6ea"}, {"distinct_range": 10000000000, "num_eq": 3282344358809912730, "num_range": 10000000000, "upper_bound": "\\\\x42fd59e09020f80713dd004008f03248440649bff7252d14ceede43fe9f76d3b76b57c3ff62502667b27a4"}, {"distinct_range": 0, "num_eq": 6388787141561169802, "num_range": 90, "upper_bound": "\\\\x42fd6c0000000000000000c00921fb54442d18bff910f1f8d9b5c0400921fb54442d183ff7ef2282c56847"}, {"distinct_range": 6501650091567699000, "num_eq": 1029679392951058891, "num_range": 7794350973742748422, "upper_bound": "\\\\x42fd700000000000000000c00921fb54442d18bff63302cad2e161400921fb54442d183ff777efe18ad47d"}, {"distinct_range": 700000, "num_eq": 10000000, "num_range": 700000, "upper_bound": "\\\\x42fd840000000000000000c00921fb54442d18bff910f1f8d9b5c0400921fb54442d183ff7ef2282c56847"}, {"distinct_range": 619941794424779600, "num_eq": 300000000, "num_range": 1246235195046834298, "upper_bound": "\\\\x42fd88c9247f003315e7004008f03248440649bff7252d14ceede43fe9f76d3b76b57c3ff62502667b27a4"}, {"distinct_range": 0, "num_eq": 5000000, "num_range": 10, "upper_bound": "\\\\x42fd8c0000000000000000c00921fb54442d18bff910f1f8d9b5c0400921fb54442d183ff7ef2282c56847"}, {"distinct_range": 0, "num_eq": 3600822827945841197, "num_range": 4000, "upper_bound": "\\\\x42fd900000000000000000c00921fb54442d18bff63302cad2e161400921fb54442d183ff777efe18ad47d"}, {"distinct_range": 1000000, "num_eq": 500000000, "num_range": 1000000, "upper_bound": "\\\\x42fd91bb1ef128a2c7b300c0060b99b2e7be80bff76998f9090a7f3fe0bb1901e0812f3ff12799d2c8a6ea"}, {"distinct_range": 7977763671481210000, "num_eq": 10000, "num_range": 8110572411089492880, "upper_bound": "\\\\x42fd940000000000000000c00921fb54442d18bff910f1f8d9b5c0400921fb54442d183ff7ef2282c56847"}, {"distinct_range": 0, "num_eq": 900000, "num_range": 1797926331496198462, "upper_bound": "\\\\x42fd990000000000000000c00921fb54442d18bff910f1f8d9b5c0400921fb54442d183ff7ef2282c56847"}, {"distinct_range": 0, "num_eq": 2000, "num_range": 619514645935164327, "upper_bound": "\\\\x42fd9d0000000000000000c00921fb54442d18bff910f1f8d9b5c0400921fb54442d183ff7ef2282c56847"}, {"distinct_range": 3073667227442060300, "num_eq": 1729503639362240134, "num_range": 4010706879410188011, "upper_bound": "\\\\x42fda243aa65b0274cc700c0060b99b2e7be80bff76998f9090a7f3fe0bb1901e0812f3ff12799d2c8a6ea"}, {"distinct_range": 0, "num_eq": 600000000, "num_range": 300000000, "upper_bound": "\\\\x42fdaf0000000000000000bf7894ca812c82ecbff6e10ce29957d34000e6e7dd161223bff24862d959362d"}, {"distinct_range": 4854843310459174000, "num_eq": 8568406628023407014, "num_range": 4854843310459173593, "upper_bound": "\\\\x42fdb00000000000000000c00921fb54442d18bff63302cad2e161400921fb54442d183ff777efe18ad47d"}, {"distinct_range": 3897271883405530000, "num_eq": 400000000, "num_range": 3897271883405529997, "upper_bound": "\\\\x42fdb00000000000000000c00921fb54442d18bff910f1f8d9b5c0400921fb54442d183ff7ef2282c56847"}, {"distinct_range": 100000000000, "num_eq": 0, "num_range": 100000000000, "upper_bound": "\\\\x42fdb03ffb22b5a541d3004008f03248440649bff7252d14ceede43fe9f76d3b76b57c3ff62502667b27a4"}, {"distinct_range": 7960630671219870000, "num_eq": 7963635888472734758, "num_range": 7960630671219869445, "upper_bound": "\\\\x42fdb04000000000000000bf7894ca812c82ecbff6e10ce29957d34000e6e7dd161223bff24862d959362d"}, {"distinct_range": 335325185975626430, "num_eq": 2000000000, "num_range": 335325185975626441, "upper_bound": "\\\\x42fdb08400000000000000bf7894ca812c82ecbff6e10ce29957d34000e6e7dd161223bff24862d959362d"}, {"distinct_range": 303944.8557564299, "num_eq": 200000, "num_range": 800000, "upper_bound": "\\\\x42fdb40000000000000000bfda0cc2ed613665bff5dea3cbcf78fe3ff707e18255f7963fe02d700c53efec"}, {"distinct_range": 10402002.976035168, "num_eq": 2000000000, "num_range": 100000000, "upper_bound": "\\\\x42fdb84000000000000000bfda0cc2ed613665bff5dea3cbcf78fe3ff707e18255f7963fe02d700c53efec"}, {"distinct_range": 256566.82377661893, "num_eq": 8000000, "num_range": 3000000, "upper_bound": "\\\\x42fdba78b0000000000000bf7894ca812c82ecbff6e10ce29957d34000e6e7dd161223bff24862d959362d"}, {"distinct_range": 0, "num_eq": 4913907148289625048, "num_range": 0, "upper_bound": "\\\\x42fdbacb4caf73cf05df00c0060b99b2e7be80bff76998f9090a7f3fe0bb1901e0812f3ff12799d2c8a6ea"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 3476029083483036458}, {"avg_size": 24, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1592578054288911773, "histo_col_type": "", "name": "__auto__", "null_count": 1349938570434077194, "row_count": 3476029083483036458}, {"avg_size": 18, "columns": ["c\U0001F632ol1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 893616847908282884, "histo_buckets": [{"distinct_range": 0, "num_eq": 20000000, "num_range": 0, "upper_bound": "\\u0007"}, {"distinct_range": 200, "num_eq": 8000000, "num_range": 200, "upper_bound": "*"}, {"distinct_range": 80000, "num_eq": 3405335463307676308, "num_range": 80000, "upper_bound": "L"}, {"distinct_range": 90000000000, "num_eq": 600, "num_range": 90000000000, "upper_bound": "X"}], "histo_col_type": "\\"char\\"", "name": "__auto__", "null_count": 0, "row_count": 3476029083483036458}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 20, "columns": ["co\u030El1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6802349108830443424, "histo_buckets": [{"distinct_range": 0, "num_eq": 1000, "num_range": 0, "upper_bound": "BOX(-1.6000348219959746 -1.6433829607342665,-0.05244674828475904 -0.9024013273464802)"}, {"distinct_range": 3204739642331994600, "num_eq": 1385958937472519814, "num_range": 3962577866321830133, "upper_bound": "BOX(0.2963534108311876 0.3878797861129374,1.1050326966760338 0.5088030272468141)"}, {"distinct_range": 2763795942108299000, "num_eq": 40000000, "num_range": 6629162085697892250, "upper_bound": "BOX(0.40848295616347013 -0.9046571110483834,1.7249036768481052 -0.14340848731283273)"}, {"distinct_range": 0, "num_eq": 500, "num_range": 100000, "upper_bound": "BOX(1.0757826939813 -1.9503549220931244,2.268456032609974 0.5595768743840289)"}], "histo_col_type": "BOX2D", "name": "__auto__", "null_count": 2013695693281908172, "row_count": 8279242549357653647}, {"avg_size": 9, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6839087283077518707, "histo_col_type": "", "name": "__auto__", "null_count": 4228613850849263666, "row_count": 8279242549357653647}, {"avg_size": 14, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2146193451994570502, "histo_buckets": [{"distinct_range": 0, "num_eq": 1638155241523938030, "num_range": 0, "upper_bound": "\\\\x42fd0ac000000000000000bffe973b534dca7abff26fb7dc82306dc0064b0ee29c7ded3ff4e3101c115e84"}, {"distinct_range": 0, "num_eq": 8703875698746544076, "num_range": 0, "upper_bound": "\\\\x42fd10000000000000000040080f8b39dbf945bff71c15039c255bbff70e8cd14ef2d83fe2d145215bafe4"}, {"distinct_range": 900000000, "num_eq": 559879523075207562, "num_range": 900000000, "upper_bound": "\\\\x42fd100000000000000000c00921fb54442d18bff8ef7ece746703400921fb54442d183ff8979e2ebbdebb"}, {"distinct_range": 4139380212055165000, "num_eq": 10000000000, "num_range": 4139380212055165116, "upper_bound": "\\\\x42fd270000000000000000bffe973b534dca7abff26fb7dc82306dc0064b0ee29c7ded3ff4e3101c115e84"}, {"distinct_range": 40, "num_eq": 715193502434469737, "num_range": 40, "upper_bound": "\\\\x42fd30000000000000000040080f8b39dbf945bff71c15039c255bbff70e8cd14ef2d83fe2d145215bafe4"}, {"distinct_range": 0, "num_eq": 6156641003917517943, "num_range": 900000000, "upper_bound": "\\\\x42fd300000000000000000c00921fb54442d18bff8ef7ece746703400921fb54442d183ff8979e2ebbdebb"}, {"distinct_range": 4647040.921058826, "num_eq": 6000000000, "num_range": 5000000, "upper_bound": "\\\\x42fd340000000000000000bffe973b534dca7abff26fb7dc82306dc0064b0ee29c7ded3ff4e3101c115e84"}, {"distinct_range": 412332.4674400822, "num_eq": 55433423021696005, "num_range": 700000, "upper_bound": "\\\\x42fd50000000000000000040080f8b39dbf945bff71c15039c255bbff70e8cd14ef2d83fe2d145215bafe4"}, {"distinct_range": 3684866775943922700, "num_eq": 100000000000, "num_range": 6686042388931793924, "upper_bound": "\\\\x42fd500000000000000000bffe973b534dca7abff26fb7dc82306dc0064b0ee29c7ded3ff4e3101c115e84"}, {"distinct_range": 920.8339628949825, "num_eq": 7175045516096215008, "num_range": 1000, "upper_bound": "\\\\x42fd500000000000000000c00921fb54442d18bff8ef7ece746703400921fb54442d183ff8979e2ebbdebb"}, {"distinct_range": 0, "num_eq": 8306289821077095185, "num_range": 0, "upper_bound": "\\\\x42fd518b0e2c34f7a33b01bffcfe6e7e54677b3ff2ef29701b771a"}, {"distinct_range": 0, "num_eq": 2073975288450156427, "num_range": 90, "upper_bound": "\\\\x42fd590000000000000000400621772a673224bfda1724dd41e54040073f9340c26e753ff3b244e0238eef"}, {"distinct_range": 2333807579726043600, "num_eq": 900000, "num_range": 2333807579726043643, "upper_bound": "\\\\x42fd5a4000000000000000400621772a673224bfda1724dd41e54040073f9340c26e753ff3b244e0238eef"}, {"distinct_range": 0, "num_eq": 148079913427135217, "num_range": 3000000, "upper_bound": "\\\\x42fd640000000000000000400621772a673224bfda1724dd41e54040073f9340c26e753ff3b244e0238eef"}, {"distinct_range": 6000000, "num_eq": 7000, "num_range": 6000000, "upper_bound": "\\\\x42fd6c0000000000000000400621772a673224bfda1724dd41e54040073f9340c26e753ff3b244e0238eef"}, {"distinct_range": 0, "num_eq": 20000, "num_range": 2403819321422397386, "upper_bound": "\\\\x42fd6c0000000000000000bffe973b534dca7abff26fb7dc82306dc0064b0ee29c7ded3ff4e3101c115e84"}, {"distinct_range": 16071119944003842, "num_eq": 607172355754223075, "num_range": 129979478543987752, "upper_bound": "\\\\x42fd70000000000000000040080f8b39dbf945bff71c15039c255bbff70e8cd14ef2d83fe2d145215bafe4"}, {"distinct_range": 6910760348178345000, "num_eq": 60000000000, "num_range": 6910760348178345267, "upper_bound": "\\\\x42fd700000000000000000c00921fb54442d18bff8ef7ece746703400921fb54442d183ff8979e2ebbdebb"}, {"distinct_range": 0, "num_eq": 5160887455547712221, "num_range": 0, "upper_bound": "\\\\x42fd710000000000000000bffe973b534dca7abff26fb7dc82306dc0064b0ee29c7ded3ff4e3101c115e84"}, {"distinct_range": 10000, "num_eq": 60000, "num_range": 10000, "upper_bound": "\\\\x42fd8b0000000000000000bffe973b534dca7abff26fb7dc82306dc0064b0ee29c7ded3ff4e3101c115e84"}, {"distinct_range": 0, "num_eq": 20, "num_range": 4477652455155875968, "upper_bound": "\\\\x42fd90000000000000000040080f8b39dbf945bff71c15039c255bbff70e8cd14ef2d83fe2d145215bafe4"}, {"distinct_range": 2026309307422971600, "num_eq": 3196334652612412157, "num_range": 2026309307422971600, "upper_bound": "\\\\x42fd900000000000000000c00921fb54442d18bff8ef7ece746703400921fb54442d183ff8979e2ebbdebb"}, {"distinct_range": 5968929570982855000, "num_eq": 6369233592767199952, "num_range": 5968929570982854430, "upper_bound": "\\\\x42fd940000000000000000bffe973b534dca7abff26fb7dc82306dc0064b0ee29c7ded3ff4e3101c115e84"}, {"distinct_range": 0, "num_eq": 1834135593851472038, "num_range": 10000, "upper_bound": "\\\\x42fd98c000000000000000bffe973b534dca7abff26fb7dc82306dc0064b0ee29c7ded3ff4e3101c115e84"}, {"distinct_range": 30, "num_eq": 6440403759710408542, "num_range": 30, "upper_bound": "\\\\x42fdb0000000000000000040080f8b39dbf945bff71c15039c255bbff70e8cd14ef2d83fe2d145215bafe4"}, {"distinct_range": 8000, "num_eq": 90000000, "num_range": 8000, "upper_bound": "\\\\x42fdb00000000000000000bffe973b534dca7abff26fb7dc82306dc0064b0ee29c7ded3ff4e3101c115e84"}, {"distinct_range": 6648850419613393000, "num_eq": 400000000, "num_range": 6648850419613393241, "upper_bound": "\\\\x42fdb00000000000000000c00921fb54442d18bff8ef7ece746703400921fb54442d183ff8979e2ebbdebb"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 8279242549357653647}, {"avg_size": 8, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4186248580822579884, "histo_col_type": "", "name": "__auto__", "null_count": 906742800087583949, "row_count": 8279242549357653647}, {"avg_size": 27, "columns": ["c\U0001F632ol1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4100233317544545319, "histo_buckets": [{"distinct_range": 0, "num_eq": 8613700889766788577, "num_range": 0, "upper_bound": "\\u0004"}, {"distinct_range": 16608515.678964041, "num_eq": 4876178024230687523, "num_range": 2000000000, "upper_bound": "\\n"}, {"distinct_range": 0, "num_eq": 1000000000, "num_range": 2000000000, "upper_bound": "\\""}, {"distinct_range": 0, "num_eq": 4099060684930660148, "num_range": 400, "upper_bound": "-"}, {"distinct_range": 768250340514549500, "num_eq": 5887002392273402483, "num_range": 2644340396713481917, "upper_bound": "."}, {"distinct_range": 100000000, "num_eq": 2062781836151764837, "num_range": 100000000, "upper_bound": "J"}, {"distinct_range": 0, "num_eq": 6637382093428539184, "num_range": 7849127582036438504, "upper_bound": "L"}], "histo_col_type": "\\"char\\"", "name": "__auto__", "null_count": 0, "row_count": 8279242549357653647}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (26.23s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ b995ddff53ee95a30537a366c6cd8e0e13fcee79:

        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (5.61s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare39277657/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("6"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(6:::INT8::INT4::INT4)::REGPROCEDURE AS "c\\x4aol4728") AS tab3321
        test_1        |             ORDER BY
        test_1        |                 "c\\x4aol4728" NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(6::INT8::INT4::INT4)::REGPROCEDURE AS "c\\x4aol4728") AS tab3321
        test_1        |             ORDER BY
        test_1        |                 "c\\x4aol4728" NULLS FIRST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.73s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "tabl'e1" (col1_0 OID NOT NULL, "col%q1_1" BOX2D NULL, "col%v1_2" INT8 NOT NULL, "c😲ol̈1_
3" REGCLASS NOT NULL, "c'ol1_4" OID NOT NULL, "col1(_5" TIMESTAMPTZ, col1_6 DATE NOT NULL, col1_7 DATE NOT NULL, col1_8 NAME NULL, col1_9 INT2 NOT NULL, col1_10 TSQUERY NOT NULL, col1_11 STRING NOT NULL AS (lower(CAST(col1_10 AS STRING))) STORED, col1_12 INT8 NOT NULL AS (col1_9 + (-30310):::INT8) STORED, col1_13 INT8 NULL AS (col1_9 + "col%v1_2") STORED, PRIMARY KEY ("c😲ol̈1_
3" ASC, "col%v1_2", col1_9 ASC, "c'ol1_4" DESC, col1_0 ASC, col1_12 ASC), UNIQUE (col1_9, col1_8 DESC) WHERE ((((((("tabl'e1".col1_12 < 127:::INT8) OR ("tabl'e1"."col1(_5" > '0001-01-01 00:00:00+00':::TIMESTAMPTZ)) AND ("tabl'e1".col1_11 < '':::STRING)) OR ("tabl'e1".col1_7 != '1970-01-01':::DATE)) AND ("tabl'e1"."col%v1_2" != (-32768):::INT8)) AND ("tabl'e1".col1_8 >= '"':::STRING:::NAME)) OR ("tabl'e1".col1_6 < 'infinity':::DATE)) AND ("tabl'e1".col1_13 != (-32768):::INT8), INDEX (col1_7 DESC, (CASE WHEN "col1(_5" IS NULL THEN 'j':::STRING ELSE 'rm':::STRING END) DESC, col1_9 DESC) STORING ("col%q1_1", col1_6, col1_8), FAMILY (col1_8), FAMILY ("c😲ol̈1_
3"), FAMILY (col1_7, col1_0), FAMILY ("col%q1_1"), FAMILY (col1_11, col1_9), FAMILY (col1_10, col1_13), FAMILY ("col1(_5", "c'ol1_4", col1_12), FAMILY (col1_6), FAMILY ("col%v1_2"));
        test_1        |             ALTER TABLE "tabl'e1" INJECT STATISTICS e'[{"avg_size": 30, "columns": ["\\"c\U0001F632ol\u03081_\\r3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1631773102265331117, "histo_buckets": [{"distinct_range": 0, "num_eq": 2000000, "num_range": 0, "upper_bound": "902367554"}], "histo_col_type": "REGCLASS", "name": "__auto__", "null_count": 0, "row_count": 4716633800387208701}, {"avg_size": 21, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3549933647297301357, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4716633800387208701}, {"avg_size": 11, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2787421547427880634, "histo_col_type": "DATE", "name": "__auto__", "null_count": 0, "row_count": 4716633800387208701}, {"avg_size": 28, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2347964180073430368, "histo_col_type": "", "name": "__auto__", "null_count": 1773040014011052549, "row_count": 4716633800387208701}, {"avg_size": 11, "columns": ["\\"col%q1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3339394542539362532, "histo_col_type": "", "name": "__auto__", "null_count": 1019897480534004846, "row_count": 4716633800387208701}, {"avg_size": 6, "columns": ["\\"col1(_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1923866193739727528, "histo_col_type": "", "name": "__auto__", "null_count": 1790831024600320731, "row_count": 4716633800387208701}, {"avg_size": 18, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3483436006885768973, "histo_buckets": [{"distinct_range": 0, "num_eq": 2249482385401349394, "num_range": 0, "upper_bound": "-11709"}], "histo_col_type": "INT2", "name": "__auto__", "null_count": 0, "row_count": 4716633800387208701}, {"avg_size": 5, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4616277841579500552, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4716633800387208701}, {"avg_size": 28, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1816770581517862377, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4716633800387208701}, {"avg_size": 2, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2354064400926567429, "histo_col_type": "", "name": "__auto__", "null_count": 1308989027991799026, "row_count": 4716633800387208701}, {"avg_size": 16, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1051919777906742564, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4716633800387208701}, {"avg_size": 25, "columns": ["\\"col%v1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3915291188976316586, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4716633800387208701}, {"avg_size": 2, "columns": ["\\"c\'ol1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 819847569160475550, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4716633800387208701}, {"avg_size": 11, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3384646511483879907, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4716633800387208701}]':::JSONB;
        test_1        |             ALTER TABLE "tabl'e1" INJECT STATISTICS e'[{"avg_size": 7, "columns": ["\\"col1(_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 64, "row_count": 70}, {"avg_size": 20, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 17, "histo_buckets": [{"distinct_range": 0, "num_eq": 3834041789217122508, "num_range": 0, "upper_bound": "1981-07-06"}, {"distinct_range": 0, "num_eq": 400, "num_range": 0, "upper_bound": "1982-06-05"}, {"distinct_range": 0, "num_eq": 7623795524273616188, "num_range": 5271620781198110921, "upper_bound": "5874897-12-31"}, {"distinct_range": 637060719.832694, "num_eq": 7000, "num_range": 1000000000, "upper_bound": "infinity"}], "histo_col_type": "DATE", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 4, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 34, "histo_col_type": "", "name": "__auto__", "null_count": 42, "row_count": 70}, {"avg_size": 6, "columns": ["\\"col%v1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 69, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 23, "columns": ["\\"c\U0001F632ol\u03081_\\r3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 14, "histo_buckets": [{"distinct_range": 0, "num_eq": 20000, "num_range": 0, "upper_bound": "1006385968"}, {"distinct_range": 70000, "num_eq": 708171591622622636, "num_range": 70000, "upper_bound": "2139121902"}, {"distinct_range": 4894978075250959000, "num_eq": 6737806658875726173, "num_range": 4894978075250959683, "upper_bound": "3278798890"}], "histo_col_type": "REGCLASS", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 3, "columns": ["\\"c\'ol1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 49, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 17, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 53, "histo_col_type": "", "name": "__auto__", "null_count": 24, "row_count": 70}, {"avg_size": 25, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 9, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 25, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 24, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 29, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 47, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 3, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 46, "histo_buckets": [{"distinct_range": 0, "num_eq": 6064079444310826869, "num_range": 0, "upper_bound": "-26132"}, {"distinct_range": 600000000, "num_eq": 4000000000, "num_range": 600000000, "upper_bound": "-11186"}], "histo_col_type": "INT2", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 24, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 28, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}, {"avg_size": 12, "columns": ["\\"col%q1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 63, "histo_col_type": "", "name": "__auto__", "null_count": 10, "row_count": 70}, {"avg_size": 2, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 25, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 70}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (32.79s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 186218edb86b5974501b2976cfd0704d4d6d1beb:

        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (4.93s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare3564210116/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |                 float64(1),
        test_1        |             -   string("false"),
        test_1        |             +   string("f"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT 1.0:::FLOAT8::FLOAT8 AS "%vcol5315", name(false::BOOL::BOOL)::NAME AS col5316) AS tab3021
        test_1        |             ORDER BY
        test_1        |                 "%vcol5315" DESC NULLS LAST, col5316 ASC NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT 1.0::FLOAT8::FLOAT8 AS "%vcol5315", name(false::BOOL::BOOL)::NAME AS col5316) AS tab3021
        test_1        |             ORDER BY
        test_1        |                 "%vcol5315" DESC NULLS LAST, col5316 ASC NULLS LAST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.71s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 GEOMETRY NOT NULL, col1_😏1 TIMESTAMP, "}c😋ol1_2" REGTYPE NOT NULL, col1_3 TIMESTAMPTZ NOT NULL, 😬col1_4 STRING AS (CASE WHEN col1_😏1 IS NULL THEN e'G\\7o?\x06':::STRING ELSE e'\x03':::STRING END) VIRTUAL, PRIMARY KEY ("}c😋ol1_2" DESC), UNIQUE ((CASE WHEN "}c😋ol1_2" IS NULL THEN e'\x15jQ':::STRING ELSE e'+m\x1e':::STRING END) DESC, (CASE WHEN col1_😏1 IS NULL THEN '@':::STRING ELSE e'4\x1c':::STRING END) ASC, 😬col1_4 ASC) WHERE ((table1.col1_😏1 >= '4714-11-24 00:00:00 BC':::TIMESTAMP) AND (table1.😬col1_4 > '':::STRING)) AND (table1.col1_3 > '0001-01-01 00:00:00+00':::TIMESTAMPTZ), UNIQUE ("}c😋ol1_2" DESC, col1_3 ASC) WHERE ((table1.😬col1_4 != e'\U00002603':::STRING) AND (table1.col1_😏1 < '0001-01-01 00:00:00':::TIMESTAMP)) OR (table1.col1_3 <= '294276-12-31 23:59:59.999999+00':::TIMESTAMPTZ), FAMILY ("}c😋ol1_2"), FAMILY (col1_3), FAMILY (col1_0), FAMILY (col1_😏1));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 4, "columns": ["\U0001F62Ccol1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6378311298362385712, "histo_col_type": "", "name": "__auto__", "null_count": 1417465587698874489, "row_count": 7127599040827151262}, {"avg_size": 5, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5745364146515581491, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7127599040827151262}, {"avg_size": 15, "columns": ["col1_\U0001F60F1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5422492779839698672, "histo_col_type": "", "name": "__auto__", "null_count": 3215475440747753657, "row_count": 7127599040827151262}, {"avg_size": 8, "columns": ["\\"}c\U0001F60Bol1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1244882826277351835, "histo_buckets": [{"distinct_range": 0, "num_eq": 900, "num_range": 0, "upper_bound": "3055781347"}, {"distinct_range": 0, "num_eq": 0, "num_range": 80000000, "upper_bound": "3504691067"}, {"distinct_range": 1169298634247192600, "num_eq": 633778446001703824, "num_range": 2297596074843911638, "upper_bound": "3815770115"}, {"distinct_range": 559162823867143230, "num_eq": 800000, "num_range": 8175853864510548627, "upper_bound": "3819344265"}], "histo_col_type": "REGTYPE", "name": "__auto__", "null_count": 0, "row_count": 7127599040827151262}, {"avg_size": 30, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 9944400503295948, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7127599040827151262}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 6, "columns": ["\\"}c\U0001F60Bol1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 868721, "histo_buckets": [{"distinct_range": 0, "num_eq": 681211166612014733, "num_range": 0, "upper_bound": "533671193"}, {"distinct_range": 4839956.613031746, "num_eq": 0, "num_range": 6000000, "upper_bound": "2023256538"}, {"distinct_range": 0, "num_eq": 20000, "num_range": 465735646182183487, "upper_bound": "3572411759"}], "histo_col_type": "REGTYPE", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 19, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2357315, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 20, "columns": ["\U0001F62Ccol1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1796312, "histo_col_type": "", "name": "__auto__", "null_count": 1748749, "row_count": 7000000}, {"avg_size": 7, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 634898, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 18, "columns": ["col1_\U0001F60F1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2458645, "histo_col_type": "", "name": "__auto__", "null_count": 6766859, "row_count": 7000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (29.76s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 3551dc089ac3efcb3772df2109164dcb01e79d8f:

        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1739886912/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   uint32(8),
        test_1        |             +   string("8"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         CASE
        test_1        |                         WHEN EXISTS(SELECT '2000-01-01 03:00:00+00':::TIMESTAMPTZ::TIMESTAMPTZ AS col8313) THEN 8:::OID::OID
        test_1        |                         ELSE regrole(0:::INT8::INT4::INT4)::REGROLE
        test_1        |                         END
        test_1        |                             AS col8314
        test_1        |                 )
        test_1        |                     AS tab4269
        test_1        |             ORDER BY
        test_1        |                 col8314 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         CASE
        test_1        |                         WHEN EXISTS(SELECT '2000-01-01 03:00:00+00'::TIMESTAMPTZ::TIMESTAMPTZ AS col8313) THEN 8::OID::OID
        test_1        |                         ELSE regrole(0::INT8::INT4::INT4)::REGROLE
        test_1        |                         END
        test_1        |                             AS col8314
        test_1        |                 )
        test_1        |                     AS tab4269
        test_1        |             ORDER BY
        test_1        |                 col8314 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (32.22s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ a34af06d8e7230e4052db80d55da21a06013f81b:

        postgres_1    |         col😯382 ASC NULLS FIRST,
        postgres_1    |         "c""o'l383" DESC,
        postgres_1    |         col384 NULLS LAST,
        postgres_1    |         "col
385" ASC NULLS LAST,
        postgres_1    |         col386 DESC NULLS FIRST,
        postgres_1    |         "
col387" NULLS FIRST,
        postgres_1    |         col388 ASC NULLS FIRST,
        postgres_1    |         col389 NULLS FIRST,
        postgres_1    |         "co%vl390" ASC NULLS LAST
        test_1        | --- FAIL: TestCompare (5.72s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.88s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare3432696819/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("2"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT * FROM (SELECT regprocedure(2:::OID::OID::OID)::REGPROCEDURE AS "col 416") AS "tab%v258" ORDER BY "col 416" ASC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT * FROM (SELECT regprocedure(2::OID::OID::OID)::REGPROCEDURE AS "col 416") AS "tab%v258" ORDER BY "col 416" ASC;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.71s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "table%v1" (col1_0 TIME NOT NULL, "Col1_1" NAME NOT NULL, col1_2 STRING COLLATE en NOT NULL, co̯l1_3 TIMESTAMP NOT NULL, col1_4 BIT(32), col1_5 VARCHAR NOT NULL, col1_6 BIT(2), "co%vl1_7" OID, "%pcol1_8" BOOL, "co'%ql1_9" INT8 NOT NULL, "co'l1_10" GEOGRAPHY NOT NULL, "coL1'_11" NAME, col1_12 BIT(40)[] NOT NULL, col1_13 TIME NOT NULL, col1_14 STRING NOT NULL AS (CASE WHEN co̯l1_3 IS NULL THEN e'\f\x1cd/?ta':::STRING ELSE '^JzG':::STRING END) STORED, col1_15 STRING AS (lower("coL1'_11")) VIRTUAL, 😘co̡l1_16 INT8 NOT NULL AS ("co'%ql1_9" + (-2299237232409043871):::INT8) VIRTUAL, col1_17 STRING AS (lower(CAST(col1_4 AS STRING))) VIRTUAL, col1_18 STRING AS (lower(CAST("co%vl1_7" AS STRING))) STORED, UNIQUE ("co%vl1_7", col1_12 ASC, 😘co̡l1_16 DESC, col1_2 ASC, col1_18 DESC, "coL1'_11" ASC, col1_13 DESC, col1_4, col1_5 DESC, "co'%ql1_9" ASC, "%pcol1_8" DESC, "Col1_1" ASC, lower(CAST(col1_0 AS STRING)) DESC, col1_14 ASC, lower(CAST("co'l1_10" AS STRING)) DESC) STORING (col1_0, co̯l1_3, "co'l1_10"), UNIQUE (lower(CAST(col1_2 AS STRING)) DESC, co̯l1_3, col1_17 DESC, lower(CAST(col1_13 AS STRING)) ASC, "co%vl1_7" ASC, col1_5 DESC, col1_0, "co'%ql1_9", lower("Col1_1") ASC, col1_4 DESC, "%pcol1_8", col1_2 ASC, col1_12 ASC) STORING (col1_13, col1_14, col1_18) WHERE ("table%v1".col1_0 >= '00:00:00':::TIME) AND ("table%v1".col1_15 >= e'\x00':::STRING), UNIQUE (col1_17 ASC, col1_5 ASC, col1_6, col1_13 DESC, lower(CAST("%pcol1_8" AS STRING)), col1_0 DESC, col1_2 DESC) WHERE (((("table%v1".col1_14 >= '"':::STRING) AND ("table%v1"."coL1'_11" > e'\'':::STRING:::NAME)) AND ("table%v1".col1_13 >= '24:00:00':::TIME)) OR ("table%v1".col1_0 >= '00:00:00':::TIME)) OR ("table%v1".col1_15 >= '':::STRING), FAMILY (col1_0), FAMILY ("Col1_1"), FAMILY (col1_12), FAMILY ("co'%ql1_9"), FAMILY (col1_18), FAMILY (col1_2, col1_14), FAMILY (col1_13, co̯l1_3, col1_5, "co%vl1_7", "coL1'_11", col1_4), FAMILY ("co'l1_10", col1_6), FAMILY ("%pcol1_8"));
        test_1        |             ALTER TABLE "table%v1" INJECT STATISTICS e'[{"avg_size": 27, "columns": ["co\u032Fl1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 909385712429283942, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7003490260495180903}, {"avg_size": 12, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2575426282818828350, "histo_col_type": "", "name": "__auto__", "null_count": 5537474099391619310, "row_count": 7003490260495180903}, {"avg_size": 13, "columns": ["\\"co%vl1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 446198906044828913, "histo_buckets": [{"distinct_range": 0, "num_eq": 3137228666769546504, "num_range": 0, "upper_bound": "514196100"}, {"distinct_range": 5998140016701326000, "num_eq": 4504313108288655446, "num_range": 5998140016701325911, "upper_bound": "3333313948"}], "histo_col_type": "OID", "name": "__auto__", "null_count": 555508361215245030, "row_count": 7003490260495180903}, {"avg_size": 29, "columns": ["\\"co\'%ql1_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3051663496715935408, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7003490260495180903}, {"avg_size": 3, "columns": ["\\"coL1\'_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4357754875366156907, "histo_col_type": "", "name": "__auto__", "null_count": 2088193207135644192, "row_count": 7003490260495180903}, {"avg_size": 28, "columns": ["col1_17"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3187409594076863249, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": ""}, {"distinct_range": 9522.203738118526, "num_eq": 8907630022338376190, "num_range": 10000, "upper_bound": ":\\u000e\x7f#\\u0016v"}, {"distinct_range": 8920839573441210000, "num_eq": 3548856935529224967, "num_range": 8920839573441210724, "upper_bound": ":Sx=d"}, {"distinct_range": 43867835.02044252, "num_eq": 60, "num_range": 50000000, "upper_bound": "N)Y\\u0002+\\u0018\\u0019]H"}, {"distinct_range": 0, "num_eq": 10000000, "num_range": 7477525921868664263, "upper_bound": "p\\u001b)AoK6"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 3266168347906403113, "row_count": 7003490260495180903}, {"avg_size": 23, "columns": ["\\"Col1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4273995834772298519, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7003490260495180903}, {"avg_size": 27, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2304797199990759751, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7003490260495180903}, {"avg_size": 10, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1451247625010002582, "histo_col_type": "", "name": "__auto__", "null_count": 2654167781846910777, "row_count": 7003490260495180903}, {"avg_size": 17, "columns": ["col1_18"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6627951035711265458, "histo_col_type": "", "name": "__auto__", "null_count": 3010793826011802937, "row_count": 7003490260495180903}, {"avg_size": 6, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6419214371701634080, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7003490260495180903}, {"avg_size": 25, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2779912336967601831, "histo_col_type": "", "name": "__auto__", "null_count": 3154986214146573415, "row_count": 7003490260495180903}, {"avg_size": 2, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1710324526309573729, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7003490260495180903}, {"avg_size": 31, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6493806386141126194, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7003490260495180903}, {"avg_size": 31, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2704020103067937863, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7003490260495180903}, {"avg_size": 15, "columns": ["\\"%pcol1_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5125558049062068179, "histo_col_type": "", "name": "__auto__", "null_count": 723826345319804160, "row_count": 7003490260495180903}, {"avg_size": 1, "columns": ["\\"co\'l1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1278250254058284334, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7003490260495180903}, {"avg_size": 23, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1560863293877394401, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7003490260495180903}, {"avg_size": 11, "columns": ["\U0001F618co\u0321l1_16"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5534372593987265320, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7003490260495180903}]':::JSONB;
        test_1        |             ALTER TABLE "table%v1" INJECT STATISTICS e'[{"avg_size": 28, "columns": ["\\"%pcol1_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6864509685, "histo_col_type": "", "name": "__auto__", "null_count": 2691587172, "row_count": 9000000000}, {"avg_size": 15, "columns": ["\\"co\'%ql1_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1429287752, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 14, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3944504013, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 17, "columns": ["\\"co%vl1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5281239402, "histo_buckets": [{"distinct_range": 0, "num_eq": 6198885788200647796, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 675535.9633126851, "num_eq": 1000000, "num_range": 700000, "upper_bound": "2279560007"}, {"distinct_range": 2428186776601925600, "num_eq": 10000, "num_range": 8397859201350657652, "upper_bound": "2483616000"}, {"distinct_range": 5415923865034192000, "num_eq": 890410316775346870, "num_range": 7948490964837438239, "upper_bound": "3198375004"}, {"distinct_range": 2197153371.1425533, "num_eq": 300, "num_range": 3000000000, "upper_bound": "3633977462"}, {"distinct_range": 0, "num_eq": 345057684860477095, "num_range": 7525375051521729064, "upper_bound": "3802330182"}, {"distinct_range": 0, "num_eq": 70000, "num_range": 300, "upper_bound": "3819231453"}, {"distinct_range": 6043766098594993000, "num_eq": 8920320708657815764, "num_range": 6043766098594992766, "upper_bound": "4249225230"}], "histo_col_type": "OID", "name": "__auto__", "null_count": 5296827476, "row_count": 9000000000}, {"avg_size": 18, "columns": ["\\"coL1\'_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1725589392, "histo_col_type": "", "name": "__auto__", "null_count": 6634197287, "row_count": 9000000000}, {"avg_size": 6, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5554646667, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 22, "columns": ["\U0001F618co\u0321l1_16"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1868905668, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 6, "columns": ["\\"Col1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 780565360, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 21, "columns": ["\\"co\'l1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4541612373, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 24, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1104546315, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 5, "columns": ["col1_17"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2438070779, "histo_buckets": [{"distinct_range": 0, "num_eq": 400000000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 0, "num_eq": 2428868835365788456, "num_range": 4423163003163493315, "upper_bound": "0(\'AltJI"}, {"distinct_range": 40000000000, "num_eq": 7827223229318500762, "num_range": 40000000000, "upper_bound": "R\\u000e=ao\\u0005\\r2E"}, {"distinct_range": 484387377931090500, "num_eq": 4000, "num_range": 484387377931090518, "upper_bound": "f\\u0013\\u0011f~=6/"}, {"distinct_range": 658705125103727400, "num_eq": 20000000, "num_range": 2963694413826147108, "upper_bound": "p(+O9"}, {"distinct_range": 800000, "num_eq": 0, "num_range": 800000, "upper_bound": "{"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 734355425, "row_count": 9000000000}, {"avg_size": 22, "columns": ["col1_18"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1515395552, "histo_col_type": "", "name": "__auto__", "null_count": 4547398570, "row_count": 9000000000}, {"avg_size": 31, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4993821559, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 24, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1884518466, "histo_col_type": "", "name": "__auto__", "null_count": 2685961143, "row_count": 9000000000}, {"avg_size": 30, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1883491227, "histo_col_type": "", "name": "__auto__", "null_count": 174325250, "row_count": 9000000000}, {"avg_size": 14, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1637287870, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 15, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5099514546, "histo_col_type": "", "name": "__auto__", "null_count": 8722872493, "row_count": 9000000000}, {"avg_size": 29, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4907168965, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000000000}, {"avg_size": 12, "columns": ["co\u032Fl1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4147784369, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (21.27s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ aec78f33d45a8376a0ecec885688bae60dbfb85c:

        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '00000000-0000-0000-0000-000000000009':::UUID::UUID AS col6355,
        test_1        |                         '2000-01-01 08:00:00+00':::TIMESTAMPTZ::TIMESTAMPTZ AS "col%p6356",
        test_1        |                         regproc(2:::INT8::INT4::INT4)::REGPROC AS col6357
        test_1        |                 )
        test_1        |                     AS tab5831
        test_1        |             ORDER BY
        test_1        |                 col6355 ASC NULLS FIRST, "col%p6356" ASC NULLS LAST, col6357 NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         '00000000-0000-0000-0000-000000000009'::UUID::UUID AS col6355,
        test_1        |                         '2000-01-01 08:00:00+00'::TIMESTAMPTZ::TIMESTAMPTZ AS "col%p6356",
        test_1        |                         regproc(2::INT8::INT4::INT4)::REGPROC AS col6357
        test_1        |                 )
        test_1        |                     AS tab5831
        test_1        |             ORDER BY
        test_1        |                 col6355 ASC NULLS FIRST, "col%p6356" ASC NULLS LAST, col6357 NULLS LAST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.58s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "ta�ble1" (col1_0 TIMESTAMPTZ NOT NULL, col1_1 DATE[] NOT NULL, col1_2 GEOMETRY NOT NULL, col1_3 DATE NOT NULL, "col1
_4" CHAR NOT NULL, "-col1_5" TIME NOT NULL, col1_6 CHAR NOT NULL, "col1_ 7" BIT(3) NOT NULL, col1_8 STRING COLLATE de NOT NULL, col1_9 TIMETZ NOT NULL, col1_10 "char" NOT NULL, col1_11 STRING COLLATE de NULL, col1_12 NAME NOT NULL, "c%7do  l1_13" INET NULL, "co�l1_14" REGTYPE NULL, col1_15 STRING NOT NULL AS (lower(CAST(col1_2 AS STRING))) VIRTUAL, PRIMARY KEY ("col1
_4" DESC, col1_0 DESC, "-col1_5" DESC, col1_1 ASC, col1_8 ASC, col1_10 ASC, "col1_ 7" DESC, col1_3 DESC, col1_15 ASC, col1_9 DESC), UNIQUE ("-col1_5", col1_3, (CASE WHEN "co�l1_14" IS NULL THEN e'\\Dh':::STRING ELSE 'dU)8:QNbq':::STRING END) ASC, col1_9, "c%7do   l1_13" DESC, col1_10 DESC, lower(CAST("col1_ 7" AS STRING)), col1_1 ASC) WHERE (((("ta�ble1".col1_10 = e'\x00':::STRING) AND ("ta�ble1".col1_15 > '':::STRING)) AND ("ta�ble1".col1_6 >= e'\x00':::STRING)) OR ("ta�ble1".col1_12 > '':::STRING:::NAME)) AND ("ta�ble1".col1_0 != '3000-01-01 00:00:00+00':::TIMESTAMPTZ), UNIQUE (col1_0 ASC, "co�l1_14" ASC, col1_8 DESC, "col1_ 7" ASC, col1_9, col1_10, col1_1 DESC, "col1
_4" DESC), FAMILY (col1_9), FAMILY ("c%7do  l1_13"), FAMILY (col1_6, col1_3, "col1_ 7"), FAMILY ("col1
_4", col1_0, col1_11, col1_1), FAMILY (col1_10), FAMILY ("-col1_5", col1_12, col1_2), FAMILY ("co�l1_14"), FAMILY (col1_8), UNIQUE ("col1
_4", col1_3) STORING (col1_2, col1_6, "co�l1_14"));
        test_1        |             ALTER TABLE "ta�ble1" INJECT STATISTICS e'[{"avg_size": 8, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 502588661461761938, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4509104122859781589}, {"avg_size": 14, "columns": ["\\"col1_ 7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3248097379225738394, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4509104122859781589}, {"avg_size": 25, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3789842556709351126, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4509104122859781589}, {"avg_size": 17, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1582576356241626391, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4509104122859781589}, {"avg_size": 24, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4447601874193559688, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4509104122859781589}, {"avg_size": 13, "columns": ["\\"-col1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3990058056147388174, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "04:24:48.631659"}, {"distinct_range": 0, "num_eq": 900000, "num_range": 200, "upper_bound": "18:05:29.779146"}, {"distinct_range": 0, "num_eq": 305280390164720643, "num_range": 20000000000, "upper_bound": "22:19:11.954446"}], "histo_col_type": "TIME", "name": "__auto__", "null_count": 0, "row_count": 4509104122859781589}, {"avg_size": 5, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1668844695537939512, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4509104122859781589}, {"avg_size": 14, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3537604618754185068, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4509104122859781589}, {"avg_size": 7, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1306441555708382151, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4509104122859781589}, {"avg_size": 31, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3833434757138923423, "histo_col_type": "", "name": "__auto__", "null_count": 3276277924327507491, "row_count": 4509104122859781589}, {"avg_size": 9, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2586437438186953026, "histo_col_type": "TIMESTAMPTZ", "name": "__auto__", "null_count": 0, "row_count": 4509104122859781589}, {"avg_size": 5, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1423267158103613397, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4509104122859781589}, {"avg_size": 0, "columns": ["\\"col1\\r_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1366436454327261124, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4509104122859781589}, {"avg_size": 4, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 981702245373101136, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4509104122859781589}, {"avg_size": 25, "columns": ["\\"c%7do\\tl1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1656047000890153698, "histo_col_type": "", "name": "__auto__", "null_count": 431291100658385346, "row_count": 4509104122859781589}, {"avg_size": 5, "columns": ["\\"co\\u000cl1_14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3062921542617479591, "histo_col_type": "", "name": "__auto__", "null_count": 2594941749567120167, "row_count": 4509104122859781589}]':::JSONB;
        test_1        |             ALTER TABLE "ta�ble1" INJECT STATISTICS e'[{"avg_size": 4, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 71831698, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 18, "columns": ["\\"col1\\r_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 53580875, "histo_buckets": [{"distinct_range": 0, "num_eq": 900000000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 759994660484657700, "num_eq": 80000, "num_range": 5653499328292659779, "upper_bound": " "}, {"distinct_range": 0, "num_eq": 100000000000, "num_range": 4383582730311037804, "upper_bound": "*"}, {"distinct_range": 3290936977716953000, "num_eq": 70000000, "num_range": 6383955758509205523, "upper_bound": "0"}, {"distinct_range": 5368734260879329000, "num_eq": 100000000000, "num_range": 5368734260879328940, "upper_bound": "3"}, {"distinct_range": 4000000000, "num_eq": 4597481608038384703, "num_range": 4000000000, "upper_bound": "P"}], "histo_col_type": "CHAR", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 3, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 80489723, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 27, "columns": ["\\"-col1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 65222120, "histo_buckets": [{"distinct_range": 0, "num_eq": 3579484809901110057, "num_range": 0, "upper_bound": "01:17:52.800943"}, {"distinct_range": 1482706271602020000, "num_eq": 7000000000, "num_range": 1482706271602020059, "upper_bound": "05:35:12.046055"}, {"distinct_range": 0, "num_eq": 7983300720859749627, "num_range": 600000, "upper_bound": "17:13:29.739883"}], "histo_col_type": "TIME", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 22, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 61046382, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 28, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 89999986, "histo_buckets": [{"distinct_range": 0, "num_eq": 5000, "num_range": 0, "upper_bound": "1982-09-26 22:15:29.000943+00"}, {"distinct_range": 0, "num_eq": 60000000, "num_range": 20000000000, "upper_bound": "1994-08-31 03:17:54.000676+00"}, {"distinct_range": 59.217174276632306, "num_eq": 1531975196753038467, "num_range": 300, "upper_bound": "2007-10-09 04:36:12.000188+00"}, {"distinct_range": 0, "num_eq": 4362240340339364040, "num_range": 2389307288488275206, "upper_bound": "2008-03-19 11:31:40.000333+00"}, {"distinct_range": 0, "num_eq": 1469598882271070490, "num_range": 30, "upper_bound": "2015-02-03 06:40:02.000394+00"}, {"distinct_range": 0, "num_eq": 8800675058023350365, "num_range": 0, "upper_bound": "2026-09-28 22:20:21.000299+00"}, {"distinct_range": 0, "num_eq": 7003310957633372141, "num_range": 7000, "upper_bound": "2026-12-01 05:11:34.000564+00"}, {"distinct_range": 7002489897.222473, "num_eq": 40000, "num_range": 40000000000, "upper_bound": "294276-12-31 23:59:59.999999+00"}], "histo_col_type": "TIMESTAMPTZ", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 19, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 81847405, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 31, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 17453422, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 16, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 43755456, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 8, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 63618431, "histo_col_type": "", "name": "__auto__", "null_count": 79736294, "row_count": 100000000}, {"avg_size": 8, "columns": ["\\"co\\u000cl1_14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 62021720, "histo_col_type": "", "name": "__auto__", "null_count": 13763803, "row_count": 100000000}, {"avg_size": 12, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 60755750, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 19, "columns": ["\\"col1_ 7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 37595487, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 22, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 17379445, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 12, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 68849750, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 20, "columns": ["\\"c%7do\\tl1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7870570, "histo_col_type": "", "name": "__auto__", "null_count": 39171986, "row_count": 100000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (27.24s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 7e72aae900c3ff4b44f1643c2d7ba55fbb2cbe23:

        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-03-31 05:17:20.905 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-03-31 05:17:20.906 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-03-31 05:17:20.906 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-03-31 05:17:20.909 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-03-31 05:17:20.914 UTC [68] LOG:  database system was shut down at 2023-03-31 05:17:20 UTC
        postgres_1    | 2023-03-31 05:17:20.915 UTC [70] FATAL:  the database system is starting up
        test_1        | I230331 05:17:20.915712 13 testutils/soon.go:41  [-] 1  SucceedsSoon: FATAL: the database system is starting up (SQLSTATE 57P03)
        postgres_1    | 2023-03-31 05:17:20.919 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-03-31 05:17:22.899 UTC [80] ERROR:  collation "de" for encoding "UTF8" does not exist at character 101
        postgres_1    | 2023-03-31 05:17:22.899 UTC [80] STATEMENT:  CREATE TABLE table2 (col2_0 OID NULL, "co\vl2_1" TIMETZ NOT NULL, co😬l2_2 REGCLASS, "c̴    ol2_3" TEXT COLLATE de NOT NULL, "col%q2_😌4" INET NOT NULL, "%qcoL2_5" TIME NOT NULL, "%3bc\\x00ol2_😸6" OID NULL, "co l2͇_7" BIT(14), "c ol2_8" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("%3bc\\x00ol2_😸6" AS TEXT))) STORED, PRIMARY KEY ("c̴ ol2_3", "%qcoL2_5", "c ol2_8", "co\vl2_1", "col%q2_😌4"));
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.79s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.97s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table2 (col2_0 OID NULL, "co\vl2_1" TIMETZ NOT NULL, co😬l2_2 REGCLASS, "c̴    ol2_3" TEXT COLLATE de NOT NULL, "col%q2_😌4" INET NOT NULL, "%qcoL2_5" TIME NOT NULL, "%3bc\\x00ol2_😸6" OID NULL, "co l2͇_7" BIT(14), "c ol2_8" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("%3bc\\x00ol2_😸6" AS TEXT))) STORED, PRIMARY KEY ("c̴ ol2_3", "%qcoL2_5", "c ol2_8", "co\vl2_1", "col%q2_😌4"));
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "de" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.68s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 BIT(20)[] NOT NULL, col1_1 "char" NOT NULL, "col1
        test_1        |             _2" JSONB NOT NULL, col1_3 VARCHAR NOT NULL, "col1""_4" INT4 NOT NULL, col1_5 BOX2D, col1_6 INET NOT NULL, col1_7 BIT(25) NOT NULL, col1_8 INET NOT NULL, "col1_%v9" STRING NOT NULL AS (lower(CAST(col1_8 AS STRING))) VIRTUAL, col1_10 STRING NOT NULL AS (lower(CAST(col1_7 AS STRING))) VIRTUAL, col1_11 STRING NOT NULL AS (lower(CAST("col1
        test_1        |             _2" AS STRING))) STORED, col1_12 STRING AS (lower(CAST(col1_5 AS STRING))) VIRTUAL, col1_13 STRING NOT NULL AS (lower(CAST(col1_8 AS STRING))) STORED, "co'l1_14" STRING NOT NULL AS (lower(col1_3)) VIRTUAL, col1_😻15 STRING NOT NULL AS (CASE WHEN col1_0 IS NULL THEN e'\x01n\x1bz\x0e_L':::STRING ELSE e'G3l\x1ei\x0e\x1b&S':::STRING END) VIRTUAL, col1_16 INT8 NOT NULL AS ("col1""_4" + (-2085929692):::INT8) STORED, PRIMARY KEY (col1_3 ASC, "col1""_4", "col1_%v9", col1_13 ASC, col1_1, col1_7 DESC, col1_16 ASC), UNIQUE (lower(CAST(col1_8 AS STRING)), col1_3, col1_😻15 DESC) STORING (col1_6, col1_11) WHERE ((((((((((table1."col1_%v9" = e'\'':::STRING) AND (table1.col1_11 != 'X':::STRING)) OR (table1.col1_1 != e'\'':::STRING)) AND (table1.col1_16 < (-9223372036854775807):::INT8)) OR (table1.col1_13 >= e'\'':::STRING)) OR (table1.col1_😻15 > e'\'':::STRING)) OR (table1.col1_10 != e'\'':::STRING)) AND (table1.col1_12 < e'\'':::STRING)) AND (table1.col1_3 <= e'\x00':::STRING)) AND (table1."col1""_4" = (-32768):::INT8)) AND (table1."co'l1_14" <= '"':::STRING), UNIQUE (col1_7 DESC, (CASE WHEN col1_0 IS NULL THEN e'\x1cV\x16\x1a':::STRING ELSE 'u``Zg':::STRING END) ASC, col1_6 ASC, col1_13 DESC, col1_11, col1_8) PARTITION BY LIST (col1_7) (PARTITION table1_part0 VALUES IN ((B'0111111111111111111111111',), (B'0111110000111011100100100',), (B'0100010100000010101111011',)), PARTITION table1_part1 VALUES IN ((B'0101001000010110111010110',), (B'0111001000011001111110100',), (B'0110011101100010000100101',)), PARTITION table1_part2 VALUES IN ((B'1001011010000011101001000',), (B'1111010100110001110000101',), (B'0100001111101010011101111',)), PARTITION "%ptable1_part3" VALUES IN ((B'1010001010011110110011110',), (B'0011001101010011011011111',), (B'0010111001101111101010101',))) WHERE (((((table1.col1_😻15 <= e'\'':::STRING) AND (table1."co'l1_14" <= e'\x00':::STRING)) AND (table1.col1_10 != 'X':::STRING)) AND (table1.col1_11 <= e'\U00002603':::STRING)) OR (table1.col1_13 != e'\U00002603':::STRING)) OR (table1."col1_%v9" <= e'\U00002603':::STRING), UNIQUE (col1_13 ASC, col1_12 DESC, col1_0 DESC, col1_16 DESC, col1_11 DESC, col1_1 ASC, "col1""_4" ASC, "co'l1_14" ASC, col1_6, col1_8 ASC, col1_5 DESC) STORING ("col1
        test_1        |             _2") WHERE ((((((((((table1.col1_3 <= '"':::STRING) OR (table1."col1""_4" < (-128):::INT8)) AND (table1.col1_1 >= '':::STRING)) AND (table1.col1_10 < e'\x00':::STRING)) OR (table1.col1_13 = 'X':::STRING)) OR (table1.col1_11 >= '':::STRING)) OR (table1."co'l1_14" = e'\U00002603':::STRING)) OR (table1.col1_16 <= (-1):::INT8)) OR (table1.col1_12 <= '"':::STRING)) OR (table1.col1_😻15 > '"':::STRING)) OR (table1."col1_%v9" = '"':::STRING), INDEX (lower(col1_3) ASC, "col1_%v9" DESC, col1_0 ASC) STORING (col1_5, col1_11), FAMILY ("col1""_4"), FAMILY (col1_8, col1_7, col1_3), FAMILY (col1_16), FAMILY (col1_13), FAMILY (col1_6, col1_0), FAMILY (col1_1, "col1
        test_1        |             _2"), FAMILY (col1_11, col1_5));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 11, "columns": ["\\"col1\\n_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 305007, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 24, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 186018, "histo_col_type": "", "name": "__auto__", "null_count": 327990, "row_count": 400000}, {"avg_size": 7, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 319273, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 23, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 345184, "histo_col_type": "", "name": "__auto__", "null_count": 167547, "row_count": 400000}, {"avg_size": 27, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 388015, "histo_buckets": [{"distinct_range": 0, "num_eq": 40, "num_range": 0, "upper_bound": ">Z\\u0007\\u0015@"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 22, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 361399, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 27, "columns": ["\\"col1_%v9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 209466, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 13, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 82131, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 6, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 98818, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 16, "columns": ["col1_16"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 154130, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 26, "columns": ["\\"co\'l1_14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 82766, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 25, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 318645, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 8, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 219300, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 24, "columns": ["\\"col1\\"\\"_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 32700, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 31, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 363402, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 21, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 369789, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000}, {"avg_size": 28, "columns": ["col1_\U0001F63B15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 11881, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 400000}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 23, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 27662897373, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000000000}, {"avg_size": 1, "columns": ["col1_\U0001F63B15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6163275843, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000000000}, {"avg_size": 8, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 14554031973, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000000000}, {"avg_size": 19, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8540328471, "histo_buckets": [{"distinct_range": 0, "num_eq": 50000000000, "num_range": 0, "upper_bound": "0000011010111001000100100"}, {"distinct_range": 0, "num_eq": 5656067355048645550, "num_range": 265423953579748728, "upper_bound": "0010011001111110001111110"}, {"distinct_range": 8967107950002690000, "num_eq": 200, "num_range": 8967107950002690166, "upper_bound": "0101101100010110001110111"}, {"distinct_range": 0, "num_eq": 9163671354323580815, "num_range": 7840125645153411199, "upper_bound": "0101110010011010110001101"}, {"distinct_range": 9671200655.589268, "num_eq": 20000000, "num_range": 30000000000, "upper_bound": "0110000010110011110001001"}, {"distinct_range": 0, "num_eq": 100, "num_range": 6467122946843361925, "upper_bound": "0111111111111111111111111"}, {"distinct_range": 191.54208498594048, "num_eq": 10000, "num_range": 3000, "upper_bound": "1001001110110111111011000"}, {"distinct_range": 7819267257461082000, "num_eq": 10000000, "num_range": 7819267257461081722, "upper_bound": "1001100100011101001101001"}, {"distinct_range": 0, "num_eq": 20000000000, "num_range": 0, "upper_bound": "1110101001011110100100000"}], "histo_col_type": "BIT(25)", "name": "__auto__", "null_count": 0, "row_count": 30000000000}, {"avg_size": 11, "columns": ["\\"col1_%v9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 12612490831, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000000000}, {"avg_size": 14, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 27583475464, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000000000}, {"avg_size": 29, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3612509094, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000000000}, {"avg_size": 9, "columns": ["\\"col1\\n_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 11387534656, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000000000}, {"avg_size": 24, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 17221595102, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000000000}, {"avg_size": 10, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 12182441728, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000000000}, {"avg_size": 29, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 687668543, "histo_col_type": "", "name": "__auto__", "null_count": 13109668803, "row_count": 30000000000}, {"avg_size": 6, "columns": ["\\"co\'l1_14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 26354851070, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000000000}, {"avg_size": 13, "columns": ["col1_16"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 23848820270, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000000000}, {"avg_size": 5, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 25927814145, "histo_buckets": [{"distinct_range": 0, "num_eq": 100, "num_range": 0, "upper_bound": "-p\\u0015#"}, {"distinct_range": 69280.22361763059, "num_eq": 60000, "num_range": 80000, "upper_bound": "M-\\n0\\u0006\\u00194T\\u0015"}], "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 0, "row_count": 30000000000}, {"avg_size": 17, "columns": ["\\"col1\\"\\"_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 24415081247, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000000000}, {"avg_size": 31, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 20049050958, "histo_col_type": "", "name": "__auto__", "null_count": 22867344639, "row_count": 30000000000}, {"avg_size": 18, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 27885824714, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.57s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 5d5abe704b0551556c35d51aa673d3162f493aa8:

        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-01 05:18:01.849 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-01 05:18:01.849 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-01 05:18:01.849 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-01 05:18:01.853 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-01 05:18:01.858 UTC [68] LOG:  database system was shut down at 2023-04-01 05:18:01 UTC
        postgres_1    | 2023-04-01 05:18:01.860 UTC [70] FATAL:  the database system is starting up
        test_1        | I230401 05:18:01.860919 25 testutils/soon.go:41  [-] 1  SucceedsSoon: FATAL: the database system is starting up (SQLSTATE 57P03)
        postgres_1    | 2023-04-01 05:18:01.863 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-01 05:18:03.779 UTC [80] ERROR:  collation "de" for encoding "UTF8" does not exist at character 210
        postgres_1    | 2023-04-01 05:18:03.779 UTC [80] STATEMENT:  CREATE TABLE "table%q3" (col3_0 OID, col3_1 UUID NULL, "�col3_2" GEOMETRY NOT NULL, col3_3 BOX2D NOT NULL, col3_4 INET NOT NULL, "c\\U00038367ol3_5" FLOAT4 NOT NULL, "col'3_6" BYTEA NOT NULL, "%qcol3'_7" TEXT COLLATE de NOT NULL, "col'3_8" FLOAT8 NOT NULL, "co�l3_9" DATE NULL, "c   ol3_\\uE74510" NAME NOT NULL, " col3_11" TIMESTAMPTZ, col3_12 GEOMETRY NOT NULL);
        postgres_1    |     CREATE INDEX ON "table%q3" ("col'3_6", "co�l3_9" ASC, "%qcol3'_7", col3_1, ("c\\U00038367ol3_5" + "col'3_8") ASC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.58s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.91s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "table%q3" (col3_0 OID, col3_1 UUID NULL, "�col3_2" GEOMETRY NOT NULL, col3_3 BOX2D NOT NULL, col3_4 INET NOT NULL, "c\\U00038367ol3_5" FLOAT4 NOT NULL, "col'3_6" BYTEA NOT NULL, "%qcol3'_7" TEXT COLLATE de NOT NULL, "col'3_8" FLOAT8 NOT NULL, "co�l3_9" DATE NULL, "c   ol3_\\uE74510" NAME NOT NULL, " col3_11" TIMESTAMPTZ, col3_12 GEOMETRY NOT NULL);
        test_1        |             CREATE INDEX ON "table%q3" ("col'3_6", "co�l3_9" ASC, "%qcol3'_7", col3_1, ("c\\U00038367ol3_5" + "col'3_8") ASC);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "de" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.54s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 STRING NOT NULL, col1_1 UUID, col1_2 INT8 NOT NULL, col1_3 REGROLE NULL, col1_4 DECIMAL NOT NULL, col1_5 TIMESTAMP, "col1?_    6" INTERVAL NOT NULL, col1_7 TIMETZ NOT NULL, "col1'_8" "char" NULL, "col1_ 9" OID NOT NULL, col1_10 STRING COLLATE da NOT NULL, "co
l1_11" DECIMAL NOT NULL AS (col1_4 + (-8.105975027467791045E+21):::DECIMAL) VIRTUAL, " col1_12" STRING NOT NULL AS (lower(CAST(col1_1 AS STRING))) VIRTUAL, PRIMARY KEY (col1_2, col1_10, "col1_    9" ASC, col1_7 ASC, " col1_12" DESC, col1_0 ASC), FAMILY ("col1'_8", col1_1), FAMILY ("col1_    9", "col1?_ 6", col1_10), FAMILY (col1_2), FAMILY (col1_3, col1_5), FAMILY (col1_7, col1_4, col1_0));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 0, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 800, "num_range": 0, "upper_bound": "-4607671165280998255"}, {"distinct_range": 0, "num_eq": 0, "num_range": 1000000, "upper_bound": "-1691056019707360542"}, {"distinct_range": 378109493989394900, "num_eq": 600000000, "num_range": 1517275109582354563, "upper_bound": "-571100541822168720"}, {"distinct_range": 0, "num_eq": 70000000000, "num_range": 3492727263262251909, "upper_bound": "2147483647"}, {"distinct_range": 7979466586128087000, "num_eq": 8000000000, "num_range": 7979466586128087394, "upper_bound": "1069723866187298975"}, {"distinct_range": 5547953269902745000, "num_eq": 2414897938521679446, "num_range": 5547953269902744470, "upper_bound": "3860629672636084320"}, {"distinct_range": 526363885290025100, "num_eq": 2793511126179639565, "num_range": 526363885290025065, "upper_bound": "5802532446042492387"}, {"distinct_range": 300000000, "num_eq": 900000000, "num_range": 300000000, "upper_bound": "7009098904409784219"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col1?_\\t6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col1\'_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col1_\\t9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\" col1_12\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"co\\rl1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 5, "columns": ["\\"col1\'_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7435, "histo_col_type": "", "name": "__auto__", "null_count": 80696, "row_count": 100000}, {"avg_size": 12, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 21963, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000}, {"avg_size": 8, "columns": ["\\" col1_12\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 13312, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000}, {"avg_size": 19, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 16803, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000}, {"avg_size": 29, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 80415, "histo_buckets": [{"distinct_range": 0, "num_eq": 100, "num_range": 0, "upper_bound": "-6104040083594180399"}, {"distinct_range": 0, "num_eq": 100000000000, "num_range": 4000, "upper_bound": "-4988871676570084525"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 100000}, {"avg_size": 18, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8678, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000}, {"avg_size": 9, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 96276, "histo_col_type": "", "name": "__auto__", "null_count": 57474, "row_count": 100000}, {"avg_size": 5, "columns": ["\\"col1?_\\t6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 70982, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000}, {"avg_size": 20, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 9696, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000}, {"avg_size": 31, "columns": ["\\"col1_\\t9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 16269, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000}, {"avg_size": 31, "columns": ["\\"co\\rl1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 30876, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000}, {"avg_size": 29, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 95025, "histo_col_type": "", "name": "__auto__", "null_count": 47973, "row_count": 100000}, {"avg_size": 20, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 85340, "histo_col_type": "", "name": "__auto__", "null_count": 56321, "row_count": 100000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.15s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 63b683eab3e0ebfff812bb54fdac936c101d9383:

        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (6.07s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare3686692065/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare postgres to cockroach1: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |                 nil,
        test_1        |             -   string("8"),
        test_1        |             +   string("array_agg"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT NULL::RECORD AS col5528, regproc(8:::OID::OID::OID)::REGPROC AS "col 5529") AS "t""\vab3105"
        test_1        |             ORDER BY
        test_1        |                 col5528 ASC, "col 5529";
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT NULL::RECORD AS col5528, regproc(8::OID::OID::OID)::REGPROC AS "col 5529") AS "t""\vab3105"
        test_1        |             ORDER BY
        test_1        |                 col5528 ASC, "col 5529";
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.82s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "ta%vble1" (col1_0 REGROLE NULL, col1_1 BOOL NOT NULL, col1_2 REGROLE NULL, "col1,_3" TIME NOT NULL, c😩ol̈1_4 TSQUERY NULL, col1͢_5 BIT(25) NOT NULL, col1_6 INT8 NOT NULL, col1_7 FLOAT4 NOT NULL, col1_8 JSONB NOT NULL, PRIMARY KEY ("col1,_3" ASC), UNIQUE (col1͢_5, col1_1) WHERE "ta%vble1".col1_1, FAMILY (c😩ol̈1_4, "col1,_3"), FAMILY (col1_8, col1_0, col1_1), FAMILY (col1_7), FAMILY (col1_6), FAMILY (col1͢_5, col1_2));
        test_1        |             ALTER TABLE "ta%vble1" INJECT STATISTICS e'[{"avg_size": 16, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 12, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 50}, {"avg_size": 4, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 9, "histo_col_type": "", "name": "__auto__", "null_count": 48, "row_count": 50}, {"avg_size": 8, "columns": ["\\"col1,_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8, "histo_buckets": [{"distinct_range": 0, "num_eq": 2105437697099353325, "num_range": 0, "upper_bound": "04:08:33.488645"}, {"distinct_range": 0, "num_eq": 7549270560914761864, "num_range": 0, "upper_bound": "06:09:38.417165"}, {"distinct_range": 0, "num_eq": 6919464734237214558, "num_range": 20000000000, "upper_bound": "07:24:53.750954"}, {"distinct_range": 0, "num_eq": 30000000, "num_range": 5882522868874621009, "upper_bound": "09:07:52.322139"}, {"distinct_range": 0, "num_eq": 5000, "num_range": 20000, "upper_bound": "10:22:33.209649"}, {"distinct_range": 0, "num_eq": 0, "num_range": 30000000, "upper_bound": "16:21:26.575555"}, {"distinct_range": 9018141190862332000, "num_eq": 20000, "num_range": 9018141190862331868, "upper_bound": "17:17:36.496219"}, {"distinct_range": 561883.0480954535, "num_eq": 40000, "num_range": 800000, "upper_bound": "19:01:40.066762"}, {"distinct_range": 4400007729596405000, "num_eq": 3597208230270024488, "num_range": 4400007729596405489, "upper_bound": "22:13:58.491732"}], "histo_col_type": "TIME", "name": "__auto__", "null_count": 0, "row_count": 50}, {"avg_size": 13, "columns": ["c\U0001F629ol\u03081_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 15, "histo_col_type": "", "name": "__auto__", "null_count": 3, "row_count": 50}, {"avg_size": 28, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 18, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 50}, {"avg_size": 21, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5, "histo_col_type": "", "name": "__auto__", "null_count": 44, "row_count": 50}, {"avg_size": 21, "columns": ["col1\u0362_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 42, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 50}, {"avg_size": 11, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 16, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 50}, {"avg_size": 19, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 31, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 50}]':::JSONB;
        test_1        |             ALTER TABLE "ta%vble1" INJECT STATISTICS e'[{"avg_size": 14, "columns": ["\\"col1,_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2822914277186397233, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3260430444478249064}, {"avg_size": 26, "columns": ["c\U0001F629ol\u03081_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2220712381465200106, "histo_col_type": "", "name": "__auto__", "null_count": 2971588043145894771, "row_count": 3260430444478249064}, {"avg_size": 3, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2948913059898239783, "histo_col_type": "", "name": "__auto__", "null_count": 2598329953734942717, "row_count": 3260430444478249064}, {"avg_size": 16, "columns": ["col1\u0362_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2969205932047350125, "histo_buckets": [{"distinct_range": 0, "num_eq": 100000000000, "num_range": 0, "upper_bound": "0001001010111111000100011"}, {"distinct_range": 70000000, "num_eq": 0, "num_range": 70000000, "upper_bound": "0111111111111111111111111"}, {"distinct_range": 0, "num_eq": 6170311619295713597, "num_range": 0, "upper_bound": "1000110110110000110111001"}, {"distinct_range": 5075218965565698000, "num_eq": 5629205013248618349, "num_range": 5075218965565697973, "upper_bound": "1101010110101100010011101"}, {"distinct_range": 0, "num_eq": 300000, "num_range": 3000, "upper_bound": "1101101010001110100100101"}, {"distinct_range": 4316967250319410000, "num_eq": 4663117091005151322, "num_range": 8048336422727337812, "upper_bound": "1111010100000110010110000"}], "histo_col_type": "BIT(25)", "name": "__auto__", "null_count": 0, "row_count": 3260430444478249064}, {"avg_size": 25, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 853186925472330247, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3260430444478249064}, {"avg_size": 17, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1357199023454908874, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3260430444478249064}, {"avg_size": 31, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2944307118817621796, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3260430444478249064}, {"avg_size": 21, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1290456892940656808, "histo_col_type": "", "name": "__auto__", "null_count": 2793495972492615711, "row_count": 3260430444478249064}, {"avg_size": 11, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 973921824431245418, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3260430444478249064}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (33.58s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 63b683eab3e0ebfff812bb54fdac936c101d9383:

        test_1        |             +   string("4"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(4:::INT8::INT4::INT4)::REGPROCEDURE AS """col10678") AS "%99tab5923"
        test_1        |             ORDER BY
        test_1        |                 """col10678" DESC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(4::INT8::INT4::INT4)::REGPROCEDURE AS """col10678") AS "%99tab5923"
        test_1        |             ORDER BY
        test_1        |                 """col10678" DESC;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.70s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 UUID[] NOT NULL, col1_1 BYTES[] NOT NULL, "col%v1_2" UUID NOT NULL, col1_3 INTERVAL NOT NULL, "col1|_4" INT8 NULL, " col1_5" BIT(36) NOT NULL, col1_😩6 STRING NOT NULL AS (CASE WHEN col1_1 IS NULL THEN e'\t37ik/':::STRING ELSE e'\U00002603':::STRING END) STORED, "
        test_1        |             😑c̨ol1_7" INT8 NULL AS ("col1|_4" + (-1):::INT8) VIRTUAL, UNIQUE (col1_1, " col1_5" ASC, "col1|_4") WHERE (table1.col1_😩6 <= 'X':::STRING) AND (table1."
        test_1        |             😑c̨ol1_7" < 0:::INT8), INDEX (" col1_5" DESC, col1_😩6, col1_3 DESC, col1_1 ASC, "col1|_4" ASC, col1_0, "
        test_1        |             😑c̨ol1_7") STORING ("col%v1_2") WHERE table1."col1|_4" > 0:::INT8, INVERTED INDEX ("col1|_4" DESC, "col%v1_2" ASC, "
        test_1        |             😑c̨ol1_7" ASC, col1_😩6 ASC, col1_1 ASC, " col1_5" DESC, col1_0 ASC) WHERE table1.col1_😩6 <= e'\'':::STRING, INDEX (col1_😩6, col1_0 DESC, "
        test_1        |             😑c̨ol1_7") STORING (col1_1, col1_3, "col1|_4") WHERE ((table1."col1|_4" = 2147483647:::INT8) AND (table1."
        test_1        |             😑c̨ol1_7" > 1:::INT8)) AND (table1.col1_😩6 >= e'\'':::STRING), INDEX ("
        test_1        |             😑c̨ol1_7", "col%v1_2", col1_😩6) STORING (col1_0, col1_3, "col1|_4", " col1_5"), UNIQUE ("
        test_1        |             😑c̨ol1_7" DESC, col1_3 DESC, "col1|_4" DESC, col1_0 ASC, " col1_5") STORING (col1_1, "col%v1_2") WHERE ((table1."col1|_4" > 0:::INT8) OR (table1."
        test_1        |             😑c̨ol1_7" = (-9223372036854775807):::INT8)) OR (table1.col1_😩6 != '"':::STRING), INDEX (col1_😩6 ASC, col1_0 DESC, " col1_5", lower(CAST(" col1_5" AS STRING)) ASC) WHERE ((table1.col1_😩6 >= e'\'':::STRING) OR (table1."
        test_1        |             😑c̨ol1_7" <= 32767:::INT8)) OR (table1."col1|_4" != 0:::INT8), UNIQUE ("col%v1_2" ASC) STORING (col1_3, "col1|_4", " col1_5") WHERE (table1.col1_😩6 >= e'\x00':::STRING) AND (table1."col1|_4" > (-1):::INT8), INDEX (col1_3 DESC, col1_0) STORING (col1_1, "col%v1_2", "col1|_4", " col1_5") WHERE ((table1."
        test_1        |             😑c̨ol1_7" > 9223372036854775807:::INT8) OR (table1."col1|_4" > (-1):::INT8)) OR (table1.col1_😩6 <= e'\'':::STRING), FAMILY ("col1|_4"), FAMILY (col1_3, "col%v1_2", " col1_5"), FAMILY (col1_😩6), FAMILY (col1_1), FAMILY (col1_0));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 5, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 90089, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000}, {"avg_size": 31, "columns": ["\\"col1|_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 86448, "histo_col_type": "", "name": "__auto__", "null_count": 21500, "row_count": 100000}, {"avg_size": 27, "columns": ["\\" col1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 23212, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000}, {"avg_size": 0, "columns": ["col1_\U0001F6296"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6618, "histo_buckets": [{"distinct_range": 0, "num_eq": 3626527034930477465, "num_range": 0, "upper_bound": ""}, {"distinct_range": 0, "num_eq": 8464307024209202799, "num_range": 8266550828854712683, "upper_bound": "\U00002603"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 100000}, {"avg_size": 18, "columns": ["\\"\\n\U0001F611c\u0328ol1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 15958, "histo_buckets": [{"distinct_range": 0, "num_eq": 7000000000, "num_range": 0, "upper_bound": "3668108549962768765"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 15048, "row_count": 100000}, {"avg_size": 28, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 44011, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000}, {"avg_size": 23, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 15297, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000}, {"avg_size": 25, "columns": ["\\"col%v1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 90748, "histo_buckets": [{"distinct_range": 0, "num_eq": 60000, "num_range": 0, "upper_bound": "4ef301aa-ae12-432f-8391-cf9c482eea75"}, {"distinct_range": 3903052228198342000, "num_eq": 5830145869253853508, "num_range": 7556425791316914644, "upper_bound": "6fce8a71-44ba-450c-a7d9-d193b93218be"}, {"distinct_range": 100000, "num_eq": 700000, "num_range": 100000, "upper_bound": "7b4151be-c60f-4974-853a-a634a270872c"}, {"distinct_range": 840630074226581500, "num_eq": 6000000, "num_range": 2474916603261320912, "upper_bound": "beb6a7e4-ee4b-44c1-9985-bf43cd4b3caf"}, {"distinct_range": 0, "num_eq": 6000000, "num_range": 31914698734042403, "upper_bound": "e7d08054-7fda-41f7-818d-d670e99c4896"}, {"distinct_range": 0, "num_eq": 4166728662683453948, "num_range": 351866631151887037, "upper_bound": "f5ad0eb4-0c48-4dc0-a7b0-27c3c20ed442"}], "histo_col_type": "UUID", "name": "__auto__", "null_count": 0, "row_count": 100000}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 0, "columns": ["\\"col%v1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 991916190021845137, "histo_buckets": [{"distinct_range": 0, "num_eq": 278515563779423201, "num_range": 0, "upper_bound": "00000000-0000-0000-0000-000000000000"}, {"distinct_range": 200, "num_eq": 8633149000553349899, "num_range": 200, "upper_bound": "007be0b4-85c2-4d7e-804b-dd9fde26fa3b"}, {"distinct_range": 1718570032184950000, "num_eq": 400, "num_range": 3554030967115423802, "upper_bound": "164736ab-5a44-48a4-afa4-9bba9df2d5cd"}, {"distinct_range": 29.54233433604941, "num_eq": 20, "num_range": 40, "upper_bound": "2712db77-99db-4afb-b14f-f726bf3cd541"}, {"distinct_range": 4222076418548857000, "num_eq": 2551676005879650788, "num_range": 4222076418548856778, "upper_bound": "2d0a88ed-a6c6-4ed9-adf7-d6c46474537b"}, {"distinct_range": 100000, "num_eq": 5638013345024936240, "num_range": 100000, "upper_bound": "7d78b02f-1514-449a-81ee-4f69bd57eb61"}, {"distinct_range": 478557350490983040, "num_eq": 0, "num_range": 478557350490983058, "upper_bound": "de7cc146-9983-4981-b7be-fe4dd08727c8"}, {"distinct_range": 1535582457141753900, "num_eq": 2000, "num_range": 1627355171436622506, "upper_bound": "ffffffff-ffff-ffff-ffff-ffffffffffff"}], "histo_col_type": "UUID", "name": "__auto__", "null_count": 0, "row_count": 2948590845922477002}, {"avg_size": 10, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1677842564069133086, "histo_buckets": [{"distinct_range": 0, "num_eq": 6716823733020530471, "num_range": 0, "upper_bound": "-81 years -11 mons -363 days -18:54:36.466688"}, {"distinct_range": 1426728407102204700, "num_eq": 40000000000, "num_range": 1426728407102204736, "upper_bound": "-63 years -9 mons -959 days -00:23:24.319368"}, {"distinct_range": 8918.480593788177, "num_eq": 6623295159792591421, "num_range": 10000, "upper_bound": "-6 years -9 mons -99 days -23:20:26.239197"}, {"distinct_range": 7632824513788423000, "num_eq": 90000000, "num_range": 7632824513788422862, "upper_bound": "22 years 8 mons 642 days 11:23:13.319333"}, {"distinct_range": 0, "num_eq": 500000, "num_range": 3875129099844806521, "upper_bound": "56 years 9 mons 362 days 10:09:38.180955"}], "histo_col_type": "INTERVAL", "name": "__auto__", "null_count": 0, "row_count": 2948590845922477002}, {"avg_size": 14, "columns": ["\\"col1|_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2343972951262967169, "histo_buckets": [{"distinct_range": 0, "num_eq": 300000, "num_range": 0, "upper_bound": "-4839491864632907468"}, {"distinct_range": 0, "num_eq": 50000, "num_range": 8150838702886113005, "upper_bound": "-3504121907048856359"}, {"distinct_range": 3888143821.4857893, "num_eq": 3326468983378526041, "num_range": 4000000000, "upper_bound": "-1588295546888242540"}, {"distinct_range": 0, "num_eq": 2676351572095403384, "num_range": 20000000, "upper_bound": "-1"}, {"distinct_range": 0, "num_eq": 6613733666684887699, "num_range": 80000, "upper_bound": "380890340639173909"}, {"distinct_range": 83123.98208448877, "num_eq": 0, "num_range": 400000, "upper_bound": "4061629796866668211"}, {"distinct_range": 7192774677405592000, "num_eq": 2000, "num_range": 7192774677405592047, "upper_bound": "4131440217410761061"}, {"distinct_range": 7606179283367745000, "num_eq": 3000000000, "num_range": 7606179283367744404, "upper_bound": "8720981913169785794"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 2570856158652697874, "row_count": 2948590845922477002}, {"avg_size": 27, "columns": ["\\" col1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1370751162782663503, "histo_buckets": [{"distinct_range": 0, "num_eq": 500000, "num_range": 0, "upper_bound": "000010010111101011010100101111011011"}, {"distinct_range": 0, "num_eq": 100000000000, "num_range": 8566104242950567359, "upper_bound": "001001001011100100111111110011100010"}, {"distinct_range": 3359826.379472565, "num_eq": 20000000000, "num_range": 60000000, "upper_bound": "010101011000100111010010000011111011"}, {"distinct_range": 0, "num_eq": 5000000, "num_range": 5867474346866490291, "upper_bound": "011001111101101111001100101011001110"}, {"distinct_range": 0, "num_eq": 1000, "num_range": 10000000, "upper_bound": "100100110100010011011110111101000110"}, {"distinct_range": 6996195928120440000, "num_eq": 30, "num_range": 8474819809482072083, "upper_bound": "111001001000101000111100011100011100"}, {"distinct_range": 203732955.55291322, "num_eq": 4583037106347401597, "num_range": 800000000, "upper_bound": "111001011110111000100000011101010000"}], "histo_col_type": "BIT(36)", "name": "__auto__", "null_count": 0, "row_count": 2948590845922477002}, {"avg_size": 26, "columns": ["col1_\U0001F6296"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2861153455544578344, "histo_buckets": [{"distinct_range": 0, "num_eq": 900000, "num_range": 0, "upper_bound": "\\u0002\'\\u00185\\u001e``\\u00060@"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 2948590845922477002}, {"avg_size": 9, "columns": ["\\"\\n\U0001F611c\u0328ol1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1905303617034685518, "histo_buckets": [{"distinct_range": 0, "num_eq": 5171490210973697564, "num_range": 0, "upper_bound": "-5052014344559823676"}, {"distinct_range": 1000, "num_eq": 7988950715853868613, "num_range": 1000, "upper_bound": "-3262193645600918448"}, {"distinct_range": 6106033760291023000, "num_eq": 80000000000, "num_range": 6106033760291023150, "upper_bound": "-3134663307107090250"}, {"distinct_range": 0, "num_eq": 0, "num_range": 4424013550321535093, "upper_bound": "1874694916434909672"}, {"distinct_range": 504107589761011140, "num_eq": 4606350993324817643, "num_range": 504107589761011127, "upper_bound": "6094395911678111169"}, {"distinct_range": 728934414661270500, "num_eq": 2620891793436054303, "num_range": 5805789036624135899, "upper_bound": "8357520819486517570"}, {"distinct_range": 851790204330671200, "num_eq": 700, "num_range": 851790204330671209, "upper_bound": "9223372036854775807"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 1588874060530678883, "row_count": 2948590845922477002}, {"avg_size": 4, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2444756744154544912, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2948590845922477002}, {"avg_size": 6, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 977550909662052981, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2948590845922477002}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (36.74s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 35b724947ac464e6af45ce5193e34035fcacb1ef:

        postgres_1    |                 postgres.public.t😥able2😥able2_col2_1_key AS tab1065,
        postgres_1    |                 postgres.public.t😥able2 AS "ta'b1066",
        postgres_1    |                 postgres.public.table1 AS ta😐b1067
        postgres_1    |             GROUP BY
        postgres_1    |                 "ta'b1066".col2_2
        postgres_1    |         )
        postgres_1    |             AS "ta.b1068"
        postgres_1    |     ORDER BY
        postgres_1    |         c̼ol1817 ASC NULLS FIRST
        test_1        | --- FAIL: TestCompare (5.69s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (2.09s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare983552245/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare postgres to cockroach1: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("8"),
        test_1        |             +   string("array_agg"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT * FROM (SELECT regproc(8:::OID::OID::OID)::REGPROC AS col1820) AS tab1073 ORDER BY col1820;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT * FROM (SELECT regproc(8::OID::OID::OID)::REGPROC AS col1820) AS tab1073 ORDER BY col1820;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.48s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 BOX2D NOT NULL, col1_1 REGNAMESPACE NULL, col1_2 INET, col1_3 BIT(11) NOT NULL, col1_4 INT8 NULL, col1_5 REGNAMESPACE NULL, col1_6 GEOGRAPHY, "c
ol1_7" VARCHAR, UNIQUE (lower(CAST(col1_2 AS STRING)) ASC) STORING (col1_5, col1_6) WHERE (table1."c
ol1_7" <= '"':::STRING) AND (table1.col1_4 = 0:::INT8), UNIQUE (col1_5 ASC, col1_0 ASC) STORING (col1_3, col1_4, col1_6, "c
ol1_7"), UNIQUE (col1_3 ASC, "c
ol1_7" DESC) STORING (col1_0, col1_1, col1_4, col1_6) WHERE (table1."c
ol1_7" > '':::STRING) OR (table1.col1_4 <= (-2147483648):::INT8), UNIQUE (col1_5 ASC, col1_0 DESC, col1_4 DESC, col1_2) WHERE (table1."c
ol1_7" != '':::STRING) OR (table1.col1_4 > (-32768):::INT8), FAMILY ("c
ol1_7", col1_5), FAMILY (col1_6), FAMILY (col1_1, col1_0), FAMILY (col1_4, col1_2, col1_3));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 17, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1847035148790338287, "histo_col_type": "", "name": "__auto__", "null_count": 5528339006370045583, "row_count": 5686827890244106830}, {"avg_size": 14, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 388745202979331976, "histo_col_type": "", "name": "__auto__", "null_count": 1090483040993070092, "row_count": 5686827890244106830}, {"avg_size": 29, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4088381207773098496, "histo_buckets": [{"distinct_range": 0, "num_eq": 7930979463493312226, "num_range": 0, "upper_bound": "11000000001"}, {"distinct_range": 300000, "num_eq": 1028875548026194937, "num_range": 300000, "upper_bound": "11110101000"}, {"distinct_range": 0, "num_eq": 3249187565284581537, "num_range": 432668542966402193, "upper_bound": "11111111100"}], "histo_col_type": "BIT(11)", "name": "__auto__", "null_count": 0, "row_count": 5686827890244106830}, {"avg_size": 1, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2012335672334679673, "histo_col_type": "", "name": "__auto__", "null_count": 2237087598914324218, "row_count": 5686827890244106830}, {"avg_size": 14, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2277005104124615481, "histo_buckets": [{"distinct_range": 0, "num_eq": 800000, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 0, "num_eq": 6038266850826608699, "num_range": 8000, "upper_bound": "345062065"}, {"distinct_range": 2216434152.135922, "num_eq": 70000, "num_range": 7000000000, "upper_bound": "421750884"}, {"distinct_range": 2805440272430989300, "num_eq": 3975788213259593664, "num_range": 3749736898155089906, "upper_bound": "622070067"}, {"distinct_range": 600000000, "num_eq": 0, "num_range": 600000000, "upper_bound": "1283768681"}, {"distinct_range": 0, "num_eq": 1911926245655721686, "num_range": 645277848364608469, "upper_bound": "1348464670"}], "histo_col_type": "REGNAMESPACE", "name": "__auto__", "null_count": 1358061960058001118, "row_count": 5686827890244106830}, {"avg_size": 8, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4396044765681061991, "histo_col_type": "", "name": "__auto__", "null_count": 921618660169789170, "row_count": 5686827890244106830}, {"avg_size": 18, "columns": ["\\"c\\rol1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3606663420987975432, "histo_col_type": "", "name": "__auto__", "null_count": 3839173382098593264, "row_count": 5686827890244106830}, {"avg_size": 16, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 262451977409806693, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5686827890244106830}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 10, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 918476598276467854, "histo_col_type": "", "name": "__auto__", "null_count": 1541128307861613012, "row_count": 2194572194111782969}, {"avg_size": 28, "columns": ["\\"c\\rol1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1387424835531112909, "histo_col_type": "", "name": "__auto__", "null_count": 1147359098716513136, "row_count": 2194572194111782969}, {"avg_size": 31, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2072429602606117393, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2194572194111782969}, {"avg_size": 12, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1484405440774747357, "histo_col_type": "", "name": "__auto__", "null_count": 1529981317235963465, "row_count": 2194572194111782969}, {"avg_size": 25, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2102782953894913556, "histo_col_type": "", "name": "__auto__", "null_count": 157500527835096228, "row_count": 2194572194111782969}, {"avg_size": 18, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1081345364271525119, "histo_buckets": [{"distinct_range": 0, "num_eq": 1313699879508352139, "num_range": 0, "upper_bound": "00001010011"}, {"distinct_range": 7000000000, "num_eq": 40000000, "num_range": 7000000000, "upper_bound": "00010001101"}, {"distinct_range": 34.675768711950525, "num_eq": 4210637106212567050, "num_range": 40, "upper_bound": "01010110111"}, {"distinct_range": 3253474698540597000, "num_eq": 7690638364043231029, "num_range": 3253474698540597065, "upper_bound": "01111111111"}, {"distinct_range": 65055.15300240976, "num_eq": 0, "num_range": 200000, "upper_bound": "10000011010"}, {"distinct_range": 0, "num_eq": 300, "num_range": 700, "upper_bound": "10010101010"}, {"distinct_range": 3833201779416763400, "num_eq": 70000000, "num_range": 3833201779416763460, "upper_bound": "11001111110"}], "histo_col_type": "BIT(11)", "name": "__auto__", "null_count": 0, "row_count": 2194572194111782969}, {"avg_size": 0, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1085129849533120809, "histo_col_type": "", "name": "__auto__", "null_count": 1056380191053933544, "row_count": 2194572194111782969}, {"avg_size": 9, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1990413335629561713, "histo_buckets": [{"distinct_range": 0, "num_eq": 50, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 0, "num_eq": 3000000000, "num_range": 7336233250599518286, "upper_bound": "2388342009"}, {"distinct_range": 0, "num_eq": 20000000, "num_range": 5705400023892539156, "upper_bound": "3671781666"}], "histo_col_type": "REGNAMESPACE", "name": "__auto__", "null_count": 434332049728528203, "row_count": 2194572194111782969}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.86s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ e847e4358c004d4a8977ae26749768ad1d417fba:

        test_1        |             -   string("array_agg"),
        test_1        |             +   string("9"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         CASE WHEN true::BOOL THEN NULL::DATE ELSE '2000-01-06':::DATE::DATE END AS "c o)l775",
        test_1        |                         regproc(int4(int4(9:::INT8::INT4::INT4)::INT4::INT4)::INT4::INT4)::REGPROC AS "c�olͥ776"
        test_1        |                 )
        test_1        |                     AS "ta b502"
        test_1        |             ORDER BY
        test_1        |                 "c o)l775" DESC NULLS LAST, "c�olͥ776" ASC NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         CASE WHEN true::BOOL THEN NULL::DATE ELSE '2000-01-06'::DATE::DATE END AS "c o)l775",
        test_1        |                         regproc(int4(int4(9::INT8::INT4::INT4)::INT4::INT4)::INT4::INT4)::REGPROC AS "c�olͥ776"
        test_1        |                 )
        test_1        |                     AS "ta b502"
        test_1        |             ORDER BY
        test_1        |                 "c o)l775" DESC NULLS LAST, "c�olͥ776" ASC NULLS LAST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.51s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "%ptabl{e\\u7C6B  1" ("col1_%q0" STRING NOT NULL, col1_1 REGCLASS NULL, col1_2 TIMESTAMPTZ NOT NULL, "col1_͏\n3" CHAR NOT NULL, PRIMARY KEY ("col1_%q0" DESC), FAMILY ("col1_͏\n3"), FAMILY ("col1_%q0"), FAMILY (col1_2), FAMILY (col1_1));
        test_1        |             ALTER TABLE "%ptabl{e\\u7C6B    1" INJECT STATISTICS e'[{"avg_size": 14, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1709492916425026829, "histo_col_type": "", "name": "__auto__", "null_count": 801690239362232398, "row_count": 3394560405968028283}, {"avg_size": 6, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 278943109809980918, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3394560405968028283}, {"avg_size": 29, "columns": ["\\"col1_\u034F\\\\n3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1827151632603258879, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3394560405968028283}, {"avg_size": 29, "columns": ["\\"col1_%q0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2182905268590924964, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3394560405968028283}]':::JSONB;
        test_1        |             ALTER TABLE "%ptabl{e\\u7C6B    1" INJECT STATISTICS e'[{"avg_size": 18, "columns": ["\\"col1_%q0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1707277419027573908, "histo_buckets": [{"distinct_range": 0, "num_eq": 200, "num_range": 0, "upper_bound": "\\u001cb"}, {"distinct_range": 311.2381964832185, "num_eq": 7930446808005861348, "num_range": 500, "upper_bound": "c"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 8048483554758195529}, {"avg_size": 6, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1712383230516924406, "histo_col_type": "", "name": "__auto__", "null_count": 5307041719240511764, "row_count": 8048483554758195529}, {"avg_size": 8, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2811082743288187886, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8048483554758195529}, {"avg_size": 19, "columns": ["\\"col1_\u034F\\\\n3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6346459819900174536, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8048483554758195529}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.34s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ b432e8c20339de5cfa7c811a9ee6f5dc98d15a1e:

        postgres_1    | 2023-04-06 05:18:20.120 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-06 05:18:20.120 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-06 05:18:20.124 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-06 05:18:20.129 UTC [68] LOG:  database system was shut down at 2023-04-06 05:18:19 UTC
        postgres_1    | 2023-04-06 05:18:20.134 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-06 05:18:22.025 UTC [78] ERROR:  collation "en" for encoding "UTF8" does not exist at character 52
        postgres_1    | 2023-04-06 05:18:22.025 UTC [78] STATEMENT:  CREATE TABLE table3 (cͣol3_0 INTERVAL, col3_1 TEXT COLLATE en NOT NULL, col3_2 DATE NULL, col3_3 DECIMAL NULL, "col{3_4" UUID NOT NULL, "c�ol😼3_5" INTERVAL NOT NULL, col3_6 TIMESTAMP NOT NULL, "col3_\g7" GEOMETRY NULL, col3_8 VARCHAR NOT NULL, col̲3_9 "char" NOT NULL, col3😟_10 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "c�ol😼3_5" IS NULL THEN e'\''::TEXT ELSE 'odx'::TEXT END) STORED, co͞l3_11 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "c�ol😼3_5" IS NULL THEN e'?\x14\x18'::TEXT ELSE ''::TEXT END) STORED, PRIMARY KEY ("c�ol😼3_5", col3_6, col3_8, col3😟_10, col̲3_9));
        postgres_1    |     CREATE INDEX ON table3 (col3_3, col3_8 ASC) INCLUDE (cͣol3_0, col3_1, "col{3_4", "col3_\g7");
        postgres_1    |     CREATE UNIQUE INDEX ON table3 ("col{3_4", cͣol3_0 DESC, col3😟_10 ASC, col3_6, co͞l3_11 ASC, col̲3_9, "c�ol😼3_5" ASC) INCLUDE (col3_1, col3_3);
        postgres_1    |     CREATE INDEX ON table3 (cͣol3_0 ASC, co͞l3_11 DESC, col3_6 ASC, col̲3_9, col3_3 ASC, col3_8, lower(CAST("col3_\g7" AS TEXT)), "col{3_4" ASC) INCLUDE ("col3_\g7");
        postgres_1    |     CREATE UNIQUE INDEX ON table3 (col3_6, col3_2 DESC, cͣol3_0 ASC, co͞l3_11 DESC, col3_3 DESC, col̲3_9 ASC, col3😟_10, col3_8 ASC);
        postgres_1    |     CREATE INDEX ON table3 ("c�ol😼3_5" ASC, col3😟_10 DESC, col3_1 ASC, col3_8, col3_2 DESC, col3_6 DESC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.90s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.02s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table3 (cͣol3_0 INTERVAL, col3_1 TEXT COLLATE en NOT NULL, col3_2 DATE NULL, col3_3 DECIMAL NULL, "col{3_4" UUID NOT NULL, "c�ol😼3_5" INTERVAL NOT NULL, col3_6 TIMESTAMP NOT NULL, "col3_\g7" GEOMETRY NULL, col3_8 VARCHAR NOT NULL, col̲3_9 "char" NOT NULL, col3😟_10 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "c�ol😼3_5" IS NULL THEN e'\''::TEXT ELSE 'odx'::TEXT END) STORED, co͞l3_11 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "c�ol😼3_5" IS NULL THEN e'?\x14\x18'::TEXT ELSE ''::TEXT END) STORED, PRIMARY KEY ("c�ol😼3_5", col3_6, col3_8, col3😟_10, col̲3_9));
        test_1        |             CREATE INDEX ON table3 (col3_3, col3_8 ASC) INCLUDE (cͣol3_0, col3_1, "col{3_4", "col3_\g7");
        test_1        |             CREATE UNIQUE INDEX ON table3 ("col{3_4", cͣol3_0 DESC, col3😟_10 ASC, col3_6, co͞l3_11 ASC, col̲3_9, "c�ol😼3_5" ASC) INCLUDE (col3_1, col3_3);
        test_1        |             CREATE INDEX ON table3 (cͣol3_0 ASC, co͞l3_11 DESC, col3_6 ASC, col̲3_9, col3_3 ASC, col3_8, lower(CAST("col3_\g7" AS TEXT)), "col{3_4" ASC) INCLUDE ("col3_\g7");
        test_1        |             CREATE UNIQUE INDEX ON table3 (col3_6, col3_2 DESC, cͣol3_0 ASC, co͞l3_11 DESC, col3_3 DESC, col̲3_9 ASC, col3😟_10, col3_8 ASC);
        test_1        |             CREATE INDEX ON table3 ("c�ol😼3_5" ASC, col3😟_10 DESC, col3_1 ASC, col3_8, col3_2 DESC, col3_6 DESC);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "en" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.75s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE tabl̯e1 ("col1""_0" INET NOT NULL, "col1_ 1" DECIMAL NULL, "col1�_2" TSVECTOR NOT NULL, col1_3 BIT(20) NULL, "Col1_4" INTERVAL NOT NULL, "c ol1_5" TIME NOT NULL, col1_6 BYTES, col1_7 INET NOT NULL, col1_8 INT4 NOT NULL, col1_9 NAME NULL, INDEX (col1_8 DESC) STORING ("col1""_0", "col1_ 1", col1_3, "Col1_4", "c ol1_5", col1_6) WHERE tabl̯e1."c ol1_5" < '00:00:00':::TIME, INDEX (col1_3 DESC, col1_7 DESC) WHERE ((((tabl̯e1.col1_8 >= (-1):::INT8) OR (tabl̯e1.col1_6 > e'\\xff':::BYTES)) AND (tabl̯e1."c ol1_5" != '00:00:00':::TIME)) AND (tabl̯e1."col1_ 1" != '-Infinity':::DECIMAL)) AND (tabl̯e1.col1_9 = '"':::STRING:::NAME), FAMILY ("Col1_4", col1_7), FAMILY ("col1""_0", col1_6, "col1_ 1", col1_9, "c ol1_5"), FAMILY (col1_3, col1_8), FAMILY ("col1�_2"));
        test_1        |             ALTER TABLE tabl̯e1 INJECT STATISTICS e'[{"avg_size": 11, "columns": ["\\"c ol1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80}, {"avg_size": 0, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 37, "histo_col_type": "", "name": "__auto__", "null_count": 36, "row_count": 80}, {"avg_size": 25, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 28, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80}, {"avg_size": 22, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 19, "histo_col_type": "", "name": "__auto__", "null_count": 70, "row_count": 80}, {"avg_size": 9, "columns": ["\\"col1\\u000b_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 64, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80}, {"avg_size": 28, "columns": ["\\"col1_ 1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 41, "histo_col_type": "", "name": "__auto__", "null_count": 72, "row_count": 80}, {"avg_size": 2, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 59, "histo_buckets": [{"distinct_range": 0, "num_eq": 200, "num_range": 0, "upper_bound": "10010111010011000111"}, {"distinct_range": 800000000, "num_eq": 40000, "num_range": 800000000, "upper_bound": "11001111010000011010"}, {"distinct_range": 1183598345044806100, "num_eq": 8000000, "num_range": 1183598345044806253, "upper_bound": "11100110110010011010"}], "histo_col_type": "BIT(20)", "name": "__auto__", "null_count": 76, "row_count": 80}, {"avg_size": 21, "columns": ["\\"Col1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80}, {"avg_size": 10, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 9, "histo_col_type": "INT4", "name": "__auto__", "null_count": 0, "row_count": 80}, {"avg_size": 18, "columns": ["\\"col1\\"\\"_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80}]':::JSONB;
        test_1        |             ALTER TABLE tabl̯e1 INJECT STATISTICS e'[{"avg_size": 16, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4021274469227969507, "histo_col_type": "", "name": "__auto__", "null_count": 432362734529584487, "row_count": 4265075464307950647}, {"avg_size": 20, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4061401657177578667, "histo_col_type": "", "name": "__auto__", "null_count": 1266331009884131117, "row_count": 4265075464307950647}, {"avg_size": 0, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3151895220365332094, "histo_col_type": "", "name": "__auto__", "null_count": 4223766087809955469, "row_count": 4265075464307950647}, {"avg_size": 29, "columns": ["\\"col1\\"\\"_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2625207363403576198, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4265075464307950647}, {"avg_size": 26, "columns": ["\\"col1_ 1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 775416901200586124, "histo_col_type": "", "name": "__auto__", "null_count": 353012072217361226, "row_count": 4265075464307950647}, {"avg_size": 28, "columns": ["\\"col1\\u000b_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3901199294348413529, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4265075464307950647}, {"avg_size": 26, "columns": ["\\"Col1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 616858112410602135, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4265075464307950647}, {"avg_size": 16, "columns": ["\\"c ol1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 595243794409095692, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4265075464307950647}, {"avg_size": 18, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1660161156738151597, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4265075464307950647}, {"avg_size": 0, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3154199714702126757, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4265075464307950647}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (21.48s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ af5e6abf7efbb1361252839703e3ef8e067c9410:

        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-07 05:14:59.389 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-07 05:14:59.389 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-07 05:14:59.389 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-07 05:14:59.393 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-07 05:14:59.397 UTC [68] LOG:  database system was shut down at 2023-04-07 05:14:59 UTC
        postgres_1    | 2023-04-07 05:14:59.401 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-07 05:15:00.773 UTC [78] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2023-04-07 05:15:00.773 UTC [78] STATEMENT:  CREATE TABLE table4 (col4_0 INT8[] NULL, "col🙀4\\U000A1D1F_%v1" NAME NOT NULL, c😦ol4_2 INT2 NOT NULL, col4_3 REGCLASS NULL, "\\u2CC4col%q4_4" TIMETZ NULL, col4_5 INT4 NULL, col4_6 FLOAT4 NOT NULL, "col4_%v7" OID NULL, col4_8 GEOMETRY NOT NULL, "c%qol4_\\U000ED5009" BYTEA NOT NULL, col4_10 OID, col4_11 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col4_3 IS NULL THEN e'\'c\'E'::TEXT ELSE e'\x00'::TEXT END) STORED, col4_12 INT8 NULL GENERATED ALWAYS AS (c😦ol4_2 + col4_5) STORED, PRIMARY KEY (col4_11));
        postgres_1    |     CREATE INDEX ON table4 (col4_5 ASC, (col4_5 + c😦ol4_2) DESC) INCLUDE ("col🙀4\\U000A1D1F_%v1", c😦ol4_2, col4_3, col4_6, "col4_%v7", col4_10);
        postgres_1    |     CREATE UNIQUE INDEX ON table4 (c😦ol4_2) INCLUDE (col4_0, "col🙀4\\U000A1D1F_%v1", col4_3, "\\u2CC4col%q4_4", "col4_%v7", col4_8, col4_10);
        postgres_1    |     CREATE UNIQUE INDEX ON table4 (col4_10, col4_11 DESC, col4_0 DESC, col4_6 ASC, col4_5, "col4_%v7" DESC, c😦ol4_2, col4_3) INCLUDE ("\\u2CC4col%q4_4", col4_8);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (4.55s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.83s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table4 (col4_0 INT8[] NULL, "col🙀4\\U000A1D1F_%v1" NAME NOT NULL, c😦ol4_2 INT2 NOT NULL, col4_3 REGCLASS NULL, "\\u2CC4col%q4_4" TIMETZ NULL, col4_5 INT4 NULL, col4_6 FLOAT4 NOT NULL, "col4_%v7" OID NULL, col4_8 GEOMETRY NOT NULL, "c%qol4_\\U000ED5009" BYTEA NOT NULL, col4_10 OID, col4_11 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col4_3 IS NULL THEN e'\'c\'E'::TEXT ELSE e'\x00'::TEXT END) STORED, col4_12 INT8 NULL GENERATED ALWAYS AS (c😦ol4_2 + col4_5) STORED, PRIMARY KEY (col4_11));
        test_1        |             CREATE INDEX ON table4 (col4_5 ASC, (col4_5 + c😦ol4_2) DESC) INCLUDE ("col🙀4\\U000A1D1F_%v1", c😦ol4_2, col4_3, col4_6, "col4_%v7", col4_10);
        test_1        |             CREATE UNIQUE INDEX ON table4 (c😦ol4_2) INCLUDE (col4_0, "col🙀4\\U000A1D1F_%v1", col4_3, "\\u2CC4col%q4_4", "col4_%v7", col4_8, col4_10);
        test_1        |             CREATE UNIQUE INDEX ON table4 (col4_10, col4_11 DESC, col4_0 DESC, col4_6 ASC, col4_5, "col4_%v7" DESC, c😦ol4_2, col4_3) INCLUDE ("\\u2CC4col%q4_4", col4_8);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        |     --- FAIL: TestCompare/mutators (0.59s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "ta""ble1" (col1_0 TSQUERY, col1_1 INET NULL, "col1\\u8895_2" INTERVAL, "c\fol1_3" FLOAT4 NOT NULL, col1_4 TIME NOT NULL, col1_5 REGCLASS NULL, "c""ol1_6" TIMESTAMPTZ NOT NULL, col1_7 BYTES NOT NULL, col1_8 REGROLE, "col1_\g9" FLOAT8 NOT NULL AS ("c\fol1_3" + (-0.09418047219514847):::FLOAT8) VIRTUAL, col1_10 FLOAT8 NOT NULL AS ("c\fol1_3" + (-0.08344773203134537):::FLOAT8) STORED, FAMILY (col1_4), FAMILY (col1_7), FAMILY (col1_1), FAMILY (col1_5), FAMILY ("col1\\u8895_2", col1_8, "c""ol1_6", "c\fol1_3"), FAMILY (col1_10), FAMILY (col1_0));
        test_1        |             ALTER TABLE "ta""ble1" INJECT STATISTICS e'[{"avg_size": 27, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 48597420030, "histo_col_type": "", "name": "__auto__", "null_count": 37464356666, "row_count": 100000000000}, {"avg_size": 21, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 41078114659, "histo_col_type": "", "name": "__auto__", "null_count": 17688443140, "row_count": 100000000000}, {"avg_size": 30, "columns": ["\\"col1\\\\\\\\u8895_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 87633127146, "histo_col_type": "", "name": "__auto__", "null_count": 77561968765, "row_count": 100000000000}, {"avg_size": 23, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 81055658589, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000000}, {"avg_size": 2, "columns": ["\\"c\\"\\"ol1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6553325073, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000000}, {"avg_size": 15, "columns": ["\\"col1_\\\\g9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3260260735, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000000}, {"avg_size": 31, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 95450188279, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000000}, {"avg_size": 30, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 84624729427, "histo_col_type": "", "name": "__auto__", "null_count": 15042609203, "row_count": 100000000000}, {"avg_size": 28, "columns": ["\\"c\\\\fol1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 96777518139, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000000}, {"avg_size": 22, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 62830593408, "histo_col_type": "", "name": "__auto__", "null_count": 56744941327, "row_count": 100000000000}, {"avg_size": 11, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 49495834451, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000000}]':::JSONB;
        test_1        |             ALTER TABLE "ta""ble1" INJECT STATISTICS e'[{"avg_size": 15, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 57422483, "histo_col_type": "", "name": "__auto__", "null_count": 17174740, "row_count": 100000000}, {"avg_size": 10, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 31878958, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 27, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 28317359, "histo_col_type": "", "name": "__auto__", "null_count": 60357449, "row_count": 100000000}, {"avg_size": 23, "columns": ["\\"c\\"\\"ol1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 63819566, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 30, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 71273182, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 18, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 43264325, "histo_col_type": "", "name": "__auto__", "null_count": 74856760, "row_count": 100000000}, {"avg_size": 1, "columns": ["\\"col1_\\\\g9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 31859526, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 29, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 26914334, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}, {"avg_size": 24, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 53674502, "histo_col_type": "", "name": "__auto__", "null_count": 98612127, "row_count": 100000000}, {"avg_size": 16, "columns": ["\\"col1\\\\\\\\u8895_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 91042688, "histo_col_type": "", "name": "__auto__", "null_count": 6521475, "row_count": 100000000}, {"avg_size": 1, "columns": ["\\"c\\\\fol1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 35933202, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (18.30s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ de239a7438f44d382c9aefceb65d9c39911dabd2:

        postgres_1    | 2023-04-08 05:15:44.327 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-08 05:15:46.155 UTC [78] ERROR:  collation "da" for encoding "UTF8" does not exist at character 34
        postgres_1    | 2023-04-08 05:15:46.155 UTC [78] STATEMENT:  CREATE TABLE table2 (col2_0 TEXT COLLATE da NOT NULL, col2_1 VARCHAR NOT NULL, PRIMARY KEY (col2_1));
        postgres_1    |     CREATE INDEX ON table2 (col2_0 DESC);
        postgres_1    |     CREATE INDEX ON table2 (col2_1 ASC, lower(CAST(col2_0 AS TEXT)));
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_1 ASC, col2_0);
        postgres_1    |     CREATE INDEX ON table2 (col2_1 DESC, lower(col2_1) DESC);
        postgres_1    |     CREATE INDEX ON table2 (lower(col2_1) ASC, col2_1) INCLUDE (col2_0);
        postgres_1    |     CREATE INDEX ON table2 (lower(CAST(col2_0 AS TEXT)) ASC, col2_0);
        postgres_1    |     CREATE INDEX ON table2 (col2_0);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (4.33s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/mutators (0.37s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 ("c%pol1_0" CHAR NOT NULL, col1_1 TIMESTAMP NOT NULL, col1_2 BYTES NOT NULL, "col""1_�3" DECIMAL NULL, "col'1😞_4" INT4 NOT NULL, col1_5 TIMESTAMP NOT NULL, "col1\\u9391_6" BOX2D, col1_7 DECIMAL, col1_8 NAME NOT NULL, col1_9 GEOMETRY, "'col1_10" TIMESTAMP NOT NULL, col1_11 TIME NOT NULL, col1_12 TIMESTAMP, PRIMARY KEY (col1_1 DESC, "c%pol1_0" ASC, "col'1😞_4", col1_8 DESC, col1_5 DESC, "'col1_10" ASC), FAMILY ("col1\\u9391_6"), FAMILY (col1_11), FAMILY ("'col1_10", col1_2), FAMILY (col1_5, "c%pol1_0"), FAMILY ("col""1_�3"), FAMILY (col1_7, col1_12), FAMILY ("col'1😞_4"), FAMILY (col1_9), FAMILY (col1_1), FAMILY (col1_8));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 15, "columns": ["\\"\'col1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 942755312741890946, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1406674273387954104}, {"avg_size": 21, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1254197705715001529, "histo_col_type": "", "name": "__auto__", "null_count": 473166166200145323, "row_count": 1406674273387954104}, {"avg_size": 26, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 338325890621662918, "histo_buckets": [{"distinct_range": 0, "num_eq": 30000000, "num_range": 0, "upper_bound": "1976-09-25 10:48:55.00036"}, {"distinct_range": 7683665516498276000, "num_eq": 81390418415420757, "num_range": 7683665516498276690, "upper_bound": "1988-01-25 14:56:00.000082"}, {"distinct_range": 283341138754664640, "num_eq": 90000000, "num_range": 4271483085381499692, "upper_bound": "1993-08-28 04:32:00.000261"}, {"distinct_range": 90, "num_eq": 20, "num_range": 90, "upper_bound": "2002-07-17 20:27:06.000453"}, {"distinct_range": 2139585655.999019, "num_eq": 70000000, "num_range": 3000000000, "upper_bound": "2020-01-23 10:59:22.000378"}, {"distinct_range": 0, "num_eq": 6133424919931246688, "num_range": 50000000000, "upper_bound": "2021-04-17 21:19:55.00018"}, {"distinct_range": 15451814983.627718, "num_eq": 60000000000, "num_range": 20000000000, "upper_bound": "3000-01-01 00:00:00"}], "histo_col_type": "TIMESTAMP", "name": "__auto__", "null_count": 0, "row_count": 1406674273387954104}, {"avg_size": 23, "columns": ["\\"col\'1\U0001F61E_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 90543441844742416, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1406674273387954104}, {"avg_size": 15, "columns": ["\\"col1\\\\\\\\u9391_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1225416798378825957, "histo_col_type": "", "name": "__auto__", "null_count": 904037267639376949, "row_count": 1406674273387954104}, {"avg_size": 4, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1083736591978844560, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1406674273387954104}, {"avg_size": 26, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3764241036511276, "histo_col_type": "", "name": "__auto__", "null_count": 1004722672816551728, "row_count": 1406674273387954104}, {"avg_size": 10, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1025075448643732278, "histo_col_type": "", "name": "__auto__", "null_count": 342506977485968603, "row_count": 1406674273387954104}, {"avg_size": 23, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 375000410348627132, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1406674273387954104}, {"avg_size": 28, "columns": ["\\"c%pol1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 311992263497236412, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1406674273387954104}, {"avg_size": 2, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 381567545651833701, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1406674273387954104}, {"avg_size": 3, "columns": ["\\"col\\"\\"1_\\u000b3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 752458975336170379, "histo_col_type": "", "name": "__auto__", "null_count": 771498438942919069, "row_count": 1406674273387954104}, {"avg_size": 3, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 72158261352934810, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1406674273387954104}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 6, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 373245455109634846, "histo_buckets": [{"distinct_range": 0, "num_eq": 600000000, "num_range": 0, "upper_bound": "1972-09-25 04:32:59.000886"}, {"distinct_range": 0, "num_eq": 1349002917046192064, "num_range": 2956786603892715342, "upper_bound": "2002-12-03 19:31:33.000662"}], "histo_col_type": "TIMESTAMP", "name": "__auto__", "null_count": 0, "row_count": 781839415004403942}, {"avg_size": 31, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 347529341881986877, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 781839415004403942}, {"avg_size": 2, "columns": ["\\"col\'1\U0001F61E_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 10353439524397186, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 781839415004403942}, {"avg_size": 27, "columns": ["\\"\'col1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 125474627048704739, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 781839415004403942}, {"avg_size": 0, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 685209499754296969, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 781839415004403942}, {"avg_size": 17, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 185543611389253828, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 781839415004403942}, {"avg_size": 20, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 100020099829035125, "histo_col_type": "", "name": "__auto__", "null_count": 645571825751264632, "row_count": 781839415004403942}, {"avg_size": 1, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 260584731472668, "histo_col_type": "", "name": "__auto__", "null_count": 37585085017754043, "row_count": 781839415004403942}, {"avg_size": 9, "columns": ["\\"c%pol1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 512225754973221065, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 781839415004403942}, {"avg_size": 16, "columns": ["\\"col\\"\\"1_\\u000b3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 579800414820455123, "histo_col_type": "", "name": "__auto__", "null_count": 346078638752682500, "row_count": 781839415004403942}, {"avg_size": 18, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 40436943003800880, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 781839415004403942}, {"avg_size": 25, "columns": ["\\"col1\\\\\\\\u9391_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 529709471893070051, "histo_col_type": "", "name": "__auto__", "null_count": 5659916165845098, "row_count": 781839415004403942}, {"avg_size": 4, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 693549808189681740, "histo_col_type": "", "name": "__auto__", "null_count": 379587478229340000, "row_count": 781839415004403942}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        |     --- FAIL: TestCompare/postgres (0.85s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table2 (col2_0 TEXT COLLATE da NOT NULL, col2_1 VARCHAR NOT NULL, PRIMARY KEY (col2_1));
        test_1        |             CREATE INDEX ON table2 (col2_0 DESC);
        test_1        |             CREATE INDEX ON table2 (col2_1 ASC, lower(CAST(col2_0 AS TEXT)));
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_1 ASC, col2_0);
        test_1        |             CREATE INDEX ON table2 (col2_1 DESC, lower(col2_1) DESC);
        test_1        |             CREATE INDEX ON table2 (lower(col2_1) ASC, col2_1) INCLUDE (col2_0);
        test_1        |             CREATE INDEX ON table2 (lower(CAST(col2_0 AS TEXT)) ASC, col2_0);
        test_1        |             CREATE INDEX ON table2 (col2_0);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "da" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (17.78s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ de239a7438f44d382c9aefceb65d9c39911dabd2:

        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/mutators (0.00s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        | panic: geos: no locations to init GEOS [recovered]
        test_1        |     panic: geos: no locations to init GEOS
        test_1        | 
        test_1        | goroutine 51 [running]:
        test_1        | testing.tRunner.func1.2({0x225b2a0, 0xc0020b6a80})
        test_1        |     GOROOT/src/testing/testing.go:1396 +0x24e
        test_1        | testing.tRunner.func1()
        test_1        |     GOROOT/src/testing/testing.go:1399 +0x39f
        test_1        | panic({0x225b2a0, 0xc0020b6a80})
        test_1        |     GOROOT/src/runtime/panic.go:884 +0x212
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.encodeInvertedIndexHistogramUpperBounds(0x44ef000?, {0x3143248?, 0xc001fb0900?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:377 +0x445
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.randHistogram(0x3109440?, 0x44ef000)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:310 +0x13c
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator.func1(0xc0020aa000)
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:227 +0x96
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.statisticsMutator(0xc00203cf90, {0xc002045440?, 0x4, 0xc00005fc38?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:260 +0x71f
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.MultiStatementMutation.Mutate(0xc002063968?, 0x245581f?, {0xc002045440?, 0x209c880?, 0x1?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/mutator.go:98 +0x2e
        test_1        | github.com/cockroachdb/cockroach/pkg/sql/randgen.RandCreateTables(0x209c880?, {0x245581f, 0x5}, 0x4, 0x0?, {0xc0000e1a48, 0x3, 0x483e720?})
        test_1        |     github.com/cockroachdb/cockroach/pkg/sql/randgen/schema.go:93 +0x16a
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTablesN(0x1?, 0x60a1a0?, {0x0, 0x0})
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:104 +0x194
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.randTables(0xc000282000?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:84 +0x37
        test_1        | github.com/cockroachdb/cockroach/pkg/internal/sqlsmith.wrapCommonSetup.func1(0xc001f72b60?)
        test_1        |     github.com/cockroachdb/cockroach/pkg/internal/sqlsmith/setup.go:51 +0x22
        test_1        | github.com/cockroachdb/cockroach/pkg/compose/compare/compare.TestCompare.func2(0xc001f72b60)
        test_1        |     github.com/cockroachdb/cockroach/pkg/compose/compare/compare/compare_test.go:141 +0xe5
        test_1        | testing.tRunner(0xc001f72b60, 0xc00203cf00)
        test_1        |     GOROOT/src/testing/testing.go:1446 +0x10b
        test_1        | created by testing.(*T).Run
        test_1        |     GOROOT/src/testing/testing.go:1493 +0x35f
        compare_test_1 exited with code 2
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach1_1 ... done
        Stopping compare_cockroach2_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 2
--- FAIL: TestComposeCompare (19.14s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 2f96695f75b07c872ec5f146acc1fa198135768f:

        postgres_1    | .2023-04-10 05:19:01.879 UTC [49] LOG:  aborting any active transactions
        postgres_1    | 2023-04-10 05:19:01.881 UTC [49] LOG:  background worker "logical replication launcher" (PID 56) exited with exit code 1
        postgres_1    | 2023-04-10 05:19:01.883 UTC [51] LOG:  shutting down
        postgres_1    | 2023-04-10 05:19:01.983 UTC [49] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-10 05:19:02.100 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-10 05:19:02.100 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-10 05:19:02.100 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-10 05:19:02.104 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-10 05:19:02.110 UTC [68] LOG:  database system was shut down at 2023-04-10 05:19:01 UTC
        postgres_1    | 2023-04-10 05:19:02.115 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-10 05:19:03.258 UTC [78] ERROR:  syntax error at or near "DESC" at character 477
        postgres_1    | 2023-04-10 05:19:03.258 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 BOOL NULL, col1_😙1 INT4 NOT NULL, "col1😴_'2" INT4 NOT NULL, "col\v1_3" "char" NOT NULL, "col""1_4" VARCHAR NOT NULL, col1_5 VARCHAR NOT NULL, col1😿_6 DECIMAL NOT NULL, "  col1_7" BOOL NOT NULL, col1_8 DATE NOT NULL, col1_9 BIT(24) NOT NULL, col1_10 BIT(18)[] NOT NULL, "co l1_11" JSONB NOT NULL, col1_12 BIT(13) NULL, col😽1_13 TSQUERY NULL, "col1\\uE2A8_14" TEXT NULL GENERATED ALWAYS AS (lower(CAST(col1_0 AS TEXT))) STORED, INVERTED INDEX (col1_9 DESC, "col1😴_'2" DESC, col1_5 DESC, col1_8, (col1_😙1 + "col1😴_'2") ASC, lower(CAST("  col1_7" AS TEXT)) DESC, col1_0, col1_10 DESC, "col""1_4" ASC, "col1\\uE2A8_14" ASC, "   col1_7" ASC, "col\v1_3" ASC, "co l1_11" ASC) WHERE ((((((((table1.col1_😙1 <= 127::INT8) AND table1."    col1_7") AND (table1."col""1_4" < e'\x00'::TEXT)) AND (table1.col1😿_6 <= 1::DECIMAL)) AND (NOT table1.col1_0)) OR (table1."col1😴_'2" >= 0::INT8)) AND (table1."col1\\uE2A8_14" <= '"'::TEXT)) OR (table1.col1_5 = e'\U00002603'::TEXT)) AND (table1.col1_8 >= '5874897-12-31'::DATE));
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (4.98s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.11s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 BOOL NULL, col1_😙1 INT4 NOT NULL, "col1😴_'2" INT4 NOT NULL, "col\v1_3" "char" NOT NULL, "col""1_4" VARCHAR NOT NULL, col1_5 VARCHAR NOT NULL, col1😿_6 DECIMAL NOT NULL, "  col1_7" BOOL NOT NULL, col1_8 DATE NOT NULL, col1_9 BIT(24) NOT NULL, col1_10 BIT(18)[] NOT NULL, "co l1_11" JSONB NOT NULL, col1_12 BIT(13) NULL, col😽1_13 TSQUERY NULL, "col1\\uE2A8_14" TEXT NULL GENERATED ALWAYS AS (lower(CAST(col1_0 AS TEXT))) STORED, INVERTED INDEX (col1_9 DESC, "col1😴_'2" DESC, col1_5 DESC, col1_8, (col1_😙1 + "col1😴_'2") ASC, lower(CAST("  col1_7" AS TEXT)) DESC, col1_0, col1_10 DESC, "col""1_4" ASC, "col1\\uE2A8_14" ASC, "   col1_7" ASC, "col\v1_3" ASC, "co l1_11" ASC) WHERE ((((((((table1.col1_😙1 <= 127::INT8) AND table1."    col1_7") AND (table1."col""1_4" < e'\x00'::TEXT)) AND (table1.col1😿_6 <= 1::DECIMAL)) AND (NOT table1.col1_0)) OR (table1."col1😴_'2" >= 0::INT8)) AND (table1."col1\\uE2A8_14" <= '"'::TEXT)) OR (table1.col1_5 = e'\U00002603'::TEXT)) AND (table1.col1_8 >= '5874897-12-31'::DATE));
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: syntax error at or near "DESC" (SQLSTATE 42601)
        test_1        |     --- FAIL: TestCompare/mutators (0.73s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "Table1" (col1_0 BYTES NOT NULL, "c o\\xd5l1_1" INET[], "col1_ 2" OID, "col1%79_3" JSONB NOT NULL, "Col1_4" INT4 NOT NULL, "col1?_5" NAME NOT NULL, col1_6 TSQUERY NOT NULL, col1_7 INT4 NOT NULL, col1_8 BOX2D NOT NULL, "col'1_9" INT2 NOT NULL, col1_10 REGCLASS NULL, "Col1_11" INTERVAL NULL, col1_12 INT8 NULL AS ("col'1_9" + col1_7) VIRTUAL, "c  ol1_13" INT8 NULL AS (("col'1_9" + "Col1_4") + col1_7) VIRTUAL, col1_14 STRING NOT NULL AS (lower(CAST("col1%79_3" AS STRING))) VIRTUAL, PRIMARY KEY (col1_7, "col1?_5" DESC, col1_0 DESC), INDEX (lower(CAST("col1_ 2" AS STRING)) ASC, col1_0, "col1?_5" DESC, col1_8 DESC, "c    ol1_13" DESC, "Col1_4" ASC, "Col1_11") STORING ("c o\\xd5l1_1", "col1_ 2", "col'1_9") WHERE (((((("Table1".col1_14 >= '':::STRING) OR ("Table1".col1_0 < '\x00':::BYTES)) OR ("Table1"."col'1_9" != 32767:::INT8)) AND ("Table1"."Col1_4" >= 32767:::INT8)) AND ("Table1"."col1?_5" != '':::STRING:::NAME)) OR ("Table1".col1_7 != 1:::INT8)) AND ("Table1"."c  ol1_13" <= 2147483647:::INT8) NOT VISIBLE, UNIQUE ("col1?_5", "col'1_9") STORING ("c o\\xd5l1_1", "col1%79_3") WHERE (((((("Table1".col1_7 <= 1:::INT8) AND ("Table1"."col1?_5" < '':::STRING:::NAME)) AND ("Table1".col1_14 >= e'\x00':::STRING)) OR ("Table1"."col'1_9" <= (-1):::INT8)) AND ("Table1".col1_12 > (-32768):::INT8)) AND ("Table1"."Col1_4" = 0:::INT8)) AND ("Table1"."c   ol1_13" != 0:::INT8), FAMILY (col1_8), FAMILY ("col1_ 2"), FAMILY ("col1?_5"), FAMILY ("c o\\xd5l1_1"), FAMILY (col1_6), FAMILY ("Col1_4"), FAMILY ("Col1_11"), FAMILY ("col'1_9"), FAMILY (col1_0), FAMILY ("col1%79_3"), FAMILY (col1_10, col1_7));
        test_1        |             ALTER TABLE "Table1" INJECT STATISTICS e'[{"avg_size": 25, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 181992, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 200000}, {"avg_size": 23, "columns": ["\\"col1%79_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 22242, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 200000}, {"avg_size": 24, "columns": ["\\"Col1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 68312, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 200000}, {"avg_size": 31, "columns": ["\\"col1?_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 573, "histo_buckets": [{"distinct_range": 0, "num_eq": 900000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 0, "num_eq": 60000000, "num_range": 5649674144375728435, "upper_bound": "\'"}, {"distinct_range": 5000000000, "num_eq": 8000000, "num_range": 5000000000, "upper_bound": "I\\u0005"}, {"distinct_range": 4274460277481364500, "num_eq": 8483350201025234463, "num_range": 4274460277481364349, "upper_bound": "Pu)"}, {"distinct_range": 7264414500280093000, "num_eq": 4661992704788079511, "num_range": 7264414500280092188, "upper_bound": "cL\\r^}HK"}, {"distinct_range": 50277.807560194015, "num_eq": 100000000, "num_range": 70000, "upper_bound": "gg;Ah}\\u000e"}, {"distinct_range": 319750068.8432043, "num_eq": 9000000000, "num_range": 500000000, "upper_bound": "\U00002603"}], "histo_col_type": "NAME", "name": "__auto__", "null_count": 0, "row_count": 200000}, {"avg_size": 20, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 147589, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 200000}, {"avg_size": 21, "columns": ["\\"Col1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 79468, "histo_col_type": "", "name": "__auto__", "null_count": 107969, "row_count": 200000}, {"avg_size": 31, "columns": ["\\"c o\\\\\\\\xd5l1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 95997, "histo_col_type": "", "name": "__auto__", "null_count": 167906, "row_count": 200000}, {"avg_size": 20, "columns": ["\\"col1_ 2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 113231, "histo_col_type": "", "name": "__auto__", "null_count": 2891, "row_count": 200000}, {"avg_size": 27, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 148490, "histo_buckets": [{"distinct_range": 0, "num_eq": 400000000, "num_range": 0, "upper_bound": "-1081583390"}, {"distinct_range": 11116.50355634434, "num_eq": 300000, "num_range": 100000, "upper_bound": "145114376"}], "histo_col_type": "INT4", "name": "__auto__", "null_count": 0, "row_count": 200000}, {"avg_size": 5, "columns": ["\\"col\'1_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 166698, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 200000}, {"avg_size": 16, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 27190, "histo_col_type": "", "name": "__auto__", "null_count": 33288, "row_count": 200000}, {"avg_size": 5, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 178975, "histo_col_type": "", "name": "__auto__", "null_count": 165423, "row_count": 200000}, {"avg_size": 15, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 96502, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 200000}, {"avg_size": 16, "columns": ["\\"c\\tol1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 9114, "histo_col_type": "", "name": "__auto__", "null_count": 43306, "row_count": 200000}, {"avg_size": 4, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 101652, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 200000}]':::JSONB;
        test_1        |             ALTER TABLE "Table1" INJECT STATISTICS e'[{"avg_size": 16, "columns": ["\\"Col1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 17504, "histo_col_type": "", "name": "__auto__", "null_count": 2690, "row_count": 30000}, {"avg_size": 16, "columns": ["\\"col1%79_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 13643, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000}, {"avg_size": 11, "columns": ["\\"Col1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1104, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000}, {"avg_size": 24, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 9094, "histo_col_type": "", "name": "__auto__", "null_count": 28800, "row_count": 30000}, {"avg_size": 14, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 11818, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000}, {"avg_size": 26, "columns": ["\\"c o\\\\\\\\xd5l1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 25044, "histo_col_type": "", "name": "__auto__", "null_count": 5400, "row_count": 30000}, {"avg_size": 30, "columns": ["\\"col\'1_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 16667, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000}, {"avg_size": 28, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 21198, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000}, {"avg_size": 30, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 25407, "histo_buckets": [{"distinct_range": 0, "num_eq": 10000, "num_range": 0, "upper_bound": "-535390739"}, {"distinct_range": 1384613991942176300, "num_eq": 80000000, "num_range": 1384613991942176368, "upper_bound": "96091624"}, {"distinct_range": 9189564689799595000, "num_eq": 2408287834904482267, "num_range": 9189564689799594983, "upper_bound": "1102524840"}, {"distinct_range": 5324899454948517000, "num_eq": 100000, "num_range": 5324899454948516625, "upper_bound": "1572999014"}], "histo_col_type": "INT4", "name": "__auto__", "null_count": 0, "row_count": 30000}, {"avg_size": 23, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1113, "histo_col_type": "", "name": "__auto__", "null_count": 17844, "row_count": 30000}, {"avg_size": 14, "columns": ["\\"c\\tol1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 18482, "histo_col_type": "", "name": "__auto__", "null_count": 15164, "row_count": 30000}, {"avg_size": 20, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 16782, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000}, {"avg_size": 11, "columns": ["\\"col1?_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 15933, "histo_buckets": [{"distinct_range": 0, "num_eq": 1453766849214327, "num_range": 0, "upper_bound": "``"}], "histo_col_type": "NAME", "name": "__auto__", "null_count": 0, "row_count": 30000}, {"avg_size": 26, "columns": ["\\"col1_ 2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 21270, "histo_col_type": "", "name": "__auto__", "null_count": 29608, "row_count": 30000}, {"avg_size": 28, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 28623, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (19.87s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ a9eb6d220fc0957d4f6f8261d447991e9d03b4ad:

        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         CASE
        test_1        |                         WHEN NULL::BOOL THEN 3:::OID::OID
        test_1        |                         ELSE COALESCE(regtype(9:::INT8::INT4::INT4)::REGTYPE, 4:::OID::OID)
        test_1        |                         END
        test_1        |                             AS col382
        test_1        |                 )
        test_1        |                     AS tab254
        test_1        |             ORDER BY
        test_1        |                 col382 ASC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         CASE
        test_1        |                         WHEN NULL::BOOL THEN 3::OID::OID
        test_1        |                         ELSE COALESCE(regtype(9::INT8::INT4::INT4)::REGTYPE, 4::OID::OID)
        test_1        |                         END
        test_1        |                             AS col382
        test_1        |                 )
        test_1        |                     AS tab254
        test_1        |             ORDER BY
        test_1        |                 col382 ASC;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.44s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 DECIMAL NOT NULL, col1_1 BYTES NOT NULL, col1_2 BYTES NOT NULL, "/col1_3" OID, "c ol1_4" DECIMAL NOT NULL AS (col1_0 + (-31596.30756598625):::DECIMAL) VIRTUAL, col1_5 STRING AS (lower(CAST("/col1_3" AS STRING))) VIRTUAL, PRIMARY KEY ("c ol1_4" ASC), UNIQUE (col1_2, col1_1 DESC, (CASE WHEN col1_2 IS NULL THEN ']':::STRING ELSE e'\x06K<@(':::STRING END) DESC) STORING (col1_0) WHERE ((((table1.col1_0 >= '-Infinity':::DECIMAL) OR (table1.col1_2 < '\x27':::BYTES)) OR (table1.col1_1 <= '\x':::BYTES)) AND (table1."c ol1_4" > (-1):::DECIMAL)) AND (table1.col1_5 < e'\'':::STRING), INDEX ("c ol1_4" ASC) WHERE table1."c ol1_4" != (-1.234E+401):::DECIMAL NOT VISIBLE, INDEX (col1_2 ASC, col1_1 DESC, "c ol1_4" DESC, "/col1_3" DESC, col1_0 ASC) WHERE ((((table1.col1_5 = '':::STRING) OR (table1.col1_0 >= 'NaN':::DECIMAL)) AND (table1.col1_1 <= e'\\x22':::BYTES)) AND (table1.col1_2 != e'\\xff':::BYTES)) AND (table1."c ol1_4" <= 'NaN':::DECIMAL) NOT VISIBLE, INDEX ("/col1_3" ASC, col1_2, col1_5 ASC) STORING (col1_0, col1_1) WHERE ((((table1.col1_5 < e'\'':::STRING) AND (table1."c ol1_4" >= '-Infinity':::DECIMAL)) AND (table1.col1_0 = 0:::DECIMAL)) OR (table1.col1_1 <= e'\\xe29883':::BYTES)) AND (table1.col1_2 > e'\\x22':::BYTES) NOT VISIBLE, INDEX (col1_5 ASC, col1_0 ASC, col1_1 DESC, "/col1_3" ASC) WHERE table1.col1_5 >= e'\U00002603':::STRING, INDEX ("/col1_3" ASC) WHERE ((((table1.col1_5 >= e'\'':::STRING) AND (table1.col1_2 > e'\\x58':::BYTES)) OR (table1."c ol1_4" <= 0:::DECIMAL)) AND (table1.col1_1 < e'\\x':::BYTES)) AND (table1.col1_0 <= 0:::DECIMAL) NOT VISIBLE, UNIQUE ("c ol1_4") STORING (col1_2) WHERE (((table1.col1_2 != '\x22':::BYTES) AND (table1.col1_5 >= e'\'':::STRING)) OR (table1.col1_1 <= '\xe29883':::BYTES)) OR (table1.col1_0 > '-Infinity':::DECIMAL), UNIQUE (col1_0 DESC, col1_1, col1_5 DESC, "c ol1_4" ASC, col1_2 DESC) STORING ("/col1_3") WHERE ((((table1.col1_1 >= e'\\x':::BYTES) AND (table1.col1_5 = 'X':::STRING)) AND (table1.col1_0 > 'NaN':::DECIMAL)) AND (table1.col1_2 != e'\\x27':::BYTES)) AND (table1."c ol1_4" > 1:::DECIMAL), FAMILY (col1_0, col1_2), FAMILY (col1_1, "/col1_3"));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 1, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2783835786829333073, "histo_buckets": [{"distinct_range": 0, "num_eq": 700000000, "num_range": 0, "upper_bound": "0.07965116854039283896"}, {"distinct_range": 156.24047882144413, "num_eq": 8078933219847636238, "num_range": 200, "upper_bound": "1"}, {"distinct_range": 0, "num_eq": 2881214212807545440, "num_range": 7676305733084025807, "upper_bound": "5.186131690342020828E+22"}, {"distinct_range": 1000596843251706800, "num_eq": 4000000, "num_range": 1437232812506532299, "upper_bound": "6.896946072996695375E+24"}, {"distinct_range": 2517113776824779000, "num_eq": 7505784194453744320, "num_range": 7604511891299859347, "upper_bound": "2.17528342509848598E+36"}], "histo_col_type": "DECIMAL", "name": "__auto__", "null_count": 0, "row_count": 4696854728052182888}, {"avg_size": 18, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3926343203726672319, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4696854728052182888}, {"avg_size": 16, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1297419194874651138, "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 4696854728052182888}, {"avg_size": 30, "columns": ["\\"/col1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4006424065141640881, "histo_buckets": [{"distinct_range": 0, "num_eq": 513496025142062247, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 8395719672042878000, "num_eq": 5230241251878208042, "num_range": 8395719672042877840, "upper_bound": "99517536"}, {"distinct_range": 0, "num_eq": 8705463997598683070, "num_range": 0, "upper_bound": "1123868420"}, {"distinct_range": 0, "num_eq": 2951705659362550500, "num_range": 700, "upper_bound": "1737535216"}, {"distinct_range": 0, "num_eq": 20000, "num_range": 7000000, "upper_bound": "1840113660"}, {"distinct_range": 5000000000, "num_eq": 4000000000, "num_range": 5000000000, "upper_bound": "2995379657"}, {"distinct_range": 0, "num_eq": 1000000000, "num_range": 0, "upper_bound": "3548839976"}, {"distinct_range": 5897417020172144000, "num_eq": 100, "num_range": 5897417020172143215, "upper_bound": "3652368356"}], "histo_col_type": "OID", "name": "__auto__", "null_count": 4003156899302551212, "row_count": 4696854728052182888}, {"avg_size": 1, "columns": ["\\"c ol1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2391612595528130927, "histo_buckets": [{"distinct_range": 0, "num_eq": 1361759437854459094, "num_range": 0, "upper_bound": "-7.183823092748330958E+29"}, {"distinct_range": 0, "num_eq": 3392662294749925472, "num_range": 5513424236502175906, "upper_bound": "0"}, {"distinct_range": 60000, "num_eq": 4892901833943006942, "num_range": 60000, "upper_bound": "88099152326.980857"}, {"distinct_range": 77051819.65177506, "num_eq": 300, "num_range": 1000000000, "upper_bound": "5.374030555059975365E+19"}, {"distinct_range": 448572459663685000, "num_eq": 6180117659028012614, "num_range": 473725194163703046, "upper_bound": "6.325955725099084629E+22"}, {"distinct_range": 7548777268604355000, "num_eq": 1760475029644086553, "num_range": 7548777268604354349, "upper_bound": "1.244664871640815107E+24"}, {"distinct_range": 0, "num_eq": 200000, "num_range": 4000000, "upper_bound": "7.996564292183754205E+35"}, {"distinct_range": 1006571735761025700, "num_eq": 5899716807301284015, "num_range": 6695563004383154803, "upper_bound": "8.294039355102962536E+36"}], "histo_col_type": "DECIMAL", "name": "__auto__", "null_count": 0, "row_count": 4696854728052182888}, {"avg_size": 30, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4136101176026323715, "histo_buckets": [{"distinct_range": 0, "num_eq": 6000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 3940711576576942000, "num_eq": 8576421682345846556, "num_range": 3940711576576942151, "upper_bound": "\\u0008\\u001aE"}, {"distinct_range": 0, "num_eq": 4577983084101924036, "num_range": 5468520983354646151, "upper_bound": "\\t\\u0018S"}, {"distinct_range": 4999763932479575000, "num_eq": 5259668647442797737, "num_range": 4999763932479575139, "upper_bound": "\\n"}, {"distinct_range": 50, "num_eq": 4000, "num_range": 50, "upper_bound": "3]"}, {"distinct_range": 36.86090313179645, "num_eq": 400000000, "num_range": 40, "upper_bound": "?"}, {"distinct_range": 20, "num_eq": 407709974768816969, "num_range": 20, "upper_bound": "X"}, {"distinct_range": 489283596.11992306, "num_eq": 2000000000, "num_range": 600000000, "upper_bound": "_T\\u000b"}, {"distinct_range": 6944841411708333000, "num_eq": 100, "num_range": 8206677061714182056, "upper_bound": "g"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 269727253289100762, "row_count": 4696854728052182888}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 19, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 119179800595387202, "histo_col_type": "STRING", "name": "__auto__", "null_count": 115725547148012059, "row_count": 2785584762629925465}, {"avg_size": 26, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1866236238538276743, "histo_buckets": [{"distinct_range": 0, "num_eq": 6750274306237017249, "num_range": 0, "upper_bound": "-Infinity"}, {"distinct_range": 0, "num_eq": 100, "num_range": 50000, "upper_bound": "0"}, {"distinct_range": 0, "num_eq": 300000000, "num_range": 10000000000, "upper_bound": "3.46433568501055018E+21"}, {"distinct_range": 0, "num_eq": 426414177005108273, "num_range": 8544024187011539427, "upper_bound": "8.670822520976029173E+22"}], "histo_col_type": "DECIMAL", "name": "__auto__", "null_count": 0, "row_count": 2785584762629925465}, {"avg_size": 12, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1967166970000310574, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2785584762629925465}, {"avg_size": 7, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2529782730241027629, "histo_buckets": [{"distinct_range": 0, "num_eq": 60000000, "num_range": 0, "upper_bound": "\\\\x64997a4b9a"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 2785584762629925465}, {"avg_size": 3, "columns": ["\\"/col1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1389849932035699005, "histo_buckets": [{"distinct_range": 0, "num_eq": 1285694091484473365, "num_range": 0, "upper_bound": "0"}], "histo_col_type": "OID", "name": "__auto__", "null_count": 154484181526552310, "row_count": 2785584762629925465}, {"avg_size": 16, "columns": ["\\"c ol1_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1887509897143613299, "histo_buckets": [{"distinct_range": 0, "num_eq": 70000000, "num_range": 0, "upper_bound": "-1.234E+401"}, {"distinct_range": 2903813310481268700, "num_eq": 8754614201073720406, "num_range": 2903813310481268599, "upper_bound": "-2.776543389550445005E+36"}, {"distinct_range": 90000, "num_eq": 8000000000, "num_range": 90000, "upper_bound": "-1.59566159449087053E+36"}, {"distinct_range": 0, "num_eq": 20000000000, "num_range": 8990298319584775836, "upper_bound": "-3.729877612866965472E+20"}, {"distinct_range": 8946372737418982000, "num_eq": 7000000000, "num_range": 8946372737418982231, "upper_bound": "-8.831165922840569258E+19"}, {"distinct_range": 900, "num_eq": 60000000, "num_range": 900, "upper_bound": "-4.264066629990949645"}, {"distinct_range": 800000, "num_eq": 800, "num_range": 800000, "upper_bound": "-0.7096234291280475203"}, {"distinct_range": 0, "num_eq": 30000000000, "num_range": 4000000, "upper_bound": "7.069480499751369129E+23"}], "histo_col_type": "DECIMAL", "name": "__auto__", "null_count": 0, "row_count": 2785584762629925465}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (18.99s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ c8a4703f9853a442ac676b44d074b43eb387f60c:

        postgres_1    | 
        postgres_1    | 2023-04-12 05:30:43.901 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-12 05:30:43.901 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-12 05:30:43.901 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-12 05:30:43.905 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-12 05:30:43.910 UTC [69] LOG:  database system was shut down at 2023-04-12 05:30:43 UTC
        postgres_1    | 2023-04-12 05:30:43.916 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-12 05:30:45.186 UTC [79] ERROR:  collation "de" for encoding "UTF8" does not exist at character 101
        postgres_1    | 2023-04-12 05:30:45.186 UTC [79] STATEMENT:  CREATE TABLE table2 ("col2_&0" TSQUERY NULL, col2_1 DECIMAL NOT NULL, col2_2 UUID NULL, col2_3 TEXT COLLATE de NOT NULL, "col2)_4" TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_2 AS TEXT))) STORED, "co%ql2\\U0003CBBD_5" TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_2 AS TEXT))) STORED);
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_1 ASC, (col2_1 + (-3.691991604699773282E+27)::DECIMAL) DESC) INCLUDE ("col2_&0", col2_3, "col2)_4");
        postgres_1    |     CREATE INDEX ON table2 ("col2)_4", "co%ql2\\U0003CBBD_5" ASC, col2_1 DESC) INCLUDE ("col2_&0", col2_3);
        postgres_1    |     CREATE INDEX ON table2 (lower(CAST(col2_3 AS TEXT)) ASC, col2_3 DESC) INCLUDE (col2_1, col2_2, "col2)_4");
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.58s)
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (1.03s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table2 ("col2_&0" TSQUERY NULL, col2_1 DECIMAL NOT NULL, col2_2 UUID NULL, col2_3 TEXT COLLATE de NOT NULL, "col2)_4" TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_2 AS TEXT))) STORED, "co%ql2\\U0003CBBD_5" TEXT NULL GENERATED ALWAYS AS (lower(CAST(col2_2 AS TEXT))) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_1 ASC, (col2_1 + (-3.691991604699773282E+27)::DECIMAL) DESC) INCLUDE ("col2_&0", col2_3, "col2)_4");
        test_1        |             CREATE INDEX ON table2 ("col2)_4", "co%ql2\\U0003CBBD_5" ASC, col2_1 DESC) INCLUDE ("col2_&0", col2_3);
        test_1        |             CREATE INDEX ON table2 (lower(CAST(col2_3 AS TEXT)) ASC, col2_3 DESC) INCLUDE (col2_1, col2_2, "col2)_4");
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "de" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (1.23s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 UUID NOT NULL, col1_1 JSONB NOT NULL, ".😾c\\u71DE
        test_1        |             ol1_2" FLOAT8 NOT NULL, "'col1_3" INTERVAL NOT NULL, col1_4 GEOGRAPHY NOT NULL, col1_5 STRING NOT NULL AS (lower(CAST(col1_1 AS STRING))) STORED, col1_6 STRING NOT NULL AS (lower(CAST(col1_1 AS STRING))) STORED, "co,l1_7" STRING NOT NULL AS (lower(CAST(col1_1 AS STRING))) VIRTUAL, FAMILY (col1_1, "'col1_3", col1_5, col1_6, ".😾c\\u71DE
        test_1        |             ol1_2", col1_4), FAMILY (col1_0));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 31, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5154173515415900037, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6450431240032870257}, {"avg_size": 31, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1694852991763410038, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6450431240032870257}, {"avg_size": 15, "columns": ["\\".\U0001F63Ec\\\\\\\\u71DE\\nol1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6153614277414567401, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6450431240032870257}, {"avg_size": 27, "columns": ["\\"\'col1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1994865265682978988, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6450431240032870257}, {"avg_size": 20, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2293163128553744232, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6450431240032870257}, {"avg_size": 25, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3062287402632039845, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6450431240032870257}, {"avg_size": 20, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3784703841321021200, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6450431240032870257}, {"avg_size": 21, "columns": ["\\"co,l1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 480434178397395033, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6450431240032870257}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 29, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2694712691407527367, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4906551774271095195}, {"avg_size": 8, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4291951277876322331, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4906551774271095195}, {"avg_size": 24, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2772206319755299254, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4906551774271095195}, {"avg_size": 16, "columns": ["\\"co,l1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2204036802006466586, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4906551774271095195}, {"avg_size": 4, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 440930487965986618, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4906551774271095195}, {"avg_size": 25, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3084618864763663841, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4906551774271095195}, {"avg_size": 1, "columns": ["\\".\U0001F63Ec\\\\\\\\u71DE\\nol1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2336450559081343213, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4906551774271095195}, {"avg_size": 5, "columns": ["\\"\'col1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3788254532313814422, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4906551774271095195}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.49s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ cf84c1c11f2f9c1a4a979033fa0af3befb2ccbcf:

        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/mutators (0.43s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE tabĺe1 (col1_0 BIT(24) NOT NULL, "coL1_1" OID NULL, col1_2 NAME NOT NULL, col1_3 JSONB, col1_4 BIT(31) NOT NULL, "c'ol1
_5" TIME NOT NULL, col😊1_6 BIT(31) NOT NULL, col1_7 BOOL, col1_8 REGCLASS, col1_9 INT8 NOT NULL, col1_10 BIT(42) NOT NULL, "co l 1_11" FLOAT4 NOT NULL, "c,ol1_12" INT4[] NOT NULL, "\\uF5DFcol1_13" STRING NOT NULL AS (lower(CAST(col1_4 AS STRING))) VIRTUAL, "co\\x88l1_14" STRING NOT NULL AS (lower(CAST(col1_4 AS STRING))) STORED, UNIQUE (col1_9, "\\uF5DFcol1_13", lower(CAST(col1_4 AS STRING)) DESC, lower(CAST("c'ol1
_5" AS STRING)), lower(CAST(col1_0 AS STRING)) DESC, (CASE WHEN col1_8 IS NULL THEN e'~:u\x1a>/;=\x0b':::STRING ELSE e'*uHl\\q':::STRING END) ASC) STORING ("coL1_1", col1_2, col1_3, col😊1_6, col1_8, col1_10, "c,ol1_12") WHERE (tabĺe1."\\uF5DFcol1_13" = '':::STRING) AND (tabĺe1.col1_9 > (-2147483648):::INT8), INDEX (col😊1_6 ASC, col1_2 ASC) STORING (col1_0, col1_4, col1_8, col1_9, col1_10, "co l 1_11", "c,ol1_12") WHERE ((((((tabĺe1."co l 1_11" <= 3.4028234663852886e+38:::FLOAT8) AND (tabĺe1."c'ol1
_5" != '24:00:00':::TIME)) OR (tabĺe1."\\uF5DFcol1_13" > '"':::STRING)) OR tabĺe1.col1_7) AND (tabĺe1.col1_2 > e'\x00':::STRING:::NAME)) OR (tabĺe1.col1_9 = 32767:::INT8)) OR (tabĺe1."co\\x88l1_14" >= 'X':::STRING), INDEX (col1_4 DESC, "co l 1_11", "c,ol1_12" ASC, col1_10, col1_7 DESC, "coL1_1" DESC, col😊1_6 ASC) WHERE (((((tabĺe1.col1_7 AND (tabĺe1.col1_9 >= 0:::INT8)) AND (tabĺe1."co\\x88l1_14" = '"':::STRING)) OR (tabĺe1."\\uF5DFcol1_13" >= e'\U00002603':::STRING)) AND (tabĺe1."co l 1_11" <= '+Inf':::FLOAT8)) OR (tabĺe1."c'ol1
_5" < '24:00:00':::TIME)) AND (tabĺe1.col1_2 < '"':::STRING:::NAME), UNIQUE ("co l 1_11" DESC, col1_7 ASC, "c'ol1
_5" DESC, col1_2 ASC, "c,ol1_12", "coL1_1" DESC, col1_8 ASC) STORING (col1_0, col😊1_6, "co\\x88l1_14"), FAMILY (col1_4), FAMILY ("co\\x88l1_14"), FAMILY (col1_0, col1_2), FAMILY ("c,ol1_12"), FAMILY (col1_3), FAMILY ("coL1_1"), FAMILY (col1_10), FAMILY ("c'ol1
_5", "co l 1_11"), FAMILY (col1_8, col😊1_6), FAMILY (col1_9), FAMILY (col1_7));
        test_1        |             ALTER TABLE tabĺe1 INJECT STATISTICS e'[{"avg_size": 0, "columns": ["\\"c\'ol1\\r_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col\U0001F60A1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 30, "num_range": 0, "upper_bound": "0000000000000000000000000000000"}, {"distinct_range": 0, "num_eq": 2132266229023634638, "num_range": 0, "upper_bound": "0010011011000010100000001001001"}, {"distinct_range": 818027682222214000, "num_eq": 300000000, "num_range": 818027682222213961, "upper_bound": "0010110110010001001011100110101"}, {"distinct_range": 70000000000, "num_eq": 600000, "num_range": 70000000000, "upper_bound": "1100010001001010110000100111011"}], "histo_col_type": "BIT(31)", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 20000, "num_range": 0, "upper_bound": "-6381797182207966501"}, {"distinct_range": 8517563296608729000, "num_eq": 3077654992663649281, "num_range": 8517563296608729495, "upper_bound": "-4714469634136244008"}, {"distinct_range": 0, "num_eq": 9000, "num_range": 30000, "upper_bound": "-4336903468338411778"}, {"distinct_range": 29062.031335356154, "num_eq": 8392513102694841711, "num_range": 80000, "upper_bound": "-3898498966377278341"}, {"distinct_range": 5747441265053198000, "num_eq": 200, "num_range": 8783233170877871937, "upper_bound": "-2277307463919801103"}, {"distinct_range": 810582311.3361372, "num_eq": 6266298312500043995, "num_range": 3000000000, "upper_bound": "1"}, {"distinct_range": 0, "num_eq": 30000, "num_range": 300, "upper_bound": "237391550210190398"}, {"distinct_range": 0, "num_eq": 500, "num_range": 0, "upper_bound": "5270105801813752126"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"\\\\\\\\uF5DFcol1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"co l 1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"c,ol1_12\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"co\\\\\\\\x88l1_14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"coL1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}]':::JSONB;
        test_1        |             ALTER TABLE tabĺe1 INJECT STATISTICS e'[{"avg_size": 3, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2233849875980060036, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3384904648311665277}, {"avg_size": 13, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 655426774872153644, "histo_col_type": "", "name": "__auto__", "null_count": 111500632372115217, "row_count": 3384904648311665277}, {"avg_size": 15, "columns": ["col\U0001F60A1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2467406088136476968, "histo_buckets": [{"distinct_range": 0, "num_eq": 8000000000, "num_range": 0, "upper_bound": "0000010000111011100100101010111"}, {"distinct_range": 0, "num_eq": 10000000000, "num_range": 8077703404244432442, "upper_bound": "0001011101111100101100111110101"}, {"distinct_range": 4144.540687934016, "num_eq": 5917446891061753491, "num_range": 10000, "upper_bound": "0001100011000110000011111101001"}, {"distinct_range": 6968150614998076000, "num_eq": 5000, "num_range": 6968150614998076829, "upper_bound": "0001101001101011101001100001111"}, {"distinct_range": 2208527047417304600, "num_eq": 100000, "num_range": 6056771484577911437, "upper_bound": "0100110000010111001001100010101"}, {"distinct_range": 20000, "num_eq": 4000000, "num_range": 20000, "upper_bound": "0101001110111110100101000011011"}, {"distinct_range": 0, "num_eq": 6295053288864556242, "num_range": 4976083524095521580, "upper_bound": "1000101100110110101100000010001"}, {"distinct_range": 700, "num_eq": 6000000, "num_range": 700, "upper_bound": "1101010100111101101000111101111"}, {"distinct_range": 5614718416208675000, "num_eq": 6000, "num_range": 7870413488939985131, "upper_bound": "1110010001010101000000011100110"}], "histo_col_type": "BIT(31)", "name": "__auto__", "null_count": 0, "row_count": 3384904648311665277}, {"avg_size": 21, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1923013821603582589, "histo_buckets": [{"distinct_range": 0, "num_eq": 6654849066706143180, "num_range": 0, "upper_bound": "-8415709436478690282"}, {"distinct_range": 0, "num_eq": 200000, "num_range": 8700381217539382958, "upper_bound": "-2444519453667237060"}, {"distinct_range": 0, "num_eq": 1223918774832039576, "num_range": 0, "upper_bound": "-663416249590882997"}, {"distinct_range": 60800476.01067922, "num_eq": 50000000, "num_range": 80000000, "upper_bound": "2147483647"}, {"distinct_range": 110352.2136718694, "num_eq": 800000000, "num_range": 600000, "upper_bound": "593157727906906561"}, {"distinct_range": 300000000, "num_eq": 1000000, "num_range": 300000000, "upper_bound": "3279583390425927309"}, {"distinct_range": 0, "num_eq": 3746605766629075685, "num_range": 20000000000, "upper_bound": "7056432515972699903"}, {"distinct_range": 0, "num_eq": 6197336406661414285, "num_range": 7281936990416953711, "upper_bound": "8644103922592935384"}, {"distinct_range": 110812.31988013236, "num_eq": 4000000000, "num_range": 400000, "upper_bound": "8698806190873907723"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 3384904648311665277}, {"avg_size": 15, "columns": ["\\"co l 1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 727985286219506330, "histo_buckets": [{"distinct_range": 0, "num_eq": 70000, "num_range": 0, "upper_bound": "-1.4030345678329468"}], "histo_col_type": "FLOAT4", "name": "__auto__", "null_count": 0, "row_count": 3384904648311665277}, {"avg_size": 28, "columns": ["\\"c,ol1_12\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 700122770694932243, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3384904648311665277}, {"avg_size": 8, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2673242702088645350, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3384904648311665277}, {"avg_size": 5, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1130530877286289352, "histo_buckets": [{"distinct_range": 0, "num_eq": 9000, "num_range": 0, "upper_bound": "0001000101010000110100001010110"}, {"distinct_range": 7000, "num_eq": 626678212756347722, "num_range": 7000, "upper_bound": "0001011000100101001010110011011"}, {"distinct_range": 7266749609720390000, "num_eq": 6000000000, "num_range": 7266749609720389717, "upper_bound": "0010111100110110110101011000010"}, {"distinct_range": 800000000, "num_eq": 6184375465426987323, "num_range": 800000000, "upper_bound": "0100011001010000000100001010101"}, {"distinct_range": 0, "num_eq": 60, "num_range": 7586396749376937758, "upper_bound": "1011111111100111111100011110001"}, {"distinct_range": 2000000000, "num_eq": 300000000, "num_range": 2000000000, "upper_bound": "1101010100011000101101110110011"}, {"distinct_range": 50695.51184858896, "num_eq": 0, "num_range": 100000, "upper_bound": "1111100000111000010100101000110"}], "histo_col_type": "BIT(31)", "name": "__auto__", "null_count": 0, "row_count": 3384904648311665277}, {"avg_size": 7, "columns": ["\\"c\'ol1\\r_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1843351932770939, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3384904648311665277}, {"avg_size": 11, "columns": ["\\"coL1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2765955902530460187, "histo_col_type": "", "name": "__auto__", "null_count": 1514702248822360942, "row_count": 3384904648311665277}, {"avg_size": 15, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1744499857581330827, "histo_col_type": "", "name": "__auto__", "null_count": 575302264038796426, "row_count": 3384904648311665277}, {"avg_size": 12, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 196602942102653576, "histo_col_type": "", "name": "__auto__", "null_count": 123823879354112496, "row_count": 3384904648311665277}, {"avg_size": 26, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3254365837541821626, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3384904648311665277}, {"avg_size": 14, "columns": ["\\"\\\\\\\\uF5DFcol1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 754926845351019608, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3384904648311665277}, {"avg_size": 18, "columns": ["\\"co\\\\\\\\x88l1_14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1179082178451142875, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3384904648311665277}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        |     --- FAIL: TestCompare/postgres (5.63s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1889260007/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("6"),
        test_1        |                 float64(7),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(6:::OID::OID::OID)::REGPROCEDURE AS "col|5897", 7.0:::FLOAT8::FLOAT8 AS col5898) AS tab5253
        test_1        |             ORDER BY
        test_1        |                 "col|5897" DESC NULLS FIRST, col5898 DESC NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(6::OID::OID::OID)::REGPROCEDURE AS "col|5897", 7.0::FLOAT8::FLOAT8 AS col5898) AS tab5253
        test_1        |             ORDER BY
        test_1        |                 "col|5897" DESC NULLS FIRST, col5898 DESC NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (29.67s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ ad16885ca3b4567ed5eb34646fe8281fd2d740e3:

        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/mutators (0.46s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE """tabl'%6be*1" (col1_0 BIT(5) NULL, col1_1 TIMESTAMPTZ NULL, "\vc(ol\\u9CDD1_2" TSVECTOR NOT NULL, "col\\U000AF08B1_3" "char" NULL, col1_̵4 OID NULL, col1_5 FLOAT4 NOT NULL, col1_6 TIMETZ, col1_7 STRING AS (lower(CAST(col1_6 AS STRING))) STORED, c̸ol1_8 STRING NOT NULL AS (lower(CAST("\vc(ol\\u9CDD1_2" AS STRING))) STORED, INVERTED INDEX (col1_0 ASC, "\vc(ol\\u9CDD1_2") WHERE ((((("""tabl'%6be*1".col1_7 = e'\x00':::STRING) OR ("""tabl'%6be*1".col1_5 = 0.0:::FLOAT8)) AND ("""tabl'%6be*1".c̸ol1_8 != e'\x00':::STRING)) OR ("""tabl'%6be*1".col1_1 != '294276-12-31 23:59:59.999999+00':::TIMESTAMPTZ)) AND ("""tabl'%6be*1".col1_6 <= '24:00:00-15:59':::TIMETZ)) OR ("""tabl'%6be*1"."col\\U000AF08B1_3" >= 'X':::STRING), INDEX (col1_0, col1_7, "col\\U000AF08B1_3", col1_̵4, col1_6 ASC) STORING (col1_1, "\vc(ol\\u9CDD1_2", col1_5, c̸ol1_8) WHERE (((("""tabl'%6be*1".col1_6 != '24:00:00-15:59':::TIMETZ) AND ("""tabl'%6be*1".col1_5 = 1.401298464324817e-45:::FLOAT8)) AND ("""tabl'%6be*1"."col\\U000AF08B1_3" < '"':::STRING)) OR ("""tabl'%6be*1".c̸ol1_8 >= e'\'':::STRING)) OR ("""tabl'%6be*1".col1_7 < 'X':::STRING), INDEX (col1_7 DESC, col1_0, c̸ol1_8 ASC, col1_6 DESC, col1_5 ASC) STORING ("\vc(ol\\u9CDD1_2", "col\\U000AF08B1_3") WHERE ((((("""tabl'%6be*1".col1_1 = '294276-12-31 23:59:59.999999+00':::TIMESTAMPTZ) AND ("""tabl'%6be*1".col1_5 < (-1.0):::FLOAT8)) OR ("""tabl'%6be*1".c̸ol1_8 != e'\'':::STRING)) AND ("""tabl'%6be*1"."col\\U000AF08B1_3" >= e'\'':::STRING)) OR ("""tabl'%6be*1".col1_7 >= e'\'':::STRING)) OR ("""tabl'%6be*1".col1_6 <= '24:00:00-15:59':::TIMETZ), UNIQUE (col1_6, lower(CAST(col1_̵4 AS STRING)) ASC) STORING (col1_1, col1_7) WHERE ((((("""tabl'%6be*1"."col\\U000AF08B1_3" > '':::STRING) AND ("""tabl'%6be*1".col1_6 >= '24:00:00-15:59':::TIMETZ)) AND ("""tabl'%6be*1".col1_1 = '3000-01-01 00:00:00+00':::TIMESTAMPTZ)) AND ("""tabl'%6be*1".c̸ol1_8 < e'\'':::STRING)) OR ("""tabl'%6be*1".col1_7 > e'\'':::STRING)) AND ("""tabl'%6be*1".col1_5 = '+Inf':::FLOAT8), UNIQUE (col1_̵4) STORING (col1_1, "\vc(ol\\u9CDD1_2", "col\\U000AF08B1_3", col1_5) WHERE ((("""tabl'%6be*1".col1_7 >= '"':::STRING) AND ("""tabl'%6be*1"."col\\U000AF08B1_3" >= e'\U00002603':::STRING)) OR ("""tabl'%6be*1".col1_1 < '2001-01-01 00:00:00+00 BC':::TIMESTAMPTZ)) OR ("""tabl'%6be*1".col1_6 <= '24:00:00-15:59':::TIMETZ), UNIQUE (col1_6) STORING (col1_0, "\vc(ol\\u9CDD1_2", col1_̵4, col1_7) WHERE (((("""tabl'%6be*1".col1_7 > '':::STRING) AND ("""tabl'%6be*1"."col\\U000AF08B1_3" >= '':::STRING)) AND ("""tabl'%6be*1".c̸ol1_8 <= e'\'':::STRING)) AND ("""tabl'%6be*1".col1_1 = '2001-01-01 00:00:00+00 BC':::TIMESTAMPTZ)) AND ("""tabl'%6be*1".col1_5 >= '+Inf':::FLOAT8), FAMILY (col1_5), FAMILY (c̸ol1_8), FAMILY (col1_1), FAMILY (col1_̵4), FAMILY (col1_6, col1_0), FAMILY ("\vc(ol\\u9CDD1_2"), FAMILY ("col\\U000AF08B1_3", col1_7));
        test_1        |             ALTER TABLE """tabl'%6be*1" INJECT STATISTICS e'[{"avg_size": 16, "columns": ["\\"\\\\vc(ol\\\\\\\\u9CDD1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5776557902220495112, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8359155191376116393}, {"avg_size": 15, "columns": ["col1_\u03354"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6167381254184847600, "histo_buckets": [{"distinct_range": 0, "num_eq": 7309458817874352600, "num_range": 0, "upper_bound": "77166330"}, {"distinct_range": 3422027.383560672, "num_eq": 40000000, "num_range": 5000000, "upper_bound": "1365126749"}, {"distinct_range": 60000000000, "num_eq": 0, "num_range": 60000000000, "upper_bound": "3261987700"}], "histo_col_type": "OID", "name": "__auto__", "null_count": 638886132994693732, "row_count": 8359155191376116393}, {"avg_size": 27, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 407446115431195539, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8359155191376116393}, {"avg_size": 18, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7259984313872266374, "histo_buckets": [{"distinct_range": 0, "num_eq": 6508540514271728580, "num_range": 0, "upper_bound": ""}, {"distinct_range": 0, "num_eq": 200000000, "num_range": 7093259368408419407, "upper_bound": "\\u0002^\\r!3qb\\u001a"}, {"distinct_range": 0, "num_eq": 5000000, "num_range": 1000000000, "upper_bound": ";\\u0015=f/P\\u00085"}, {"distinct_range": 4086452966319110000, "num_eq": 3753781085128191296, "num_range": 4086452966319110368, "upper_bound": "KPk3\\u0005Tn\\u00162"}, {"distinct_range": 0, "num_eq": 0, "num_range": 5417726224511572255, "upper_bound": "L"}, {"distinct_range": 208662902.69011372, "num_eq": 7645003386589408719, "num_range": 20000000000, "upper_bound": "UzK{,$"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 238985910807961962, "row_count": 8359155191376116393}, {"avg_size": 1, "columns": ["c\u0338ol1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8240975412574364208, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8359155191376116393}, {"avg_size": 6, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4871092804166734891, "histo_buckets": [{"distinct_range": 0, "num_eq": 9000000000, "num_range": 0, "upper_bound": "00110"}, {"distinct_range": 3314607904087253000, "num_eq": 1000000000, "num_range": 7198203504066647322, "upper_bound": "01011"}, {"distinct_range": 1000000, "num_eq": 2000000000, "num_range": 1000000, "upper_bound": "01101"}, {"distinct_range": 534451.4432557259, "num_eq": 1000000000, "num_range": 800000, "upper_bound": "10010"}, {"distinct_range": 22682.2877386726, "num_eq": 5000, "num_range": 3000000, "upper_bound": "10111"}, {"distinct_range": 0, "num_eq": 6000000000, "num_range": 9133355466009982738, "upper_bound": "11010"}, {"distinct_range": 2547728121774506000, "num_eq": 6368687415157820008, "num_range": 3304221711940894143, "upper_bound": "11100"}, {"distinct_range": 0, "num_eq": 30000000000, "num_range": 3067260435970215105, "upper_bound": "11110"}], "histo_col_type": "BIT(5)", "name": "__auto__", "null_count": 3368935064954894272, "row_count": 8359155191376116393}, {"avg_size": 4, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7706172670832518848, "histo_col_type": "", "name": "__auto__", "null_count": 4292045432492345040, "row_count": 8359155191376116393}, {"avg_size": 19, "columns": ["\\"col\\\\\\\\U000AF08B1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 908437679713148212, "histo_col_type": "", "name": "__auto__", "null_count": 395894106757461734, "row_count": 8359155191376116393}, {"avg_size": 7, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6127819924383741576, "histo_buckets": [{"distinct_range": 0, "num_eq": 7958356991590652231, "num_range": 0, "upper_bound": "13:20:02.692498-01:29"}, {"distinct_range": 1012771812062410500, "num_eq": 400000000, "num_range": 5797540970280955793, "upper_bound": "13:39:16.19274-04:02"}, {"distinct_range": 3571615678202768400, "num_eq": 400000, "num_range": 3571615678202768469, "upper_bound": "06:44:48.520972-11:45"}, {"distinct_range": 6166194270643658000, "num_eq": 7451656767288679484, "num_range": 6166194270643657810, "upper_bound": "08:01:36.785843-13:16"}], "histo_col_type": "TIMETZ", "name": "__auto__", "null_count": 7949964342040173401, "row_count": 8359155191376116393}]':::JSONB;
        test_1        |             ALTER TABLE """tabl'%6be*1" INJECT STATISTICS e'[{"avg_size": 11, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 458748926, "histo_buckets": [{"distinct_range": 0, "num_eq": 1353742032694039984, "num_range": 0, "upper_bound": "01:10:33.630852+06:37"}, {"distinct_range": 10000, "num_eq": 1000000, "num_range": 10000, "upper_bound": "07:05:59.774886-03:48"}, {"distinct_range": 4575878310969771500, "num_eq": 900000000, "num_range": 4575878310969771673, "upper_bound": "22:58:21.131207+08:33"}, {"distinct_range": 3972661602509658600, "num_eq": 90000000000, "num_range": 3972661602509658516, "upper_bound": "23:06:11.967468+06:19"}, {"distinct_range": 15569.882076620324, "num_eq": 10000000000, "num_range": 700000, "upper_bound": "11:08:47.078607-06:51"}, {"distinct_range": 932.0143876803974, "num_eq": 3381546945264526805, "num_range": 1000, "upper_bound": "16:40:15.593446-06:25"}, {"distinct_range": 6587961098860363000, "num_eq": 4000000, "num_range": 7276372619509008827, "upper_bound": "16:14:32.172046-07:22"}], "histo_col_type": "TIMETZ", "name": "__auto__", "null_count": 897263749, "row_count": 1000000000}, {"avg_size": 19, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 667643390, "histo_buckets": [{"distinct_range": 0, "num_eq": 1676326549542997515, "num_range": 0, "upper_bound": ""}, {"distinct_range": 0, "num_eq": 2293812459439148716, "num_range": 8194491202855908964, "upper_bound": "\\u001f\\u001f"}, {"distinct_range": 0, "num_eq": 5485891973259759601, "num_range": 484543101395681658, "upper_bound": "vT\x7f"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 402335844, "row_count": 1000000000}, {"avg_size": 8, "columns": ["\\"\\\\vc(ol\\\\\\\\u9CDD1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 207505698, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 14, "columns": ["col1_\u03354"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 239241216, "histo_buckets": [{"distinct_range": 0, "num_eq": 1000, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 60000000000, "num_eq": 4562404244618674771, "num_range": 60000000000, "upper_bound": "1812402675"}, {"distinct_range": 48960810090357944, "num_eq": 1363851721477127949, "num_range": 3291744516193464193, "upper_bound": "2020352862"}, {"distinct_range": 1591.2577631906422, "num_eq": 2694111112816005678, "num_range": 10000, "upper_bound": "2351746767"}, {"distinct_range": 3628976367998053400, "num_eq": 5757498874151978274, "num_range": 4727516354286026063, "upper_bound": "2619068802"}, {"distinct_range": 336269769894291650, "num_eq": 2000000000, "num_range": 336269769894291677, "upper_bound": "2985168004"}, {"distinct_range": 300000, "num_eq": 7824468278199120482, "num_range": 300000, "upper_bound": "3476529824"}], "histo_col_type": "OID", "name": "__auto__", "null_count": 419465851, "row_count": 1000000000}, {"avg_size": 9, "columns": ["\\"col\\\\\\\\U000AF08B1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 659694069, "histo_col_type": "", "name": "__auto__", "null_count": 573033607, "row_count": 1000000000}, {"avg_size": 6, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 149984662, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 29, "columns": ["c\u0338ol1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 695801467, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 18, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 619080003, "histo_buckets": [{"distinct_range": 0, "num_eq": 8000, "num_range": 0, "upper_bound": "00000"}, {"distinct_range": 434999556524793200, "num_eq": 300000, "num_range": 1070701210509906735, "upper_bound": "00101"}, {"distinct_range": 133.20499624743738, "num_eq": 365190702304425005, "num_range": 200, "upper_bound": "10001"}, {"distinct_range": 100000000, "num_eq": 7722606192931099718, "num_range": 100000000, "upper_bound": "10100"}, {"distinct_range": 0, "num_eq": 100000000, "num_range": 6884399738011895067, "upper_bound": "11001"}, {"distinct_range": 1605586335724396800, "num_eq": 70000, "num_range": 5296648208489942506, "upper_bound": "11011"}], "histo_col_type": "BIT(5)", "name": "__auto__", "null_count": 914836252, "row_count": 1000000000}, {"avg_size": 28, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 622565502, "histo_col_type": "", "name": "__auto__", "null_count": 680528179, "row_count": 1000000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        |     --- FAIL: TestCompare/postgres (5.35s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2542764114/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("heap_tableam_handler"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regproc(3:::INT8::INT4::INT4)::REGPROC AS c̵ol4419) AS "�t😉ab3259"
        test_1        |             ORDER BY
        test_1        |                 c̵ol4419 NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regproc(3::INT8::INT4::INT4)::REGPROC AS c̵ol4419) AS "�t😉ab3259"
        test_1        |             ORDER BY
        test_1        |                 c̵ol4419 NULLS FIRST;
        test_1        |             
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (32.32s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 84905b8396e7cd7ef999b264faaafe13110d631a:

        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-15 05:20:13.051 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-15 05:20:13.051 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-15 05:20:13.051 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-15 05:20:13.055 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-15 05:20:13.061 UTC [68] LOG:  database system was shut down at 2023-04-15 05:20:12 UTC
        postgres_1    | 2023-04-15 05:20:13.066 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-15 05:20:14.898 UTC [78] ERROR:  collation "da" for encoding "UTF8" does not exist at character 123
        postgres_1    | 2023-04-15 05:20:14.898 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 GEOGRAPHY NOT NULL, col1_1 GEOMETRY, col1_2 UUID NOT NULL, col1_3 JSONB NOT NULL, col1_4 TEXT COLLATE da NOT NULL, "col1   _5" INET NOT NULL, "col1""🙀_6" NAME NOT NULL, "c%pol1_7" TSVECTOR NULL, col1_8 GEOGRAPHY NOT NULL, "😦c%b1ol1_😆9" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_4 AS TEXT))) STORED);
        postgres_1    |     CREATE INDEX ON table1 (col1_2 ASC, col1_4 ASC, "col1""🙀_6" ASC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (6.07s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.11s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 GEOGRAPHY NOT NULL, col1_1 GEOMETRY, col1_2 UUID NOT NULL, col1_3 JSONB NOT NULL, col1_4 TEXT COLLATE da NOT NULL, "col1   _5" INET NOT NULL, "col1""🙀_6" NAME NOT NULL, "c%pol1_7" TSVECTOR NULL, col1_8 GEOGRAPHY NOT NULL, "😦c%b1ol1_😆9" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_4 AS TEXT))) STORED);
        test_1        |             CREATE INDEX ON table1 (col1_2 ASC, col1_4 ASC, "col1""🙀_6" ASC);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "da" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.82s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "tabl'%pe̻1" (col1_0 TSQUERY NOT NULL, "c\no,l1_1" INTERVAL, "c%vol1 _2" BOX2D NOT NULL, co😀l1_3 STRING COLLATE en NULL, "col1_
        test_1        |             4" STRING NOT NULL AS (lower(CAST(col1_0 AS STRING))) VIRTUAL, INDEX (lower(CAST(co😀l1_3 AS STRING)) ASC, co😀l1_3 ASC) WHERE "tabl'%pe̻1"."col1_
        test_1        |             4" > e'\x00':::STRING NOT VISIBLE, FAMILY (col1_0), FAMILY ("c%vol1 _2", "c\no,l1_1"), FAMILY (co😀l1_3));
        test_1        |             ALTER TABLE "tabl'%pe̻1" INJECT STATISTICS e'[{"avg_size": 30, "columns": ["\\"col1_\\n4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 428096829, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 9, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 638286367, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 28, "columns": ["\\"c\\\\no,l1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 961323670, "histo_col_type": "", "name": "__auto__", "null_count": 193605525, "row_count": 1000000000}, {"avg_size": 20, "columns": ["\\"c%vol1 _2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 427726829, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1000000000}, {"avg_size": 10, "columns": ["co\U0001F600l1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 732780160, "histo_col_type": "", "name": "__auto__", "null_count": 381207975, "row_count": 1000000000}]':::JSONB;
        test_1        |             ALTER TABLE "tabl'%pe̻1" INJECT STATISTICS e'[{"avg_size": 18, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3997422705124234574, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6695795998428130572}, {"avg_size": 12, "columns": ["\\"c\\\\no,l1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2187172513163770860, "histo_col_type": "", "name": "__auto__", "null_count": 5139091143260142724, "row_count": 6695795998428130572}, {"avg_size": 29, "columns": ["\\"c%vol1 _2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3662224414614303465, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6695795998428130572}, {"avg_size": 23, "columns": ["co\U0001F600l1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5413656451701378388, "histo_col_type": "", "name": "__auto__", "null_count": 4259754011610205619, "row_count": 6695795998428130572}, {"avg_size": 9, "columns": ["\\"col1_\\n4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2258145674735565052, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6695795998428130572}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (21.73s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 6cce6c746150307a9ecf3b529dfd633a6985c110:

        postgres_1    |                 "ta""\vb1742".col1_3 AS col2915,
        postgres_1    |                 '2000-01-01 09:00:00'::TIMESTAMP::TIMESTAMP AS col2916
        postgres_1    |             FROM
        postgres_1    |                 postgres.public."tab
😖le1"@"tab
😖le1_col1_0_🙁co'l1_6_expr_,col😓1̻_5_col
1_ 4_key"
        postgres_1    |                     AS "ta""\vb1742"
        postgres_1    |         )
        postgres_1    |             AS tab1743
        postgres_1    |     ORDER BY
        postgres_1    |         """co%ql2912" NULLS LAST, col2913 NULLS FIRST, coͨl2914 DESC NULLS LAST, col2915 NULLS FIRST, col2916 NULLS FIRST
        test_1        | --- FAIL: TestCompare (8.78s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (3.68s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare141428037/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("9"),
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT * FROM (SELECT regproc(9::INT8::INT4::INT4)::REGPROC AS col2928) AS "tab 1748" ORDER BY col2928 ASC NULLS FIRST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT * FROM (SELECT regproc(9:::INT8::INT4::INT4)::REGPROC AS col2928) AS "tab    1748" ORDER BY col2928 ASC NULLS FIRST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.97s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE t͑able1 (col1_0 REGTYPE NOT NULL, col1_1 DATE NOT NULL, PRIMARY KEY (col1_1 ASC, col1_0 ASC), UNIQUE (col1_1 ASC) WHERE t͑able1.col1_1 >= '-infinity':::DATE, INDEX (col1_1) WHERE t͑able1.col1_1 > 'infinity':::DATE, UNIQUE ((CASE WHEN col1_1 IS NULL THEN e'lE\x0fn':::STRING ELSE e'\\m\x1bs':::STRING END) DESC) WHERE t͑able1.col1_1 < '-infinity':::DATE, FAMILY (col1_0), FAMILY (col1_1));
        test_1        |             ALTER TABLE t͑able1 INJECT STATISTICS '[{"avg_size": 4, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 163042354, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 200000000}, {"avg_size": 13, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 43912331, "histo_buckets": [{"distinct_range": 0, "num_eq": 2747615508966007403, "num_range": 0, "upper_bound": "1975-10-20"}], "histo_col_type": "DATE", "name": "__auto__", "null_count": 0, "row_count": 200000000}]':::JSONB;
        test_1        |             ALTER TABLE t͑able1 INJECT STATISTICS '[{"avg_size": 31, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4061, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6000}, {"avg_size": 2, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1457, "histo_buckets": [{"distinct_range": 0, "num_eq": 30000000, "num_range": 0, "upper_bound": "1971-04-14"}, {"distinct_range": 5422536806415582000, "num_eq": 9000, "num_range": 5422536806415582195, "upper_bound": "1973-06-05"}, {"distinct_range": 0, "num_eq": 8065629710755436366, "num_range": 50000000000, "upper_bound": "1990-05-20"}, {"distinct_range": 1000, "num_eq": 1000000000, "num_range": 1000, "upper_bound": "1991-12-14"}, {"distinct_range": 0, "num_eq": 1000000000, "num_range": 2687093654149305697, "upper_bound": "1993-03-16"}, {"distinct_range": 0, "num_eq": 2000000, "num_range": 2042361096370024504, "upper_bound": "1993-10-10"}, {"distinct_range": 748322441627348600, "num_eq": 40000000000, "num_range": 748322441627348553, "upper_bound": "1994-12-16"}], "histo_col_type": "DATE", "name": "__auto__", "null_count": 0, "row_count": 6000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (29.33s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 6cce6c746150307a9ecf3b529dfd633a6985c110:

        postgres_1    | 2023-04-17 05:17:40.187 UTC [78] ERROR:  collation "da" for encoding "UTF8" does not exist at character 87
        postgres_1    | 2023-04-17 05:17:40.187 UTC [78] STATEMENT:  CREATE TABLE table1 ("co l1_0" DECIMAL NOT NULL, "c*ol1_1" INTERVAL NULL, col1_2 TEXT COLLATE da NOT NULL, col1_3 INT2 NOT NULL, col1_4 GEOGRAPHY NOT NULL, col1_5 BOX2D NULL, col1_6 TIMESTAMP NULL, "co
        postgres_1    |     l1_7" NAME NOT NULL, co😶l1_8 INT4 NOT NULL, col1_9 BOX2D NOT NULL, col😃1_10 INT4 NOT NULL, 😭col1_11 VARCHAR NOT NULL, col1_12 "char", "c'ol1_13" TEXT NULL GENERATED ALWAYS AS (CASE WHEN "c*ol1_1" IS NULL THEN NULL ELSE e'{\'\t'::TEXT END) STORED, "c ol1_14" INT8 NOT NULL GENERATED ALWAYS AS (col1_3 + 8038::INT8) STORED, col1_15 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col1_6 IS NULL THEN e'\x0eCC'::TEXT ELSE e'7 \r\x03'::TEXT END) STORED);
        postgres_1    |     CREATE UNIQUE INDEX ON table1 ("c*ol1_1" ASC, "co
        postgres_1    |     l1_7" ASC, "co l1_0" ASC, col1_6 ASC, "c'ol1_13" DESC, col1_15, 😭col1_11 ASC, col😃1_10 ASC, co😶l1_8 ASC, col1_12, "c ol1_14", col1_3, col1_2 ASC) INCLUDE (col1_4);
        postgres_1    |     CREATE INDEX ON table1 (((co😶l1_8 + col1_3) + col😃1_10), "c'ol1_13", col1_15 ASC, col1_3, lower(col1_12) DESC, "c ol1_14" ASC, col😃1_10, (CASE WHEN "c*ol1_1" IS NULL THEN e'<.X/d\x11H\bz'::TEXT ELSE 'Y'::TEXT END) DESC, col1_2);
        postgres_1    |     CREATE UNIQUE INDEX ON table1 (col1_3, 😭col1_11 ASC);
        postgres_1    |     CREATE INDEX ON table1 ("c'ol1_13" ASC, col😃1_10 DESC, col1_3 DESC, "co
        postgres_1    |     l1_7", lower(col1_12) DESC, col1_12 ASC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (4.97s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.97s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table1 ("co l1_0" DECIMAL NOT NULL, "c*ol1_1" INTERVAL NULL, col1_2 TEXT COLLATE da NOT NULL, col1_3 INT2 NOT NULL, col1_4 GEOGRAPHY NOT NULL, col1_5 BOX2D NULL, col1_6 TIMESTAMP NULL, "co
        test_1        |             l1_7" NAME NOT NULL, co😶l1_8 INT4 NOT NULL, col1_9 BOX2D NOT NULL, col😃1_10 INT4 NOT NULL, 😭col1_11 VARCHAR NOT NULL, col1_12 "char", "c'ol1_13" TEXT NULL GENERATED ALWAYS AS (CASE WHEN "c*ol1_1" IS NULL THEN NULL ELSE e'{\'\t'::TEXT END) STORED, "c ol1_14" INT8 NOT NULL GENERATED ALWAYS AS (col1_3 + 8038::INT8) STORED, col1_15 TEXT NULL GENERATED ALWAYS AS (CASE WHEN col1_6 IS NULL THEN e'\x0eCC'::TEXT ELSE e'7 \r\x03'::TEXT END) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table1 ("c*ol1_1" ASC, "co
        test_1        |             l1_7" ASC, "co l1_0" ASC, col1_6 ASC, "c'ol1_13" DESC, col1_15, 😭col1_11 ASC, col😃1_10 ASC, co😶l1_8 ASC, col1_12, "c ol1_14", col1_3, col1_2 ASC) INCLUDE (col1_4);
        test_1        |             CREATE INDEX ON table1 (((co😶l1_8 + col1_3) + col😃1_10), "c'ol1_13", col1_15 ASC, col1_3, lower(col1_12) DESC, "c ol1_14" ASC, col😃1_10, (CASE WHEN "c*ol1_1" IS NULL THEN e'<.X/d\x11H\bz'::TEXT ELSE 'Y'::TEXT END) DESC, col1_2);
        test_1        |             CREATE UNIQUE INDEX ON table1 (col1_3, 😭col1_11 ASC);
        test_1        |             CREATE INDEX ON table1 ("c'ol1_13" ASC, col😃1_10 DESC, col1_3 DESC, "co
        test_1        |             l1_7", lower(col1_12) DESC, col1_12 ASC);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "da" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.87s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 BOOL NOT NULL, col1_1 INT8 NOT NULL, "col1! _2" REGROLE NOT NULL, col1_3 BIT(47) NOT NULL, col1_4 INTERVAL NOT NULL, "%qcol1_5" DATE NOT NULL, c😯ol1_6 TIMESTAMP NOT NULL, col1_7 FLOAT4 NOT NULL, col1_8 FLOAT8 AS (col1_7 + 0.06680329889059067:::FLOAT8) VIRTUAL, PRIMARY KEY (col1_4, col1_1 DESC, "col1! _2" DESC, "%qcol1_5", col1_7 ASC, c😯ol1_6 ASC, col1_0 ASC), UNIQUE (col1_7 ASC, "%qcol1_5" DESC, "col1! _2" DESC, col1_4, col1_8 DESC), INDEX ("col1! _2" DESC, col1_8, c😯ol1_6 ASC, col1_1 ASC, col1_3 ASC, (CASE WHEN "col1! _2" IS NULL THEN '':::STRING ELSE 'yl':::STRING END) DESC), INDEX (c😯ol1_6 ASC, col1_3 DESC, col1_8 ASC, "col1! _2" DESC), UNIQUE (col1_0 DESC, col1_7 ASC, col1_8 DESC, col1_1 ASC, "%qcol1_5" DESC, c😯ol1_6 ASC, "col1! _2") STORING (col1_3) PARTITION BY LIST (col1_0, col1_7, col1_8, col1_1) (PARTITION "ta%pble1\\xa7_part0" VALUES IN ((false, 0.343036413192749:::FLOAT8, (-0.4994991582198169):::FLOAT8, (-3337643204643037769):::INT8), (false, 0.0:::FLOAT8, 1.4014353229804644:::FLOAT8, 5074876584328353779:::INT8), (true, 0.5993672013282776:::FLOAT8, (-1.0):::FLOAT8, (-4623864216698348577):::INT8), (false, (-0.7737160325050354):::FLOAT8, 2.1586016396180763:::FLOAT8, 6222229392978505315:::INT8), (true, (-1.2092950344085693):::FLOAT8, 1.7976931348623157e+308:::FLOAT8, (-32768):::INT8), (true, (-0.9972615838050842):::FLOAT8, 0.854928604781386:::FLOAT8, 1625564833821616043:::INT8), (true, (-0.7896857857704163):::FLOAT8, (-1.1188274728024183):::FLOAT8, 215161960704177962:::INT8), (true, 1.0415717363357544:::FLOAT8, 1.6086702387711367:::FLOAT8, 3632244539452294786:::INT8)), PARTITION table1_part1 VALUES IN ((false, (-0.05987320467829704):::FLOAT8, 0.05154645431526306:::FLOAT8, 1927437619161630811:::INT8), (false, (-0.6780315041542053):::FLOAT8, (-0.314922750435523):::FLOAT8, 8897350173229136834:::INT8), (true, (-0.7989897131919861):::FLOAT8, 0.9683340385336336:::FLOAT8, 6715213853339783813:::INT8), (true, (-0.9614681005477905):::FLOAT8, (-0.40410387816587373):::FLOAT8, (-1):::INT8), (true, 2.5907232761383057:::FLOAT8, (-0.9093507505193021):::FLOAT8, 7688559612555920665:::INT8), (false, (-0.5257112383842468):::FLOAT8, (-0.4810172027788884):::FLOAT8, (-3581699233577624114):::INT8), (false, (-1.0):::FLOAT8, 0.4471400672244288:::FLOAT8, 7560378952322294275:::INT8), (false, 1.2376981973648071:::FLOAT8, (-0.3029289266887053):::FLOAT8, (-128):::INT8)), PARTITION "table1_%ppart2" VALUES IN ((false, (-0.004575483035296202):::FLOAT8, 0.7894875187588051:::FLOAT8, 127:::INT8), (true, 0.7784442901611328:::FLOAT8, 0.16827077644086696:::FLOAT8, 2261749635456188487:::INT8), (true, 1.4887577295303345:::FLOAT8, 0.2882493884875972:::FLOAT8, 7909619249469002219:::INT8), (false, (-0.9758395552635193):::FLOAT8, (-0.665638544098565):::FLOAT8, (-2602388266574689729):::INT8), (true, (-0.30980268120765686):::FLOAT8, 1.8169975996425343:::FLOAT8, 6407979084091057943:::INT8), (false, 1.1129875183105469:::FLOAT8, (-1.7995232119527642):::FLOAT8, 4516926323550297153:::INT8), (false, 0.39904171228408813:::FLOAT8, 1.5718187868401539:::FLOAT8, 7211308407120026218:::INT8), (true, 0.958274781703949:::FLOAT8, 0.46868703158667113:::FLOAT8, (-8589650421429440218):::INT8)), PARTITION table1_part3 VALUES IN ((true, 1.0:::FLOAT8, (-0.9808564992661821):::FLOAT8, (-8127042242590062061):::INT8), (false, 1.401298464324817e-45:::FLOAT8, (-1.6146159139523126):::FLOAT8, (-701016538690819983):::INT8), (false, 1.1944975852966309:::FLOAT8, 0.14344770240812843:::FLOAT8, (-9104270524571415430):::INT8), (false, (-1.166749119758606):::FLOAT8, (-0.19349647807265813):::FLOAT8, 3510951967739518173:::INT8), (false, 0.7282466888427734:::FLOAT8, 1.227234214305534:::FLOAT8, 5252404738598176552:::INT8), (false, (-0.24548161029815674):::FLOAT8, 0.37335412262016376:::FLOAT8, (-128):::INT8), (true, 0.1668747067451477:::FLOAT8, 0.20443544330488217:::FLOAT8, (-6132101637096081953):::INT8), (false, (-0.736530065536499):::FLOAT8, (-0.4242532179617786):::FLOAT8, (-6010818214452796977):::INT8)), PARTITION "tab͘ le1_part4" VALUES IN ((false, (-0.5624302625656128):::FLOAT8, 0.15212723276721601:::FLOAT8, 993917230118470695:::INT8), (true, 0.5431700348854065:::FLOAT8, 1.010546606317781:::FLOAT8, (-8799737561153091633):::INT8), (true, 1.5068836212158203:::FLOAT8, 0.3688298730118064:::FLOAT8, 8676124210370441996:::INT8), (true, (-0.7632553577423096):::FLOAT8, 3.4028234663852886e+38:::FLOAT8, 1351507242182180257:::INT8), (true, (-0.44043201208114624):::FLOAT8, (-0.14257385416642776):::FLOAT8, 6029675257685864557:::INT8), (false, 0.05470771715044975:::FLOAT8, 1.5333329767903932:::FLOAT8, (-893038889300277032):::INT8), (true, (-1.2531028985977173):::FLOAT8, (-0.9243096641128512):::FLOAT8, 8215430562970778913:::INT8), (false, 0.31509679555892944:::FLOAT8, 0.8763431863851778:::FLOAT8, (-1771270933270731746):::INT8)), PARTITION "table1_
        test_1        |             part5" VALUES IN ((false, (-1.508293628692627):::FLOAT8, (-0.45460342388883723):::FLOAT8, 6194455822509745806:::INT8), (true, (-2.020491600036621):::FLOAT8, (-0.30172634235277096):::FLOAT8, (-2393730011142804862):::INT8), (true, (-1.6212009191513062):::FLOAT8, (-1.0199978828560674):::FLOAT8, 4827588059805449354:::INT8), (false, (-0.43790939450263977):::FLOAT8, (-0.925439527038711):::FLOAT8, (-7809695369991720268):::INT8), (false, (-1.0214380025863647):::FLOAT8, (-1.2401878755616598):::FLOAT8, (-5884285521634056458):::INT8), (false, 1.340408205986023:::FLOAT8, (-1.5921241167403384):::FLOAT8, 1755508926810521580:::INT8), (true, 1.3729881048202515:::FLOAT8, (-0.7647794470244095):::FLOAT8, (-4829322160523705056):::INT8), (false, 0.006129944697022438:::FLOAT8, 0.39895630058163545:::FLOAT8, (-3285349009157346821):::INT8)), PARTITION table1_part6 VALUES IN ((true, 0.08887451887130737:::FLOAT8, (-0.5889813105608188):::FLOAT8, 4203730236903691518:::INT8), (false, 0.06853752583265305:::FLOAT8, (-0.3761134890602933):::FLOAT8, 4531704358605838869:::INT8), (false, 0.0:::FLOAT8, 1.0764561006037847:::FLOAT8, (-5391037483955783417):::INT8), (false, 1.4908006191253662:::FLOAT8, (-0.23822607649499883):::FLOAT8, 8627027923903991763:::INT8), (false, (-0.2824763357639313):::FLOAT8, (-0.2412909312251823):::FLOAT8, 4856894418819410769:::INT8), (true, 1.401298464324817e-45:::FLOAT8, (-1.482698072611233):::FLOAT8, 3511750896798267435:::INT8), (false, (-0.18583543598651886):::FLOAT8, 1.4110848862820087:::FLOAT8, 1728217201286499984:::INT8), (false, (-1.0):::FLOAT8, 5e-324:::FLOAT8, (-32768):::INT8))) WHERE (((NOT table1.col1_0) AND (table1."%qcol1_5" >= 'infinity':::DATE)) AND (table1.col1_1 > (-2147483648):::INT8)) AND (table1.col1_7 <= '+Inf':::FLOAT8), INDEX (col1_8 ASC, col1_3, col1_4 ASC, col1_1 ASC, "col1! _2" ASC) WHERE (((((table1.c😯ol1_6 > '294276-12-31 23:59:59.999999':::TIMESTAMP) AND (NOT table1.col1_0)) OR (table1.col1_8 > 5e-324:::FLOAT8)) AND (table1."%qcol1_5" < '1970-01-01':::DATE)) OR (table1.col1_1 = (-9223372036854775807):::INT8)) OR (table1.col1_7 < 1.0:::FLOAT8), FAMILY (col1_4), FAMILY (c😯ol1_6, col1_3, col1_7), FAMILY ("%qcol1_5"), FAMILY (col1_0), FAMILY (col1_1, "col1! _2"));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 30, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 631, "histo_col_type": "", "name": "__auto__", "null_count": 517, "row_count": 3000}, {"avg_size": 19, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 653, "histo_buckets": [{"distinct_range": 0, "num_eq": 400000, "num_range": 0, "upper_bound": "true"}], "histo_col_type": "BOOL", "name": "__auto__", "null_count": 0, "row_count": 3000}, {"avg_size": 6, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1491, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000}, {"avg_size": 1, "columns": ["\\"col1! _2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1713, "histo_buckets": [{"distinct_range": 0, "num_eq": 755678413034773017, "num_range": 0, "upper_bound": "403275804"}, {"distinct_range": 412.83539098949615, "num_eq": 5000000000, "num_range": 500, "upper_bound": "635444028"}, {"distinct_range": 0, "num_eq": 600, "num_range": 1000000000, "upper_bound": "1628023376"}, {"distinct_range": 971464.0675509421, "num_eq": 80000000000, "num_range": 2000000, "upper_bound": "2074262912"}, {"distinct_range": 399715360562846700, "num_eq": 3838537333429098402, "num_range": 1571615391913538584, "upper_bound": "2504245324"}, {"distinct_range": 9000000000, "num_eq": 7713437276937043033, "num_range": 9000000000, "upper_bound": "2924842770"}, {"distinct_range": 300000, "num_eq": 0, "num_range": 300000, "upper_bound": "3812313337"}], "histo_col_type": "REGROLE", "name": "__auto__", "null_count": 0, "row_count": 3000}, {"avg_size": 5, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2126, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000}, {"avg_size": 11, "columns": ["\\"%qcol1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2585, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000}, {"avg_size": 23, "columns": ["c\U0001F62Fol1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 81, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3000}, {"avg_size": 12, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2574, "histo_buckets": [{"distinct_range": 0, "num_eq": 5902775567145951686, "num_range": 0, "upper_bound": "-0.1947573721408844"}, {"distinct_range": 4000000, "num_eq": 200, "num_range": 4000000, "upper_bound": "0.5532668232917786"}], "histo_col_type": "FLOAT4", "name": "__auto__", "null_count": 0, "row_count": 3000}, {"avg_size": 28, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 21, "histo_buckets": [{"distinct_range": 0, "num_eq": 10000, "num_range": 0, "upper_bound": "-73 years -3 mons -927 days -15:02:01.801947"}, {"distinct_range": 0, "num_eq": 231167874433878747, "num_range": 3820352589727324598, "upper_bound": "-61 years -10 mons -603 days -11:19:20.787696"}, {"distinct_range": 0, "num_eq": 2824224822080007289, "num_range": 2829344124236503494, "upper_bound": "-23 years -5 mons -959 days -16:06:06.398854"}, {"distinct_range": 200000000, "num_eq": 5855481328233249875, "num_range": 200000000, "upper_bound": "-18 years -7 mons -678 days -12:22:33.577496"}, {"distinct_range": 0, "num_eq": 9000000000, "num_range": 3455866536125492065, "upper_bound": "-5 years -2 mons -356 days -02:16:02.610961"}, {"distinct_range": 3840789106819746300, "num_eq": 600000, "num_range": 3840789106819746265, "upper_bound": "70 years 780 days 15:14:40.077353"}, {"distinct_range": 2998266294353278000, "num_eq": 10000000, "num_range": 2998266294353277708, "upper_bound": "74 years 2 mons 947 days 03:54:01.852379"}, {"distinct_range": 172.1001067260738, "num_eq": 200, "num_range": 300, "upper_bound": "82 years 8 mons 150 days 06:01:41.06322"}], "histo_col_type": "INTERVAL", "name": "__auto__", "null_count": 0, "row_count": 3000}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 0, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1146285539085025997, "histo_buckets": [{"distinct_range": 0, "num_eq": 400, "num_range": 0, "upper_bound": "-76 years -3 mons -598 days -16:16:03.415471"}, {"distinct_range": 0, "num_eq": 377824511120747144, "num_range": 9000000000, "upper_bound": "-44 years -10 mons -904 days -00:22:53.633384"}, {"distinct_range": 0, "num_eq": 6000, "num_range": 5636628637939799000, "upper_bound": "-27 years -6 mons -255 days -06:49:55.82204"}, {"distinct_range": 0, "num_eq": 90, "num_range": 0, "upper_bound": "-27 years -308 days -10:43:17.844884"}, {"distinct_range": 5258941817098460000, "num_eq": 80000, "num_range": 5258941817098459759, "upper_bound": "1 day"}, {"distinct_range": 700000000, "num_eq": 500, "num_range": 700000000, "upper_bound": "52 years 11 mons 374 days 07:55:46.130006"}, {"distinct_range": 79408082540546000, "num_eq": 0, "num_range": 1278096014884650413, "upper_bound": "57 years 3 mons 207 days 06:10:23.606008"}, {"distinct_range": 0, "num_eq": 6905493621725269384, "num_range": 578500081803953139, "upper_bound": "62 years 7 mons 49 days 06:39:19.059391"}, {"distinct_range": 45529890.51596679, "num_eq": 8000000, "num_range": 70000000, "upper_bound": "72 years 11 mons 272 days 07:12:40.009502"}], "histo_col_type": "INTERVAL", "name": "__auto__", "null_count": 0, "row_count": 1254234049247928432}, {"avg_size": 27, "columns": ["c\U0001F62Fol1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 461964741401133528, "histo_buckets": [{"distinct_range": 0, "num_eq": 300000, "num_range": 0, "upper_bound": "1987-09-05 21:54:52.000172"}, {"distinct_range": 300, "num_eq": 2000, "num_range": 300, "upper_bound": "2013-10-22 16:49:54.000066"}, {"distinct_range": 3365734789009609700, "num_eq": 1890040005461177553, "num_range": 3365734789009609887, "upper_bound": "2029-08-22 22:12:42.000856"}, {"distinct_range": 1682366.2858086152, "num_eq": 50000000, "num_range": 4000000, "upper_bound": "2032-11-06 10:05:40.000238"}], "histo_col_type": "TIMESTAMP", "name": "__auto__", "null_count": 0, "row_count": 1254234049247928432}, {"avg_size": 11, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 523387031687357421, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1254234049247928432}, {"avg_size": 0, "columns": ["\\"%qcol1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1103971897633325553, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1254234049247928432}, {"avg_size": 27, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 356726400585716800, "histo_buckets": [{"distinct_range": 0, "num_eq": 10000000000, "num_range": 0, "upper_bound": "0.0"}], "histo_col_type": "FLOAT8", "name": "__auto__", "null_count": 485636915923815717, "row_count": 1254234049247928432}, {"avg_size": 13, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1092777491183052761, "histo_buckets": [{"distinct_range": 0, "num_eq": 6684915501549566077, "num_range": 0, "upper_bound": "false"}, {"distinct_range": 9000, "num_eq": 3724802927794632702, "num_range": 9000, "upper_bound": "true"}], "histo_col_type": "BOOL", "name": "__auto__", "null_count": 0, "row_count": 1254234049247928432}, {"avg_size": 25, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 928519146673816533, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1254234049247928432}, {"avg_size": 23, "columns": ["\\"col1! _2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 775258739008203487, "histo_buckets": [{"distinct_range": 0, "num_eq": 4445613692392017306, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 0, "num_eq": 2170545823978771839, "num_range": 30000000, "upper_bound": "140401262"}, {"distinct_range": 0, "num_eq": 5000, "num_range": 50000000000, "upper_bound": "593375107"}, {"distinct_range": 0, "num_eq": 9047208379377138221, "num_range": 5400299808298647862, "upper_bound": "1211299238"}, {"distinct_range": 8740694.95574304, "num_eq": 3000000, "num_range": 100000000, "upper_bound": "3563168164"}, {"distinct_range": 0, "num_eq": 1257848563963871593, "num_range": 7657388671475811529, "upper_bound": "3708385605"}, {"distinct_range": 21627.1338122019, "num_eq": 117391735079763218, "num_range": 70000, "upper_bound": "4001804015"}, {"distinct_range": 2000000, "num_eq": 0, "num_range": 2000000, "upper_bound": "4142857754"}], "histo_col_type": "REGROLE", "name": "__auto__", "null_count": 0, "row_count": 1254234049247928432}, {"avg_size": 24, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 604290978993959283, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1254234049247928432}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (19.86s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 12607684868d04f957b3385f142e4e8b9b55c799:

        postgres_1    |         )
        postgres_1    |             AS tab5043
        postgres_1    |     ORDER BY
        postgres_1    |         col9274 DESC NULLS LAST, 😈col9275 DESC NULLS LAST, 😾col9276 ASC, col9277 NULLS FIRST
        test_1        | --- FAIL: TestCompare (11.58s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (7.74s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2298095646/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("6"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT * FROM (SELECT regproc(6:::INT8::INT4::INT4)::REGPROC AS col9323) AS tab5073 ORDER BY col9323 ASC NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT * FROM (SELECT regproc(6::INT8::INT4::INT4)::REGPROC AS col9323) AS tab5073 ORDER BY col9323 ASC NULLS FIRST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.71s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "tabl,e1" ("coL1̬_0" INT4[] NULL, "co😉l1_%q1" STRING COLLATE de NOT NULL, "cOl1
        test_1        |             _"" 2" BOOL NULL, "coL1_3" VARCHAR NOT NULL, col1_4 DATE NOT NULL, "C̦(ol1_5" TIMETZ NULL, """col1\\U000CE3AB_6" INT2, col1_7 TIMESTAMP NULL, "coļ1_%p 8" VARCHAR NOT NULL, "col1_'9" BOX2D NULL, col1_10 TIMESTAMP NOT NULL, col1_11 TIMESTAMPTZ NOT NULL, c😝ol1_̴12 INET NOT NULL, "�col1_13" REGTYPE, col1_14 STRING NOT NULL AS (CASE WHEN col1_4 IS NULL THEN '':::STRING ELSE e'x\x055ZtV':::STRING END) VIRTUAL, PRIMARY KEY (col1_14 DESC), UNIQUE (lower("coļ1_%p 8"), col1_11 DESC, col1_7 ASC, "C̦(ol1_5" ASC, (CASE WHEN "coL1̬_0" IS NULL THEN e'm-*t]C?\x1b\b':::STRING ELSE e'{-\x14yk,\x07\x1b':::STRING END) ASC, """col1\\U000CE3AB_6" ASC, col1_4 DESC, "coL1_3", "col1_'9", col1_14 DESC) STORING ("co😉l1_%q1", "cOl1
        test_1        |             _"" 2", "coļ1_%p 8", "�col1_13") WHERE (((((("tabl,e1".col1_4 != '4714-11-24 BC':::DATE) AND ("tabl,e1".col1_10 != '0001-01-01 00:00:00':::TIMESTAMP)) OR ("tabl,e1".col1_7 = '0001-01-01 00:00:00':::TIMESTAMP)) OR (NOT "tabl,e1"."cOl1
        test_1        |             _"" 2")) OR ("tabl,e1"."coļ1_%p 8" <= e'\U00002603':::STRING)) OR ("tabl,e1".col1_11 <= '4714-11-24 00:00:00+00 BC':::TIMESTAMPTZ)) AND ("tabl,e1"."coL1_3" < '"':::STRING), INDEX ("�col1_13", "coL1̬_0" ASC, "coL1_3" ASC, "cOl1
        test_1        |             _"" 2", col1_14, "co😉l1_%q1" DESC, "col1_'9", col1_4 DESC, lower(CAST(c😝ol1_̴12 AS STRING)), (CASE WHEN col1_4 IS NULL THEN '':::STRING ELSE e'#lV\x04j]f{':::STRING END) DESC) STORING ("C̦(ol1_5", col1_7) WHERE "tabl,e1".col1_10 = '2001-01-01 00:00:00 BC':::TIMESTAMP, FAMILY ("coļ1_%p 8"), FAMILY ("C̦(ol1_5", "cOl1
        test_1        |             _"" 2"), FAMILY ("col1_'9"), FAMILY (col1_10), FAMILY ("�col1_13", "coL1̬_0"), FAMILY (col1_4), FAMILY ("coL1_3"), FAMILY ("""col1\\U000CE3AB_6", "co😉l1_%q1", col1_7, c😝ol1_̴12, col1_11));
        test_1        |             ALTER TABLE "tabl,e1" INJECT STATISTICS e'[{"avg_size": 27, "columns": ["\\"co\U0001F609l1_%q1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2858, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4000}, {"avg_size": 9, "columns": ["\\"coL1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 951, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4000}, {"avg_size": 25, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2785, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4000}, {"avg_size": 2, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2676, "histo_buckets": [{"distinct_range": 0, "num_eq": 778019302194960206, "num_range": 0, "upper_bound": ":d\\u001c14"}, {"distinct_range": 0, "num_eq": 3090768921360482554, "num_range": 50000000, "upper_bound": "X"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 4000}, {"avg_size": 16, "columns": ["\\"\\"\\"col1\\\\\\\\U000CE3AB_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1033, "histo_col_type": "", "name": "__auto__", "null_count": 1384, "row_count": 4000}, {"avg_size": 29, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1306, "histo_col_type": "", "name": "__auto__", "null_count": 3552, "row_count": 4000}, {"avg_size": 31, "columns": ["\\"co\u013C1_%p 8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2384, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4000}, {"avg_size": 30, "columns": ["\\"col1_\'9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2727, "histo_col_type": "", "name": "__auto__", "null_count": 1860, "row_count": 4000}, {"avg_size": 28, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 422, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4000}, {"avg_size": 9, "columns": ["\\"\\u000ccol1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2915, "histo_col_type": "", "name": "__auto__", "null_count": 3625, "row_count": 4000}, {"avg_size": 0, "columns": ["\\"coL1\u032C_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 592, "histo_col_type": "", "name": "__auto__", "null_count": 1638, "row_count": 4000}, {"avg_size": 31, "columns": ["\\"cOl1\\n_\\"\\"\\t2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1218, "histo_col_type": "", "name": "__auto__", "null_count": 536, "row_count": 4000}, {"avg_size": 19, "columns": ["c\U0001F61Dol1_\u033412"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1625, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4000}, {"avg_size": 27, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 456, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4000}, {"avg_size": 10, "columns": ["\\"C\u0326(ol1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2159, "histo_col_type": "", "name": "__auto__", "null_count": 917, "row_count": 4000}]':::JSONB;
        test_1        |             ALTER TABLE "tabl,e1" INJECT STATISTICS e'[{"avg_size": 24, "columns": ["c\U0001F61Dol1_\u033412"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2234693558708476636, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5940027012553536794}, {"avg_size": 26, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4802278590186415237, "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 5940027012553536794}, {"avg_size": 8, "columns": ["\\"co\U0001F609l1_%q1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4815925488548063986, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5940027012553536794}, {"avg_size": 3, "columns": ["\\"coL1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4323454528631536823, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5940027012553536794}, {"avg_size": 29, "columns": ["\\"\\"\\"col1\\\\\\\\U000CE3AB_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3808137718543913923, "histo_col_type": "", "name": "__auto__", "null_count": 1963035331644463359, "row_count": 5940027012553536794}, {"avg_size": 18, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 770141692624493168, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5940027012553536794}, {"avg_size": 2, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3677293444824251482, "histo_col_type": "", "name": "__auto__", "null_count": 4776377001346867511, "row_count": 5940027012553536794}, {"avg_size": 15, "columns": ["\\"col1_\'9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2404598398440222584, "histo_col_type": "", "name": "__auto__", "null_count": 1002124566715168194, "row_count": 5940027012553536794}, {"avg_size": 23, "columns": ["\\"co\u013C1_%p 8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2603844607395210838, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5940027012553536794}, {"avg_size": 27, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4345552293106168446, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5940027012553536794}, {"avg_size": 22, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 978822724516832985, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5940027012553536794}, {"avg_size": 7, "columns": ["\\"coL1\u032C_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5426927777545446794, "histo_col_type": "", "name": "__auto__", "null_count": 1595653726004770377, "row_count": 5940027012553536794}, {"avg_size": 27, "columns": ["\\"cOl1\\n_\\"\\"\\t2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3972031055940214852, "histo_col_type": "", "name": "__auto__", "null_count": 744393435278090253, "row_count": 5940027012553536794}, {"avg_size": 16, "columns": ["\\"C\u0326(ol1_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2896723130621717589, "histo_col_type": "", "name": "__auto__", "null_count": 4289431771215928847, "row_count": 5940027012553536794}, {"avg_size": 18, "columns": ["\\"\\u000ccol1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4188801554169094492, "histo_buckets": [{"distinct_range": 0, "num_eq": 2437659561019281776, "num_range": 0, "upper_bound": "819212769"}, {"distinct_range": 730169.5502885508, "num_eq": 20, "num_range": 800000, "upper_bound": "1191899412"}, {"distinct_range": 70000000, "num_eq": 7691885675046152223, "num_range": 70000000, "upper_bound": "1448151034"}, {"distinct_range": 80000, "num_eq": 5660994850002341346, "num_range": 80000, "upper_bound": "3442950566"}], "histo_col_type": "REGTYPE", "name": "__auto__", "null_count": 1643708630785340644, "row_count": 5940027012553536794}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (34.87s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 2f86475f2e3d713b4c8c976c34dba99acce7c4c7:

        test_1        | I230419 05:19:04.997688 23 testutils/soon.go:41  [-] 1  SucceedsSoon: dial tcp 172.18.0.4:5432: connect: connection refused
        postgres_1    | 2023-04-19 05:19:05.016 UTC [48] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-19 05:19:05.129 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-19 05:19:05.129 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-19 05:19:05.129 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-19 05:19:05.133 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-19 05:19:05.138 UTC [67] LOG:  database system was shut down at 2023-04-19 05:19:04 UTC
        postgres_1    | 2023-04-19 05:19:05.143 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-19 05:19:06.994 UTC [77] ERROR:  collation "da" for encoding "UTF8" does not exist at character 131
        postgres_1    | 2023-04-19 05:19:06.994 UTC [77] STATEMENT:  CREATE TABLE t😡able2 ("co%14l2_0" INET NOT NULL, col2_1 BIT(18) NULL, col2_2 GEOMETRY NULL, c͜ol2_3 INT4 NOT NULL, "
col2_4" TEXT COLLATE da, col2_5 REGROLE, "%pcol2_%q6" REGROLE, col2_7 REGCLASS NULL, col2_8 CHAR NOT NULL, col2_9 BOOL NOT NULL, col2_10 TEXT NOT NULL GENERATED ALWAYS AS (lower(col2_8)) STORED, "co l̖2_11" TEXT GENERATED ALWAYS AS (lower(CAST("
col2_4" AS TEXT))) STORED, "col2_'12" INT8 NOT NULL GENERATED ALWAYS AS (c͜ol2_3 + 229516893::INT8) STORED, "'😿col2_13" TEXT NULL GENERATED ALWAYS AS (CASE WHEN col2_7 IS NULL THEN e'3j\x19'::TEXT ELSE e'7H\x1c\x11\x07\x046$Q'::TEXT END) STORED, "col2%bb_14" TEXT GENERATED ALWAYS AS (CASE WHEN col2_5 IS NULL THEN e'\x1cd\x04h'::TEXT ELSE e'M\x11'::TEXT END) STORED);
        postgres_1    |     CREATE UNIQUE INDEX ON t😡able2 (col2_8 DESC, c͜ol2_3, col2_1 ASC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.80s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.99s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE t😡able2 ("co%14l2_0" INET NOT NULL, col2_1 BIT(18) NULL, col2_2 GEOMETRY NULL, c͜ol2_3 INT4 NOT NULL, "
col2_4" TEXT COLLATE da, col2_5 REGROLE, "%pcol2_%q6" REGROLE, col2_7 REGCLASS NULL, col2_8 CHAR NOT NULL, col2_9 BOOL NOT NULL, col2_10 TEXT NOT NULL GENERATED ALWAYS AS (lower(col2_8)) STORED, "co l̖2_11" TEXT GENERATED ALWAYS AS (lower(CAST("
col2_4" AS TEXT))) STORED, "col2_'12" INT8 NOT NULL GENERATED ALWAYS AS (c͜ol2_3 + 229516893::INT8) STORED, "'😿col2_13" TEXT NULL GENERATED ALWAYS AS (CASE WHEN col2_7 IS NULL THEN e'3j\x19'::TEXT ELSE e'7H\x1c\x11\x07\x046$Q'::TEXT END) STORED, "col2%bb_14" TEXT GENERATED ALWAYS AS (CASE WHEN col2_5 IS NULL THEN e'\x1cd\x04h'::TEXT ELSE e'M\x11'::TEXT END) STORED);
        test_1        |             CREATE UNIQUE INDEX ON t😡able2 (col2_8 DESC, c͜ol2_3, col2_1 ASC);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "da" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.68s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "Table1" (col1_0 INT8 NOT NULL, col1_1 DECIMAL, col1_2 BOX2D NOT NULL, "c ol1_3" TSQUERY, co😓l1_4 TIMESTAMP NULL, col1_5 GEOMETRY NOT NULL, col1_6 STRING NULL AS (CASE WHEN co😓l1_4 IS NULL THEN e'qM5\x1e\x06':::STRING ELSE e'b?}\x1cE':::STRING END) STORED, UNIQUE (co😓l1_4 ASC, col1_2 DESC, col1_6, col1_0 ASC) STORING (col1_5) WHERE ("Table1".co😓l1_4 >= '3000-01-01 00:00:00':::TIMESTAMP) OR ("Table1".col1_0 <= 32767:::INT8), UNIQUE (col1_2 ASC) STORING (col1_1, "c ol1_3", co😓l1_4, col1_6) WHERE ("Table1".co😓l1_4 = '2001-01-01 00:00:00 BC':::TIMESTAMP) OR ("Table1".col1_0 < 0:::INT8), INDEX (col1_6 DESC) NOT VISIBLE, FAMILY (col1_0), FAMILY (col1_2), FAMILY (col1_1, col1_5, co😓l1_4), FAMILY ("c ol1_3"), FAMILY (col1_6));
        test_1        |             ALTER TABLE "Table1" INJECT STATISTICS e'[{"avg_size": 17, "columns": ["co\U0001F613l1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 23604291205, "histo_buckets": [{"distinct_range": 0, "num_eq": 80000, "num_range": 0, "upper_bound": "1973-07-05 14:33:02.000183"}, {"distinct_range": 0, "num_eq": 10000, "num_range": 4019818786275914913, "upper_bound": "1975-05-01 02:16:59.000743"}, {"distinct_range": 1010146466483418000, "num_eq": 4738010026935564686, "num_range": 2188310585722044547, "upper_bound": "1979-09-29 17:39:23.000454"}, {"distinct_range": 0, "num_eq": 60000000, "num_range": 800, "upper_bound": "1995-05-25 17:18:31.000305"}, {"distinct_range": 0, "num_eq": 4000000000, "num_range": 30, "upper_bound": "2018-05-20 16:43:35.000799"}, {"distinct_range": 375.62589955761894, "num_eq": 500, "num_range": 900, "upper_bound": "2029-07-19 22:48:02.000231"}, {"distinct_range": 3004751966905416000, "num_eq": 900000000, "num_range": 3004751966905416271, "upper_bound": "2030-10-17 16:15:57.000733"}], "histo_col_type": "TIMESTAMP", "name": "__auto__", "null_count": 34717310880, "row_count": 40000000000}, {"avg_size": 28, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8559032168, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000000}, {"avg_size": 4, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 31754304004, "histo_buckets": [{"distinct_range": 0, "num_eq": 1577101516377093538, "num_range": 0, "upper_bound": "\\u00088g\\u0002_"}, {"distinct_range": 9035358151376171000, "num_eq": 9185825277890745188, "num_range": 9035358151376170600, "upper_bound": "\\""}, {"distinct_range": 0, "num_eq": 2187969098627575574, "num_range": 0, "upper_bound": "%m\'"}, {"distinct_range": 0, "num_eq": 90000, "num_range": 7820114482595020051, "upper_bound": "%qc4z"}, {"distinct_range": 2645091365345101300, "num_eq": 200, "num_range": 6243939242114590567, "upper_bound": "@00E"}, {"distinct_range": 0, "num_eq": 500000000, "num_range": 8000000, "upper_bound": "G0f\\u0006#v\\u001for"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 33119512975, "row_count": 40000000000}, {"avg_size": 7, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 35092714654, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000000}, {"avg_size": 7, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 23760477527, "histo_col_type": "", "name": "__auto__", "null_count": 32999754211, "row_count": 40000000000}, {"avg_size": 29, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 28442747344, "histo_buckets": [{"distinct_range": 0, "num_eq": 2000000, "num_range": 0, "upper_bound": "BOX(-10 -10,10 10)"}, {"distinct_range": 1103531418221625000, "num_eq": 3428689426268997693, "num_range": 2022335711195103903, "upper_bound": "BOX(-0.8372985469746004 -1.7488932057408069,0.14324828811059798 -1.6657942046622622)"}, {"distinct_range": 366.6921194192598, "num_eq": 0, "num_range": 700, "upper_bound": "BOX(-0.755414153062205 -0.3308296027559168,-0.6045730759664953 0.49905480151943654)"}, {"distinct_range": 2576613807822508000, "num_eq": 6999686261455408006, "num_range": 7395945960841098710, "upper_bound": "BOX(-0.5660477047142287 -1.132930797230836,0.7203506949121463 1.982802815288807)"}, {"distinct_range": 0, "num_eq": 6137115150955363759, "num_range": 600000000, "upper_bound": "BOX(-0.4317724501194776 -1.5302362537432064,1.503298106808789 -0.09029728185944164)"}, {"distinct_range": 4918577120950203000, "num_eq": 20000, "num_range": 6424094296406976400, "upper_bound": "BOX(-0.23886834327868325 -0.8758181569651718,0.4203490372629459 0.07590998709432001)"}, {"distinct_range": 0, "num_eq": 4595170443315654770, "num_range": 1230282368233866881, "upper_bound": "BOX(0.14027107226467106 -0.8166998645974957,1.4174812880560772 -0.7249561667568658)"}, {"distinct_range": 0, "num_eq": 2000000000, "num_range": 6037276414322971632, "upper_bound": "BOX(0.18327433170979912 0.0005063384235559631,0.5892439888067468 0.23452383692430456)"}, {"distinct_range": 7537731794202655000, "num_eq": 2605089094358442120, "num_range": 7537731794202655090, "upper_bound": "BOX(0.4472083011626067 0.01912020199653136,1.1427051498409369 1.461679561935238)"}], "histo_col_type": "BOX2D", "name": "__auto__", "null_count": 0, "row_count": 40000000000}, {"avg_size": 22, "columns": ["\\"c ol1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 33347785095, "histo_col_type": "", "name": "__auto__", "null_count": 29650608760, "row_count": 40000000000}]':::JSONB;
        test_1        |             ALTER TABLE "Table1" INJECT STATISTICS e'[{"avg_size": 23, "columns": ["co\U0001F613l1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1842950059838226183, "histo_buckets": [{"distinct_range": 0, "num_eq": 2000, "num_range": 0, "upper_bound": "1985-01-03 08:33:51.000404"}, {"distinct_range": 0, "num_eq": 6543365609506576477, "num_range": 5000000000, "upper_bound": "2012-04-08 10:27:17.00098"}, {"distinct_range": 0, "num_eq": 100000, "num_range": 7832947221321884109, "upper_bound": "2020-04-30 10:48:02.000718"}, {"distinct_range": 31125.996640628087, "num_eq": 1501825939486074888, "num_range": 40000, "upper_bound": "3000-01-01 00:00:00"}], "histo_col_type": "TIMESTAMP", "name": "__auto__", "null_count": 5200850326029017564, "row_count": 7614348686761051456}, {"avg_size": 8, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5720112365102741203, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7614348686761051456}, {"avg_size": 14, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2771252808048801442, "histo_buckets": [{"distinct_range": 0, "num_eq": 300, "num_range": 0, "upper_bound": "\\u001d2C\\u000f\\u0013]"}, {"distinct_range": 3260873989432249000, "num_eq": 9064446508301854186, "num_range": 7068282256314207429, "upper_bound": "4_YPEK"}, {"distinct_range": 60, "num_eq": 8807940132936299316, "num_range": 60, "upper_bound": "DN6"}, {"distinct_range": 90000000000, "num_eq": 4433735089442451349, "num_range": 90000000000, "upper_bound": "``;Ml\\u0008"}, {"distinct_range": 4841955.121060276, "num_eq": 5607513351075918904, "num_range": 7000000, "upper_bound": "a[;"}, {"distinct_range": 0, "num_eq": 70, "num_range": 3923394470144403280, "upper_bound": "f5["}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 6621714967827672905, "row_count": 7614348686761051456}, {"avg_size": 1, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1614122900595219098, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7614348686761051456}, {"avg_size": 3, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6924333144691636287, "histo_col_type": "", "name": "__auto__", "null_count": 1061033708923313775, "row_count": 7614348686761051456}, {"avg_size": 11, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 187688101394634521, "histo_col_type": "BOX2D", "name": "__auto__", "null_count": 0, "row_count": 7614348686761051456}, {"avg_size": 0, "columns": ["\\"c ol1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6871825820486309851, "histo_col_type": "", "name": "__auto__", "null_count": 4204046761028447792, "row_count": 7614348686761051456}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (21.01s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ ad6ce866ea3b5c5bb47ba9a0ac19b721a0c98add:

        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (17.09s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1332559453/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("false"),
        test_1        |             +   string("f"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT name(('I':::STRING::STRING::STRING % 'F':::STRING::STRING::STRING)::BOOL::BOOL)::NAME AS "Col21033")
        test_1        |                     AS "t%pab 12159"
        test_1        |             ORDER BY
        test_1        |                 "Col21033" DESC NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT name(('I'::TEXT::TEXT::TEXT % 'F'::TEXT::TEXT::TEXT)::BOOL::BOOL)::NAME AS "Col21033")
        test_1        |                     AS "t%pab 12159"
        test_1        |             ORDER BY
        test_1        |                 "Col21033" DESC NULLS LAST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.71s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 BIT NOT NULL, col1_1 BYTES, col1_2 "char", col1_3 INTERVAL NOT NULL, col1_4 JSONB NOT NULL, col1_5 GEOMETRY[] NOT NULL, "col{1_6" INTERVAL, "c%qo l1_7" OID, col1_8 TSVECTOR NOT NULL, col1_9 BOOL NOT NULL, col1_10 DECIMAL, col1_11 REGCLASS, col1_12 TSQUERY NOT NULL, col1_13 STRING AS (CASE WHEN col1_11 IS NULL THEN e'T_x{\x01':::STRING ELSE e'<\x01=+!B1C\'':::STRING END) VIRTUAL, INDEX (lower(CAST(col1_4 AS STRING)), col1_2 ASC, lower(CAST(col1_0 AS STRING)) DESC, col1_1 ASC) WHERE table1.col1_13 = e'\x00':::STRING, INDEX ("col{1_6", col1_9) NOT VISIBLE, INVERTED INDEX (col1_0 DESC, lower(CAST("c%qo l1_7" AS STRING)), "col{1_6" ASC, col1_5) NOT VISIBLE, INDEX (col1_11 ASC, lower(CAST(col1_0 AS STRING)), lower(CAST(col1_9 AS STRING)), col1_3 ASC, (CASE WHEN "col{1_6" IS NULL THEN '({Wy7':::STRING ELSE '':::STRING END) ASC) STORING (col1_0, col1_1, col1_4, "c%qo l1_7") WHERE ((((table1.col1_2 >= e'\U00002603':::STRING) AND (NOT table1.col1_9)) AND (table1.col1_13 != 'X':::STRING)) AND (table1.col1_1 > '\xe29883':::BYTES)) AND (table1.col1_10 > '-Infinity':::DECIMAL) NOT VISIBLE, FAMILY ("c%qo l1_7", col1_5, col1_10), FAMILY (col1_0), FAMILY (col1_8, col1_9), FAMILY (col1_12, col1_11, col1_2, "col{1_6"), FAMILY (col1_4), FAMILY (col1_3), FAMILY (col1_1));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 1, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 857, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 16, "columns": ["\\"c%qo l1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 816, "histo_col_type": "", "name": "__auto__", "null_count": 176, "row_count": 900}, {"avg_size": 24, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 811, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 30, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 42, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 17, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 483, "histo_buckets": [{"distinct_range": 0, "num_eq": 80000, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 80000000, "num_eq": 300000000, "num_range": 80000000, "upper_bound": "1"}], "histo_col_type": "BIT", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 19, "columns": ["\\"col{1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 393, "histo_buckets": [{"distinct_range": 0, "num_eq": 90000000000, "num_range": 0, "upper_bound": "-15 years -6 mons -161 days -10:19:06.76736"}, {"distinct_range": 0, "num_eq": 4750055602611263410, "num_range": 8502830921787648863, "upper_bound": "-11 years -5 mons -767 days -11:33:45.416177"}, {"distinct_range": 0, "num_eq": 40000000000, "num_range": 5340405706681169632, "upper_bound": "-2 years -1 mons -949 days -24:41:30.480452"}, {"distinct_range": 37693724847.34195, "num_eq": 8392917172192258457, "num_range": 60000000000, "upper_bound": "1 mon 759 days 04:30:30.975914"}, {"distinct_range": 0, "num_eq": 2293504289233031467, "num_range": 0, "upper_bound": "39 years 4 mons 207 days 18:27:17.423039"}, {"distinct_range": 45.59435585241268, "num_eq": 2722522364736887776, "num_range": 90, "upper_bound": "50 years 10 mons 358 days 24:38:18.358059"}, {"distinct_range": 3194570664445603300, "num_eq": 50, "num_range": 7237888849721061155, "upper_bound": "290 years"}], "histo_col_type": "INTERVAL", "name": "__auto__", "null_count": 271, "row_count": 900}, {"avg_size": 27, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 711, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 29, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 747, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 900}, {"avg_size": 9, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 465, "histo_col_type": "", "name": "__auto__", "null_count": 342, "row_count": 900}, {"avg_size": 18, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 604, "histo_col_type": "", "name": "__auto__", "null_count": 280, "row_count": 900}, {"avg_size": 7, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 331, "histo_col_type": "", "name": "__auto__", "null_count": 380, "row_count": 900}, {"avg_size": 5, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 63, "histo_buckets": [{"distinct_range": 0, "num_eq": 100, "num_range": 0, "upper_bound": "172103256"}, {"distinct_range": 0, "num_eq": 700000, "num_range": 4000000000, "upper_bound": "1073474198"}, {"distinct_range": 0, "num_eq": 7037606346489313567, "num_range": 9000, "upper_bound": "2696417750"}, {"distinct_range": 49278.51542485082, "num_eq": 536733270800550907, "num_range": 100000, "upper_bound": "3141903737"}], "histo_col_type": "REGCLASS", "name": "__auto__", "null_count": 618, "row_count": 900}, {"avg_size": 19, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 686, "histo_col_type": "", "name": "__auto__", "null_count": 276, "row_count": 900}, {"avg_size": 31, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 476, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 900}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 8, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 39, "histo_col_type": "", "name": "__auto__", "null_count": 65, "row_count": 100}, {"avg_size": 22, "columns": ["\\"col{1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 63, "histo_col_type": "INTERVAL", "name": "__auto__", "null_count": 5, "row_count": 100}, {"avg_size": 5, "columns": ["\\"c%qo l1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 17, "histo_col_type": "", "name": "__auto__", "null_count": 27, "row_count": 100}, {"avg_size": 10, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 81, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"avg_size": 0, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 33, "histo_buckets": [{"distinct_range": 0, "num_eq": 900000, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 6321817.680543104, "num_eq": 6312340290757515730, "num_range": 8000000, "upper_bound": "1"}], "histo_col_type": "BIT", "name": "__auto__", "null_count": 0, "row_count": 100}, {"avg_size": 26, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 67, "histo_col_type": "", "name": "__auto__", "null_count": 38, "row_count": 100}, {"avg_size": 28, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 89, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"avg_size": 2, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 12, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"avg_size": 27, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 33, "histo_buckets": [{"distinct_range": 0, "num_eq": 8906951955108486700, "num_range": 0, "upper_bound": "295025888"}, {"distinct_range": 30000, "num_eq": 20000000000, "num_range": 30000, "upper_bound": "455600337"}, {"distinct_range": 64242.2697431484, "num_eq": 8254581561252236477, "num_range": 80000, "upper_bound": "712348508"}, {"distinct_range": 1756286504874649600, "num_eq": 4642744509405053846, "num_range": 1756286504874649703, "upper_bound": "1080672473"}, {"distinct_range": 900, "num_eq": 800000000, "num_range": 900, "upper_bound": "1678998352"}, {"distinct_range": 7230841107795308000, "num_eq": 739345144228459648, "num_range": 7230841107795307155, "upper_bound": "1734977897"}, {"distinct_range": 0, "num_eq": 70000000, "num_range": 100, "upper_bound": "2024299383"}, {"distinct_range": 0, "num_eq": 4712872478359797127, "num_range": 0, "upper_bound": "2317023637"}, {"distinct_range": 40000, "num_eq": 30000, "num_range": 40000, "upper_bound": "3151489846"}], "histo_col_type": "REGCLASS", "name": "__auto__", "null_count": 3, "row_count": 100}, {"avg_size": 12, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 62, "histo_col_type": "", "name": "__auto__", "null_count": 36, "row_count": 100}, {"avg_size": 30, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 11, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"avg_size": 19, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 18, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"avg_size": 22, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 97, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"avg_size": 9, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8, "histo_col_type": "", "name": "__auto__", "null_count": 68, "row_count": 100}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (44.54s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 2c34f145b83f771667baf3f7ef8633e7e1cd2ad6:

        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (3.17s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1358390270/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare postgres to cockroach1: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("4"),
        test_1        |             +   string("array_agg"),
        test_1        |                 nil,
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(4:::OID::OID::OID)::REGPROCEDURE AS "c%pol1972", NULL::rand_typ_0 AS col1973) AS "tab%q1392"
        test_1        |             ORDER BY
        test_1        |                 "c%pol1972" DESC, col1973 ASC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(4::OID::OID::OID)::REGPROCEDURE AS "c%pol1972", NULL::rand_typ_0 AS col1973) AS "tab%q1392"
        test_1        |             ORDER BY
        test_1        |                 "c%pol1972" DESC, col1973 ASC;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.68s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "tabl e1" ("coL1_\n0" INT2 NOT NULL, " Col1_1" OID, c̻ol1_2 BIT(17) NOT NULL, " col1_3" VARCHAR[] NOT NULL, col1😨_4 REGCLASS NULL, col1_5 JSONB NOT NULL, col1_6 BIT(8) NOT NULL, col1_7 REGCLASS NULL, col1_8 BOX2D NOT NULL, col1_9 FLOAT8 NOT NULL, col1_10 VARCHAR NOT NULL, "coL1_11" STRING AS (lower(CAST(" Col1_1" AS STRING))) STORED, col1_12 FLOAT8 NOT NULL AS (col1_9 + (-0.10656327870630111):::FLOAT8) STORED, col1_13 STRING NOT NULL AS (lower(CAST(col1_6 AS STRING))) VIRTUAL, col1_14 STRING NOT NULL AS (CASE WHEN " col1_3" IS NULL THEN e'E\x16=4w':::STRING ELSE e'\'':::STRING END) VIRTUAL, INDEX ("coL1_11", col1_6 DESC, " Col1_1" DESC) STORING ("coL1_\n0", c̻ol1_2, " col1_3", col1😨_4, col1_5, col1_8, col1_9, col1_12) WHERE ((((("tabl e1".col1_9 != 1.401298464324817e-45:::FLOAT8) AND ("tabl e1".col1_13 < 'X':::STRING)) AND ("tabl e1"."coL1_\n0" < (-1):::INT8)) AND ("tabl e1".col1_14 <= e'\U00002603':::STRING)) AND ("tabl e1".col1_12 > (-1.0):::FLOAT8)) AND ("tabl e1".col1_10 < e'\'':::STRING), INVERTED INDEX (" col1_3" DESC, col1_8 ASC, c̻ol1_2 DESC, " Col1_1" ASC, "coL1_11" gin_trgm_ops), UNIQUE (" Col1_1", col1_7 ASC, col1😨_4 DESC, "coL1_11" DESC, " col1_3" DESC, col1_10, col1_8, col1_6 ASC, "coL1_\n0", col1_13 ASC, col1_9 ASC, c̻ol1_2 DESC, col1_12) WHERE (((((("tabl e1".col1_12 <= 1.401298464324817e-45:::FLOAT8) AND ("tabl e1".col1_9 < (-1.0):::FLOAT8)) AND ("tabl e1".col1_14 <= '':::STRING)) OR ("tabl e1"."coL1_\n0" <= 0:::INT8)) AND ("tabl e1"."coL1_11" = '"':::STRING)) AND ("tabl e1".col1_13 >= e'\x00':::STRING)) OR ("tabl e1".col1_10 <= e'\'':::STRING), FAMILY (col1_6), FAMILY (col1😨_4, col1_8), FAMILY (col1_10, col1_12, "coL1_11", col1_5), FAMILY ("coL1_\n0", col1_9), FAMILY (" Col1_1"), FAMILY (col1_7), FAMILY (c̻ol1_2), FAMILY (" col1_3"));
        test_1        |             ALTER TABLE "tabl e1" INJECT STATISTICS e'[{"avg_size": 13, "columns": ["\\" col1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 283, "histo_buckets": [{"distinct_range": 0, "num_eq": 100000000, "num_range": 0, "upper_bound": "ARRAY[]"}], "histo_col_type": "VARCHAR[]", "name": "__auto__", "null_count": 0, "row_count": 700}, {"avg_size": 28, "columns": ["col1\U0001F628_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 23, "histo_col_type": "", "name": "__auto__", "null_count": 29, "row_count": 700}, {"avg_size": 31, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 70, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 700}, {"avg_size": 5, "columns": ["\\" Col1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 402, "histo_buckets": [{"distinct_range": 0, "num_eq": 400000, "num_range": 0, "upper_bound": "129273028"}, {"distinct_range": 0, "num_eq": 6000000, "num_range": 7556328413279124061, "upper_bound": "2497218427"}], "histo_col_type": "OID", "name": "__auto__", "null_count": 25, "row_count": 700}, {"avg_size": 0, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 697, "histo_col_type": "", "name": "__auto__", "null_count": 141, "row_count": 700}, {"avg_size": 5, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 265, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 700}, {"avg_size": 11, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 635, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 700}, {"avg_size": 17, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 638, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 700}, {"avg_size": 3, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 540, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 700}, {"avg_size": 4, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 64, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 700}, {"avg_size": 9, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 456, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 700}, {"avg_size": 9, "columns": ["\\"coL1_\\\\n0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 47, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 700}, {"avg_size": 1, "columns": ["c\u033Bol1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 260, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 700}, {"avg_size": 23, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 439, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 700}, {"avg_size": 8, "columns": ["\\"coL1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 297, "histo_buckets": [{"distinct_range": 0, "num_eq": 200, "num_range": 0, "upper_bound": ""}, {"distinct_range": 0, "num_eq": 10000, "num_range": 700000, "upper_bound": "\\nZC)"}, {"distinct_range": 70000, "num_eq": 8856992021803213722, "num_range": 70000, "upper_bound": "V4r\\u0013@"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 77, "row_count": 700}]':::JSONB;
        test_1        |             ALTER TABLE "tabl e1" INJECT STATISTICS e'[{"avg_size": 6, "columns": ["c\u033Bol1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6863922, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 6, "columns": ["\\" col1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2592227, "histo_buckets": [{"distinct_range": 0, "num_eq": 1351727829872977016, "num_range": 0, "upper_bound": "ARRAY[e\'\\"0%\\\\t5,I\':::STRING,\'l\':::STRING,\'J\':::STRING]"}, {"distinct_range": 0, "num_eq": 3716248760162104684, "num_range": 100, "upper_bound": "ARRAY[\'HpGXq\':::STRING]"}, {"distinct_range": 0, "num_eq": 10000000000, "num_range": 5000000000, "upper_bound": "ARRAY[e\'Y\\\\x0eJNp{\\\\x0b\':::STRING,\'x_j\':::STRING,\'$40$C\':::STRING]"}], "histo_col_type": "VARCHAR[]", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 7, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1922197, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 10, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1667269, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 24, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3631354, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 14, "columns": ["\\"coL1_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2740646, "histo_buckets": [{"distinct_range": 0, "num_eq": 900000000, "num_range": 0, "upper_bound": "\\u000e)T"}, {"distinct_range": 0, "num_eq": 7794816909094349008, "num_range": 2973183930350470713, "upper_bound": "\\u001b\\u000bZ\\u000c|"}, {"distinct_range": 3023684975307030500, "num_eq": 2000, "num_range": 8787863821600763653, "upper_bound": "#"}, {"distinct_range": 150773009.15697837, "num_eq": 0, "num_range": 200000000, "upper_bound": "NxP\\u0013"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 3082735, "row_count": 7000000}, {"avg_size": 25, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4564596, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 0, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6610956, "histo_col_type": "", "name": "__auto__", "null_count": 5743453, "row_count": 7000000}, {"avg_size": 15, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5031182, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 6, "columns": ["\\"coL1_\\\\n0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2933205, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 27, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4775758, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 31, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5521817, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}, {"avg_size": 16, "columns": ["\\" Col1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1498141, "histo_buckets": [{"distinct_range": 0, "num_eq": 1853497988407341294, "num_range": 0, "upper_bound": "2731859531"}], "histo_col_type": "OID", "name": "__auto__", "null_count": 714752, "row_count": 7000000}, {"avg_size": 16, "columns": ["col1\U0001F628_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3705546, "histo_col_type": "", "name": "__auto__", "null_count": 6192248, "row_count": 7000000}, {"avg_size": 9, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4313080, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (26.82s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 01f129a59ab66166d6ef7189a8930f2b37cced74:

        postgres_1    | 2023-04-22 05:20:25.208 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-22 05:20:25.208 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-22 05:20:25.212 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-22 05:20:25.217 UTC [68] LOG:  database system was shut down at 2023-04-22 05:20:25 UTC
        postgres_1    | 2023-04-22 05:20:25.223 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-22 05:20:27.273 UTC [78] ERROR:  collation "de" for encoding "UTF8" does not exist at character 229
        postgres_1    | 2023-04-22 05:20:27.273 UTC [78] STATEMENT:  CREATE TABLE "t%qabLe""1" (col1_0 NAME, "c Ol1_�1" BIT(30) NOT NULL, "C%qoL1_2" INTERVAL NOT NULL, col1_3 FLOAT4 NOT NULL, col1_4 DATE NOT NULL, col😣1_5 TIME NULL, col1_6 INT4[] NOT NULL, "c ol 1_7" FLOAT4 NOT NULL, col1_8 TEXT COLLATE de NOT NULL, col1_9 BOOL NOT NULL, col1_10 TIMETZ[] NOT NULL, col1_11 FLOAT4[] NOT NULL, col1_12 BYTEA NOT NULL, "Col1🙁_13" BIT(41) NOT NULL, col1_14 TIME NULL, "col1\\x55_15" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("Col1🙁_13" AS TEXT))) STORED, col1_16 FLOAT8 GENERATED ALWAYS AS (col1_3 + 0.22376394271850586::FLOAT8) STORED, col1_17 FLOAT8 NULL GENERATED ALWAYS AS ("c ol 1_7" + col1_3) STORED, PRIMARY KEY ("Col1🙁_13", "col1\\x55_15", col1_3, col1_10, col1_4, col1_6, "c ol 1_7"));
        postgres_1    |     CREATE INDEX ON "t%qabLe""1" (col1_6 ASC, col1_8, col1_10, col1_14, col1_17, col1_11 ASC, "c ol 1_7", "col1\\x55_15", ("c ol 1_7" + col1_3), "C%qoL1_2" DESC, (CASE WHEN col1_11 IS NULL THEN e'E\'qdB\fM\x0b_'::TEXT ELSE '<"m'::TEXT END) DESC, col1_0 DESC, col1_4 DESC, col1_9 ASC, col1_12 DESC, "Col1🙁_13" DESC, "c   Ol1_�1" ASC, col😣1_5 ASC);
        postgres_1    |     CREATE INDEX ON "t%qabLe""1" ("c    Ol1_�1" ASC, col1_17, "col1\\x55_15" ASC, col😣1_5, "Col1🙁_13" ASC, col1_11 ASC, col1_3, lower(CAST(col1_9 AS TEXT)) DESC, "c ol 1_7" DESC, col1_0 ASC, col1_9, "C%qoL1_2", col1_10 ASC);
        postgres_1    |     CREATE UNIQUE INDEX ON "t%qabLe""1" (col1_4 DESC, "Col1🙁_13" DESC) INCLUDE (col1_0, "c  Ol1_�1", "C%qoL1_2", col1_8, col1_9, col1_17);
        postgres_1    |     CREATE INDEX ON "t%qabLe""1" (col1_16, col1_9 ASC, col1_10 ASC, col1_14, "C%qoL1_2", col1_17 DESC, col1_11, "Col1🙁_13" ASC, col1_0) INCLUDE ("c Ol1_�1", col😣1_5, col1_8, col1_12);
        postgres_1    |     CREATE INDEX ON "t%qabLe""1" (lower(CAST(col1_8 AS TEXT)) ASC, col1_12 ASC, col1_8 DESC, col1_10 DESC, col1_16 ASC, col1_4, lower(CAST("c   Ol1_�1" AS TEXT)) ASC, col1_0, col1_3 ASC, col1_11 DESC, "col1\\x55_15" DESC) INCLUDE ("C%qoL1_2", col1_17);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (6.53s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.16s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "t%qabLe""1" (col1_0 NAME, "c Ol1_�1" BIT(30) NOT NULL, "C%qoL1_2" INTERVAL NOT NULL, col1_3 FLOAT4 NOT NULL, col1_4 DATE NOT NULL, col😣1_5 TIME NULL, col1_6 INT4[] NOT NULL, "c ol 1_7" FLOAT4 NOT NULL, col1_8 TEXT COLLATE de NOT NULL, col1_9 BOOL NOT NULL, col1_10 TIMETZ[] NOT NULL, col1_11 FLOAT4[] NOT NULL, col1_12 BYTEA NOT NULL, "Col1🙁_13" BIT(41) NOT NULL, col1_14 TIME NULL, "col1\\x55_15" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("Col1🙁_13" AS TEXT))) STORED, col1_16 FLOAT8 GENERATED ALWAYS AS (col1_3 + 0.22376394271850586::FLOAT8) STORED, col1_17 FLOAT8 NULL GENERATED ALWAYS AS ("c ol 1_7" + col1_3) STORED, PRIMARY KEY ("Col1🙁_13", "col1\\x55_15", col1_3, col1_10, col1_4, col1_6, "c ol 1_7"));
        test_1        |             CREATE INDEX ON "t%qabLe""1" (col1_6 ASC, col1_8, col1_10, col1_14, col1_17, col1_11 ASC, "c ol 1_7", "col1\\x55_15", ("c ol 1_7" + col1_3), "C%qoL1_2" DESC, (CASE WHEN col1_11 IS NULL THEN e'E\'qdB\fM\x0b_'::TEXT ELSE '<"m'::TEXT END) DESC, col1_0 DESC, col1_4 DESC, col1_9 ASC, col1_12 DESC, "Col1🙁_13" DESC, "c   Ol1_�1" ASC, col😣1_5 ASC);
        test_1        |             CREATE INDEX ON "t%qabLe""1" ("c    Ol1_�1" ASC, col1_17, "col1\\x55_15" ASC, col😣1_5, "Col1🙁_13" ASC, col1_11 ASC, col1_3, lower(CAST(col1_9 AS TEXT)) DESC, "c ol 1_7" DESC, col1_0 ASC, col1_9, "C%qoL1_2", col1_10 ASC);
        test_1        |             CREATE UNIQUE INDEX ON "t%qabLe""1" (col1_4 DESC, "Col1🙁_13" DESC) INCLUDE (col1_0, "c  Ol1_�1", "C%qoL1_2", col1_8, col1_9, col1_17);
        test_1        |             CREATE INDEX ON "t%qabLe""1" (col1_16, col1_9 ASC, col1_10 ASC, col1_14, "C%qoL1_2", col1_17 DESC, col1_11, "Col1🙁_13" ASC, col1_0) INCLUDE ("c Ol1_�1", col😣1_5, col1_8, col1_12);
        test_1        |             CREATE INDEX ON "t%qabLe""1" (lower(CAST(col1_8 AS TEXT)) ASC, col1_12 ASC, col1_8 DESC, col1_10 DESC, col1_16 ASC, col1_4, lower(CAST("c   Ol1_�1" AS TEXT)) ASC, col1_0, col1_3 ASC, col1_11 DESC, "col1\\x55_15" DESC) INCLUDE ("C%qoL1_2", col1_17);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "de" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (1.23s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "\gtable1" ("coL1_ 0" BOX2D NOT NULL, col1_1 BIT(41) NOT NULL, PRIMARY KEY ("coL1_ 0"), INDEX ("coL1_ 0"), INDEX (col1_1 DESC) NOT VISIBLE, INDEX (lower(CAST("coL1_ 0" AS STRING)) DESC) STORING (col1_1) NOT VISIBLE, UNIQUE ("coL1_ 0" DESC, col1_1 ASC), INDEX (lower(CAST(col1_1 AS STRING)) ASC), INDEX (col1_1 ASC, lower(CAST(col1_1 AS STRING)) ASC), UNIQUE ("coL1_ 0" DESC), INDEX (col1_1, "coL1_ 0" DESC), UNIQUE ("coL1_ 0", col1_1 ASC), FAMILY (col1_1, "coL1_ 0"));
        test_1        |             ALTER TABLE "\gtable1" INJECT STATISTICS e'[{"avg_size": 2, "columns": ["\\"coL1_ 0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 185, "histo_buckets": [{"distinct_range": 0, "num_eq": 6930533569883835844, "num_range": 0, "upper_bound": "BOX(-1.7985057855169044 -1.5930063902368992,-0.8902069481126818 2.7062132572534234)"}, {"distinct_range": 40, "num_eq": 3000000000, "num_range": 40, "upper_bound": "BOX(-0.8108595314435627 -0.42093430067216,0.5448165435300139 1.0196362159049757)"}, {"distinct_range": 4558973755928706600, "num_eq": 100000, "num_range": 6607221981753843327, "upper_bound": "BOX(-0.7730777457217286 -1.4758462672650217,0.6952484093490655 0.6187495186883163)"}, {"distinct_range": 0, "num_eq": 400000, "num_range": 5194114913090328500, "upper_bound": "BOX(0.2298565807239933 -0.08502076511683754,0.9375305271475232 1.0187026907316987)"}], "histo_col_type": "BOX2D", "name": "__auto__", "null_count": 0, "row_count": 200}, {"avg_size": 27, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 117, "histo_col_type": "BIT(41)", "name": "__auto__", "null_count": 0, "row_count": 200}]':::JSONB;
        test_1        |             ALTER TABLE "\gtable1" INJECT STATISTICS e'[{"avg_size": 5, "columns": ["\\"coL1_ 0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1357955, "histo_col_type": "BOX2D", "name": "__auto__", "null_count": 0, "row_count": 2000000}, {"avg_size": 26, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1960902, "histo_buckets": [{"distinct_range": 0, "num_eq": 7000, "num_range": 0, "upper_bound": "00000000000000000000000000000000000000000"}, {"distinct_range": 0, "num_eq": 2889366766947298252, "num_range": 7454121870429612219, "upper_bound": "00010011110111010000011001001100000111110"}, {"distinct_range": 0, "num_eq": 4256804455910598172, "num_range": 600, "upper_bound": "01000000010100000011111111001011100110001"}, {"distinct_range": 0, "num_eq": 1336220888249807309, "num_range": 100000000000, "upper_bound": "01100011100100001111110001011101011101110"}, {"distinct_range": 7180614682.900989, "num_eq": 80000000, "num_range": 8000000000, "upper_bound": "01111111111111111111111111111111111111111"}, {"distinct_range": 0, "num_eq": 153722660758235143, "num_range": 700000, "upper_bound": "11110101111111000001000011111101100010010"}, {"distinct_range": 0, "num_eq": 0, "num_range": 8090029983044545656, "upper_bound": "11110111010111010010011001100000111100101"}], "histo_col_type": "BIT(41)", "name": "__auto__", "null_count": 0, "row_count": 2000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (22.59s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ e82cf4ec488258875dcf5e42e7d6745b03210edd:

        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-23 05:17:24.519 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-23 05:17:24.519 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-23 05:17:24.519 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-23 05:17:24.523 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-23 05:17:24.530 UTC [68] LOG:  database system was shut down at 2023-04-23 05:17:24 UTC
        postgres_1    | 2023-04-23 05:17:24.536 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-23 05:17:26.554 UTC [78] ERROR:  invalid input syntax for type numeric: "Infinity" at character 127
        postgres_1    | 2023-04-23 05:17:26.554 UTC [78] STATEMENT:  CREATE TABLE table1 (col1_0 DECIMAL NOT NULL, col1_1 UUID NOT NULL, "co""l1_2" DECIMAL NOT NULL GENERATED ALWAYS AS (col1_0 + 'Infinity'::DECIMAL) STORED, PRIMARY KEY (col1_0, col1_1));
        postgres_1    |     CREATE UNIQUE INDEX ON table1 ("co""l1_2" DESC, col1_0);
        postgres_1    |     CREATE INDEX ON table1 (col1_1 DESC, "co""l1_2");
        postgres_1    |     CREATE INDEX ON table1 (col1_1);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (6.27s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.06s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 DECIMAL NOT NULL, col1_1 UUID NOT NULL, "co""l1_2" DECIMAL NOT NULL GENERATED ALWAYS AS (col1_0 + 'Infinity'::DECIMAL) STORED, PRIMARY KEY (col1_0, col1_1));
        test_1        |             CREATE UNIQUE INDEX ON table1 ("co""l1_2" DESC, col1_0);
        test_1        |             CREATE INDEX ON table1 (col1_1 DESC, "co""l1_2");
        test_1        |             CREATE INDEX ON table1 (col1_1);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: invalid input syntax for type numeric: "Infinity" (SQLSTATE 22P02)
        test_1        |     --- FAIL: TestCompare/mutators (1.08s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 ("😀co l1_\\u52DC0" DECIMAL, col1_1 TIMESTAMPTZ NULL, col1_2 INT4, col1_3 TSVECTOR NOT NULL, col1_4 REGROLE, "col1\\U000B443B_5" BOOL NOT NULL, "
c😗o̹ḽ1_6" BOOL NOT NULL, col1_7 STRING NULL AS (CASE WHEN col1_1 IS NULL THEN '_':::STRING ELSE '':::STRING END) VIRTUAL, col1_8 DECIMAL AS ("😀co l1_\\u52DC0" + (-6846755281421337.11):::DECIMAL) STORED, col1_9 STRING NOT NULL AS (lower(CAST("col1\\U000B443B_5" AS STRING))) VIRTUAL, UNIQUE (col1_9, col1_1 ASC, "col1\\U000B443B_5" DESC, "😀co l1_\\u52DC0" DESC, col1_8 DESC) WHERE (((((((table1.col1_9 > e'\U00002603':::STRING) OR (table1.col1_2 != (-1):::INT8)) OR (table1."😀co l1_\\u52DC0" < 1:::DECIMAL)) OR (table1.col1_8 = (-1):::DECIMAL)) AND (table1.col1_7 != 'X':::STRING)) OR table1."
c😗o̹ḽ1_6") OR (table1.col1_1 > '2001-01-01 00:00:00+00 BC':::TIMESTAMPTZ)) OR (NOT table1."col1\\U000B443B_5"), INDEX ("col1\\U000B443B_5", col1_8, col1_4, col1_2, "😀co l1_\\u52DC0" DESC, col1_1 ASC, col1_7 ASC, col1_9 DESC) STORING (col1_3) WHERE table1."
c😗o̹ḽ1_6" AND (table1.col1_7 = '':::STRING), UNIQUE ("col1\\U000B443B_5", col1_7 ASC, col1_2 ASC) STORING ("😀co l1_\\u52DC0", col1_4, "
c😗o̹ḽ1_6", col1_8) PARTITION BY LIST ("col1\\U000B443B_5", col1_7) (PARTITION table1_part0 VALUES IN ((false, 'X':::STRING), (true, 'Y':::STRING), (false, 'X]':::STRING), (false, e'5Dn\x13[PD\x15':::STRING), (true, e'\f,JQ':::STRING), (false, e'n\x05':::STRING)), PARTITION "ta(ble1_part1" VALUES IN ((false, e'"zG]l\x17\x17\x0e':::STRING), (true, 'mcL':::STRING), (false, '#LVzB':::STRING), (false, e'\x13\\``':::STRING), (true, e'\U00002603':::STRING), (true, '}5M':::STRING)), PARTITION "tAbl'e1_part2" VALUES IN ((true, '"':::STRING), (true, 'P':::STRING), (true, '-':::STRING), (true, '':::STRING), (true, e'\x18h':::STRING), (false, e'\x1c\\\x15I\f':::STRING)), PARTITION "table1_parT3" VALUES IN ((true, ' ':::STRING), (true, e'\x13BUpcP\x03\x1a':::STRING), (false, e'\x17x\'*6':::STRING), (false, '':::STRING), (false, e'\U00002603':::STRING)), PARTITION table1_pa😺rt4 VALUES IN ((true, e'_<\x1f':::STRING), (true, 'm/eD>':::STRING), (false, e'\b':::STRING), (false, 'f;pf':::STRING)), PARTITION table1_part5 VALUES IN ((false, e'\x0fn2h':::STRING), (true, 'wTu8cl':::STRING), (false, e'JeU\x12 pf':::STRING), (true, e'\x14\x1dx\x12n9':::STRING), (false, e'JHd<DV\x1e':::STRING), (true, ')QD':::STRING)), PARTITION "table1_part.6" VALUES IN ((true, e'\x1c$A9M':::STRING), (false, e'i~\x04\'h\x0f$*':::STRING), (true, '|k"':::STRING), (false, e'\x07\x15z7=@':::STRING), (false, e'\x1d-)\x1a<':::STRING), (true, e'Ve\x12ZNr\x0b':::STRING)), PARTITION table1_part7 VALUES IN ((false, e'GPt\x12k~':::STRING), (true, e'yc\x1b\x11]+>g':::STRING), (false, e'k]s\x7f':::STRING), (false, 'O!1j,I':::STRING), (false, 'w':::STRING)), PARTITION "DEFAULT" VALUES IN ((DEFAULT, DEFAULT))) WHERE ((((((table1.col1_9 > 'X':::STRING) OR (table1.col1_7 >= e'\x00':::STRING)) AND table1."col1\\U000B443B_5") OR (table1.col1_1 != '0001-01-01 00:00:00+00':::TIMESTAMPTZ)) AND (table1."😀co l1_\\u52DC0" < (-1):::DECIMAL)) AND table1."
c😗o̹ḽ1_6") OR (table1.col1_2 < (-128):::INT8), INVERTED INDEX ("
c😗o̹ḽ1_6" ASC, col1_9 DESC, col1_7, col1_4 DESC, col1_1 DESC, "😀co l1_\\u52DC0" ASC, col1_2, "col1\\U000B443B_5" DESC, col1_3) WHERE ((table1.col1_9 != '"':::STRING) OR (table1.col1_7 != '"':::STRING)) AND (NOT table1."
c😗o̹ḽ1_6"), UNIQUE ("
c😗o̹ḽ1_6" DESC, "col1\\U000B443B_5", col1_8 ASC, col1_1 ASC) STORING ("😀co l1_\\u52DC0", col1_4) PARTITION BY LIST ("
c😗o̹ḽ1_6", "col1\\U000B443B_5", col1_8) (PARTITION "table1_ \npart0" VALUES IN ((true, true, (-4898.270500803765512):::DECIMAL), (true, false, 1:::DECIMAL), (false, true, 115798171083434810.7:::DECIMAL), (false, false, 1:::DECIMAL), (false, true, (-4.873351364548418765E+28):::DECIMAL), (true, false, (-3.426493839175194507E+21):::DECIMAL), (false, false, (-6599651.229384189674):::DECIMAL)), PARTITION table1_part1 VALUES IN ((false, true, 46723794873937.25481:::DECIMAL), (false, false, 0.05154125032266326546:::DECIMAL), (false, true, 0.03781715266894803094:::DECIMAL), (true, true, 1715104109.561363080:::DECIMAL), (false, true, (-85099.51663259339798):::DECIMAL), (true, false, 62175666082.64563310:::DECIMAL), (false, false, (-2.612166323287626685E+20):::DECIMAL)), PARTITION "table1_pa%vrt2" VALUES IN ((true, false, 1057729717298.287756:::DECIMAL), (true, false, 8001999815329.753087:::DECIMAL), (false, true, (-17445108638034922.39):::DECIMAL), (false, false, 6.208678291511763643E+19:::DECIMAL), (false, true, 9.096241552671786821E+35:::DECIMAL), (true, false, (-39399030314242.53099):::DECIMAL), (true, true, 779215423683371222.2:::DECIMAL)), PARTITION "DEFAULT" VALUES IN ((DEFAULT, DEFAULT, DEFAULT))) WHERE ((((((table1."col1\\U000B443B_5" AND (table1.col1_1 < '294276-12-31 23:59:59.999999+00':::TIMESTAMPTZ)) OR table1."
c😗o̹ḽ1_6") AND (table1.col1_9 = e'\U00002603':::STRING)) OR (table1.col1_7 = e'\U00002603':::STRING)) OR (table1.col1_8 > 'Infinity':::DECIMAL)) AND (table1.col1_2 != (-1):::INT8)) OR (table1."😀co l1_\\u52DC0" < (-1):::DECIMAL), FAMILY (col1_2), FAMILY ("😀co l1_\\u52DC0", col1_4), FAMILY (col1_8, col1_1, col1_3), FAMILY ("
c😗o̹ḽ1_6"), FAMILY ("col1\\U000B443B_5"));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 4, "columns": ["\\"col1\\\\\\\\U000B443B_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2059139410003733817, "histo_buckets": [{"distinct_range": 0, "num_eq": 400, "num_range": 0, "upper_bound": "false"}, {"distinct_range": 0, "num_eq": 3000000, "num_range": 2628451960808706787, "upper_bound": "true"}], "histo_col_type": "BOOL", "name": "__auto__", "null_count": 0, "row_count": 2405399284592999815}, {"avg_size": 17, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1120373075428027358, "histo_col_type": "", "name": "__auto__", "null_count": 217111982674732802, "row_count": 2405399284592999815}, {"avg_size": 8, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 947155065979565397, "histo_col_type": "", "name": "__auto__", "null_count": 2271713135079223201, "row_count": 2405399284592999815}, {"avg_size": 19, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1287970069020745881, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2405399284592999815}, {"avg_size": 11, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1937880896706738962, "histo_col_type": "", "name": "__auto__", "null_count": 1591879181942088959, "row_count": 2405399284592999815}, {"avg_size": 27, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2134771334152939916, "histo_col_type": "", "name": "__auto__", "null_count": 11888606751572919, "row_count": 2405399284592999815}, {"avg_size": 17, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1754018388313827207, "histo_col_type": "", "name": "__auto__", "null_count": 390928340995034278, "row_count": 2405399284592999815}, {"avg_size": 1, "columns": ["\\"\\rc\U0001F617o\u0339\U00001E3D1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1625760274086162647, "histo_buckets": [{"distinct_range": 0, "num_eq": 4178500756931764188, "num_range": 0, "upper_bound": "false"}, {"distinct_range": 0, "num_eq": 22893414219261400, "num_range": 4000000, "upper_bound": "true"}], "histo_col_type": "BOOL", "name": "__auto__", "null_count": 0, "row_count": 2405399284592999815}, {"avg_size": 9, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 136974349892395562, "histo_buckets": [{"distinct_range": 0, "num_eq": 9000, "num_range": 0, "upper_bound": "H\\u0012E\\tW\\u00195z"}, {"distinct_range": 8886365474499044000, "num_eq": 7477397117560999343, "num_range": 8886365474499044471, "upper_bound": "SJ,\\u0018\\\\qA"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 2405399284592999815}, {"avg_size": 17, "columns": ["\\"\U0001F600co l1_\\\\\\\\u52DC0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2339198367219482169, "histo_col_type": "", "name": "__auto__", "null_count": 2398274940022654774, "row_count": 2405399284592999815}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 10, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4058393583493032615, "histo_buckets": [{"distinct_range": 0, "num_eq": 1000000, "num_range": 0, "upper_bound": "\\u0018_\x7f|C\\u0008\\u0018P"}, {"distinct_range": 0, "num_eq": 771304825035107771, "num_range": 6129034256594686308, "upper_bound": "\\u001f\\n\\u0016T\\u001e"}, {"distinct_range": 8932393196414966000, "num_eq": 3369964752924601504, "num_range": 8932393196414965765, "upper_bound": ";\\u00043\\u001d"}, {"distinct_range": 4074198161396093400, "num_eq": 4093688261595339275, "num_range": 4074198161396093468, "upper_bound": "Iyfm"}, {"distinct_range": 0, "num_eq": 30000000000, "num_range": 70000, "upper_bound": "N\\u0007~{\'U\\u0019J"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 8790732856461643032}, {"avg_size": 17, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1877214349212328423, "histo_col_type": "", "name": "__auto__", "null_count": 4882211134950763372, "row_count": 8790732856461643032}, {"avg_size": 10, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4982971933164985264, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8790732856461643032}, {"avg_size": 0, "columns": ["\\"col1\\\\\\\\U000B443B_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6881462372701922385, "histo_buckets": [{"distinct_range": 0, "num_eq": 5000, "num_range": 0, "upper_bound": "false"}, {"distinct_range": 0, "num_eq": 8000000, "num_range": 305998847394460754, "upper_bound": "true"}], "histo_col_type": "BOOL", "name": "__auto__", "null_count": 0, "row_count": 8790732856461643032}, {"avg_size": 2, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1919764559865546165, "histo_col_type": "", "name": "__auto__", "null_count": 7017959134221535473, "row_count": 8790732856461643032}, {"avg_size": 19, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8668234673219484682, "histo_col_type": "", "name": "__auto__", "null_count": 2023849949237324941, "row_count": 8790732856461643032}, {"avg_size": 11, "columns": ["\\"\U0001F600co l1_\\\\\\\\u52DC0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7479393987573772571, "histo_col_type": "", "name": "__auto__", "null_count": 8378277337970456794, "row_count": 8790732856461643032}, {"avg_size": 14, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4521792155200639094, "histo_col_type": "", "name": "__auto__", "null_count": 8418625992571476563, "row_count": 8790732856461643032}, {"avg_size": 17, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 486547723890817219, "histo_col_type": "", "name": "__auto__", "null_count": 4141608502048877769, "row_count": 8790732856461643032}, {"avg_size": 13, "columns": ["\\"\\rc\U0001F617o\u0339\U00001E3D1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4058509444892801770, "histo_buckets": [{"distinct_range": 0, "num_eq": 577436426288133942, "num_range": 0, "upper_bound": "false"}, {"distinct_range": 4172383294573014500, "num_eq": 4388354802280287778, "num_range": 8996928061036044920, "upper_bound": "true"}], "histo_col_type": "BOOL", "name": "__auto__", "null_count": 0, "row_count": 8790732856461643032}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (22.06s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 33677face99e0b20b041458bd653d8846906b44e:

        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-24 05:15:15.846 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-24 05:15:15.846 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-24 05:15:15.846 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-24 05:15:15.849 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-24 05:15:15.854 UTC [69] LOG:  database system was shut down at 2023-04-24 05:15:15 UTC
        postgres_1    | 2023-04-24 05:15:15.858 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-24 05:15:17.725 UTC [79] ERROR:  collation "de" for encoding "UTF8" does not exist at character 58
        postgres_1    | 2023-04-24 05:15:17.725 UTC [79] STATEMENT:  CREATE TABLE tablē1 (col1_0 UUID NOT NULL, "cOl1_1" TEXT COLLATE de NOT NULL, col1_2 INT4 NOT NULL, "c'ol1_3" BOX2D NOT NULL, "😻col1_\\x414" TSQUERY NOT NULL, "col1_\\x815" BIT(30) NULL, col1_6 BIT(26) NOT NULL, col1_7 TIME NOT NULL, col1😡_8 VARCHAR NOT NULL, col1_9 UUID, "col'1_10" BOOL NOT NULL, col1_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("cOl1_1" AS TEXT))) STORED, "!col1_12" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_6 AS TEXT))) STORED, "c%52ol1%q_13" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("c'ol1_3" AS TEXT))) STORED, 😅col1_14 TEXT GENERATED ALWAYS AS (lower(CAST(col1_9 AS TEXT))) STORED, col1_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("cOl1_1" AS TEXT))) STORED, col1_😡16 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("c'ol1_3" AS TEXT))) STORED, col1_😘17 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_7 AS TEXT))) STORED, "c\rol1_18" TEXT GENERATED ALWAYS AS (lower(CAST(col1_9 AS TEXT))) STORED);
        postgres_1    |     CREATE UNIQUE INDEX ON tablē1 (lower(CAST("😻col1_\\x414" AS TEXT)) DESC, col1_6 ASC, "cOl1_1");
        postgres_1    |     CREATE INDEX ON tablē1 (col1_6 DESC, col1_0 ASC, 😅col1_14, col1_2, "col'1_10", "col1_\\x815" ASC);
        postgres_1    |     CREATE INDEX ON tablē1 (lower(CAST("col1_\\x815" AS TEXT)), col1_11 DESC, col1_2 DESC, col1_7 DESC, col1😡_8, col1_15 ASC, col1_9 DESC, col1_😡16 ASC, 😅col1_14 DESC) INCLUDE (col1_0, "cOl1_1", "😻col1_\\x414", "col1_\\x815", "!col1_12", col1_😘17);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (4.44s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/mutators (0.38s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 TIMETZ NULL, "😖co\fl1_1" BYTES[] NOT NULL, PRIMARY KEY ("😖co\fl1_1" ASC), UNIQUE ((CASE WHEN "😖co\fl1_1" IS NULL THEN e'\x11t\x17':::STRING ELSE e':Z<&\x0f=b\x1c':::STRING END)), UNIQUE (col1_0 DESC, "😖co\fl1_1" DESC) WHERE table1.col1_0 <= '24:00:00-15:59':::TIMETZ, INDEX ("😖co\fl1_1" DESC, col1_0 DESC) WHERE table1.col1_0 <= '24:00:00-15:59':::TIMETZ, FAMILY ("😖co\fl1_1"), FAMILY (col1_0));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 25, "columns": ["\\"\U0001F616co\\\\fl1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 857685490987121705, "histo_buckets": [{"distinct_range": 0, "num_eq": 20, "num_range": 0, "upper_bound": "ARRAY[]"}, {"distinct_range": 255094206850385100, "num_eq": 3267124847880152098, "num_range": 351709625346595283, "upper_bound": "ARRAY[\'\\\\x\':::BYTES,\'\\\\xacca7aa1\':::BYTES]"}, {"distinct_range": 5.232451994882531, "num_eq": 2756356873549662885, "num_range": 60, "upper_bound": "ARRAY[\'\\\\x\':::BYTES,\'\\\\xd0f9e51e260bbb6d\':::BYTES,\'\\\\x\':::BYTES,\'\\\\x849749\':::BYTES,\'\\\\x8eaead81d3d293\':::BYTES]"}, {"distinct_range": 0, "num_eq": 100, "num_range": 6000000, "upper_bound": "ARRAY[\'\\\\xbd\':::BYTES,\'\\\\x\':::BYTES,\'\\\\x0d071f45e737b9\':::BYTES]"}, {"distinct_range": 0, "num_eq": 4527944672244180462, "num_range": 4606400633574953731, "upper_bound": "ARRAY[\'\\\\xcc\':::BYTES,\'\\\\xc5d7\':::BYTES]"}, {"distinct_range": 300000000, "num_eq": 6000000, "num_range": 300000000, "upper_bound": "ARRAY[\'\\\\xd41d3032\':::BYTES,\'\\\\x1e64\':::BYTES,\'\\\\x239e8f56d46398\':::BYTES]"}, {"distinct_range": 0, "num_eq": 8128532037086505042, "num_range": 492229169877491651, "upper_bound": "ARRAY[\'\\\\xf2268556fbf63bbf91\':::BYTES,\'\\\\xa8754066469c\':::BYTES]"}, {"distinct_range": 0, "num_eq": 5454393781559207589, "num_range": 2000000000, "upper_bound": "ARRAY[\'\\\\xf22ac672\':::BYTES,\'\\\\x6380fce5ef249a66\':::BYTES,\'\\\\x563649d684da04e6d8\':::BYTES,\'\\\\xabaa39f2\':::BYTES]"}, {"distinct_range": 0, "num_eq": 142562121801549299, "num_range": 0, "upper_bound": "ARRAY[\'\\\\xff\':::BYTES,\'\\\\xfa1f\':::BYTES]"}], "histo_col_type": "BYTES[]", "name": "__auto__", "null_count": 0, "row_count": 4019764066186857534}, {"avg_size": 10, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3696142232126771856, "histo_buckets": [{"distinct_range": 0, "num_eq": 20000000000, "num_range": 0, "upper_bound": "03:40:54.069707+06:11"}, {"distinct_range": 0, "num_eq": 4900905368591621243, "num_range": 4352829487468236652, "upper_bound": "00:37:23.61298-04:35"}], "histo_col_type": "TIMETZ", "name": "__auto__", "null_count": 361320672458707280, "row_count": 4019764066186857534}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 7, "columns": ["\\"\U0001F616co\\\\fl1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 747193417315598867, "histo_buckets": [{"distinct_range": 0, "num_eq": 6791304871855773112, "num_range": 0, "upper_bound": "ARRAY[\'\\\\x22\':::BYTES,\'\\\\x8ad997aa\':::BYTES]"}, {"distinct_range": 8000000000, "num_eq": 2776654848298048253, "num_range": 8000000000, "upper_bound": "ARRAY[\'\\\\x717149037925\':::BYTES,\'\\\\xbfe5da13c579\':::BYTES,\'\\\\x55ecc716dc15\':::BYTES,\'\\\\x49974eb7\':::BYTES,\'\\\\x\':::BYTES]"}, {"distinct_range": 0, "num_eq": 4554586994226485424, "num_range": 400000, "upper_bound": "ARRAY[\'\\\\x87\':::BYTES,\'\\\\x62a5\':::BYTES,\'\\\\x265b9239a5de4ac6\':::BYTES,\'\\\\xd4d05ccd4186c6\':::BYTES,\'\\\\x37277a631a5ad834ca\':::BYTES]"}, {"distinct_range": 680153.8083411027, "num_eq": 50000000000, "num_range": 2000000, "upper_bound": "ARRAY[\'\\\\xacc8a2\':::BYTES,\'\\\\x9ad5af7e09ab991044\':::BYTES,\'\\\\xe0e287b032\':::BYTES,\'\\\\x12f4\':::BYTES]"}, {"distinct_range": 8897572958518043000, "num_eq": 1000000, "num_range": 8897572958518042382, "upper_bound": "ARRAY[\'\\\\xd1c3d32555456f\':::BYTES,\'\\\\x3e75f848dd\':::BYTES,\'\\\\xe4a8f482e3efd119\':::BYTES,\'\\\\x003668\':::BYTES,\'\\\\xb042193d7b29\':::BYTES,\'\\\\xbc06efc2b0bfc5\':::BYTES]"}, {"distinct_range": 90000000, "num_eq": 7012897383685583996, "num_range": 90000000, "upper_bound": "ARRAY[\'\\\\xfd545e1c13\':::BYTES,\'\\\\x0c5b7e30854e\':::BYTES,\'\\\\xff\':::BYTES]"}, {"distinct_range": 0, "num_eq": 8000, "num_range": 100, "upper_bound": "ARRAY[\'\\\\xff995a3d8e21aeaf\':::BYTES,\'\\\\x\':::BYTES,\'\\\\x\':::BYTES]"}], "histo_col_type": "BYTES[]", "name": "__auto__", "null_count": 0, "row_count": 1052936203555681135}, {"avg_size": 14, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 998948051169724699, "histo_buckets": [{"distinct_range": 0, "num_eq": 10000000, "num_range": 0, "upper_bound": "00:43:25.880234+00:11"}, {"distinct_range": 0, "num_eq": 30000000000, "num_range": 70000000000, "upper_bound": "10:11:17.554247+08:43"}, {"distinct_range": 2000000, "num_eq": 7601139155947582203, "num_range": 2000000, "upper_bound": "04:47:57.859905-00:29"}, {"distinct_range": 0, "num_eq": 1893994005879374370, "num_range": 4000000, "upper_bound": "18:30:43.102537+00:08"}], "histo_col_type": "TIMETZ", "name": "__auto__", "null_count": 1042884393870425982, "row_count": 1052936203555681135}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        |     --- FAIL: TestCompare/postgres (0.94s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE tablē1 (col1_0 UUID NOT NULL, "cOl1_1" TEXT COLLATE de NOT NULL, col1_2 INT4 NOT NULL, "c'ol1_3" BOX2D NOT NULL, "😻col1_\\x414" TSQUERY NOT NULL, "col1_\\x815" BIT(30) NULL, col1_6 BIT(26) NOT NULL, col1_7 TIME NOT NULL, col1😡_8 VARCHAR NOT NULL, col1_9 UUID, "col'1_10" BOOL NOT NULL, col1_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("cOl1_1" AS TEXT))) STORED, "!col1_12" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_6 AS TEXT))) STORED, "c%52ol1%q_13" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("c'ol1_3" AS TEXT))) STORED, 😅col1_14 TEXT GENERATED ALWAYS AS (lower(CAST(col1_9 AS TEXT))) STORED, col1_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("cOl1_1" AS TEXT))) STORED, col1_😡16 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("c'ol1_3" AS TEXT))) STORED, col1_😘17 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_7 AS TEXT))) STORED, "c\rol1_18" TEXT GENERATED ALWAYS AS (lower(CAST(col1_9 AS TEXT))) STORED);
        test_1        |             CREATE UNIQUE INDEX ON tablē1 (lower(CAST("😻col1_\\x414" AS TEXT)) DESC, col1_6 ASC, "cOl1_1");
        test_1        |             CREATE INDEX ON tablē1 (col1_6 DESC, col1_0 ASC, 😅col1_14, col1_2, "col'1_10", "col1_\\x815" ASC);
        test_1        |             CREATE INDEX ON tablē1 (lower(CAST("col1_\\x815" AS TEXT)), col1_11 DESC, col1_2 DESC, col1_7 DESC, col1😡_8, col1_15 ASC, col1_9 DESC, col1_😡16 ASC, 😅col1_14 DESC) INCLUDE (col1_0, "cOl1_1", "😻col1_\\x414", "col1_\\x815", "!col1_12", col1_😘17);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "de" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (18.14s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ fa10e980c24442f18e688bea904ece4777ba0ca9:

        postgres_1    |             AS tab148
        postgres_1    |     ORDER BY
        postgres_1    |         "c̃ ol212",
        postgres_1    |         col213 ASC NULLS LAST,
        postgres_1    |         col214 DESC NULLS FIRST,
        postgres_1    |         "c%ol215" NULLS FIRST,
        postgres_1    |         "%qcoL216" DESC NULLS FIRST,
        postgres_1    |         col217 ASC,
        postgres_1    |         col_218 ASC NULLS LAST
        test_1        | --- FAIL: TestCompare (5.79s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.81s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare1373423950/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("9"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT * FROM (SELECT regprocedure(9:::OID::OID::OID)::REGPROCEDURE AS col225) AS tab152 ORDER BY col225 ASC NULLS FIRST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT * FROM (SELECT regprocedure(9::OID::OID::OID)::REGPROCEDURE AS col225) AS tab152 ORDER BY col225 ASC NULLS FIRST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.85s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "t%pablę1" ("co%ql1_0" BYTES NOT NULL, "c*ol1_1" DATE NOT NULL, col1_2 INTERVAL, "col1{_3" FLOAT8, col1_4 INT2 NULL, "col1_ 5" TSVECTOR NOT NULL, col1_6 REGTYPE, coͭl1_7 TSVECTOR NOT NULL, col1_8 GEOGRAPHY NOT NULL, col1_9 NAME NOT NULL, col1_10 STRING, col1_11 BYTES NOT NULL, col1_12 BOX2D NOT NULL, INVERTED INDEX (col1_8) WHERE (((((("t%pablę1"."co%ql1_0" < e'\\x22':::BYTES) OR ("t%pablę1".col1_4 > 127:::INT8)) OR ("t%pablę1".col1_10 = 'X':::STRING)) OR ("t%pablę1"."c*ol1_1" > 'infinity':::DATE)) OR ("t%pablę1".col1_11 >= e'\\x':::BYTES)) OR ("t%pablę1".col1_9 < '':::STRING:::NAME)) OR ("t%pablę1"."col1{_3" > 3.4028234663852886e+38:::FLOAT8), INDEX (lower(CAST(col1_12 AS STRING))) STORING (col1_2, "col1{_3", "col1_ 5", col1_9, col1_12), FAMILY (col1_8), FAMILY (coͭl1_7), FAMILY (col1_2), FAMILY ("col1{_3", col1_11), FAMILY ("col1_ 5", col1_12, col1_9), FAMILY (col1_10), FAMILY ("co%ql1_0", col1_4), FAMILY (col1_6, "c*ol1_1"));
        test_1        |             ALTER TABLE "t%pablę1" INJECT STATISTICS e'[{"avg_size": 21, "columns": ["\\"col1_ 5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 482465732484637303, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 758493074878366860}, {"avg_size": 14, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 616503500885406372, "histo_buckets": [{"distinct_range": 0, "num_eq": 7948739527321477974, "num_range": 0, "upper_bound": "\\\\x42fd100000000000000000c00921fb54442d18bff8ebf2d74fb903400921fb54442d183ff90340e05bdd64"}, {"distinct_range": 1872150.0171101203, "num_eq": 4575081419126237615, "num_range": 3000000, "upper_bound": "\\\\x42fd300000000000000000c00921fb54442d18bff8ebf2d74fb903400921fb54442d183ff90340e05bdd64"}, {"distinct_range": 4626262.91239642, "num_eq": 5284520385493303044, "num_range": 10000000, "upper_bound": "\\\\x42fd500000000000000000c00921fb54442d18bff8ebf2d74fb903400921fb54442d183ff90340e05bdd64"}, {"distinct_range": 0, "num_eq": 1000000000, "num_range": 7631855695147331569, "upper_bound": "\\\\x42fd700000000000000000c00921fb54442d18bff8ebf2d74fb903400921fb54442d183ff90340e05bdd64"}, {"distinct_range": 38442.679058493355, "num_eq": 40000000, "num_range": 70000, "upper_bound": "\\\\x42fd900000000000000000c00921fb54442d18bff8ebf2d74fb903400921fb54442d183ff90340e05bdd64"}, {"distinct_range": 0, "num_eq": 80000000, "num_range": 40000000, "upper_bound": "\\\\x42fdb00000000000000000c00921fb54442d18bff8ebf2d74fb903400921fb54442d183ff90340e05bdd64"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 758493074878366860}, {"avg_size": 19, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 573518547892629642, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 758493074878366860}, {"avg_size": 5, "columns": ["\\"co%ql1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 576087830708646251, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 758493074878366860}, {"avg_size": 18, "columns": ["\\"col1{_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 175614745880437949, "histo_col_type": "", "name": "__auto__", "null_count": 92470856149046140, "row_count": 758493074878366860}, {"avg_size": 21, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 197595008075418825, "histo_col_type": "", "name": "__auto__", "null_count": 420200825284638834, "row_count": 758493074878366860}, {"avg_size": 12, "columns": ["co\u036Dl1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 316814864054248350, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 758493074878366860}, {"avg_size": 22, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 488839461485462235, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 758493074878366860}, {"avg_size": 13, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 470982628550148068, "histo_col_type": "", "name": "__auto__", "null_count": 41408802106228399, "row_count": 758493074878366860}, {"avg_size": 13, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 92062262316116794, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 758493074878366860}, {"avg_size": 9, "columns": ["\\"c*ol1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 232559391751583965, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 758493074878366860}, {"avg_size": 27, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 73184528570252733, "histo_col_type": "", "name": "__auto__", "null_count": 656487567708339633, "row_count": 758493074878366860}, {"avg_size": 15, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 445656378498067386, "histo_col_type": "", "name": "__auto__", "null_count": 327667955513871100, "row_count": 758493074878366860}]':::JSONB;
        test_1        |             ALTER TABLE "t%pablę1" INJECT STATISTICS e'[{"avg_size": 18, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 14, "histo_col_type": "", "name": "__auto__", "null_count": 24, "row_count": 30}, {"avg_size": 4, "columns": ["\\"col1_ 5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 13, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30}, {"avg_size": 8, "columns": ["co\u036Dl1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 24, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30}, {"avg_size": 17, "columns": ["\\"co%ql1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 18, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30}, {"avg_size": 29, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 23, "histo_col_type": "", "name": "__auto__", "null_count": 6, "row_count": 30}, {"avg_size": 29, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 20, "histo_col_type": "", "name": "__auto__", "null_count": 27, "row_count": 30}, {"avg_size": 12, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30}, {"avg_size": 18, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 17, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30}, {"avg_size": 2, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7, "histo_col_type": "", "name": "__auto__", "null_count": 12, "row_count": 30}, {"avg_size": 30, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 21, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30}, {"avg_size": 8, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30}, {"avg_size": 30, "columns": ["\\"c*ol1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 18, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 30}, {"avg_size": 27, "columns": ["\\"col1{_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 19, "histo_col_type": "", "name": "__auto__", "null_count": 8, "row_count": 30}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (21.04s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ d329422358d677325c818eee10d23f35b080c877:

        postgres_1    | 
        postgres_1    | 2023-04-26 05:14:36.769 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-26 05:14:36.770 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-26 05:14:36.770 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-26 05:14:36.772 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-26 05:14:36.776 UTC [68] LOG:  database system was shut down at 2023-04-26 05:14:36 UTC
        postgres_1    | 2023-04-26 05:14:36.781 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-26 05:14:38.173 UTC [78] ERROR:  syntax error at or near "DESC" at character 330
        postgres_1    | 2023-04-26 05:14:38.173 UTC [78] STATEMENT:  CREATE TABLE "ta%qb""le2" (col2_0 INTERVAL, "co%pl2_1" TSVECTOR NOT NULL, "col 2_2" TIMESTAMP NULL, "co'%pl2_3" TIMESTAMPTZ NOT NULL, col2_4 TSVECTOR NOT NULL, col2_5 GEOGRAPHY NOT NULL, col2_6 INTERVAL NULL, col2😅_7 INT2, col2_8 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("co%pl2_1" AS TEXT))) STORED, INVERTED INDEX (col2_6 DESC, col2_4) PARTITION BY LIST (col2_6) (PARTITION " ta%qb""le2_part0" VALUES IN (('1 mon 1 day'::INTERVAL), ('66 years 9 mons 795 days 08:03:23.831437'::INTERVAL), ('-36 years -2 mons -659 days -01:23:18.012275'::INTERVAL), ('-4 years -3 mons -43 days -23:20:52.339626'::INTERVAL)), PARTITION "ta%qb""le2_part1" VALUES IN (('54 years 2 mons 799 days 11:26:17.170254'::INTERVAL), ('35 years 11 mons 266 days 16:35:17.611436'::INTERVAL), ('63 years 274 days 03:49:40.655808'::INTERVAL), ('40 years 3 mons 386 days 05:00:00.415968'::INTERVAL)), PARTITION "ta%qb""le2_part2" VALUES IN (('27 years 6 mons 198 days 04:08:23.446507'::INTERVAL), ('-30 years -625 days -06:26:25.478114'::INTERVAL), ('57 years 3 mons 27 days 15:11:25.041732'::INTERVAL), ('30 years 6 mons 836 days 15:54:54.20767'::INTERVAL)), PARTITION "ta%qb""le2_part3" VALUES IN (('71 years 6 mons 610 days 09:36:59.771889'::INTERVAL), ('73 years 7 mons 131 days 10:23:21.082667'::INTERVAL), ('67 years 9 mons 258 days 24:22:58.087769'::INTERVAL), ('-16 years -2 mons -163 days -18:36:21.432696'::INTERVAL)), PARTITION "ta%qb""le2_part4" VALUES IN (('-70 years -2 mons -268 days -24:23:04.29695'::INTERVAL), ('49 years 10 mons 251 days 19:32:00.313839'::INTERVAL), ('-29 years -9 mons -418 days -23:08:51.410827'::INTERVAL), ('-75 years -9 mons -866 days -09:14:36.622298'::INTERVAL)), PARTITION "ta%qb""le2_part5" VALUES IN (('75 years 8 mons 818 days 06:42:58.705752'::INTERVAL), ('-18 years -4 mons -601 days -12:19:50.300354'::INTERVAL), ('63 years 2 mons 71 days 08:50:12.027475'::INTERVAL), ('18 years 10 mons 151 days 00:30:40.399539'::INTERVAL)), PARTITION "DEFAULT" VALUES IN ((DEFAULT))) WHERE ((("ta%qb""le2"."col 2_2" != '2001-01-01 00:00:00 BC'::TIMESTAMP) AND ("ta%qb""le2".col2_8 < e'\''::TEXT)) AND ("ta%qb""le2"."co'%pl2_3" > '294276-12-31 23:59:59.999999+00'::TIMESTAMPTZ)) AND ("ta%qb""le2".col2😅_7 != (-1)::INT8))
        test_1        | --- FAIL: TestCompare (4.46s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.81s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "ta%qb""le2" (col2_0 INTERVAL, "co%pl2_1" TSVECTOR NOT NULL, "col 2_2" TIMESTAMP NULL, "co'%pl2_3" TIMESTAMPTZ NOT NULL, col2_4 TSVECTOR NOT NULL, col2_5 GEOGRAPHY NOT NULL, col2_6 INTERVAL NULL, col2😅_7 INT2, col2_8 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("co%pl2_1" AS TEXT))) STORED, INVERTED INDEX (col2_6 DESC, col2_4) PARTITION BY LIST (col2_6) (PARTITION " ta%qb""le2_part0" VALUES IN (('1 mon 1 day'::INTERVAL), ('66 years 9 mons 795 days 08:03:23.831437'::INTERVAL), ('-36 years -2 mons -659 days -01:23:18.012275'::INTERVAL), ('-4 years -3 mons -43 days -23:20:52.339626'::INTERVAL)), PARTITION "ta%qb""le2_part1" VALUES IN (('54 years 2 mons 799 days 11:26:17.170254'::INTERVAL), ('35 years 11 mons 266 days 16:35:17.611436'::INTERVAL), ('63 years 274 days 03:49:40.655808'::INTERVAL), ('40 years 3 mons 386 days 05:00:00.415968'::INTERVAL)), PARTITION "ta%qb""le2_part2" VALUES IN (('27 years 6 mons 198 days 04:08:23.446507'::INTERVAL), ('-30 years -625 days -06:26:25.478114'::INTERVAL), ('57 years 3 mons 27 days 15:11:25.041732'::INTERVAL), ('30 years 6 mons 836 days 15:54:54.20767'::INTERVAL)), PARTITION "ta%qb""le2_part3" VALUES IN (('71 years 6 mons 610 days 09:36:59.771889'::INTERVAL), ('73 years 7 mons 131 days 10:23:21.082667'::INTERVAL), ('67 years 9 mons 258 days 24:22:58.087769'::INTERVAL), ('-16 years -2 mons -163 days -18:36:21.432696'::INTERVAL)), PARTITION "ta%qb""le2_part4" VALUES IN (('-70 years -2 mons -268 days -24:23:04.29695'::INTERVAL), ('49 years 10 mons 251 days 19:32:00.313839'::INTERVAL), ('-29 years -9 mons -418 days -23:08:51.410827'::INTERVAL), ('-75 years -9 mons -866 days -09:14:36.622298'::INTERVAL)), PARTITION "ta%qb""le2_part5" VALUES IN (('75 years 8 mons 818 days 06:42:58.705752'::INTERVAL), ('-18 years -4 mons -601 days -12:19:50.300354'::INTERVAL), ('63 years 2 mons 71 days 08:50:12.027475'::INTERVAL), ('18 years 10 mons 151 days 00:30:40.399539'::INTERVAL)), PARTITION "DEFAULT" VALUES IN ((DEFAULT))) WHERE ((("ta%qb""le2"."col 2_2" != '2001-01-01 00:00:00 BC'::TIMESTAMP) AND ("ta%qb""le2".col2_8 < e'\''::TEXT)) AND ("ta%qb""le2"."co'%pl2_3" > '294276-12-31 23:59:59.999999+00'::TIMESTAMPTZ)) AND ("ta%qb""le2".col2😅_7 != (-1)::INT8))
        test_1        |         compare_test.go:171: postgres: exec: ERROR: syntax error at or near "DESC" (SQLSTATE 42601)
        test_1        |     --- FAIL: TestCompare/mutators (0.53s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "
tab
        test_1        |             lE1" ("%pco-%b7l1_͈0" BOOL NOT NULL, "co
        test_1        |             l\\U000294431_1" REGTYPE, col1_2 STRING COLLATE da NOT NULL, "coL1_😢3" GEOMETRY NOT NULL, col1_4 VARCHAR NOT NULL, col1_5 STRING COLLATE da NULL, col1_6 REGTYPE, col1_😟7 INTERVAL, col1_8 INT2 NULL, "cOL1_9" OID NULL, col1_10 GEOGRAPHY NULL, col1_11 VARCHAR, _col1_12 INT2 NULL, col1_13 GEOGRAPHY, "co\\u326Bl1_14" STRING NULL, "c'ol1%p_15" INT8 NOT NULL, col1_16 FLOAT8, "co.l1_17" TIME NOT NULL, col1_18 VARCHAR, INVERTED INDEX (col1_4 DESC, col1_13 ASC) WHERE (((("
tab
        test_1        |             lE1"._col1_12 < 32767:::INT8) AND ("
tab
        test_1        |             lE1".col1_4 != '"':::STRING)) AND ("
tab
        test_1        |             lE1"."co.l1_17" > '00:00:00':::TIME)) AND ("
tab
        test_1        |             lE1".col1_8 >= (-1):::INT8)) AND ("
tab
        test_1        |             lE1".col1_11 = 'X':::STRING), UNIQUE (col1_11 ASC, ("c'ol1%p_15" + _col1_12) DESC), FAMILY (col1_8, col1_10, "%pco-%b7l1_͈0", "cOL1_9"), FAMILY (col1_11, _col1_12), FAMILY ("co\\u326Bl1_14"), FAMILY ("co.l1_17", col1_5), FAMILY (col1_😟7), FAMILY (col1_6), FAMILY ("co
        test_1        |             l\\U000294431_1", col1_4, col1_13), FAMILY (col1_2, col1_16), FAMILY ("c'ol1%p_15"), FAMILY (col1_18), FAMILY ("coL1_😢3"));
        test_1        |             ALTER TABLE "
tab
        test_1        |             lE1" INJECT STATISTICS e'[{"avg_size": 13, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 88, "histo_col_type": "", "name": "__auto__", "null_count": 25, "row_count": 100}, {"avg_size": 17, "columns": ["col1_\U0001F61F7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 36, "histo_col_type": "", "name": "__auto__", "null_count": 83, "row_count": 100}, {"avg_size": 22, "columns": ["col1_16"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 48, "histo_col_type": "", "name": "__auto__", "null_count": 56, "row_count": 100}, {"avg_size": 2, "columns": ["\\"coL1_\U0001F6223\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 31, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"avg_size": 19, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 15, "histo_buckets": [{"distinct_range": 0, "num_eq": 2062831104578436844, "num_range": 0, "upper_bound": ""}, {"distinct_range": 3677651283966409000, "num_eq": 30000000000, "num_range": 3677651283966409383, "upper_bound": "\\nKF\\u0013"}, {"distinct_range": 0, "num_eq": 6000000, "num_range": 0, "upper_bound": "\\u000e"}, {"distinct_range": 1575419233058111500, "num_eq": 90000, "num_range": 1575419233058111405, "upper_bound": "\\u0013\\u000cmsp\\u000f0\\u0002"}, {"distinct_range": 50000000, "num_eq": 70, "num_range": 50000000, "upper_bound": "?0fwy\\u0016r1"}, {"distinct_range": 0, "num_eq": 8630050989498374671, "num_range": 0, "upper_bound": "H&zz\\t"}, {"distinct_range": 2063669853299577000, "num_eq": 1070653238293324698, "num_range": 2983082163843109779, "upper_bound": "I\\u000fqb<"}, {"distinct_range": 7161361707557615000, "num_eq": 9092437024926757712, "num_range": 7161361707557614583, "upper_bound": "e"}], "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 0, "row_count": 100}, {"avg_size": 8, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 84, "histo_col_type": "", "name": "__auto__", "null_count": 29, "row_count": 100}, {"avg_size": 28, "columns": ["\\"cOL1_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 65, "histo_col_type": "", "name": "__auto__", "null_count": 46, "row_count": 100}, {"avg_size": 17, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 90, "histo_buckets": [{"distinct_range": 0, "num_eq": 90000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 403.5557796924658, "num_eq": 1319294795289847216, "num_range": 2000, "upper_bound": "\\u0016"}, {"distinct_range": 4860019914376762000, "num_eq": 6888859235444559225, "num_range": 4860019914376762012, "upper_bound": "X"}, {"distinct_range": 4.177715515724681, "num_eq": 2591503858222831541, "num_range": 50, "upper_bound": "lM\\u000br\\u0004o"}, {"distinct_range": 1029458711586575400, "num_eq": 20000000, "num_range": 5216096578843169083, "upper_bound": "~cEJ\\u0018.=&"}], "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 4, "row_count": 100}, {"avg_size": 22, "columns": ["\\"co.l1_17\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 88, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"avg_size": 9, "columns": ["\\"%pco-%b7l1_\u03480\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 39, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"avg_size": 27, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 71, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"avg_size": 12, "columns": ["col1_18"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 18, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"avg_size": 0, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 98, "histo_col_type": "", "name": "__auto__", "null_count": 47, "row_count": 100}, {"avg_size": 17, "columns": ["_col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 51, "histo_col_type": "", "name": "__auto__", "null_count": 22, "row_count": 100}, {"avg_size": 13, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 39, "histo_col_type": "", "name": "__auto__", "null_count": 37, "row_count": 100}, {"avg_size": 19, "columns": ["\\"co\\\\\\\\u326Bl1_14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 17, "histo_col_type": "", "name": "__auto__", "null_count": 36, "row_count": 100}, {"avg_size": 17, "columns": ["\\"c\'ol1%p_15\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 59, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 100}, {"avg_size": 4, "columns": ["\\"co\\nl\\\\\\\\U000294431_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 52, "histo_col_type": "", "name": "__auto__", "null_count": 44, "row_count": 100}, {"avg_size": 23, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 81, "histo_col_type": "", "name": "__auto__", "null_count": 18, "row_count": 100}]':::JSONB;
        test_1        |             ALTER TABLE "
tab
        test_1        |             lE1" INJECT STATISTICS e'[{"avg_size": 18, "columns": ["\\"%pco-%b7l1_\u03480\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 988787161084139217, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2999641835808604633}, {"avg_size": 25, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 671203294138525235, "histo_col_type": "", "name": "__auto__", "null_count": 1891593968080588242, "row_count": 2999641835808604633}, {"avg_size": 31, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2929542651453937052, "histo_col_type": "", "name": "__auto__", "null_count": 2100733409807811858, "row_count": 2999641835808604633}, {"avg_size": 10, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1186492897968772457, "histo_buckets": [{"distinct_range": 0, "num_eq": 9173930549119635858, "num_range": 0, "upper_bound": "\\u0001"}, {"distinct_range": 39312.17252842858, "num_eq": 400000, "num_range": 40000, "upper_bound": "\\u00032D\\u0007sx.~D"}, {"distinct_range": 0, "num_eq": 10000000000, "num_range": 1141840816485164345, "upper_bound": "\\u00114E:j"}, {"distinct_range": 0, "num_eq": 0, "num_range": 4171353472162126597, "upper_bound": "6\\u0017QhsCQw"}, {"distinct_range": 2000000000, "num_eq": 1000000000, "num_range": 2000000000, "upper_bound": "D\\u000b\'Z&x"}, {"distinct_range": 2266096958.6113515, "num_eq": 4000, "num_range": 4000000000, "upper_bound": "Z?"}, {"distinct_range": 0, "num_eq": 8785540271170353041, "num_range": 7871952749034060943, "upper_bound": "n\\u001f\\rb"}, {"distinct_range": 0, "num_eq": 2639149767531474368, "num_range": 20, "upper_bound": "~y^"}], "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 2559757902716846226, "row_count": 2999641835808604633}, {"avg_size": 18, "columns": ["_col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1574620577639371736, "histo_col_type": "", "name": "__auto__", "null_count": 1623392500891467882, "row_count": 2999641835808604633}, {"avg_size": 27, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1223300076949948178, "histo_col_type": "", "name": "__auto__", "null_count": 2121046186330908493, "row_count": 2999641835808604633}, {"avg_size": 10, "columns": ["col1_18"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 297015706838424276, "histo_col_type": "", "name": "__auto__", "null_count": 2002376438878938455, "row_count": 2999641835808604633}, {"avg_size": 22, "columns": ["\\"co\\\\\\\\u326Bl1_14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1497212670499081221, "histo_col_type": "", "name": "__auto__", "null_count": 2728862556132794283, "row_count": 2999641835808604633}, {"avg_size": 19, "columns": ["\\"co.l1_17\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1739518416490239256, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2999641835808604633}, {"avg_size": 9, "columns": ["\\"coL1_\U0001F6223\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 371883172400210318, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2999641835808604633}, {"avg_size": 17, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2739204954187897303, "histo_buckets": [{"distinct_range": 0, "num_eq": 7031474831058979250, "num_range": 0, "upper_bound": ""}, {"distinct_range": 8624890714024428000, "num_eq": 8621490373920046716, "num_range": 8867292502541748426, "upper_bound": "\\u000bU\\u0007pGf"}, {"distinct_range": 4332005245145420000, "num_eq": 5696082285394958061, "num_range": 4332005245145419659, "upper_bound": ".,P\\"W"}, {"distinct_range": 0, "num_eq": 70, "num_range": 3449604246231183921, "upper_bound": "?\\u001a\\u0011"}, {"distinct_range": 26.281421919288313, "num_eq": 10000000, "num_range": 50, "upper_bound": "C"}], "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 0, "row_count": 2999641835808604633}, {"avg_size": 26, "columns": ["\\"cOL1_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1863242928637441773, "histo_col_type": "", "name": "__auto__", "null_count": 210027270595570344, "row_count": 2999641835808604633}, {"avg_size": 17, "columns": ["col1_16"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2409212668086756203, "histo_col_type": "", "name": "__auto__", "null_count": 2852872183127241549, "row_count": 2999641835808604633}, {"avg_size": 9, "columns": ["\\"co\\nl\\\\\\\\U000294431_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 177069646495972592, "histo_col_type": "", "name": "__auto__", "null_count": 226324034530133649, "row_count": 2999641835808604633}, {"avg_size": 15, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1892855643373367885, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2999641835808604633}, {"avg_size": 12, "columns": ["col1_\U0001F61F7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2373969737020003708, "histo_col_type": "", "name": "__auto__", "null_count": 2418005321737584069, "row_count": 2999641835808604633}, {"avg_size": 10, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2926531953739366620, "histo_col_type": "", "name": "__auto__", "null_count": 1459752635947331437, "row_count": 2999641835808604633}, {"avg_size": 9, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1015570870249907227, "histo_col_type": "", "name": "__auto__", "null_count": 609729102517461129, "row_count": 2999641835808604633}, {"avg_size": 30, "columns": ["\\"c\'ol1%p_15\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1614111900817091798, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2999641835808604633}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (18.05s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 6636edf9d8c0ebf9cdeedeeffd563ecb49da5b8a:

        postgres_1    |     CREATE INDEX ON "t'able1" ("col
1&_2" ASC, "col%v1_0" ASC, col1_7, col1_9 DESC, col1_8 DESC, "c%vol1_6", col1_3, col1_1, "co�l1
        postgres_1    |     _4");
        postgres_1    |     CREATE UNIQUE INDEX ON "t'able1" (("c%vol1_6" + 0.8136744499206543::FLOAT8) DESC, "col
1&_2" ASC, (CASE WHEN col1_8 IS NULL THEN e'f\x02?\x18\f'::TEXT ELSE e'P[\x1a\bUis:K'::TEXT END) DESC, "col%v1_0" DESC, col1_9 DESC, col1_8 ASC, col1_7 DESC, col1_1 ASC, "c%qol1_5" ASC, "co�l1
        postgres_1    |     _4" ASC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.27s)
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (1.04s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "t'able1" ("col%v1_0" FLOAT8 NOT NULL, col1_1 BIT(39), "col
1&_2" OID, col1_3 BIT(34) NOT NULL, "co�l1
        test_1        |             _4" INT4 NOT NULL, "c%qol1_5" INET NULL, "c%vol1_6" FLOAT4 NOT NULL, col1_7 TEXT COLLATE en NOT NULL, col1_8 REGCLASS NULL, col1_9 FLOAT8 NOT NULL GENERATED ALWAYS AS ("col%v1_0" + (-0.0029122198914114383)::FLOAT8) STORED, PRIMARY KEY ("c%vol1_6", col1_7));
        test_1        |             CREATE INDEX ON "t'able1" ("c%vol1_6") INCLUDE ("col%v1_0", "col
1&_2", col1_3, "co�l1
        test_1        |             _4", "c%qol1_5", col1_8);
        test_1        |             CREATE INDEX ON "t'able1" ("c%vol1_6" DESC, col1_9 ASC, "co�l1
        test_1        |             _4" DESC, col1_7 ASC, col1_1 DESC, col1_8, col1_3 DESC, "col
1&_2") INCLUDE ("c%qol1_5");
        test_1        |             CREATE INDEX ON "t'able1" ("col%v1_0", col1_8 ASC, col1_1);
        test_1        |             CREATE UNIQUE INDEX ON "t'able1" (col1_3 DESC, col1_9 DESC, "col
1&_2");
        test_1        |             CREATE UNIQUE INDEX ON "t'able1" (("col%v1_0" + "c%vol1_6"), "co�l1
        test_1        |             _4" ASC, "c%vol1_6" ASC, "col%v1_0", "c%qol1_5" ASC, col1_8 DESC, col1_3);
        test_1        |             CREATE INDEX ON "t'able1" ("col
1&_2" ASC, "col%v1_0" ASC, col1_7, col1_9 DESC, col1_8 DESC, "c%vol1_6", col1_3, col1_1, "co�l1
        test_1        |             _4");
        test_1        |             CREATE UNIQUE INDEX ON "t'able1" (("c%vol1_6" + 0.8136744499206543::FLOAT8) DESC, "col
1&_2" ASC, (CASE WHEN col1_8 IS NULL THEN e'f\x02?\x18\f'::TEXT ELSE e'P[\x1a\bUis:K'::TEXT END) DESC, "col%v1_0" DESC, col1_9 DESC, col1_8 ASC, col1_7 DESC, col1_1 ASC, "c%qol1_5" ASC, "co�l1
        test_1        |             _4" ASC);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "en" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.98s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "tabl e1" (col1_0 TIMESTAMP[] NOT NULL, "co%l1'_1" STRING COLLATE da NOT NULL, col1_2 TSVECTOR NOT NULL, "col1%v_3" STRING COLLATE de NOT NULL, col1ͤ_4 BYTES NOT NULL, col1_5 BIT(15) NOT NULL, col1_6 TIMETZ NOT NULL, col1_7 FLOAT8 NOT NULL, "cOl1_8" FLOAT4 NOT NULL, col1_9 FLOAT8 NOT NULL, "col\v1_10" VARCHAR NOT NULL, col1_11 BIT(8) NOT NULL, col1_12 STRING[] NOT NULL, "c%pol1%v_13" INET NOT NULL, "col1_ 14" FLOAT8 NOT NULL AS ((col1_7 + "cOl1_8") + col1_9) STORED, INDEX ((CASE WHEN col1_12 IS NULL THEN 'JrE<o':::STRING ELSE '':::STRING END)) STORING ("co%l1'_1", "col1%v_3", col1ͤ_4, col1_5, "cOl1_8", col1_9, "col1_ 14") WHERE ((((("tabl e1"."cOl1_8" > 'NaN':::FLOAT8) AND ("tabl e1"."col1_ 14" != 5e-324:::FLOAT8)) OR ("tabl e1".col1_6 > '00:00:00+15:59':::TIMETZ)) OR ("tabl e1".col1ͤ_4 <= '\xff':::BYTES)) AND ("tabl e1"."col\v1_10" > e'\x00':::STRING)) OR ("tabl e1".col1_7 = 1.0:::FLOAT8), INDEX (col1ͤ_4, col1_6, ((col1_7 + "cOl1_8") + col1_9) ASC, "col1_ 14", col1_5, col1_12 DESC) STORING (col1_2, "col1%v_3", col1_7, "cOl1_8", col1_9, "col\v1_10", col1_11, "c%pol1%v_13") WHERE (((((("tabl e1"."col\v1_10" > e'\'':::STRING) OR ("tabl e1"."cOl1_8" != '+Inf':::FLOAT8)) OR ("tabl e1".col1_6 >= '24:00:00-15:59':::TIMETZ)) AND ("tabl e1"."col1_ 14" > (-1.0):::FLOAT8)) OR ("tabl e1".col1_9 < 1.7976931348623157e+308:::FLOAT8)) OR ("tabl e1".col1_7 <= (-1.0):::FLOAT8)) AND ("tabl e1".col1ͤ_4 >= e'\\x58':::BYTES), FAMILY ("co%l1'_1", "c%pol1%v_13"), FAMILY (col1_5), FAMILY ("col1%v_3", "col\v1_10", "col1_ 14"), FAMILY (col1ͤ_4), FAMILY (col1_2), FAMILY (col1_0), FAMILY (col1_7, col1_11), FAMILY (col1_12, "cOl1_8"), FAMILY (col1_9, col1_6));
        test_1        |             ALTER TABLE "tabl e1" INJECT STATISTICS e'[{"avg_size": 4, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1460434467741411121, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}, {"avg_size": 19, "columns": ["\\"col\\\\v1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5480395155405054357, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}, {"avg_size": 23, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4247854071030596352, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}, {"avg_size": 19, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3660846031544302042, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}, {"avg_size": 6, "columns": ["\\"cOl1_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1321010054249539103, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}, {"avg_size": 17, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1522490170455718101, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}, {"avg_size": 29, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 994143158115597998, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}, {"avg_size": 18, "columns": ["\\"col1_ 14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5253857089128858416, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}, {"avg_size": 11, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2291905928833160569, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}, {"avg_size": 25, "columns": ["\\"co%l1\'_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4548885865277619848, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}, {"avg_size": 20, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3043489061053794041, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}, {"avg_size": 0, "columns": ["\\"col1%v_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 138394552904805596, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}, {"avg_size": 18, "columns": ["col1\u0364_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3170066075191095266, "histo_buckets": [{"distinct_range": 0, "num_eq": 7703894748112241777, "num_range": 0, "upper_bound": "\\\\x03508890b8d229"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}, {"avg_size": 15, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 425460958978687660, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}, {"avg_size": 25, "columns": ["\\"c%pol1%v_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5321623941082762565, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 5523678545569657775}]':::JSONB;
        test_1        |             ALTER TABLE "tabl e1" INJECT STATISTICS e'[{"avg_size": 7, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 194563, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 300000}, {"avg_size": 31, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 137817, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 300000}, {"avg_size": 30, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 265700, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 300000}, {"avg_size": 1, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 155054, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 300000}, {"avg_size": 6, "columns": ["\\"col\\\\v1_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 128690, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 300000}, {"avg_size": 31, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 280852, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 300000}, {"avg_size": 7, "columns": ["\\"c%pol1%v_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 37058, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 300000}, {"avg_size": 22, "columns": ["\\"col1_ 14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 43439, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 300000}, {"avg_size": 18, "columns": ["\\"co%l1\'_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 129109, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 300000}, {"avg_size": 6, "columns": ["\\"col1%v_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 215800, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 300000}, {"avg_size": 28, "columns": ["col1\u0364_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 115333, "histo_buckets": [{"distinct_range": 0, "num_eq": 4000, "num_range": 0, "upper_bound": "\\\\x"}, {"distinct_range": 2578339829633064000, "num_eq": 1519192615028760996, "num_range": 6199599272912473253, "upper_bound": "\\\\x1a0269553cdba7"}, {"distinct_range": 500000, "num_eq": 90, "num_range": 500000, "upper_bound": "\\\\x36e8bfef"}, {"distinct_range": 0, "num_eq": 1568238170475361192, "num_range": 6441232897456400130, "upper_bound": "\\\\x4563d2bd17b6"}, {"distinct_range": 200000000, "num_eq": 3660911239359239380, "num_range": 200000000, "upper_bound": "\\\\x6408"}, {"distinct_range": 0, "num_eq": 6985290861542729569, "num_range": 1000000, "upper_bound": "\\\\x7caeec28ce9ab0"}, {"distinct_range": 0, "num_eq": 0, "num_range": 6993208114073021482, "upper_bound": "\\\\x9d87"}, {"distinct_range": 30000000000, "num_eq": 4000000000, "num_range": 30000000000, "upper_bound": "\\\\xd23889c3ce72"}, {"distinct_range": 0, "num_eq": 3832811033130435811, "num_range": 10000, "upper_bound": "\\\\xe6"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 300000}, {"avg_size": 17, "columns": ["\\"cOl1_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 279713, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 300000}, {"avg_size": 3, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 211497, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 300000}, {"avg_size": 11, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 217391, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 300000}, {"avg_size": 4, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 10190, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 300000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.45s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 7f6458093d42bb7131cef623deb47f6318a233e9:

        postgres_1    | 
        postgres_1    | 2023-04-28 05:20:07.953 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-28 05:20:07.953 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-28 05:20:07.953 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-28 05:20:07.957 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-28 05:20:07.963 UTC [68] LOG:  database system was shut down at 2023-04-28 05:20:07 UTC
        postgres_1    | 2023-04-28 05:20:07.968 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-28 05:20:09.187 UTC [78] ERROR:  collation "de" for encoding "UTF8" does not exist at character 195
        postgres_1    | 2023-04-28 05:20:09.187 UTC [78] STATEMENT:  CREATE TABLE table4 (col4_0 UUID, col4_1 REGTYPE NULL, col4_2 OID NULL, col4_3 BIT(3) NOT NULL, "col4|_!%q4" TIMESTAMP, "co😳l4_\\U0005D0C55" CHAR NOT NULL, "col�4_6" BYTEA NOT NULL, col4_7 TEXT COLLATE de NOT NULL, col4_8 TSVECTOR NOT NULL, "c�ol4_9" BIT(30) NULL, "col4_'10" REGCLASS NULL, "c""ol4_11" TEXT NULL GENERATED ALWAYS AS (CASE WHEN "col4_'10" IS NULL THEN ''::TEXT ELSE ''::TEXT END) STORED, "co!l4_12" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col4_8 AS TEXT))) STORED, col4_13 TEXT NULL GENERATED ALWAYS AS (CASE WHEN "col4_'10" IS NULL THEN 'Uz3Pla'::TEXT ELSE e'PiYQ\x16"]\x11'::TEXT END) STORED);
        postgres_1    |     CREATE UNIQUE INDEX ON table4 ("co!l4_12" DESC, "co😳l4_\\U0005D0C55", "c�ol4_9" DESC, "col4_'10", lower(CAST(col4_0 AS TEXT)) ASC, col4_3 ASC, col4_2 ASC, col4_0 DESC, "col�4_6" DESC, "col4|_!%q4" DESC, col4_13 DESC, col4_1 ASC) INCLUDE (col4_8);
        postgres_1    |     CREATE INDEX ON table4 (col4_7 DESC, "c�ol4_9" DESC, "col�4_6" ASC, "c""ol4_11", col4_1 DESC);
        postgres_1    |     CREATE INDEX ON table4 ("c""ol4_11" DESC, lower(CAST(col4_8 AS TEXT)) ASC, "col�4_6" DESC, col4_1 ASC, "col4|_!%q4" ASC, col4_2 DESC, "co😳l4_\\U0005D0C55" ASC, col4_7, (CASE WHEN "col4|_!%q4" IS NULL THEN 'e3'::TEXT ELSE ')'::TEXT END) DESC) INCLUDE (col4_0, col4_3, col4_8, "c�ol4_9");
        postgres_1    |     CREATE INDEX ON table4 (col4_1 ASC, "co😳l4_\\U0005D0C55" ASC) INCLUDE (col4_2, "col4|_!%q4", "col4_'10", "co!l4_12", col4_13);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.35s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.03s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table4 (col4_0 UUID, col4_1 REGTYPE NULL, col4_2 OID NULL, col4_3 BIT(3) NOT NULL, "col4|_!%q4" TIMESTAMP, "co😳l4_\\U0005D0C55" CHAR NOT NULL, "col�4_6" BYTEA NOT NULL, col4_7 TEXT COLLATE de NOT NULL, col4_8 TSVECTOR NOT NULL, "c�ol4_9" BIT(30) NULL, "col4_'10" REGCLASS NULL, "c""ol4_11" TEXT NULL GENERATED ALWAYS AS (CASE WHEN "col4_'10" IS NULL THEN ''::TEXT ELSE ''::TEXT END) STORED, "co!l4_12" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col4_8 AS TEXT))) STORED, col4_13 TEXT NULL GENERATED ALWAYS AS (CASE WHEN "col4_'10" IS NULL THEN 'Uz3Pla'::TEXT ELSE e'PiYQ\x16"]\x11'::TEXT END) STORED);
        test_1        |             CREATE UNIQUE INDEX ON table4 ("co!l4_12" DESC, "co😳l4_\\U0005D0C55", "c�ol4_9" DESC, "col4_'10", lower(CAST(col4_0 AS TEXT)) ASC, col4_3 ASC, col4_2 ASC, col4_0 DESC, "col�4_6" DESC, "col4|_!%q4" DESC, col4_13 DESC, col4_1 ASC) INCLUDE (col4_8);
        test_1        |             CREATE INDEX ON table4 (col4_7 DESC, "c�ol4_9" DESC, "col�4_6" ASC, "c""ol4_11", col4_1 DESC);
        test_1        |             CREATE INDEX ON table4 ("c""ol4_11" DESC, lower(CAST(col4_8 AS TEXT)) ASC, "col�4_6" DESC, col4_1 ASC, "col4|_!%q4" ASC, col4_2 DESC, "co😳l4_\\U0005D0C55" ASC, col4_7, (CASE WHEN "col4|_!%q4" IS NULL THEN 'e3'::TEXT ELSE ')'::TEXT END) DESC) INCLUDE (col4_0, col4_3, col4_8, "c�ol4_9");
        test_1        |             CREATE INDEX ON table4 (col4_1 ASC, "co😳l4_\\U0005D0C55" ASC) INCLUDE (col4_2, "col4|_!%q4", "col4_'10", "co!l4_12", col4_13);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "de" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (1.19s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "table%v1" ("col1_%p0" STRING NOT NULL, "col-1_1" OID, "col1_ 2" BYTES NOT NULL, "col1""_3" TIMESTAMP NULL, "col1_""4" INT2 NOT NULL, "col1�_5" INTERVAL NOT NULL, col1_6 STRING NULL AS (CASE WHEN "col1""_3" IS NULL THEN '':::STRING ELSE e'd&(\x11\x019N~':::STRING END) VIRTUAL, col1_7 STRING AS (lower(CAST("col-1_1" AS STRING))) VIRTUAL, PRIMARY KEY ("col1_""4"), UNIQUE ("col1_ 2" DESC, col1_6, "col1�_5" ASC, "col1_%p0" DESC, col1_7 DESC, "col-1_1") STORING ("col1""_3") WHERE ((((("table%v1"."col1_""4" > (-1):::INT8) OR ("table%v1"."col1""_3" > '2001-01-01 00:00:00 BC':::TIMESTAMP)) OR ("table%v1"."col1_%p0" != e'\'':::STRING)) AND ("table%v1"."col1_ 2" <= '\x27':::BYTES)) AND ("table%v1".col1_7 != e'\'':::STRING)) OR ("table%v1".col1_6 >= e'\'':::STRING), UNIQUE ((CASE WHEN "col1_ 2" IS NULL THEN e'\x07\x04':::STRING ELSE 'x':::STRING END) DESC, "col-1_1", "col1_ 2", "col1""_3" DESC, "col1_""4" ASC, "col1_%p0" DESC, col1_6 ASC) STORING ("col1�_5") WHERE ((((("table%v1".col1_6 <= 'X':::STRING) AND ("table%v1"."col1""_3" != '294276-12-31 23:59:59.999999':::TIMESTAMP)) AND ("table%v1"."col1_""4" <= 127:::INT8)) AND ("table%v1"."col1_ 2" > e'\\xff':::BYTES)) OR ("table%v1".col1_7 <= e'\'':::STRING)) AND ("table%v1"."col1_%p0" < e'\'':::STRING), UNIQUE ("col1_ 2") STORING ("col1�_5") WHERE ((("table%v1"."col1_""4" > 32767:::INT8) OR ("table%v1"."col1_%p0" >= '':::STRING)) AND ("table%v1".col1_7 != '"':::STRING)) OR ("table%v1"."col1_ 2" = '\x22':::BYTES), FAMILY ("col1_ 2"), FAMILY ("col1�_5", "col1""_3"), FAMILY ("col1_""4", "col-1_1", "col1_%p0"));
        test_1        |             ALTER TABLE "table%v1" INJECT STATISTICS e'[{"avg_size": 0, "columns": ["\\"col1_ 2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 8587199410486895948, "num_range": 0, "upper_bound": "\\\\x"}, {"distinct_range": 1560617874.7198653, "num_eq": 100000, "num_range": 3000000000, "upper_bound": "\\\\x0dd6c65b04"}, {"distinct_range": 0, "num_eq": 20000000000, "num_range": 387245644810202776, "upper_bound": "\\\\x271c9a"}, {"distinct_range": 0, "num_eq": 10000000000, "num_range": 700000, "upper_bound": "\\\\x4405c05ae315cb7f"}, {"distinct_range": 0, "num_eq": 9000, "num_range": 5258892961949531845, "upper_bound": "\\\\x44e51a7d43"}, {"distinct_range": 1000000000, "num_eq": 80000000, "num_range": 1000000000, "upper_bound": "\\\\x6d108db015b1d3d3dd"}, {"distinct_range": 1387681994663042300, "num_eq": 300000, "num_range": 1387681994663042286, "upper_bound": "\\\\xd381"}, {"distinct_range": 2092895535167271400, "num_eq": 30000, "num_range": 2092895535167271516, "upper_bound": "\\\\xd3aa"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col1\\"\\"_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col1_\\"\\"4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_buckets": [{"distinct_range": 0, "num_eq": 594213916362855680, "num_range": 0, "upper_bound": "-11662"}, {"distinct_range": 0, "num_eq": 6630168519244590005, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 5867917802961833000, "num_eq": 8000000000, "num_range": 6613724710103770563, "upper_bound": "5809"}, {"distinct_range": 0, "num_eq": 70000, "num_range": 20000000, "upper_bound": "8202"}, {"distinct_range": 259672.31693130377, "num_eq": 1000, "num_range": 300000, "upper_bound": "31343"}], "histo_col_type": "INT2", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col1\\u000c_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col1_%p0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}, {"avg_size": 0, "columns": ["\\"col-1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}]':::JSONB;
        test_1        |             ALTER TABLE "table%v1" INJECT STATISTICS e'[{"avg_size": 3, "columns": ["\\"col-1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1832184297686284154, "histo_col_type": "", "name": "__auto__", "null_count": 871039798253853361, "row_count": 4533525715345890200}, {"avg_size": 9, "columns": ["\\"col1_ 2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1513186105415231287, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4533525715345890200}, {"avg_size": 28, "columns": ["\\"col1\\"\\"_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3695543713249641274, "histo_col_type": "", "name": "__auto__", "null_count": 3885321385990268729, "row_count": 4533525715345890200}, {"avg_size": 24, "columns": ["\\"col1_\\"\\"4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1356023361467049258, "histo_buckets": [{"distinct_range": 0, "num_eq": 7000000, "num_range": 0, "upper_bound": "-27849"}, {"distinct_range": 3000000000, "num_eq": 5000000000, "num_range": 3000000000, "upper_bound": "-26652"}, {"distinct_range": 3483201871186214000, "num_eq": 6303945751528135577, "num_range": 4604833400020284576, "upper_bound": "0"}, {"distinct_range": 0, "num_eq": 2104081594560614057, "num_range": 10000, "upper_bound": "3309"}, {"distinct_range": 7358988176229970000, "num_eq": 2000000, "num_range": 7358988176229970304, "upper_bound": "4934"}, {"distinct_range": 0, "num_eq": 10000, "num_range": 5729328958280547266, "upper_bound": "7399"}, {"distinct_range": 2002609490253911600, "num_eq": 7782243680530373398, "num_range": 2002609490253911590, "upper_bound": "8295"}, {"distinct_range": 2894434564482821600, "num_eq": 500000000, "num_range": 2894434564482821662, "upper_bound": "25674"}], "histo_col_type": "INT2", "name": "__auto__", "null_count": 0, "row_count": 4533525715345890200}, {"avg_size": 20, "columns": ["\\"col1\\u000c_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1280191451207542874, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4533525715345890200}, {"avg_size": 0, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2343825086052250698, "histo_col_type": "", "name": "__auto__", "null_count": 993411560610998623, "row_count": 4533525715345890200}, {"avg_size": 31, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2196650170613440520, "histo_col_type": "", "name": "__auto__", "null_count": 3703269721427708457, "row_count": 4533525715345890200}, {"avg_size": 10, "columns": ["\\"col1_%p0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2997554381734257820, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4533525715345890200}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.33s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ f0e37ada00cf99a1fa25236e158861647c2ea713:

        postgres_1    | 2023-04-29 05:18:40.274 UTC [49] LOG:  background worker "logical replication launcher" (PID 56) exited with exit code 1
        postgres_1    | 2023-04-29 05:18:40.276 UTC [51] LOG:  shutting down
        postgres_1    | 2023-04-29 05:18:40.380 UTC [49] LOG:  database system is shut down
        test_1        | I230429 05:18:40.470065 8 testutils/soon.go:41  [-] 1  SucceedsSoon: dial tcp 172.18.0.3:5432: connect: connection refused
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-04-29 05:18:40.493 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-04-29 05:18:40.493 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-04-29 05:18:40.493 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-04-29 05:18:40.497 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-04-29 05:18:40.502 UTC [68] LOG:  database system was shut down at 2023-04-29 05:18:40 UTC
        postgres_1    | 2023-04-29 05:18:40.507 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-04-29 05:18:42.451 UTC [78] ERROR:  syntax error at or near "DESC" at character 517
        postgres_1    | 2023-04-29 05:18:42.451 UTC [78] STATEMENT:  CREATE TABLE "tabl""e2" ("col2\\uB4FA_0" REGCLASS, col2_1 GEOMETRY NOT NULL, col2_2 NAME NULL, col2_3 JSONB NOT NULL, "col2,%q_4" BYTEA NOT NULL, col2_5 CHAR NOT NULL, col2_6 REGTYPE NULL, "'col2_7" TEXT NULL, col2_8 UUID NOT NULL, "col2_%v9" INET NOT NULL, "col2/_10" TSVECTOR NOT NULL, " col2_11" TIMESTAMP NULL, col2_12 TEXT COLLATE da NOT NULL, "col\\x372_13" INT2 NOT NULL, col2_14 VARCHAR NULL, col2_15 GEOGRAPHY, col2_16 "char" NULL, col2_17 GEOGRAPHY NOT NULL, "c ol2_18" BIT(35), INVERTED INDEX ("col2_%v9" DESC, lower(CAST(col2_3 AS TEXT)) DESC, "col2/_10") WHERE ("tabl""e2".col2_16 > 'X'::TEXT) AND ("tabl""e2".col2_2 <= e'\''::TEXT::NAME));
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.89s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.97s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "tabl""e2" ("col2\\uB4FA_0" REGCLASS, col2_1 GEOMETRY NOT NULL, col2_2 NAME NULL, col2_3 JSONB NOT NULL, "col2,%q_4" BYTEA NOT NULL, col2_5 CHAR NOT NULL, col2_6 REGTYPE NULL, "'col2_7" TEXT NULL, col2_8 UUID NOT NULL, "col2_%v9" INET NOT NULL, "col2/_10" TSVECTOR NOT NULL, " col2_11" TIMESTAMP NULL, col2_12 TEXT COLLATE da NOT NULL, "col\\x372_13" INT2 NOT NULL, col2_14 VARCHAR NULL, col2_15 GEOGRAPHY, col2_16 "char" NULL, col2_17 GEOGRAPHY NOT NULL, "c ol2_18" BIT(35), INVERTED INDEX ("col2_%v9" DESC, lower(CAST(col2_3 AS TEXT)) DESC, "col2/_10") WHERE ("tabl""e2".col2_16 > 'X'::TEXT) AND ("tabl""e2".col2_2 <= e'\''::TEXT::NAME));
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: syntax error at or near "DESC" (SQLSTATE 42601)
        test_1        |     --- FAIL: TestCompare/mutators (0.79s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 GEOMETRY NOT NULL);
        test_1        |             ALTER TABLE table1 INJECT STATISTICS '[{"avg_size": 0, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 0, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 0}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS '[{"avg_size": 12, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 902, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.50s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 6944c293f14d5c1c5b28d6ea53329c3e214dd9ea:

        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (3.06s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare3792527711/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("1"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(1:::OID::OID::OID)::REGPROCEDURE AS col1990) AS tab1351
        test_1        |             ORDER BY
        test_1        |                 col1990 DESC NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(1::OID::OID::OID)::REGPROCEDURE AS col1990) AS tab1351
        test_1        |             ORDER BY
        test_1        |                 col1990 DESC NULLS LAST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.75s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "tabLe1" (col͚1_0 TIMETZ NOT NULL, PRIMARY KEY (col͚1_0 DESC), INDEX (col͚1_0) PARTITION BY LIST (col͚1_0) (PARTITION "tabLe1😋_part0" VALUES IN (('18:14:18.08262-08:18':::TIMETZ,), ('20:45:13.246108-09:20':::TIMETZ,), ('02:48:03.08584-06:41':::TIMETZ,), ('09:16:44.819837-05:04':::TIMETZ,), ('09:11:27.003859+07:35':::TIMETZ,), ('00:00:00+15:59':::TIMETZ,), ('22:15:51.783253-04:23':::TIMETZ,)), PARTITION "tabLe1_part1" VALUES IN (('10:17:12.532195+12:06':::TIMETZ,), ('12:36:43.784413+04:54':::TIMETZ,), ('05:14:28.113244+14:45':::TIMETZ,), ('21:40:29.358131-06:13':::TIMETZ,), ('15:25:03.320151+03:44':::TIMETZ,), ('19:43:09.710238+02:09':::TIMETZ,), ('03:16:22.577948+13:38':::TIMETZ,)), PARTITION "t  abLe1_pa rt2" VALUES IN (('14:11:55.389442-07:01':::TIMETZ,), ('11:45:59.899212-06:48':::TIMETZ,), ('20:19:46.441978+06:54':::TIMETZ,), ('09:49:18.141437-09:55':::TIMETZ,), ('23:54:58.618069-10:15':::TIMETZ,), ('13:00:03.614344-07:51':::TIMETZ,)), PARTITION "tabLe1_p%e9art3" VALUES IN (('19:16:42.912762-04:38':::TIMETZ,), ('08:21:31.027607+11:02':::TIMETZ,), ('21:58:32.973278+13:03':::TIMETZ,), ('04:00:46.496534-00:23':::TIMETZ,), ('03:19:36.247268-10:10':::TIMETZ,), ('22:41:49.855883-13:33':::TIMETZ,)), PARTITION "tabLe1_pa�rt4" VALUES IN (('08:25:35.011942-03:25':::TIMETZ,), ('06:50:00.942909-10:19':::TIMETZ,), ('07:51:36.698143-04:02':::TIMETZ,), ('19:07:30.864164-10:49':::TIMETZ,), ('19:59:19.562023-02:26':::TIMETZ,), ('15:10:37.198286+01:31':::TIMETZ,), ('01:36:47.050574+08:45':::TIMETZ,)), PARTITION "tabLe1_part5" VALUES IN (('23:55:11.337481-02:08':::TIMETZ,), ('07:54:46.8793+08:26':::TIMETZ,), ('15:59:00.344142-04:21':::TIMETZ,), ('06:40:41.853405-10:25':::TIMETZ,), ('10:33:00.404913+14:55':::TIMETZ,), ('16:07:20.111451+13:58':::TIMETZ,), ('15:59:51.499961-05:30':::TIMETZ,)), PARTITION "tabLe1_part6" VALUES IN (('10:43:04.488063+04:42':::TIMETZ,), ('05:32:27.58307+10:12':::TIMETZ,), ('24:00:00-15:59':::TIMETZ,), ('14:56:47.39641+12:55':::TIMETZ,), ('06:46:29.128761+00:03':::TIMETZ,), ('22:46:06.82047+13:30':::TIMETZ,), ('20:59:15.674358-05:12':::TIMETZ,))) WHERE "tabLe1".col͚1_0 != '00:00:00+15:59':::TIMETZ NOT VISIBLE, UNIQUE (col͚1_0), UNIQUE (col͚1_0 ASC), INDEX (col͚1_0 ASC) WHERE "tabLe1".col͚1_0 >= '24:00:00-15:59':::TIMETZ, UNIQUE (col͚1_0 DESC) WHERE "tabLe1".col͚1_0 > '00:00:00+15:59':::TIMETZ, INDEX (col͚1_0 ASC) WHERE "tabLe1".col͚1_0 >= '24:00:00-15:59':::TIMETZ, UNIQUE (lower(CAST(col͚1_0 AS STRING))) WHERE "tabLe1".col͚1_0 > '00:00:00+15:59':::TIMETZ);
        test_1        |             ALTER TABLE "tabLe1" INJECT STATISTICS e'[{"avg_size": 18, "columns": ["col\u035A1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 606616181081464865, "histo_buckets": [{"distinct_range": 0, "num_eq": 50, "num_range": 0, "upper_bound": "01:25:54.089481+12:27"}, {"distinct_range": 0, "num_eq": 9094695338944755069, "num_range": 800000000, "upper_bound": "03:09:08.17331+05:43"}, {"distinct_range": 50000, "num_eq": 500000000, "num_range": 50000, "upper_bound": "00:05:24.042155-01:41"}, {"distinct_range": 90000000, "num_eq": 7538845372173066616, "num_range": 90000000, "upper_bound": "00:06:37.002918-06:17"}, {"distinct_range": 2020835213127793700, "num_eq": 40000, "num_range": 2020835213127793779, "upper_bound": "00:05:50.826272-11:16"}, {"distinct_range": 0, "num_eq": 1000, "num_range": 5000000, "upper_bound": "12:58:56.655706-01:32"}, {"distinct_range": 0, "num_eq": 1125161425539496035, "num_range": 20000, "upper_bound": "12:47:12.392966-02:54"}, {"distinct_range": 7145871861896964000, "num_eq": 5020240569743355731, "num_range": 7145871861896964064, "upper_bound": "18:58:05.641814+02:27"}, {"distinct_range": 1193930530003782400, "num_eq": 8826872515067811969, "num_range": 1457349867404047426, "upper_bound": "13:50:36.066747-11:17"}], "histo_col_type": "TIMETZ", "name": "__auto__", "null_count": 0, "row_count": 2431685967756692030}]':::JSONB;
        test_1        |             ALTER TABLE "tabLe1" INJECT STATISTICS e'[{"avg_size": 18, "columns": ["col\u035A1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7126891595271400797, "histo_buckets": [{"distinct_range": 0, "num_eq": 7000000000, "num_range": 0, "upper_bound": "06:34:46.36407+11:40"}, {"distinct_range": 3907309996653790.5, "num_eq": 1000, "num_range": 1568063237050783099, "upper_bound": "14:59:42.62554+14"}, {"distinct_range": 0, "num_eq": 20000000, "num_range": 2060805563370612565, "upper_bound": "15:31:13.729496+08:12"}, {"distinct_range": 724412.2499146009, "num_eq": 900, "num_range": 2000000, "upper_bound": "17:42:48.375475+07:13"}, {"distinct_range": 0, "num_eq": 1302861347117373012, "num_range": 2412676944172926347, "upper_bound": "00:44:21.29589-12:37"}, {"distinct_range": 976399399.0433302, "num_eq": 7994667254122198249, "num_range": 1000000000, "upper_bound": "18:33:08.824658+03:03"}, {"distinct_range": 3637333558685059600, "num_eq": 3216554314944917091, "num_range": 3637333558685059411, "upper_bound": "18:36:17.560585-01:58"}, {"distinct_range": 101875305.71257351, "num_eq": 30000000000, "num_range": 700000000, "upper_bound": "24:00:00-15:59"}], "histo_col_type": "TIMETZ", "name": "__auto__", "null_count": 0, "row_count": 7259013907624965929}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (26.53s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ fa8d237846052ae72cc44b3eaebe1f38c89834f8:

        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (2.38s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare585856729/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("2"),
        test_1        |               }))
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(2:::INT8::INT4::INT4)::REGPROCEDURE AS "\rcol2626") AS tab1256
        test_1        |             ORDER BY
        test_1        |                 "\rcol2626" DESC NULLS LAST;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(2::INT8::INT4::INT4)::REGPROCEDURE AS "\rcol2626") AS tab1256
        test_1        |             ORDER BY
        test_1        |                 "\rcol2626" DESC NULLS LAST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.50s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE tabl🙁e1 (😴col1_0 INET NOT NULL, col1_1 INTERVAL NOT NULL, col1_2 NAME NOT NULL, col1_3 UUID NOT NULL, "col1�_4" "char" NOT NULL, "col1_%v5" STRING NOT NULL, "coLͤ1_6" INTERVAL, "c̘ ol1_7" UUID NULL, col1_8 TIMESTAMPTZ NOT NULL, col1_9 STRING NOT NULL AS (lower("col1�_4")) STORED, col1_10 STRING NULL AS (lower(CAST("c̘ ol1_7" AS STRING))) VIRTUAL, col1_11 STRING NOT NULL AS (lower(col1_2)) STORED, col1_12 STRING NOT NULL AS (lower(CAST(😴col1_0 AS STRING))) STORED, "col 1_13" STRING NOT NULL AS (CASE WHEN col1_1 IS NULL THEN '':::STRING ELSE e'%Puy+-=\x16j':::STRING END) VIRTUAL, PRIMARY KEY (col1_8 DESC, "col 1_13", col1_2 ASC, col1_11 ASC), UNIQUE (col1_1 DESC, "col 1_13", 😴col1_0, col1_8 DESC, col1_9, "c̘ ol1_7" DESC, lower(CAST("c̘ ol1_7" AS STRING)) ASC, col1_12 ASC, col1_3 DESC) STORING ("col1�_4", "col1_%v5") WHERE ((((((tabl🙁e1.col1_8 < '294276-12-31 23:59:59.999999+00':::TIMESTAMPTZ) OR (tabl🙁e1."col 1_13" > e'\U00002603':::STRING)) AND (tabl🙁e1.col1_11 != e'\'':::STRING)) OR (tabl🙁e1.col1_12 >= '':::STRING)) OR (tabl🙁e1."col1�_4" <= e'\'':::STRING)) OR (tabl🙁e1.col1_9 = '"':::STRING)) OR (tabl🙁e1."col1_%v5" = '':::STRING), UNIQUE (lower(CAST(😴col1_0 AS STRING)) DESC, col1_12 ASC, lower("col1�_4") ASC, 😴col1_0, "col1�_4", col1_9 ASC, col1_8) WHERE (tabl🙁e1.col1_9 < '':::STRING) OR (tabl🙁e1.col1_10 <= '':::STRING), UNIQUE (col1_11 ASC, "col 1_13" DESC, "coLͤ1_6", col1_10) STORING (😴col1_0, col1_1, "col1�_4", "col1_%v5", col1_9, col1_12) PARTITION BY LIST (col1_11, "col 1_13") (PARTITION tabl🙁e1_part0 VALUES IN ((e'\x1f;\x1d':::STRING, e'\x00':::STRING), ('~a]zb':::STRING, e'Z}X6g\x15':::STRING), (e'\x00':::STRING, e'\'':::STRING), ('>':::STRING, '@WjS':::STRING)), PARTITION tabl🙁e1_part1 VALUES IN ((e'0>A{\x1a':::STRING, e'\x15\x05$?':::STRING), (e'K:u\\0-yV\x19':::STRING, e'X\x17\x7fC\n\x12fz%':::STRING), (e'j~.\x0fKHu}a':::STRING, 'NA!':::STRING), ('"':::STRING, 'TaZboxc8':::STRING)), PARTITION tabl😍🙁e1_part2 VALUES IN (('Z':::STRING, e'*\x04c\x18\x06':::STRING), ('H+/':::STRING, e'\x15jr2,(\x01&g':::STRING), (e'2ii\x1ee':::STRING, '':::STRING), (e'1\x01@ \x1c,\x14%I':::STRING, '':::STRING)), PARTITION tabl🙁e1_part3 VALUES IN ((e'\U00002603':::STRING, e'9f\x0f\x10(G``\x05\f':::STRING), ('=R':::STRING, e'\x1d':::STRING), (e'\'-OZa\x07':::STRING, e'5JO)fZ\x0b':::STRING), (e'\U00002603':::STRING, '{;K':::STRING)), PARTITION tabl🙁e1_part4 VALUES IN (('':::STRING, '|':::STRING), (e';\x19$':::STRING, e'\'':::STRING), ('U':::STRING, e'KUp\x01':::STRING), ('R':::STRING, e'\x12\x18(KO':::STRING)), PARTITION tabl🙁e1_part5 VALUES IN ((e'/K\x14Ek':::STRING, e'E\n:L,Gq0':::STRING), ('':::STRING, e'%_\x05\x1cH\x1e\b':::STRING), ('y':::STRING, e'(8\x7fxiE\x01':::STRING), (e'\fG\x1bD\x18':::STRING, '':::STRING)), PARTITION tabl🙁e1_part6 VALUES IN (('':::STRING, e'E.M,S]\x0b~6':::STRING), ('Z{':::STRING, '':::STRING), ('"':::STRING, 'B':::STRING), (e'\x17\x1faF\x01':::STRING, e'\x00':::STRING)), PARTITION tabl🙁e1_part7 VALUES IN (('%':::STRING, 'H':::STRING), (e'\x1c\x1cfb\x1c\x14':::STRING, '':::STRING), (e'u\x18':::STRING, e'aA*j\x1d=':::STRING), ('':::STRING, e'D\f\x03h\x030@':::STRING))) WHERE (((tabl🙁e1.col1_8 = '3000-01-01 00:00:00+00':::TIMESTAMPTZ) AND (tabl🙁e1."col1_%v5" < 'X':::STRING)) AND (tabl🙁e1.col1_10 != e'\U00002603':::STRING)) OR (tabl🙁e1.col1_9 < e'\x00':::STRING), FAMILY ("c̘ ol1_7"), FAMILY (col1_12), FAMILY (😴col1_0), FAMILY ("col1�_4"), FAMILY (col1_3, col1_1), FAMILY ("col1_%v5"), FAMILY (col1_8, col1_9, col1_11, "coLͤ1_6", col1_2));
        test_1        |             ALTER TABLE tabl🙁e1 INJECT STATISTICS e'[{"avg_size": 17, "columns": ["\\"col 1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3786, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000}, {"avg_size": 25, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3012, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000}, {"avg_size": 30, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2747, "histo_buckets": [{"distinct_range": 0, "num_eq": 6270185093719793568, "num_range": 0, "upper_bound": "1977-07-23 09:42:53.000026+00"}, {"distinct_range": 0, "num_eq": 6299312467859572630, "num_range": 0, "upper_bound": "1978-05-21 14:04:49.000351+00"}, {"distinct_range": 506725188.85356694, "num_eq": 1559182850622935549, "num_range": 800000000, "upper_bound": "2004-02-12 17:06:10.000691+00"}], "histo_col_type": "TIMESTAMPTZ", "name": "__auto__", "null_count": 0, "row_count": 9000}, {"avg_size": 9, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1351, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000}, {"avg_size": 31, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2636, "histo_buckets": [{"distinct_range": 0, "num_eq": 10, "num_range": 0, "upper_bound": "\\u000cw"}, {"distinct_range": 1182535953514922500, "num_eq": 40000000, "num_range": 2383673557394436823, "upper_bound": "\\u001bh\\u0010K\\u0013"}, {"distinct_range": 2292265509475168500, "num_eq": 5317259451414391022, "num_range": 5514876686852166850, "upper_bound": "\\u001d"}, {"distinct_range": 0, "num_eq": 70000, "num_range": 7810050829516375675, "upper_bound": "#;"}, {"distinct_range": 136250573125801070, "num_eq": 7433881305910728513, "num_range": 154482001714164749, "upper_bound": "\'\\u0003#\\"3$N\\u0001"}, {"distinct_range": 0, "num_eq": 10, "num_range": 100000, "upper_bound": "6Sx\\u000f"}, {"distinct_range": 2.0051841375629724, "num_eq": 0, "num_range": 10, "upper_bound": "8Pi,TV1"}, {"distinct_range": 10000000000, "num_eq": 100, "num_range": 10000000000, "upper_bound": "a\\\\\\u0018#y"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 9000}, {"avg_size": 4, "columns": ["\\"col1\\u000b_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5678, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000}, {"avg_size": 25, "columns": ["\\"coL\u03641_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4274, "histo_col_type": "", "name": "__auto__", "null_count": 1190, "row_count": 9000}, {"avg_size": 30, "columns": ["\\"c\u0318 ol1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1055, "histo_col_type": "", "name": "__auto__", "null_count": 3434, "row_count": 9000}, {"avg_size": 20, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6838, "histo_col_type": "", "name": "__auto__", "null_count": 8453, "row_count": 9000}, {"avg_size": 17, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4639, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000}, {"avg_size": 0, "columns": ["\U0001F634col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5122, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000}, {"avg_size": 9, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5664, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000}, {"avg_size": 15, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2244, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000}, {"avg_size": 28, "columns": ["\\"col1_%v5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1426, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 9000}]':::JSONB;
        test_1        |             ALTER TABLE tabl🙁e1 INJECT STATISTICS e'[{"avg_size": 0, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 766156183, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000000}, {"avg_size": 21, "columns": ["\\"col1\\u000b_4\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 62114676, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000000}, {"avg_size": 0, "columns": ["\\"col1_%v5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 780821340, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000000}, {"avg_size": 23, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 108778640, "histo_buckets": [{"distinct_range": 0, "num_eq": 7000000000, "num_range": 0, "upper_bound": "1975-07-29 11:46:41.000319+00"}, {"distinct_range": 8464729484830643000, "num_eq": 10, "num_range": 8464729484830643668, "upper_bound": "1979-05-11 04:18:54.000024+00"}, {"distinct_range": 0, "num_eq": 217200803250136889, "num_range": 9000, "upper_bound": "1988-01-03 19:01:28.000263+00"}, {"distinct_range": 68126248254771680, "num_eq": 6216163659261208871, "num_range": 395445985085566843, "upper_bound": "1990-11-26 06:59:50.000474+00"}, {"distinct_range": 1093511219383772200, "num_eq": 3000000000, "num_range": 1093511219383772162, "upper_bound": "1998-07-16 13:58:13.000553+00"}, {"distinct_range": 0, "num_eq": 5000000, "num_range": 2184603771146448860, "upper_bound": "2001-03-31 05:44:51.000506+00"}, {"distinct_range": 0, "num_eq": 2000, "num_range": 3589749130096925491, "upper_bound": "2002-11-22 16:39:10.000763+00"}, {"distinct_range": 1210374624177513700, "num_eq": 2648203566289745444, "num_range": 2729622639942762992, "upper_bound": "2018-08-26 09:58:02.000715+00"}, {"distinct_range": 0, "num_eq": 6000000, "num_range": 8000000000, "upper_bound": "2020-04-14 08:16:14.000311+00"}], "histo_col_type": "TIMESTAMPTZ", "name": "__auto__", "null_count": 0, "row_count": 800000000}, {"avg_size": 10, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 246984440, "histo_col_type": "", "name": "__auto__", "null_count": 287362989, "row_count": 800000000}, {"avg_size": 29, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 424117787, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000000}, {"avg_size": 6, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 357921118, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000000}, {"avg_size": 15, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 682116400, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000000}, {"avg_size": 28, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 691985072, "histo_buckets": [{"distinct_range": 0, "num_eq": 100000000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 2347906247914983000, "num_eq": 7137756070186449002, "num_range": 2347906247914982900, "upper_bound": "\\u001a"}, {"distinct_range": 0, "num_eq": 40000, "num_range": 6357950067916111069, "upper_bound": "\\u001dA6PK\\u0004_"}, {"distinct_range": 0, "num_eq": 7255219025060220576, "num_range": 8693056535990000743, "upper_bound": "!\\\\H9gT"}, {"distinct_range": 4581254733016492000, "num_eq": 7544376298517827323, "num_range": 5314633457950340939, "upper_bound": "\\""}, {"distinct_range": 3027622115529771000, "num_eq": 10000, "num_range": 3027622115529771174, "upper_bound": "X"}, {"distinct_range": 0, "num_eq": 100000, "num_range": 400000, "upper_bound": "hX5\\u0010/r\\n"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 800000000}, {"avg_size": 19, "columns": ["\U0001F634col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 791457115, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000000}, {"avg_size": 13, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 501910649, "histo_buckets": [{"distinct_range": 0, "num_eq": 4000000000, "num_range": 0, "upper_bound": "-61 years -828 days -04:07:07.047433"}, {"distinct_range": 0, "num_eq": 50000, "num_range": 367935312016848514, "upper_bound": "8 years 4 mons 93 days 01:13:36.652806"}], "histo_col_type": "INTERVAL", "name": "__auto__", "null_count": 0, "row_count": 800000000}, {"avg_size": 25, "columns": ["\\"coL\u03641_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 437449153, "histo_col_type": "", "name": "__auto__", "null_count": 455352087, "row_count": 800000000}, {"avg_size": 0, "columns": ["\\"c\u0318 ol1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 547109582, "histo_col_type": "", "name": "__auto__", "null_count": 238228001, "row_count": 800000000}, {"avg_size": 27, "columns": ["\\"col 1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 517700957, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 800000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (22.71s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 82fddc52747a86c696a1f77a85abc25d05858cc1:

        test_1        |                 col7236 DESC;
        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         tab😘3686."\\u055Cco\\x93l7235" AS col7236
        test_1        |                     FROM
        test_1        |                         (
        test_1        |                             VALUES
        test_1        |                                 (NULL::OID),
        test_1        |                                 (regprocedure(0::OID::OID::OID)::REGPROCEDURE),
        test_1        |                                 (2::OID::OID),
        test_1        |                                 (NULL::OID),
        test_1        |                                 (4::OID::OID),
        test_1        |                                 (1::OID::OID)
        test_1        |                         )
        test_1        |                             AS tab😘3686 ("\\u055Cco\\x93l7235")
        test_1        |                     ORDER BY
        test_1        |                         tab😘3686."\\u055Cco\\x93l7235",
        test_1        |                         tab😘3686."\\u055Cco\\x93l7235",
        test_1        |                         tab😘3686."\\u055Cco\\x93l7235" DESC NULLS LAST
        test_1        |                 )
        test_1        |                     AS "taB͓3687"
        test_1        |             ORDER BY
        test_1        |                 col7236 DESC;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.59s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "ta\\U000F1F99bl😱e1" (col1_0 NAME[] NOT NULL, "c!ol1_ 1" DECIMAL NULL, INDEX (col1_0 ASC) STORING ("c!ol1_ 1"), INDEX (col1_0 ASC, "c!ol1_ 1" ASC), INDEX ("c!ol1_ 1" ASC, col1_0) WHERE "ta\\U000F1F99bl😱e1"."c!ol1_ 1" != '-Infinity':::DECIMAL NOT VISIBLE, FAMILY ("c!ol1_ 1", col1_0));
        test_1        |             ALTER TABLE "ta\\U000F1F99bl😱e1" INJECT STATISTICS e'[{"avg_size": 5, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 469146713476674731, "histo_buckets": [{"distinct_range": 0, "num_eq": 40, "num_range": 0, "upper_bound": "ARRAY[e\'\\";\\\\x10\\\\x7f5\\\\f-h\\\\x0f\':::STRING:::NAME]"}, {"distinct_range": 5153.461432684579, "num_eq": 300000000, "num_range": 10000, "upper_bound": "ARRAY[\'3%KH:y{2u\':::STRING:::NAME,e\'H\\\\x14\\\\x14\':::STRING:::NAME]"}, {"distinct_range": 0, "num_eq": 7000000000, "num_range": 1000, "upper_bound": "ARRAY[\'G\':::STRING:::NAME]"}, {"distinct_range": 766497776211379800, "num_eq": 4320076760877302906, "num_range": 801323425290316650, "upper_bound": "ARRAY[\'c``Dqt\':::STRING:::NAME,\'X\':::STRING:::NAME,e\'pZ\\\\\'L$j?\':::STRING:::NAME,\'\':::STRING:::NAME,\'LY\':::STRING:::NAME]"}, {"distinct_range": 4090569.035242857, "num_eq": 20000000000, "num_range": 9000000, "upper_bound": "ARRAY[e\'f\\\\x0ej\':::STRING:::NAME,e\'\\\\\'\':::STRING:::NAME,\'?u\':::STRING:::NAME]"}, {"distinct_range": 0, "num_eq": 2404545309802212557, "num_range": 1588043442808590279, "upper_bound": "ARRAY[e\'{\\\\\\\\m\':::STRING:::NAME,e\'\\\\x1dR\\\\x1d6(.P\\\\r\':::STRING:::NAME]"}], "histo_col_type": "NAME[]", "name": "__auto__", "null_count": 0, "row_count": 5206480918187602921}, {"avg_size": 5, "columns": ["\\"c!ol1_ 1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1502351087489039435, "histo_col_type": "", "name": "__auto__", "null_count": 280235412217284800, "row_count": 5206480918187602921}]':::JSONB;
        test_1        |             ALTER TABLE "ta\\U000F1F99bl😱e1" INJECT STATISTICS e'[{"avg_size": 18, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1572550930675631463, "histo_buckets": [{"distinct_range": 0, "num_eq": 50, "num_range": 0, "upper_bound": "ARRAY[e\'C\\\\x10\':::STRING:::NAME,e\'u7}_\\\\x7f\\\\x10r\':::STRING:::NAME,e\'XQ\\\\x06p\\\\x0f\':::STRING:::NAME]"}], "histo_col_type": "NAME[]", "name": "__auto__", "null_count": 0, "row_count": 1588591214521416365}, {"avg_size": 20, "columns": ["\\"c!ol1_ 1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 681481894448307094, "histo_col_type": "", "name": "__auto__", "null_count": 211693093897778761, "row_count": 1588591214521416365}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (34.73s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ fb4670bf26561963694a5b431549c7ae87bb12cd:

        test_1        |             
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         NULL::DECIMAL AS _col20429,
        test_1        |                         COALESCE(
        test_1        |                             regprocedure(CASE WHEN NULL::BOOL THEN 5::INT8::INT4 ELSE 3::INT8::INT4 END::INT4)::REGPROCEDURE,
        test_1        |                             regprocedure(2::OID::OID::OID)::REGPROCEDURE
        test_1        |                         )
        test_1        |                             AS ")col20430"
        test_1        |                 )
        test_1        |                     AS tab11148
        test_1        |             ORDER BY
        test_1        |                 _col20429, ")col20430" NULLS FIRST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.51s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "/table1" (col1_0 BOOL[], col1_1 INT4 NOT NULL, "col1_
2" REGCLASS, "c ol1_�3" BIT(14)[] NULL, col1🙀_4 REGCLASS NULL, col1_5 TIME NOT NULL, "col 1_6" INT8[] NULL, col1_7 INT8 NOT NULL AS (col1_1 + 525036791:::INT8) STORED, col1_8 STRING NOT NULL AS (CASE WHEN "col1_
2" IS NULL THEN e'\b@6\x10v\x12A':::STRING ELSE e'\x0bzS1':::STRING END) VIRTUAL, "col
        test_1        |             1_9" INT8 NOT NULL AS (col1_1 + (-251043840):::INT8) VIRTUAL, col1_10 STRING NULL AS (CASE WHEN col1🙀_4 IS NULL THEN '1[O':::STRING ELSE e')8V\r]]l\x05':::STRING END) VIRTUAL, INDEX (col1_5 ASC, col1🙀_4 DESC) STORING (col1_7) WHERE ((((("/table1".col1_8 > 'X':::STRING) OR ("/table1"."col
        test_1        |             1_9" >= (-1):::INT8)) AND ("/table1".col1_10 = 'X':::STRING)) AND ("/table1".col1_7 >= 0:::INT8)) AND ("/table1".col1_1 <= (-32768):::INT8)) AND ("/table1".col1_5 < '24:00:00':::TIME), INDEX ("c ol1_�3" ASC, col1_8, col1_1 ASC, col1_5 ASC, col1_0 ASC, "col1_
2") STORING (col1_7) WHERE (((("/table1".col1_8 >= e'\'':::STRING) OR ("/table1".col1_10 <= e'\'':::STRING)) AND ("/table1".col1_5 < '24:00:00':::TIME)) AND ("/table1".col1_1 >= 1:::INT8)) OR ("/table1"."col
        test_1        |             1_9" != 1:::INT8), INDEX ("col1_
2", col1_10, col1_8) STORING ("c ol1_�3", col1_5, "col 1_6", col1_7) PARTITION BY LIST ("col1_
2", col1_10) (PARTITION "/table1_part0" VALUES IN ((3366325753:::OID, e'E\x0ff\x11\x0f\x0e\x1e':::STRING), (0:::OID, e'c\x0e\fx]\x03':::STRING), (2475651030:::OID, e'oj4lLi\x07qQ':::STRING), (0:::OID, e'0[=3?O\x15':::STRING), (2938076996:::OID, '"':::STRING), (1751217714:::OID, '3=':::STRING), (4142177229:::OID, e'g\x146':::STRING), (3591644778:::OID, e'\x0e\x0eOK\'\x05':::STRING), (2990084029:::OID, e'"\x04\r\x19\x10':::STRING), (2013452027:::OID, e'Y\\\x05\\=\x14V^':::STRING)), PARTITION "/table1_part1" VALUES IN ((2569267304:::OID, e'f\x13\x05mF':::STRING), (1895480843:::OID, e'z#@S\x05':::STRING), (95070186:::OID, '2k':::STRING), (1765098578:::OID, e'|d"\x1da':::STRING), (0:::OID, e'Q/~\x1c\x7f\x13\x04':::STRING), (2905002365:::OID, '&G':::STRING), (2294431287:::OID, e'd\x169)P_8\x7f(':::STRING), (1915675749:::OID, e'z/1nX(\x13{q':::STRING), (0:::OID, '':::STRING), (3977101076:::OID, e'\x11X\x1ff\x12EO0':::STRING)), PARTITION "/table1_😔part2" VALUES IN ((3130365263:::OID, e'~enry``\x0e\x0et':::STRING), (3485612967:::OID, e'\t c@|BE':::STRING), (343714569:::OID, e'\x01\x1cfhq"&':::STRING), (3931278694:::OID, e'\x10':::STRING), (3021308753:::OID, e'Wo>-\'C*':::STRING), (3177386896:::OID, e'\n=+\x07"Al':::STRING), (3444607500:::OID, e'RvHbVGg"\n':::STRING), (2986192597:::OID, e'\x1e5':::STRING), (1002875051:::OID, e'Ya+*``O\x1a$':::STRING)), PARTITION "/table1_part3" VALUES IN ((3213971002:::OID, e'~j\x12t':::STRING), (641143754:::OID, 'qi':::STRING), (3929346541:::OID, e'\x10\x13q>@\x13':::STRING), (3929016855:::OID, '':::STRING), (1006706185:::OID, e'F~FAf\x13i\x13':::STRING), (2448850316:::OID, 'x+FOp_':::STRING), (3546156994:::OID, e'[jC\f\x05>2"':::STRING), (3490244656:::OID, e'r\x12\x15\x01':::STRING), (1218584969:::OID, e'KoV\x16"dK':::STRING), (655949876:::OID, 'O':::STRING)), PARTITION "/table1_part🙄4" VALUES IN ((0:::OID, e'$!\x1bng':::STRING), (741376529:::OID, e'*\x1a(&)':::STRING), (1815857276:::OID, e'\r':::STRING), (2290361144:::OID, e'="\x14\f':::STRING), (4056967589:::OID, e'=\x13Pp':::STRING), (1562579209:::OID, e'\x00':::STRING), (0:::OID, e'\x1e>\x1d&@':::STRING), (1322669968:::OID, e'\'':::STRING), (2519281151:::OID, '"':::STRING), (0:::OID, 'lI':::STRING)), PARTITION "DEFAULT" VALUES IN ((DEFAULT, DEFAULT))) WHERE ((((("/table1".col1_7 < 127:::INT8) AND ("/table1"."col
        test_1        |             1_9" >= 0:::INT8)) AND ("/table1".col1_8 = 'X':::STRING)) AND ("/table1".col1_1 != 32767:::INT8)) OR ("/table1".col1_10 != '':::STRING)) AND ("/table1".col1_5 != '00:00:00':::TIME) NOT VISIBLE, INDEX ("col
        test_1        |             1_9" ASC, col1_0 ASC, (CASE WHEN "col 1_6" IS NULL THEN '_?*$u':::STRING ELSE e'Q\x17\x1a\rY``\x04':::STRING END) ASC, "col1_
2" ASC, "c ol1_�3", col1_7 ASC, col1🙀_4 ASC, "col 1_6" DESC, col1_8 DESC, col1_5 DESC, col1_10 DESC) STORING (col1_1) WHERE ((((("/table1".col1_5 <= '24:00:00':::TIME) OR ("/table1"."col
        test_1        |             1_9" = 2147483647:::INT8)) AND ("/table1".col1_10 < e'\U00002603':::STRING)) OR ("/table1".col1_8 != e'\x00':::STRING)) AND ("/table1".col1_7 <= 0:::INT8)) OR ("/table1".col1_1 != 127:::INT8), INDEX (col1_1 ASC, col1_0 ASC, col1_7 DESC, "col1_
2", col1_10, "c ol1_�3" DESC, "col 1_6", "col
        test_1        |             1_9", col1🙀_4 ASC) WHERE "/table1".col1_10 = '':::STRING, INDEX (col1🙀_4 ASC, col1_5 DESC, lower(CAST(col1_5 AS STRING))) STORING ("col1_
2", "c ol1_�3") WHERE ((((("/table1"."col
        test_1        |             1_9" != (-1):::INT8) OR ("/table1".col1_7 = 1:::INT8)) OR ("/table1".col1_1 > 0:::INT8)) AND ("/table1".col1_5 != '24:00:00':::TIME)) OR ("/table1".col1_8 <= e'\'':::STRING)) AND ("/table1".col1_10 != '"':::STRING), UNIQUE (col1_5 ASC, "c ol1_�3" DESC, col1_10 DESC, "col 1_6", col1_0 DESC, col1_8 DESC, col1_7 DESC, col1_1 ASC) STORING (col1🙀_4) WHERE (((("/table1"."col
        test_1        |             1_9" = 0:::INT8) AND ("/table1".col1_7 = 1:::INT8)) AND ("/table1".col1_10 < e'\'':::STRING)) OR ("/table1".col1_5 >= '00:00:00':::TIME)) AND ("/table1".col1_1 < (-128):::INT8), UNIQUE ((CASE WHEN col1_0 IS NULL THEN e'*W\x15+T\x14':::STRING ELSE e'#\x1c!$':::STRING END) DESC, col1_5, col1_0 DESC) STORING (col1_1, "col1_
2", col1🙀_4, "col 1_6") WHERE (("/table1"."col
        test_1        |             1_9" > 9223372036854775807:::INT8) OR ("/table1".col1_1 <= 0:::INT8)) OR ("/table1".col1_7 <= (-1):::INT8), UNIQUE (col1_5 ASC, "col
        test_1        |             1_9" ASC, "col1_
2", (col1_1 + (-1943938094):::INT8), col1_10, col1_0 DESC, (CASE WHEN col1🙀_4 IS NULL THEN '':::STRING ELSE 'u':::STRING END), "col 1_6" DESC, col1_1) STORING ("c ol1_�3", col1🙀_4), FAMILY (col1_0, col1🙀_4), FAMILY ("col1_
2", col1_5), FAMILY ("c ol1_�3", col1_7, "col 1_6", col1_1));
        test_1        |             ALTER TABLE "/table1" INJECT STATISTICS e'[{"avg_size": 5, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 608804632112957617, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1753668942639251736}, {"avg_size": 9, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 899273031682049940, "histo_col_type": "", "name": "__auto__", "null_count": 1573987345489900463, "row_count": 1753668942639251736}, {"avg_size": 4, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 752393729916264514, "histo_col_type": "", "name": "__auto__", "null_count": 1255715525612331856, "row_count": 1753668942639251736}, {"avg_size": 8, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 965895714596140192, "histo_buckets": [{"distinct_range": 0, "num_eq": 6171626843222846312, "num_range": 0, "upper_bound": "-2131327312"}, {"distinct_range": 0, "num_eq": 8886450936669143045, "num_range": 10000000, "upper_bound": "-2037983051"}, {"distinct_range": 3882.0384405373716, "num_eq": 60000, "num_range": 4000, "upper_bound": "-2013328447"}, {"distinct_range": 1757344057769809000, "num_eq": 206032208385143944, "num_range": 4804856952146455903, "upper_bound": "-1850162859"}, {"distinct_range": 0, "num_eq": 900, "num_range": 5755355572414953218, "upper_bound": "-1570670043"}, {"distinct_range": 7360953574698022000, "num_eq": 600000, "num_range": 7360953574698021650, "upper_bound": "-32768"}, {"distinct_range": 100000000, "num_eq": 90000, "num_range": 100000000, "upper_bound": "0"}, {"distinct_range": 10000000000, "num_eq": 4000, "num_range": 10000000000, "upper_bound": "818418862"}, {"distinct_range": 199720001233551360, "num_eq": 0, "num_range": 5085471442707942643, "upper_bound": "982176187"}], "histo_col_type": "INT4", "name": "__auto__", "null_count": 0, "row_count": 1753668942639251736}, {"avg_size": 15, "columns": ["\\"col1_\\r2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 408285425011858000, "histo_col_type": "", "name": "__auto__", "null_count": 213595102131542058, "row_count": 1753668942639251736}, {"avg_size": 7, "columns": ["\\"c ol1_\\u000c3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 295983865414631894, "histo_buckets": [{"distinct_range": 0, "num_eq": 10000000, "num_range": 0, "upper_bound": "ARRAY[B\'00000000000000\',B\'10001001011010\',B\'00111110010011\']"}, {"distinct_range": 0, "num_eq": 9000000, "num_range": 1955589038457878061, "upper_bound": "ARRAY[B\'00000000000000\',B\'10011001001011\',B\'10110101010111\',B\'01011101100001\',B\'10001101010001\',B\'10111101000010\']"}, {"distinct_range": 17738266.497670326, "num_eq": 4436647636556726243, "num_range": 40000000, "upper_bound": "ARRAY[B\'01010001111011\',B\'00101111100110\',B\'01100110011110\',B\'01110110001001\',B\'00100101110001\']"}, {"distinct_range": 4655317451996635000, "num_eq": 8288608911859692573, "num_range": 4655317451996635196, "upper_bound": "ARRAY[B\'01011111000010\',B\'01100011101111\',B\'01111111111111\',B\'01111011000101\']"}, {"distinct_range": 0, "num_eq": 7000, "num_range": 50000000, "upper_bound": "ARRAY[B\'01101101000000\',B\'11001000000010\']"}, {"distinct_range": 4000000, "num_eq": 8000, "num_range": 4000000, "upper_bound": "ARRAY[B\'10100001000001\']"}, {"distinct_range": 800000000, "num_eq": 6593361182746239099, "num_range": 800000000, "upper_bound": "ARRAY[B\'11010100001111\',B\'00000100011100\']"}, {"distinct_range": 0, "num_eq": 900000, "num_range": 8790028799951099577, "upper_bound": "ARRAY[B\'11101111101001\',B\'01101010010011\']"}, {"distinct_range": 8699628296644158000, "num_eq": 1268032588621102355, "num_range": 8699628296644158350, "upper_bound": "ARRAY[B\'11110100011000\',B\'00111011010100\',B\'11100111100000\',B\'10100111010000\']"}], "histo_col_type": "BIT(14)[]", "name": "__auto__", "null_count": 570031772864751539, "row_count": 1753668942639251736}, {"avg_size": 7, "columns": ["col1\U0001F640_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1501140930062990561, "histo_col_type": "", "name": "__auto__", "null_count": 100825986505251755, "row_count": 1753668942639251736}, {"avg_size": 12, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 952596005700649040, "histo_buckets": [{"distinct_range": 0, "num_eq": 3720910497515443306, "num_range": 0, "upper_bound": "04:39:39.636106"}], "histo_col_type": "TIME", "name": "__auto__", "null_count": 0, "row_count": 1753668942639251736}, {"avg_size": 23, "columns": ["\\"col 1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 899531351132260149, "histo_col_type": "", "name": "__auto__", "null_count": 842212575797748394, "row_count": 1753668942639251736}, {"avg_size": 10, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1476627780807745859, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 1753668942639251736}, {"avg_size": 7, "columns": ["\\"col\\n1_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1700606501331666992, "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 1753668942639251736}]':::JSONB;
        test_1        |             ALTER TABLE "/table1" INJECT STATISTICS e'[{"avg_size": 1, "columns": ["col1\U0001F640_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1497990482440606527, "histo_col_type": "", "name": "__auto__", "null_count": 646602664200799158, "row_count": 6445269308097325746}, {"avg_size": 10, "columns": ["\\"col 1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2982516533857573398, "histo_col_type": "", "name": "__auto__", "null_count": 6249281609448170303, "row_count": 6445269308097325746}, {"avg_size": 6, "columns": ["\\"col\\n1_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2912732741438991487, "histo_buckets": [{"distinct_range": 0, "num_eq": 10000, "num_range": 0, "upper_bound": "-5774882656398531395"}, {"distinct_range": 0, "num_eq": 7596381083740154191, "num_range": 4293846663361066500, "upper_bound": "-2706770776699075820"}, {"distinct_range": 3000, "num_eq": 5000000000, "num_range": 3000, "upper_bound": "748824569864938420"}, {"distinct_range": 3714206978754976000, "num_eq": 892008213562279708, "num_range": 5591443578790716716, "upper_bound": "6721668733749602938"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 6445269308097325746}, {"avg_size": 16, "columns": ["\\"c ol1_\\u000c3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3175242811664548467, "histo_buckets": [{"distinct_range": 0, "num_eq": 624685550351361691, "num_range": 0, "upper_bound": "ARRAY[]"}, {"distinct_range": 912316444402058200, "num_eq": 50, "num_range": 912316444402058200, "upper_bound": "ARRAY[B\'00001000011011\',B\'01011101001111\',B\'00010011001011\']"}, {"distinct_range": 1292226162895395300, "num_eq": 9000, "num_range": 9200289769120043704, "upper_bound": "ARRAY[B\'00100001110101\',B\'00111110010010\',B\'00100010000001\',B\'10010100010110\']"}, {"distinct_range": 7273940006701073000, "num_eq": 0, "num_range": 7273940006701073829, "upper_bound": "ARRAY[B\'01101100000001\',B\'00110001101110\']"}, {"distinct_range": 0, "num_eq": 200000000, "num_range": 9000000, "upper_bound": "ARRAY[B\'01101110010000\',B\'00010010001100\',B\'11011110101011\',B\'10111011010010\']"}, {"distinct_range": 2766368794713171500, "num_eq": 500000000, "num_range": 4373219658066975140, "upper_bound": "ARRAY[B\'10000111000001\']"}, {"distinct_range": 0, "num_eq": 2390262158316154326, "num_range": 4000, "upper_bound": "ARRAY[B\'10010000011011\',B\'00011111100100\',B\'01001011000001\',B\'01100100110101\',B\'00000000000000\',B\'11001100000000\',B\'11100010101111\',B\'00101110100010\']"}, {"distinct_range": 0, "num_eq": 5887400256556117094, "num_range": 40000, "upper_bound": "ARRAY[B\'10110101001010\',B\'11001111010100\',B\'00110000011010\',B\'00000000000000\',B\'00101110111101\']"}, {"distinct_range": 7931558855219424000, "num_eq": 30, "num_range": 7931558855219423912, "upper_bound": "ARRAY[B\'11101100010001\']"}], "histo_col_type": "BIT(14)[]", "name": "__auto__", "null_count": 3289816341732723872, "row_count": 6445269308097325746}, {"avg_size": 3, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5509598230907499706, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6445269308097325746}, {"avg_size": 24, "columns": ["\\"col1_\\r2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4671594650600660405, "histo_col_type": "REGCLASS", "name": "__auto__", "null_count": 6421462127270475583, "row_count": 6445269308097325746}, {"avg_size": 9, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2272429105982392102, "histo_buckets": [{"distinct_range": 0, "num_eq": 8666482003285241114, "num_range": 0, "upper_bound": "01:56:46.455813"}, {"distinct_range": 841068122338917400, "num_eq": 800000000, "num_range": 1049295694144657820, "upper_bound": "06:40:22.034159"}], "histo_col_type": "TIME", "name": "__auto__", "null_count": 0, "row_count": 6445269308097325746}, {"avg_size": 31, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5509919358501151244, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6445269308097325746}, {"avg_size": 2, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1902914725811470029, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6445269308097325746}, {"avg_size": 30, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4727816852033637031, "histo_col_type": "", "name": "__auto__", "null_count": 3944899300429504123, "row_count": 6445269308097325746}, {"avg_size": 22, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5433573382691706154, "histo_col_type": "", "name": "__auto__", "null_count": 5544834455964244828, "row_count": 6445269308097325746}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (38.42s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ fbea48d5cd399ab1889ae8ce76b11f521d914686:

        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-05-04 05:15:15.531 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-05-04 05:15:15.531 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-05-04 05:15:15.531 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-05-04 05:15:15.534 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-05-04 05:15:15.539 UTC [68] LOG:  database system was shut down at 2023-05-04 05:15:15 UTC
        postgres_1    | 2023-05-04 05:15:15.543 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-05-04 05:15:17.171 UTC [78] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2023-05-04 05:15:17.171 UTC [78] STATEMENT:  CREATE TABLE t̸able1 (col1_0 FLOAT4 NOT NULL, "c'ol1'_1" GEOMETRY NOT NULL, "c
ol1_2" BOX2D NOT NULL, col1_3 TEXT NOT NULL, "col 1_4" INTERVAL, col1__5 REGTYPE, 😛c😆ol1_6 JSONB NOT NULL, col1_7 INT8 NOT NULL, "col1\\U0010D428_8" VARCHAR NOT NULL, "co%7cl1_9" "char", "col%q1_10" TEXT, col1_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("c
ol1_2" AS TEXT))) STORED, "col1_/12" TEXT NOT NULL GENERATED ALWAYS AS (lower("col1\\U0010D428_8")) STORED, col1_13 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("c
ol1_2" AS TEXT))) STORED, "col\f1_14" TEXT GENERATED ALWAYS AS (CASE WHEN col1__5 IS NULL THEN e'p8B\x1f\f\x02'::TEXT ELSE e'\x00'::TEXT END) STORED, col1_15 FLOAT8 NOT NULL GENERATED ALWAYS AS (col1_0 + 0.34414494037628174::FLOAT8) STORED, col1_16 TEXT GENERATED ALWAYS AS (CASE WHEN col1__5 IS NULL THEN e'\x02"\x12}\x17\nf'::TEXT ELSE e'\x1bG3dsC\f'::TEXT END) STORED, co😱l1_17 TEXT GENERATED ALWAYS AS (lower("col%q1_10")) STORED);
        postgres_1    |     CREATE INDEX ON t̸able1 (lower("col1\\U0010D428_8")) INCLUDE (col1_0, "c'ol1'_1", "c
ol1_2", 😛c😆ol1_6, col1_7, "co%7cl1_9", col1_11, "col1_/12");
        postgres_1    |     CREATE UNIQUE INDEX ON t̸able1 ("col%q1_10") INCLUDE (col1_3, col1__5, "col1\\U0010D428_8", "co%7cl1_9", "col1_/12", col1_16);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (4.15s)
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     --- FAIL: TestCompare/mutators (0.40s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "t_'able1" (col1_0 BYTES NOT NULL, col1_1 TIMETZ NOT NULL, col1_2 INET NOT NULL, "Col1_3" OID NULL, col1_4 GEOMETRY NOT NULL, "c̲ol1&😅_5" BIT(22) NOT NULL, col1_6 TSQUERY NOT NULL, col1_7 TIMESTAMPTZ, col1_8 STRING NOT NULL AS (lower(CAST(col1_4 AS STRING))) VIRTUAL, FAMILY (col1_2), FAMILY (col1_1), FAMILY (col1_6), FAMILY (col1_4, col1_7, "c̲ol1&😅_5"), FAMILY (col1_0), FAMILY ("Col1_3"));
        test_1        |             ALTER TABLE "t_'able1" INJECT STATISTICS e'[{"avg_size": 18, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 16027, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 20000}, {"avg_size": 30, "columns": ["\\"c\u0332ol1&\U0001F605_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 869, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 20000}, {"avg_size": 5, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5291, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 20000}, {"avg_size": 10, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 14532, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 20000}, {"avg_size": 10, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3919, "histo_col_type": "", "name": "__auto__", "null_count": 8643, "row_count": 20000}, {"avg_size": 15, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 19245, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 20000}, {"avg_size": 3, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 11679, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 20000}, {"avg_size": 10, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 17153, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 20000}, {"avg_size": 7, "columns": ["\\"Col1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3807, "histo_col_type": "", "name": "__auto__", "null_count": 6764, "row_count": 20000}]':::JSONB;
        test_1        |             ALTER TABLE "t_'able1" INJECT STATISTICS e'[{"avg_size": 31, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2418975670532946826, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3588776642181341677}, {"avg_size": 23, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2260985050608385243, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3588776642181341677}, {"avg_size": 26, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 842166140808628993, "histo_col_type": "", "name": "__auto__", "null_count": 2336107284693020591, "row_count": 3588776642181341677}, {"avg_size": 24, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 229372896352030680, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3588776642181341677}, {"avg_size": 7, "columns": ["col1_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1593690505909261878, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3588776642181341677}, {"avg_size": 26, "columns": ["\\"Col1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 769699531672216815, "histo_col_type": "", "name": "__auto__", "null_count": 146092488739707932, "row_count": 3588776642181341677}, {"avg_size": 19, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2798035442793356150, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3588776642181341677}, {"avg_size": 5, "columns": ["\\"c\u0332ol1&\U0001F605_5\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 923276347842720344, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3588776642181341677}, {"avg_size": 26, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3067094747568401375, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 3588776642181341677}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        |     --- FAIL: TestCompare/postgres (0.89s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE t̸able1 (col1_0 FLOAT4 NOT NULL, "c'ol1'_1" GEOMETRY NOT NULL, "c
ol1_2" BOX2D NOT NULL, col1_3 TEXT NOT NULL, "col 1_4" INTERVAL, col1__5 REGTYPE, 😛c😆ol1_6 JSONB NOT NULL, col1_7 INT8 NOT NULL, "col1\\U0010D428_8" VARCHAR NOT NULL, "co%7cl1_9" "char", "col%q1_10" TEXT, col1_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("c
ol1_2" AS TEXT))) STORED, "col1_/12" TEXT NOT NULL GENERATED ALWAYS AS (lower("col1\\U0010D428_8")) STORED, col1_13 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("c
ol1_2" AS TEXT))) STORED, "col\f1_14" TEXT GENERATED ALWAYS AS (CASE WHEN col1__5 IS NULL THEN e'p8B\x1f\f\x02'::TEXT ELSE e'\x00'::TEXT END) STORED, col1_15 FLOAT8 NOT NULL GENERATED ALWAYS AS (col1_0 + 0.34414494037628174::FLOAT8) STORED, col1_16 TEXT GENERATED ALWAYS AS (CASE WHEN col1__5 IS NULL THEN e'\x02"\x12}\x17\nf'::TEXT ELSE e'\x1bG3dsC\f'::TEXT END) STORED, co😱l1_17 TEXT GENERATED ALWAYS AS (lower("col%q1_10")) STORED);
        test_1        |             CREATE INDEX ON t̸able1 (lower("col1\\U0010D428_8")) INCLUDE (col1_0, "c'ol1'_1", "c
ol1_2", 😛c😆ol1_6, col1_7, "co%7cl1_9", col1_11, "col1_/12");
        test_1        |             CREATE UNIQUE INDEX ON t̸able1 ("col%q1_10") INCLUDE (col1_3, col1__5, "col1\\U0010D428_8", "co%7cl1_9", "col1_/12", col1_16);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (17.88s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 26713f81a397d13db4f2257eaa0f6bb70d1a7cb3:

        postgres_1    |     CREATE INDEX ON "tabLe%v2" ("col(2_0" ASC, "col2_{\\U000DBE0414" DESC, col2_12, "%pcol2_😑5" DESC, "�col2_10" ASC, col2_4 ASC, col2_9 DESC, col2_17 DESC, 😷col2_15, col2_6 ASC, col2_13 ASC, "'col2😹_7", col2_1, col2_2);
        postgres_1    |     CREATE UNIQUE INDEX ON "tabLe%v2" (col2_1 DESC) INCLUDE ("col(2_0", col2_3, col2_4, "%pcol2_😑5", "'col2😹_7", col2_8, col2_9, "c' ol2_11");
        postgres_1    |     CREATE UNIQUE INDEX ON "tabLe%v2" (col2_9 DESC, "�col2_10" DESC, "col(2_0" DESC, "%pcol2_😑5" DESC, col2_17 DESC, col2_6, "'col2😹_7");
        postgres_1    |     CREATE UNIQUE INDEX ON "tabLe%v2" (col2_13 ASC, 😷col2_15 ASC, col2_6, "'col2😹_7" DESC, "�col2_10", "col(2_0", col2_8 ASC) INCLUDE (col2_2, col2_4, "%pcol2_😑5", "c' ol2_11", "c ol2_16");
        postgres_1    |     CREATE INDEX ON "tabLe%v2" (col2_1, col2_4 DESC, 😷col2_15 DESC, col2_6 ASC, col2_8, "%pcol2_😑5" ASC, "col2_{\\U000DBE0414" ASC, (CASE WHEN col2_4 IS NULL THEN '1OUe'::TEXT ELSE e'm\x7f'::TEXT END) ASC, col2_2 DESC, col2_17 DESC);
        postgres_1    |     CREATE UNIQUE INDEX ON "tabLe%v2" (col2_9, "'col2😹_7" DESC, "col2_{\\U000DBE0414" DESC, lower(CAST("col(2_0" AS TEXT)) ASC, "c' ol2_11", col2_2 DESC, 😷col2_15, "�col2_10" ASC, "%pcol2_😑5" ASC, col2_13 DESC, col2_1 ASC, col2_12, "c ol2_16" DESC, (CASE WHEN "�col2_10" IS NULL THEN '}|u'::TEXT ELSE ''::TEXT END) ASC, col2_4, col2_8 ASC, col2_17 DESC) INCLUDE (col2_6);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (4.77s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (0.93s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "tabLe%v2" ("col(2_0" BIT NOT NULL, col2_1 REGTYPE NULL, col2_2 NAME NOT NULL, col2_3 GEOGRAPHY NOT NULL, col2_4 BYTEA NOT NULL, "%pcol2_😑5" INTERVAL NOT NULL, col2_6 BYTEA NOT NULL, "'col2😹_7" OID, col2_8 INTERVAL[] NOT NULL, col2_9 FLOAT8[] NOT NULL, "�col2_10" TIMESTAMPTZ[] NOT NULL, "c' ol2_11" TIMESTAMPTZ NOT NULL, col2_12 TEXT NULL, col2_13 TEXT NOT NULL GENERATED ALWAYS AS (lower(col2_2)) STORED, "col2_{\\U000DBE0414" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_6 IS NULL THEN '_3'::TEXT ELSE e'x\x1c'::TEXT END) STORED, 😷col2_15 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST("col(2_0" AS TEXT))) STORED, "c ol2_16" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "�col2_10" IS NULL THEN e'\x00'::TEXT ELSE e'L\x1f\n%k'::TEXT END) STORED, col2_17 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "%pcol2_😑5" IS NULL THEN e'\x0eh+9[2^\x02'::TEXT ELSE e'>r\x07t&\x13\x17'::TEXT END) STORED);
        test_1        |             CREATE INDEX ON "tabLe%v2" ("col(2_0" ASC, "col2_{\\U000DBE0414" DESC, col2_12, "%pcol2_😑5" DESC, "�col2_10" ASC, col2_4 ASC, col2_9 DESC, col2_17 DESC, 😷col2_15, col2_6 ASC, col2_13 ASC, "'col2😹_7", col2_1, col2_2);
        test_1        |             CREATE UNIQUE INDEX ON "tabLe%v2" (col2_1 DESC) INCLUDE ("col(2_0", col2_3, col2_4, "%pcol2_😑5", "'col2😹_7", col2_8, col2_9, "c' ol2_11");
        test_1        |             CREATE UNIQUE INDEX ON "tabLe%v2" (col2_9 DESC, "�col2_10" DESC, "col(2_0" DESC, "%pcol2_😑5" DESC, col2_17 DESC, col2_6, "'col2😹_7");
        test_1        |             CREATE UNIQUE INDEX ON "tabLe%v2" (col2_13 ASC, 😷col2_15 ASC, col2_6, "'col2😹_7" DESC, "�col2_10", "col(2_0", col2_8 ASC) INCLUDE (col2_2, col2_4, "%pcol2_😑5", "c' ol2_11", "c ol2_16");
        test_1        |             CREATE INDEX ON "tabLe%v2" (col2_1, col2_4 DESC, 😷col2_15 DESC, col2_6 ASC, col2_8, "%pcol2_😑5" ASC, "col2_{\\U000DBE0414" ASC, (CASE WHEN col2_4 IS NULL THEN '1OUe'::TEXT ELSE e'm\x7f'::TEXT END) ASC, col2_2 DESC, col2_17 DESC);
        test_1        |             CREATE UNIQUE INDEX ON "tabLe%v2" (col2_9, "'col2😹_7" DESC, "col2_{\\U000DBE0414" DESC, lower(CAST("col(2_0" AS TEXT)) ASC, "c' ol2_11", col2_2 DESC, 😷col2_15, "�col2_10" ASC, "%pcol2_😑5" ASC, col2_13 DESC, col2_1 ASC, col2_12, "c ol2_16" DESC, (CASE WHEN "�col2_10" IS NULL THEN '}|u'::TEXT ELSE ''::TEXT END) ASC, col2_4, col2_8 ASC, col2_17 DESC) INCLUDE (col2_6);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        |     --- FAIL: TestCompare/mutators (0.72s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 ("co
        test_1        |             l""1_😤0" BOOL, col1_1 STRING COLLATE de, "\\u5A44col1 _2" BOOL NOT NULL, col1_3 STRING NULL, col1_4 NAME[] NOT NULL, col1_5 "char" NOT NULL, col1_6 TIME, col1_7 GEOGRAPHY, "c  ol1_8" REGCLASS, col1_9 STRING COLLATE en NOT NULL, col1_10 REGCLASS, "col1�_11" GEOMETRY NULL, col1_12 "char" NULL, "cOl1_13" NAME NOT NULL, col1_14 STRING NULL AS (lower(CAST("col1�_11" AS STRING))) STORED, col1_15 STRING AS (lower(CAST("co
        test_1        |             l""1_😤0" AS STRING))) STORED, "col1(_16" STRING NOT NULL AS (lower(CAST("\\u5A44col1 _2" AS STRING))) VIRTUAL, col1_17 STRING AS (CASE WHEN "c  ol1_8" IS NULL THEN e'\x7f&2WNW\nl':::STRING ELSE e'\b&DL#S_':::STRING END) VIRTUAL, PRIMARY KEY ("cOl1_13" ASC), INDEX (col1_17, col1_14 DESC, col1_5 ASC, "c  ol1_8" DESC, col1_1, "col1(_16" ASC, lower(CAST("co
        test_1        |             l""1_😤0" AS STRING)) ASC, col1_4, col1_12) STORING ("\\u5A44col1 _2", col1_3, col1_6, col1_9, col1_10, col1_15) WHERE ((((((((((table1.col1_12 < e'\x00':::STRING) OR (table1.col1_5 = e'\'':::STRING)) OR (NOT table1."co
        test_1        |             l""1_😤0")) AND (NOT table1."\\u5A44col1 _2")) OR (table1."col1(_16" < '':::STRING)) OR (table1."cOl1_13" <= '"':::STRING:::NAME)) AND (table1.col1_17 < e'\'':::STRING)) AND (table1.col1_3 >= e'\x00':::STRING)) OR (table1.col1_15 <= 'X':::STRING)) AND (table1.col1_6 < '24:00:00':::TIME)) AND (table1.col1_14 < '':::STRING), FAMILY (col1_1, "c  ol1_8"), FAMILY (col1_3, col1_6, col1_9, "\\u5A44col1 _2"), FAMILY (col1_4), FAMILY (col1_5), FAMILY (col1_14, "cOl1_13"), FAMILY ("co
        test_1        |             l""1_😤0", "col1�_11", col1_7, col1_10), FAMILY (col1_12, col1_15));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 13, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 67626, "histo_col_type": "", "name": "__auto__", "null_count": 12452, "row_count": 80000}, {"avg_size": 17, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 46390, "histo_col_type": "", "name": "__auto__", "null_count": 4770, "row_count": 80000}, {"avg_size": 24, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 63731, "histo_col_type": "", "name": "__auto__", "null_count": 40988, "row_count": 80000}, {"avg_size": 29, "columns": ["\\"cOl1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 16704, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000}, {"avg_size": 15, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 64059, "histo_col_type": "", "name": "__auto__", "null_count": 32113, "row_count": 80000}, {"avg_size": 26, "columns": ["col1_17"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 49718, "histo_col_type": "", "name": "__auto__", "null_count": 51291, "row_count": 80000}, {"avg_size": 19, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 16230, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000}, {"avg_size": 8, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 18623, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000}, {"avg_size": 0, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8761, "histo_col_type": "", "name": "__auto__", "null_count": 37910, "row_count": 80000}, {"avg_size": 10, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2067, "histo_col_type": "", "name": "__auto__", "null_count": 64820, "row_count": 80000}, {"avg_size": 20, "columns": ["\\"\\\\\\\\u5A44col1 _2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 28035, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000}, {"avg_size": 12, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 28275, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000}, {"avg_size": 12, "columns": ["\\"c\\tol1_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 72482, "histo_col_type": "", "name": "__auto__", "null_count": 74467, "row_count": 80000}, {"avg_size": 9, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 70225, "histo_col_type": "", "name": "__auto__", "null_count": 21082, "row_count": 80000}, {"avg_size": 16, "columns": ["\\"col1\\u000b_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 30778, "histo_col_type": "", "name": "__auto__", "null_count": 74848, "row_count": 80000}, {"avg_size": 21, "columns": ["\\"col1(_16\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 10200, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000}, {"avg_size": 23, "columns": ["\\"co\\nl\\"\\"1_\U0001F6240\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 66849, "histo_col_type": "", "name": "__auto__", "null_count": 47745, "row_count": 80000}, {"avg_size": 26, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 33862, "histo_col_type": "", "name": "__auto__", "null_count": 54567, "row_count": 80000}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 14, "columns": ["col1_17"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 21, "histo_col_type": "", "name": "__auto__", "null_count": 33, "row_count": 50}, {"avg_size": 2, "columns": ["\\"co\\nl\\"\\"1_\U0001F6240\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 45, "histo_col_type": "", "name": "__auto__", "null_count": 1, "row_count": 50}, {"avg_size": 3, "columns": ["\\"c\\tol1_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 26, "histo_col_type": "", "name": "__auto__", "null_count": 25, "row_count": 50}, {"avg_size": 16, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 42, "histo_col_type": "", "name": "__auto__", "null_count": 7, "row_count": 50}, {"avg_size": 18, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 30, "histo_col_type": "", "name": "__auto__", "null_count": 43, "row_count": 50}, {"avg_size": 17, "columns": ["\\"col1\\u000b_11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 45, "histo_col_type": "", "name": "__auto__", "null_count": 46, "row_count": 50}, {"avg_size": 4, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 18, "histo_col_type": "", "name": "__auto__", "null_count": 6, "row_count": 50}, {"avg_size": 6, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 30, "histo_col_type": "", "name": "__auto__", "null_count": 27, "row_count": 50}, {"avg_size": 23, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 27, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 50}, {"avg_size": 3, "columns": ["col1_10"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 22, "histo_col_type": "", "name": "__auto__", "null_count": 41, "row_count": 50}, {"avg_size": 22, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 36, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 50}, {"avg_size": 9, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 26, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 50}, {"avg_size": 11, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 14, "histo_col_type": "", "name": "__auto__", "null_count": 9, "row_count": 50}, {"avg_size": 6, "columns": ["\\"cOl1_13\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 40, "histo_buckets": [{"distinct_range": 0, "num_eq": 8870930444548233159, "num_range": 0, "upper_bound": "\\u0006\'\\u000ca"}, {"distinct_range": 6000, "num_eq": 2000, "num_range": 6000, "upper_bound": "\\u000e\\u001aI\\u000e(m_0W"}, {"distinct_range": 3000000000, "num_eq": 2000000000, "num_range": 3000000000, "upper_bound": "\\u001c!<uq\\u0008\'k"}, {"distinct_range": 0, "num_eq": 4653402330389056925, "num_range": 2392795454507590255, "upper_bound": "\\""}, {"distinct_range": 0, "num_eq": 2707842022173495763, "num_range": 5256382164393027950, "upper_bound": "C"}, {"distinct_range": 494579.4345529204, "num_eq": 70000000, "num_range": 1000000, "upper_bound": "K\\u0007jqiZ@\\rF"}, {"distinct_range": 0, "num_eq": 7000000, "num_range": 60000000, "upper_bound": "\x7f&}eU_~A"}], "histo_col_type": "NAME", "name": "__auto__", "null_count": 0, "row_count": 50}, {"avg_size": 21, "columns": ["\\"\\\\\\\\u5A44col1 _2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 23, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 50}, {"avg_size": 26, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3, "histo_col_type": "", "name": "__auto__", "null_count": 25, "row_count": 50}, {"avg_size": 1, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 13, "histo_col_type": "", "name": "__auto__", "null_count": 25, "row_count": 50}, {"avg_size": 17, "columns": ["\\"col1(_16\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 50}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (19.06s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ e8cad69249719e193cedcfd30d6a91350210d9d5:

        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (5.36s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:199: open /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/_tmp/018812dfcf0ce383ac3e799915a61396/TestComposeCompare2496379278/002/postgres.log: no such file or directory
        test_1        |         compare_test.go:201: compare cockroach1 to postgres: unexpected diff:
        test_1        |               []any(Inverse(func1, []any{
        test_1        |             -   string("array_agg"),
        test_1        |             +   string("5"),
        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(5::INT8::INT4::INT4)::REGPROCEDURE AS "\fcol5544") AS tab3015
        test_1        |             ORDER BY
        test_1        |                 "\fcol5544" DESC NULLS FIRST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (SELECT regprocedure(5:::INT8::INT4::INT4)::REGPROCEDURE AS "\fcol5544") AS tab3015
        test_1        |             ORDER BY
        test_1        |                 "\fcol5544" DESC NULLS FIRST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.82s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 DATE NOT NULL, col1_1 GEOMETRY NOT NULL, INDEX (col1_0 DESC) WHERE table1.col1_0 != 'infinity':::DATE, FAMILY (col1_0, col1_1));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS '[{"avg_size": 7, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 130, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "1978-06-14"}, {"distinct_range": 30949398.64018392, "num_eq": 50000000000, "num_range": 50000000, "upper_bound": "1978-08-08"}], "histo_col_type": "DATE", "name": "__auto__", "null_count": 0, "row_count": 500}, {"avg_size": 2, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 222, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 500}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS '[{"avg_size": 21, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3981379494341924501, "histo_buckets": [{"distinct_range": 0, "num_eq": 100000, "num_range": 0, "upper_bound": "1970-01-01"}, {"distinct_range": 2625005.7448637094, "num_eq": 282803632089848477, "num_range": 8000000, "upper_bound": "1978-03-15"}, {"distinct_range": 3999507917894848500, "num_eq": 5000000000, "num_range": 3999507917894848721, "upper_bound": "1986-04-30"}, {"distinct_range": 363897.9534813014, "num_eq": 30000000, "num_range": 400000, "upper_bound": "1992-05-08"}], "histo_col_type": "DATE", "name": "__auto__", "null_count": 0, "row_count": 4915556032765257622}, {"avg_size": 28, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4703932256834003725, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4915556032765257622}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (32.87s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 4226a83871bbce776bc9389fca5cf084b4bb7632:

        test_1        |               }))
        test_1        |             postgres:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         6::OID::OID AS col33344,
        test_1        |                         bpchar((NULL::INTERVAL::INTERVAL + '00:07:00'::TIME::TIME::TIME)::TIME::TIME)::CHAR AS col33345,
        test_1        |                         regproc(2::OID::OID::OID)::REGPROC AS col33346
        test_1        |                 )
        test_1        |                     AS tab͘18673
        test_1        |             ORDER BY
        test_1        |                 col33344 DESC NULLS LAST, col33345 ASC NULLS FIRST, col33346 ASC NULLS LAST;
        test_1        |             
        test_1        |             cockroach1:
        test_1        |             SELECT
        test_1        |                 *
        test_1        |             FROM
        test_1        |                 (
        test_1        |                     SELECT
        test_1        |                         6:::OID::OID AS col33344,
        test_1        |                         bpchar((NULL::INTERVAL::INTERVAL + '00:07:00':::TIME::TIME::TIME)::TIME::TIME)::CHAR AS col33345,
        test_1        |                         regproc(2:::OID::OID::OID)::REGPROC AS col33346
        test_1        |                 )
        test_1        |                     AS tab͘18673
        test_1        |             ORDER BY
        test_1        |                 col33344 DESC NULLS LAST, col33345 ASC NULLS FIRST, col33346 ASC NULLS LAST;
        test_1        |             
        test_1        |     --- FAIL: TestCompare/mutators (0.74s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (col1_0 BYTES NOT NULL, "Col1_1" TIMESTAMPTZ NOT NULL, "c'ol1_2" INT4 NOT NULL, cͤol1_3 INTERVAL NOT NULL, col1_4 DATE NOT NULL, col1_5 BYTES NOT NULL, "col1_""6" STRING COLLATE de NOT NULL, col1_7 STRING NOT NULL AS (CASE WHEN "Col1_1" IS NULL THEN e'\x1b\x07)':::STRING ELSE ' ':::STRING END) VIRTUAL, col1_8 STRING NOT NULL AS (CASE WHEN "Col1_1" IS NULL THEN e'\x00':::STRING ELSE e'S\x10\'u5\x1c\x19]c':::STRING END) VIRTUAL, "col1!_9" STRING NOT NULL AS (CASE WHEN col1_5 IS NULL THEN '':::STRING ELSE '_6&':::STRING END) STORED, "cOl😁1_10" STRING NOT NULL AS (CASE WHEN col1_0 IS NULL THEN e'PrN\x16gP':::STRING ELSE '=1I':::STRING END) STORED, col1_11 STRING NOT NULL AS (CASE WHEN col1_4 IS NULL THEN 'vX2%2Y':::STRING ELSE '':::STRING END) VIRTUAL, PRIMARY KEY (col1_0 ASC, "col1!_9" DESC, "col1_""6", col1_5 DESC, col1_4, col1_11 DESC, "c'ol1_2" ASC, "Col1_1", col1_8 ASC, "cOl😁1_10", cͤol1_3, col1_7 ASC), INDEX ("c'ol1_2", "col1!_9", "Col1_1" ASC, col1_0 ASC, col1_7 DESC) NOT VISIBLE, UNIQUE (lower(CAST("col1_""6" AS STRING)) ASC), UNIQUE ((CASE WHEN col1_0 IS NULL THEN e'o\nHp1':::STRING ELSE 't':::STRING END) DESC, cͤol1_3 DESC, "cOl😁1_10", col1_7, col1_5, "col1_""6" ASC, col1_4 ASC) WHERE (((((((((table1."col1!_9" = e'\U00002603':::STRING) OR (table1."cOl😁1_10" <= 'X':::STRING)) OR (table1.col1_11 != '':::STRING)) OR (table1.col1_5 = '\x58':::BYTES)) OR (table1.col1_0 < '\xe29883':::BYTES)) OR (table1."c'ol1_2" <= (-32768):::INT8)) AND (table1.col1_7 = '"':::STRING)) OR (table1.col1_8 = '':::STRING)) OR (table1.col1_4 >= 'infinity':::DATE)) OR (table1."Col1_1" != '2001-01-01 00:00:00+00 BC':::TIMESTAMPTZ), UNIQUE (col1_5 ASC) WHERE table1."cOl😁1_10" <= e'\'':::STRING, INDEX (col1_0 DESC, lower(CAST("col1_""6" AS STRING)) DESC, col1_11, col1_4, col1_7, "c'ol1_2" DESC) WHERE (((((((((table1."c'ol1_2" < (-1):::INT8) AND (table1."col1!_9" > e'\U00002603':::STRING)) AND (table1."Col1_1" >= '294276-12-31 23:59:59.999999+00':::TIMESTAMPTZ)) OR (table1.col1_0 = '\x27':::BYTES)) OR (table1.col1_8 != e'\'':::STRING)) AND (table1.col1_7 < '':::STRING)) AND (table1."cOl😁1_10" > e'\x00':::STRING)) OR (table1.col1_4 <= '-infinity':::DATE)) AND (table1.col1_5 < '\x22':::BYTES)) OR (table1.col1_11 <= e'\U00002603':::STRING), INDEX (col1_4, col1_11, cͤol1_3) WHERE (((table1."c'ol1_2" != 1:::INT8) AND (table1.col1_4 < '1970-01-01':::DATE)) AND (table1."cOl😁1_10" != e'\x00':::STRING)) AND (table1."col1!_9" >= e'\U00002603':::STRING) NOT VISIBLE, UNIQUE (col1_11 DESC, col1_7, "col1_""6" ASC) WHERE ((((((((table1.col1_5 <= e'\\x58':::BYTES) AND (table1.col1_4 < '-infinity':::DATE)) AND (table1.col1_7 < e'\'':::STRING)) OR (table1."cOl😁1_10" < '':::STRING)) AND (table1."c'ol1_2" = 0:::INT8)) OR (table1."col1!_9" != '"':::STRING)) AND (table1.col1_8 < '"':::STRING)) AND (table1.col1_0 <= e'\\xff':::BYTES)) AND (table1.col1_11 <= e'\'':::STRING), FAMILY ("c'ol1_2"), FAMILY ("Col1_1", col1_4, "col1!_9", cͤol1_3, col1_5), FAMILY (col1_0, "cOl😁1_10", "col1_""6"));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 10, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1308919647277626440, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7777443938310188934}, {"avg_size": 17, "columns": ["\\"col1_\\"\\"6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5469640490903155689, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7777443938310188934}, {"avg_size": 9, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6267268324059297944, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7777443938310188934}, {"avg_size": 15, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3211613444742329041, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7777443938310188934}, {"avg_size": 2, "columns": ["\\"cOl\U0001F6011_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5375807885756349295, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7777443938310188934}, {"avg_size": 18, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7697682455367765285, "histo_buckets": [{"distinct_range": 0, "num_eq": 90, "num_range": 0, "upper_bound": "\\\\x8899a513"}, {"distinct_range": 500, "num_eq": 2133194009944112158, "num_range": 500, "upper_bound": "\\\\x94cec3"}, {"distinct_range": 0, "num_eq": 6777931657623287668, "num_range": 5000, "upper_bound": "\\\\xe9c3b63415"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 7777443938310188934}, {"avg_size": 28, "columns": ["\\"c\'ol1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5334710083950573439, "histo_buckets": [{"distinct_range": 0, "num_eq": 7163170448914853120, "num_range": 0, "upper_bound": "-1814138340"}, {"distinct_range": 6238577365001239000, "num_eq": 10000000, "num_range": 6238577365001238355, "upper_bound": "-930331552"}, {"distinct_range": 50000, "num_eq": 60000000, "num_range": 50000, "upper_bound": "1150655143"}, {"distinct_range": 10000, "num_eq": 2104387871030690555, "num_range": 10000, "upper_bound": "1522659234"}], "histo_col_type": "INT4", "name": "__auto__", "null_count": 0, "row_count": 7777443938310188934}, {"avg_size": 18, "columns": ["c\u0364ol1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 335811626775778559, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7777443938310188934}, {"avg_size": 12, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2158353508099883189, "histo_buckets": [{"distinct_range": 0, "num_eq": 5000000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 52713.3267713844, "num_eq": 20, "num_range": 60000, "upper_bound": ".u"}, {"distinct_range": 1727243139679505000, "num_eq": 2525162449256262384, "num_range": 1727243139679504848, "upper_bound": "5"}, {"distinct_range": 1247424040595254300, "num_eq": 60, "num_range": 1247424040595254280, "upper_bound": "w\\u0006"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 7777443938310188934}, {"avg_size": 16, "columns": ["\\"Col1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7246444882253158149, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7777443938310188934}, {"avg_size": 20, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5279965736496055986, "histo_buckets": [{"distinct_range": 0, "num_eq": 7000000, "num_range": 0, "upper_bound": "1979-01-07"}, {"distinct_range": 7879487555783540000, "num_eq": 10000, "num_range": 8035245721707318290, "upper_bound": "1979-03-23"}, {"distinct_range": 20000, "num_eq": 1468350565592997788, "num_range": 20000, "upper_bound": "1989-06-25"}, {"distinct_range": 286405838417719940, "num_eq": 1000000000, "num_range": 2826257344504109356, "upper_bound": "1990-02-16"}, {"distinct_range": 507374.4082182865, "num_eq": 455724266213775168, "num_range": 800000, "upper_bound": "1991-03-03"}, {"distinct_range": 2688247170214660600, "num_eq": 5617906042387077784, "num_range": 6687187084461311555, "upper_bound": "1991-11-13"}, {"distinct_range": 560743.9907932587, "num_eq": 800000000, "num_range": 700000, "upper_bound": "1992-06-15"}, {"distinct_range": 5902959712272069000, "num_eq": 9000000000, "num_range": 5902959712272068660, "upper_bound": "1994-07-10"}, {"distinct_range": 0, "num_eq": 10000000000, "num_range": 0, "upper_bound": "1996-04-16"}], "histo_col_type": "DATE", "name": "__auto__", "null_count": 0, "row_count": 7777443938310188934}, {"avg_size": 15, "columns": ["\\"col1!_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 568813321597091975, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 7777443938310188934}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 9, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 35883757, "histo_buckets": [{"distinct_range": 0, "num_eq": 4052893621589076829, "num_range": 0, "upper_bound": "\\\\x32dc515e"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 16, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 21841527, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 0, "columns": ["\\"col1!_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6839469, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 3, "columns": ["\\"cOl\U0001F6011_10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 26055135, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 25, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 14693037, "histo_buckets": [{"distinct_range": 0, "num_eq": 7054579378944635242, "num_range": 0, "upper_bound": "\\\\x00"}, {"distinct_range": 3504090911454670300, "num_eq": 70, "num_range": 3504090911454670298, "upper_bound": "\\\\x042f08"}, {"distinct_range": 8000000, "num_eq": 0, "num_range": 8000000, "upper_bound": "\\\\x51c96f2f"}, {"distinct_range": 0, "num_eq": 70000000000, "num_range": 5430156926430678728, "upper_bound": "\\\\xee17aa25d8742365"}], "histo_col_type": "BYTES", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 14, "columns": ["\\"Col1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 25742760, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 3, "columns": ["\\"c\'ol1_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 22653849, "histo_buckets": [{"distinct_range": 0, "num_eq": 10, "num_range": 0, "upper_bound": "-1374036125"}, {"distinct_range": 0, "num_eq": 8210899241434120647, "num_range": 3032410459331712007, "upper_bound": "-1338700094"}, {"distinct_range": 2492323.8524035914, "num_eq": 5893663048609288181, "num_range": 10000000, "upper_bound": "635550680"}], "histo_col_type": "INT4", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 3, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1062974, "histo_col_type": "DATE", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 14, "columns": ["c\u0364ol1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 12546764, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 10, "columns": ["\\"col1_\\"\\"6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 28640797, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 18, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 29538684, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 40000000}, {"avg_size": 25, "columns": ["col1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 14542549, "histo_buckets": [{"distinct_range": 0, "num_eq": 1691820223198479381, "num_range": 0, "upper_bound": ""}, {"distinct_range": 0, "num_eq": 90000000000, "num_range": 100000, "upper_bound": "\\u0012%"}, {"distinct_range": 6205507922169156000, "num_eq": 600000, "num_range": 6205507922169155985, "upper_bound": "#dw<A\\u0013\\tR\\u001c"}, {"distinct_range": 987907.9764618538, "num_eq": 5702984518732555888, "num_range": 1000000, "upper_bound": "5>\\u001dv"}, {"distinct_range": 4579705219157256000, "num_eq": 1221522883271849243, "num_range": 4579705219157256322, "upper_bound": "B"}, {"distinct_range": 3824139557096869000, "num_eq": 2352603242733346129, "num_range": 9046887859708454673, "upper_bound": "K\\u0013"}, {"distinct_range": 100000, "num_eq": 900000, "num_range": 100000, "upper_bound": "|D)fO[pL\\\\"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 0, "row_count": 40000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (53.26s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 4226a83871bbce776bc9389fca5cf084b4bb7632:

        postgres_1    | 2023-05-08 05:19:02.207 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-05-08 05:19:02.207 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-05-08 05:19:02.212 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-05-08 05:19:02.217 UTC [68] LOG:  database system was shut down at 2023-05-08 05:19:02 UTC
        postgres_1    | 2023-05-08 05:19:02.221 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-05-08 05:19:03.643 UTC [78] ERROR:  collation "da" for encoding "UTF8" does not exist at character 346
        postgres_1    | 2023-05-08 05:19:03.643 UTC [78] STATEMENT:  CREATE TABLE "
        postgres_1    |     table🙂1" (col1😎_😖0 "char" NULL, col1_1 NAME, col1_2 GEOMETRY NOT NULL, col1_3 TIME NOT NULL, col1_4 TSQUERY NOT NULL, col1_5 BOX2D NOT NULL, ćol1_6 REGTYPE, "col͈%v1_7" BYTEA NOT NULL, "col1""_8" BYTEA NOT NULL, "col1*_9" BYTEA NULL, "co %ql1_10" BOX2D NOT NULL, "col1?_11" TSQUERY NULL, col1_12 REGTYPE NOT NULL, "col1'_13" TEXT COLLATE da, col1_14 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_5 AS TEXT))) STORED, "col1_%q15" TEXT NOT NULL GENERATED ALWAYS AS (lower(col1_1)) STORED);
        postgres_1    |     CREATE UNIQUE INDEX ON "
        postgres_1    |     table🙂1" (col1😎_😖0, col1_1 DESC, col1_14 ASC) INCLUDE (col1_2, col1_4, ćol1_6, "col͈%v1_7", "col1*_9", "co %ql1_10");
        postgres_1    |     CREATE UNIQUE INDEX ON "
        postgres_1    |     table🙂1" (col1😎_😖0);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.34s)
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     --- FAIL: TestCompare/postgres (1.17s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "
        test_1        |             table🙂1" (col1😎_😖0 "char" NULL, col1_1 NAME, col1_2 GEOMETRY NOT NULL, col1_3 TIME NOT NULL, col1_4 TSQUERY NOT NULL, col1_5 BOX2D NOT NULL, ćol1_6 REGTYPE, "col͈%v1_7" BYTEA NOT NULL, "col1""_8" BYTEA NOT NULL, "col1*_9" BYTEA NULL, "co %ql1_10" BOX2D NOT NULL, "col1?_11" TSQUERY NULL, col1_12 REGTYPE NOT NULL, "col1'_13" TEXT COLLATE da, col1_14 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col1_5 AS TEXT))) STORED, "col1_%q15" TEXT NOT NULL GENERATED ALWAYS AS (lower(col1_1)) STORED);
        test_1        |             CREATE UNIQUE INDEX ON "
        test_1        |             table🙂1" (col1😎_😖0, col1_1 DESC, col1_14 ASC) INCLUDE (col1_2, col1_4, ćol1_6, "col͈%v1_7", "col1*_9", "co %ql1_10");
        test_1        |             CREATE UNIQUE INDEX ON "
        test_1        |             table🙂1" (col1😎_😖0);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "da" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.74s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 ("c""ol1_0" STRING COLLATE en NOT NULL, col1_1 INT4 NOT NULL, 😌col😷1_2 FLOAT4 NOT NULL, col1_3 TIME, col1_4 BYTES NULL, col1_5 INET NOT NULL, "c�ol1_6" INT8 NOT NULL, "c\\U000D686Bol1_7" BOX2D, col1_8 INT8 NOT NULL, "col1*_9" INT8 NOT NULL, "c ol1_😃10" GEOMETRY[] NOT NULL, c😑ol1_11 INT8 NOT NULL AS (("c�ol1_6" + col1_8) + "col1*_9") VIRTUAL, "col�1_12" STRING AS (lower(CAST("c\\U000D686Bol1_7" AS STRING))) STORED, col1_13 INT8 NOT NULL AS (("col1*_9" + col1_1) + col1_8) VIRTUAL, "col1_%p14" INT8 NOT NULL AS (col1_8 + 5072398531513908494:::INT8) VIRTUAL, co😈l1_15 INT8 NOT NULL AS (col1_1 + 972782469:::INT8) STORED, col1_16 INT8 NOT NULL AS (("col1*_9" + col1_1) + col1_8) VIRTUAL, co🙃l1_17 STRING NULL AS (CASE WHEN col1_4 IS NULL THEN e',Jh\rQT':::STRING ELSE e'Z)\x05\x02V\\':::STRING END) VIRTUAL, INVERTED INDEX ("c\\U000D686Bol1_7" ASC, co😈l1_15 ASC, col1_1 ASC, col1_8, "col1_%p14" DESC, c😑ol1_11 ASC, col1_4, "c""ol1_0" DESC, co🙃l1_17 ASC, 😌col😷1_2 DESC, "c ol1_😃10") WHERE (((((((((((((table1.col1_4 >= e'\\x00':::BYTES) OR (table1."c�ol1_6" != 1:::INT8)) AND (table1.😌col😷1_2 >= 0.0:::FLOAT8)) AND (table1.co😈l1_15 != 1:::INT8)) OR (table1.col1_16 <= (-9223372036854775807):::INT8)) AND (table1.co🙃l1_17 < '':::STRING)) OR (table1."col�1_12" < '"':::STRING)) OR (table1.c😑ol1_11 < 0:::INT8)) AND (table1.col1_13 > 9223372036854775807:::INT8)) OR (table1."col1_%p14" <= 2147483647:::INT8)) AND (table1.col1_3 < '00:00:00':::TIME)) AND (table1.col1_8 <= 32767:::INT8)) OR (table1."col1*_9" > 32767:::INT8)) OR (table1.col1_1 <= (-32768):::INT8) NOT VISIBLE, INDEX (co🙃l1_17 ASC, col1_13 ASC) STORING (😌col😷1_2, col1_5, "c�ol1_6", col1_8, "col1*_9", "c ol1_😃10", "col�1_12", co😈l1_15) WHERE (table1.col1_3 >= '00:00:00':::TIME) OR (table1."c�ol1_6" != (-32768):::INT8), INVERTED INDEX (col1_16 DESC, "col1*_9" ASC, "c\\U000D686Bol1_7", co🙃l1_17, 😌col😷1_2 DESC, c😑ol1_11 ASC, "c�ol1_6", col1_5 DESC, col1_8 ASC, col1_4, lower(CAST(col1_5 AS STRING)) ASC, col1_1 ASC, col1_13 DESC, (CASE WHEN col1_4 IS NULL THEN '':::STRING ELSE e'\x10]Ag\x0b(':::STRING END) DESC, "col1_%p14" ASC, "c""ol1_0" DESC, "c ol1_😃10" ASC), INDEX (co🙃l1_17 ASC) STORING ("c""ol1_0", col1_3, "c\\U000D686Bol1_7", "col�1_12") WHERE (((((((((((((table1."col1_%p14" != (-32768):::INT8) AND (table1."col�1_12" <= e'\x00':::STRING)) OR (table1.col1_13 < 2147483647:::INT8)) OR (table1.😌col😷1_2 <= 1.401298464324817e-45:::FLOAT8)) AND (table1.col1_4 != e'\\x27':::BYTES)) AND (table1.col1_16 <= 2147483647:::INT8)) OR (table1.col1_3 != '24:00:00':::TIME)) OR (table1.co😈l1_15 <= 127:::INT8)) AND (table1.co🙃l1_17 <= e'\U00002603':::STRING)) AND (table1.col1_8 < 9223372036854775807:::INT8)) AND (table1.c😑ol1_11 = 32767:::INT8)) OR (table1.col1_1 != (-32768):::INT8)) OR (table1."c�ol1_6" < (-32768):::INT8)) OR (table1."col1*_9" <= (-1):::INT8) NOT VISIBLE, UNIQUE ((😌col😷1_2 + 1.5905005931854248:::FLOAT8), "col�1_12", 😌col😷1_2 DESC, co🙃l1_17 DESC, col1_13 DESC, col1_1 ASC, "c�ol1_6" ASC, ((("col1*_9" + "c�ol1_6") + col1_1) + col1_8), "col1_%p14", col1_4 ASC) STORING ("c""ol1_0", col1_5, "col1*_9"), INVERTED INDEX (co🙃l1_17, col1_5 ASC, col1_4 DESC, col1_3 DESC, ("c�ol1_6" + col1_1) DESC, "c""ol1_0", col1_8 DESC, c😑ol1_11, co😈l1_15 DESC, 😌col😷1_2 ASC, "col�1_12", "col1_%p14" DESC, "c�ol1_6", col1_1 ASC, col1_16, "col1*_9", "c\\U000D686Bol1_7" DESC, "c ol1_😃10") WHERE (((((((((((((table1.co😈l1_15 <= (-1):::INT8) AND (table1.col1_1 >= (-1):::INT8)) OR (table1."col�1_12" < e'\U00002603':::STRING)) OR (table1."c�ol1_6" = 127:::INT8)) OR (table1.col1_8 > 32767:::INT8)) OR (table1.col1_13 != 1:::INT8)) AND (table1.c😑ol1_11 != (-1):::INT8)) AND (table1.co🙃l1_17 != '':::STRING)) OR (table1."col1*_9" >= 0:::INT8)) OR (table1.😌col😷1_2 < '-Inf':::FLOAT8)) AND (table1.col1_16 <= (-1):::INT8)) OR (table1."col1_%p14" >= 2147483647:::INT8)) AND (table1.col1_4 > '\x00':::BYTES)) AND (table1.col1_3 >= '00:00:00':::TIME), FAMILY ("c""ol1_0"), FAMILY ("c ol1_😃10"), FAMILY (col1_5), FAMILY (col1_8, co😈l1_15, "c�ol1_6", "col1*_9"), FAMILY ("c\\U000D686Bol1_7"), FAMILY ("col�1_12", 😌col😷1_2, col1_1, col1_3), FAMILY (col1_4));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 7, "columns": ["\\"c\\"\\"ol1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2500570031962842615, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4406264413925579641}, {"avg_size": 9, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2931513512118466167, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4406264413925579641}, {"avg_size": 3, "columns": ["\\"c\\\\\\\\U000D686Bol1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2714999790370612388, "histo_col_type": "BOX2D", "name": "__auto__", "null_count": 2306958693115055713, "row_count": 4406264413925579641}, {"avg_size": 15, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3427730645328337346, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4406264413925579641}, {"avg_size": 6, "columns": ["col1_16"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3023064176940964791, "histo_buckets": [{"distinct_range": 0, "num_eq": 600000, "num_range": 0, "upper_bound": "-6946329003834260066"}, {"distinct_range": 3000000000, "num_eq": 2000000, "num_range": 3000000000, "upper_bound": "-2904652151477935083"}, {"distinct_range": 20000000000, "num_eq": 6201422864192389703, "num_range": 20000000000, "upper_bound": "-2086718709803213565"}, {"distinct_range": 80000000000, "num_eq": 313206584413335803, "num_range": 80000000000, "upper_bound": "-1240143771621271885"}, {"distinct_range": 4725030700358716000, "num_eq": 1000000, "num_range": 4737210993948312932, "upper_bound": "1456402269547973580"}, {"distinct_range": 0, "num_eq": 358162088128525627, "num_range": 40000, "upper_bound": "2065833213718656084"}, {"distinct_range": 4103725293059988500, "num_eq": 7000000000, "num_range": 7182470697086882764, "upper_bound": "9223372036854775807"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 4406264413925579641}, {"avg_size": 6, "columns": ["\U0001F60Ccol\U0001F6371_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3861112300919263770, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4406264413925579641}, {"avg_size": 15, "columns": ["\\"col1_%p14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2287778783796966829, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4406264413925579641}, {"avg_size": 1, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4003683821483213259, "histo_col_type": "", "name": "__auto__", "null_count": 951484263877496799, "row_count": 4406264413925579641}, {"avg_size": 6, "columns": ["\\"c\\u000bol1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1709659080568484951, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4406264413925579641}, {"avg_size": 19, "columns": ["\\"c ol1_\U0001F60310\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1611743375574373735, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4406264413925579641}, {"avg_size": 15, "columns": ["c\U0001F611ol1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3909490374009027527, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4406264413925579641}, {"avg_size": 26, "columns": ["co\U0001F608l1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3613030076665713472, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4406264413925579641}, {"avg_size": 15, "columns": ["co\U0001F643l1_17"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3967364637429277596, "histo_buckets": [{"distinct_range": 0, "num_eq": 100000000, "num_range": 0, "upper_bound": ""}, {"distinct_range": 700000, "num_eq": 0, "num_range": 700000, "upper_bound": "\'\\u000co+\\\\\\u0001\\u0019"}, {"distinct_range": 0, "num_eq": 900099555340215804, "num_range": 60, "upper_bound": "]E%G"}, {"distinct_range": 6000000000, "num_eq": 7861106127425787118, "num_range": 6000000000, "upper_bound": "_,I"}, {"distinct_range": 4267203127307063300, "num_eq": 5187413874728286735, "num_range": 4594935638651866533, "upper_bound": "e;\\u0016!\\u0002\\u0012"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 2197414324692316126, "row_count": 4406264413925579641}, {"avg_size": 21, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1947446330131540983, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4406264413925579641}, {"avg_size": 18, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3472779115407068432, "histo_col_type": "", "name": "__auto__", "null_count": 1947666911071861547, "row_count": 4406264413925579641}, {"avg_size": 31, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4360821281206721379, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4406264413925579641}, {"avg_size": 31, "columns": ["\\"col1*_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 247755839855230766, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 4406264413925579641}, {"avg_size": 8, "columns": ["\\"col\\u000c1_12\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2324952574752625977, "histo_col_type": "", "name": "__auto__", "null_count": 3218380372383863750, "row_count": 4406264413925579641}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 16, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5900499874100240414, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8754181913347304394}, {"avg_size": 15, "columns": ["\\"col1_%p14\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8355053359945053858, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8754181913347304394}, {"avg_size": 12, "columns": ["co\U0001F643l1_17"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1679475638751858768, "histo_buckets": [{"distinct_range": 0, "num_eq": 5000000000, "num_range": 0, "upper_bound": "}"}], "histo_col_type": "STRING", "name": "__auto__", "null_count": 3378333477252819738, "row_count": 8754181913347304394}, {"avg_size": 13, "columns": ["co\U0001F608l1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 753168180521556626, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8754181913347304394}, {"avg_size": 24, "columns": ["\\"c\\\\\\\\U000D686Bol1_7\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1893593599722632388, "histo_buckets": [{"distinct_range": 0, "num_eq": 696438570892882638, "num_range": 0, "upper_bound": "BOX(-1.3793877958163332 -0.5139464917439056,-0.9492790862868887 -0.19063475178237643)"}, {"distinct_range": 2.233624218073546, "num_eq": 40000000000, "num_range": 90, "upper_bound": "BOX(-0.9436526675837063 0.29020790368929117,1.5111716747743997 0.46066922961478146)"}, {"distinct_range": 0, "num_eq": 8467185127692181261, "num_range": 100000, "upper_bound": "BOX(-0.9232482195031583 -1.969782488050292,1.0676108767244807 -0.6181932906473371)"}, {"distinct_range": 2674719.732975879, "num_eq": 1476455544944341537, "num_range": 4000000, "upper_bound": "BOX(-0.8387024086215568 -0.781930633386036,-0.5690978245767642 1.4278299353099726)"}, {"distinct_range": 5991373012713964000, "num_eq": 200, "num_range": 7253598624919623160, "upper_bound": "BOX(-0.6296206920718062 -0.9237936584500117,-0.04238931702696802 0.593897773096617)"}, {"distinct_range": 0, "num_eq": 949927046152511855, "num_range": 87593796662853155, "upper_bound": "BOX(0.007887410246868676 -0.7619449303803509,0.3948460314694682 0.39364942222711297)"}, {"distinct_range": 0, "num_eq": 50000000000, "num_range": 10000000000, "upper_bound": "BOX(1.1125926923957863 -1.593948558067937,1.4622118212577835 -0.07815108918784834)"}], "histo_col_type": "BOX2D", "name": "__auto__", "null_count": 6600151273996351626, "row_count": 8754181913347304394}, {"avg_size": 7, "columns": ["col1_8"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8073336543487572301, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8754181913347304394}, {"avg_size": 14, "columns": ["\\"col1*_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1236464251560165397, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8754181913347304394}, {"avg_size": 24, "columns": ["\\"col\\u000c1_12\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3135813469948033104, "histo_col_type": "", "name": "__auto__", "null_count": 2956651979450155062, "row_count": 8754181913347304394}, {"avg_size": 10, "columns": ["\\"c ol1_\U0001F60310\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3791709912398414563, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8754181913347304394}, {"avg_size": 18, "columns": ["col1_16"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6123113417536804531, "histo_buckets": [{"distinct_range": 0, "num_eq": 9059105253307344304, "num_range": 0, "upper_bound": "-8642356066034932197"}, {"distinct_range": 0, "num_eq": 7895174555804835447, "num_range": 1000, "upper_bound": "-8210887857751606519"}, {"distinct_range": 0, "num_eq": 200000000, "num_range": 300, "upper_bound": "-6775366426349334067"}, {"distinct_range": 0, "num_eq": 196033934574269664, "num_range": 6142361716930654375, "upper_bound": "-5398135083569019307"}, {"distinct_range": 1000000, "num_eq": 3000000, "num_range": 1000000, "upper_bound": "-811079559041133116"}, {"distinct_range": 3827630160967746600, "num_eq": 200, "num_range": 3827630160967746697, "upper_bound": "127"}, {"distinct_range": 1474.3593061146262, "num_eq": 6329981864291562149, "num_range": 8000, "upper_bound": "4534739743547151496"}, {"distinct_range": 0, "num_eq": 800, "num_range": 977980958746053550, "upper_bound": "7428650780412450769"}], "histo_col_type": "INT8", "name": "__auto__", "null_count": 0, "row_count": 8754181913347304394}, {"avg_size": 30, "columns": ["\\"c\\"\\"ol1_0\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 7969297558156720379, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8754181913347304394}, {"avg_size": 5, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4917686352412011, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8754181913347304394}, {"avg_size": 29, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5801311155013816170, "histo_col_type": "", "name": "__auto__", "null_count": 4197909929187188620, "row_count": 8754181913347304394}, {"avg_size": 25, "columns": ["\\"c\\u000bol1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6938807907198928230, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8754181913347304394}, {"avg_size": 19, "columns": ["\U0001F60Ccol\U0001F6371_2"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3677317866387743809, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8754181913347304394}, {"avg_size": 6, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6328579380803717439, "histo_col_type": "", "name": "__auto__", "null_count": 3659193247812313873, "row_count": 8754181913347304394}, {"avg_size": 12, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3237174114015711797, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8754181913347304394}, {"avg_size": 20, "columns": ["c\U0001F611ol1_11"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6871899607540754340, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 8754181913347304394}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.44s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 5376e479204d6e8243f67c30aea3d031df529afd:

        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-05-09 05:19:09.795 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-05-09 05:19:09.795 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-05-09 05:19:09.795 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-05-09 05:19:09.799 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-05-09 05:19:09.804 UTC [68] LOG:  database system was shut down at 2023-05-09 05:19:09 UTC
        postgres_1    | 2023-05-09 05:19:09.809 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-05-09 05:19:10.915 UTC [78] ERROR:  invalid byte sequence for encoding "UTF8": 0x00
        postgres_1    | 2023-05-09 05:19:10.915 UTC [78] STATEMENT:  CREATE TABLE "tablE2" ("col2_'0" INTERVAL NOT NULL, col2_1 INT4 NOT NULL, col2_2 UUID NOT NULL, col2_3 BOX2D NOT NULL, "%vcol2_4" TIMESTAMPTZ NOT NULL, "co l2_5" OID[] NOT NULL, col2_6 "char", col2_7 DATE NOT NULL, col2_8 GEOGRAPHY, col2_9 FLOAT8 NOT NULL, "c\\U00085916ol2_\\uED2110" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_2 AS TEXT))) STORED, col2_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_3 AS TEXT))) STORED, "😂coL2_12" FLOAT8 NOT NULL GENERATED ALWAYS AS (col2_9 + 0.2854012322418792::FLOAT8) STORED, col2_13 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_2 AS TEXT))) STORED, "col%v2_14" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col2_'0" IS NULL THEN e'\x00'::TEXT ELSE e'zj\x1etr+'::TEXT END) STORED, col2😐_15 TEXT GENERATED ALWAYS AS (lower(col2_6)) STORED, "c\gol2_16" INT8 NOT NULL GENERATED ALWAYS AS (col2_1 + (-1449278848)::INT8) STORED, "%c1col2_17" TEXT GENERATED ALWAYS AS (lower(CAST(col2_8 AS TEXT))) STORED, col2_18 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_3 AS TEXT))) STORED);
        postgres_1    |     CREATE INDEX ON "tablE2" ("c\\U00085916ol2_\\uED2110" DESC, col2_1 ASC, "co l2_5" DESC, "col2_'0" DESC, "%c1col2_17" DESC, col2_6 DESC, (CASE WHEN "%vcol2_4" IS NULL THEN e'.[d\x1e\'\x11'::TEXT ELSE e'&\x1e2.k}sv'::TEXT END), col2_18 ASC, "%vcol2_4" ASC);
        postgres_1    |     CREATE UNIQUE INDEX ON "tablE2" ("c\\U00085916ol2_\\uED2110" DESC, col2_6, col2_13 DESC, col2_2, col2_18, "col2_'0", col2_11 DESC) INCLUDE (col2_3, col2_7, col2_8, col2_9);
        postgres_1    |     CREATE UNIQUE INDEX ON "tablE2" (col2_6, "c\gol2_16", col2_9 DESC, "co l2_5") INCLUDE (col2_1, col2_2, col2_8, "c\\U00085916ol2_\\uED2110", col2_18);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (4.88s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.02s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "tablE2" ("col2_'0" INTERVAL NOT NULL, col2_1 INT4 NOT NULL, col2_2 UUID NOT NULL, col2_3 BOX2D NOT NULL, "%vcol2_4" TIMESTAMPTZ NOT NULL, "co l2_5" OID[] NOT NULL, col2_6 "char", col2_7 DATE NOT NULL, col2_8 GEOGRAPHY, col2_9 FLOAT8 NOT NULL, "c\\U00085916ol2_\\uED2110" TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_2 AS TEXT))) STORED, col2_11 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_3 AS TEXT))) STORED, "😂coL2_12" FLOAT8 NOT NULL GENERATED ALWAYS AS (col2_9 + 0.2854012322418792::FLOAT8) STORED, col2_13 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_2 AS TEXT))) STORED, "col%v2_14" TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN "col2_'0" IS NULL THEN e'\x00'::TEXT ELSE e'zj\x1etr+'::TEXT END) STORED, col2😐_15 TEXT GENERATED ALWAYS AS (lower(col2_6)) STORED, "c\gol2_16" INT8 NOT NULL GENERATED ALWAYS AS (col2_1 + (-1449278848)::INT8) STORED, "%c1col2_17" TEXT GENERATED ALWAYS AS (lower(CAST(col2_8 AS TEXT))) STORED, col2_18 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_3 AS TEXT))) STORED);
        test_1        |             CREATE INDEX ON "tablE2" ("c\\U00085916ol2_\\uED2110" DESC, col2_1 ASC, "co l2_5" DESC, "col2_'0" DESC, "%c1col2_17" DESC, col2_6 DESC, (CASE WHEN "%vcol2_4" IS NULL THEN e'.[d\x1e\'\x11'::TEXT ELSE e'&\x1e2.k}sv'::TEXT END), col2_18 ASC, "%vcol2_4" ASC);
        test_1        |             CREATE UNIQUE INDEX ON "tablE2" ("c\\U00085916ol2_\\uED2110" DESC, col2_6, col2_13 DESC, col2_2, col2_18, "col2_'0", col2_11 DESC) INCLUDE (col2_3, col2_7, col2_8, col2_9);
        test_1        |             CREATE UNIQUE INDEX ON "tablE2" (col2_6, "c\gol2_16", col2_9 DESC, "co l2_5") INCLUDE (col2_1, col2_2, col2_8, "c\\U00085916ol2_\\uED2110", col2_18);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: invalid byte sequence for encoding "UTF8": 0x00 (SQLSTATE 22021)
        test_1        |     --- FAIL: TestCompare/mutators (0.73s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "
table1" (col1_0 BIT(22) NULL, col1_1 TIMETZ NOT NULL, "c{ol1%p_2" REGROLE, "%qcol1_3" VARCHAR NOT NULL, col1_4 DECIMAL, col1_5 INT8 NOT NULL, col1_6 TIMESTAMP NOT NULL, col1_7 TSVECTOR NOT NULL, "col1_ 8" BOOL NOT NULL, col1_9 STRING NOT NULL AS (lower(CAST(col1_7 AS STRING))) VIRTUAL, UNIQUE (col1_1, col1_4, col1_9 ASC) STORING (col1_0, "c{ol1%p_2", "col1_ 8") WHERE (((((("
table1".col1_1 <= '00:00:00+15:59':::TIMETZ) OR ("
table1".col1_6 >= '294276-12-31 23:59:59.999999':::TIMESTAMP)) OR ("
table1".col1_4 = (-1.234E+401):::DECIMAL)) AND "
table1"."col1_ 8") AND ("
table1".col1_5 >= (-2147483648):::INT8)) OR ("
table1"."%qcol1_3" < '':::STRING)) AND ("
table1".col1_9 < e'\x00':::STRING), INDEX ("%qcol1_3" ASC, col1_6) STORING (col1_4, col1_5, col1_7, "col1_ 8") NOT VISIBLE, INDEX (col1_4 ASC, col1_1, col1_9 ASC, "c{ol1%p_2" DESC, col1_5 ASC, col1_0) STORING ("col1_ 8"), INDEX (col1_6 ASC) STORING (col1_4, col1_5, col1_7), FAMILY (col1_6, "col1_ 8"), FAMILY (col1_0, "%qcol1_3"), FAMILY ("c{ol1%p_2"), FAMILY (col1_4, col1_1), FAMILY (col1_5, col1_7));
        test_1        |             ALTER TABLE "
table1" INJECT STATISTICS e'[{"avg_size": 24, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2871222304554498994, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6706097406730379343}, {"avg_size": 29, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3288881874746923301, "histo_col_type": "", "name": "__auto__", "null_count": 3375248692754334511, "row_count": 6706097406730379343}, {"avg_size": 1, "columns": ["\\"%qcol1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3540130904912711767, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "2"}, {"distinct_range": 0, "num_eq": 3402697669400991255, "num_range": 0, "upper_bound": "y\\""}], "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 0, "row_count": 6706097406730379343}, {"avg_size": 1, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1203585037623687348, "histo_buckets": [{"distinct_range": 0, "num_eq": 4745968476281353365, "num_range": 0, "upper_bound": "-8.414316969220185155E+28"}, {"distinct_range": 900, "num_eq": 400, "num_range": 900, "upper_bound": "-1.897905632932509507E+19"}], "histo_col_type": "DECIMAL", "name": "__auto__", "null_count": 1640658415641185314, "row_count": 6706097406730379343}, {"avg_size": 8, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1209911347470581599, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6706097406730379343}, {"avg_size": 29, "columns": ["\\"col1_ 8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 818380260574434509, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6706097406730379343}, {"avg_size": 17, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 509531725281034324, "histo_buckets": [{"distinct_range": 0, "num_eq": 40000000000, "num_range": 0, "upper_bound": "08:15:37.244035-03:50"}, {"distinct_range": 2284757838182292700, "num_eq": 0, "num_range": 6971538594431972085, "upper_bound": "06:51:22.574613-11:17"}], "histo_col_type": "TIMETZ", "name": "__auto__", "null_count": 0, "row_count": 6706097406730379343}, {"avg_size": 29, "columns": ["\\"c{ol1%p_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3147439846326052956, "histo_col_type": "", "name": "__auto__", "null_count": 2613601338413855002, "row_count": 6706097406730379343}, {"avg_size": 4, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 6199834178281325417, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6706097406730379343}, {"avg_size": 13, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4810834947397755487, "histo_buckets": [{"distinct_range": 0, "num_eq": 6187853521390254355, "num_range": 0, "upper_bound": "2001-01-01 00:00:00 BC"}, {"distinct_range": 8219143294448856000, "num_eq": 8239913137813424846, "num_range": 8219143294448855726, "upper_bound": "1988-12-25 02:09:55.000549"}, {"distinct_range": 0, "num_eq": 10000000000, "num_range": 20000, "upper_bound": "1997-05-10 02:01:35.000964"}], "histo_col_type": "TIMESTAMP", "name": "__auto__", "null_count": 0, "row_count": 6706097406730379343}]':::JSONB;
        test_1        |             ALTER TABLE "
table1" INJECT STATISTICS e'[{"avg_size": 26, "columns": ["\\"c{ol1%p_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2165840319931635106, "histo_col_type": "", "name": "__auto__", "null_count": 5155223266541298440, "row_count": 6677696036775012204}, {"avg_size": 19, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 370100287632633840, "histo_buckets": [{"distinct_range": 0, "num_eq": 269018049367939190, "num_range": 0, "upper_bound": "-Infinity"}, {"distinct_range": 4084218398912726500, "num_eq": 800000000, "num_range": 4084218398912726406, "upper_bound": "-835699686978.3719691"}, {"distinct_range": 0, "num_eq": 0, "num_range": 7000000, "upper_bound": "-209403767397.1996258"}, {"distinct_range": 198562078303689100, "num_eq": 80000, "num_range": 504048059617785984, "upper_bound": "-5965349.520122744917"}], "histo_col_type": "DECIMAL", "name": "__auto__", "null_count": 3443997798209882179, "row_count": 6677696036775012204}, {"avg_size": 28, "columns": ["col1_6"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 773762253374865828, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6677696036775012204}, {"avg_size": 1, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5585074165029930973, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6677696036775012204}, {"avg_size": 11, "columns": ["\\"col1_ 8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3812370416985392313, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6677696036775012204}, {"avg_size": 24, "columns": ["col1_9"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5688874627186377739, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6677696036775012204}, {"avg_size": 14, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3695573879620480007, "histo_col_type": "", "name": "__auto__", "null_count": 5765420019040087685, "row_count": 6677696036775012204}, {"avg_size": 28, "columns": ["col1_1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2595912965030358678, "histo_buckets": [{"distinct_range": 0, "num_eq": 20, "num_range": 0, "upper_bound": "18:57:39.976147-08:37"}], "histo_col_type": "TIMETZ", "name": "__auto__", "null_count": 0, "row_count": 6677696036775012204}, {"avg_size": 11, "columns": ["\\"%qcol1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1617977196691232163, "histo_buckets": [{"distinct_range": 0, "num_eq": 8164467537748627861, "num_range": 0, "upper_bound": "\\u0000"}, {"distinct_range": 0, "num_eq": 600000000, "num_range": 0, "upper_bound": "$ "}, {"distinct_range": 209.87466121716278, "num_eq": 7096919868750226867, "num_range": 300, "upper_bound": "dFd\\u0003"}, {"distinct_range": 300000, "num_eq": 8216549354242501329, "num_range": 300000, "upper_bound": "w\\u000e>\\u001bNY"}], "histo_col_type": "VARCHAR", "name": "__auto__", "null_count": 0, "row_count": 6677696036775012204}, {"avg_size": 26, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2790752599738150062, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 6677696036775012204}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (19.93s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 6c6d6657a21dd94d98e4c99c8d6c64f6353a5774:

        postgres_1    | 2023-05-10 05:17:30.320 UTC [68] LOG:  database system was shut down at 2023-05-10 05:17:30 UTC
        postgres_1    | 2023-05-10 05:17:30.321 UTC [70] FATAL:  the database system is starting up
        test_1        | I230510 05:17:30.321640 50 testutils/soon.go:41  [-] 1  SucceedsSoon: FATAL: the database system is starting up (SQLSTATE 57P03)
        postgres_1    | 2023-05-10 05:17:30.325 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-05-10 05:17:32.373 UTC [80] ERROR:  collation "en" for encoding "UTF8" does not exist at character 34
        postgres_1    | 2023-05-10 05:17:32.373 UTC [80] STATEMENT:  CREATE TABLE table2 (col2_0 TEXT COLLATE en NOT NULL, col2_1 "char" NOT NULL, "col2_""2" INT2 NOT NULL, "'col2_3" REGROLE NULL, col2_4 TEXT COLLATE de NOT NULL, col2_😍5 TSVECTOR NOT NULL, col̄2_6 INTERVAL NULL, "c'O%1al2_7" BOOL NOT NULL, col2_8 BIT(37) NOT NULL, col2̲_9 TEXT NOT NULL, "co�l2_10" BOX2D NOT NULL, col2_11 TEXT NULL GENERATED ALWAYS AS (CASE WHEN "'col2_3" IS NULL THEN ''::TEXT ELSE '=>``&p9wLp'::TEXT END) STORED, """col2_12" INT8 NOT NULL GENERATED ALWAYS AS ("col2_""2" + (-28098)::INT8) STORED, col2_13 TEXT NULL GENERATED ALWAYS AS (CASE WHEN "'col2_3" IS NULL THEN NULL ELSE e'KPFQy\x15'::TEXT END) STORED);
        postgres_1    |     CREATE INDEX ON table2 ("c'O%1al2_7" ASC) INCLUDE (col2_0, col2_1, "col2_""2", col2_4, col2_😍5, col̄2_6, col2_8, "co�l2_10", col2_13);
        postgres_1    |     CREATE UNIQUE INDEX ON table2 (col2_13, col2_4 ASC, "c'O%1al2_7", col2_1 DESC, col̄2_6, "col2_""2" ASC, "'col2_3", col2_11 ASC, """col2_12" ASC, col2_8 DESC) INCLUDE (col2_😍5);
        postgres_1    |     CREATE INDEX ON table2 ("c'O%1al2_7", col2_0 DESC, col2̲_9 ASC, """col2_12");
        postgres_1    |     CREATE INDEX ON table2 ("'col2_3", lower(CAST(col2_0 AS TEXT)) ASC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (5.98s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/postgres (1.04s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE table2 (col2_0 TEXT COLLATE en NOT NULL, col2_1 "char" NOT NULL, "col2_""2" INT2 NOT NULL, "'col2_3" REGROLE NULL, col2_4 TEXT COLLATE de NOT NULL, col2_😍5 TSVECTOR NOT NULL, col̄2_6 INTERVAL NULL, "c'O%1al2_7" BOOL NOT NULL, col2_8 BIT(37) NOT NULL, col2̲_9 TEXT NOT NULL, "co�l2_10" BOX2D NOT NULL, col2_11 TEXT NULL GENERATED ALWAYS AS (CASE WHEN "'col2_3" IS NULL THEN ''::TEXT ELSE '=>``&p9wLp'::TEXT END) STORED, """col2_12" INT8 NOT NULL GENERATED ALWAYS AS ("col2_""2" + (-28098)::INT8) STORED, col2_13 TEXT NULL GENERATED ALWAYS AS (CASE WHEN "'col2_3" IS NULL THEN NULL ELSE e'KPFQy\x15'::TEXT END) STORED);
        test_1        |             CREATE INDEX ON table2 ("c'O%1al2_7" ASC) INCLUDE (col2_0, col2_1, "col2_""2", col2_4, col2_😍5, col̄2_6, col2_8, "co�l2_10", col2_13);
        test_1        |             CREATE UNIQUE INDEX ON table2 (col2_13, col2_4 ASC, "c'O%1al2_7", col2_1 DESC, col̄2_6, "col2_""2" ASC, "'col2_3", col2_11 ASC, """col2_12" ASC, col2_8 DESC) INCLUDE (col2_😍5);
        test_1        |             CREATE INDEX ON table2 ("c'O%1al2_7", col2_0 DESC, col2̲_9 ASC, """col2_12");
        test_1        |             CREATE INDEX ON table2 ("'col2_3", lower(CAST(col2_0 AS TEXT)) ASC);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "en" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        |     --- FAIL: TestCompare/mutators (0.81s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE table1 (c😰ol1_0 FLOAT8 NOT NULL, col1_ͪ1 DECIMAL NOT NULL, "col\\xe71_2" DECIMAL NOT NULL, col1_3 FLOAT4 NOT NULL, col1_4 REGCLASS NOT NULL, col1_5 TIMESTAMPTZ NOT NULL, "col1
        test_1        |             _6" BIT(30) NOT NULL, PRIMARY KEY ("col1
        test_1        |             _6", "col\\xe71_2", col1_ͪ1, col1_3 DESC, col1_5, c😰ol1_0 ASC, col1_4 DESC), FAMILY ("col1
        test_1        |             _6"), FAMILY (col1_3), FAMILY (col1_4), FAMILY ("col\\xe71_2"), FAMILY (col1_ͪ1, c😰ol1_0, col1_5));
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 1, "columns": ["col1_\u036A1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1353805891329729776, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2956410798513315988}, {"avg_size": 23, "columns": ["\\"col\\\\\\\\xe71_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1202485665685316347, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2956410798513315988}, {"avg_size": 11, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 930942654201750617, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2956410798513315988}, {"avg_size": 29, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 988351512182531445, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2956410798513315988}, {"avg_size": 27, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 962249674723098663, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2956410798513315988}, {"avg_size": 7, "columns": ["\\"col1\\n_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 766397722556687975, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "110111001010011110010110110110"}], "histo_col_type": "BIT(30)", "name": "__auto__", "null_count": 0, "row_count": 2956410798513315988}, {"avg_size": 21, "columns": ["c\U0001F630ol1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 2120033321884379009, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2956410798513315988}]':::JSONB;
        test_1        |             ALTER TABLE table1 INJECT STATISTICS e'[{"avg_size": 19, "columns": ["c\U0001F630ol1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 358, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2000}, {"avg_size": 7, "columns": ["col1_\u036A1"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 525, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2000}, {"avg_size": 25, "columns": ["\\"col\\\\\\\\xe71_2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 603, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2000}, {"avg_size": 21, "columns": ["col1_3"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 451, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2000}, {"avg_size": 23, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1071, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2000}, {"avg_size": 14, "columns": ["col1_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 755, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 2000}, {"avg_size": 23, "columns": ["\\"col1\\n_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 604, "histo_buckets": [{"distinct_range": 0, "num_eq": 0, "num_range": 0, "upper_bound": "000000000000000000000000000000"}, {"distinct_range": 0, "num_eq": 7000000, "num_range": 900000000, "upper_bound": "010000011101010100001011011110"}, {"distinct_range": 804886134666873100, "num_eq": 214330288518613049, "num_range": 6483704827714915775, "upper_bound": "011000110001100100000100100000"}, {"distinct_range": 0, "num_eq": 6187190188525155750, "num_range": 20, "upper_bound": "011110001110111001100010001100"}, {"distinct_range": 1513527953003915800, "num_eq": 1210768983007507641, "num_range": 2844047261385784295, "upper_bound": "100001101111001100010000010001"}], "histo_col_type": "BIT(30)", "name": "__auto__", "null_count": 0, "row_count": 2000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (20.52s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-sessions branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

compose.TestComposeCompare failed with artifacts on release-23.1 @ 6ceddbd9dc6b987add91ea93a665088e7928cb88:

        postgres_1    | 2023-05-11 05:17:50.805 UTC [52] LOG:  shutting down
        postgres_1    | 2023-05-11 05:17:50.906 UTC [50] LOG:  database system is shut down
        postgres_1    |  done
        postgres_1    | server stopped
        postgres_1    | 
        postgres_1    | PostgreSQL init process complete; ready for start up.
        postgres_1    | 
        postgres_1    | 2023-05-11 05:17:51.021 UTC [1] LOG:  starting PostgreSQL 13.5 (Debian 13.5-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
        postgres_1    | 2023-05-11 05:17:51.021 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
        postgres_1    | 2023-05-11 05:17:51.021 UTC [1] LOG:  listening on IPv6 address "::", port 5432
        postgres_1    | 2023-05-11 05:17:51.024 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
        postgres_1    | 2023-05-11 05:17:51.029 UTC [69] LOG:  database system was shut down at 2023-05-11 05:17:50 UTC
        postgres_1    | 2023-05-11 05:17:51.034 UTC [1] LOG:  database system is ready to accept connections
        postgres_1    | 2023-05-11 05:17:52.868 UTC [79] ERROR:  collation "de" for encoding "UTF8" does not exist at character 165
        postgres_1    | 2023-05-11 05:17:52.868 UTC [79] STATEMENT:  CREATE TABLE "ta b�lȅ2" (col2_0 GEOGRAPHY NOT NULL, col2_1 CHAR NOT NULL, col2_2 TIMETZ NOT NULL, "'col2_3" INT4 NOT NULL, col2_4 INTERVAL NOT NULL, "c'ol2_5" TEXT COLLATE de, "c-ol2 _6" FLOAT4 NOT NULL, col2_7 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_4 IS NULL THEN e'\x18Mj|39 /t'::TEXT ELSE e'0T\x15G\x02&"+#'::TEXT END) STORED, col2😜_8 TEXT GENERATED ALWAYS AS (lower(CAST("c'ol2_5" AS TEXT))) STORED, col2_9 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_2 AS TEXT))) STORED, col2_10 FLOAT8 NOT NULL GENERATED ALWAYS AS ("c-ol2 _6" + 0.04934949427843094::FLOAT8) STORED, col2_11 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_4 IS NULL THEN e'\x188H\x03\x035'::TEXT ELSE e'|\x1e``,U'::TEXT END) STORED);
        postgres_1    |     CREATE INDEX ON "ta b�lȅ2" (col2_10 ASC, col2_11 DESC, col2_4 ASC, ("c-ol2 _6" + (-0.42417630553245544)::FLOAT8), col2_1 DESC);
        postgres_1    |     
        test_1        | --- FAIL: TestCompare (4.89s)
        test_1        |     compare_test.go:130: Checking connection to: postgres
        test_1        |     compare_test.go:130: Checking connection to: cockroach1
        test_1        |     compare_test.go:130: Checking connection to: cockroach2
        test_1        |     --- FAIL: TestCompare/mutators (0.58s)
        test_1        |         compare_test.go:139: starting test: mutators
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: cockroach2
        test_1        |         compare_test.go:170: CREATE TABLE "taBle1" (col1_0 DATE NOT NULL, "col?1_1" INET NOT NULL, "col1_%v2" TSVECTOR NOT NULL, "c""ol1_3" TIMETZ NOT NULL, col1_4 BYTES, col1ͯ_5 DECIMAL NOT NULL, "\\U0005C9E5col1_6" FLOAT4 NULL, col1_7 JSONB NOT NULL, "c'ol1_8" REGCLASS NULL, "col 1_9" INET NOT NULL, "col1_'10" TSVECTOR NOT NULL, "col1_ 11" BIT NULL, col1_12 TIME, col1_13 VARCHAR NOT NULL, col1_14 TIMESTAMPTZ NULL, col1_15 GEOMETRY NULL, "c\\U000BCC25ol1_16" BIT(27) NOT NULL, "col%q1_17" DATE NULL, col1_18 STRING NULL, UNIQUE ("col1_ 11") STORING ("col?1_1", "\\U0005C9E5col1_6", col1_7, "c'ol1_8", col1_12, col1_14, "c\\U000BCC25ol1_16", col1_18) WHERE ((((("taBle1".col1_18 > '"':::STRING) AND ("taBle1".col1_13 < e'\U00002603':::STRING)) AND ("taBle1"."col%q1_17" >= '-infinity':::DATE)) AND ("taBle1"."c""ol1_3" != '24:00:00-15:59':::TIMETZ)) AND ("taBle1".col1_0 != '-infinity':::DATE)) OR ("taBle1".col1_4 < '\xe29883':::BYTES), FAMILY ("col?1_1", "c""ol1_3"), FAMILY (col1_15), FAMILY ("\\U0005C9E5col1_6"), FAMILY (col1_13, col1ͯ_5, "col1_ 11", col1_12), FAMILY (col1_14, "col%q1_17"), FAMILY (col1_18, "c'ol1_8"), FAMILY ("c\\U000BCC25ol1_16"), FAMILY (col1_0), FAMILY ("col1_%v2", "col1_'10", "col 1_9"), FAMILY (col1_7), FAMILY (col1_4));
        test_1        |             ALTER TABLE "taBle1" INJECT STATISTICS e'[{"avg_size": 31, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 41687591, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000}, {"avg_size": 13, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 39427312, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000}, {"avg_size": 16, "columns": ["\\"col 1_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 10677004, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000}, {"avg_size": 16, "columns": ["\\"col1_\'10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 73527650, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000}, {"avg_size": 18, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 57112531, "histo_col_type": "", "name": "__auto__", "null_count": 15709229, "row_count": 80000000}, {"avg_size": 25, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 36047647, "histo_col_type": "", "name": "__auto__", "null_count": 72807121, "row_count": 80000000}, {"avg_size": 29, "columns": ["\\"col1_%v2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 33753880, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000}, {"avg_size": 24, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 12815195, "histo_col_type": "", "name": "__auto__", "null_count": 33217938, "row_count": 80000000}, {"avg_size": 6, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 29490428, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000}, {"avg_size": 19, "columns": ["col1\u036F_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 8624642, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000}, {"avg_size": 19, "columns": ["\\"col1_ 11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 62409159, "histo_buckets": [{"distinct_range": 0, "num_eq": 2846831155960282229, "num_range": 0, "upper_bound": "0"}, {"distinct_range": 1793720559436006700, "num_eq": 6000000000, "num_range": 7140163812599710215, "upper_bound": "1"}], "histo_col_type": "BIT", "name": "__auto__", "null_count": 76209563, "row_count": 80000000}, {"avg_size": 18, "columns": ["\\"col?1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 40015348, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000}, {"avg_size": 20, "columns": ["\\"c\\"\\"ol1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 1909487, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000}, {"avg_size": 11, "columns": ["\\"\\\\\\\\U0005C9E5col1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 23831233, "histo_col_type": "", "name": "__auto__", "null_count": 74449082, "row_count": 80000000}, {"avg_size": 7, "columns": ["\\"c\'ol1_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 829177, "histo_col_type": "", "name": "__auto__", "null_count": 43555098, "row_count": 80000000}, {"avg_size": 29, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 19573251, "histo_col_type": "", "name": "__auto__", "null_count": 77629145, "row_count": 80000000}, {"avg_size": 10, "columns": ["\\"c\\\\\\\\U000BCC25ol1_16\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 42082902, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000}, {"avg_size": 29, "columns": ["\\"col%q1_17\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 22094429, "histo_col_type": "", "name": "__auto__", "null_count": 68489429, "row_count": 80000000}, {"avg_size": 19, "columns": ["col1_18"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 3457034, "histo_col_type": "", "name": "__auto__", "null_count": 58544420, "row_count": 80000000}]':::JSONB;
        test_1        |             ALTER TABLE "taBle1" INJECT STATISTICS e'[{"avg_size": 19, "columns": ["col1_0"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 29929576941, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000000}, {"avg_size": 18, "columns": ["\\"\\\\\\\\U0005C9E5col1_6\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 36918495000, "histo_col_type": "", "name": "__auto__", "null_count": 62428128174, "row_count": 80000000000}, {"avg_size": 13, "columns": ["\\"col1_\'10\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 43944103802, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000000}, {"avg_size": 26, "columns": ["col1_14"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 38343382448, "histo_col_type": "", "name": "__auto__", "null_count": 45590667276, "row_count": 80000000000}, {"avg_size": 4, "columns": ["col1_15"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 34522503124, "histo_col_type": "", "name": "__auto__", "null_count": 21156032477, "row_count": 80000000000}, {"avg_size": 4, "columns": ["\\"col?1_1\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 9864257792, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000000}, {"avg_size": 26, "columns": ["\\"c\\"\\"ol1_3\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 46348243599, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000000}, {"avg_size": 7, "columns": ["col1\u036F_5"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 4585802493, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000000}, {"avg_size": 28, "columns": ["col1_7"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 5662685887, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000000}, {"avg_size": 17, "columns": ["\\"col 1_9\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 31850160540, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000000}, {"avg_size": 12, "columns": ["\\"col1_ 11\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 21500456066, "histo_col_type": "", "name": "__auto__", "null_count": 14691461739, "row_count": 80000000000}, {"avg_size": 10, "columns": ["col1_13"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 44095560273, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000000}, {"avg_size": 21, "columns": ["\\"c\\\\\\\\U000BCC25ol1_16\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 68098486386, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000000}, {"avg_size": 13, "columns": ["\\"col1_%v2\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 73124053092, "histo_col_type": "", "name": "__auto__", "null_count": 0, "row_count": 80000000000}, {"avg_size": 25, "columns": ["col1_4"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 75566917507, "histo_col_type": "", "name": "__auto__", "null_count": 61361735671, "row_count": 80000000000}, {"avg_size": 13, "columns": ["col1_12"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 26523246852, "histo_col_type": "", "name": "__auto__", "null_count": 51015362856, "row_count": 80000000000}, {"avg_size": 24, "columns": ["\\"col%q1_17\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 20608042259, "histo_col_type": "", "name": "__auto__", "null_count": 10543116508, "row_count": 80000000000}, {"avg_size": 26, "columns": ["col1_18"], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 54146367490, "histo_col_type": "", "name": "__auto__", "null_count": 247574612, "row_count": 80000000000}, {"avg_size": 31, "columns": ["\\"c\'ol1_8\\""], "created_at": "2000-01-01 00:00:00+00:00", "distinct_count": 45339878083, "histo_col_type": "", "name": "__auto__", "null_count": 64256490381, "row_count": 80000000000}]':::JSONB;
        test_1        |             
        test_1        |         compare_test.go:171: cockroach2: exec: ERROR: cannot inject statistics in an explicit transaction (SQLSTATE XXUUU)
        test_1        |     --- FAIL: TestCompare/postgres (1.19s)
        test_1        |         compare_test.go:139: starting test: postgres
        test_1        |         compare_test.go:148: initializing connection: cockroach1
        test_1        |         compare_test.go:148: initializing connection: postgres
        test_1        |         compare_test.go:170: CREATE TABLE "ta b�lȅ2" (col2_0 GEOGRAPHY NOT NULL, col2_1 CHAR NOT NULL, col2_2 TIMETZ NOT NULL, "'col2_3" INT4 NOT NULL, col2_4 INTERVAL NOT NULL, "c'ol2_5" TEXT COLLATE de, "c-ol2 _6" FLOAT4 NOT NULL, col2_7 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_4 IS NULL THEN e'\x18Mj|39 /t'::TEXT ELSE e'0T\x15G\x02&"+#'::TEXT END) STORED, col2😜_8 TEXT GENERATED ALWAYS AS (lower(CAST("c'ol2_5" AS TEXT))) STORED, col2_9 TEXT NOT NULL GENERATED ALWAYS AS (lower(CAST(col2_2 AS TEXT))) STORED, col2_10 FLOAT8 NOT NULL GENERATED ALWAYS AS ("c-ol2 _6" + 0.04934949427843094::FLOAT8) STORED, col2_11 TEXT NOT NULL GENERATED ALWAYS AS (CASE WHEN col2_4 IS NULL THEN e'\x188H\x03\x035'::TEXT ELSE e'|\x1e``,U'::TEXT END) STORED);
        test_1        |             CREATE INDEX ON "ta b�lȅ2" (col2_10 ASC, col2_11 DESC, col2_4 ASC, ("c-ol2 _6" + (-0.42417630553245544)::FLOAT8), col2_1 DESC);
        test_1        |             
        test_1        |         compare_test.go:171: postgres: exec: ERROR: collation "de" for encoding "UTF8" does not exist (SQLSTATE 42704)
        test_1        | FAIL
        compare_test_1 exited with code 1
        Stopping compare_postgres_1   ... 
        Stopping compare_cockroach2_1 ... 
        Stopping compare_cockroach1_1 ... 
        Stopping compare_postgres_1   ... done
        Stopping compare_cockroach2_1 ... done
        Stopping compare_cockroach1_1 ... done
        Aborting on container exit...

    compose_test.go:122: exit status 1
--- FAIL: TestComposeCompare (19.76s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #101271 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-23.1.0] - #89361 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-22.2] - #82867 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-master] - #78068 compose: TestComposeCompare failed [C-test-failure O-robot T-sql-foundations branch-release-22.1 sync-me-8] - #73421 compose: TestComposeCompare failed [C-test-failure O-robot branch-release-21.2 sync-me-8]

This test on roachdash | Improve this report!