search

yugabyte / yugabyte-db

YugabyteDB - the cloud native distributed SQL database for mission-critical applications.
https://www.yugabyte.com
Other
8.98k stars 1.07k forks source link

[YSQL] OID collision from different tservers #16130

Closed yifanguan closed 11 months ago

yifanguan commented 1 year ago

Jira Link: DB-5568

Description

In file: yb-master.ip-172-151-25-232.us-west-2.compute.internal.yugabyte.log.INFO.20230215-111239.19978 in attached log.

I0215 11:36:23.690174 20003 catalog_manager.cc:3557] CreateTable from 172.151.25.232:36961:
name: "pg_temp_16615"
...
table_id: "000040000000300080000000000040f4"
is_colocated_via_database: true
tablegroup_id: "00004000000030008000000000004008"
...
is_matview: true

I0215 11:47:15.423025 20022 catalog_manager.cc:3557] CreateTable from 172.151.31.147:45284:
name: "unique_idx_c1f057"
...
table_type: PGSQL_TABLE_TYPE
namespace {
  id: "00004000000030008000000000000000"
  name: "db_d52530"
  database_type: YQL_DATABASE_PGSQL
}
indexed_table_id: "0000400000003000800000000000401e"
is_local_index: false
is_unique_index: true
table_id: "000040000000300080000000000040f4"
index_info {
  is_unique: true
  indexed_table_id: "0000400000003000800000000000401e"
}
skip_index_backfill: false
tablegroup_id: "00004000000030008000000000004008"
is_matview: false
I0215 11:47:15.423108 20022 partition.cc:632] Creating partitions with num_tablets: 1
I0215 11:47:15.423133 20022 catalog_manager.cc:3821] Set number of tablets: 1
I0215 11:47:15.423138 20022 catalog_manager.cc:3863] CreateTable with IndexInfo is_unique: true indexed_table_id: "0000400000003000800000000000401e"
W0215 11:47:15.423270 20022 master_service_base-internal.h:45] Unknown master error in status: Already present (yb/master/ysql_tablegroup_manager.cc:141): Tablegroup { id: 00004000000030008000000000004008, db_id: 00004000000030008000000000000000, tablet_id: 388c93c5ba4441dea8cc5e3ad6766377, tables: [00004000000030008000000000004000, 00004000000030008000000000004001, 00004000000030008000000000004005, 00004000000030008000000000004006, 0000400000003000800000000000400b, 0000400000003000800000000000400c, 0000400000003000800000000000400d, 00004000000030008000000000004011, 00004000000030008000000000004013, 00004000000030008000000000004015, 00004000000030008000000000004016, 00004000000030008000000000004019, 0000400000003000800000000000401a, 0000400000003000800000000000401e, 0000400000003000800000000000401f, 00004000000030008000000000004024, 00004000000030008000000000004025, 00004000000030008000000000004026, 00004000000030008000000000004029, 0000400000003000800000000000402e, 0000400000003000800000000000402f, 00004000000030008000000000004030, 00004000000030008000000000004033, 00004000000030008000000000004037, 00004000000030008000000000004038, 0000400000003000800000000000403d, 0000400000003000800000000000403e, 0000400000003000800000000000403f, 00004000000030008000000000004042, 00004000000030008000000000004046, 00004000000030008000000000004047, 0000400000003000800000000000404c, 0000400000003000800000000000404d, 0000400000003000800000000000404e, 00004000000030008000000000004051, 00004000000030008000000000004055, 00004000000030008000000000004056, 00004000000030008000000000004059, 0000400000003000800000000000405b, 0000400000003000800000000000405d, 0000400000003000800000000000405f, 00004000000030008000000000004060, 00004000000030008000000000004064, 00004000000030008000000000004066, 00004000000030008000000000004068, 00004000000030008000000000004069, 0000400000003000800000000000406e, 0000400000003000800000000000406f, 00004000000030008000000000004070, 00004000000030008000000000004074, 00004000000030008000000000004076, 00004000000030008000000000004078, 00004000000030008000000000004079, 0000400000003000800000000000407e, 0000400000003000800000000000407f, 00004000000030008000000000004080, 00004000000030008000000000004083, 00004000000030008000000000004088, 00004000000030008000000000004089, 0000400000003000800000000000408a, 0000400000003000800000000000408d, 00004000000030008000000000004092, 00004000000030008000000000004093, 00004000000030008000000000004094, 00004000000030008000000000004097, 0000400000003000800000000000409c, 0000400000003000800000000000409d, 0000400000003000800000000000409e, 000040000000300080000000000040a1, 000040000000300080000000000040a5, 000040000000300080000000000040a6, 000040000000300080000000000040ab, 000040000000300080000000000040ac, 000040000000300080000000000040ad, 000040000000300080000000000040b1, 000040000000300080000000000040b3, 000040000000300080000000000040b4, 000040000000300080000000000040b7, 000040000000300080000000000040b9, 000040000000300080000000000040ba, 000040000000300080000000000040bd, 000040000000300080000000000040bf, 000040000000300080000000000040c0, 000040000000300080000000000040c5, 000040000000300080000000000040c6, 000040000000300080000000000040c7, 000040000000300080000000000040cb, 000040000000300080000000000040cc, 000040000000300080000000000040d1, 000040000000300080000000000040d2, 000040000000300080000000000040d3, 000040000000300080000000000040d7, 000040000000300080000000000040d9, 000040000000300080000000000040da, 000040000000300080000000000040df, 000040000000300080000000000040e0, 000040000000300080000000000040e1, 000040000000300080000000000040e5, 000040000000300080000000000040e9, 000040000000300080000000000040ea, 000040000000300080000000000040ec, 000040000000300080000000000040ee, 000040000000300080000000000040ef, 000040000000300080000000000040f1, 000040000000300080000000000040f3, 000040000000300080000000000040f4, 000040000000300080000000000040fa, 000040000000300080000000000040fe, 00004000000030008000000000004279, 0000400000003000800000000000427a, 0000400000003000800000000000427b, 0000400000003000800000000000427c, 0000400000003000800000000000427d, 0000400000003000800000000000427e, 0000400000003000800000000000427f, 00004000000030008000000000004280, 00004000000030008000000000004281, 00004000000030008000000000004282, 00004000000030008000000000004283, 00004000000030008000000000004284, 00004000000030008000000000004302, 00004000000030008000000000004305, 00004000000030008000000000004308, 0000400000003000800000000000430b, 0000400000003000800000000000430e, 00004000000030008000000000004311, 00004000000030008000000000004314, 00004000000030008000000000004317, 0000400000003000800000000000431a, 0000400000003000800000000000431d, 00004000000030008000000000004320, 00004000000030008000000000004323, 00004000000030008000000000004326, 00004000000030008000000000004329, 0000400000003000800000000000432c, 0000400000003000800000000000432f, 00004000000030008000000000004332, 00004000000030008000000000004335, 00004000000030008000000000004338, 0000400000003000800000000000433b, 0000400000003000800000000000433e, 00004000000030008000000000004341, 00004000000030008000000000004344, 00004000000030008000000000004347, 0000400000003000800000000000434a, 0000400000003000800000000000434d, 00004000000030008000000000004350, 00004000000030008000000000004353, 00004000000030008000000000004356, 00004000000030008000000000004359, 0000400000003000800000000000435c, 0000400000003000800000000000435f, 00004000000030008000000000004362, 00004000000030008000000000004365, 00004000000030008000000000004368, 0000400000003000800000000000436b, 0000400000003000800000000000436e, 00004000000030008000000000004371, 00004000000030008000000000004374, 00004000000030008000000000004377, 0000400000003000800000000000437a, 0000400000003000800000000000437d, 00004000000030008000000000004380, 00004000000030008000000000004383, 00004000000030008000000000004386, 00004000000030008000000000004389, 0000400000003000800000000000438c, 0000400000003000800000000000438f, 00004000000030008000000000004392, 00004000000030008000000000004395, 00004000000030008000000000004398, 0000400000003000800000000000439b, 0000400000003000800000000000439e, 000040000000300080000000000043a1, 000040000000300080000000000043a4, 000040000000300080000000000043a7, 000040000000300080000000000043aa, 000040000000300080000000000043ad, 000040000000300080000000000043b0, 000040000000300080000000000043b3, 000040000000300080000000000043b6, 000040000000300080000000000043b9, 000040000000300080000000000043bc, 000040000000300080000000000043bf, 000040000000300080000000000043c2, 000040000000300080000000000043c5, 000040000000300080000000000043c8, 000040000000300080000000000043cb, 000040000000300080000000000043ce, 000040000000300080000000000043d1, 000040000000300080000000000043d4, 000040000000300080000000000043d7, 000040000000300080000000000043da, 000040000000300080000000000043dd, 000040000000300080000000000043e0, 000040000000300080000000000043e3, 000040000000300080000000000043e6, 000040000000300080000000000043e9, 000040000000300080000000000043ec, 000040000000300080000000000043ef, 000040000000300080000000000043f2, 000040000000300080000000000043f5, 000040000000300080000000000043f8, 000040000000300080000000000043fb, 000040000000300080000000000043fe, 00004000000030008000000000004401, 00004000000030008000000000004404, 00004000000030008000000000004407, 0000400000003000800000000000440a, 0000400000003000800000000000440d, 00004000000030008000000000004410, 00004000000030008000000000004413, 00004000000030008000000000004416, 00004000000030008000000000004419, 0000400000003000800000000000441c, 0000400000003000800000000000441f, 00004000000030008000000000004422, 00004000000030008000000000004425, 00004000000030008000000000004426, 00004000000030008000000000004427, 00004000000030008000000000004428, 00004000000030008000000000004429, 0000400000003000800000000000442b, 0000400000003000800000000000442c, 0000400000003000800000000000442d, 0000400000003000800000000000442e, 0000400000003000800000000000442f, 00004000000030008000000000004430, 00004000000030008000000000004431] } already contains a table with ID 000040000000300080000000000040f4
rthallamko3 commented 1 year ago

@yifanguan , Is this being actively worked on? The QA team has been running into it across tests. cc @shishir2001-yb , @kripasreenivasan

pilshchikov commented 1 year ago

@rthallamko3 looks like we stopped to run into it on master. We planned to backport fixes in 2.18? Because it still failing there

yifanguan commented 1 year ago

@pilshchikov The actual fix for this issue hasn't landed yet. I suspect some other changes on master caused the issue to be bypassed but not solved.

yifanguan commented 1 year ago

Should be resolved by commit 8a3278d

rthallamko3 commented 11 months ago

Reactivating for backports to 2.18 to land.

myang2021 commented 11 months ago

[BACKPORT 2.18][#16130] YSQL: Introduce per-database PG new oid allocator 92ed992cd969