search

Tencent / TBase

TBase is an enterprise-level distributed HTAP database. Through a single database cluster to provide users with highly consistent distributed database services and high-performance data warehouse services, a set of integrated enterprise-level solutions is formed.
Other
1.38k stars 262 forks source link

gtm slave cannot not start #55

Open konglingkang123 opened 4 years ago

konglingkang123 commented 4 years ago

after I successfully start gtm,coor,dn,when i add a gtm slave whith command “add gtm slave s1 exnode1 18921 /data/gs” ，the gtm slave can not run(Not running: gtm slave)。

gtm slave log: 13:493893312:2020-06-19 20:13:40.760 CST -LOG: Connecting the GTM active on exnode1:19211... LOCATION: gtm_standby_connectToActiveGTM, gtm_standby.c:672 14:493893312:2020-06-19 20:13:40.762 CST -LOG: Connection established to the GTM active. LOCATION: gtm_standby_start_startup, gtm_standby.c:81 15:493893312:2020-06-19 20:13:40.762 CST -LOG: Standby GTM Startup connection established with active-GTM. LOCATION: main, main.c:1021 16:493893312:2020-06-19 20:13:40.762 CST -LOG: Starting GTM server at (*:18921) with syn storage LOCATION: main, main.c:1025 17:493893312:2020-06-19 20:13:41.092 CST -LOG: GTM_StoreStandbyInit backup file:gtm_kernel.map to gtm_kernel.backup. LOCATION: GTM_StoreStandbyInit, gtm_store.c:332 18:493893312:2020-06-19 20:13:42.951 CST -LOG: GTM Storage file VERSION:2.0, GTM VERSION:2.0 LOCATION: GTM_StoreCheckHeaderCRC, gtm_store.c:477 19:493893312:2020-06-19 20:13:42.951 CST -LOG: GTM_StoreStandbyInit file:gtm_kernel.map header CRC check succeed. LOCATION: GTM_StoreStandbyInit, gtm_store.c:374 20:493893312:2020-06-19 20:13:42.956 CST -LOG: GTM_StoreStandbyInit succeed, storage file:gtm_kernel.map. LOCATION: GTM_StoreStandbyInit, gtm_store.c:447 21:493893312:2020-06-19 20:13:42.967 CST -LOG: Get start replication at 0/400000,timeLine: 1 LOCATION: GTM_StoreStandbyInitFromMaster, gtm_standby.c:727 GTMPQgetResult() done. 22:493893312:2020-06-19 20:13:42.968 CST -LOG: Restoring gts to 4089377439

LOCATION: GTM_RestoreStoreInfo, main.c:5097 23:493893312:2020-06-19 20:13:42.968 CST -LOG: Restoring next/last gxid from the active-GTM succeeded. LOCATION: main, main.c:1082 24:493893312:2020-06-19 20:13:42.968 CST -LOG: Restoring all of gxid(s) from the active-GTM succeeded. LOCATION: main, main.c:1089 25:493893312:2020-06-19 20:13:42.968 CST -LOG: Restoring sequences from the active-GTM succeeded. LOCATION: main, main.c:1096 26:493893312:2020-06-19 20:13:42.968 CST -LOG: register standbyhostname exnode1, port number 18921 node name s1 datadir /data/gs LOCATION: gtm_standby_register_self, gtm_standby.c:321 27:493893312:2020-06-19 20:13:42.969 CST -LOG: Registering myself to the active-GTM as a GTM node succeeded. LOCATION: main, main.c:1216 28:493893312:2020-06-19 20:13:42.969 CST -LOG: Copying node information from the GTM active... LOCATION: gtm_standby_restore_node, gtm_standby.c:241 29:493893312:2020-06-19 20:13:42.969 CST -LOG: Recovery_PGXCNodeRegister Node info: type=5, nodename=s1, port=18921, datafolder=/data/gs, ipaddress=192.168.43.201, status=0 LOCATION: Recovery_PGXCNodeRegister, register_common.c:453 30:493893312:2020-06-19 20:13:42.969 CST -LOG: Recovery_PGXCNodeRegister Node info: type=5, nodename=gs, port=10201, datafolder=/data/gs, ipaddress=192.168.43.202, status=0 LOCATION: Recovery_PGXCNodeRegister, register_common.c:453 31:493893312:2020-06-19 20:13:42.969 CST -LOG: Copying node information from GTM active done. LOCATION: gtm_standby_restore_node, gtm_standby.c:270 32:493893312:2020-06-19 20:13:42.969 CST -LOG: Restoring node information from the active-GTM succeeded. LOCATION: main, main.c:1227 33:493893312:2020-06-19 20:13:42.970 CST -LOG: register standbyhostname exnode1, port number 18921 node name s1 datadir /data/gs LOCATION: gtm_standby_activate_self, gtm_standby.c:356 34:493893312:2020-06-19 20:13:42.970 CST -LOG: Updating the standby-GTM status as "CONNECTED" succeeded. LOCATION: main, main.c:1265 35:493893312:2020-06-19 20:13:42.970 CST -LOG: Started to run as GTM-Standby. LOCATION: main, main.c:1278 36:493893312:2020-06-19 20:13:43.042 CST -LOG: constant and nonstop TSC is available.

LOCATION: main, main.c:1312 37:493893312:2020-06-19 20:13:43.043 CST -LOG: Start sever loop start thread count 11 running thread count 11.

LOCATION: main, main.c:1480 1:1433167616:2020-06-19 20:13:43.044 CST -LOG: start redo thread from 0/4047C8 LOCATION: GTM_ThreadWalRedoer_Internal, gtm_xlog.c:1505 1:1428965120:2020-06-19 20:13:43.058 CST -LOG: checkpointer start. LOCATION: GTM_ThreadCheckPointer, main.c:2155 1:1431066368:2020-06-19 20:13:44.060 CST -LOG: Connecting the GTM active on exnode1:19211... LOCATION: gtm_standby_connectToActiveGTM, gtm_standby.c:672 2:1431066368:2020-06-19 20:13:44.060 CST -LOG: Connection established to the GTM active. LOCATION: gtm_standby_start_startup, gtm_standby.c:81 3:1431066368:2020-06-19 20:13:44.060 CST -LOG: register standbyhostname exnode1, port number 18921 node name s1 datadir /data/gs LOCATION: gtm_standby_register_self, gtm_standby.c:321 1:1426863872:2020-06-19 20:14:44.112 CST -LOG: IsValidXLogStatusFile 000000010000000000000002 2 LOCATION: IsValidXLogStatusFile, main.c:2419

gtm master log: 1:2364618496:2020-06-19 20:13:40.762 CST -LOG: GTM start backup local identifier:1592566328288537 local lsn:0 local gts:3789377439 remote identifier:1592566328288537, remote lsn:0, remote gts:3764350337 LOCATION: ProcessGTMBeginBackup, register_gtm.c:538 2:2364618496:2020-06-19 20:13:40.762 CST -LOG: GTM start backup local identifier:1592566328288537 local lsn:0 local gts:3789377439 remote identifier:1592566328288537, remote lsn:0, remote gts:3764350337 LOCATION: ProcessGTMBeginBackup, register_gtm.c:538 3:2364618496:2020-06-19 20:13:40.762 CST -LOG: GTM start backup succeed LOCATION: ProcessGTMBeginBackup, register_gtm.c:564 4:2364618496:2020-06-19 20:13:40.762 CST -LOG: GTM start backup succeed LOCATION: ProcessGTMBeginBackup, register_gtm.c:564 1:2398189312:2020-06-19 20:13:40.763 CST -LOG: mtype = MSG_GET_STORAGE (72). LOCATION: ProcessBasebackupCommand, main.c:3375 2:2398189312:2020-06-19 20:13:40.763 CST -LOG: mtype = MSG_GET_STORAGE (72). LOCATION: ProcessBasebackupCommand, main.c:3375 3:2398189312:2020-06-19 20:13:42.967 CST -LOG: mtype = MSG_TXN_GET_NEXT_GXID (42). LOCATION: ProcessBasebackupCommand, main.c:3375 4:2398189312:2020-06-19 20:13:42.967 CST -LOG: mtype = MSG_TXN_GET_NEXT_GXID (42). LOCATION: ProcessBasebackupCommand, main.c:3375 5:2398189312:2020-06-19 20:13:42.968 CST -LOG: mtype = MSG_NODE_REGISTER (2). LOCATION: ProcessBasebackupCommand, main.c:3375 6:2398189312:2020-06-19 20:13:42.968 CST -LOG: mtype = MSG_NODE_REGISTER (2). LOCATION: ProcessBasebackupCommand, main.c:3375 7:2398189312:2020-06-19 20:13:42.968 CST -LOG: Recovery_PGXCNodeRegister Node info: type=5, nodename=s1, port=18921, datafolder=/data/gs, ipaddress=192.168.43.201, status=1 LOCATION: Recovery_PGXCNodeRegister, register_common.c:453 8:2398189312:2020-06-19 20:13:42.968 CST -LOG: Recovery_PGXCNodeRegister Node info: type=5, nodename=s1, port=18921, datafolder=/data/gs, ipaddress=192.168.43.201, status=1 LOCATION: Recovery_PGXCNodeRegister, register_common.c:453 9:2398189312:2020-06-19 20:13:42.968 CST -LOG: Node with the given ID number already exists - s1 1:5 LOCATION: pgxcnode_add_info, register_common.c:270 10:2398189312:2020-06-19 20:13:42.968 CST -LOG: Node with the given ID number already exists - s1 1:5 LOCATION: pgxcnode_add_info, register_common.c:270 11:2398189312:2020-06-19 20:13:42.968 CST -LOG: gtm slave reconnected LOCATION: ProcessPGXCNodeRegister, register_gtm.c:193 12:2398189312:2020-06-19 20:13:42.968 CST -LOG: gtm slave reconnected LOCATION: ProcessPGXCNodeRegister, register_gtm.c:193 13:2398189312:2020-06-19 20:13:42.969 CST -LOG: mtype = MSG_NODE_LIST (9). LOCATION: ProcessBasebackupCommand, main.c:3375 14:2398189312:2020-06-19 20:13:42.969 CST -LOG: mtype = MSG_NODE_LIST (9). LOCATION: ProcessBasebackupCommand, main.c:3375 15:2398189312:2020-06-19 20:13:42.970 CST -LOG: mtype = MSG_NODE_UNREGISTER (4). LOCATION: ProcessBasebackupCommand, main.c:3375 16:2398189312:2020-06-19 20:13:42.970 CST -LOG: mtype = MSG_NODE_UNREGISTER (4). LOCATION: ProcessBasebackupCommand, main.c:3375 17:2398189312:2020-06-19 20:13:42.970 CST -LOG: Node:s1 host:192.168.43.201 port:18921 forder:/data/gs unregistered. LOCATION: Recovery_PGXCNodeUnregister, register_common.c:386 18:2398189312:2020-06-19 20:13:42.970 CST -LOG: Node:s1 host:192.168.43.201 port:18921 forder:/data/gs unregistered. LOCATION: Recovery_PGXCNodeUnregister, register_common.c:386 19:2398189312:2020-06-19 20:13:42.970 CST -LOG: mtype = MSG_NODE_REGISTER (2). LOCATION: ProcessBasebackupCommand, main.c:3375 20:2398189312:2020-06-19 20:13:42.970 CST -LOG: mtype = MSG_NODE_REGISTER (2). LOCATION: ProcessBasebackupCommand, main.c:3375 21:2398189312:2020-06-19 20:13:42.970 CST -LOG: Recovery_PGXCNodeRegister Node info: type=5, nodename=s1, port=18921, datafolder=/data/gs, ipaddress=192.168.43.201, status=0 LOCATION: Recovery_PGXCNodeRegister, register_common.c:453 22:2398189312:2020-06-19 20:13:42.970 CST -LOG: Recovery_PGXCNodeRegister Node info: type=5, nodename=s1, port=18921, datafolder=/data/gs, ipaddress=192.168.43.201, status=0 LOCATION: Recovery_PGXCNodeRegister, register_common.c:453 23:2398189312:2020-06-19 20:13:42.970 CST -LOG: mtype = MSG_END_BACKUP (13). LOCATION: ProcessBasebackupCommand, main.c:3375 24:2398189312:2020-06-19 20:13:42.970 CST -LOG: mtype = MSG_END_BACKUP (13). LOCATION: ProcessBasebackupCommand, main.c:3375 25:2398189312:2020-06-19 20:13:42.970 CST -LOG: GTM end backup LOCATION: ProcessGTMEndBackup, register_gtm.c:588 26:2398189312:2020-06-19 20:13:42.970 CST -LOG: GTM end backup LOCATION: ProcessGTMEndBackup, register_gtm.c:588 27:2398189312:2020-06-19 20:13:42.970 CST -LOG: GTM end backup complete LOCATION: ProcessGTMEndBackup, register_gtm.c:616 28:2398189312:2020-06-19 20:13:42.970 CST -LOG: GTM end backup complete LOCATION: ProcessGTMEndBackup, register_gtm.c:616 29:2398189312:2020-06-19 20:13:42.981 CST -LOG: invalid message LOCATION: GTM_ThreadBasebackup, main.c:3354 30:2398189312:2020-06-19 20:13:42.981 CST -LOG: invalid message LOCATION: GTM_ThreadBasebackup, main.c:3354 1:2364618496:2020-06-19 20:13:44.061 CST -LOG: Recovery_PGXCNodeRegister Node info: type=5, nodename=s1, port=18921, datafolder=/data/gs, ipaddress=192.168.43.201, status=1 LOCATION: Recovery_PGXCNodeRegister, register_common.c:453 2:2364618496:2020-06-19 20:13:44.061 CST -LOG: Recovery_PGXCNodeRegister Node info: type=5, nodename=s1, port=18921, datafolder=/data/gs, ipaddress=192.168.43.201, status=1 LOCATION: Recovery_PGXCNodeRegister, register_common.c:453 3:2364618496:2020-06-19 20:13:44.061 CST -LOG: Node with the given ID number already exists - s1 1:5 LOCATION: pgxcnode_add_info, register_common.c:270 4:2364618496:2020-06-19 20:13:44.061 CST -LOG: Node with the given ID number already exists - s1 1:5 LOCATION: pgxcnode_add_info, register_common.c:270 5:2364618496:2020-06-19 20:13:44.061 CST -LOG: gtm slave reconnected LOCATION: ProcessPGXCNodeRegister, register_gtm.c:193 6:2364618496:2020-06-19 20:13:44.061 CST -LOG: gtm slave reconnected LOCATION: ProcessPGXCNodeRegister, register_gtm.c:193 7:2364618496:2020-06-19 20:13:44.061 CST -LOG: replication exnode1:18921 connected LOCATION: ProcessStartReplicationCommand, gtm_xlog.c:647 8:2364618496:2020-06-19 20:13:44.061 CST -LOG: replication exnode1:18921 connected LOCATION: ProcessStartReplicationCommand, gtm_xlog.c:647 1:2356225792:2020-06-19 20:13:44.147 CST -LOG: Acquire one standby exnode1:18921 LOCATION: GTM_ThreadWalSender, main.c:2283

q2683252 commented 4 years ago

It's running according the log. Please provide gtm log for both master and slave.