search

codership / galera

Synchronous multi-master replication library
GNU General Public License v2.0
451 stars 176 forks source link

The joining node kick out the donor node off the cluster during SST/IST #623

Open houndegnonm opened 2 years ago

houndegnonm commented 2 years ago

I have 3 Percona Galera XtraDB Cluster with 3 nodes pexgal001-dev3 pexgal002-dev3 pexgal003-dev3

version of the server

root@pexgal001-dev3:/var/lib/mysql-pexgal001/logs# dpkg --list | grep -i percona
ii  percona-xtrabackup-24                 2.4.26-1.focal                    amd64        Open source backup tool for InnoDB and XtraDB
ii  percona-xtradb-cluster-client-5.7     5.7.31-31.45-3.focal              amd64        Percona XtraDB Cluster database client binaries
ii  percona-xtradb-cluster-common-5.7     5.7.31-31.45-3.focal              amd64        Percona XtraDB Cluster database common files (e.g. /etc/mysql/my.cnf)
ii  percona-xtradb-cluster-server-5.7     5.7.31-31.45-3.focal              amd64        Percona XtraDB Cluster database server binaries

When trying to shutdown a specific node by example pexgal001-dev3, pexgal002/3 respectively detect the node is out of the cluster and behave as designed, but when pexgal001-dev3 is now up again this caused a split brain situation between the donor (pexgal003-dev3) and the joining node (pexgal001-dev3) leaving only 1 node up and running in the cluster (pexgal002-dev3)

Here is the full log of pexgal002-dev3 and pexgal003-dev3 (donor) when the joining pexgal001-dev3 node is down and then up.

###### pexgal002-dev3 error log ###### 
######                          ###### 
######                          ###### 

###### When stopping pexgal001-dev3
2022-08-12T17:39:05.458404Z 0 [Note] WSREP: declaring cfa5fea8 at tcp://192.168.170.143:4567 stable
2022-08-12T17:39:05.458495Z 0 [Note] WSREP: forgetting f5d705fe (tcp://192.168.170.141:4567)
2022-08-12T17:39:05.459191Z 0 [Note] WSREP: Node 67c46602 state primary
2022-08-12T17:39:05.459468Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,67c46602,42)
memb {
        67c46602,0
        cfa5fea8,0
        }
joined {
        }
left {
        }
partitioned {
        f5d705fe,0
        }
)
2022-08-12T17:39:05.459493Z 0 [Note] WSREP: Save the discovered primary-component to disk
2022-08-12T17:39:05.460743Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2
2022-08-12T17:39:05.460840Z 0 [Note] WSREP: forgetting f5d705fe (tcp://192.168.170.141:4567)
2022-08-12T17:39:05.461012Z 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a9691181-1a65-11ed-b29a-efd09340cd08
2022-08-12T17:39:05.463488Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a9691181-1a65-11ed-b29a-efd09340cd08
2022-08-12T17:39:05.463818Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: a9691181-1a65-11ed-b29a-efd09340cd08 from 0 (pexgal002-dev3)
2022-08-12T17:39:05.463855Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: a9691181-1a65-11ed-b29a-efd09340cd08 from 1 (pexgal003-dev3)
2022-08-12T17:39:05.463865Z 0 [Note] WSREP: Quorum results:
        version    = 6,
        component  = PRIMARY,
        conf_id    = 4,
        members    = 2/2 (primary/total),
        act_id     = 2249383,
        last_appl. = 2249281,
        protocols  = 0/9/3 (gcs/repl/appl),
        group UUID = 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4
2022-08-12T17:39:05.463897Z 0 [Note] WSREP: Flow-control interval: [2896, 2896]
2022-08-12T17:39:05.464016Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:39:05.464232Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:39:05.464327Z 4 [Note] WSREP: New cluster view: global state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383, view# 5: Primary, number of nodes: 2, my index: 0, protocol version 3
2022-08-12T17:39:05.464386Z 4 [Note] WSREP: Setting wsrep_ready to true
2022-08-12T17:39:05.464439Z 4 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 1 -> 1) (Increment: 3 -> 2)
2022-08-12T17:39:05.464518Z 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-08-12T17:39:05.464822Z 4 [Note] WSREP: Assign initial position for certification: 2249383, protocol version: 4
2022-08-12T17:39:05.464983Z 0 [Note] WSREP: Service thread queue flushed.
2022-08-12T17:39:10.472899Z 0 [Note] WSREP:  cleaning up f5d705fe (tcp://192.168.170.141:4567)

###### When starting pexgal001-dev3

2022-08-12T17:42:03.229785Z 0 [Note] WSREP: (67c46602, 'tcp://0.0.0.0:4567') connection established to 135e2e5d tcp://192.168.170.141:4567
2022-08-12T17:42:03.230100Z 0 [Note] WSREP: (67c46602, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2022-08-12T17:42:03.487024Z 0 [Note] WSREP: declaring 135e2e5d at tcp://192.168.170.141:4567 stable
2022-08-12T17:42:03.487143Z 0 [Note] WSREP: declaring cfa5fea8 at tcp://192.168.170.143:4567 stable
2022-08-12T17:42:03.487575Z 0 [Note] WSREP: Node 67c46602 state primary
2022-08-12T17:42:03.487967Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,135e2e5d,43)
memb {
    135e2e5d,0
    67c46602,0
    cfa5fea8,0
    }
joined {
    }
left {
    }
partitioned {
    }
)
2022-08-12T17:42:03.487989Z 0 [Note] WSREP: Save the discovered primary-component to disk
2022-08-12T17:42:03.489459Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3
2022-08-12T17:42:03.489576Z 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2022-08-12T17:42:03.730225Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff
2022-08-12T17:42:03.730707Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 0 (pexgal001-dev3)
2022-08-12T17:42:03.730778Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 1 (pexgal002-dev3)
2022-08-12T17:42:03.730857Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 2 (pexgal003-dev3)
2022-08-12T17:42:03.730928Z 0 [Note] WSREP: Quorum results:
    version    = 6,
    component  = PRIMARY,
    conf_id    = 5,
    members    = 2/3 (primary/total),
    act_id     = 2249393,
    last_appl. = 2249281,
    protocols  = 0/9/3 (gcs/repl/appl),
    group UUID = 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4
2022-08-12T17:42:03.730962Z 0 [Note] WSREP: Flow-control interval: [3547, 3547]
2022-08-12T17:42:03.731108Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:03.731147Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:03.731204Z 4 [Note] WSREP: New cluster view: global state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249393, view# 6: Primary, number of nodes: 3, my index: 1, protocol version 3
2022-08-12T17:42:03.731260Z 4 [Note] WSREP: Setting wsrep_ready to true
2022-08-12T17:42:03.731296Z 4 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 1 -> 2) (Increment: 2 -> 3)
2022-08-12T17:42:03.731325Z 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-08-12T17:42:03.731408Z 4 [Note] WSREP: Assign initial position for certification: 2249393, protocol version: 4
2022-08-12T17:42:03.731511Z 0 [Note] WSREP: Service thread queue flushed.
2022-08-12T17:42:06.278837Z 0 [Note] WSREP: Member 0.0 (pexgal001-dev3) requested state transfer from '*any*'. Selected 2.0 (pexgal003-dev3)(SYNCED) as donor.
2022-08-12T17:42:06.516975Z 0 [Note] WSREP: (67c46602, 'tcp://0.0.0.0:4567') turning message relay requesting off
2022-08-12T17:42:08.369352Z 0 [Note] WSREP: 2.0 (pexgal003-dev3): State transfer to 0.0 (pexgal001-dev3) complete.
2022-08-12T17:42:08.369881Z 0 [Note] WSREP: Member 2.0 (pexgal003-dev3) synced with group.
2022-08-12T17:42:16.284726Z 0 [Note] WSREP: declaring 135e2e5d at tcp://192.168.170.141:4567 stable
2022-08-12T17:42:16.284905Z 0 [Note] WSREP: forgetting cfa5fea8 (tcp://192.168.170.143:4567)
2022-08-12T17:42:16.285713Z 0 [Note] WSREP: Node 135e2e5d state primary
2022-08-12T17:42:16.288477Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,135e2e5d,44)
memb {
    135e2e5d,0
    67c46602,0
    }
joined {
    }
left {
    }
partitioned {
    cfa5fea8,0
    }
)
2022-08-12T17:42:16.288561Z 0 [Note] WSREP: Save the discovered primary-component to disk
2022-08-12T17:42:16.289634Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2022-08-12T17:42:16.289695Z 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2022-08-12T17:42:16.289737Z 0 [Note] WSREP: forgetting cfa5fea8 (tcp://192.168.170.143:4567)
2022-08-12T17:42:16.290193Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 1b2706f6-1a66-11ed-9fae-7fc396c0da36
2022-08-12T17:42:16.290483Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 1b2706f6-1a66-11ed-9fae-7fc396c0da36 from 0 (pexgal001-dev3)
2022-08-12T17:42:16.290568Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 1b2706f6-1a66-11ed-9fae-7fc396c0da36 from 1 (pexgal002-dev3)
2022-08-12T17:42:16.290600Z 0 [Note] WSREP: Quorum results:
    version    = 6,
    component  = PRIMARY,
    conf_id    = 6,
    members    = 1/2 (primary/total),
    act_id     = 2249393,
    last_appl. = 2249281,
    protocols  = 0/9/3 (gcs/repl/appl),
    group UUID = 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4
2022-08-12T17:42:16.290644Z 0 [Note] WSREP: Flow-control interval: [2896, 2896]
2022-08-12T17:42:16.290712Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:16.290774Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:16.290804Z 4 [Note] WSREP: New cluster view: global state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249393, view# 7: Primary, number of nodes: 2, my index: 1, protocol version 3
2022-08-12T17:42:16.290823Z 4 [Note] WSREP: Setting wsrep_ready to true
2022-08-12T17:42:16.290841Z 4 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 2 -> 2) (Increment: 3 -> 2)
2022-08-12T17:42:16.290892Z 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-08-12T17:42:16.290950Z 4 [Note] WSREP: Assign initial position for certification: 2249393, protocol version: 4
2022-08-12T17:42:16.291011Z 0 [Note] WSREP: Service thread queue flushed.
2022-08-12T17:42:21.521764Z 0 [Note] WSREP:  cleaning up cfa5fea8 (tcp://192.168.170.143:4567)
###### pexgal003-dev3 error log ###### 
######                          ###### 
######                          ###### 

###### When stopping pexgal001-dev3

2022-08-12T17:39:05.458758Z 0 [Note] WSREP: declaring 67c46602 at tcp://192.168.170.142:4567 stable
2022-08-12T17:39:05.458876Z 0 [Note] WSREP: forgetting f5d705fe (tcp://192.168.170.141:4567)
2022-08-12T17:39:05.459240Z 0 [Note] WSREP: Node 67c46602 state primary
2022-08-12T17:39:05.461236Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,67c46602,42)
memb {
    67c46602,0
    cfa5fea8,0
    }
joined {
    }
left {
    }
partitioned {
    f5d705fe,0
    }
)
2022-08-12T17:39:05.461260Z 0 [Note] WSREP: Save the discovered primary-component to disk
2022-08-12T17:39:05.463141Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2022-08-12T17:39:05.463163Z 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2022-08-12T17:39:05.463179Z 0 [Note] WSREP: forgetting f5d705fe (tcp://192.168.170.141:4567)
2022-08-12T17:39:05.463683Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a9691181-1a65-11ed-b29a-efd09340cd08
2022-08-12T17:39:05.464056Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: a9691181-1a65-11ed-b29a-efd09340cd08 from 0 (pexgal002-dev3)
2022-08-12T17:39:05.464079Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: a9691181-1a65-11ed-b29a-efd09340cd08 from 1 (pexgal003-dev3)
2022-08-12T17:39:05.464090Z 0 [Note] WSREP: Quorum results:
    version    = 6,
    component  = PRIMARY,
    conf_id    = 4,
    members    = 2/2 (primary/total),
    act_id     = 2249383,
    last_appl. = 2249281,
    protocols  = 0/9/3 (gcs/repl/appl),
    group UUID = 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4
2022-08-12T17:39:05.464098Z 0 [Note] WSREP: Flow-control interval: [2896, 2896]
2022-08-12T17:39:05.464140Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:39:05.464147Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:39:05.464154Z 4 [Note] WSREP: New cluster view: global state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383, view# 5: Primary, number of nodes: 2, my index: 1, protocol version 3
2022-08-12T17:39:05.464166Z 4 [Note] WSREP: Setting wsrep_ready to true
2022-08-12T17:39:05.464171Z 4 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 2 -> 2) (Increment: 3 -> 2)
2022-08-12T17:39:05.464203Z 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-08-12T17:39:05.464490Z 4 [Note] WSREP: Assign initial position for certification: 2249383, protocol version: 4
2022-08-12T17:39:05.464604Z 0 [Note] WSREP: Service thread queue flushed.
2022-08-12T17:39:10.899384Z 0 [Note] WSREP:  cleaning up f5d705fe (tcp://192.168.170.141:4567)

###### When starting pexgal001-dev3

2022-08-12T17:42:03.229836Z 0 [Note] WSREP: (cfa5fea8, 'tcp://0.0.0.0:4567') connection established to 135e2e5d tcp://192.168.170.141:4567
2022-08-12T17:42:03.230197Z 0 [Note] WSREP: (cfa5fea8, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2022-08-12T17:42:03.487025Z 0 [Note] WSREP: declaring 135e2e5d at tcp://192.168.170.141:4567 stable
2022-08-12T17:42:03.487196Z 0 [Note] WSREP: declaring 67c46602 at tcp://192.168.170.142:4567 stable
2022-08-12T17:42:03.487562Z 0 [Note] WSREP: Node 67c46602 state primary
2022-08-12T17:42:03.487971Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,135e2e5d,43)
memb {
    135e2e5d,0
    67c46602,0
    cfa5fea8,0
    }
joined {
    }
left {
    }
partitioned {
    }
)
2022-08-12T17:42:03.488022Z 0 [Note] WSREP: Save the discovered primary-component to disk
2022-08-12T17:42:03.489881Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2022-08-12T17:42:03.489904Z 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2022-08-12T17:42:03.730260Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff
2022-08-12T17:42:03.730846Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 0 (pexgal001-dev3)
2022-08-12T17:42:03.730862Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 1 (pexgal002-dev3)
2022-08-12T17:42:03.730867Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 2 (pexgal003-dev3)
2022-08-12T17:42:03.730872Z 0 [Note] WSREP: Quorum results:
    version    = 6,
    component  = PRIMARY,
    conf_id    = 5,
    members    = 2/3 (primary/total),
    act_id     = 2249393,
    last_appl. = 2249281,
    protocols  = 0/9/3 (gcs/repl/appl),
    group UUID = 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4
2022-08-12T17:42:03.730879Z 0 [Note] WSREP: Flow-control interval: [3547, 3547]
2022-08-12T17:42:03.730974Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:03.731015Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:03.731033Z 4 [Note] WSREP: New cluster view: global state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249393, view# 6: Primary, number of nodes: 3, my index: 2, protocol version 3
2022-08-12T17:42:03.731048Z 4 [Note] WSREP: Setting wsrep_ready to true
2022-08-12T17:42:03.731072Z 4 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 2 -> 3) (Increment: 2 -> 3)
2022-08-12T17:42:03.731092Z 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-08-12T17:42:03.731161Z 4 [Note] WSREP: Assign initial position for certification: 2249393, protocol version: 4
2022-08-12T17:42:03.731233Z 0 [Note] WSREP: Service thread queue flushed.
2022-08-12T17:42:06.278904Z 0 [Note] WSREP: Member 0.0 (pexgal001-dev3) requested state transfer from '*any*'. Selected 2.0 (pexgal003-dev3)(SYNCED) as donor.
2022-08-12T17:42:06.278953Z 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 2249393)
2022-08-12T17:42:06.279191Z 4 [Note] WSREP: IST request: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383-2249393|tcp://192.168.170.141:4568
2022-08-12T17:42:06.279208Z 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-08-12T17:42:06.279410Z 0 [Note] WSREP: Initiating SST/IST transfer on DONOR side (wsrep_sst_xtrabackup-v2 --role 'donor' --address '192.168.170.141:4444/xtrabackup_sst//1' --socket '/var/lib/mysql-pexgal003/run/mysql.sock' --datadir '/var/lib/mysql-pexgal003/myisam/data/' --defaults-file '/var/lib/mysql-pexgal003/my.cnf-master' --defaults-group-suffix '' --mysqld-version '5.7.31-34-57'  --binlog '/var/lib/mysql-pexgal003/binlogs/pexgal003-bin' --gtid '7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383'  --bypass)
2022-08-12T17:42:06.279989Z 4 [Note] WSREP: DONOR thread signaled with 0
2022-08-12T17:42:06.280342Z 4 [ERROR] WSREP: context: unable to load ssl3 md5 routines
2022-08-12T17:42:06.280355Z 4 [Note] WSREP: applier thread exiting (code:8)
2022-08-12T17:42:06.280369Z 4 [Note] WSREP: Starting Shutdown
2022-08-12T17:42:06.280476Z 0 [Note] WSREP: Received shutdown signal. Will sleep for 10 secs before initiating shutdown. pxc_maint_mode switched to SHUTDOWN
2022-08-12T17:42:06.440009Z 0 [Note] WSREP: (cfa5fea8, 'tcp://0.0.0.0:4567') turning message relay requesting off
    2022-08-12T17:42:08.168411Z WSREP_SST: [INFO] Streaming with xbstream
    2022-08-12T17:42:08.279961Z WSREP_SST: [INFO] Bypassing SST. Can work it through IST
2022-08-12T17:42:08.369360Z 0 [Note] WSREP: 2.0 (pexgal003-dev3): State transfer to 0.0 (pexgal001-dev3) complete.
2022-08-12T17:42:08.369400Z 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 2249393)
2022-08-12T17:42:08.369872Z 0 [Note] WSREP: Member 2.0 (pexgal003-dev3) synced with group.
2022-08-12T17:42:08.369890Z 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2249393)
2022-08-12T17:42:16.282955Z 0 [Note] WSREP: Stop replication
2022-08-12T17:42:16.283053Z 0 [Note] WSREP: Closing send monitor...
2022-08-12T17:42:16.283079Z 0 [Note] WSREP: Closed send monitor.
2022-08-12T17:42:16.283132Z 0 [Note] WSREP: gcomm: terminating thread
2022-08-12T17:42:16.283184Z 0 [Note] WSREP: gcomm: joining thread
2022-08-12T17:42:16.283299Z 0 [Note] WSREP: gcomm: closing backend
2022-08-12T17:42:16.284403Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(NON_PRIM,135e2e5d,43)
memb {
    cfa5fea8,0
    }
joined {
    }
left {
    }
partitioned {
    135e2e5d,0
    67c46602,0
    }
)
2022-08-12T17:42:16.284617Z 0 [Note] WSREP: Current view of cluster as seen by this node
view ((empty))
2022-08-12T17:42:16.284902Z 0 [Note] WSREP: gcomm: closed
2022-08-12T17:42:16.284984Z 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
2022-08-12T17:42:16.285007Z 0 [Note] WSREP: Flow-control interval: [2048, 2048]
2022-08-12T17:42:16.285011Z 0 [Note] WSREP: Received NON-PRIMARY.
2022-08-12T17:42:16.285014Z 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 2249393)
2022-08-12T17:42:16.285020Z 0 [Note] WSREP: Received self-leave message.
2022-08-12T17:42:16.285024Z 0 [Note] WSREP: Flow-control interval: [0, 0]
2022-08-12T17:42:16.285026Z 0 [Note] WSREP: Received SELF-LEAVE. Closing connection.
2022-08-12T17:42:16.285028Z 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 2249393)
2022-08-12T17:42:16.285034Z 0 [Note] WSREP: RECV thread exiting 0: Success
2022-08-12T17:42:16.285070Z 0 [Note] WSREP: recv_thread() joined.
2022-08-12T17:42:16.285090Z 0 [Note] WSREP: Closing replication queue.
2022-08-12T17:42:16.285189Z 0 [Note] WSREP: Closing slave action queue.
2022-08-12T17:42:16.285213Z 0 [Note] WSREP: Waiting for active wsrep applier to exit
###### pexgal001-dev3 error log ###### 
######                          ###### 
######                          ###### 

###### When starting pexgal001-dev3
2022-08-12T17:42:03.205940Z 0 [Warning] The syntax '--log_warnings/-W' is deprecated and will be removed in a future release. Please use '--log_error_verbosity' instead.
2022-08-12T17:42:03.206113Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
2022-08-12T17:42:03.206122Z 0 [Warning] 'NO_AUTO_CREATE_USER' sql mode was not set.
2022-08-12T17:42:03.207915Z 0 [Warning] Insecure configuration for --secure-file-priv: Data directory is accessible through --secure-file-priv. Consider choosing a different directory.
2022-08-12T17:42:03.207923Z 0 [Warning] Insecure configuration for --secure-file-priv: Location is accessible to all OS users. Consider choosing a different directory.
2022-08-12T17:42:03.207995Z 0 [Note] /usr/sbin/mysqld (mysqld 5.7.31-34-57-log) starting as process 1979695 ...
2022-08-12T17:42:03.210869Z 0 [Note] WSREP: Setting wsrep_ready to false
2022-08-12T17:42:03.210882Z 0 [Note] WSREP: No pre-stored wsrep-start position found. Skipping position initialization.
2022-08-12T17:42:03.210885Z 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera3/libgalera_smm.so'
2022-08-12T17:42:03.211422Z 0 [Note] WSREP: wsrep_load(): Galera 3.45(ra60e019) by Codership Oy <info@codership.com> loaded successfully.
2022-08-12T17:42:03.211472Z 0 [Note] WSREP: CRC-32C: using hardware acceleration.
2022-08-12T17:42:03.211734Z 0 [Note] WSREP: Found saved state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383, safe_to_bootstrap: 0
2022-08-12T17:42:03.211816Z 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4, offset: 1280
2022-08-12T17:42:03.211883Z 0 [Note] WSREP: GCache::RingBuffer initial scan...  0.0% (         0/5368709160 bytes) complete.
2022-08-12T17:42:03.212007Z 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (5368709160/5368709160 bytes) complete.
2022-08-12T17:42:03.212013Z 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 2249155-2249383
2022-08-12T17:42:03.212029Z 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...  0.0% (     0/147632 bytes) complete.
2022-08-12T17:42:03.212037Z 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (147632/147632 bytes) complete.
2022-08-12T17:42:03.212041Z 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): found 0/229 locked buffers
2022-08-12T17:42:03.212044Z 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): free space: 5368561488/5368709120
2022-08-12T17:42:03.213176Z 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql-pexgal001/myisam/data/; base_host = 192.168.170.141; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 10; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 4; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql-pexgal001/myisam/data/; gcache.freeze_purge_at_seqno = -1; gcache.keep_pages_count = 0; gcache.keep_pages_size = 512M; gcache.mem_size = 0; gcache.name = /var/lib/mysql-pexgal001/myisam/data//galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 5G; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 2048; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignore_quorum = false; pc.ignore_sb = false; pc.npvo = false; pc.recovery = true; pc.version = 0; pc.wait_prim = true; pc.wait_prim_timeout = PT30S; pc.weight = 1; protonet.backend = asio; protonet.version = 0; repl.causal_read_timeout = PT30S; repl.commit_order = 3; repl.key_format = FLAT8; repl.max_ws_size = 2147483647; repl.proto_max = 9; socket.checksum = 2; socket.recv_buf_size = auto; socket.send_buf_size = auto;
2022-08-12T17:42:03.227503Z 0 [Note] WSREP: Assign initial position for certification: 2249383, protocol version: -1
2022-08-12T17:42:03.227542Z 0 [Note] WSREP: Preparing to initiate SST/IST
2022-08-12T17:42:03.227547Z 0 [Note] WSREP: Starting replication
2022-08-12T17:42:03.227554Z 0 [Note] WSREP: Setting initial position to 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383
2022-08-12T17:42:03.227717Z 0 [Note] WSREP: Using CRC-32C for message checksums.
2022-08-12T17:42:03.227819Z 0 [Note] WSREP: gcomm thread scheduling priority set to other:0
2022-08-12T17:42:03.227888Z 0 [Warning] WSREP: Fail to access the file (/var/lib/mysql-pexgal001/myisam/data//gvwstate.dat) error (No such file or directory). It is possible if node is booting for first time or re-booting after a graceful shutdown
2022-08-12T17:42:03.227894Z 0 [Note] WSREP: Restoring primary-component from disk failed. Either node is booting for first time or re-booting after a graceful shutdown
2022-08-12T17:42:03.228045Z 0 [Note] WSREP: GMCast version 0
2022-08-12T17:42:03.228168Z 0 [Note] WSREP: (135e2e5d, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
2022-08-12T17:42:03.228174Z 0 [Note] WSREP: (135e2e5d, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
2022-08-12T17:42:03.228379Z 0 [Note] WSREP: EVS version 0
2022-08-12T17:42:03.228450Z 0 [Note] WSREP: gcomm: connecting to group 'pexgal3', peer '192.168.170.141:,192.168.170.142:,192.168.170.143:'
2022-08-12T17:42:03.229050Z 0 [Note] WSREP: (135e2e5d, 'tcp://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address tcp://192.168.170.141:4567
2022-08-12T17:42:03.230006Z 0 [Note] WSREP: (135e2e5d, 'tcp://0.0.0.0:4567') connection established to cfa5fea8 tcp://192.168.170.143:4567
2022-08-12T17:42:03.230071Z 0 [Note] WSREP: (135e2e5d, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2022-08-12T17:42:03.230156Z 0 [Note] WSREP: (135e2e5d, 'tcp://0.0.0.0:4567') connection established to 67c46602 tcp://192.168.170.142:4567
2022-08-12T17:42:03.486959Z 0 [Note] WSREP: declaring 67c46602 at tcp://192.168.170.142:4567 stable
2022-08-12T17:42:03.486991Z 0 [Note] WSREP: declaring cfa5fea8 at tcp://192.168.170.143:4567 stable
2022-08-12T17:42:03.487535Z 0 [Note] WSREP: Node 67c46602 state primary
2022-08-12T17:42:03.487932Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,135e2e5d,43)
memb {
        135e2e5d,0
        67c46602,0
        cfa5fea8,0
        }
joined {
        }
left {
        }
partitioned {
        }
)
2022-08-12T17:42:03.487944Z 0 [Note] WSREP: Save the discovered primary-component to disk
2022-08-12T17:42:03.729040Z 0 [Note] WSREP: gcomm: connected
2022-08-12T17:42:03.729263Z 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
2022-08-12T17:42:03.729308Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
2022-08-12T17:42:03.729393Z 0 [Note] WSREP: Waiting for SST/IST to complete.
2022-08-12T17:42:03.729511Z 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 13aab0e4-1a66-11ed-932b-ca9da6b99eff
2022-08-12T17:42:03.730198Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff
2022-08-12T17:42:03.730655Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 0 (pexgal001-dev3)
2022-08-12T17:42:03.730674Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 1 (pexgal002-dev3)
2022-08-12T17:42:03.730678Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 2 (pexgal003-dev3)
2022-08-12T17:42:03.730684Z 0 [Note] WSREP: Quorum results:
        version    = 6,
        component  = PRIMARY,
        conf_id    = 5,
        members    = 2/3 (primary/total),
        act_id     = 2249393,
        last_appl. = -1,
        protocols  = 0/9/3 (gcs/repl/appl),
        group UUID = 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4
2022-08-12T17:42:03.730689Z 0 [Note] WSREP: Flow-control interval: [3547, 3547]
2022-08-12T17:42:03.730693Z 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 2249393)
2022-08-12T17:42:03.730768Z 1 [Note] WSREP: State transfer required:
        Group state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249393
        Local state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383
2022-08-12T17:42:03.730800Z 1 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:03.730810Z 1 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:03.730820Z 1 [Note] WSREP: New cluster view: global state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249393, view# 6: Primary, number of nodes: 3, my index: 0, protocol version 3
2022-08-12T17:42:03.730824Z 1 [Note] WSREP: Setting wsrep_ready to true
2022-08-12T17:42:03.730827Z 1 [Warning] WSREP: Gap in state sequence. Need state transfer.
2022-08-12T17:42:03.730829Z 1 [Note] WSREP: Setting wsrep_ready to false
2022-08-12T17:42:03.730918Z 0 [Note] WSREP: Initiating SST/IST transfer on JOINER side (wsrep_sst_xtrabackup-v2 --role 'joiner' --address '192.168.170.141' --datadir '/var/lib/mysql-pexgal001/myisam/data/' --defaults-file '/var/lib/mysql-pexgal001/my.cnf-master' --defaults-group-suffix '' --parent '1979695' --mysqld-version '5.7.31-34-57'  --binlog '/var/lib/mysql-pexgal001/binlogs/pexgal001-bin' )
        2022-08-12T17:42:05.544041Z WSREP_SST: [INFO] Streaming with xbstream
2022-08-12T17:42:06.230408Z 0 [Note] WSREP: (135e2e5d, 'tcp://0.0.0.0:4567') turning message relay requesting off
2022-08-12T17:42:06.276896Z 1 [Note] WSREP: Prepared SST/IST request: xtrabackup-v2|192.168.170.141:4444/xtrabackup_sst//1
2022-08-12T17:42:06.276922Z 1 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 1 -> 1) (Increment: 1 -> 3)
2022-08-12T17:42:06.276948Z 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-08-12T17:42:06.276970Z 1 [Note] WSREP: Assign initial position for certification: 2249393, protocol version: 4
2022-08-12T17:42:06.277008Z 0 [Note] WSREP: Service thread queue flushed.
2022-08-12T17:42:06.277023Z 1 [Note] WSREP: Check if state gap can be serviced using IST
2022-08-12T17:42:06.277090Z 1 [Note] WSREP: IST receiver addr using tcp://192.168.170.141:4568
2022-08-12T17:42:06.277244Z 1 [Note] WSREP: Prepared IST receiver, listening at: tcp://192.168.170.141:4568
2022-08-12T17:42:06.277254Z 1 [Note] WSREP: State gap can be likely serviced using IST. SST request though present would be void.
2022-08-12T17:42:06.278732Z 0 [Note] WSREP: Member 0.0 (pexgal001-dev3) requested state transfer from '*any*'. Selected 2.0 (pexgal003-dev3)(SYNCED) as donor.
2022-08-12T17:42:06.278742Z 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 2249393)
2022-08-12T17:42:06.278758Z 1 [Note] WSREP: Requesting state transfer: success, donor: 2
2022-08-12T17:42:06.278782Z 1 [Note] WSREP: GCache history reset: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383 -> 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249393
2022-08-12T17:42:06.279261Z 1 [Note] WSREP: GCache DEBUG: RingBuffer::seqno_reset(): full reset
2022-08-12T17:42:08.369307Z 0 [Note] WSREP: 2.0 (pexgal003-dev3): State transfer to 0.0 (pexgal001-dev3) complete.
2022-08-12T17:42:08.369867Z 0 [Note] WSREP: Member 2.0 (pexgal003-dev3) synced with group.
        2022-08-12T17:42:08.496773Z WSREP_SST: [INFO] xtrabackup_ist received from donor: Running IST
        2022-08-12T17:42:08.498811Z WSREP_SST: [INFO] Galera co-ords from recovery: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383
2022-08-12T17:42:08.567634Z 0 [Note] WSREP: SST complete, seqno: 2249383
2022-08-12T17:42:08.571393Z 0 [Note] InnoDB: PUNCH HOLE support available
2022-08-12T17:42:08.571416Z 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2022-08-12T17:42:08.571419Z 0 [Note] InnoDB: Uses event mutexes
2022-08-12T17:42:08.571422Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
2022-08-12T17:42:08.571425Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2022-08-12T17:42:08.571428Z 0 [Note] InnoDB: Using Linux native AIO
2022-08-12T17:42:08.571858Z 0 [Note] InnoDB: Number of pools: 1
2022-08-12T17:42:08.571960Z 0 [Note] InnoDB: Using CPU crc32 instructions
2022-08-12T17:42:08.574376Z 0 [Note] InnoDB: Initializing buffer pool, total size = 4G, instances = 8, chunk size = 128M
2022-08-12T17:42:08.735191Z 0 [Note] InnoDB: Completed initialization of buffer pool
2022-08-12T17:42:08.792202Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2022-08-12T17:42:08.875641Z 0 [Note] InnoDB: Crash recovery did not find the parallel doublewrite buffer at /var/lib/mysql-pexgal001/innodb/data/xb_doublewrite
2022-08-12T17:42:08.877333Z 0 [Note] InnoDB: Highest supported file format is Barracuda.
2022-08-12T17:42:09.031189Z 0 [Note] InnoDB: Created parallel doublewrite buffer at /var/lib/mysql-pexgal001/innodb/data/xb_doublewrite, size 31457280 bytes
2022-08-12T17:42:09.567759Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2022-08-12T17:42:09.567857Z 0 [Note] InnoDB: Setting file '/var/lib/mysql-pexgal001/innodb/data/ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2022-08-12T17:42:09.589231Z 0 [Note] InnoDB: File '/var/lib/mysql-pexgal001/innodb/data/ibtmp1' size is now 12 MB.
2022-08-12T17:42:09.590096Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
2022-08-12T17:42:09.590108Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
2022-08-12T17:42:09.593711Z 0 [Note] InnoDB: Waiting for purge to start
2022-08-12T17:42:09.644459Z 0 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.7.31-34 started; log sequence number 59199104884790
2022-08-12T17:42:09.644721Z 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql-pexgal001/innodb/data/ib_buffer_pool
2022-08-12T17:42:09.644860Z 0 [Note] Plugin 'FEDERATED' is disabled.
2022-08-12T17:42:09.742392Z 0 [Warning] Percona Server cannot operate under OpenSSL FIPS mode. Disabling FIPS.
2022-08-12T17:42:09.742421Z 0 [Note] Found ca.pem, server-cert.pem and server-key.pem in data directory. Trying to enable SSL support using them.
2022-08-12T17:42:09.742430Z 0 [Note] Skipping generation of SSL certificates as certificate files are present in data directory.
2022-08-12T17:42:09.742504Z 0 [Warning] Failed to set up SSL because of the following SSL library error: SSL_CTX_new failed
2022-08-12T17:42:09.742516Z 0 [Note] Skipping generation of RSA key pair as key files are present in data directory.
2022-08-12T17:42:09.742625Z 0 [Note] Server hostname (bind-address): '192.168.170.141'; port: 3306
2022-08-12T17:42:09.742635Z 0 [Note]   - '192.168.170.141' resolves to '192.168.170.141';
2022-08-12T17:42:09.742662Z 0 [Note] Server socket created on IP: '192.168.170.141'.
2022-08-12T17:42:09.861359Z 0 [Warning] 'user' entry 'root@pexdb002c.grantstreet.com' ignored in --skip-name-resolve mode.
2022-08-12T17:42:09.861401Z 0 [Warning] 'user' entry '@pexdb002c.grantstreet.com' ignored in --skip-name-resolve mode.
2022-08-12T17:42:09.876449Z 0 [Warning] 'proxies_priv' entry '@ root@pexdb002c.grantstreet.com' ignored in --skip-name-resolve mode.
2022-08-12T17:42:10.545164Z 0 [Note] Event Scheduler: Loaded 0 events
2022-08-12T17:42:10.545342Z 0 [Note] WSREP: Signalling provider to continue on SST completion.
2022-08-12T17:42:10.545360Z 0 [Note] WSREP: Initialized wsrep sidno 2
2022-08-12T17:42:10.545378Z 0 [Note] WSREP: SST received: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383
2022-08-12T17:42:10.545492Z 0 [Note] /usr/sbin/mysqld: ready for connections.
Version: '5.7.31-34-57-log'  socket: '/var/lib/mysql-pexgal001/run/mysql.sock'  port: 3306  Percona XtraDB Cluster (GPL), Release rel34, Revision d76a6e8, WSREP version 31.45, wsrep_31.45
2022-08-12T17:42:10.546120Z 1 [Note] WSREP: Receiving IST: 10 writesets, seqnos 2249383-2249393
2022-08-12T17:42:16.284805Z 0 [Note] WSREP: declaring 67c46602 at tcp://192.168.170.142:4567 stable
2022-08-12T17:42:16.284878Z 0 [Note] WSREP: forgetting cfa5fea8 (tcp://192.168.170.143:4567)
2022-08-12T17:42:16.285635Z 0 [Note] WSREP: Node 135e2e5d state primary
2022-08-12T17:42:16.285968Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,135e2e5d,44)
memb {
        135e2e5d,0
        67c46602,0
        }
joined {
        }
left {
        }
partitioned {
        cfa5fea8,0
        }
)
2022-08-12T17:42:16.285981Z 0 [Note] WSREP: Save the discovered primary-component to disk
2022-08-12T17:42:16.288212Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2
2022-08-12T17:42:16.288276Z 0 [Note] WSREP: forgetting cfa5fea8 (tcp://192.168.170.143:4567)
2022-08-12T17:42:16.288312Z 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 1b2706f6-1a66-11ed-9fae-7fc396c0da36
2022-08-12T17:42:16.290035Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 1b2706f6-1a66-11ed-9fae-7fc396c0da36
2022-08-12T17:42:16.290434Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 1b2706f6-1a66-11ed-9fae-7fc396c0da36 from 0 (pexgal001-dev3)
2022-08-12T17:42:16.290453Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 1b2706f6-1a66-11ed-9fae-7fc396c0da36 from 1 (pexgal002-dev3)
2022-08-12T17:42:16.290459Z 0 [Note] WSREP: Quorum results:
        version    = 6,
        component  = PRIMARY,
        conf_id    = 6,
        members    = 1/2 (primary/total),
        act_id     = 2249393,
        last_appl. = 0,
        protocols  = 0/9/3 (gcs/repl/appl),
        group UUID = 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4
2022-08-12T17:42:16.290462Z 0 [Warning] WSREP: Donor cfa5fea8-1a55-11ed-b236-06a7d79f15c1 is no longer in the group. State transfer cannot be completed, need to abort. Aborting...
2022-08-12T17:42:16.290467Z 0 [Note] WSREP: Flow-control interval: [2896, 2896]
2022-08-12T17:42:21.732489Z 0 [Note] WSREP:  cleaning up cfa5fea8 (tcp://192.168.170.143:4567)
2022-08-12T17:42:31.117663Z 0 [Note] InnoDB: Buffer pool(s) load completed at 220812 13:42:31