microservices-patterns / ftgo-application

Example code for the book Microservice patterns
Other
3.35k stars 1.29k forks source link

CDC service use docker compose #115

Closed medoer closed 3 years ago

medoer commented 3 years ago

cdc service log

cdc | org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata cdc | cdc | 2020-08-29 10:53:11.505 INFO 7 --- [nio-8080-exec-3] o.a.c.f.imps.CuratorFrameworkImpl : Starting cdc | 2020-08-29 10:53:11.506 INFO 7 --- [nio-8080-exec-3] org.apache.zookeeper.ZooKeeper : Initiating client connection, connectString=zookeeper:2181 sessionTimeout=1000 watcher=org.apache.curator.ConnectionState@7a7c112e cdc | 2020-08-29 10:53:11.511 INFO 7 --- [r_default:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server zookeeper.local-server_default/172.20.0.5:2181. Will not attempt to authenticate using SASL (unknown error) cdc | 2020-08-29 10:53:11.511 INFO 7 --- [r_default:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established to zookeeper.local-server_default/172.20.0.5:2181, initiating session cdc | 2020-08-29 10:53:11.514 INFO 7 --- [r_default:2181)] org.apache.zookeeper.ClientCnxn : Session establishment complete on server zookeeper.local-server_default/172.20.0.5:2181, sessionid = 0x10000e1ef79010b, negotiated timeout = 6000 cdc | 2020-08-29 10:53:11.514 INFO 7 --- [c-3-EventThread] o.a.c.f.state.ConnectionStateManager : State change: CONNECTED cdc | 2020-08-29 10:53:11.517 INFO 7 --- [tor-Framework-0] o.a.c.f.imps.CuratorFrameworkImpl : backgroundOperationsLoop exiting cdc | 2020-08-29 10:53:11.520 INFO 7 --- [c-3-EventThread] org.apache.zookeeper.ClientCnxn : EventThread shut down cdc | 2020-08-29 10:53:11.520 INFO 7 --- [nio-8080-exec-3] org.apache.zookeeper.ZooKeeper : Session: 0x10000e1ef79010b closed cdc | 2020-08-29 10:53:31.767 ERROR 7 --- [nio-8080-exec-2] i.e.l.u.c.p.c.health.KafkaHealthCheck : Timeout expired while fetching topic metadata cdc | cdc | org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata cdc | cdc | 2020-08-29 10:53:51.574 ERROR 7 --- [ Thread-9] i.e.l.d.l.c.DatabaseOffsetKafkaStore : Timeout expired while fetching topic metadata cdc | cdc | org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata cdc | cdc | 2020-08-29 10:54:01.483 INFO 7 --- [nio-8080-exec-4] o.a.c.f.imps.CuratorFrameworkImpl : Starting cdc | 2020-08-29 10:54:01.485 INFO 7 --- [nio-8080-exec-4] org.apache.zookeeper.ZooKeeper : Initiating client connection, connectString=zookeeper:2181 sessionTimeout=1000 watcher=org.apache.curator.ConnectionState@6d6eaae3 cdc | 2020-08-29 10:54:01.490 INFO 7 --- [r_default:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server zookeeper.local-server_default/172.20.0.5:2181. Will not attempt to authenticate using SASL (unknown error) cdc | 2020-08-29 10:54:01.492 INFO 7 --- [r_default:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established to zookeeper.local-server_default/172.20.0.5:2181, initiating session cdc | 2020-08-29 10:54:01.496 INFO 7 --- [r_default:2181)] org.apache.zookeeper.ClientCnxn : Session establishment complete on server zookeeper.local-server_default/172.20.0.5:2181, sessionid = 0x10000e1ef79010c, negotiated timeout = 6000 cdc | 2020-08-29 10:54:01.497 INFO 7 --- [c-4-EventThread] o.a.c.f.state.ConnectionStateManager : State change: CONNECTED cdc | 2020-08-29 10:54:01.499 INFO 7 --- [tor-Framework-0] o.a.c.f.imps.CuratorFrameworkImpl : backgroundOperationsLoop exiting cdc | 2020-08-29 10:54:01.502 INFO 7 --- [c-4-EventThread] org.apache.zookeeper.ClientCnxn : EventThread shut down cdc | 2020-08-29 10:54:01.502 INFO 7 --- [nio-8080-exec-4] org.apache.zookeeper.ZooKeeper : Session: 0x10000e1ef79010c closed cdc | 2020-08-29 10:54:31.774 ERROR 7 --- [nio-8080-exec-3] i.e.l.u.c.p.c.health.KafkaHealthCheck : Timeout expired while fetching topic metadata cdc | cdc | org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata

zookeeper log:

| [2020-08-29 10:53:11,519] INFO Processed session termination for sessionid: 0x10000e1ef79010b (org.apache.zookeeper.server.PrepRequestProcessor) zookeeper | [2020-08-29 10:53:11,520] WARN Unable to read additional data from client sessionid 0x10000e1ef79010b, likely client has closed socket (org.apache.zookeeper.server.NIOServerCnxn) zookeeper | [2020-08-29 10:53:11,521] INFO Closed socket connection for client /172.20.0.6:54642 which had sessionid 0x10000e1ef79010b (org.apache.zookeeper.server.NIOServerCnxn) zookeeper | [2020-08-29 10:54:01,491] INFO Accepted socket connection from /172.20.0.6:54646 (org.apache.zookeeper.server.NIOServerCnxnFactory) zookeeper | [2020-08-29 10:54:01,493] INFO Client attempting to establish new session at /172.20.0.6:54646 (org.apache.zookeeper.server.ZooKeeperServer) zookeeper | [2020-08-29 10:54:01,495] INFO Established session 0x10000e1ef79010c with negotiated timeout 6000 for client /172.20.0.6:54646 (org.apache.zookeeper.server.ZooKeeperServer) zookeeper | [2020-08-29 10:54:01,500] INFO Processed session termination for sessionid: 0x10000e1ef79010c (org.apache.zookeeper.server.PrepRequestProcessor) zookeeper | [2020-08-29 10:54:01,502] INFO Closed socket connection for client /172.20.0.6:54646 which had sessionid 0x10000e1ef79010c (org.apache.zookeeper.server.NIOServerCnxn) zookeeper | [2020-08-29 10:54:51,520] INFO Accepted socket connection from /172.20.0.6:54650 (org.apache.zookeeper.server.NIOServerCnxnFactory) zookeeper | [2020-08-29 10:54:51,521] INFO Client attempting to establish new session at /172.20.0.6:54650 (org.apache.zookeeper.server.ZooKeeperServer) zookeeper | [2020-08-29 10:54:51,525] INFO Established session 0x10000e1ef79010d with negotiated timeout 6000 for client /172.20.0.6:54650 (org.apache.zookeeper.server.ZooKeeperServer) zookeeper | [2020-08-29 10:54:51,530] INFO Processed session termination for sessionid: 0x10000e1ef79010d (org.apache.zookeeper.server.PrepRequestProcessor) zookeeper | [2020-08-29 10:54:51,531] INFO Closed socket connection for client /172.20.0.6:54650 which had sessionid 0x10000e1ef79010d (org.apache.zookeeper.server.NIOServerCnxn) zookeeper | [2020-08-29 10:55:41,572] INFO Accepted socket connection from /172.20.0.6:54654 (org.apache.zookeeper.server.NIOServerCnxnFactory) zookeeper | [2020-08-29 10:55:41,576] INFO Client attempting to establish new session at /172.20.0.6:54654 (org.apache.zookeeper.server.ZooKeeperServer) zookeeper | [2020-08-29 10:55:41,580] INFO Established session 0x10000e1ef79010e with negotiated timeout 6000 for client /172.20.0.6:54654 (org.apache.zookeeper.server.ZooKeeperServer) zookeeper | [2020-08-29 10:55:41,585] INFO Processed session termination for sessionid: 0x10000e1ef79010e (org.apache.zookeeper.server.PrepRequestProcessor) zookeeper | [2020-08-29 10:55:41,588] INFO Closed socket connection for client /172.20.0.6:54654 which had sessionid 0x10000e1ef79010e (org.apache.zookeeper.server.NIOServerCnxn) zookeeper | [2020-08-29 10:56:31,580] INFO Accepted socket connection from /172.20.0.6:54662 (org.apache.zookeeper.server.NIOServerCnxnFactory) zookeeper | [2020-08-29 10:56:31,580] INFO Client attempting to establish new session at /172.20.0.6:54662 (org.apache.zookeeper.server.ZooKeeperServer) zookeeper | [2020-08-29 10:56:31,582] INFO Established session 0x10000e1ef79010f with negotiated timeout 6000 for client /172.20.0.6:54662 (org.apache.zookeeper.server.ZooKeeperServer) zookeeper | [2020-08-29 10:56:31,585] INFO Processed session termination for sessionid: 0x10000e1ef79010f (org.apache.zookeeper.server.PrepRequestProcessor) zookeeper | [2020-08-29 10:56:31,587] INFO Closed socket connection for client /172.20.0.6:54662 which had sessionid 0x10000e1ef79010f (org.apache.zookeeper.server.NIOServerCnxn) zookeeper | [2020-08-29 10:57:21,588] INFO Accepted socket connection from /172.20.0.6:54666 (org.apache.zookeeper.server.NIOServerCnxnFactory) zookeeper | [2020-08-29 10:57:21,588] INFO Client attempting to establish new session at /172.20.0.6:54666 (org.apache.zookeeper.server.ZooKeeperServer) zookeeper | [2020-08-29 10:57:21,598] INFO Established session 0x10000e1ef790110 with negotiated timeout 6000 for client /172.20.0.6:54666 (org.apache.zookeeper.server.ZooKeeperServer) zookeeper | [2020-08-29 10:57:21,605] INFO Processed session termination for sessionid: 0x10000e1ef790110 (org.apache.zookeeper.server.PrepRequestProcessor) zookeeper | [2020-08-29 10:57:21,606] INFO Closed socket connection for client /172.20.0.6:54666 which had sessionid 0x10000e1ef790110 (org.apache.zookeeper.server.NIOServerCnxn)

medoer commented 3 years ago

The CDC server tries to connect to zookeeper bug 'EventThread shut down' right now. and the CDC didn't work.