sofastack / sofa-registry

SOFARegistry is a production-level, low-latency, high-availability service registry powered by Ant Financial.
https://www.sofastack.tech/sofa-registry/docs/Home
Apache License 2.0
649 stars 244 forks source link

注册中心启动失败,leadr选举地址为docker网卡地址,localhost:9622 health check failed. #35

Closed WangShuangQuan-A closed 2 years ago

WangShuangQuan-A commented 5 years ago

使用默认配置文件,DefualtDataCenter:本机地址 启动报错,leader选举地址为docker网卡对应地址

Your scenes

错误信息如下 registry-raft.log

[2019-06-25 16:55:50,350][INFO][main][FSMCallerImpl] - Starts FSMCaller successfully. [2019-06-25 16:55:50,489][WARN][main][LocalSnapshotStorage] - No data for snapshot reader /home/wsq/Applications/SOFA/sofa-registry-integration/raftData/snapshot [2019-06-25 16:55:50,637][INFO][main][NodeImpl] - Node <RegistryGroup_DefaultDataCenter/172.17.0.1:9614> init, term: 0, lastLogId: LogId [index=0, term=0], conf: 192.168.155.60:9614, old_conf: [2019-06-25 16:55:50,670][INFO][main][RaftGroupService] - Start the RaftGroupService successfully. [2019-06-25 16:55:52,466][INFO][JRaft-ElectionTimer][NodeImpl] - Node <RegistryGroup_DefaultDataCenter/172.17.0.1:9614> term 0 start preVote [2019-06-25 16:55:52,474][WARN][JRaft-ElectionTimer][NodeImpl] - Node <RegistryGroup_DefaultDataCenter/172.17.0.1:9614> can't do preVote as it is not in conf <192.168.155.60:9614> [2019-06-25 16:55:53,597][INFO][JRaft-ElectionTimer][NodeImpl] - Node <RegistryGroup_DefaultDataCenter/172.17.0.1:9614> term 0 start preVote [2019-06-25 16:55:53,598][WARN][JRaft-ElectionTimer][NodeImpl] - Node <RegistryGroup_DefaultDataCenter/172.17.0.1:9614> can't do preVote as it is not in conf <192.168.155.60:9614> [2019-06-25 16:55:54,728][INFO][JRaft-ElectionTimer][NodeImpl] - Node <RegistryGroup_DefaultDataCenter/172.17.0.1:9614> term 0 start preVote [2019-06-25 16:55:54,729][WARN][JRaft-ElectionTimer][NodeImpl] - Node <RegistryGroup_DefaultDataCenter/172.17.0.1:9614> can't do preVote as it is not in conf <192.168.155.60:9614> registry-integration-std.out Command: java -Dregistry.integration.home=/home/wsq/Applications/SOFA/sofa-registry-integration -Dspring.config.location=/home/wsq/Applications/SOFA/sofa-registry-integration/conf/application.properties -Duser.home=/home/wsq/Applications/SOFA/sofa-registry-integration -server -Xms512m -Xmx512m -Xmn256m -Xss256k -XX:+DisableExplicitGC -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/home/wsq/Applications/SOFA/sofa-registry-integration/logs/registry-integration-gc.log -verbose:gc -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/wsq/Applications/SOFA/sofa-registry-integration/logs -XX:ErrorFile=/home/wsq/Applications/SOFA/sofa-registry-integration/logs/registry-integration-hs_err_pid%p.log -XX:-OmitStackTraceInFastThrow -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ParallelGCThreads=4 -XX:+CMSClassUnloadingEnabled -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=70 -jar /home/wsq/Applications/SOFA/sofa-registry-integration/registry-integration.jar --logging.config=/home/wsq/Applications/SOFA/sofa-registry-integration/conf/logback-spring.xml Sofa-Middleware-Log SLF4J : Actual binding is of type [ com.alipay.remoting Logback ] [2019-06-25 17:25:46,010][INFO][main][MetaServerBootstrap] - Open session node register server port 9610 success! [2019-06-25 17:25:46,033][INFO][main][MetaServerBootstrap] - Open data node register server port 9611 success! [2019-06-25 17:25:46,064][INFO][main][MetaServerBootstrap] - Open meta server port 9612 success! [2019-06-25 17:25:51,753][INFO][main][MetaServerBootstrap] - Open http server port 9615 success! [2019-06-25 17:25:53,651][INFO][main][MetaServerBootstrap] - Raft server port 9614 start success!group RegistryGroup [2019-06-25 17:25:53,653][INFO][main][MetaServerBootstrap] - Raft client connect success! [2019-06-25 17:25:53,682][INFO][main][MetaServerBootstrap] - Raft start CliService success! [2019-06-25 17:25:53,692][INFO][main][MetaServerInitializerConfiguration] - Started MetaServer [2019-06-25 17:25:59,264][INFO][main][RegistryApplication] - localhost:9615 health check success. [2019-06-25 17:26:07,227][INFO][main][DataServerBootstrap] - [DataServerBootstrap] begin start server [2019-06-25 17:26:07,349][INFO][main][DataServerBootstrap] - Data server for session started! port:9620 [2019-06-25 17:26:07,414][INFO][main][DataServerBootstrap] - Data server for sync started! port:9621 [2019-06-25 17:26:08,602][INFO][main][DataServerBootstrap] - Open http server port 9622 success! [2019-06-25 17:26:09,085][INFO][main][DataServerBootstrap] - [DataServerBootstrap] raft client started!Leader is 172.17.0.1:9614 [2019-06-25 17:26:09,138][INFO][main][DataServerBootstrap] - [DataServerBootstrap] start server success [2019-06-25 17:26:09,300][ERROR][main][RegistryApplication] - localhost:9622 health check failed. [2019-06-25 17:26:10,342][ERROR][main][RegistryApplication] - localhost:9622 health check failed. [2019-06-25 17:26:11,360][ERROR][main][RegistryApplication] - localhost:9622 health check failed.

Environment

---- 网卡信息 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: wlp2s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000 link/ether a0:c5:89:4e:5e:26 brd ff:ff:ff:ff:ff:ff inet 192.168.155.60/24 brd 192.168.155.255 scope global dynamic noprefixroute wlp2s0 valid_lft 71228sec preferred_lft 71228sec inet6 fe80::1138:8b8e:eff4:7199/64 scope link noprefixroute valid_lft forever preferred_lft forever 3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default link/ether 02:42:87:2f:e8:ef brd ff:ff:ff:ff:ff:ff inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 valid_lft forever preferred_lft forever inet6 fe80::42:87ff:fe2f:e8ef/64 scope link valid_lft forever preferred_lft forever

Synex-wh commented 5 years ago

注册中心启动需要配置当前meta节点的ip(即是application.properties文件里配置的“DefualtDataCenter:localhost”,机房名称:metaip),如果按照默认配置为localhost,这个时候对应ip不确定是那个网卡的ip,上述描述获取了docker0这个网卡的ip。当前环境有多个网卡,但是配置中心本身获取当前机器ip的逻辑是:不指定网卡就获取第一个网卡的ip作为当前机器ip,导致localhost对应的ip和注册中心获取的当前机器ip未必一致

同样如果不使用设置localhost,通过明确修改ip设置比如DefualtDataCenter:192.168.155.60,这个样还是无法保证192.168.155.60这个ip就是注册中心内部获取的网卡对应ip

这些不一致一定会导致meta启动会有问题,因为内部获取的当前机器ip和配置的不符,导致上述选举列表不在配置范围内的情况,所以修改方式就是保证配置的ip和内部获取ip的一致

配置中心提供了网卡指定的配置,通过jvm参数指定-Dnetwork_interface_binding=你的ip的网卡名称。这样指定了网卡,确定绑定的ip和配置的ip 192.168.155.60一致了,上述描述应该配置-Dnetwork_interface_binding=wlp2s0就可以了

jvm参数-D可以通过修改启动脚本加入即可,后续我们可以把这个变为启动参数加入application.properties文件里配置

WangShuangQuan-A commented 5 years ago

蟹蟹

maodou38 commented 4 years ago

能告知一下registry的默认注册端口是哪个嘛,我执行sofa的官方demo一直不成功

khotyn commented 4 years ago

@maodou38 默认端口 9603,这里有写:https://www.sofastack.tech/projects/sofa-rpc/registry-sofa/

maodou38 commented 4 years ago

@khotyn 我的9063也无法注册成功 ,已经解决了网卡选择问题,ip获取没什么问题,但是sofastack的demo执行就是找不到推送

khotyn commented 4 years ago

@maodou38 你有修改过 Demo 的代码吗?可以把日志打个包放上来看下。

maodou38 commented 4 years ago

common-error.log中的报错信息: 只是改了下start.sh中加了个选择网卡 [2020-03-17 06:43:18,191][ERROR][DataNodeChangePushTaskDataDispatcher-0][DataNodeServiceImpl] - Push dataNode list error! No data node registered! [2020-03-17 06:43:18,194][ERROR][DataNodeChangePushTaskDataDispatcher-0][DataNodeSingleTaskProcessor] - [Task] Data node SingleTask Process error! java.lang.RuntimeException: Push dataNode list error! No data node registered! at com.alipay.sofa.registry.server.meta.node.impl.DataNodeServiceImpl.pushDataNodes(DataNodeServiceImpl.java:88) at com.alipay.sofa.registry.server.meta.task.DataNodeChangePushTask.execute(DataNodeChangePushTask.java:86) at com.alipay.sofa.registry.server.meta.task.processor.DataNodeSingleTaskProcessor.process(DataNodeSingleTaskProcessor.java:41) at com.alipay.sofa.registry.server.meta.task.processor.DataNodeSingleTaskProcessor.process(DataNodeSingleTaskProcessor.java:32) at com.alipay.sofa.registry.task.batcher.TaskExecutors$WorkerRunnable.run(TaskExecutors.java:136) at java.lang.Thread.run(Thread.java:748) [2020-03-17 06:43:18,194][ERROR][DataNodeChangePushTaskSessionDispatcher-17][SessionNodeServiceImpl] - Push sessionNode list error! No session node connected! [2020-03-17 06:43:18,221][ERROR][DataNodeChangePushTaskSessionDispatcher-17][DataNodeSingleTaskProcessor] - [Task] Data node SingleTask Process error! java.lang.RuntimeException: Push sessionNode list error! No session node connected! at com.alipay.sofa.registry.server.meta.node.impl.SessionNodeServiceImpl.pushDataNodes(SessionNodeServiceImpl.java:131) at com.alipay.sofa.registry.server.meta.task.DataNodeChangePushTask.execute(DataNodeChangePushTask.java:81) at com.alipay.sofa.registry.server.meta.task.processor.DataNodeSingleTaskProcessor.process(DataNodeSingleTaskProcessor.java:41) at com.alipay.sofa.registry.server.meta.task.processor.DataNodeSingleTaskProcessor.process(DataNodeSingleTaskProcessor.java:32) at com.alipay.sofa.registry.task.batcher.TaskExecutors$WorkerRunnable.run(TaskExecutors.java:136) at java.lang.Thread.run(Thread.java:748) [2020-03-17 06:43:21,536][ERROR][DataNodeChangePushTaskSessionDispatcher-18][SessionNodeServiceImpl] - Push sessionNode list error! No session node connected! [2020-03-17 06:43:21,536][ERROR][DataNodeChangePushTaskSessionDispatcher-18][DataNodeSingleTaskProcessor] - [Task] Data node SingleTask Process error! java.lang.RuntimeException: Push sessionNode list error! No session node connected! at com.alipay.sofa.registry.server.meta.node.impl.SessionNodeServiceImpl.pushDataNodes(SessionNodeServiceImpl.java:131) at com.alipay.sofa.registry.server.meta.task.DataNodeChangePushTask.execute(DataNodeChangePushTask.java:81) at com.alipay.sofa.registry.server.meta.task.processor.DataNodeSingleTaskProcessor.process(DataNodeSingleTaskProcessor.java:41) at com.alipay.sofa.registry.server.meta.task.processor.DataNodeSingleTaskProcessor.process(DataNodeSingleTaskProcessor.java:32) at com.alipay.sofa.registry.task.batcher.TaskExecutors$WorkerRunnable.run(TaskExecutors.java:136) at java.lang.Thread.run(Thread.java:748) [2020-03-17 06:43:21,561][ERROR][main][RegistryApplication] - localhost:9622 health check failed. javax.ws.rs.InternalServerErrorException: HTTP 500 Internal Server Error at org.glassfish.jersey.client.JerseyInvocation.convertToException(JerseyInvocation.java:1098) at org.glassfish.jersey.client.JerseyInvocation.translate(JerseyInvocation.java:883) at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$1(JerseyInvocation.java:767) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:229) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:414) at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:765) at org.glassfish.jersey.client.JerseyInvocation$Builder.method(JerseyInvocation.java:428) at org.glassfish.jersey.client.JerseyInvocation$Builder.get(JerseyInvocation.java:324) at com.alipay.sofa.registry.server.integration.RegistryApplication.nodeHealthCheck(RegistryApplication.java:134) at com.alipay.sofa.registry.server.integration.RegistryApplication.waitClusterStart(RegistryApplication.java:119) at com.alipay.sofa.registry.server.integration.RegistryApplication.main(RegistryApplication.java:80) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) at org.springframework.boot.loader.Launcher.launch(Launcher.java:51) at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:52) [2020-03-17 06:43:21,561][ERROR][main][RegistryApplication] - localhost:9622 health check failed. [2020-03-17 06:43:25,235][ERROR][ReceiveStatusConfirmNotifyTaskDispatcher-0][BoltServer] - Bolt Server sendSync message RemotingException! target url:Origin url [10.140.0.7:41122], Unique key [10.140.0.7:41122]. com.alipay.remoting.rpc.exception.InvokeTimeoutException: Rpc invocation timeout[responseCommand TIMEOUT]! the address is 10.140.0.7:41122 at com.alipay.remoting.rpc.RpcResponseResolver.preProcess(RpcResponseResolver.java:83) at com.alipay.remoting.rpc.RpcResponseResolver.resolveResponseObject(RpcResponseResolver.java:54) at com.alipay.remoting.rpc.RpcRemoting.invokeSync(RpcRemoting.java:186) at com.alipay.remoting.rpc.RpcServerRemoting.invokeSync(RpcServerRemoting.java:67) at com.alipay.remoting.rpc.RpcServer.invokeSync(RpcServer.java:541) at com.alipay.sofa.registry.remoting.bolt.BoltServer.sendSync(BoltServer.java:251) at com.alipay.sofa.registry.server.meta.remoting.DataNodeExchanger.request(DataNodeExchanger.java:62) at com.alipay.sofa.registry.server.meta.node.impl.DataNodeServiceImpl.notifyStatusConfirm(DataNodeServiceImpl.java:175) at com.alipay.sofa.registry.server.meta.task.ReceiveStatusConfirmNotifyTask.execute(ReceiveStatusConfirmNotifyTask.java:57) at com.alipay.sofa.registry.server.meta.task.processor.DataNodeSingleTaskProcessor.process(DataNodeSingleTaskProcessor.java:41) at com.alipay.sofa.registry.server.meta.task.processor.DataNodeSingleTaskProcessor.process(DataNodeSingleTaskProcessor.java:32) at com.alipay.sofa.registry.task.batcher.TaskExecutors$WorkerRunnable.run(TaskExecutors.java:136) at java.lang.Thread.run(Thread.java:748) [2020-03-17 06:43:25,235][ERROR][ReceiveStatusConfirmNotifyTaskDispatcher-0][DataNodeExchanger] - DataNode Exchanger request data error! java.lang.RuntimeException: Bolt Server sendSync message RemotingException! at com.alipay.sofa.registry.remoting.bolt.BoltServer.sendSync(BoltServer.java:255) at com.alipay.sofa.registry.server.meta.remoting.DataNodeExchanger.request(DataNodeExchanger.java:62) at com.alipay.sofa.registry.server.meta.node.impl.DataNodeServiceImpl.notifyStatusConfirm(DataNodeServiceImpl.java:175) at com.alipay.sofa.registry.server.meta.task.ReceiveStatusConfirmNotifyTask.execute(ReceiveStatusConfirmNotifyTask.java:57) at com.alipay.sofa.registry.server.meta.task.processor.DataNodeSingleTaskProcessor.process(DataNodeSingleTaskProcessor.java:41) at com.alipay.sofa.registry.server.meta.task.processor.DataNodeSingleTaskProcessor.process(DataNodeSingleTaskProcessor.java:32) at com.alipay.sofa.registry.task.batcher.TaskExecutors$WorkerRunnable.run(TaskExecutors.java:136) at java.lang.Thread.run(Thread.java:748) Caused by: com.alipay.remoting.rpc.exception.InvokeTimeoutException: Rpc invocation timeout[responseCommand TIMEOUT]! the address is 10.140.0.7:41122 at com.alipay.remoting.rpc.RpcResponseResolver.preProcess(RpcResponseResolver.java:83) at com.alipay.remoting.rpc.RpcResponseResolver.resolveResponseObject(RpcResponseResolver.java:54) at com.alipay.remoting.rpc.RpcRemoting.invokeSync(RpcRemoting.java:186) at com.alipay.remoting.rpc.RpcServerRemoting.invokeSync(RpcServerRemoting.java:67) at com.alipay.remoting.rpc.RpcServer.invokeSync(RpcServer.java:541) at com.alipay.sofa.registry.remoting.bolt.BoltServer.sendSync(BoltServer.java:251) ... 7 common frames omitted [2020-03-17 06:43:25,308][ERROR][ReceiveStatusConfirmNotifyTaskDispatcher-0][DataNodeSingleTaskProcessor] - [Task] Data node SingleTask Process error! java.lang.RuntimeException: Notify status confirm error: request url: URL{address='10.140.0.7:41122'}, body: StatusConfirmRequest{node=DataNode{ip=10.140.0.7}, nodeStatus=INIT}, DataNode Exchanger request data error! at com.alipay.sofa.registry.server.meta.node.impl.DataNodeServiceImpl.notifyStatusConfirm(DataNodeServiceImpl.java:182) at com.alipay.sofa.registry.server.meta.task.ReceiveStatusConfirmNotifyTask.execute(ReceiveStatusConfirmNotifyTask.java:57) at com.alipay.sofa.registry.server.meta.task.processor.DataNodeSingleTaskProcessor.process(DataNodeSingleTaskProcessor.java:41) at com.alipay.sofa.registry.server.meta.task.processor.DataNodeSingleTaskProcessor.process(DataNodeSingleTaskProcessor.java:32) at com.alipay.sofa.registry.task.batcher.TaskExecutors$WorkerRunnable.run(TaskExecutors.java:136) at java.lang.Thread.run(Thread.java:748) Caused by: com.alipay.sofa.registry.remoting.exchange.RequestException: request url: URL{address='10.140.0.7:41122'}, body: StatusConfirmRequest{node=DataNode{ip=10.140.0.7}, nodeStatus=INIT}, DataNode Exchanger request data error! at com.alipay.sofa.registry.server.meta.remoting.DataNodeExchanger.request(DataNodeExchanger.java:77) at com.alipay.sofa.registry.server.meta.node.impl.DataNodeServiceImpl.notifyStatusConfirm(DataNodeServiceImpl.java:175) ... 5 common frames omitted Caused by: java.lang.RuntimeException: Bolt Server sendSync message RemotingException! at com.alipay.sofa.registry.remoting.bolt.BoltServer.sendSync(BoltServer.java:255) at com.alipay.sofa.registry.server.meta.remoting.DataNodeExchanger.request(DataNodeExchanger.java:62) ... 6 common frames omitted Caused by: com.alipay.remoting.rpc.exception.InvokeTimeoutException: Rpc invocation timeout[responseCommand TIMEOUT]! the address is 10.140.0.7:41122 at com.alipay.remoting.rpc.RpcResponseResolver.preProcess(RpcResponseResolver.java:83) at com.alipay.remoting.rpc.RpcResponseResolver.resolveResponseObject(RpcResponseResolver.java:54) at com.alipay.remoting.rpc.RpcRemoting.invokeSync(RpcRemoting.java:186) at com.alipay.remoting.rpc.RpcServerRemoting.invokeSync(RpcServerRemoting.java:67) at com.alipay.remoting.rpc.RpcServer.invokeSync(RpcServer.java:541) at com.alipay.sofa.registry.remoting.bolt.BoltServer.sendSync(BoltServer.java:251) ... 7 common frames omitted

maodou38 commented 4 years ago

@khotyn registry-startup中各项启动都正常 9622端口的health check也是正常的,怎么到了common-error中9622也不正常了

[2020-03-17 06:43:15,153][INFO][main][MetaServerBootstrap] - the configuration items are as follows: com.alipay.sofa.registry.server.meta.bootstrap.MetaServerConfigBean@74235045[ sessionServerPort=9610 dataServerPort=9611 metaServerPort=9612 httpServerPort=9615 schedulerHeartbeatTimeout=3 schedulerHeartbeatFirstDelay=3 schedulerHeartbeatExpBackOffBound=10 schedulerGetDataChangeTimeout=5 schedulerGetDataChangeFirstDelay=5 schedulerGetDataChangeExpBackOffBound=5 schedulerConnectMetaServerTimeout=3 schedulerConnectMetaServerFirstDelay=3 schedulerConnectMetaServerExpBackOffBound=10 schedulerCheckNodeListChangePushTimeout=3 schedulerCheckNodeListChangePushFirstDelay=1 schedulerCheckNodeListChangePushExpBackOffBound=10 dataNodeExchangeTimeout=3000 sessionNodeExchangeTimeout=3000 metaNodeExchangeTimeout=3000 dataCenterChangeNotifyTaskRetryTimes=3 dataNodeChangePushTaskRetryTimes=1 getDataCenterChangeListTaskRetryTimes=3 receiveStatusConfirmNotifyTaskRetryTimes=3 sessionNodeChangePushTaskRetryTimes=3 enableMetrics=true decisionMode= raftDataPath=/home/maodoulove19950815/registry-integration/raftData rockDBCacheSize=64 heartbeatCheckExecutorMinSize=3 heartbeatCheckExecutorMaxSize=10 heartbeatCheckExecutorQueueSize=1024 checkDataChangeExecutorMinSize=3 checkDataChangeExecutorMaxSize=10 checkDataChangeExecutorQueueSize=1024 getOtherDataCenterChangeExecutorMinSize=3 getOtherDataCenterChangeExecutorMaxSize=10 getOtherDataCenterChangeExecutorQueueSize=1024 connectMetaServerExecutorMinSize=3 connectMetaServerExecutorMaxSize=10 connectMetaServerExecutorQueueSize=1024 checkNodeListChangePushExecutorMinSize=3 checkNodeListChangePushExecutorMaxSize=10 checkNodeListChangePushExecutorQueueSize=1024 raftClientRefreshExecutorMinSize=3 raftClientRefreshExecutorMaxSize=10 raftClientRefreshExecutorQueueSize=1024 metaSchedulerPoolSize=6 ] [2020-03-17 06:43:15,247][INFO][main][MetaServerBootstrap] - Open session node register server port 9610 success! [2020-03-17 06:43:15,250][INFO][main][MetaServerBootstrap] - Open data node register server port 9611 success! [2020-03-17 06:43:15,253][INFO][main][MetaServerBootstrap] - Open meta server port 9612 success! [2020-03-17 06:43:16,834][INFO][main][MetaServerBootstrap] - Open http server port 9615 success! [2020-03-17 06:43:17,319][INFO][main][MetaServerBootstrap] - Raft server port 9614 start success!group RegistryGroup [2020-03-17 06:43:17,320][INFO][main][MetaServerBootstrap] - Raft client connect success! [2020-03-17 06:43:17,332][INFO][main][MetaServerBootstrap] - Raft start CliService success! [2020-03-17 06:43:17,339][INFO][main][MetaServerInitializerConfiguration] - Started MetaServer [2020-03-17 06:43:18,862][INFO][main][RegistryApplication] - localhost:9615 health check success. [2020-03-17 06:43:21,102][INFO][main][DataServerBootstrap] - begin start server [2020-03-17 06:43:21,102][INFO][main][DataServerBootstrap] - the configuration items are as follows: com.alipay.sofa.registry.server.data.bootstrap.DataServerConfig@58ffcbd7[ port=9620 syncDataPort=9621 metaServerPort=9611 httpServerPort=9622 queueCount=4 queueSize=10240 notifyIntervalMs=500 clientOffDelayMs=0 notifyTempDataIntervalMs=0 rpcTimeout=3000 commonConfig=com.alipay.sofa.registry.server.data.bootstrap.CommonConfig@555cf22 metaIps= storeNodes=3 numberOfReplicas=1000 localDataServerCleanDelay=1800000 getDataExecutorMinPoolSize=80 getDataExecutorMaxPoolSize=400 getDataExecutorQueueSize=10000 getDataExecutorKeepAliveTime=60 notifyDataSyncExecutorMinPoolSize=80 notifyDataSyncExecutorMaxPoolSize=400 notifyDataSyncExecutorQueueSize=700 notifyDataSyncExecutorKeepAliveTime=60 notifySessionRetryFirstDelay=3000 notifySessionRetryIncrementDelay=3000 notifySessionRetryTimes=5 publishExecutorMinPoolSize=200 publishExecutorMaxPoolSize=400 publishExecutorQueueSize=10000 renewDatumExecutorMinPoolSize=100 renewDatumExecutorMaxPoolSize=400 renewDatumExecutorQueueSize=100000 datumTimeToLiveSec=20 datumLeaseManagerExecutorThreadSize=1 datumLeaseManagerExecutorQueueSize=1000000 sessionServerNotifierRetryExecutorThreadSize=10 sessionServerNotifierRetryExecutorQueueSize=10000 renewEnableDelaySec=30 dataSyncDelayTimeout=1000 dataSyncNotifyRetry=3 ] [2020-03-17 06:43:21,134][INFO][main][DataServerBootstrap] - Data server for session started! port:9620 [2020-03-17 06:43:21,148][INFO][main][DataServerBootstrap] - Data server for sync started! port:9621 [2020-03-17 06:43:21,317][INFO][main][DataServerBootstrap] - Open http server port 9622 success! [2020-03-17 06:43:21,453][INFO][main][DataServerBootstrap] - raft client started!Leader is 10.140.0.7:9614 [2020-03-17 06:43:21,462][INFO][main][DataServerBootstrap] - Fetch enableDataDatumExpire but no data existed, current config not change! [2020-03-17 06:43:21,474][INFO][main][DataServerBootstrap] - start server success [2020-03-17 06:43:22,570][INFO][main][RegistryApplication] - localhost:9622 health check success. [2020-03-17 06:43:26,646][INFO][main][SessionServerBootstrap] - the configuration items are as follows: com.alipay.sofa.registry.server.session.bootstrap.SessionServerConfigBean@42d236fb[ serverPort=9600 metaServerPort=9610 dataServerPort=9620 httpServerPort=9603 schedulerHeartbeatTimeout=30 schedulerHeartbeatFirstDelay=30 schedulerHeartbeatExpBackOffBound=10 schedulerGetSessionNodeTimeout=3 schedulerGetSessionNodeFirstDelay=5 schedulerGetSessionNodeExpBackOffBound=10 schedulerFetchDataTimeout=3 schedulerFetchDataFirstDelay=3 schedulerFetchDataExpBackOffBound=10 schedulerConnectMetaTimeout=5 schedulerConnectMetaFirstDelay=5 schedulerConnectMetaExpBackOffBound=3 schedulerConnectDataTimeout=10 schedulerConnectDataFirstDelay=10 schedulerConnectDataExpBackOffBound=3 schedulerCleanInvalidClientTimeOut=3 schedulerCleanInvalidClientFirstDelay=10 schedulerCleanInvalidClientBackOffBound=5 cancelDataTaskRetryTimes=2 cancelDataTaskRetryFirstDelay=500 cancelDataTaskRetryIncrementDelay=500 publishDataTaskRetryTimes=2 publishDataTaskRetryFirstDelay=3000 publishDataTaskRetryIncrementDelay=5000 unPublishDataTaskRetryTimes=2 unPublishDataTaskRetryFirstDelay=3000 unPublishDataTaskRetryIncrementDelay=5000 datumSnapshotTaskRetryTimes=1 datumSnapshotTaskRetryFirstDelay=5000 datumSnapshotTaskRetryIncrementDelay=5000 renewDatumTaskRetryTimes=1 dataChangeFetchTaskRetryTimes=3 subscriberRegisterFetchRetryTimes=3 receivedDataMultiPushTaskRetryTimes=3 sessionRegisterDataServerTaskRetryTimes=5 defaultSessionExecutorMinPoolSize=1 defaultSessionExecutorMaxPoolSize=5 defaultSessionExecutorKeepAliveTime=60 accessDataExecutorMinPoolSize=100 accessDataExecutorMaxPoolSize=400 accessDataExecutorQueueSize=10000 accessDataExecutorKeepAliveTime=60 pushTaskExecutorMinPoolSize=40 pushTaskExecutorMaxPoolSize=400 pushTaskExecutorQueueSize=100000 pushTaskExecutorKeepAliveTime=60 dataChangeExecutorMinPoolSize=40 dataChangeExecutorMaxPoolSize=400 dataChangeExecutorQueueSize=100000 dataChangeExecutorKeepAliveTime=60 connectClientExecutorMinPoolSize=60 connectClientExecutorMaxPoolSize=400 connectClientExecutorQueueSize=10000 dataChangeFetchTaskMaxBufferSize=1000000 dataChangeFetchTaskWorkerSize=100 clientNodeExchangeTimeOut=1000 dataNodeExchangeTimeOut=3000 metaNodeExchangeTimeOut=3000 numberOfReplicas=1000 userDataPushRetryWheelTicksSize=5120 userDataPushRetryWheelTicksDuration=100 userDataPushRetryExecutorQueueSize=1000000 userDataPushRetryExecutorThreadSize=10 renewDatumWheelTicksSize=2048 renewDatumWheelTicksDuration=500 renewDatumWheelTaskDelaySec=180 renewDatumWheelTaskRandomFirstDelaySec=200 renewDatumWheelThreadSize=10 renewDatumWheelQueueSize=10000 pushDataTaskRetryFirstDelay=500 pushDataTaskRetryIncrementDelay=500 pushTaskConfirmWaitTimeout=10000 pushTaskConfirmCheckWheelTicksSize=1024 pushTaskConfirmCheckWheelTicksDuration=100 pushTaskConfirmCheckExecutorQueueSize=10000 pushTaskConfirmCheckExecutorThreadSize=10 publishDataExecutorMinPoolSize=100 publishDataExecutorMaxPoolSize=400 publishDataExecutorQueueSize=10000 publishDataExecutorKeepAliveTime=60 accessLimitRate=100000.0 sessionServerRegion=DEFAULT_ZONE sessionServerDataCenter=DefaultDataCenter stopPushSwitch=false beginDataFetchTask=false invalidForeverZones= invalidIgnoreDataidRegex= invalidForeverZonesSet= invalidIgnoreDataIdPattern= blacklistPubDataIdRegex= blacklistSubDataIdRegex= renewAndSnapshotSilentPeriodSec=20 writeDataAcceptorQueueSize=10000 dataNodeRetryExecutorQueueSize=1000000 dataNodeRetryExecutorThreadSize=100 dataClientConnNum=10 sessionSchedulerPoolSize=6 commonConfig=com.alipay.sofa.registry.server.session.bootstrap.CommonConfig@1d9bec4d[ localDataCenter=DefaultDataCenter localRegion=DEFAULT_ZONE metaNode={DefaultDataCenter=[localhost]} ] ] [2020-03-17 06:43:26,669][INFO][main][SessionServerBootstrap] - Session server Environment: DataCenter DefaultDataCenter,Region DEFAULT_ZONE,ProcessId 0a8c0007158442740666910013402 [2020-03-17 06:43:26,684][INFO][main][SessionServerBootstrap] - Raft Client started! Leader:10.140.0.7:9614 [2020-03-17 06:43:26,788][INFO][main][SessionServerBootstrap] - Register MetaServer Session Node success!get data node list {DefaultDataCenter={10.140.0.7=DataNode{ip=10.140.0.7}}} [2020-03-17 06:43:26,793][INFO][main][SessionServerBootstrap] - Get all dataCenter from meta Server success! [2020-03-17 06:43:26,806][INFO][main][SessionServerBootstrap] - MetaServer connected meta server! Port:9610 [2020-03-17 06:43:26,867][INFO][main][SessionServerBootstrap] - Session Scheduler started! [2020-03-17 06:43:27,107][INFO][main][SessionServerBootstrap] - Open http server port 9603 success! [2020-03-17 06:43:27,124][INFO][main][SessionServerBootstrap] - Session server started! port:9600 [2020-03-17 06:43:27,185][INFO][main][SessionServerBootstrap] - Initialized Session Server... [2020-03-17 06:43:27,186][INFO][main][SessionServerInitializer] - Started SessionServer [2020-03-17 06:43:27,292][INFO][main][RegistryApplication] - localhost:9603 health check success.

maodou38 commented 4 years ago

@khotyn 41122端口哪来的,我netstat发现并没有打开

maodou38 commented 4 years ago

按照https://www.sofastack.tech/guides/sofastack-quick-start/#%E6%9B%B4%E5%A4%9A这个demo做的。 安装了openzipkin/zipkin xzchaoo/lookout-allinone:1.6.0-SNAPSHOT elasticsearch:5.6 三个docker容器 加上registry-integration。启动就是炸裂。

maodou38 commented 4 years ago

@khotyn 劳烦了,我看了一下午日志,自己解决了。但是还是要吐槽下,那个sofastack-demo是真的粗制滥造啊,里面都还有些错。而且本机作为注册中心,都一直会出现500找不到RPC对象。google云200ms直接没办法玩,这registry不是很稳定啊

khotyn commented 4 years ago

@maodou38 我们再看下 Demo,看下优化一下,多谢多谢~~~

maodou38 commented 4 years ago

你们内部有这个sofa-registry的那种监控工具嘛,类似zookeeper的那个。我现在很好奇为什么我的registry一会好一会坏了。SOFALookout和ZipKin都部署在台湾google cloud上,时延大概200ms。拿不到RPC对象和这有关系嘛?

khotyn commented 4 years ago

@maodou38 SOFALookout 和 Zipkin 跟服务发现没有关系,应该不是这个原因。

GaryLeung922 commented 3 years ago

@maodou38 Could you tell me how to solve it?

dzdx commented 2 years ago

6.1.4 版本优先会使用 eth0和en0 网络设备获取ip , 如果有希望自己指定的网卡,可以使用-Dnetwork_interface_binding 指定 https://github.com/sofastack/sofa-registry/blob/master/server%2Fcommon%2Futil%2Fsrc%2Fmain%2Fjava%2Fcom%2Falipay%2Fsofa%2Fregistry%2Fnet%2FNetUtil.java#L61