search

opencurve / curveadm

Deploy and manage Curve cluster
Apache License 2.0
66 stars 72 forks source link

curve bs list server deadline exceeded in playground #155

Closed tsonglew closed 1 year ago

tsonglew commented 1 year ago

To Reproduce

  1. run playground with 
$  curveadm playground run --kind curvebs --container_image harbor.cloud.netease.com/curve/curvebs:playground                                                                                                                   Run Playground: [OK]
  + kind=curvebs  name=playground-curvebs-1668438402  image=opencurvedocker/curvebs-playground:v1.2 [1/1] [OK]
$ curveadm playground list                                                                                                                                                                                                     
Get Playground Status: [OK]

Id  Name                           Create Time          Status
--  ----                           -----------          ------
3   playground-curvebs-1668438402  2022-11-14 23:06:48  Up 5 minutes
--------------------------------------------------------------------------

  1. copy compiled curve into container

  2. run curve bs list server

    $ curve bs list server --mdsaddr 127.0.0.1:6700
Error: lsit zone fail. the error is list physical pool fail, the error is: dial to rpc server [127.0.0.1:6700] failed, the error is: context deadline exceeded
Cyber-SiKu commented 1 year ago

If 127.0.0.1:6700 is not the main mds, no service will be provided.

Cyber-SiKu commented 1 year ago

The address of mds will be: 127.0.0.1:6700,127.0.0.1:6701,127.0.0.1:6702

tsonglew commented 1 year ago

using 127.0.0.1:6700,127.0.0.1:6701,127.0.0.1:6702 raises error as well.

$ curve bs list server --mdsaddr 127.0.0.1:6700,127.0.0.1:6701,127.0.0.1:6702
Error: lsit zone fail. the error is list physical pool fail, the error is: dial to rpc server [127.0.0.1:6700 failed, the error is: context deadline exceeded
dial to rpc server 127.0.0.1:6701 failed, the error is: context deadline exceeded
dial to rpc server 127.0.0.1:6702] failed, the error is: context deadline exceeded

docker logs:

WARNING: Logging before InitGoogleLogging() is written to STDERR
I 2022-11-14T23:06:52.252156+0800    85 configuration.cpp:76] ==============================BEGIN==============================
I 2022-11-14T23:06:52.252259+0800    85 configuration.cpp:78] global.port                                                 : 6700
I 2022-11-14T23:06:52.252270+0800    85 configuration.cpp:78] global.subnet                                               : 127.0.0.0/24
I 2022-11-14T23:06:52.252279+0800    85 configuration.cpp:78] mds.auth.rootPassword                                       : root_password
I 2022-11-14T23:06:52.252285+0800    85 configuration.cpp:78] mds.auth.rootUserName                                       : root
I 2022-11-14T23:06:52.252292+0800    85 configuration.cpp:78] mds.cache.count                                             : 100000
I 2022-11-14T23:06:52.252300+0800    85 configuration.cpp:78] mds.chunkserver.failure.tolerance                           : 3
I 2022-11-14T23:06:52.252306+0800    85 configuration.cpp:78] mds.chunkserverclient.rpcRetryIntervalMs                    : 500
I 2022-11-14T23:06:52.252313+0800    85 configuration.cpp:78] mds.chunkserverclient.rpcRetryTimes                         : 5
I 2022-11-14T23:06:52.252319+0800    85 configuration.cpp:78] mds.chunkserverclient.rpcTimeoutMs                          : 500
I 2022-11-14T23:06:52.252328+0800    85 configuration.cpp:78] mds.chunkserverclient.updateLeaderRetryIntervalMs           : 5000
I 2022-11-14T23:06:52.252336+0800    85 configuration.cpp:78] mds.chunkserverclient.updateLeaderRetryTimes                : 5
I 2022-11-14T23:06:52.252342+0800    85 configuration.cpp:78] mds.common.logDir                                           : /curvebs/mds1/logs
I 2022-11-14T23:06:52.252349+0800    85 configuration.cpp:78] mds.copyset.copysetRetryTimes                               : 10
I 2022-11-14T23:06:52.252357+0800    85 configuration.cpp:78] mds.copyset.scatterWidthFloatingPercentage                  : 20
I 2022-11-14T23:06:52.252364+0800    85 configuration.cpp:78] mds.copyset.scatterWidthRange                               : 0
I 2022-11-14T23:06:52.252372+0800    85 configuration.cpp:78] mds.copyset.scatterWidthStandardDevation                    : 0
I 2022-11-14T23:06:52.252379+0800    85 configuration.cpp:78] mds.copyset.scatterWidthVariance                            : 0
I 2022-11-14T23:06:52.252386+0800    85 configuration.cpp:78] mds.copyset.scheduler.intervalSec                           : 5
I 2022-11-14T23:06:52.252393+0800    85 configuration.cpp:78] mds.curvefs.defaultChunkSize                                : 16777216
I 2022-11-14T23:06:52.252400+0800    85 configuration.cpp:78] mds.curvefs.defaultSegmentSize                              : 1073741824
I 2022-11-14T23:06:52.252408+0800    85 configuration.cpp:78] mds.curvefs.maxFileLength                                   : 21990232555520
I 2022-11-14T23:06:52.252414+0800    85 configuration.cpp:78] mds.curvefs.minFileLength                                   : 10737418240
I 2022-11-14T23:06:52.252421+0800    85 configuration.cpp:78] mds.dummy.listen.port                                       : 7700
I 2022-11-14T23:06:52.252429+0800    85 configuration.cpp:78] mds.enable.copyset.scheduler                                : true
I 2022-11-14T23:06:52.252436+0800    85 configuration.cpp:78] mds.enable.leader.scheduler                                 : true
I 2022-11-14T23:06:52.252444+0800    85 configuration.cpp:78] mds.enable.recover.scheduler                                : true
I 2022-11-14T23:06:52.252450+0800    85 configuration.cpp:78] mds.enable.replica.scheduler                                : true
I 2022-11-14T23:06:52.252457+0800    85 configuration.cpp:78] mds.etcd.dailtimeoutMs                                      : 5000
I 2022-11-14T23:06:52.252465+0800    85 configuration.cpp:78] mds.etcd.endpoint                                           : 127.0.0.1:23790,127.0.0.1:23791,127.0.0.1:23792
I 2022-11-14T23:06:52.252471+0800    85 configuration.cpp:78] mds.etcd.operation.timeoutMs                                : 5000
I 2022-11-14T23:06:52.252478+0800    85 configuration.cpp:78] mds.etcd.retry.times                                        : 3
I 2022-11-14T23:06:52.252485+0800    85 configuration.cpp:78] mds.file.expiredTimeUs                                      : 5000000
I 2022-11-14T23:06:52.252493+0800    85 configuration.cpp:78] mds.file.scanIntevalTimeUs                                  : 500000
I 2022-11-14T23:06:52.252503+0800    85 configuration.cpp:78] mds.filelock.bucketNum                                      : 8
I 2022-11-14T23:06:52.252514+0800    85 configuration.cpp:78] mds.heartbeat.clean_follower_afterMs                        : 1200000
I 2022-11-14T23:06:52.252525+0800    85 configuration.cpp:78] mds.heartbeat.intervalMs                                    : 10000
I 2022-11-14T23:06:52.252552+0800    85 configuration.cpp:78] mds.heartbeat.misstimeoutMs                                 : 30000
I 2022-11-14T23:06:52.252566+0800    85 configuration.cpp:78] mds.heartbeat.offlinetimeoutMs                              : 1800000
I 2022-11-14T23:06:52.252580+0800    85 configuration.cpp:78] mds.leader.electionTimeoutMs                                : 0
I 2022-11-14T23:06:52.252588+0800    85 configuration.cpp:78] mds.leader.scheduler.intervalSec                            : 30
I 2022-11-14T23:06:52.252596+0800    85 configuration.cpp:78] mds.leader.sessionInterSec                                  : 5
I 2022-11-14T23:06:52.252604+0800    85 configuration.cpp:78] mds.listen.addr                                             : 127.0.0.1:6700
I 2022-11-14T23:06:52.252610+0800    85 configuration.cpp:78] mds.recover.scheduler.intervalSec                           : 5
I 2022-11-14T23:06:52.252619+0800    85 configuration.cpp:78] mds.replica.scheduler.intervalSec                           : 5
I 2022-11-14T23:06:52.252625+0800    85 configuration.cpp:78] mds.schduler.operator.concurrent                            : 1
I 2022-11-14T23:06:52.252632+0800    85 configuration.cpp:78] mds.schduler.scatterWidthRangePerent                        : 0.2
I 2022-11-14T23:06:52.252638+0800    85 configuration.cpp:78] mds.schduler.transfer.limitSec                              : 60
I 2022-11-14T23:06:52.252646+0800    85 configuration.cpp:78] mds.scheduler.add.limitSec                                  : 1800
I 2022-11-14T23:06:52.252653+0800    85 configuration.cpp:78] mds.scheduler.change.limitSec                               : 1800
I 2022-11-14T23:06:52.252660+0800    85 configuration.cpp:78] mds.scheduler.chunkserver.cooling.timeSec                   : 1800
I 2022-11-14T23:06:52.252667+0800    85 configuration.cpp:78] mds.scheduler.copysetNumRangePercent                        : 0.05
I 2022-11-14T23:06:52.252676+0800    85 configuration.cpp:78] mds.scheduler.remove.limitSec                               : 300
I 2022-11-14T23:06:52.252682+0800    85 configuration.cpp:78] mds.segment.alloc.periodic.persistInterMs                   : 10000
I 2022-11-14T23:06:52.252691+0800    85 configuration.cpp:78] mds.segment.alloc.retryInterMs                              : 1000
I 2022-11-14T23:06:52.252697+0800    85 configuration.cpp:78] mds.snapshotcloneclient.addr                                :
I 2022-11-14T23:06:52.252705+0800    85 configuration.cpp:78] mds.topology.CreateCopysetRpcRetrySleepTimeMs               : 1000
I 2022-11-14T23:06:52.252713+0800    85 configuration.cpp:78] mds.topology.CreateCopysetRpcRetryTimes                     : 20
I 2022-11-14T23:06:52.252722+0800    85 configuration.cpp:78] mds.topology.CreateCopysetRpcTimeoutMs                      : 10000
I 2022-11-14T23:06:52.252728+0800    85 configuration.cpp:78] mds.topology.PoolUsagePercentLimit                          : 85
I 2022-11-14T23:06:52.252735+0800    85 configuration.cpp:78] mds.topology.TopologyUpdateToRepoSec                        : 60
I 2022-11-14T23:06:52.252743+0800    85 configuration.cpp:78] mds.topology.UpdateMetricIntervalSec                        : 60
I 2022-11-14T23:06:52.252750+0800    85 configuration.cpp:78] mds.topology.choosePoolPolicy                               : 0
I 2022-11-14T23:06:52.252758+0800    85 configuration.cpp:78] mds.topology.enableLogicalPoolStatus                        : false
I 2022-11-14T23:06:52.252766+0800    85 configuration.cpp:81] ===============================END===============================
2022-11-14 23:06:52.374076 I | current leader is: 127.0.0.1:6700[390d8476adc70204/127.0.0.1:6700]
WARNING: Logging before InitGoogleLogging() is written to STDERR
I 2022-11-14T23:06:53.240459+0800   114 configuration.cpp:76] ==============================BEGIN==============================
I 2022-11-14T23:06:53.240495+0800   114 configuration.cpp:78] global.port                                                 : 6701
I 2022-11-14T23:06:53.240499+0800   114 configuration.cpp:78] global.subnet                                               : 127.0.0.0/24
I 2022-11-14T23:06:53.240500+0800   114 configuration.cpp:78] mds.auth.rootPassword                                       : root_password
I 2022-11-14T23:06:53.240502+0800   114 configuration.cpp:78] mds.auth.rootUserName                                       : root
I 2022-11-14T23:06:53.240504+0800   114 configuration.cpp:78] mds.cache.count                                             : 100000
I 2022-11-14T23:06:53.240506+0800   114 configuration.cpp:78] mds.chunkserver.failure.tolerance                           : 3
I 2022-11-14T23:06:53.240507+0800   114 configuration.cpp:78] mds.chunkserverclient.rpcRetryIntervalMs                    : 500
I 2022-11-14T23:06:53.240509+0800   114 configuration.cpp:78] mds.chunkserverclient.rpcRetryTimes                         : 5
I 2022-11-14T23:06:53.240511+0800   114 configuration.cpp:78] mds.chunkserverclient.rpcTimeoutMs                          : 500
I 2022-11-14T23:06:53.240514+0800   114 configuration.cpp:78] mds.chunkserverclient.updateLeaderRetryIntervalMs           : 5000
I 2022-11-14T23:06:53.240515+0800   114 configuration.cpp:78] mds.chunkserverclient.updateLeaderRetryTimes                : 5
I 2022-11-14T23:06:53.240516+0800   114 configuration.cpp:78] mds.common.logDir                                           : /curvebs/mds2/logs
I 2022-11-14T23:06:53.240518+0800   114 configuration.cpp:78] mds.copyset.copysetRetryTimes                               : 10
I 2022-11-14T23:06:53.240520+0800   114 configuration.cpp:78] mds.copyset.scatterWidthFloatingPercentage                  : 20
I 2022-11-14T23:06:53.240522+0800   114 configuration.cpp:78] mds.copyset.scatterWidthRange                               : 0
I 2022-11-14T23:06:53.240525+0800   114 configuration.cpp:78] mds.copyset.scatterWidthStandardDevation                    : 0
I 2022-11-14T23:06:53.240525+0800   114 configuration.cpp:78] mds.copyset.scatterWidthVariance                            : 0
I 2022-11-14T23:06:53.240527+0800   114 configuration.cpp:78] mds.copyset.scheduler.intervalSec                           : 5
I 2022-11-14T23:06:53.240530+0800   114 configuration.cpp:78] mds.curvefs.defaultChunkSize                                : 16777216
I 2022-11-14T23:06:53.240531+0800   114 configuration.cpp:78] mds.curvefs.defaultSegmentSize                              : 1073741824
I 2022-11-14T23:06:53.240533+0800   114 configuration.cpp:78] mds.curvefs.maxFileLength                                   : 21990232555520
I 2022-11-14T23:06:53.240535+0800   114 configuration.cpp:78] mds.curvefs.minFileLength                                   : 10737418240
I 2022-11-14T23:06:53.240563+0800   114 configuration.cpp:78] mds.dummy.listen.port                                       : 7701
I 2022-11-14T23:06:53.240567+0800   114 configuration.cpp:78] mds.enable.copyset.scheduler                                : true
I 2022-11-14T23:06:53.240571+0800   114 configuration.cpp:78] mds.enable.leader.scheduler                                 : true
I 2022-11-14T23:06:53.240573+0800   114 configuration.cpp:78] mds.enable.recover.scheduler                                : true
I 2022-11-14T23:06:53.240576+0800   114 configuration.cpp:78] mds.enable.replica.scheduler                                : true
I 2022-11-14T23:06:53.240579+0800   114 configuration.cpp:78] mds.etcd.dailtimeoutMs                                      : 5000
I 2022-11-14T23:06:53.240583+0800   114 configuration.cpp:78] mds.etcd.endpoint                                           : 127.0.0.1:23790,127.0.0.1:23791,127.0.0.1:23792
I 2022-11-14T23:06:53.240586+0800   114 configuration.cpp:78] mds.etcd.operation.timeoutMs                                : 5000
I 2022-11-14T23:06:53.240587+0800   114 configuration.cpp:78] mds.etcd.retry.times                                        : 3
I 2022-11-14T23:06:53.240589+0800   114 configuration.cpp:78] mds.file.expiredTimeUs                                      : 5000000
I 2022-11-14T23:06:53.240592+0800   114 configuration.cpp:78] mds.file.scanIntevalTimeUs                                  : 500000
I 2022-11-14T23:06:53.240593+0800   114 configuration.cpp:78] mds.filelock.bucketNum                                      : 8
I 2022-11-14T23:06:53.240608+0800   114 configuration.cpp:78] mds.heartbeat.clean_follower_afterMs                        : 1200000
I 2022-11-14T23:06:53.240610+0800   114 configuration.cpp:78] mds.heartbeat.intervalMs                                    : 10000
I 2022-11-14T23:06:53.240612+0800   114 configuration.cpp:78] mds.heartbeat.misstimeoutMs                                 : 30000
I 2022-11-14T23:06:53.240614+0800   114 configuration.cpp:78] mds.heartbeat.offlinetimeoutMs                              : 1800000
I 2022-11-14T23:06:53.240617+0800   114 configuration.cpp:78] mds.leader.electionTimeoutMs                                : 0
I 2022-11-14T23:06:53.240618+0800   114 configuration.cpp:78] mds.leader.scheduler.intervalSec                            : 30
I 2022-11-14T23:06:53.240620+0800   114 configuration.cpp:78] mds.leader.sessionInterSec                                  : 5
I 2022-11-14T23:06:53.240622+0800   114 configuration.cpp:78] mds.listen.addr                                             : 127.0.0.1:6701
I 2022-11-14T23:06:53.240624+0800   114 configuration.cpp:78] mds.recover.scheduler.intervalSec                           : 5
I 2022-11-14T23:06:53.240626+0800   114 configuration.cpp:78] mds.replica.scheduler.intervalSec                           : 5
I 2022-11-14T23:06:53.240628+0800   114 configuration.cpp:78] mds.schduler.operator.concurrent                            : 1
I 2022-11-14T23:06:53.240630+0800   114 configuration.cpp:78] mds.schduler.scatterWidthRangePerent                        : 0.2
I 2022-11-14T23:06:53.240633+0800   114 configuration.cpp:78] mds.schduler.transfer.limitSec                              : 60
I 2022-11-14T23:06:53.240634+0800   114 configuration.cpp:78] mds.scheduler.add.limitSec                                  : 1800
I 2022-11-14T23:06:53.240636+0800   114 configuration.cpp:78] mds.scheduler.change.limitSec                               : 1800
I 2022-11-14T23:06:53.240638+0800   114 configuration.cpp:78] mds.scheduler.chunkserver.cooling.timeSec                   : 1800
I 2022-11-14T23:06:53.240640+0800   114 configuration.cpp:78] mds.scheduler.copysetNumRangePercent                        : 0.05
I 2022-11-14T23:06:53.240641+0800   114 configuration.cpp:78] mds.scheduler.remove.limitSec                               : 300
I 2022-11-14T23:06:53.240643+0800   114 configuration.cpp:78] mds.segment.alloc.periodic.persistInterMs                   : 10000
I 2022-11-14T23:06:53.240645+0800   114 configuration.cpp:78] mds.segment.alloc.retryInterMs                              : 1000
I 2022-11-14T23:06:53.240648+0800   114 configuration.cpp:78] mds.snapshotcloneclient.addr                                :
I 2022-11-14T23:06:53.240649+0800   114 configuration.cpp:78] mds.topology.CreateCopysetRpcRetrySleepTimeMs               : 1000
I 2022-11-14T23:06:53.240651+0800   114 configuration.cpp:78] mds.topology.CreateCopysetRpcRetryTimes                     : 20
I 2022-11-14T23:06:53.240653+0800   114 configuration.cpp:78] mds.topology.CreateCopysetRpcTimeoutMs                      : 10000
I 2022-11-14T23:06:53.240655+0800   114 configuration.cpp:78] mds.topology.PoolUsagePercentLimit                          : 85
I 2022-11-14T23:06:53.240657+0800   114 configuration.cpp:78] mds.topology.TopologyUpdateToRepoSec                        : 60
I 2022-11-14T23:06:53.240659+0800   114 configuration.cpp:78] mds.topology.UpdateMetricIntervalSec                        : 60
I 2022-11-14T23:06:53.240661+0800   114 configuration.cpp:78] mds.topology.choosePoolPolicy                               : 0
I 2022-11-14T23:06:53.240664+0800   114 configuration.cpp:78] mds.topology.enableLogicalPoolStatus                        : false
I 2022-11-14T23:06:53.240665+0800   114 configuration.cpp:81] ===============================END===============================
2022-11-14 23:06:53.292844 I | current leader is: 127.0.0.1:6700[20408476adc33f07/127.0.0.1:6701]
WARNING: Logging before InitGoogleLogging() is written to STDERR
I 2022-11-14T23:06:54.265587+0800   141 configuration.cpp:76] ==============================BEGIN==============================
I 2022-11-14T23:06:54.265695+0800   141 configuration.cpp:78] global.port                                                 : 6702
I 2022-11-14T23:06:54.265707+0800   141 configuration.cpp:78] global.subnet                                               : 127.0.0.0/24
I 2022-11-14T23:06:54.265715+0800   141 configuration.cpp:78] mds.auth.rootPassword                                       : root_password
I 2022-11-14T23:06:54.265722+0800   141 configuration.cpp:78] mds.auth.rootUserName                                       : root
I 2022-11-14T23:06:54.265729+0800   141 configuration.cpp:78] mds.cache.count                                             : 100000
I 2022-11-14T23:06:54.265736+0800   141 configuration.cpp:78] mds.chunkserver.failure.tolerance                           : 3
I 2022-11-14T23:06:54.265743+0800   141 configuration.cpp:78] mds.chunkserverclient.rpcRetryIntervalMs                    : 500
I 2022-11-14T23:06:54.265750+0800   141 configuration.cpp:78] mds.chunkserverclient.rpcRetryTimes                         : 5
I 2022-11-14T23:06:54.265758+0800   141 configuration.cpp:78] mds.chunkserverclient.rpcTimeoutMs                          : 500
I 2022-11-14T23:06:54.265769+0800   141 configuration.cpp:78] mds.chunkserverclient.updateLeaderRetryIntervalMs           : 5000
I 2022-11-14T23:06:54.265780+0800   141 configuration.cpp:78] mds.chunkserverclient.updateLeaderRetryTimes                : 5
I 2022-11-14T23:06:54.265790+0800   141 configuration.cpp:78] mds.common.logDir                                           : /curvebs/mds3/logs
I 2022-11-14T23:06:54.265801+0800   141 configuration.cpp:78] mds.copyset.copysetRetryTimes                               : 10
I 2022-11-14T23:06:54.265813+0800   141 configuration.cpp:78] mds.copyset.scatterWidthFloatingPercentage                  : 20
I 2022-11-14T23:06:54.265825+0800   141 configuration.cpp:78] mds.copyset.scatterWidthRange                               : 0
I 2022-11-14T23:06:54.265849+0800   141 configuration.cpp:78] mds.copyset.scatterWidthStandardDevation                    : 0
I 2022-11-14T23:06:54.265864+0800   141 configuration.cpp:78] mds.copyset.scatterWidthVariance                            : 0
I 2022-11-14T23:06:54.265877+0800   141 configuration.cpp:78] mds.copyset.scheduler.intervalSec                           : 5
I 2022-11-14T23:06:54.265888+0800   141 configuration.cpp:78] mds.curvefs.defaultChunkSize                                : 16777216
I 2022-11-14T23:06:54.265902+0800   141 configuration.cpp:78] mds.curvefs.defaultSegmentSize                              : 1073741824
I 2022-11-14T23:06:54.265913+0800   141 configuration.cpp:78] mds.curvefs.maxFileLength                                   : 21990232555520
I 2022-11-14T23:06:54.265926+0800   141 configuration.cpp:78] mds.curvefs.minFileLength                                   : 10737418240
I 2022-11-14T23:06:54.265938+0800   141 configuration.cpp:78] mds.dummy.listen.port                                       : 7702
I 2022-11-14T23:06:54.265956+0800   141 configuration.cpp:78] mds.enable.copyset.scheduler                                : true
I 2022-11-14T23:06:54.265970+0800   141 configuration.cpp:78] mds.enable.leader.scheduler                                 : true
I 2022-11-14T23:06:54.265982+0800   141 configuration.cpp:78] mds.enable.recover.scheduler                                : true
I 2022-11-14T23:06:54.265993+0800   141 configuration.cpp:78] mds.enable.replica.scheduler                                : true
I 2022-11-14T23:06:54.266005+0800   141 configuration.cpp:78] mds.etcd.dailtimeoutMs                                      : 5000
I 2022-11-14T23:06:54.266017+0800   141 configuration.cpp:78] mds.etcd.endpoint                                           : 127.0.0.1:23790,127.0.0.1:23791,127.0.0.1:23792
I 2022-11-14T23:06:54.266029+0800   141 configuration.cpp:78] mds.etcd.operation.timeoutMs                                : 5000
I 2022-11-14T23:06:54.266039+0800   141 configuration.cpp:78] mds.etcd.retry.times                                        : 3
I 2022-11-14T23:06:54.266047+0800   141 configuration.cpp:78] mds.file.expiredTimeUs                                      : 5000000
I 2022-11-14T23:06:54.266054+0800   141 configuration.cpp:78] mds.file.scanIntevalTimeUs                                  : 500000
I 2022-11-14T23:06:54.266062+0800   141 configuration.cpp:78] mds.filelock.bucketNum                                      : 8
I 2022-11-14T23:06:54.266068+0800   141 configuration.cpp:78] mds.heartbeat.clean_follower_afterMs                        : 1200000
I 2022-11-14T23:06:54.266075+0800   141 configuration.cpp:78] mds.heartbeat.intervalMs                                    : 10000
I 2022-11-14T23:06:54.266083+0800   141 configuration.cpp:78] mds.heartbeat.misstimeoutMs                                 : 30000
I 2022-11-14T23:06:54.266089+0800   141 configuration.cpp:78] mds.heartbeat.offlinetimeoutMs                              : 1800000
I 2022-11-14T23:06:54.266095+0800   141 configuration.cpp:78] mds.leader.electionTimeoutMs                                : 0
I 2022-11-14T23:06:54.266103+0800   141 configuration.cpp:78] mds.leader.scheduler.intervalSec                            : 30
I 2022-11-14T23:06:54.266110+0800   141 configuration.cpp:78] mds.leader.sessionInterSec                                  : 5
I 2022-11-14T23:06:54.266116+0800   141 configuration.cpp:78] mds.listen.addr                                             : 127.0.0.1:6702
I 2022-11-14T23:06:54.266124+0800   141 configuration.cpp:78] mds.recover.scheduler.intervalSec                           : 5
I 2022-11-14T23:06:54.266130+0800   141 configuration.cpp:78] mds.replica.scheduler.intervalSec                           : 5
I 2022-11-14T23:06:54.266139+0800   141 configuration.cpp:78] mds.schduler.operator.concurrent                            : 1
I 2022-11-14T23:06:54.266144+0800   141 configuration.cpp:78] mds.schduler.scatterWidthRangePerent                        : 0.2
I 2022-11-14T23:06:54.266151+0800   141 configuration.cpp:78] mds.schduler.transfer.limitSec                              : 60
I 2022-11-14T23:06:54.266158+0800   141 configuration.cpp:78] mds.scheduler.add.limitSec                                  : 1800
I 2022-11-14T23:06:54.266165+0800   141 configuration.cpp:78] mds.scheduler.change.limitSec                               : 1800
I 2022-11-14T23:06:54.266172+0800   141 configuration.cpp:78] mds.scheduler.chunkserver.cooling.timeSec                   : 1800
I 2022-11-14T23:06:54.266180+0800   141 configuration.cpp:78] mds.scheduler.copysetNumRangePercent                        : 0.05
I 2022-11-14T23:06:54.266186+0800   141 configuration.cpp:78] mds.scheduler.remove.limitSec                               : 300
I 2022-11-14T23:06:54.266193+0800   141 configuration.cpp:78] mds.segment.alloc.periodic.persistInterMs                   : 10000
I 2022-11-14T23:06:54.266201+0800   141 configuration.cpp:78] mds.segment.alloc.retryInterMs                              : 1000
I 2022-11-14T23:06:54.266208+0800   141 configuration.cpp:78] mds.snapshotcloneclient.addr                                :
I 2022-11-14T23:06:54.266216+0800   141 configuration.cpp:78] mds.topology.CreateCopysetRpcRetrySleepTimeMs               : 1000
I 2022-11-14T23:06:54.266222+0800   141 configuration.cpp:78] mds.topology.CreateCopysetRpcRetryTimes                     : 20
I 2022-11-14T23:06:54.266228+0800   141 configuration.cpp:78] mds.topology.CreateCopysetRpcTimeoutMs                      : 10000
I 2022-11-14T23:06:54.266235+0800   141 configuration.cpp:78] mds.topology.PoolUsagePercentLimit                          : 85
I 2022-11-14T23:06:54.266242+0800   141 configuration.cpp:78] mds.topology.TopologyUpdateToRepoSec                        : 60
I 2022-11-14T23:06:54.266249+0800   141 configuration.cpp:78] mds.topology.UpdateMetricIntervalSec                        : 60
I 2022-11-14T23:06:54.266256+0800   141 configuration.cpp:78] mds.topology.choosePoolPolicy                               : 0
I 2022-11-14T23:06:54.266263+0800   141 configuration.cpp:78] mds.topology.enableLogicalPoolStatus                        : false
I 2022-11-14T23:06:54.266270+0800   141 configuration.cpp:81] ===============================END===============================
2022-11-14 23:06:54.341395 I | current leader is: 127.0.0.1:6700[4f738476adcae808/127.0.0.1:6702]
WARNING: Logging before InitGoogleLogging() is written to STDERR
I 2022-11-14T23:06:55.253209+0800   168 chunkserver_main.cpp:28] ChunkServer starting.
I 2022-11-14T23:06:55.253295+0800   168 chunkserver.cpp:88] Loading Configuration.
WARNING: Logging before InitGoogleLogging() is written to STDERR
I 2022-11-14T23:06:56.261626+0800   293 chunkserver_main.cpp:28] ChunkServer starting.
I 2022-11-14T23:06:56.261762+0800   293 chunkserver.cpp:88] Loading Configuration.
WARNING: Logging before InitGoogleLogging() is written to STDERR
I 2022-11-14T23:06:57.285199+0800   418 chunkserver_main.cpp:28] ChunkServer starting.
I 2022-11-14T23:06:57.285470+0800   418 chunkserver.cpp:88] Loading Configuration.
2022-11-14 23:06:59.309894 I | current leader is: 127.0.0.1:6700[4f738476adcae808/127.0.0.1:6702]
2022-11-14 23:06:59.310819 I | [127.0.0.1:6700/390d8476adc70204] campaign for leader success
2022-11-14 23:06:59.311008 I | [390d8476adc70204/127.0.0.1:6700]stop watch current leader
2022-11-14 23:06:59.311057 I | wait session done recieve existSignal[390d8476adc70204/127.0.0.1:6700]
{"level":"warn","ts":"2022-11-14T23:06:59.311+0800","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-ba31a269-a836-4afb-b380-c70212f25818/127.0.0.1:23790","attempt":0,"error":"rpc error: code = Canceled desc = context canceled"}
2022-11-14 23:07:00.291066 I | current leader is: 127.0.0.1:6700[20408476adc33f07/127.0.0.1:6701]
curve-nbd: ignoring kernel module parameter options: nbd module already loaded. nbds_max: 16, set_max_part: 0
Cyber-SiKu commented 1 year ago

It seems that the main mds did not receive the request.

tsonglew commented 1 year ago

It seems that the main mds did not receive the request.

mdsaddr in curve bs list server --mdsaddr 127.0.0.1:6701 is parsed as [127.0.0.1:6701], because CURVEBS_MDSADDR is defined as a string slice option in config/bs.go. Should mdsaddr be a string option ?(CURVEBS_MDSDUMMYADDR is in the same situation)

image image

and GetRpcResponse dials [127.0.0.1:6701] but not 127.0.0.1:6701, which is an invalid address

image

I fix this in my forked repo, and it works find now.

image
tsonglew commented 1 year ago

pr in https://github.com/opencurve/curve/pull/2076

https://github.com/opencurve/curve/blob/8e7099f95728be3cc080a2aa9a6eaf0844c759d6/tools-v2/pkg/config/bs.go#L113