vesoft-inc / nebula

A distributed, fast open-source graph database featuring horizontal scalability and high availability
https://nebula-graph.io
Apache License 2.0
10.83k stars 1.2k forks source link

storage container cannot startup correctly #5848

Open ruifengma opened 7 months ago

ruifengma commented 7 months ago

after docker-compose up, the containers status are all good except 3 storage containers and the following are the log, what should I do? Thanks

Log file created at: 2024/04/02 02:03:44
Running on machine: 0ce185995012
Running duration (h:mm:ss): 0:00:00
Log line format: [IWEF]yyyymmdd hh:mm:ss.uuuuuu threadid file:line] msg
I20240402 02:03:44.992156     1 StorageDaemon.cpp:132] localhost = "storaged0":9779
I20240402 02:03:44.992297     1 StorageDaemon.cpp:147] data path= /data/storage
I20240402 02:03:44.997619     1 MetaClient.cpp:80] Create meta client to "metad0":9559
I20240402 02:03:44.997635     1 MetaClient.cpp:81] root path: /usr/local/nebula, data path size: 1
W20240402 02:03:44.997653     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:03:45.008289    48 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:03:48.020865     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:03:48.020970     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:03:58.021052     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:03:58.021605    54 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:04:01.032883     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:04:01.032908     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:04:11.032986     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:04:11.033540    55 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:04:14.045516     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:04:14.045539     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:04:24.045619     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:04:24.046185    56 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:04:27.080615     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:04:27.080644     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:04:37.080724     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:04:37.081044    57 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:04:40.092646     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:04:40.092679     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:04:50.092762     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:04:50.093137    58 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:04:53.104943     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:04:53.104977     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:05:03.105060     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:05:03.105420    59 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:05:06.117063     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:05:06.117095     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:05:16.117172     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:05:16.117547    60 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:05:19.129168     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:05:19.129199     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:05:29.129279     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:05:29.129603    61 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:05:32.141197     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:05:32.141229     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:05:42.141327     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:05:42.141690    62 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:05:45.152359     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:05:45.152393     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:05:55.152477     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:05:55.152825    63 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:05:58.164376     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:05:58.164405     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:06:08.164492     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:06:08.164883    64 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:06:11.176471     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:06:11.176498     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:06:21.176579     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:06:21.176919    72 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:06:24.188560     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:06:24.188596     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:06:34.188678     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:06:34.189024    73 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:06:37.200625     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:06:37.200651     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:06:47.200732     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:06:47.201094    74 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:06:50.212710     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:06:50.212743     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:07:00.212836     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
I20240402 02:07:00.213227    75 ThriftClientManager-inl.h:67] resolve "metad1":9559 as "172.25.0.2":9559
E20240402 02:07:03.224970     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:07:03.225262     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:07:13.225344     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
E20240402 02:07:16.236421     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:07:16.236456     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:07:26.236536     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
E20240402 02:07:29.249050     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:07:29.249091     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:07:39.249176     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
E20240402 02:07:42.260838     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:07:42.260890     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:07:52.260969     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
E20240402 02:07:55.272630     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:07:55.272658     1 MetaClient.cpp:137] Waiting for the metad to be ready!
W20240402 02:08:05.272738     1 FileBasedClusterIdMan.cpp:43] Open file failed, error No such file or directory
E20240402 02:08:08.284279     1 MetaClient.cpp:112] Heartbeat failed, status:Machine not existed!
I20240402 02:08:08.284307     1 MetaClient.cpp:137] Waiting for the metad to be ready!
QingZ11 commented 7 months ago

Is your deployment the docker-compose deployment referring to the documentation? Any configuration files modified during the process?

ruifengma commented 7 months ago

Thanks @QingZ11 for the reply. No, I did not modify anything from configuration files. I completly followed the instruction.

QingZ11 commented 7 months ago

Well, you can try starting all the meta services from the Docker side before starting other services. According to the documentation example, there should be three meta services: meta0-1, meta1-1, and meta2-1.