search

datafuselabs / databend

𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com
https://docs.databend.com
Other
7.71k stars 730 forks source link

The background service automatically shut down when i exit the terminal #8382

Open thermal-life opened 1 year ago

thermal-life commented 1 year ago

Summary i'm use nohup bin/databend-meta --config-file=configs/databend-meta.toml 2>&1 >meta.log & to start meta service,but when i exit the terminal, the meta service will shut down automatically. nohup command doesn't work. same situation as databend-query service.

there're some log mesage:

{"v":0,"name":"databend-meta","msg":"shutdown raft","level":30,"hostname":"10-182-1-93","pid":1974,"time":"2022-10-20T13:55:45.671578869Z","target":"databend_meta::meta_service::raftmeta","line":406,"file":"src/meta/service/src/meta_service/raftmeta.rs"}
{"v":0,"name":"databend-meta","msg":"signal received, shutting down: id=1 0.0.0.0:28103 ","level":30,"hostname":"10-182-1-93","pid":1974,"time":"2022-10-20T13:55:45.671586834Z","target":"databend_meta::meta_service::raftmeta","line":311,"file":"src/meta/service/src/meta_service/raftmeta.rs"}
{"v":0,"name":"databend-meta","msg":"[WATCH-METRICS - EVENT] channel closed when watching metrics_rx","level":50,"hostname":"10-182-1-93","pid":1974,"time":"2022-10-20T13:55:45.671582948Z","target":"databend_meta::meta_service::raftmeta","line":439,"file":"src/meta/service/src/meta_service/raftmeta.rs"}
{"v":0,"name":"databend-meta","msg":"[WATCH-METRICS - END]","level":30,"hostname":"10-182-1-93","pid":1974,"time":"2022-10-20T13:55:45.671599095Z","target":"databend_meta::meta_service::raftmeta","line":475,"file":"src/meta/service/src/meta_service/raftmeta.rs"}
{"v":0,"name":"databend-meta","msg":"task quit res: Ok(Ok(()))","level":30,"hostname":"10-182-1-93","pid":1974,"time":"2022-10-20T13:55:45.671633722Z","target":"databend_meta::meta_service::raftmeta","line":410,"file":"src/meta/service/src/meta_service/raftmeta.rs"}
{"v":0,"name":"databend-meta","msg":"task quit res: Ok(Ok(()))","level":30,"hostname":"10-182-1-93","pid":1974,"time":"2022-10-20T13:55:45.671647663Z","target":"databend_meta::meta_service::raftmeta","line":410,"file":"src/meta/service/src/meta_service/raftmeta.rs"}
{"v":0,"name":"databend-meta","msg":"shutdown: id=1","level":30,"hostname":"10-182-1-93","pid":1974,"time":"2022-10-20T13:55:45.671652189Z","target":"databend_meta::meta_service::raftmeta","line":422,"file":"src/meta/service/src/meta_service/raftmeta.rs"}
{"v":0,"name":"databend-meta","msg":"metasrv sending signal of finishing shutdown 0.0.0.0:9191, res: Ok(())","level":30,"hostname":"10-182-1-93","pid":1974,"time":"2022-10-20T13:55:45.671663077Z","target":"databend_meta::api::grpc_server","line":123,"file":"src/meta/service/src/api/grpc_server.rs"}
{"v":0,"name":"databend-meta","msg":"metasrv returned res: Ok(())","level":30,"hostname":"10-182-1-93","pid":1974,"time":"2022-10-20T13:55:45.671667293Z","target":"databend_meta::api::grpc_server","line":128,"file":"src/meta/service/src/api/grpc_server.rs"}
{"v":0,"name":"databend-meta","msg":"Done: graceful shutdown","level":30,"hostname":"10-182-1-93","pid":1974,"time":"2022-10-20T13:55:45.671697852Z","target":"databend_meta::api::grpc_server","line":161,"file":"src/meta/service/src/api/grpc_server.rs"}
{"v":0,"name":"databend-meta","msg":"Done: block waiting for fin_rx: res: Ok(())","level":30,"hostname":"10-182-1-93","pid":1974,"time":"2022-10-20T13:55:45.671717656Z","target":"databend_meta::api::grpc_server","line":174,"file":"src/meta/service/src/api/grpc_server.rs"}
{"v":0,"name":"databend-meta","msg":"Done GrpcServer::stop","level":30,"hostname":"10-182-1-93","pid":1974,"time":"2022-10-20T13:55:45.671722551Z","target":"databend_meta::api::grpc_server","line":208,"file":"src/meta/service/src/api/grpc_server.rs"}
{"v":0,"name":"databend-meta","msg":"Databend-meta is done shutting down","level":30,"hostname":"10-182-1-93","pid":1974,"time":"2022-10-20T13:55:45.671753547Z","target":"databend_meta","line":148,"file":"src/binaries/meta/main.rs"}
wubx commented 1 year ago

Need to to be improved!

Here's a temporary solution:

  1. use tmux & screen startup
  2. use shell scritp for startup 
    start.sh
nohup bin/databend-meta --config-file=configs/databend-meta.toml 2>&1 >meta.log &

    exec: chmod +x start.sh ./start.sh

You can found demo https://github.com/datafuselabs/databend/blob/main/scripts/ci/deploy/databend-query-management-mode.sh

Xuanwo commented 1 year ago

related to https://github.com/datafuselabs/databend/issues/7482