executor can still initialize when meta is not accessible

[CharlesCheung96]

What did you do?

Start an excecutor

What did you expect to see?

Excecutor successfully started or exited with an error

What did you see instead?

executor can still initialize when meta is not accessible

$ ./tiflow executor --name=server-executor --advertise-addr=[172.31.52.61:10241](http://172.31.52.61:10241/) --join=[172.31.52.193:10240](http://172.31.52.193:10240/) --config=./executor.toml --addr=[0.0.0.0:10241](http://0.0.0.0:10241/)
[2022/10/28 07:07:49.302 +00:00] [INFO] [version.go:47] ["Welcome to TiFlow Executor"] [release-version=v6.3.0-master] [git-hash=6baa8bb9c84c92b2fbea1232b9dc22ec1d11be19] [git-branch=master] [utc-build-time="2022-10-27 03:27:58"] [go-version="go version go1.19.2 linux/amd64"] [failpoint-build=false]
[2022/10/28 07:07:49.303 +00:00] [INFO] [server.go:100] ["creating executor"] [config="{\"name\":\"server-executor\",\"log\":{\"level\":\"debug\",\"file\":\"\",\"max-size\":0,\"max-days\":0,\"max-backups\":0,\"error-output\":\"\"},\"join\":\"[172.31.52.193:10240](http://172.31.52.193:10240/)\",\"addr\":\"[0.0.0.0:10241](http://0.0.0.0:10241/)\",\"advertise-addr\":\"[172.31.52.61:10241](http://172.31.52.61:10241/)\",\"labels\":null,\"enable-gc-tuning\":true,\"keepalive-ttl\":\"20s\",\"keepalive-interval\":\"500ms\",\"rpc-timeout\":\"3s\",\"security\":null}"]
[2022/10/28 07:07:49.304 +00:00] [INFO] [registry.go:68] ["register worker"] [worker-type=CVSTask]
[2022/10/28 07:07:49.304 +00:00] [INFO] [registry.go:68] ["register worker"] [worker-type=CVSJobMaster]
[2022/10/28 07:07:49.304 +00:00] [INFO] [registry.go:68] ["register worker"] [worker-type=DMJobMaster]
[2022/10/28 07:07:49.304 +00:00] [INFO] [registry.go:68] ["register worker"] [worker-type=DMDumpTask]
[2022/10/28 07:07:49.304 +00:00] [INFO] [registry.go:68] ["register worker"] [worker-type=DMLoadTask]
[2022/10/28 07:07:49.304 +00:00] [INFO] [registry.go:68] ["register worker"] [worker-type=DMSyncTask]
[2022/10/28 07:07:49.304 +00:00] [INFO] [registry.go:68] ["register worker"] [worker-type=FakeJobMaster]
[2022/10/28 07:07:49.304 +00:00] [INFO] [registry.go:68] ["register worker"] [worker-type=FakeTask]
[2022/10/28 07:07:49.304 +00:00] [INFO] [server.go:402] ["set memory threshold to GC tuner"] ["memory limit"=986931200] [threshold=690851840]
[2022/10/28 07:07:49.304 +00:00] [INFO] [server.go:611] ["master client init successful"] [server-addrs=[172.31.52.193:10240](http://172.31.52.193:10240/)]
[2022/10/28 07:07:49.314 +00:00] [INFO] [server.go:633] ["register successful"] [executor-id=server-executor-620fcfba]
[2022/10/28 07:07:49.315 +00:00] [INFO] [file_manager.go:285] ["Configured local file directory does not existing, try to create one"] [dir=/tmp/dfe-storage/server-executor-620fcfba]
[2022/10/28 07:07:49.315 +00:00] [INFO] [file_manager.go:300] ["Local file directory disk info"] [disk-info="{All: 28GB; Used: 1GB; Free: 27GB; Available: 27GB; Available Percentage: 96.42857%}"]
[2022/10/28 07:07:49.315 +00:00] [DEBUG] [file_manager.go:313] ["pre-checking s3Storage config"] [config="{\"endpoint\":\"\",\"region\":\"\",\"storage-class\":\"\",\"sse\":\"\",\"sse-kms-key-id\":\"\",\"acl\":\"\",\"access-key\":\"\",\"secret-access-key\":\"\",\"provider\":\"\",\"force-path-style\":true,\"use-accelerate-endpoint\":false,\"role-arn\":\"\",\"external-id\":\"\",\"object-lock-enabled\":false,\"bucket\":\"tiflow-test\",\"prefix\":\"\"}"]
[2022/10/28 07:07:49.599 +00:00] [INFO] [s3.go:384] ["succeed to get bucket region from s3"] ["bucket region"=us-west-2]
[2022/10/28 07:07:49.599 +00:00] [INFO] [broker.go:102] ["Create new resource broker"] [executor-id=server-executor-620fcfba] [config="{\"local\":{\"base-dir\":\"/tmp/dfe-storage/server-executor-620fcfba\"},\"s3\":{\"endpoint\":\"\",\"region\":\"\",\"storage-class\":\"\",\"sse\":\"\",\"sse-kms-key-id\":\"\",\"acl\":\"\",\"access-key\":\"\",\"secret-access-key\":\"\",\"provider\":\"\",\"force-path-style\":true,\"use-accelerate-endpoint\":false,\"role-arn\":\"\",\"external-id\":\"\",\"object-lock-enabled\":false,\"bucket\":\"tiflow-test\",\"prefix\":\"\"}}"]
[2022/10/28 07:07:49.664 +00:00] [INFO] [s3.go:384] ["succeed to get bucket region from s3"] ["bucket region"=us-west-2]
[2022/10/28 07:07:49.857 +00:00] [INFO] [server.go:566] ["listen address"] [addr=[0.0.0.0:10241](http://0.0.0.0:10241/)]
[2022/10/28 07:07:49.857 +00:00] [INFO] [metastore.go:141] ["Obtained framework metastore endpoint"] [addr="{\"store-id\":\"_root\",\"store-type\":\"mysql\",\"endpoints\":[\"localhost:3306\"],\"user\":\"root\",\"password\":\"\",\"schema\":\"test_framework\",\"read-timeout\":\"3s\",\"write-timeout\":\"3s\",\"dial-timeout\":\"3s\",\"dbconfs\":{\"conn-max-idle-time\":60000000000,\"conn-max-life-time\":43200000000000,\"max-idle-conns\":3,\"max-open-conns\":7},\"security\":null}"]
[2022/10/28 07:07:49.858 +00:00] [INFO] [metastore.go:161] ["Obtained business metastore endpoint"] [addr="{\"store-id\":\"_default\",\"store-type\":\"mysql\",\"endpoints\":[\"localhost:3306\"],\"user\":\"root\",\"password\":\"\",\"schema\":\"test_business\",\"read-timeout\":\"3s\",\"write-timeout\":\"3s\",\"dial-timeout\":\"3s\",\"dbconfs\":{\"conn-max-idle-time\":60000000000,\"conn-max-life-time\":43200000000000,\"max-idle-conns\":3,\"max-open-conns\":7},\"security\":null}"]
[2022/10/28 07:07:49.860 +00:00] [DEBUG] [server.go:483] ["update p2p msg router"] [event="{\"Tp\":\"add\",\"Node\":{\"Tp\":\"master\",\"ID\":\"server-master-94416335\",\"Addr\":\"[172.31.52.193:10240](http://172.31.52.193:10240/)\"}}"]
[2022/10/28 07:07:49.860 +00:00] [DEBUG] [server.go:483] ["update p2p msg router"] [event="{\"Tp\":\"add\",\"Node\":{\"Tp\":\"executor\",\"ID\":\"server-executor-620fcfba\",\"Addr\":\"[172.31.52.61:10241](http://172.31.52.61:10241/)\"}}"]
[2022/10/28 07:07:49.860 +00:00] [DEBUG] [server.go:483] ["update p2p msg router"] [event="{\"Tp\":\"add\",\"Node\":{\"Tp\":\"executor\",\"ID\":\"server-executor-eeb738e7\",\"Addr\":\"[172.31.52.61:10241](http://172.31.52.61:10241/)\"}}"]
[2022/10/28 07:07:49.860 +00:00] [DEBUG] [server.go:523] ["update executor client group"] [event="{\"Tp\":\"add\",\"Node\":{\"Tp\":\"executor\",\"ID\":\"server-executor-620fcfba\",\"Addr\":\"[172.31.52.61:10241](http://172.31.52.61:10241/)\"}}"]
[2022/10/28 07:07:49.860 +00:00] [INFO] [executor_group.go:241] ["executor client added"] [executor-id=server-executor-620fcfba] [address=[172.31.52.61:10241](http://172.31.52.61:10241/)]
[2022/10/28 07:07:49.860 +00:00] [DEBUG] [server.go:523] ["update executor client group"] [event="{\"Tp\":\"add\",\"Node\":{\"Tp\":\"executor\",\"ID\":\"server-executor-eeb738e7\",\"Addr\":\"[172.31.52.61:10241](http://172.31.52.61:10241/)\"}}"]
[2022/10/28 07:07:49.860 +00:00] [INFO] [executor_group.go:241] ["executor client added"] [executor-id=server-executor-eeb738e7] [address=[172.31.52.61:10241](http://172.31.52.61:10241/)]
[2022/10/28 07:07:50.359 +00:00] [INFO] [server.go:692] ["heartbeat success"] [leader=[172.31.52.193:10240](http://172.31.52.193:10240/)] [members="[[172.31.52.193:10240](http://172.31.52.193:10240/)]"]
[2022/10/28 07:07:54.860 +00:00] [INFO] [leader_resolver.go:190] ["leader resolver state updated"] [server-list="{\"[172.31.52.193:10240](http://172.31.52.193:10240/)\":true}"]
[2022/10/28 07:07:55.360 +00:00] [INFO] [server.go:692] ["heartbeat success"] [leader=[172.31.52.193:10240](http://172.31.52.193:10240/)] [members="[[172.31.52.193:10240](http://172.31.52.193:10240/)]"]
[2022/10/28 07:08:00.787 +00:00] [ERROR] [gorm.go:206] ["failed to initialize database, got error dial tcp [127.0.0.1:3306](http://127.0.0.1:3306/): connect: connection refused"] [component=gorm]

Versions of the cluster

Dataflow Engine version (run tiflow version):

(paste Dataflow Engine version here)

[CharlesCheung96]

/severity minor

[CharlesCheung96]

/cc @amyangfei /cc @maxshuang

[sleepymole]

meta is not accessible

Is meta accessible for servermaster?

[CharlesCheung96]

meta is not accessible

Is meta accessible for servermaster?

Yes.