Thanks for opening an issue for the M3DB Operator! We'd love to help you, but we need the following information included
with any issue:
What version of the operator are you running? Please include the docker tag. If using master, please include the git
SHA logged when the operator first starts.
m3db-operator 0.10.0
What version of Kubernetes are you running? Please include the output of kubectl version.
v1.11.10
What are you trying to do?
What did you expect to happen?
Normal bootstrap and initialize shards
Bootstrap and shards cannot be initialized normally after pod and configmap are created
m3db-operator shows current unavailable instances, m3db shows no bootstrap and shards
m3db log
{"level":"info","ts":1603975525.0615256,"msg":"no m3msg server configured"}
{"level":"info","ts":1603975525.061538,"msg":"using registered interrupt handler"}
{"level":"info","ts":1603975525.0615675,"msg":"starting API server","address":"[::]:7201"}
{"level":"info","ts":1603975526.6106744,"msg":"tracing disabled; set `tracing.backend` to enable"}
{"level":"info","ts":1603975526.6107037,"msg":"no seed nodes set, using dedicated etcd cluster"}
{"level":"warn","ts":1603975529.2892141,"msg":"max index query IDs concurrency was not set, falling back to default value"}
{"level":"warn","ts":1603975529.289353,"msg":"host doesn't support HugeTLB, proceeding without it"}
{"level":"info","ts":1603975529.3279648,"msg":"set thrift bytes pool alloc size","size":2048}
{"level":"info","ts":1603975529.328014,"msg":"bytes pool configured","capacity":16,"size":524288,"refillLowWaterMark":0.3,"refillHighWaterMark":0.6}
{"level":"info","ts":1603975529.328026,"msg":"bytes pool configured","capacity":32,"size":262144,"refillLowWaterMark":0.3,"refillHighWaterMark":0.6}
{"level":"info","ts":1603975529.3280313,"msg":"bytes pool configured","capacity":64,"size":131072,"refillLowWaterMark":0.3,"refillHighWaterMark":0.6}
{"level":"info","ts":1603975529.328036,"msg":"bytes pool configured","capacity":128,"size":65536,"refillLowWaterMark":0.3,"refillHighWaterMark":0.6}
{"level":"info","ts":1603975529.3280413,"msg":"bytes pool configured","capacity":256,"size":65536,"refillLowWaterMark":0.3,"refillHighWaterMark":0.6}
{"level":"info","ts":1603975529.3280458,"msg":"bytes pool configured","capacity":1440,"size":16384,"refillLowWaterMark":0.3,"refillHighWaterMark":0.6}
{"level":"info","ts":1603975529.3280504,"msg":"bytes pool configured","capacity":4096,"size":8192,"refillLowWaterMark":0.3,"refillHighWaterMark":0.6}
{"level":"info","ts":1603975529.328117,"msg":"bytes pool init start"}
{"level":"info","ts":1603975529.951818,"msg":"bytes pool init end"}
{"level":"info","ts":1603975530.1808083,"msg":"creating dynamic config service client with m3cluster"}
{"level":"info","ts":1603975530.1822543,"msg":"successfully created new cache dir","path":"/var/lib/m3kv","mode":493}
{"level":"warn","ts":1603975530.1822956,"msg":"could not load cache from file","file":"/var/lib/m3kv/_kv_monitoring_m3db-cluster_m3db_embedded.json","error":"error opening cache file /var/lib/m3kv/_kv_monitoring_m3db-cluster_m3db_embedded.json: open /var/lib/m3kv/_kv_monitoring_m3db-cluster_m3db_embedded.json: no such file or directory"}
{"level":"info","ts":1603975530.5168633,"msg":"node tchannelthrift: listening","address":"0.0.0.0:9000"}
{"level":"info","ts":1603975530.517485,"msg":"node httpjson: listening","address":"0.0.0.0:9002"}
{"level":"info","ts":1603975530.5175393,"msg":"waiting for dynamic topology initialization, if this takes a long time, make sure that a topology/placement is configured"}
{"level":"info","ts":1603975530.5175579,"msg":"adding a watch","service":"m3db","env":"monitoring/m3db-cluster","zone":"embedded","includeUnhealthy":true}
{"level":"info","ts":1603975530.5176663,"msg":"successfully created new cache dir","path":"/var/lib/m3kv","mode":493}
{"level":"warn","ts":1603975530.517716,"msg":"could not load cache from file","file":"/var/lib/m3kv/m3db_embedded.json","error":"error opening cache file /var/lib/m3kv/m3db_embedded.json: open /var/lib/m3kv/m3db_embedded.json: no such file or directory"}
{"level":"warn","ts":1603975534.6081727,"msg":"invalid configuration found, refer to linked documentation for more information","url":"https://docs.m3db.io/operational_guide/kernel_configuration","error":"current value for RLIMIT_NOFILE(1048576) is below recommended threshold(3000000)\nmax value for RLIMIT_NOFILE(1048576) is below recommended threshold(3000000)\ncurrent value for vm.max_map_count(655360) is below recommended threshold(3000000)","errorCauses":[{"error":"current value for vm.max_map_count(655360) is below recommended threshold(3000000)"},{"error":"current value for RLIMIT_NOFILE(1048576) is below recommended threshold(3000000)"},{"error":"max value for RLIMIT_NOFILE(1048576) is below recommended threshold(3000000)"}]}
{"level":"info","ts":1603975543.699024,"msg":"successfully created new cache dir","path":"/var/lib/m3kv","mode":493}
{"level":"warn","ts":1603975543.6991584,"msg":"could not load cache from file","file":"/var/lib/m3kv/_kv_monitoring_m3db-cluster-without-etcd_m3db_embedded.json","error":"error opening cache file /var/lib/m3kv/_kv_monitoring_m3db-cluster-without-etcd_m3db_embedded.json: open /var/lib/m3kv/_kv_monitoring_m3db-cluster-without-etcd_m3db_embedded.json: no such file or directory"}
gemiit
commented
3 years ago 
Thanks for opening an issue for the M3DB Operator! We'd love to help you, but we need the following information included with any issue:
What version of the operator are you running? Please include the docker tag. If using
master, please include the git SHA logged when the operator first starts. m3db-operator 0.10.0What version of Kubernetes are you running? Please include the output of
kubectl version. v1.11.10What are you trying to do?
What did you expect to happen? Normal bootstrap and initialize shards
What happened?
my configmap
my m3db-cluster
Bootstrap and shards cannot be initialized normally after pod and configmap are created m3db-operator shows current unavailable instances, m3db shows no bootstrap and shards
m3db log
m3db-operator log
m3db-operator not support etcd ssl