cp: cannot stat '/vt/bin/mysqlctld': No such file or directory

[droslean]

NAME                                           READY   STATUS                  RESTARTS   AGE
my-db-etcd-ef78da7d-1                          1/1     Running                 0          7d15h
my-db-etcd-ef78da7d-2                          1/1     Running                 0          7d15h
my-db-etcd-ef78da7d-3                          1/1     Running                 0          7d15h
my-db-vttablet-zone1-1407048482-bd9db5f2       0/3     Init:CrashLoopBackOff   5          4m19s
my-db-vttablet-zone1-1563904368-16ebd7f6       0/3     Init:CrashLoopBackOff   5          4m12s
my-db-zone1-vtctld-0de28170-b5cb8894b-k8znj    1/1     Running                 0          6m20s
my-db-zone1-vtgate-6926eeba-5db759d8c6-q8p5n   1/1     Running                 0          6m20s
vitess-operator-6dff974b75-zdvzz               1/1     Running                 0          7d15h

$ kubectl logs ginbits-db-vttablet-zone1-1563904368-16ebd7f6 -c init-vt-root
+ mkdir -p /mnt/vt/bin
+ cp --no-clobber /vt/bin/mysqlctld /mnt/vt/bin/
cp: cannot stat '/vt/bin/mysqlctld': No such file or directory

I am using vitess operator image: planetscale/vitess-operator:latest

Cluster config images:

...
spec:
  images:
    vtctld: vitess/lite:latest
    vtgate: vitess/lite:latest
    vttablet: vitess/lite:latest
    vtbackup: vitess/lite:latest
...

[lasantharanjana]

@droslean Was the above resolved? What was the action plan? Please advise.

[droslean]

@lasantharanjana The issue still stands. I am not aware of any solutions.

[lasantharanjana]

@lasantharanjana The issue still stands. I am not aware of any solutions.

Hope the below is the same issue that I'm facing on IBM Cloud. Please review.

`+ cd /vt/vtdataroot ++ find . -mindepth 2 -maxdepth 2 -path './vt_*/my.cnf' ERROR: logging before flag.Parse: E0116 20:16:41.944803 1 syslogger.go:149] can't connect to syslog I0116 20:16:41.955701 1 mysqlctld.go:76] mycnf file (/vt/vtdataroot/vt_2469782763/my.cnf) doesn't exist, initializing ERROR: logging before flag.Parse: E0116 20:16:41.623900 1 syslogger.go:149] can't connect to syslog

• mkdir -p /mnt/vt/bin I0116 20:16:41.956305 1 dbconfigs.go:382] DBConfigs: allprivs: I0116 20:16:41.697483 1 servenv.go:97] Version: 12.0.0 (Git revision de06fcaa92 branch 'heads/v12.0.0') built on Tue Oct 26 10:59:18 UTC 2021 by vitess@buildkitsandbox using go1.17 linux/amd64
• cp --no-clobber /vt/bin/mysqlctld /mnt/vt/bin/ password: '' I0116 20:16:41.697971 1 streamlog.go:158] Streaming logs from TabletServer at /debug/querylog. I0116 20:16:41.697992 1 streamlog.go:158] Streaming logs from TxLog at /debug/txlog. app: password: '' I0116 20:16:41.699073 1 vttablet.go:142] Loaded config file successfully: cacheResultFields: true consolidator: enable db: allprivs: password: '' useSsl: true user: vt_allprivs app: password: '' appdebug: password: '****' charset: utf8 dba: useSsl: true
• mkdir -p /mnt/vt/config time="2022-01-16T19:19:32Z" level=info msg="Starting mysqld_exporter (version=0.11.0, branch=HEAD, revision=5d7179615695a61ecc3b5bf90a2a7c76a9592cdd)" source="mysqld_exporter.go:206" password: '****' user: vt_app
• [[ -d /vt/config/mycnf ]] time="2022-01-16T19:19:32Z" level=info msg="Build context (go=go1.10.3, user=root@3d3ff666b0e4, date=20180629-15:00:35)" source="mysqld_exporter.go:207" useSsl: true appdebug:
• mkdir -p /mnt/vt/config/mycnf time="2022-01-16T19:19:32Z" level=info msg="Enabled scrapers:" source="mysqld_exporter.go:218" user: vt_dba password: '****'
• mkdir -p /mnt/vt/vtdataroot time="2022-01-16T19:19:32Z" level=info msg=" --collect.global_status" source="mysqld_exporter.go:222" filtered: useSsl: true
• ln -sf /dev/stderr /mnt/vt/config/stderr.symlink time="2022-01-16T19:19:32Z" level=info msg=" --collect.global_variables" source="mysqld_exporter.go:222" password: '****' user: vt_appdebug
• echo 'log-error = /vt/config/stderr.symlink' time="2022-01-16T19:19:32Z" level=info msg=" --collect.slave_status" source="mysqld_exporter.go:222" repl: charset: utf8mb4
• echo binlog_format=row time="2022-01-16T19:19:32Z" level=info msg=" --collect.info_schema.tables" source="mysqld_exporter.go:222" password: '****' dba:

• echo 'socket = /vt/socket/mysql.sock' time="2022-01-16T19:19:32Z" level=info msg="Listening on :9104" source="mysqld_exporter.go:232"

  password: '' I0116 20:16:41.956667 1 mysqld.go:590] execCmd: /usr/sbin/mysqld /usr/sbin/mysqld [--version] useSsl: true user: vt_dba I0116 20:16:41.963394 1 mysqld.go:604] execCmd: /usr/sbin/mysqld output: /usr/sbin/mysqld Ver 5.7.31 for Linux on x86_64 (MySQL Community Server (GPL)) I0116 20:16:41.963495 1 mysqld.go:172] Using flavor: mysql, version: {5 7 31} filtered: password: '' I0116 20:16:41.963534 1 mysqld.go:643] mysqlctl.Init I0116 20:16:41.963543 1 mysqld.go:625] mysqlctl.InitConfig I0116 20:16:41.963555 1 mysqld.go:927] creating directory /vt/vtdataroot/vt_2469782763 useSsl: true user: vt_filtered E0116 20:16:41.965037 1 mysqld.go:628] mkdir /vt/vtdataroot/vt_2469782763: permission denied E0116 20:16:41.965054 1 mysqld.go:646] mkdir /vt/vtdataroot/vt_2469782763: permission denied repl: password: '****' E0116 20:16:41.965064 1 mysqlctld.go:87] failed to initialize mysql data dir and start mysqld: mkdir /vt/vtdataroot/vt_2469782763: permission denied useSsl: true user: vt_repl gracePeriods: {} healthcheck: degradedThresholdSeconds: 30 intervalSeconds: 5 unhealthyThresholdSeconds: 7200 hotRowProtection: maxConcurrency: 5 maxGlobalQueueSize: 1000 maxQueueSize: 20 mode: disable messagePostponeParallelism: 4 olapReadPool: idleTimeoutSeconds: 1800 size: 96 oltp: maxRows: 100000 queryTimeoutSeconds: 900 txTimeoutSeconds: 30 oltpReadPool: idleTimeoutSeconds: 1800 maxWaiters: 5000 size: 96 queryCacheLFU: true queryCacheMemory: 33554432 queryCacheSize: 5000 replicationTracker: heartbeatIntervalSeconds: 1 mode: polling schemaReloadIntervalSeconds: 1800 signalSchemaChangeReloadIntervalSeconds: 5 streamBufferSize: 32768 txPool: idleTimeoutSeconds: 1800 maxWaiters: 5000 size: 300 timeoutSeconds: 1 I0116 20:16:41.699102 1 mycnf_flag.go:123] No mycnf_server_id, no mycnf-file specified, using default config for server id 2469782763: /vt/vtdataroot/vt_2469782763/my.cnf F0116 20:16:41.699146 1 vttablet.go:153] mycnf read failed: open /vt/vtdataroot/vt_2469782763/my.cnf: no such file or directory`

Appreciate the inputs.

[droslean]

@lasantharanjana Your problem is not related to this issue.

[lasantharanjana]

@droslean Thank you for the quick response. Please note that I'm a newbie on the Vitess. I would highly appreciate if you can give me any direction or a workaround on the issue that I'm facing. Please advise. Thanks.

[droslean]

@lasantharanjana Please open a new issue

[mattlord]

@droslean Thank you for the quick response. Please note that I'm a newbie on the Vitess. I would highly appreciate if you can give me any direction or a workaround on the issue that I'm facing. Please advise. Thanks.

Hi @lasantharanjana!

GitHub issues is not the appropriate place for support like questions. You should instead join the Vitess slack, where there are channels for getting help on various topics. Thanks!

https://vitess.io/community/