GKE deploy does not work

Error is in several places:

Helm

[x] ReadWriteMany in common-data and deposit-storage will lead to unsupported on default storageClass. I have tried with workaround with nfs, which could be good path
[x] Nimbus 0 after genesis container does not boot properly and stall other clients, which wont be bootstrapped.

kubectl describe pod nimbus-0

Events:
  Type     Reason     Age                    From                                           Message
  ----     ------     ----                   ----                                           -------
  Normal   Scheduled  39m                    default-scheduler                              Successfully assigned default/nimbus-0 to gke-eth20-default-pool-0d802a45-pgc2
  Normal   Pulled     39m                    kubelet, gke-eth20-default-pool-0d802a45-pgc2  Container image "eth2clients/multinet-nimbus" already present on machine
  Normal   Created    39m                    kubelet, gke-eth20-default-pool-0d802a45-pgc2  Created container genesis
  Normal   Started    39m                    kubelet, gke-eth20-default-pool-0d802a45-pgc2  Started container genesis
  Normal   Pulled     38m                    kubelet, gke-eth20-default-pool-0d802a45-pgc2  Container image "eth2clients/eth2stats-client" already present on machine
  Normal   Created    38m                    kubelet, gke-eth20-default-pool-0d802a45-pgc2  Created container eth2stats-client
  Normal   Started    38m                    kubelet, gke-eth20-default-pool-0d802a45-pgc2  Started container eth2stats-client
  Normal   Started    35m (x4 over 38m)      kubelet, gke-eth20-default-pool-0d802a45-pgc2  Started container nimbus
  Normal   Pulled     33m (x5 over 38m)      kubelet, gke-eth20-default-pool-0d802a45-pgc2  Container image "eth2clients/multinet-nimbus" already present on machine
  Normal   Created    33m (x5 over 38m)      kubelet, gke-eth20-default-pool-0d802a45-pgc2  Created container nimbus
  Warning  BackOff    3m55s (x122 over 36m)  kubelet, gke-eth20-default-pool-0d802a45-pgc2  Back-off restarting failed container

kubectl get pods

NAME                                  READY   STATUS     RESTARTS   AGE
eth2stats-dashboard-5458757df-n6kjx   1/1     Running    0          40m
eth2stats-server-74859c8ddd-9n9r9     1/1     Running    0          40m
lighthouse-0                          2/2     Running    0          40m
nfs-server-57698dcc79-976rl           1/1     Running    0          21h
nimbus-0                              2/2     Running    11         40m
nimbus-1                              0/2     Init:0/1   0          39m
prysm-0                               2/2     Running    0          40m

kubectl logs nimbus-0 nimbus

Running nimbus
++ dirname ./run_nimbus.sh
+ source ./vars.sh
++ PWD_CMD=pwd
++ uname
++ grep -qi mingw
+++ dirname ./run_nimbus.sh
++ cd .
+++ pwd
++ SIM_ROOT=/root/multinet/repo
++ SPEC_VERSION=mainnet
++ NUM_VALIDATORS=64
++ NUM_NODES=1
++ NUM_MISSING_NODES=2
++ DATA_DIR=/root/multinet/repo/data
++ BUILD_DIR=/root/multinet/repo/build
++ TESTNET_DIR=/root/multinet/repo/data/testnet
++ VALIDATORS_DIR=/root/multinet/repo/data/testnet/validators
++ SECRETS_DIR=/root/multinet/repo/data/testnet/secrets
++ NETWORK_BOOTSTRAP_FILE=/root/multinet/repo/data/testnet/bootstrap_nodes.txt
++ PRESET_FILE=/root/multinet/repo/mainnet.yaml
++ NIMFLAGS='-d:insecure -d:chronicles_log_level=TRACE --warnings:off --hints:off --opt:speed -d:disableMarchNative -d:const_preset=/root/multinet/repo/mainnet.yaml'
++ NIMBUS_BIN=/root/multinet/repo/build/nimbus
+ NIMBUS_DIR=nimbus-eth2
+ MULTINET_POD_NAME=nimbus-0
+ NIMBUS_DATA_DIR=/root/multinet/repo/deposits/nimbus-0
+ chmod -R 750 /root/multinet/repo/deposits/nimbus-0
+ chmod -R 600 /root/multinet/repo/deposits/nimbus-0/validators
+ chmod -R 600 /root/multinet/repo/deposits/nimbus-0/secrets
+ cd nimbus-eth2
+ source env.sh
+++ dirname env.sh
++ REL_PATH=.
+++ cd .
+++ pwd
++ ABS_PATH=/root/multinet/repo/nimbus-eth2
++ '[' -z '' ']'
++ command -v nvm
++ echo

++ source /root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts/env.sh
++++ dirname /root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts/env.sh
+++ export REL_PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts
+++ REL_PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts
++++ cd /root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts
++++ pwd
+++ export ABS_PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts
+++ ABS_PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts
+++ export NIMBUS_ENV_DIR=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts
+++ NIMBUS_ENV_DIR=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts
++++ cd /root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts/../vendor/Nim/bin
++++ pwd
+++ export NIM_PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/vendor/Nim/bin
+++ NIM_PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/vendor/Nim/bin
++++ cd /root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts/../../.nimble
++++ pwd
+++ export NIMBLE_DIR=/root/multinet/repo/nimbus-eth2/vendor/.nimble
+++ NIMBLE_DIR=/root/multinet/repo/nimbus-eth2/vendor/.nimble
+++ export PATH=/root/multinet/repo/nimbus-eth2/vendor/.nimble/bin:/usr/local/cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+++ PATH=/root/multinet/repo/nimbus-eth2/vendor/.nimble/bin:/usr/local/cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+++ [[ '' != \1 ]]
+++ export PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/vendor/Nim/bin:/root/multinet/repo/nimbus-eth2/vendor/.nimble/bin:/usr/local/cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+++ PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/vendor/Nim/bin:/root/multinet/repo/nimbus-eth2/vendor/.nimble/bin:/usr/local/cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+++ export BUILD_OUTPUTS_DIR=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts/../../../build
+++ BUILD_OUTPUTS_DIR=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts/../../../build
+++ [[ -n 5.0.17(1)-release ]]
+++ export 'PS1= [Nimbus env]\$ '
+++ PS1=' [Nimbus env]\$ '
+++ EXPORT_FUNC='export -f'
+++ [[ -n '' ]]
+++ export -f nimble
+++ export -f add_submodule
+++ [[ 0 == 1 ]]
+ ./env.sh nim c -o:/root/multinet/repo/build/nimbus -d:insecure -d:chronicles_log_level=TRACE --warnings:off --hints:off --opt:speed -d:disableMarchNative -d:const_preset=/root/multinet/repo/mainnet.yaml beacon_chain/beacon_node
++ printf 5%04d 0
+ PORT=50000
+ NAT_FLAG=--nat:extip:172.20.0.10
+ '[' 10.0.2.14 '!=' '' ']'
+ NAT_FLAG=--nat:extip:10.0.2.14
+ rm -rf /root/multinet/repo/deposits/nimbus-0/db
+ rm -f /root/multinet/repo/deposits/nimbus-0/beacon_node.enr
+ rm -f /root/multinet/repo/deposits/nimbus-0/genesis.ssz
+ rm -rf /root/multinet/repo/deposits/nimbus-0/dump
+ mkdir -p /root/multinet/repo/deposits/nimbus-0/dump
+ BOOTNODES_ARG=
+ [[ -f /root/multinet/repo/data/testnet/bootstrap_nodes.txt ]]
+ '[' nimbus-0 == nimbus-0 ']'
+ /root/multinet/repo/build/nimbus '--log-level=INFO;TRACE:switch,multistream' --log-file=/root/multinet/repo/nimbus.log --data-dir:/root/multinet/repo/deposits/nimbus-0 --tcp-port:50000 --udp-port:50000 --rpc --rpc-address=0.0.0.0 --rpc-port=7000 --nat:extip:10.0.2.14 --finalized-checkpoint-state:/root/multinet/repo/data/testnet/genesis.ssz --metrics
+ wait_and_register_enr /root/multinet/repo/deposits/nimbus-0/beacon_node.enr
+ echo 'Registering ENR'
Registering ENR
+ wait_file /root/multinet/repo/deposits/nimbus-0/beacon_node.enr
+ MSG_DISPLAYED=0
+ '[' '!' -f /root/multinet/repo/deposits/nimbus-0/beacon_node.enr ']'
+ ((  MSG_DISPLAYED == 0  ))
+ echo 'Waiting for /root/multinet/repo/deposits/nimbus-0/beacon_node.enr to appear...'
Waiting for /root/multinet/repo/deposits/nimbus-0/beacon_node.enr to appear...
+ MSG_DISPLAYED=1
+ sleep 0.1
Error while processing the 'finalized-checkpoint-state' parameter: File doesn't exist
Try nimbus --help for more information.

eth-clients / multinet

GKE deploy does not work #8