search

kubernetes / cloud-provider-openstack

Apache License 2.0
616 stars 602 forks source link

Kubelet: could not init cloud provider "openstack": 1:1: expected section header #214

Closed s0komma closed 6 years ago

s0komma commented 6 years ago

Is this a BUG REPORT or FEATURE REQUEST?:

Uncomment only one, leave it on its own line:

/kind bug /kind feature

What happened: Hi Guys, i’m trying to setup k8s persistent storage using cinder. my k8s version is 1.9.4 followed all the steps we added below details on all the nodes of k8s including master and worker --cloud-provider=openstack --cloud-config=/etc/kubernetes/cloud_config --> the added to kubelet, controller and api server on all master nodes and only for kubelet on worker nodes (edited) after doing so kubelet won’t start on master node, all worker nodes are up

Kubelet logs are below


Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.779199   21254 flags.go:52] FLAG: --address="0.0.0.0"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.779786   21254 flags.go:52] FLAG: --allow-privileged="true"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.780036   21254 flags.go:52] FLAG: --alsologtostderr="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.780316   21254 flags.go:52] FLAG: --anonymous-auth="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.780584   21254 flags.go:52] FLAG: --application-metrics-count-limit="100"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.780848   21254 flags.go:52] FLAG: --authentication-token-webhook="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.781151   21254 flags.go:52] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.781443   21254 flags.go:52] FLAG: --authorization-mode="Webhook"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.781719   21254 flags.go:52] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.781963   21254 flags.go:52] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.782237   21254 flags.go:52] FLAG: --azure-container-registry-config=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.782494   21254 flags.go:52] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.782780   21254 flags.go:52] FLAG: --bootstrap-checkpoint-path=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.783084   21254 flags.go:52] FLAG: --bootstrap-kubeconfig=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.783355   21254 flags.go:52] FLAG: --cadvisor-port="4194"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.783657   21254 flags.go:52] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.783914   21254 flags.go:52] FLAG: --cgroup-driver="cgroupfs"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.784176   21254 flags.go:52] FLAG: --cgroup-root=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.784433   21254 flags.go:52] FLAG: --cgroups-per-qos="true"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.784688   21254 flags.go:52] FLAG: --chaos-chance="0"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.784956   21254 flags.go:52] FLAG: --client-ca-file="/var/lib/kubelet/ca.pem"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785222   21254 flags.go:52] FLAG: --cloud-config="/etc/kubernetes/cloud_config"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785486   21254 flags.go:52] FLAG: --cloud-provider="openstack"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785509   21254 flags.go:52] FLAG: --cloud-provider-gce-lb-src-cidrs="130.211.0.0/22,35.191.0.0/16,209.85.152.0/22,209.85.204.0/22"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785518   21254 flags.go:52] FLAG: --cluster-dns="[172.16.56.10]"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785527   21254 flags.go:52] FLAG: --cluster-domain="cluster.local"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785531   21254 flags.go:52] FLAG: --cni-bin-dir=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785535   21254 flags.go:52] FLAG: --cni-conf-dir=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785538   21254 flags.go:52] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785542   21254 flags.go:52] FLAG: --container-runtime="docker"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785546   21254 flags.go:52] FLAG: --container-runtime-endpoint="unix:///var/run/dockershim.sock"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785550   21254 flags.go:52] FLAG: --containerd="unix:///var/run/containerd.sock"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785554   21254 flags.go:52] FLAG: --containerized="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785558   21254 flags.go:52] FLAG: --contention-profiling="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785561   21254 flags.go:52] FLAG: --cpu-cfs-quota="true"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785564   21254 flags.go:52] FLAG: --cpu-manager-policy="none"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785568   21254 flags.go:52] FLAG: --cpu-manager-reconcile-period="10s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785572   21254 flags.go:52] FLAG: --docker="unix:///var/run/docker.sock"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785575   21254 flags.go:52] FLAG: --docker-disable-shared-pid="true"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785579   21254 flags.go:52] FLAG: --docker-endpoint="unix:///var/run/docker.sock"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785582   21254 flags.go:52] FLAG: --docker-env-metadata-whitelist=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785586   21254 flags.go:52] FLAG: --docker-only="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785589   21254 flags.go:52] FLAG: --docker-root="/var/lib/docker"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785593   21254 flags.go:52] FLAG: --docker-tls="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785596   21254 flags.go:52] FLAG: --docker-tls-ca="ca.pem"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785600   21254 flags.go:52] FLAG: --docker-tls-cert="cert.pem"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785603   21254 flags.go:52] FLAG: --docker-tls-key="key.pem"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785607   21254 flags.go:52] FLAG: --dynamic-config-dir=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785612   21254 flags.go:52] FLAG: --enable-controller-attach-detach="true"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785615   21254 flags.go:52] FLAG: --enable-custom-metrics="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785619   21254 flags.go:52] FLAG: --enable-debugging-handlers="true"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785622   21254 flags.go:52] FLAG: --enable-load-reader="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785625   21254 flags.go:52] FLAG: --enable-server="true"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785629   21254 flags.go:52] FLAG: --enforce-node-allocatable="[pods]"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785637   21254 flags.go:52] FLAG: --event-burst="10"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785641   21254 flags.go:52] FLAG: --event-qps="5"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785644   21254 flags.go:52] FLAG: --event-storage-age-limit="default=0"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785648   21254 flags.go:52] FLAG: --event-storage-event-limit="default=0"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785651   21254 flags.go:52] FLAG: --eviction-hard="imagefs.available<15%,memory.available<100Mi,nodefs.available<10%,nodefs.inodesFree<5%"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785664   21254 flags.go:52] FLAG: --eviction-max-pod-grace-period="0"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785668   21254 flags.go:52] FLAG: --eviction-minimum-reclaim=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785674   21254 flags.go:52] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785678   21254 flags.go:52] FLAG: --eviction-soft=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785682   21254 flags.go:52] FLAG: --eviction-soft-grace-period=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785685   21254 flags.go:52] FLAG: --exit-on-lock-contention="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785689   21254 flags.go:52] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785692   21254 flags.go:52] FLAG: --experimental-allowed-unsafe-sysctls="[]"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785696   21254 flags.go:52] FLAG: --experimental-bootstrap-kubeconfig=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785700   21254 flags.go:52] FLAG: --experimental-check-node-capabilities-before-mount="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785703   21254 flags.go:52] FLAG: --experimental-dockershim="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785707   21254 flags.go:52] FLAG: --experimental-dockershim-root-directory="/var/lib/dockershim"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785711   21254 flags.go:52] FLAG: --experimental-fail-swap-on="true"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785714   21254 flags.go:52] FLAG: --experimental-kernel-memcg-notification="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785718   21254 flags.go:52] FLAG: --experimental-mounter-path=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785722   21254 flags.go:52] FLAG: --experimental-qos-reserved=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785726   21254 flags.go:52] FLAG: --fail-swap-on="true"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785729   21254 flags.go:52] FLAG: --feature-gates=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785734   21254 flags.go:52] FLAG: --file-check-frequency="20s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785738   21254 flags.go:52] FLAG: --global-housekeeping-interval="1m0s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785741   21254 flags.go:52] FLAG: --google-json-key=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785745   21254 flags.go:52] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785748   21254 flags.go:52] FLAG: --healthz-bind-address="127.0.0.1"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785752   21254 flags.go:52] FLAG: --healthz-port="10248"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785756   21254 flags.go:52] FLAG: --host-ipc-sources="[*]"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785774   21254 flags.go:52] FLAG: --host-network-sources="[*]"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785778   21254 flags.go:52] FLAG: --host-pid-sources="[*]"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785784   21254 flags.go:52] FLAG: --hostname-override=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785788   21254 flags.go:52] FLAG: --housekeeping-interval="10s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785792   21254 flags.go:52] FLAG: --http-check-frequency="20s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785795   21254 flags.go:52] FLAG: --image-gc-high-threshold="85"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785799   21254 flags.go:52] FLAG: --image-gc-low-threshold="80"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785802   21254 flags.go:52] FLAG: --image-pull-progress-deadline="2m0s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785806   21254 flags.go:52] FLAG: --image-service-endpoint=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785809   21254 flags.go:52] FLAG: --init-config-dir=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785812   21254 flags.go:52] FLAG: --iptables-drop-bit="15"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785815   21254 flags.go:52] FLAG: --iptables-masquerade-bit="14"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785819   21254 flags.go:52] FLAG: --keep-terminated-pod-volumes="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785822   21254 flags.go:52] FLAG: --kube-api-burst="10"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785826   21254 flags.go:52] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785830   21254 flags.go:52] FLAG: --kube-api-qps="5"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785833   21254 flags.go:52] FLAG: --kube-reserved=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785837   21254 flags.go:52] FLAG: --kube-reserved-cgroup=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785840   21254 flags.go:52] FLAG: --kubeconfig="/var/lib/kubelet/kubelet.kubeconfig"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785845   21254 flags.go:52] FLAG: --kubelet-cgroups=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785848   21254 flags.go:52] FLAG: --lock-file=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785852   21254 flags.go:52] FLAG: --log-backtrace-at=":0"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785856   21254 flags.go:52] FLAG: --log-cadvisor-usage="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785859   21254 flags.go:52] FLAG: --log-dir=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785863   21254 flags.go:52] FLAG: --log-flush-frequency="5s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785868   21254 flags.go:52] FLAG: --logtostderr="true"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785871   21254 flags.go:52] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785875   21254 flags.go:52] FLAG: --make-iptables-util-chains="true"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785879   21254 flags.go:52] FLAG: --manifest-url=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785882   21254 flags.go:52] FLAG: --manifest-url-header=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785889   21254 flags.go:52] FLAG: --master-service-namespace="default"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785893   21254 flags.go:52] FLAG: --max-open-files="1000000"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785899   21254 flags.go:52] FLAG: --max-pods="110"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785903   21254 flags.go:52] FLAG: --maximum-dead-containers="-1"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785906   21254 flags.go:52] FLAG: --maximum-dead-containers-per-container="1"
Jun 21 08:20:22 control-plane-271098166-1-377715803 systemd[1]: kubelet.service: Unit entered failed state.
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785910   21254 flags.go:52] FLAG: --minimum-container-ttl-duration="0s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785924   21254 flags.go:52] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785928   21254 flags.go:52] FLAG: --network-plugin="cni"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785931   21254 flags.go:52] FLAG: --network-plugin-mtu="0"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785935   21254 flags.go:52] FLAG: --node-ip=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785938   21254 flags.go:52] FLAG: --node-labels=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785944   21254 flags.go:52] FLAG: --node-status-update-frequency="10s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785948   21254 flags.go:52] FLAG: --non-masquerade-cidr="10.0.0.0/8"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785951   21254 flags.go:52] FLAG: --oom-score-adj="-999"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785956   21254 flags.go:52] FLAG: --pod-cidr=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785960   21254 flags.go:52] FLAG: --pod-infra-container-image="gcr.docker.prod.walmart.com/google_containers/pause-amd64:3.0"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785964   21254 flags.go:52] FLAG: --pod-manifest-path="/etc/kubernetes/manifests"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785968   21254 flags.go:52] FLAG: --pods-per-core="0"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785971   21254 flags.go:52] FLAG: --port="10250"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785974   21254 flags.go:52] FLAG: --protect-kernel-defaults="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785978   21254 flags.go:52] FLAG: --provider-id=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785981   21254 flags.go:52] FLAG: --read-only-port="10255"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785984   21254 flags.go:52] FLAG: --really-crash-for-testing="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785988   21254 flags.go:52] FLAG: --register-node="true"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785991   21254 flags.go:52] FLAG: --register-schedulable="true"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.785994   21254 flags.go:52] FLAG: --register-with-taints="node-role.kubernetes.io/master=:NoSchedule"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786004   21254 flags.go:52] FLAG: --registry-burst="10"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786008   21254 flags.go:52] FLAG: --registry-qps="5"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786011   21254 flags.go:52] FLAG: --require-kubeconfig="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786015   21254 flags.go:52] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 21 08:20:22 control-plane-271098166-1-377715803 systemd[1]: kubelet.service: Failed with result 'exit-code'.
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786019   21254 flags.go:52] FLAG: --rkt-api-endpoint="localhost:15441"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786023   21254 flags.go:52] FLAG: --rkt-path=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786026   21254 flags.go:52] FLAG: --rkt-stage1-image=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786029   21254 flags.go:52] FLAG: --root-dir="/var/lib/kubelet"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786032   21254 flags.go:52] FLAG: --rotate-certificates="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786036   21254 flags.go:52] FLAG: --runonce="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786039   21254 flags.go:52] FLAG: --runtime-cgroups=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786042   21254 flags.go:52] FLAG: --runtime-request-timeout="15m0s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786046   21254 flags.go:52] FLAG: --seccomp-profile-root="/var/lib/kubelet/seccomp"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786049   21254 flags.go:52] FLAG: --serialize-image-pulls="true"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786053   21254 flags.go:52] FLAG: --stderrthreshold="2"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786056   21254 flags.go:52] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786059   21254 flags.go:52] FLAG: --storage-driver-db="cadvisor"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786063   21254 flags.go:52] FLAG: --storage-driver-host="localhost:8086"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786066   21254 flags.go:52] FLAG: --storage-driver-password="root"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786070   21254 flags.go:52] FLAG: --storage-driver-secure="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786074   21254 flags.go:52] FLAG: --storage-driver-table="stats"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786077   21254 flags.go:52] FLAG: --storage-driver-user="root"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786081   21254 flags.go:52] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786084   21254 flags.go:52] FLAG: --sync-frequency="1m0s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786087   21254 flags.go:52] FLAG: --system-cgroups=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786091   21254 flags.go:52] FLAG: --system-reserved=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786094   21254 flags.go:52] FLAG: --system-reserved-cgroup=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786097   21254 flags.go:52] FLAG: --tls-cert-file="/var/lib/kubelet/kubelet-client.pem"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786101   21254 flags.go:52] FLAG: --tls-private-key-file="/var/lib/kubelet/kubelet-client-key.pem"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786105   21254 flags.go:52] FLAG: --v="10"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786109   21254 flags.go:52] FLAG: --version="false"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786115   21254 flags.go:52] FLAG: --vmodule=""
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786119   21254 flags.go:52] FLAG: --volume-plugin-dir="/usr/libexec/kubernetes/kubelet-plugins/volume/exec/"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786123   21254 flags.go:52] FLAG: --volume-stats-agg-period="1m0s"
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.786938   21254 feature_gate.go:226] feature gates: &{{} map[]}
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.787016   21254 controller.go:114] kubelet config controller: starting controller
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.787022   21254 controller.go:118] kubelet config controller: validating combination of defaults and flags
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.809494   21254 mount_linux.go:208] Detected OS with systemd
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.811801   21254 iptables.go:589] couldn't get iptables-restore version; assuming it doesn't support --wait
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.813061   21254 server.go:182] Version: v1.9.4
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: I0621 08:20:22.813142   21254 feature_gate.go:226] feature gates: &{{} map[]}
Jun 21 08:20:22 control-plane-271098166-1-377715803 kubelet[21254]: error: failed to run Kubelet: could not init cloud provider "openstack": 1:1: expected section header
Jun 21 08:20:27 control-plane-271098166-1-377715803 systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Jun 21 08:20:27 control-plane-271098166-1-377715803 systemd[1]: Stopped Kubernetes Kubelet.
a

**What you expected to happen**:
Kubelet to come up 
**How to reproduce it (as minimally and precisely as possible)**:

**Anything else we need to know?**:

**Environment**:
- openstack-cloud-controller-manager version: using in tree 
- OS (e.g. from /etc/os-release): NAME="Ubuntu"
VERSION="16.04.3 LTS (Xenial Xerus)"
- Kernel (e.g. `uname -a`): Linux control-plane-271098166-1-377715803 4.4.0-89-generic #112-Ubuntu SMP Mon Jul 31 19:38:41 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
- Install tools:
- Others:
s0komma commented 6 years ago

FYI all the openstack commands work from the affected system. All things as been as per https://github.com/kubernetes/cloud-provider-openstack/issues/169

s0komma commented 6 years ago

below is the host kubelet config 


# Ansible managed
[Unit]
Description=Kubernetes Kubelet
Documentation=https://github.com/kubernetes/kubernetes
After=docker.service
Requires=docker.service

[Service]

ExecStart=/usr/local/bin/kubelet \
  --logtostderr=true \
  --cloud-provider=openstack \
  --cloud-config=/etc/kubernetes/cloud_config \
  --hostname-override=control-plane-test-skomma-kubernetes-377715785 \
  --allow-privileged=true \
  --anonymous-auth=false \
  --authorization-mode=Webhook \
  --client-ca-file=/var/lib/kubelet/ca.pem \
  --cluster-dns=xxx.xx.xx.xx \
  --cluster-domain=cluster.local \
  --container-runtime=docker \
  --image-pull-progress-deadline=2m \
  --kubeconfig=/var/lib/kubelet/kubelet.kubeconfig \
  --network-plugin=cni \
  --pod-infra-container-image=gcr.docker.prod.walmart.com/google_containers/pause-amd64:3.0 \
  --register-node=true \
  --runtime-request-timeout=15m \
  --tls-cert-file=/var/lib/kubelet/kubelet-client.pem \
  --tls-private-key-file=/var/lib/kubelet/kubelet-client-key.pem \
  --v=10 \
  --register-with-taints=node-role.kubernetes.io/master=:NoSchedule \
  --pod-manifest-path=/etc/kubernetes/manifests

Restart=on-failure
RestartSec=5

[Install]
WantedBy=multi-user.target
dims commented 6 years ago

@s0komma what's in your /etc/kubernetes/cloud_config file?

s0komma commented 6 years ago

@dims Thank you looking in to this below are the details 


root@workers-271098166-3-377715648:/etc/kubernetes# cat cloud_config
[Global]
region=RegionOne
username=username
password=password
auth-url=https://stg-002-api-endpoint.com:5000/v3
tenant-id=33e2c5824ff44ae1ad47915c461143a5
domain-name=Default
root@control-plane-271098166-1-377715803:/home/app# source source_cdc
root@control-plane-271098166-1-377715803:/home/app# openstack server list
+--------------------------------------+------------------------------------------------+--------+-------------------------------------+
| ID                                   | Name                                           | Status | Networks                            |
+--------------------------------------+------------------------------------------------+--------+-------------------------------------+
| b9fb37f7-6d42-4ff6-b78b-91aaa1cd720a | etcd-lab-l0m01gh-kubernetes-385673138          | ACTIVE | Primary6_External_Net=10.**.**.** |
| fb33034a-788c-4247-a2c4-8b95045833e5 | control-plane-lab-l0m01gh-kubernetes-385672975 | ACTIVE | Primary6_External_Net=10.**.**.** |
| 19eb493d-d771-4570-9fe7-948de148f46d | workers-lab-l0m01gh-kubernetes-385673311       | ACTIVE | Primary7_External_Net=10.**.**.** |
| 2c08720d-97ff-4a09-8a65-ca80cf1e24c4 | workers-dev-us-cdc3-kubernetes-379497634       | ACTIVE | Primary8_External_Net=10.**.**.** |
| e0cdbc13-2beb-4e1f-a937-46fd22385c32 | etcd-dev-us-cdc3-kubernetes-379497811          | ACTIVE | Primary7_External_Net=10.**.**.** |
| 94f3a83c-71f8-4f80-83a2-1cbe40d72990 | control-plane-dev-us-cdc3-kubernetes-379497530 | ACTIVE | Primary6_External_Net=10.**.**.**  |
| b19a9e4f-341b-4e03-8271-a3f4f9e8d202 | etcd-dev-us-cdc3-kubernetes-379497808          | ACTIVE | Primary7_External_Net=10.**.**.**  |
| d42de561-4c6d-45e5-a504-648b090b1591 | control-plane-dev-us-cdc3-kubernetes-379497524 | ACTIVE | Primary7_External_Net=10.**.**.**  |
| 41ea90a5-5434-4e10-b8e5-d73a4123bd1c | workers-dev-us-cdc3-kubernetes-379497643       | ACTIVE | Primary8_External_Net=10.**.**.**  |
| 3b112d5d-34c1-4bba-884c-a85779560027 | control-plane-dev-us-cdc3-kubernetes-379497527 | ACTIVE | Primary9_External_Net=10.**.**.** |
| 537e2f2a-55e1-4854-ab88-ec9ce2e04b46 | workers-dev-us-cdc3-kubernetes-379497637       | ACTIVE | Primary7_External_Net=10.**.**.**  |
| 60199071-3ce3-450c-8cf1-b7b6e1a7d10b | workers-dev-us-cdc3-kubernetes-379497646       | ACTIVE | Primary9_External_Net=10.**.**.** |
| 91e5a7a2-446d-46b6-b1d1-f4cb9a1a5dcc | etcd-dev-us-cdc3-kubernetes-379497814          | ACTIVE | Primary6_External_Net=10.**.**.**  |
| f8af6cf9-a2b8-4f75-983b-0e1e1b058f91 | workers-dev-us-cdc3-kubernetes-379497640       | ACTIVE | Primary9_External_Net=10.**.**.**  |
| 07786eb3-5478-4f6f-b810-c04ec2c6c453 | etcd-test-skomma-kubernetes-377715516          | ACTIVE | Primary7_External_Net=10.**.**.**  |
| 33d12493-826f-4d68-92f0-b89838fe9c01 | workers-test-skomma-kubernetes-377715626       | ACTIVE | Primary9_External_Net=10.**.**.**  |
| 44132de2-1f89-41f0-b43e-d034a9247872 | workers-test-skomma-kubernetes-377715632       | ACTIVE | Primary6_External_Net=10.**.**.** |
| 66d2b19b-58b5-496e-8506-4d732a63b530 | etcd-test-skomma-kubernetes-377715513          | ACTIVE | Primary8_External_Net=10.**.**.**  |
| ddbdddb9-c7a1-4951-a1e8-bf9b43106eae | control-plane-test-skomma-kubernetes-377715791 | ACTIVE | Primary8_External_Net=10.**.**.**  |
| 584cd90b-f2c0-456a-98f6-5cbc4a4d6bd9 | etcd-test-skomma-kubernetes-377715510          | ACTIVE | Primary3_External_Net=10.**.**.** |
| 5ee385fd-9193-4e48-80bf-703d0b999aa8 | workers-test-skomma-kubernetes-377715618       | ACTIVE | Primary7_External_Net=10.**.**.** |
| b94d6d7a-ebd0-463a-862c-bd7b7db53aa4 | control-plane-test-skomma-kubernetes-377715788 | ACTIVE | Primary9_External_Net=10.**.**.** |
| 80d0c574-ef87-461c-a170-6dd70a5d5f7e | workers-test-skomma-kubernetes-377715621       | ACTIVE | Primary8_External_Net=10.**.**.** |
| 949ed62f-3cfe-451f-88e4-6f0d59784097 | control-plane-test-skomma-kubernetes-377715785 | ACTIVE | Primary6_External_Net=10.**.**.** |
+--------------------------------------+------------------------------------------------+--------+-------------------------------------+
root@control-plane-271098166-1-377715803:/home/app# openstack endpoint list
+----------------------------------+-----------+--------------+----------------+---------+-----------+---------------------------------------------------------------------------+
| ID                               | Region    | Service Name | Service Type   | Enabled | Interface | URL                                                                       |
+----------------------------------+-----------+--------------+----------------+---------+-----------+---------------------------------------------------------------------------+
| ********** | RegionOne | cinderv2     | volumev2       | True    | internal  | https://stg-002-api-endpoint.com:8776/v2/%(tenant_id)s   |
| ********** | RegionOne | keystone     | identity       | True    | admin     | https://stg-002-api-endpoint.com:35357/v3                |
| ********** | RegionOne | glance       | image          | True    | public    | https://stg-002-api-endpoint.com:9292                    |
| ********** | RegionOne | octavia      | load-balancing | True    | internal  | https://stg-002-api-endpoint.com:9876/v1/%(tenant_id)s   |
| ********** | RegionOne | keystone     | identity       | True    | internal  | https://stg-002-api-endpoint.com:5000/v3                 |
| ********** | RegionOne | placement    | placement      | True    | internal  | https://stg-002-api-endpoint.com:8780/placement          |
| ********** | RegionOne | barbican     | key-manager    | True    | internal  | https://stg-002-api-endpoint.com:9311                    |
| ********** | RegionOne | cinderv3     | volumev3       | True    | public    | https://stg-002-api-endpoint.com:8776/v3/%(tenant_id)s   |
| ********** | RegionOne | cinder       | volume         | True    | internal  | https://stg-002-api-endpoint.com:8776/v1/%(tenant_id)s   |
| ********** | RegionOne | neutron      | network        | True    | admin     | https://stg-002-api-endpoint.com:9696                    |
| ********** | RegionOne | glance       | image          | True    | internal  | https://stg-002-api-endpoint.com:9292                    |
| ********** | RegionOne | placement    | placement      | True    | public    | https://stg-002-api-endpoint.com:8780/placement          |
| ********** | RegionOne | glance       | image          | True    | admin     | https://stg-002-api-endpoint.com:9292                    |
| ********** | RegionOne | cinderv2     | volumev2       | True    | admin     | https://stg-002-api-endpoint.com:8776/v2/%(tenant_id)s   |
| ********** | RegionOne | cinderv3     | volumev3       | True    | admin     | https://stg-002-api-endpoint.com:8776/v3/%(tenant_id)s   |
| ********** | RegionOne | cinder       | volume         | True    | admin     | https://stg-002-api-endpoint.com:8776/v1/%(tenant_id)s   |
| ********** | RegionOne | nova         | compute        | True    | admin     | https://stg-002-api-endpoint.com:8774/v2.1/%(tenant_id)s |
| ********** | RegionOne | barbican     | key-manager    | True    | admin     | https://stg-002-api-endpoint.com:9311                    |
| ********** | RegionOne | cinder       | volume         | True    | public    | https://stg-002-api-endpoint.com:8776/v1/%(tenant_id)s   |
| ********** | RegionOne | nova         | compute        | True    | public    | https://stg-002-api-endpoint.com:8774/v2.1/%(tenant_id)s |
| ********** | RegionOne | keystone     | identity       | True    | public    | https://stg-002-api-endpoint.com:5000/v3                 |
| ********** | RegionOne | neutron      | network        | True    | public    | https://stg-002-api-endpoint.com:9696                    |
| ********** | RegionOne | nova         | compute        | True    | internal  | https://stg-002-api-endpoint.com:8774/v2.1/%(tenant_id)s |
| ********** | RegionOne | cinderv2     | volumev2       | True    | public    | https://stg-002-api-endpoint.com:8776/v2/%(tenant_id)s   |
| ********** | RegionOne | neutron      | network        | True    | internal  | https://stg-002-api-endpoint.com:9696                    |
| ********** | RegionOne | placement    | placement      | True    | admin     | https://stg-002-api-endpoint.com:8780/placement          |
| ********** | RegionOne | barbican     | key-manager    | True    | public    | https://stg-002-api-endpoint.com:9311                    |
| ********** | RegionOne | cinderv3     | volumev3       | True    | internal  | https://stg-002-api-endpoint.com:8776/v3/%(tenant_id)s   |
+----------------------------------+-----------+--------------+----------------+---------+-----------+---------------------------------------------------------------------------+
root@control-plane-271098166-1-377715803:/home/app# openstack service list
+----------------------------------+-----------+----------------+
| ID                               | Name      | Type           |
+----------------------------------+-----------+----------------+
| ********** | octavia   | load-balancing |
| ********** | cinderv3  | volumev3       |
| ********** | cinder    | volume         |
| ********** | nova      | compute        |
| ********** | keystone  | identity       |
| ********** | placement | placement      |
| ********** | glance    | image          |
| ********** | barbican  | key-manager    |
| ********** | cinderv2  | volumev2       |
| ********** | neutron   | network        |
+----------------------------------+-----------+----------------+

root@control-plane-271098166-1-377715803:/home/app# nova show control-plane-dev-us-cdc3-kubernetes-379497530
/usr/lib/python2.7/dist-packages/urllib3/connectionpool.py:794: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html
  InsecureRequestWarning)
+--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Property                             | Value                                                                                                                                                                                                                                                              |
+--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| OS-DCF:diskConfig                    | MANUAL                                                                                                                                                                                                                                                             |
| OS-EXT-AZ:availability_zone          | az1                                                                                                                                                                                                                                                                |
| OS-EXT-SRV-ATTR:host                 | box-1                                                                                                                                                                                                                                                   |
| OS-EXT-SRV-ATTR:hostname             | control-plane-dev-us-cdc3-kubernetes-379497530                                                                                                                                                                                                                     |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | box-1.com                                                                                                                                                                                                                                  |
| OS-EXT-SRV-ATTR:instance_name        | instance-00011073                                                                                                                                                                                                                                                  |
| OS-EXT-SRV-ATTR:kernel_id            |                                                                                                                                                                                                                                                                    |
| OS-EXT-SRV-ATTR:launch_index         | 0                                                                                                                                                                                                                                                                  |
| OS-EXT-SRV-ATTR:ramdisk_id           |                                                                                                                                                                                                                                                                    |
| OS-EXT-SRV-ATTR:reservation_id       | r-ynj7ohft                                                                                                                                                                                                                                                         |
| OS-EXT-SRV-ATTR:root_device_name     | /dev/vda                                                                                                                                                                                                                                                           |
| OS-EXT-SRV-ATTR:user_data            | -                                                                                                                                                                                                                                                                  |
| OS-EXT-STS:power_state               | 1                                                                                                                                                                                                                                                                  |
| OS-EXT-STS:task_state                | -                                                                                                                                                                                                                                                                  |
| OS-EXT-STS:vm_state                  | active                                                                                                                                                                                                                                                             |
| OS-SRV-USG:launched_at               | 2018-06-11T23:26:39.000000                                                                                                                                                                                                                                         |
| OS-SRV-USG:terminated_at             | -                                                                                                                                                                                                                                                                  |
| Primary6_External_Net network        | 10.**.XXX.**                                                                                                                                                                                                                                                       |
| accessIPv4                           |                                                                                                                                                                                                                                                                    |
| accessIPv6                           |                                                                                                                                                                                                                                                                    |
| config_drive                         | True                                                                                                                                                                                                                                                               |
| created                              | 2018-06-11T23:26:28Z                                                                                                                                                                                                                                               |
| description                          | control-plane-dev-us-cdc3-kubernetes-379497530                                                                                                                                                                                                                     |
| flavor                               | m1.large (4)                                                                                                                                                                                                                                                       |
| hostId                               | ***************                                                                                                                                                                                                          |
| id                                   | 94f3a83c-71f8-4f80-83a2-1cbe40d72990                                                                                                                                                                                                                               |
| image                                | Ubuntu-16.04-minimal-cloud-init RC10 (4fbebc68-9853-4c0a-9a41-e2aa1afaf7d4)                                                                                                                                                                                        |
| key_name                             | oneops_key-XXXX-dev-XXXX                                                                                                                                                                                                                                 |
| locked                               | False                                                                                                                                                                                                                                                              |
| metadata                             | {"instance": "379497530", "assembly": "us", "platform": "control-plane", "component": "379496212", "environment": "dev", "organization": "kubernetes"} |
| name                                 | control-plane-dev-us-cdc3-kubernetes-379497530                                                                                                                                                                                                                     |
| os-extended-volumes:volumes_attached | []                                                                                                                                                                                                                                                                 |
| progress                             | 0                                                                                                                                                                                                                                                                  |
| security_groups                      | control-plane-dev-us-cdc3-kubernetes-379497518, default                                                                                                                                                                                                            |
| status                               | ACTIVE                                                                                                                                                                                                                                                             |
| tenant_id                            | 33e2c5824ff44ae1ad47915c461143a5                                                                                                                                                                                                                                   |
| updated                              | 2018-06-11T23:26:39Z                                                                                                                                                                                                                                               |
| user_id                              | ************                                                                                                                                                                                                                                   |
+--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
dims commented 6 years ago

@s0komma : cat cloud_config from the master please :) that's where you have the problem right

s0komma commented 6 years ago

@dims -- found a typo and now its coming up. Thanks for the pointer