$ kubectl describe pod monitor-prometheus-server
Name: monitor-prometheus-server-7c55cc4c5-kvw28
Namespace: default
Priority: 0
Node: keti1-worker1/192.168.100.6
Start Time: Wed, 19 Aug 2020 15:10:35 +0900
Labels: app=prometheus
chart=prometheus-11.12.0
component=server
heritage=Helm
pod-template-hash=7c55cc4c5
release=monitor
Annotations:
Status: Pending
IP: 10.244.1.3
IPs:
IP: 10.244.1.3
Controlled By: ReplicaSet/monitor-prometheus-server-7c55cc4c5
Containers:
prometheus-server-configmap-reload:
Container ID:
Image: jimmidyson/configmap-reload:v0.4.0
Image ID:
Port:
Host Port:
Args:
--volume-dir=/etc/config
--webhook-url=http://127.0.0.1:9090/-/reload
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment:
Mounts:
/etc/config from config-volume (ro)
/var/run/secrets/kubernetes.io/serviceaccount from monitor-prometheus-server-token-rgpwr (ro)
prometheus-server:
Container ID:
Image: prom/prometheus:v2.20.1
Image ID:
Port: 9090/TCP
Host Port: 0/TCP
Args:
--storage.tsdb.retention.time=15d
--config.file=/etc/config/prometheus.yml
--storage.tsdb.path=/data
--web.console.libraries=/etc/prometheus/console_libraries
--web.console.templates=/etc/prometheus/consoles
--web.enable-lifecycle
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Liveness: http-get http://:9090/-/healthy delay=30s timeout=30s period=15s #success=1 #failure=3
Readiness: http-get http://:9090/-/ready delay=30s timeout=30s period=5s #success=1 #failure=3
Environment:
Mounts:
/data from storage-volume (rw)
/etc/config from config-volume (rw)
/var/run/secrets/kubernetes.io/serviceaccount from monitor-prometheus-server-token-rgpwr (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
config-volume:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: monitor-prometheus-server
Optional: false
storage-volume:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit:
monitor-prometheus-server-token-rgpwr:
Type: Secret (a volume populated by a Secret)
SecretName: monitor-prometheus-server-token-rgpwr
Optional: false
QoS Class: BestEffort
Node-Selectors:
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
Normal Scheduled default-scheduler Successfully assigned default/monitor-prometheus-server-7c55cc4c5-kvw28 to keti1-worker1
Warning Failed 36m kubelet, keti1-worker1 Error: ImagePullBackOff
Normal Pulling 35m (x3 over 36m) kubelet, keti1-worker1 Pulling image "jimmidyson/configmap-reload:v0.4.0"
Warning Failed 35m (x3 over 36m) kubelet, keti1-worker1 Failed to pull image "jimmidyson/configmap-reload:v0.4.0": rpc error: code = Unknown desc = Error response from daemon: Get https://registry-1.docker.io/v2/: dial tcp: lookup registry-1.docker.io: no such host
Warning Failed 35m (x3 over 36m) kubelet, keti1-worker1 Error: ErrImagePull
Normal Pulling 35m (x3 over 36m) kubelet, keti1-worker1 Pulling image "prom/prometheus:v2.20.1"
Warning Failed 35m (x3 over 36m) kubelet, keti1-worker1 Failed to pull image "prom/prometheus:v2.20.1": rpc error: code = Unknown desc = Error response from daemon: Get https://registry-1.docker.io/v2/: dial tcp: lookup registry-1.docker.io: no such host
Warning Failed 35m (x3 over 36m) kubelet, keti1-worker1 Error: ErrImagePull
Normal BackOff 35m (x2 over 36m) kubelet, keti1-worker1 Back-off pulling image "prom/prometheus:v2.20.1"
Warning Failed 6m39s (x115 over 36m) kubelet, keti1-worker1 Error: ImagePullBackOff
Normal BackOff 100s (x136 over 36m) kubelet, keti1-worker1 Back-off pulling image "jimmidyson/configmap-reload:v0.4.0"
Name: monitor-prometheus-server-f8ddc97f-f4rk7
Namespace: default
Priority: 0
Node:
Labels: app=prometheus
chart=prometheus-11.12.0
component=server
heritage=Helm
pod-template-hash=f8ddc97f
release=monitor
Annotations:
Status: Pending
IP:
IPs:
Controlled By: ReplicaSet/monitor-prometheus-server-f8ddc97f
Containers:
prometheus-server-configmap-reload:
Image: jimmidyson/configmap-reload:v0.4.0
Port:
Host Port:
Args:
--volume-dir=/etc/config
--webhook-url=http://127.0.0.1:9090/-/reload
Environment:
Mounts:
/etc/config from config-volume (ro)
/var/run/secrets/kubernetes.io/serviceaccount from monitor-prometheus-server-token-rgpwr (ro)
prometheus-server:
Image: prom/prometheus:v2.20.1
Port: 9090/TCP
Host Port: 0/TCP
Args:
--storage.tsdb.retention.time=15d
--config.file=/etc/config/prometheus.yml
--storage.tsdb.path=/data
--web.console.libraries=/etc/prometheus/console_libraries
--web.console.templates=/etc/prometheus/consoles
--web.enable-lifecycle
Liveness: http-get http://:9090/-/healthy delay=30s timeout=30s period=15s #success=1 #failure=3
Readiness: http-get http://:9090/-/ready delay=30s timeout=30s period=5s #success=1 #failure=3
Environment:
Mounts:
/data from storage-volume (rw)
/etc/config from config-volume (rw)
/var/run/secrets/kubernetes.io/serviceaccount from monitor-prometheus-server-token-rgpwr (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
config-volume:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: monitor-prometheus-server
Optional: false
storage-volume:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: monitor-prometheus-server
ReadOnly: false
monitor-prometheus-server-token-rgpwr:
Type: Secret (a volume populated by a Secret)
SecretName: monitor-prometheus-server-token-rgpwr
Optional: false
QoS Class: BestEffort
Node-Selectors:
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
Warning FailedScheduling default-scheduler running "VolumeBinding" filter plugin for pod "monitor-prometheus-server-f8ddc97f-f4rk7": pod has unbound immediate PersistentVolumeClaims
Warning FailedScheduling default-scheduler persistentvolumeclaim "monitor-prometheus-server" not found
$ kubectl describe pod monitor-prometheus-server Name: monitor-prometheus-server-7c55cc4c5-kvw28 Namespace: default Priority: 0 Node: keti1-worker1/192.168.100.6 Start Time: Wed, 19 Aug 2020 15:10:35 +0900 Labels: app=prometheus chart=prometheus-11.12.0 component=server heritage=Helm pod-template-hash=7c55cc4c5 release=monitor Annotations:
Status: Pending
IP: 10.244.1.3
IPs:
IP: 10.244.1.3
Controlled By: ReplicaSet/monitor-prometheus-server-7c55cc4c5
Containers:
prometheus-server-configmap-reload:
Container ID:
Host Port:
Args:
--volume-dir=/etc/config
--webhook-url=http://127.0.0.1:9090/-/reload
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment:
Mounts:
/etc/config from config-volume (ro)
/var/run/secrets/kubernetes.io/serviceaccount from monitor-prometheus-server-token-rgpwr (ro)
prometheus-server:
Container ID:
Mounts:
/data from storage-volume (rw)
/etc/config from config-volume (rw)
/var/run/secrets/kubernetes.io/serviceaccount from monitor-prometheus-server-token-rgpwr (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
config-volume:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: monitor-prometheus-server
Optional: false
storage-volume:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
monitor-prometheus-server-token-rgpwr:
Type: Secret (a volume populated by a Secret)
SecretName: monitor-prometheus-server-token-rgpwr
Optional: false
QoS Class: BestEffort
Node-Selectors:
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
Image: jimmidyson/configmap-reload:v0.4.0 Image ID:
Port:
Image: prom/prometheus:v2.20.1 Image ID:
Port: 9090/TCP Host Port: 0/TCP Args: --storage.tsdb.retention.time=15d --config.file=/etc/config/prometheus.yml --storage.tsdb.path=/data --web.console.libraries=/etc/prometheus/console_libraries --web.console.templates=/etc/prometheus/consoles --web.enable-lifecycle State: Waiting Reason: ImagePullBackOff Ready: False Restart Count: 0 Liveness: http-get http://:9090/-/healthy delay=30s timeout=30s period=15s #success=1 #failure=3 Readiness: http-get http://:9090/-/ready delay=30s timeout=30s period=5s #success=1 #failure=3 Environment:
SizeLimit:
Normal Scheduled default-scheduler Successfully assigned default/monitor-prometheus-server-7c55cc4c5-kvw28 to keti1-worker1
Warning Failed 36m kubelet, keti1-worker1 Error: ImagePullBackOff
Normal Pulling 35m (x3 over 36m) kubelet, keti1-worker1 Pulling image "jimmidyson/configmap-reload:v0.4.0"
Warning Failed 35m (x3 over 36m) kubelet, keti1-worker1 Failed to pull image "jimmidyson/configmap-reload:v0.4.0": rpc error: code = Unknown desc = Error response from daemon: Get https://registry-1.docker.io/v2/: dial tcp: lookup registry-1.docker.io: no such host
Warning Failed 35m (x3 over 36m) kubelet, keti1-worker1 Error: ErrImagePull
Normal Pulling 35m (x3 over 36m) kubelet, keti1-worker1 Pulling image "prom/prometheus:v2.20.1"
Warning Failed 35m (x3 over 36m) kubelet, keti1-worker1 Failed to pull image "prom/prometheus:v2.20.1": rpc error: code = Unknown desc = Error response from daemon: Get https://registry-1.docker.io/v2/: dial tcp: lookup registry-1.docker.io: no such host
Warning Failed 35m (x3 over 36m) kubelet, keti1-worker1 Error: ErrImagePull
Normal BackOff 35m (x2 over 36m) kubelet, keti1-worker1 Back-off pulling image "prom/prometheus:v2.20.1"
Warning Failed 6m39s (x115 over 36m) kubelet, keti1-worker1 Error: ImagePullBackOff
Normal BackOff 100s (x136 over 36m) kubelet, keti1-worker1 Back-off pulling image "jimmidyson/configmap-reload:v0.4.0"
Name: monitor-prometheus-server-f8ddc97f-f4rk7 Namespace: default Priority: 0 Node:
Labels: app=prometheus
chart=prometheus-11.12.0
component=server
heritage=Helm
pod-template-hash=f8ddc97f
release=monitor
Annotations:
Status: Pending
IP:
Controlled By: ReplicaSet/monitor-prometheus-server-f8ddc97f
Containers:
prometheus-server-configmap-reload:
Image: jimmidyson/configmap-reload:v0.4.0
Port:
Host Port:
Args:
--volume-dir=/etc/config
--webhook-url=http://127.0.0.1:9090/-/reload
Environment:
Mounts:
/etc/config from config-volume (ro)
/var/run/secrets/kubernetes.io/serviceaccount from monitor-prometheus-server-token-rgpwr (ro)
prometheus-server:
Image: prom/prometheus:v2.20.1
Port: 9090/TCP
Host Port: 0/TCP
Args:
--storage.tsdb.retention.time=15d
--config.file=/etc/config/prometheus.yml
--storage.tsdb.path=/data
--web.console.libraries=/etc/prometheus/console_libraries
--web.console.templates=/etc/prometheus/consoles
--web.enable-lifecycle
Liveness: http-get http://:9090/-/healthy delay=30s timeout=30s period=15s #success=1 #failure=3
Readiness: http-get http://:9090/-/ready delay=30s timeout=30s period=5s #success=1 #failure=3
Environment:
Mounts:
/data from storage-volume (rw)
/etc/config from config-volume (rw)
/var/run/secrets/kubernetes.io/serviceaccount from monitor-prometheus-server-token-rgpwr (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
config-volume:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: monitor-prometheus-server
Optional: false
storage-volume:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: monitor-prometheus-server
ReadOnly: false
monitor-prometheus-server-token-rgpwr:
Type: Secret (a volume populated by a Secret)
SecretName: monitor-prometheus-server-token-rgpwr
Optional: false
QoS Class: BestEffort
Node-Selectors:
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
IPs:
Warning FailedScheduling default-scheduler running "VolumeBinding" filter plugin for pod "monitor-prometheus-server-f8ddc97f-f4rk7": pod has unbound immediate PersistentVolumeClaims
Warning FailedScheduling default-scheduler persistentvolumeclaim "monitor-prometheus-server" not found