Call out instructions for GKE autopilot

petewall commented 1 year ago

Tried installing today. Node Exporter does not deploy:

{
  "[denied by autogke-disallow-hostnamespaces]": [
    "enabling hostPID is not allowed in Autopilot.",
    "enabling hostNetwork is not allowed in Autopilot."
  ],
  "[denied by autogke-no-host-port]": [
    "container node-exporter specifies host ports [9100], which are disallowed in Autopilot."
  ],
  "[denied by autogke-no-write-mode-hostpath]": [
    "hostPath volume proc used in container node-exporter uses path /proc which is not allowed in Autopilot. Allowed path prefixes for hostPath volumes are: [/var/log/].",
    "hostPath volume sys used in container node-exporter uses path /sys which is not allowed in Autopilot. Allowed path prefixes for hostPath volumes are: [/var/log/].",
    "hostPath volume root used in container node-exporter uses path / which is not allowed in Autopilot. Allowed path prefixes for hostPath volumes are: [/var/log/]."
  ]
}

moxious commented 1 year ago

+1

Failures I see are similar

"grafana" already exists with the same configuration, skipping
Hang tight while we grab the latest from your chart repositories...
...Successfully got an update from the "grafana" chart repository
Update Complete. ⎈Happy Helming!⎈
Release "grafana-k8s-monitoring" does not exist. Installing it now.
W1003 07:39:30.640711    2068 warnings.go:70] autopilot-default-resources-mutator:Autopilot updated DaemonSet default/grafana-k8s-monitoring-grafana-agent-logs: defaulted unspecified resources for containers [grafana-agent, config-reloader] (see http://g.co/gke/autopilot-defaults)
W1003 07:39:30.640806    2068 warnings.go:70] autopilot-default-resources-mutator:Autopilot updated DaemonSet default/grafana-k8s-monitoring-prometheus-node-exporter: defaulted unspecified resources for containers [node-exporter] (see http://g.co/gke/autopilot-defaults)
W1003 07:39:30.739594    2068 warnings.go:70] autopilot-default-resources-mutator:Autopilot updated Deployment default/grafana-k8s-monitoring-kube-state-metrics: defaulted unspecified resources for containers [kube-state-metrics] (see http://g.co/gke/autopilot-defaults)
W1003 07:39:30.741597    2068 warnings.go:70] autopilot-default-resources-mutator:Autopilot updated Deployment default/grafana-k8s-monitoring-opencost: adjusted resources to meet requirements for containers [grafana-k8s-monitoring-opencost] (see http://g.co/gke/autopilot-resources)
W1003 07:39:30.846097    2068 warnings.go:70] autopilot-default-resources-mutator:Autopilot updated StatefulSet default/grafana-k8s-monitoring-grafana-agent: defaulted unspecified resources for containers [grafana-agent, config-reloader] (see http://g.co/gke/autopilot-defaults)
Error: 2 errors occurred:
    * admission webhook "warden-validating.common-webhooks.networking.gke.io" denied the request: GKE Warden rejected the request because it violates one or more constraints.
Violations details: {"[denied by autogke-no-write-mode-hostpath]":["hostPath volume dockercontainers used in container grafana-agent uses path /var/lib/docker/containers which is not allowed in Autopilot. Allowed path prefixes for hostPath volumes are: [/var/log/]."]}
Requested by user: '(email)', groups: 'system:authenticated'.
    * admission webhook "warden-validating.common-webhooks.networking.gke.io" denied the request: GKE Warden rejected the request because it violates one or more constraints.
Violations details: {"[denied by autogke-disallow-hostnamespaces]":["enabling hostNetwork is not allowed in Autopilot.","enabling hostPID is not allowed in Autopilot."],"[denied by autogke-no-host-port]":["container node-exporter specifies host ports [9100], which are disallowed in Autopilot."],"[denied by autogke-no-write-mode-hostpath]":["hostPath volume proc used in container node-exporter uses path /proc which is not allowed in Autopilot. Allowed path prefixes for hostPath volumes are: [/var/log/].","hostPath volume sys used in container node-exporter uses path /sys which is not allowed in Autopilot. Allowed path prefixes for hostPath volumes are: [/var/log/].","hostPath volume root used in container node-exporter uses path / which is not allowed in Autopilot. Allowed path prefixes for hostPath volumes are: [/var/log/]."]}
Requested by user: '(email)', groups: 'system:authenticated'.

Conall-Grafana commented 1 year ago

some related discussions in a 3rd party repo that might be of interest:

https://github.com/lensapp/lens/issues/7126

grafana / k8s-monitoring-helm

Call out instructions for GKE autopilot #39