ebi-ait / dcp-ingest-central

Central point of access for the Ingestion Service of the HCA DCP
Apache License 2.0
0 stars 0 forks source link

Authorization error while contacting pods #970

Closed amnonkhen closed 1 year ago

amnonkhen commented 1 year ago

I started getting the following errors on prod without changing anything on the cluster.

❯ kubectl logs rabbit-0
Error from server (InternalError): Internal error occurred: Authorization error (user=kube-apiserver-kubelet-client, verb=get, resource=nodes, subresource=proxy)
❯ kubectl port-forward rabbit-0 15672:15672
error: error upgrading connection: unable to upgrade connection: Authorization error (user=kube-apiserver-kubelet-client, verb=create, resource=nodes, subresource=proxy)

Created support case 13346330601 with aws.

amnonkhen commented 1 year ago

pods need to be migrated to new nodes running new kubelet.

This stackoverflow might be relevant.

amnonkhen commented 1 year ago

solved with the cluster upgrade task #774