search

kyma-project / kyma

Kyma is an opinionated set of Kubernetes-based modular building blocks, including all necessary capabilities to develop and run enterprise-grade cloud-native applications.
https://kyma-project.io
Apache License 2.0
1.52k stars 405 forks source link

Broken serverless on GKE 1.19 with self-signed cert #10572

Closed adamwalach closed 3 years ago

adamwalach commented 3 years ago

Description

After upgrading GKE pipeline to 1.19.7 we noticed that 3 tests are constantly failing

These tests are failing because they are not able to pull docker images:

long-running-function-test   longrun-build-srf7j-v59c6                                         0/1     Completed          0          13m
long-running-function-test   longrun-zsprh-74f5cddbd9-rz6rc                                    1/2     ImagePullBackOff   0          13m
natss                        nats-streaming-0                                                  1/1     Running            0          29m
test-parallel-12h-57m-33s    default-broker-filter-78dd7c8f9d-wzbkr                            2/2     Running            2          3m34s
test-parallel-12h-57m-33s    default-broker-ingress-d9d48d4dd-8nsc6                            2/2     Running            2          3m34s
test-parallel-12h-57m-33s    nodejs12-build-ph67b-w2jd4                                        0/1     Completed          0          3m32s
test-parallel-12h-57m-33s    nodejs12-v587q-84cbb949d4-lll2x                                   1/2     ErrImagePull       0          3m18s

This is probably caused by changes to the underlying containerization soulution. Processes on GKE 1.8:

\_ containerd-shim -namespace moby -workdir /var/lib/containerd/io.containerd.runtime.v1.linux/moby/d799d0d71a3e65a4c88ba0002fbd9f44a68262413d92f164fdfc7afb5a524902 -address /run/contain
chronos    12949  0.3  0.2 736948 43912 ?        Ssl  14:10   0:09  |   \_ /app/main --metrics-addr :8080

Processes on GKE 1.9:

/usr/bin/containerd-shim-runc-v2 -namespace k8s.io -id 5b0259713978b610829f4ea74ea365f871c63d48bf195a3296ec531c3e105ace -address /run/containerd/containerd.sock
root        7766  0.0  0.0    968     4 ?        Ss   13:57   0:00  \_ /pause
70          7883  0.0  0.1 192404 20676 ?        Ss   13:57   0:00  \_ postgres
70          7946  0.0  0.0 192480  4672 ?        Ss   13:57   0:00      \_ postgres: checkpointer

Related issue: https://github.com/containerd/containerd/issues/3071

Expected result

Tests should be green,

Actual result

Steps to reproduce

Troubleshooting

adamwalach commented 3 years ago

Test for serverless are now disabled on post-master-kyma-gke-rapid-integration https://github.com/kyma-project/test-infra/pull/3282/files

kwiatekus commented 3 years ago

We will adjust documentation and tests fro the certificate prerequisire: https://github.com/kyma-project/kyma/issues/10624

ghost commented 3 years ago

This issue has been automatically marked as stale due to the lack of recent activity. It will soon be closed if no further activity occurs. Thank you for your contributions.