kubernetes-sigs / cri-tools

CLI and validation tools for Kubelet Container Runtime Interface (CRI) .
Apache License 2.0
1.69k stars 454 forks source link

Crictl returning Internal Server Error when i try to pull images from it. #1608

Open Anddiy opened 2 months ago

Anddiy commented 2 months ago

What happened:

When i try to pull a image from my nexus private repository using the command crictl --debug pull , CRIO didnt pull the image and show the error:

DEBU[0000] PullImageRequest: &PullImageRequest{Image:&ImageSpec{Image:,Annotations:map[string]string{},},Auth:nil,SandboxConfig:nil,} E1002 17:49:13.548119 2819941 remote_image.go:167] "PullImage from image service failed" err="rpc error: code = Unknown desc = pinging container registry : Get \"https:///v2/\": Internal Server Error" image="/:tag" FATA[0000] pulling image: rpc error: code = Unknown desc = pinging container registry repo-ace.infoacesso.internal.timbrasil.com.br: Get "https:///v2/": Internal Server Error

This error occurs to any image i try to use from that repository and occurs in all machines of the cluster.

What you expected to happen:

The commands download the image succesfully.

How to reproduce it (as minimally and precisely as possible):

-> Set Up a external Nexus docker hosted repository running on RKE2 and build any image. -> Set Up an OpenShift Cluster -> Try to download any image from the nexus private repository using the command crictl pull

Anything else we need to know?:

I have an HML enverionment running openshift too and from that HML cluster, crioctl works normally.

The funny thing is when i try to use the image using podman pull, its works normally, only with crictl this problem occurs, openshift uses crictl to run pod images, so even with podman working normally, my pod will return a crashLoopBackOff error because the crictl didint work.

Environment:

SergeyKanzhelev commented 1 month ago

Internal Server Error often indicate the backend issue. In your error log I see that https:///v2/ is listed instead of the full URL.

I think to make progress here you would need to provide the full command you use, the whole log output, and logs with the maximum verbosity you can think of from the container runtime.

I would expect it is either CRI-O or backend issue though, so this may not be the best repo for this issue

kwilczynski commented 1 month ago

I don't think this has anything immediately to do with our CLI. We don't pull anything, we ask CRI to pull the image for us.

kwilczynski commented 1 month ago

@Anddiy, if you can reproduce this and if you believe this is an issue that is not within your infrastructure or environment, then feel free to open an issue against CRI-O so it can be tracked there.