CSI CI starts to fail after adding K8s 1.29 jobs

For 1.28 and earlier jobs, it uses CSI_PROW_GO_VERSION_BUILD "1.21.5" defined in prow.sh. We fixed a similar issue earlier with this PR: https://github.com/kubernetes-csi/csi-release-tools/pull/246/files.

For the latest K8s version in CI, it tries to use the minimum_go_version in hack/lib/golang.sh. For K8s 1.29, the minimum_go_version is 1.21.

https://github.com/kubernetes-csi/csi-release-tools/blob/master/prow.sh#L562

go_version_for_kubernetes () (
    local path="$1"
    local version="$2"
    local go_version

    # We use the minimal Go version specified for each K8S release (= minimum_go_version in hack/lib/golang.sh).
    # More recent versions might also work, but we don't want to count on that.
    go_version="$(grep minimum_go_version= "$path/hack/lib/golang.sh" | sed -e 's/.*=go//')"
    if ! [ "$go_version" ]; then
        die "Unable to determine Go version for Kubernetes $version from hack/lib/golang.sh."
    fi
    # Strip the trailing .0. Kubernetes includes it, Go itself doesn't.
    # Ignore: See if you can use ${variable//search/replace} instead.
    # shellcheck disable=SC2001
    go_version="$(echo "$go_version" | sed -e 's/\.0$//')"
    echo "$go_version"
)

However, go1.21.linux-amd64.tar.gz does not exist.

Fri Feb 16 15:00:38 UTC 2024 go1.22.0 /home/prow/go/pkg/csiprow.XBzTGe3OIr/src/kubernetes$ curl --fail --location https://dl.google.com/go/go1.21.linux-amd64.tar.gz
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0  1449    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
curl: (22) The requested URL returned error: 404

gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
ERROR: installation of Go 1.21 failed
ERROR: 'kind build node-image' failed

@pohly Should we use CSI_PROW_GO_VERSION_BUILD defined in prow.sh instead for the latest K8s job as well? Depending on minimum_go_version in hack/lib/golang.sh does not seem to be reliable.

kubernetes-csi / csi-release-tools

CSI CI starts to fail after adding K8s 1.29 jobs #248