Install logic switched to ele-testhelpers

[thehejik]

Fixes https://github.com/rancher/hosted-providers-e2e/issues/189

Totally work in progress - the suite and install files were borrowed from turtles-e2e - needs to be adapted for HP.

RANCHER_PASSWORD=mypwd \
RANCHER_HOSTNAME=1.2.3.4.nip.io \
RANCHER_VERSION=latest/2.9.2 \
INSTALL_K3S_VERSION=v1.28.10+k3s1 \
make prepare-rancher

Todo:

• [x] create a normal user??? - NOT USED
• [x] install helm - already in Makefile as install-helm target - now always installs latest
• [x] install nightly operators - ~so far kept in Makefile~ moved to install_suite.go
• [x] waiting for rancher-webhook pods already implemented, fixes https://github.com/rancher/hosted-providers-e2e/issues/183
• [x] proxy - run squid in docker, config k3s, certmanager and rancher
• [x] process squid logs
• [x] combine nighly x proxy x normal - no big change - only that all scenarios are driven by env variables NIGHTLY_CHART and RANCHER_BEHIND_PROXY (use when != "") and calling make prepare-rancher
• [x] code cleanup

[thehejik]

Notes for initial proxy support:

• add support for proxy in k3s, cert-manager and rancher via command:

  RANCHER_BEHIND_PROXY=anything \
  RANCHER_PASSWORD=mypasswd \
  RANCHER_HOSTNAME=1.2.3.4.nip.io \
  RANCHER_VERSION=latest/devel/2.9 \
  INSTALL_K3S_VERSION=v1.28.10+k3s1 \
  make prepare-rancher

• proxyUrl is hardcoded
• Workflows not modified
• Cleanup required

[thehejik]

required PR https://github.com/rancher-sandbox/ele-testhelpers/pull/67

[thehejik]

Notes for previous commit

• function complete
• nightly charts supported (needs change in testhelpers)
• workflows not adapted yet
• initial cleanup

Used command to deploy rancher with proxy and with nightly hosted providers chart:

PROVIDER=aks \
NIGHTLY=yes \
RANCHER_BEHIND_PROXY=yes \
RANCHER_PASSWORD=mypassword \
RANCHER_HOSTNAME=1.2.3.4.nip.io \
RANCHER_VERSION=latest/devel/2.10 \
INSTALL_K3S_VERSION=v1.30.6+k3s1 \
make prepare-e2e-ci-rancher-hosted-nightly-chart-behind-proxy

Verified values helm get values rancher -n cattle-system -o yaml:

bootstrapPassword: mypassword
extraEnv:
- name: CATTLE_SERVER_URL
  value: https://1.2.3.4.nip.io
- name: CATTLE_AGENT_IMAGE
  value: rancher/rancher-agent:v2.10-head
- name: CATTLE_SKIP_HOSTED_CLUSTER_CHART_INSTALLATION
  value: "true"
hostname: 1.2.3.4.nip.io
noProxy: 127.0.0.0/8,10.0.0.0/8,cattle-system.svc,172.16.0.0/12,192.168.0.0/16,.svc,.cluster.local
proxy: http://172.17.0.1:3128
rancherImageTag: v2.10-head
replicas: 1
useBundledSystemChart: true

[thehejik]

First testrun, enabled proxy and nightly on AKS with p0_provisioning: https://github.com/rancher/hosted-providers-e2e/actions/runs/11841053192

[thehejik]

After fix for installing nightly_charts: https://github.com/rancher/hosted-providers-e2e/actions/runs/11841322069

[thehejik]

Thanks for valuable inputs, comments from both reviews incorporated.

Almost everything has been addressed but I left following untouched on purpose:

• proxy and nightly values as string
• PROXY_HOST check needed for certmanager

For local rancher deployment you may use this:

RANCHER_BEHIND_PROXY=enabled \
NIGHTLY_CHART=enabled \
PROVIDER=aks \
RANCHER_PASSWORD=mypasswd \
RANCHER_HOSTNAME=1.2.3.4.nip.io \
RANCHER_VERSION=latest/devel/2.10 \
INSTALL_K3S_VERSION=v1.30.6+k3s1 \
make prepare-rancher

Testrun: AKS p0_provisioning, nighly & proxy: https://github.com/rancher/hosted-providers-e2e/actions/runs/11895010284

[valaparthvi]

@thehejik Can you look into https://github.com/rancher/hosted-providers-e2e/actions/runs/11951035086/job/33313855933 failure? I tried to run proxy with nightly operator and rancher installation failed twice.

[thehejik]

@thehejik Can you look into https://github.com/rancher/hosted-providers-e2e/actions/runs/11951035086/job/33313855933 failure? I tried to run proxy with nightly operator and rancher installation failed twice.

@valaparthvi thanks, good catch - it should be resolved by latest commit - problem was that extraEnv index was out of the sequence and then helm rendered invalid rancher deployment yaml.

Testruns:

• on prime/2.9.4 p0_provisioning with proxy & nightly enabled: https://github.com/rancher/hosted-providers-e2e/actions/runs/11973230563
• on latest/devel/2.10 p0_import with nightly enabled: https://github.com/rancher/hosted-providers-e2e/actions/runs/11973478743

[thehejik]

Now installing the correct k3s version, thanks @cpinjani for the heads up.

Testrun GKE p0_provisioning, nightly and proxy enabled: https://github.com/rancher/hosted-providers-e2e/actions/runs/12031750996