[ctdb/ss] Test clustered mode in the default CI - Githubissues

samba-in-kubernetes / samba-operator

An operator for a Samba as a service on PVCs in kubernetes

Apache License 2.0

117 stars 24 forks source link

[ctdb/ss] Test clustered mode in the default CI #121

Closed phlogistonjohn closed 2 years ago

phlogistonjohn commented 3 years ago

Currently the tests for clustered SmbShares are not run in the CI. This is because the CI uses a single node k8s cluster with no ability to provision RWX PVCs.

At the bare minimum the test cluster must support Read-Write-Many. Ideally it would also support >=3 k8s nodes.

I don't know if the github CI is sufficient for this.

phlogistonjohn commented 2 years ago

We discussed this a bit in a call earlier today. The current plan is to investigate the use of centos ci for this:

get the needed integration set up
create the ci jobs
set up a three node cluster (probably use minikube)
set up rook for rwx pvcs

After the above, the remaining work would be like what we currently have in the github actions with a few tweaks (probably).

The initial project setup work with be handled by @anoopcs9 with my help.

anoopcs9 commented 2 years ago

Request for Samba project namespace: https://pagure.io/centos-infra/issue/537

anoopcs9 commented 2 years ago

After fighting with various issues we are now ready on our dedicated Samba Namespace. Jobs and other scripts are currently residing under my GitHub username in samba-centosci repository. I have also setup GitHub workflows to verify/update jobs as and when they are modified in the repository.

anoopcs9 commented 2 years ago

We are progressing with a sample job on CentOS CI. Currently looking into a frequent minikube start failure on CentOS installed host.

anoopcs9 commented 2 years ago

Currently looking into a frequent minikube start failure on CentOS installed host.

This is now being fixed with https://github.com/kubernetes/minikube/pull/13482. Next step is to establish an internal CI registry for Samba project namespace to be used as local mirror.

anoopcs9 commented 2 years ago

Updates:

Internal CI registry up and running at https://registry-samba.apps.ocp.ci.centos.org
Consumes new minikube release(v1.25.2) with required fixes
Validation started for running clustered test cases.

anoopcs9 commented 2 years ago

CI jobs are setup to be run against each PR. Additionally they are triggered as nightly jobs.

anoopcs9 commented 2 years ago

In the light of discussions around the need for running tests with 3 different Kubernetes versions, decision has been made to only run centos-ci/sink-clustered/mini-k8s-1.23 against each PR to samba-operator repository. No change in nightly configured jobs.