search

i4Ds / Karabo-Pipeline

The Karabo Pipeline can be used as Digital Twin for SKA
https://i4ds.github.io/Karabo-Pipeline/
MIT License
11 stars 4 forks source link

Run (multi-node) unit tests on CSCS #170

Open sfiruch opened 2 years ago

sfiruch commented 2 years ago

At least for our releases, we should make sure that they work as expected on CSCS infra. Victor suggested we use ReFrame. We could also use that to confirm that resource-intensive unit tests still work.

It's probably not smart to execute the tests for every commit, because we only get 5000 node-hours. But perhaps running those tests on every PR merge into the main branch might be interesting.

kenfus commented 2 years ago

I had a look at it and it seems doable (of course it is). I will also look at commented out tests in this PR and if they can be added to the CSCS testing.

@deiruch I think it would be great if we would have a separate user for testing on CSCS, to clearly see how many hours the testing is using.

sfiruch commented 2 years ago

Perhaps ask Victor Holanda (CSCS) on how to setup the infra to get automated CI/CD.

sfiruch commented 1 year ago

Andreas Fink from CSCS suggested we use their dockerized CI infrastructure: https://gitlab.com/cscs-ci/ci-testing/containerised_ci_doc

@kenfus What do you think? Should be easy to use, and webhooks are already supported?

sfiruch commented 1 year ago

Maybe this would also solve #189, because CSCS requires docker containers anyway...

kenfus commented 1 year ago

I think it looks OK and we are currently caching a dev environment as a docker image, so this should be possible. However, I am unsure how exactly docker works with slurm jobs and we would also need access as described in https://gitlab.com/cscs-ci/ci-testing/containerised_ci_doc . I can have a look at it?

sfiruch commented 1 year ago

I asked CSCS to register our project, so we can test this. I'll post when I hear back from them.

sfiruch commented 1 year ago

I registered our project with CSCS/Andreas Fink.

CSCS can test docker containers: https://gitlab.com/cscs-ci/ci-testing/containerised_ci_doc and supports webhooks.

sfiruch commented 1 year ago

There will be a meeting with CSCS on Aug 17 about this exact topic: https://ethz.zoom.us/my/cscsvrdahlia; cscs-dahlia