search

rancher / highlander

2 stars 2 forks source link

QA automation for CAPI UI extension #41

Open kkaempf opened 9 months ago

kkaempf commented 9 months ago

As the CAPI UI extension evolves, we need to provide test automation to verify its functionality and detect regressions early.

This should build up on the work done by Elemental, which esp. covers

richardcase commented 7 months ago

We need the UI extension to fully do this.

We can start with:

A lot of this will probably have been done by Julien already.

Danil-Grigorev commented 7 months ago

I’ll try to have a look at this.

cpinjani commented 7 months ago

Automation repo: https://github.com/rancher-sandbox/rancher-turtles-e2e

Danil-Grigorev commented 7 months ago

Most of this was done by Julien and Chandan, we would probably need to run this in our repository by now. Also currently tested version of UI does not support providing CAPIProvider manifests.

Danil-Grigorev commented 7 months ago

I’m moving this as completed, as the rancher-turtles-e2e contains all required implementations, and runs in a periodic. Can’t see anything to add to this ticket.

kkaempf commented 7 months ago

@Danil-Grigorev @cpinjani is this running against current dev or last release of the turtles UI ? And where would one see the result of the latest test run ?

Danil-Grigorev commented 7 months ago

This is running against current dev, the workflow results are here: https://github.com/rancher-sandbox/rancher-turtles-e2e/actions. I can add a test case running against latest rancher-turtles release, if you think it is necessary.

Danil-Grigorev commented 7 months ago

Also it seems to me that since yesterday latest rancher 2.8 installation started to fail. Hit this in my local testing as well, but assumed it is a flake.

cpinjani commented 7 months ago

The automation is running on:

I've raised fix for current failure: https://github.com/rancher-sandbox/rancher-turtles-e2e/pull/11