canonical / chisel

GNU Affero General Public License v3.0
270 stars 42 forks source link

tests: add spread tests #30

Closed cjdcordeiro closed 1 year ago

cjdcordeiro commented 2 years ago

Summary of changes

Add Spread tests to the CI.

Spread is running with an Adhoc backend, for a few reasons: 1) GH runners don't support nested virtualization, 2) the LXD backend seems to be misbehaving, and 3) Adhoc is easier and faster to setup than cloud-based backends (which we can set up in the future).

For now, only 2 spread tests are introduced: basic for a quick run-through of the basic Chisel features (i.e. checking mutation scripts are executed, as well as the correct installation of contents and dependencies), and use-a-custom-chisel-release for making sure one can do chisel cut --release ./local/path/to/release ....

woky commented 2 years ago

Can you please squash the commits into one or several logically atomic piece(s)? Same as in #28

cjdcordeiro commented 2 years ago

done

cjdcordeiro commented 1 year ago

Nice, thanks! Was this tested in a local branch, and is it working?

A few superficial comments:

Thanks for the comments. These changes are being tested in the source branch: https://github.com/cjdcordeiro/chisel/actions?query=branch%3Aci-spread

cjdcordeiro commented 1 year ago

Thanks @jnsgruk. I've applied the new lines where they were missing, replaced the Spread systems (the old ones had too old Golang versions, and until we have pre-built Chisel binaries, I don't think it is worth the effort to be working around that), and created a new PR in the Spread repo for creating a new custom GH action for it.

If the latter gets merged 1st, I'll update this PR. (will do it later then :p)