ibis-project / ibis

the portable Python dataframe library
https://ibis-project.org
Apache License 2.0
5.23k stars 592 forks source link

ci: improve when we run the full test suite on CI #8233

Open gforsyth opened 8 months ago

gforsyth commented 8 months ago

Current status

We have a large test suite and don't want to run the entire thing for unrelated changes. Currently, there are two ways that CI gets run:

  1. Run everything
  2. If all the changes in a PR (or push) are within the docs/ folder (or are one of a few config files that lives at the root of the repo), then only run a subset of the test suite (mostly the docs-related bits).

This is a good start, but I think we can probably reduce the testing burden more with a few rules that should give us reasonably good coverage (I think).

New rules

Then, as a fallback, we add a label akin to our docs-preview label that can trigger a full backend test suite run if the reviewer thinks that something might have a larger blast radius than accounted for by these rules.

ncclementi commented 8 months ago

I just found out about path-filters GHA thanks to this blog https://www.flightcontrol.dev/blog/reduced-github-actions-bill-by-63.

I think we could use this to filter by backend folders.