Open simonbyrne opened 1 year ago
In the EDMF part of the ClimaAtmos CI we have plots that show the state of the main branch and the PR branch. Checkout any recent profile plot (two lines for the main and PR) and contour plots (two panels for the main and the PR).
@charleskawczynski : Is this issue still active?
For some CI infra, it would be helpful if we could compare with the most recent (or perhaps n most recent?) builds on the main branch. This could be helpful for regression testing (i.e. have our results changed?), and performance (how has our scaling changed).
Buildkite provides two mechanisms for storing data:
Initially we will use artifacts, as they are more useful for storing data. The main problem is then "what is the step id of the previous job"? The best way to do this is probably something like:
prev_build_id
?)PREV_BUILDKITE_BUILD_ID
?)In that way, the comparison code can then download the artifact by