Human-in-the-loop pipeline step

[MightyGoldenJA]

Proposal Summary

Some pipeline steps, especially after quality control should be able to pause the execution of the pipeline and prompting the user for confirmation before proceeding to the next steps, this is common feature in most CI pipeline tools. The step should execute pre-hook code to prepare QC report or even be integrated with ClearML report so the human user can directly see data to make his decision. The UI should also have a Continue and Abort buttons.

Motivation

This would allow for more flexible validation of pipeline-shipping pipeline than programmatic quality criterion.

[ainoam]

Thanks for suggesting @MightyGoldenJA.

What interface beyond the actual go/no-go decision are you imagining?

Note that as of v1.15.0, you can effectively implement a manual check by creating a step in draft status (#1226).