Better support for automated (headless) workflows

[olivierdalang]

Is your feature request related to a problem? Please describe. The tool seems to imply that we manually inspect the reports. This is not always practical, e.g. for automated testing (CI). The tool should also properly support automated usage.

Describe the solution you'd like

• [ ] add a CLI argument to output results to stdout in a non-verbose way, containing only the summary table (so you can understand what happened in the test by looking at the logs, without download an html file)
• [ ] make the CLI exit with error code != 0 when the tests fail
• [ ] (added 2023/05/04) allow to provide a deterministic output file (not prepended by random UUID)

Describe alternatives you've considered No idea

Additional context Related issues that would improve CLI experience

• https://github.com/opengeospatial/teamengine-docker/issues/39
• https://github.com/opengeospatial/ets-ogcapi-features10/issues/197

[dstenger]

Thank you for creating the issue. We will discuss your proposal in the CITE team.

[dstenger]

Can you please provide an example command how you executed the command line interface?