As a developer I would like multiple test classes to speed up my testing regime - Githubissues

oscal-compass / compliance-trestle

An opinionated tooling platform for managing compliance as code, using continuous integration and NIST's OSCAL standard.

https://oscal-compass.github.io/compliance-trestle

Apache License 2.0

168 stars 61 forks source link

As a developer I would like multiple test classes to speed up my testing regime #920

Open butler54 opened 2 years ago

butler54 commented 2 years ago

Issue description / feature objectives

Currently trestle effectively has one testing regime 'all tests must pass'. Pytest has marks which allow tests to be categorized.

My suggestion would be that we create 3 mark levels:

Default - normal unit tests
slow - for long running tests (such as split and merge) that we may run less in the pipeline (e.g. once per OS in the CI).
integration where they have external dependencies, provided by the CI pipeline and require additional setup from users see #316

Caveats / Assumptions

Will require re-work of the CI pipeline

Completion Criteria

github-actions[bot] commented 3 weeks ago

This issue has been automatically marked as stale because it has not had activity within 90 days. It will be automatically closed if no further activity occurs within 30 days.