search

galasa-dev / projectmanagement

Project Management repo for Issues and ZenHub
7 stars 3 forks source link

General CPS Conditional Annotation #1909

Open Tom-Slattery opened 3 days ago

Tom-Slattery commented 3 days ago

Story

As a Galasa test developer, I want to be able to skip a Galasa test method from running if CPS properties do not match expected conditions, so that I only receive failing test results for valid test scenarios.

Background

It is really important that we can automatically exempt certain tests from running if CPS properties do not match expected values. I think a good implementation of this would be a "conditions" annotation that is capable of performing comparisons, e.g.: 

@conditions({
    CpsProperty("cicsts.default.version").greaterThan(5.6.0),
    CpsProperty("cicsts.provision.type").equals("sem")
})

This allows us to run tests in bulk without needing to worry that changes to the CPS properties will affect test results in a way that does not give us accurate information about the status of the feature under test.