search

JamesPHoughton / pysd-tools

0 stars 0 forks source link

Automatic Extreme Condition Test Case Generation #1

Open JamesPHoughton opened 7 years ago

JamesPHoughton commented 7 years ago

For each parameter we have, create a test condition template in which they are individually or together set to extreme values. Then all the user needs to do is fill in what the expected behavior should be for various model elements under these extreme conditions.

We could also generate a tool like 'coverage' which tells you what fraction of extreme conditions (either singly or in combination) have tests established.

JamesPHoughton commented 7 years ago

You could have a table, with rows representing conditions (e.g. population = 0) and columns representing some set of model parameters (e.g. births) and the value in the corresponding cell would be what we expect the value of births to take on whenever population was zero. It would be a sparse matrix, but probably a relatively efficient way to add test conditions.

The indicies could be a pandas hierarchical index, with the first layer of the index being the parameter, and the second layer being the value. Might give you trouble when you want to specify values for multiple parameters, though...