When OP Params are used to enable / disable certain features then it creates a lot of behavior branches in code. Right now, all the CI tests use the default OP Params which means there's a lot of things that aren't being tested as part of the CI pipeline.
This enhancement to rework the CI tests should do the following:
[ ] Each unit and integration test case should run multiple times with each run enabling a different toggleable OP Param.
[ ] The default params (with everything off) should be able to pass comma's integration test for that version of OP.
Things to keep in mind:
Look into auto-generating tests cases. Ideally we wouldn't have to update a list of toggleable params manually.
Process Replay (integration tests) need to work with remote comma data and for local data.
When OP Params are used to enable / disable certain features then it creates a lot of behavior branches in code. Right now, all the CI tests use the default OP Params which means there's a lot of things that aren't being tested as part of the CI pipeline.
This enhancement to rework the CI tests should do the following:
Things to keep in mind: