Integration Tests :
Run these test cases in the build pipeline optionally on every build or they should be triggered manually.
Performance Test:
In the same build pipeline, run integration test cases and calculate elapsed time with the latest release/previous commit binaries to create a baseline and then run integration test with the built binaries to compare the elapsed time with the baseline. Need to make sure this produces reproducible performance results and not false positives.
Create two options in the build pipeline to run integration and performance tests manually.
The repositories which contain the positive and negative test cases are :
Integration Tests : Run these test cases in the build pipeline optionally on every build or they should be triggered manually.
Performance Test: In the same build pipeline, run integration test cases and calculate elapsed time with the latest release/previous commit binaries to create a baseline and then run integration test with the built binaries to compare the elapsed time with the baseline. Need to make sure this produces reproducible performance results and not false positives.
Create two options in the build pipeline to run integration and performance tests manually.