We should run integration testing in a frequent basis, comparing tests results from reference implementations from the last release and from current master.
For every test we do the following
When we are ok with the release (we have a new version/tag), we store the results with reference implementations (or files or scripts)
If there are new commits after creating the tag (other than updating the POM file) we should check (run it nightly or weekly) to see if there are new bugs introduced
Data needed: Run date | Test name | Test version | TE version | Result | Explanation | Link to report | Link to screenshot
The nightly report is compared to the latest report from a tagged version. If new bugs appear a red flag is raised. The report will show in red that there has been a change detected.
We should run integration testing in a frequent basis, comparing tests results from reference implementations from the last release and from current master. For every test we do the following
Data needed: Run date | Test name | Test version | TE version | Result | Explanation | Link to report | Link to screenshot
The nightly report is compared to the latest report from a tagged version. If new bugs appear a red flag is raised. The report will show in red that there has been a change detected.