MEGA65 / mega65-tools

Tools and Utilities for the MEGA65 Retro Computers
GNU General Public License v3.0
28 stars 31 forks source link

Implement automated regression testing #124

Closed lydon42 closed 1 year ago

lydon42 commented 2 years ago

The CI/CD chain needs to be able to test a bitstream with all available unit tests.

For this a script is needed that can execute all those tests, record there results in log files, evaluate the combined result and report this back to the calling instance.

Parameters are a bitstream, a path to store the test logs and an optional device string to select the board to talk to.

Todo

lydon42 commented 2 years ago

This is related to #108

lydon42 commented 1 year ago

test_332 does not set video mode and coordinates are set for NTSC mode.

lydon42 commented 1 year ago

Test 332 needs to properly switch to PAL mode on startup, as it is tuned (pixel wise) for that. It will fail if ran in NTSC mode.

lydon42 commented 1 year ago
lydon42 commented 1 year ago

This works reasonably well, as the recent release test builds show. Now the infrastructure (jenkins, remote test hosts) and shell scripts (in core) have to be created.