Add a way to routinely test if an issue still applies

[andylolz]

A bugtracker issue could have an accompanying programmatic test. When that test passes, the issue has been fixed and the ticket can be closed.