search

DOMjudge / domjudge

DOMjudge programming contest jury system
https://www.domjudge.org
GNU General Public License v2.0
720 stars 254 forks source link

automated testsuite for judgedaemon #91

Closed eldering closed 11 years ago

eldering commented 11 years ago

Running fully automated testing of judgedaemon: create database, submit stuff, judge it all, check whether it gives expected output. Run this nightly/weekly.

eldering commented 11 years ago

Imported from trac issue 91. Created by kink on 2012-01-21T12:42:16, last modified: 2012-03-31T16:51:32

eldering commented 11 years ago

Trac comment by eldering on 2012-02-05 20:08:12:

Added a first version of a script check_judging.sh to the DOMjudge-scripts repository that can be run on a configured maintainer-install of DOMjudge to replay submissions with known results.

eldering commented 11 years ago

Trac comment by eldering on 2012-02-12 13:02:38:

The script now also checks the final scoreboard. It gives expected results on old NWERC'10 contest data for me.

eldering commented 11 years ago

Trac comment by eldering on 2012-03-31 16:51:32:

Closing: the script works for me (TM).

We cannot run this as a cron job at A-Es2, but it is easily run semi-automatically by the developers.