Add checker for non-deterministic problems

vicrac / domjudge

DOMjudge programming contest jury system

https://www.domjudge.org

GNU General Public License v2.0

0 stars 0 forks source link

Add checker for non-deterministic problems #1

Open vicrac opened 5 years ago

vicrac commented 5 years ago

For now, there are solution checkers for deterministic problems only. There are located in:

sql/files/defaultdata/compare/compare.cc - standard checker for integer output
sql/files/defaultdata/float/check_float.c - checker for output with float values

We wish to add checker for non-deterministic problems (e.g. estimating confidence interval based on data file). By its nature, we admit some errors with some confidence level set - confusion matrix perhaps?

vicrac commented 5 years ago

@aginiewicz I spoke to the maintainers, and if we want to have this feature introduced in the next release (which will be the last one before our contest runs), we have to come up with the implementation within four weeks (by the end of ICPC world finals).

aginiewicz commented 5 years ago

I've copied float checker and work on modifying it to be estimation checker, matching functionality of our old checker