timpalpant / LittleBoxes

A crossword solver
GNU General Public License v3.0
1 stars 0 forks source link

Add benchmark driver to run solver and score its performance #3

Open timpalpant opened 8 years ago

timpalpant commented 8 years ago

Add a script that runs a solver against puzzles from the last ~6 months and reports statistics about its performance on them. The score for each puzzle should be a number >= 0 representing the deviation from the correct solution. A perfect solution will have score == 0, and imperfect solutions have score > 0. Some tunable parameters should probably be: 1) penalty for unfilled squares, 2) penalty for incorrect squares.