After a user provided sampling algorithms and calculated a sample he should get an evaluation how well his sampling algorithm performed. To enable this functionality the following evaluation criteria need to be integrated into the TIRA system.
Make sure samples are saved persistently?
Count the number of configurations contained in the sample
Calculate how long a sampling algorithm needs to calculate a solution.
Track memory consumption during solution calculation
Calculate percentage of achieved t-wise coverage (see Issue#1)
After a user provided sampling algorithms and calculated a sample he should get an evaluation how well his sampling algorithm performed. To enable this functionality the following evaluation criteria need to be integrated into the TIRA system.