search

tthuem / SamplingChallenge

A repository to plan upcoming versions of the SPLC challenge on product sampling
0 stars 0 forks source link

Automated calculation of t-wise coverage #1

Open tthuem opened 5 years ago

tthuem commented 5 years ago

When allowing the submission of sampling algorithms that do not ensure t-wise coverage, we need to be able to compute the percentage of t-wise interactions being covered.

This is also useful to check for algorithms with t-wise coverage in two dimensions:

  1. We can identify faults in algorithms.
  2. We can check the coverage for higher values of t for those algorithms too.
tthuem commented 5 years ago

This is also planned to be integrated into FeatureIDE: https://github.com/FeatureIDE/FeatureIDE/issues/888

@skrieter mentioned that the calculation of t-wise coverage will be available in the FeatureIDE library in the version 3.6.0. Hence, we can avoid redundant development by waiting for that release.