NTU-ALComLab / ssatABC

Stochastic SAT solver within ABC
Other
5 stars 2 forks source link

Benchmarking multiple tools #14

Closed nianzelee closed 3 years ago

nianzelee commented 3 years ago

BenchExec usage questions regarding benchmarking multiple tools:

nianzelee commented 3 years ago
  • Can we benchmark two tools in one XML file? (It seems there cannot be two <benchmark></benchmark> section in one XML file.)

No, because XML syntax only allows one root element.

  • Can table-generator read different table-definition XML files for results from different tools?

Yes, we only need one table-definition file, and use <result> tags for different tools.

nianzelee commented 3 years ago

Commit cd4b29e updates the table-definition XML file to reflect the second point.