dice-group / IGUANA

IGUANA is a benchmark execution framework for RDF triple stores and quad stores
http://iguana-benchmark.eu
GNU Affero General Public License v3.0
24 stars 15 forks source link

Result Validation #209

Open Clueliss opened 1 year ago

Clueliss commented 1 year ago

For general correctness tests of triplestores it would be handy if IGUANA could validate query results.

Two major problems:

  1. If there is no pre-generated ground-truth: Where do we get that from?
  2. If there is pre-generate ground-truth provided by the user: Blank nodes are problematic as their labels could differ while still being the same entity. To correctly determine equality IGUANA would need a way to solve the graph isomorphism problem.

This is by no means a simple task and probably needs further research/thinking, just opening this issue so we can keep track of it.

Ordering is relevant if the outermost query uses ORDER BY.