search

LOD-Laundromat / lodlaundry.github.io

http://lodlaundromat.org
2 stars 2 forks source link

Fix re-generation of dataset metrics #46

Closed LaurensRietveld closed 9 years ago

LaurensRietveld commented 9 years ago

The script runs every night. Apparently, the check which determines whether a dataset has already been added to the metrics named graph, does not work. As a consequence, quite some data is re-added every night, resulting in lots of duplicates. fix this check

LaurensRietveld commented 9 years ago

fixed. Was caused by the default limit of virtuoso, which only fetches the first 20.000 rows. As a result, fetching the list of 'already added metrics' was incomplete (causing re-adding of metrics). Fixed by adding pagination, to get the complete list