nicoring / locationMashup

0 stars 0 forks source link

tourpedia data crawler #7

Closed mischkew closed 9 years ago

mischkew commented 9 years ago

[ ] move script to scripts directory [ ] add usage data [ ] add sparql query which fetches resource ids

script currenlty online at: 6ee864e37d51365c84596bbc8ace8077ef83a899

current usage:

./bin/rdfentities-download.sh rdffile outputfile startresource endresource & > crawler-start-end.log

try to name log file with sequence chunks, so you know what had to be fetched. missing endresource means crawl until everything done. missing startresource crawls the whole rdffile.