gbv / cocoda-mappings

concordances, mappings and conversion scripts to create JSKOS mappings
https://coli-conc.gbv.de/concordances/
1 stars 4 forks source link

Timeout for Geonames #7

Open nichtich opened 7 years ago

nichtich commented 7 years ago

More than 1.5 Million mappings but still possible to download on local machine:

$ time wdmapper get P1566 -g '' -o P1566.txt

real    1m27.590s
user    0m52.872s
sys 0m5.252s

On the server, however the call dies after half an hour with segfault or similar. Further debugging required. The SPARQL query is

SELECT ?item ?target WHERE { ?item wdt:P1566 ?target }

Looks like a bug in wdmapper (?)

jneubert commented 7 years ago

Perhaps it could help to add a filter(isLiteral(?target)) to the query. Wikidata uses blank nodes on properties to indicate "unknown value". That has bitten me several times, in queries as well as in the processing afterwards, so I now add this routinely.