The OccupationQidSet now properly handles concurrent execution of itself by means of an external cache which is concurrent safe. This cache is shared across all threads and invocations of the OccupationQidSet feature so that now the number of SPARQL queries we need to make is drastically reduced.
Another change introduced by this PR is to soweego/wikidata/sparql_queries.py where now we handle response code 429 by simply retrying after a short time.
The
OccupationQidSetnow properly handles concurrent execution of itself by means of an externalcachewhich is concurrent safe. This cache is shared across all threads and invocations of theOccupationQidSetfeature so that now the number of SPARQL queries we need to make is drastically reduced.Another change introduced by this PR is to
soweego/wikidata/sparql_queries.pywhere now we handle response code429by simply retrying after a short time.Closes #273