Create a script to harvest Wikidata item JSONs from the official wikidata API - Githubissues

openfoodfacts / openfoodfacts-server

Open Food Facts database, API server and web interface - 🐪🦋 Perl, CSS and JS coders welcome 😊 For helping in Python, see Robotoff or taxonomy-editor

http://openfoodfacts.github.io/openfoodfacts-server/

GNU Affero General Public License v3.0

660 stars 389 forks source link

Create a script to harvest Wikidata item JSONs from the official wikidata API #10983

Open teolemon opened 3 weeks ago

teolemon commented 3 weeks ago

Problem

We have many qid for many taxonomies, but we don't leverage them the way we should
We should probably have a cache to avoid spamming wikidata + data breakage potential

Proposed solution

Create a script to harvest Wikidata item JSONs from the official wikidata API
Route to use: https://wikidata.org/w/rest.php/wikibase/v1/entities/items/Q20034?_fields=type,labels,descriptions,aliases,statements,sitelinks
Loop on all items which have a Wikidata entity
Define where (openfoodfacts-web?) to store the output