search

citation-js / toolforge-tool

Tool for Wikimedia Toolforge
https://citation-js.toolforge.org/
MIT License
0 stars 0 forks source link

Wikidata dumps #1

Open larsgw opened 2 years ago

larsgw commented 2 years ago

Wikidata dumps are available at /public/dumps/public/wikidatawiki/entities/latest-all.json.bz2 and /public/dumps/public/wikidatawiki/entities/latest-all.json.gz.

larsgw commented 2 years ago

The structure of the file is a big array in no particular order[1] containing entities[2]. This precludes binary search.

[1] https://www.wikidata.org/wiki/Wikidata:Database_download/en#JSON_dumps_(recommended) [2] https://doc.wikimedia.org/Wikibase/master/php/md_docs_topics_json.html

larsgw commented 2 years ago

This is 70 Gb of data.