Publish sitelinks - Githubissues

brawer / wikidata-qrank

Ranking signals for Wikidata

https://qrank.wmcloud.org

MIT License

61 stars 5 forks source link

Publish sitelinks #9

Closed brawer closed 6 months ago

brawer commented 1 year ago

In an early stage of the QRank pipeline, we compute a mapping from Wikimedia sitelinks to Wikidata entity IDs. This mapping seems generally useful. For example, OpenStreetMap quality assurance tools could use this for checking the consistency of wikipedia and wikidata tags on geographic features.

[ ] re-implement the sitelinks extraction in Rust for better performance / lower memory consumption
[ ] set up a cronjob to re-generate the sitelinks file once per week
[ ] document the format and schema of the sitelinks file
[ ] change the QRank pipeline to use the new file

brawer commented 6 months ago

We’ll eventually stop using sitelinks, so this will not be done. See https://github.com/brawer/wikidata-qrank/issues/23.