search

Daniel-Mietchen / ideas

A dumping ground for halfbaked ideas, some of which will hopefully be worked on soon
Other
25 stars 6 forks source link

Look into Open Refine for Wikidata #215

Open Daniel-Mietchen opened 7 years ago

Daniel-Mietchen commented 7 years ago

http://www.mnylc.org/fellows/2017/03/17/using-openrefine-to-reconcile-name-entities/

good for a hackday

Daniel-Mietchen commented 6 years ago

Some more in https://www.wikidata.org/wiki/Wikidata:Tools/OpenRefine and http://blogs.bodleian.ox.ac.uk/digital/2017/10/12/reconciling-database-identifiers-with-wikidata/

Daniel-Mietchen commented 6 years ago

See also this two-part screencast of reconciliation in OpenRefine: https://www.youtube.com/watch?v=q8ffvdeyuNQ https://www.youtube.com/watch?v=0tQPmfb6IFk

Daniel-Mietchen commented 6 years ago
Daniel-Mietchen commented 6 years ago

See also https://medium.com/a-academic-librarians-thoughts-on-open-access/i-tried-using-oadoi-org-288d383cd075 , with examples around accessibility of journal articles.

Daniel-Mietchen commented 6 years ago

Key thing to try here is "Add column by fetching URLs" as described in the post above. I just tried that with files of ~100k lines, and that seems to have been too large.

Daniel-Mietchen commented 6 years ago

There is now a video tutorial: https://www.wikidata.org/wiki/Wikidata:Tools/OpenRefine/Editing/Tutorials/Video

Daniel-Mietchen commented 6 years ago

Here's a write-up on OpenRefine for Wikidata: https://medium.com/the-bytegeist-blog/enriching-reconciled-data-with-openrefine-89b885dcadbb .

Via https://twitter.com/izahoina/status/994678617081819147 .

Daniel-Mietchen commented 6 years ago

See also https://www.wikidata.org/wiki/Wikidata:Tools/OpenRefine and the series of tutorials there, e.g. https://www.wikidata.org/wiki/Wikidata:Tools/OpenRefine/Editing/Tutorials/Working_with_APIs for working with the ORCID API around affiliation.

Daniel-Mietchen commented 6 years ago

Further pointer combining OpenRefine and Wikidata tutorials: https://twitter.com/aarontay/status/998868000043220992

Daniel-Mietchen commented 6 years ago

Slides from an OpenRefine workshop: https://twitter.com/AlexandraAlisa/status/999712137470672896

Daniel-Mietchen commented 6 years ago

I have gone through https://www.wikidata.org/wiki/Wikidata:Tools/OpenRefine/Editing/Tutorials/Working_with_APIs until https://www.wikidata.org/wiki/Wikidata:Tools/OpenRefine/Editing/Tutorials/Working_with_APIs#Creating_the_schema so far.

Daniel-Mietchen commented 6 years ago

Impressions from my first batch of OpenRefine-based Wikidata edits: https://www.wikidata.org/wiki/Wikidata:Edit_groups/OR/8cb3004 .

Daniel-Mietchen commented 5 years ago

See also OpenRefine training materials at http://refinepro.com/training/ / https://cognitiveclass.ai/courses/introduction-to-openrefine/ , as per https://twitter.com/salgo60/status/1030800396263075840 .

Daniel-Mietchen commented 5 years ago

I had another go at it last week but got stuck: https://www.wikidata.org/wiki/Wikidata_talk:Tools/OpenRefine#Error_%22join_expects_an_array_and_a_string%22 .

Also found this additional guiding doc via https://twitter.com/aarontay/status/1073640619656994817 .

Daniel-Mietchen commented 5 years ago

There's also this tutorial from WIkiCIte 2018: https://www.youtube.com/watch?v=xORXSkE0yCE