Update MappingExtractor to use the Commons namespaces and try mapping a few templates

gaurav / extraction-framework

The software used to extract structured data from Wikipedia

1 stars 0 forks source link

Update MappingExtractor to use the Commons namespaces and try mapping a few templates #7

Closed gaurav closed 10 years ago

gaurav commented 10 years ago

Start with the most popular templates that might provide interesting metadata. The goal here is to prepare a dataset showcasing the sort of data we might be able to provide by the end of this project to the Commons community, who I hope to e-mail by the end of this week; so think about simple templates with rich metadata whose RDF can be immediately put to work.

gaurav commented 10 years ago

I've created a template at http://mappings.dbpedia.org/index.php/Mapping_commons:Authority_control (stole it from Mapping_en:Authority_control) and I'm trying to get the MappingExtractor to work now.

gaurav commented 10 years ago

Bear in mind that the MappingExtractor cannot handle multiple languages within the same template at the moment, so something like {{VN|en=in English|fr=in French}} cannot currently be handled automatically.

jimkont commented 10 years ago

The commons stats are now deployed online ;) http://mappings.dbpedia.org/server/statistics/commons/

gaurav commented 10 years ago

Awesome -- and look what I found in the top-100 list! http://mappings.dbpedia.org/server/templatestatistics/commons/?template=Coleoptera

gaurav commented 10 years ago

[x] How do I add templates to the ignorelist? I tried adding them to my local ignorelist_commons.txt file, but my local server didn't grey them out.

gaurav commented 10 years ago

[x] Is there any way to ignore a property in a mapping? For example, in http://mappings.dbpedia.org/index.php/Mapping_commons:Uncategorized-Geograph, 'day', 'month' and 'year' refer to the date on which the image was tagged, which isn't useful data IMO.

gaurav commented 10 years ago

[x] Is it better to use {{PropertyMapping|comment=Comment goes here}} (e.g. http://mappings.dbpedia.org/index.php/Mapping_commons:Check_categories-Geograph) or {{PropertyMapping|comment={{comment|en|Comment goes here}} }} (e.g. http://mappings.dbpedia.org/index.php/Mapping_commons:Uncategorized-Geograph)? (Answer: the former, NOT the latter)

gaurav commented 10 years ago

[x] Every image that uses {{Template:EBI License}} appears to be in the public domain, so I've tried to set that up in http://mappings.dbpedia.org/index.php/Mapping_commons:EBI_License using ConstantMapping; however, these are being parsed as Wikipedia page names instead of absolute URIs (e.g. http://mappings.dbpedia.org/server/mappings/commons/extractionSamples/Mapping_commons:EBI_License?namespace=File) -- any idea how to fix this?

jimkont commented 10 years ago

this is fixed with dbpedia/extraction-framework#242 it won't be deployed soon but keep working on the mappings

If we go this way, maybe we should create a category for all the licence mappings

gaurav commented 10 years ago

[ ] Map https://commons.wikimedia.org/wiki/Template:IUCN as well, so we get endangered status, IUCN id and maybe a ConstantMapping to point out that this is a species.

gaurav commented 10 years ago

Not enough time left, closing.