ENH: parse schema.org/NewsArticle RDFa, Microdata, or JSONLD

[westurner]

Schema.org Linked Data:

• http://schema.org/NewsArticle
• http://schema.org/docs/news.html

Parsers:

• http://rdflib.readthedocs.io/en/stable/apidocs/rdflib.html#rdflib.graph.Graph.parse
• https://rdflib.readthedocs.io/en/stable/_modules/rdflib/plugins/parsers/pyRdfa.html#pyRdfa
• https://rdflib.readthedocs.io/en/stable/_modules/rdflib/plugins/parsers/pyMicrodata/microdata.html
• https://github.com/RDFLib/rdflib-jsonld

Tasks:

• [ ] sniff(fileobj, location)
• [ ] parse(fileobj, location)
  • rdflib.Graph().parse(fileobj, uri, format='rdfa'|'microdata'|'jsonld') # for each

[westurner]

251 mentions itemProp="datePublished" (Microdata)

The RDFa for this property could be:

• property="http://schema.org/datePublished"
• property="datePublished"
• property="schema:datePublished"
• property="http://schema.org/datePublished" content="ISO8601date+timeZ'

[westurner]

Extruct is the best tool for accomplishing this, IMHO https://github.com/scrapinghub/extruct

extruct.extract() https://github.com/scrapinghub/extruct/blob/master/extruct/_extruct.py

https://github.com/RDFLib/rdflib/issues/770#issuecomment-433655142

[simonm3]

Great package but wondering why schema.org is not included as most newspapers and media sites seem to use it. Are there any plans to add this?