Implement a worst-case fallback (parsing a page if no Pants JSON or mf2 are available)

hmans / indiepants

IndiePants, aka Pants Phase 2. A clean indieweb-like implementation.

13 stars 1 forks source link

Implement a worst-case fallback (parsing a page if no Pants JSON or mf2 are available) #29

Open hmans opened 9 years ago

hmans commented 9 years ago

If we're fetching a remote document, and it has neither pants-document JSON nor h-entry available, we should try to magically extract the article from the document. There is probably a number of solutions and approaches to this.

Ideas and Notes:

https://github.com/peterc/pismo
https://github.com/cantino/ruby-readability
https://github.com/pauldix/extractula

czottmann commented 9 years ago

Regarding user data: I suggest adding support for JSON-LD. Google seems committed to support that so I assume it's going to gain in popularity. (There's a json-ld gem albeit I think using Nokogiri to find the relevant <script> tag and then a JSON parser to deal with the content might be sufficient.) Also, of course, support for OpenGraph's profile.

What do you think?