Trove newspapers front page data

[wragge]

My 'Front page' web app that showed changes in the content of newspaper front pages is now down because of web host changes etc. I don't want to rebuild it in its old form, but think it'd be good to assemble a dataset that aggregated some stats on front pages across all available issues.

Possible approach:

• work through lists of newspapers and issues from the newspapers endpoint
• search for articles from page 1 for each issue
• get facets for article type
• calculate number of words for each article type
• save page id for issue

[wragge]

Stage one of this complete -- I harvested data from all available issues. This could be used to gather the front page info.