Need a function that downloads raw captured HTML from Versionista - Githubissues

edgi-govdata-archiving / web-monitoring-processing

Tools for access, "diff"-ing, and analyzing archived web pages

https://edgi-govdata-archiving.github.io/web-monitoring-processing

GNU General Public License v3.0

20 stars 20 forks source link

Need a function that downloads raw captured HTML from Versionista #2

Closed danielballan closed 7 years ago

danielballan commented 7 years ago

It should:

Write the downloaded HTML into a local file
Insert a row into Snapshots referencing that file
Insert a row into Page if this is our first time seeing this URL

danielballan commented 7 years ago

This is handled by https://github.com/edgi-govdata-archiving/web-monitoring-versionista-scraper