Use Data Together Sentry to crawl EPA data.json

[dcwalk]

Picking up from #119 and #120, in order to further identify datasets the EPA has both to: 1) Map the amount we've downloaded ("coverage"), and 2) Download those we don't already have

... we want to use Data Together's sentry to crawl the EPA's Environmental Dataset Gateway data.json JSON-LD. In order to get there, @b5 wants to get sentry to feature parity with the WARC 1.1 spec, which is tracked in https://github.com/datatogether/roadmap/issues/26

TODOs:

• [x] Point the Data Together sentry at the JSON-LD urls list A lot of those links are dead / useless based on some initial spot-checking.
• [x] Examine the list of non-404 urls reported post-crawl Confirm those are in archivers.space or captured by other means

This will resolve #120 in prep for #119

[dcwalk]

During our September 11 Archiving call, this was indicated as an ongoing and important priority. Moving to the Fall Work Cycle milestone

[dcwalk]

As far as I have been updated this happened. I think larger discussions about the future of this node/where this data lives are on the horizion. I'm going to close this for now, as I imagine those conversations will pick up further along/reframe future work