Understanding the Internet Archive Webcrawler (MOVE)

[dcwalk]

Goal for Guide

MOVE existing "Understanding What the Internet Archive Webcrawler Does" from Event Toolkit

Description of content

"In this document we explain a little bit about what Heritrix can do, why it needs our help, and also how to identify documents and datasets that Heritrix can’t reach. "

Resources

• https://docs.google.com/document/d/1PeWefW2toThs-Pbw0CMv2us7wxQI0gRrP1LGuwMp_UQ/edit

• [x] I have reviewed current guides for existing content

• [x] This guide deals with technical details rather than event documentation or planning material

[dcwalk]

Draft revision here! https://hackmd.io/EYRgZiBM6QtAnADgMxwCwBMwDZbAKbwCssyRRaRAhohtvAMbxA==?both

@sharlychan -- it would be wonderful to get some feedback on the above! We are moving some of the guides into more of a 'website' format. If you are interested, assign yourself to this issue!

[dcwalk]

@titaniumbones a review would be nice!

[dcwalk]

Merged in, closing!