Write Up for Each Collection

[ianmilligan1]

I've been playing around with our new site, and the new idea is to have a landing page per institution, broken down by collection. For each collection, I'd like to have a paragraph of text describing the collection.

Research assistants will do this by (a) creating Gephi files (#42); (b) consulting our Crawl Visualizations available at https://github.com/web-archive-group/WALK-CrawlVis:

• what sites are in it? A quick summary of its coverage.
• what time period does it cover, and how comprehensively?
• any weird crawl issues - a coverage spike or not? (from crawl visualization)

We'll then have links under the text to:

• derivative files;
• Archive-It page;
• library unit creating the collections, etc.

Anything you think I am missing out? This will be one of the major RA tasks this summer.

[ianmilligan1]

Mock-up here.

[greebie]

I think this is a great idea. Is it possible that there is metadata for the collections already in the WARC files? It seems like there should be, and it could be an easy way to show the grad students what a WARC is.

[ianmilligan1]

Unfortunately I think we'll have to do that manually, as there's no real metadata within the WARCs pertaining to overall collection data and scope. But yeah, I wish there was.

What the workflow will probably be:

• students consult Archive-It page;
• students render network diagram, taking screenshot and making a few quick notes of the major hubs;
• students consult crawl visualization, domain-by-domain breakdown;

Which they then write a paragraph out of?

[ianmilligan1]

We've achieved this milestone!