Missing Link Diagrams - Githubissues

web-archive-group / WALK

Web Archives for Longitudinal Knowledge

8 stars 2 forks source link

Missing Link Diagrams #60

Closed ianmilligan1 closed 6 years ago

ianmilligan1 commented 7 years ago

These have all failed at various points, but w/ improvements to warcbase code may work.

[ ] ALBERTA_circumpolar
[x] ALBERTA_edmonton_public_libraries
[x] ALBERTA_education_curriculum
[ ] ALBERTA_idle_no_more
[x] ALBERTA_prairie_provinces
[ ] ALBERTA_university_of_alberta_websites
[ ] DALHOUSIE_homesnothondas_Tweets_Homes_not_Hondas
[ ] DALHOUSIE_Halifax_Regional_Municipality_Documents
[ ] DALHOUSIE_Dalhousie_University_200th_Anniversary_1818-2018
[ ] DALHOUSIETEST-_Nova_Scotia_theatre_websites
[ ] TORONTO_canadian_government_information
[ ] TORONTO_toronto_mayoral_election_2014
[ ] TORONTO_federal_election_candidate_sites_2015
[ ] UVIC_maps_at_risk

ianmilligan1 commented 7 years ago

Running script to generate ALBERTA_education_curriculum, ALBERTA_idle_no_more, and ALBERTA_university_of_alberta_websites. The other two I found. Circumpolar has massive 60GB+ WARCs which have really eluded our ability to process.

Some errors though, so we may be out of luck.