web-archive-group / WALK

Web Archives for Longitudinal Knowledge
8 stars 2 forks source link

Second-level domain handling for comparing collections #45

Closed ianmilligan1 closed 6 years ago

ianmilligan1 commented 8 years ago

Right now, when working with something like

((201009,www.una.ab.ca),193125)

We normalize the domain down to the last two, so ab.ca. However, until 2000 .ca supported second and third-level domains for provinces and territories. We need to make sure the compare class handles these limited exceptions?

ianmilligan1 commented 8 years ago

Here's .ca.

.ab.ca — Alberta .bc.ca — British Columbia .mb.ca — Manitoba .nb.ca — New Brunswick .nf.ca — Newfoundland (replaced by .nl.ca) .nl.ca — Newfoundland and Labrador .ns.ca — Nova Scotia .nt.ca — Northwest Territories .nu.ca — Nunavut .on.ca — Ontario .pe.ca — Prince Edward Island .qc.ca — Quebec .sk.ca — Saskatchewan .yk.ca — Yukon

Gc.ca is a standard domain but we might want to unpack it for granularity.

i.e. cupe.on.ca is still using the old arrangement.

ianmilligan1 commented 8 years ago

And here's .uk. Couldn't register directly under .uk until 2014!

.ac.uk - academic (tertiary education, further education colleges and research establishments) and learned societies .co.uk - commercial and general .gov.uk - government (central, devolved and local) .judiciary.uk - courts (to be introduced in the near future)[16] .ltd.uk - limited companies .me.uk - general use (usually personal) .mod.uk - Ministry of Defence and HM Forces public sites .net.uk - ISPs and network companies (unlike .net, use is restricted to these users) .nhs.uk - National Health Service institutions .nic.uk - network use only (Nominet UK) .org.uk - general use (usually for non-profit organisations) .parliament.uk - parliamentary use (only for the UK Parliament and the Scottish Parliament) .plc.uk - public limited companies .police.uk - police forces[17] .sch.uk - local education authorities, schools, primary and secondary education, community education

ianmilligan1 commented 8 years ago

We also want to look into .eu a bit more, but we think that the .ca/.uk is a good start.