openrightsgroup / blocked-org-uk

Template front-end code, markup, style-sheets, images and other assets for the Censorship Monitoring Project (blocked.org.uk)
https://www.blocked.org.uk/
GNU General Public License v3.0
13 stars 5 forks source link

Court ordered block domains should not be case-sensitive #329

Closed gwire closed 6 years ago

gwire commented 6 years ago

Both http://primewire.unblocked.bz and http://Primewire.unblocked.bz are listed as separate entries in the court-ordered blocklist.

dantheta commented 6 years ago

New domains that are added through the court order system will be normalized. The scheme and netloc parts of the URL will be converted to lower case. The path component (if present) will retain its original case. The http scheme will be added if none is present.

URLs that are already there will be converted using database edits, or deleted if a normalized-case version exists.

dantheta commented 6 years ago

I've cleaned up some of the lower vs title case duplicates and https vs http duplicates.