openrightsgroup / Blocking-Middleware

The censorship monitoring project (blocked.org.uk) API, database and message-queueing system
https://www.blocked.org.uk/
GNU General Public License v3.0
25 stars 11 forks source link

Treat all suspended domain subdomains and https / http as one result #140

Closed JimKillock closed 1 year ago

JimKillock commented 3 years ago

Ensure that *.domain.uk are treated as one result; and that https / http results are also treated as one result. I seem to have been able to get two results for accountscjsweepers.co.uk by changing http and https and further results for www. ww2. for instance.

dantheta commented 3 years ago

That was a slightly tricky one!

The system now retains a preferred form for a domain (above the normalization rules), which is http:// and no www., falling back on their original forms if the system doesn't have a url record for the preferred form.

The registrar blocks listing will show most preferable form. We can have a background job that inserts the preferred form and links them together.