openrightsgroup / Blocking-Middleware

The censorship monitoring project (blocked.org.uk) API, database and message-queueing system
https://www.blocked.org.uk/
GNU General Public License v3.0
25 stars 11 forks source link

New .uk tests #119

Open JimKillock opened 3 years ago

JimKillock commented 3 years ago

I've sent a consolidated list of .uk domains to test via email, these contain about a third of the Nominet suspensions we think. so it would be great to test them ASAP.

dantheta commented 3 years ago

We'll need to add some custom code to the probe to pick up nameservers of domains that don't resolve normally (these ones don't have a visible holding page, but are still listed in the zone)

JimKillock commented 3 years ago

Interesting - these must be some of the domains suspended before Dec last year. So, in these cases,

  1. The ZF records show the domain is suspended;
  2. A nameserver is mentioned in the ZF record and / or DNS record;
  3. The domain does not resolve

Is that right?

Yes, we should definitely pick those up and list them. I'd be surprised if this was most of the records we have here tho, if it is the case, then we have a lot more digging to do.

dantheta commented 3 years ago

How do we want to represent these? Should we add a new pseudo-ISP for these nominet abuse suspensions from the zone file?

The nameserver listed in the zone is not visible with DNS lookups, these would be extracted solely from the zone file.

JimKillock commented 3 years ago

I think they are most like the copyright blocks; there is a body asking for a domain suspension, and a suspended domain. Ideally, we would be able to group suspensions by "order" (although these are not made public, so we'd have to make "psudeo-orders" perhaps based on date) and by body issuing that "order / request" (which would be CTIRU, etc, rather than Nominet).

As we develop this we may add a means to file complaints, based on the body making the 'order'; we intend to do the same with the copyright 'court orders'.

The presentation of these should be separate to the copyright blocks and the ISP filter results.