search

danielcuthbert / thescum

This is an attempt to footprint all the trackers and profiling attempts used by numerous UK newspapers operating online, papers known for being liberal with the truth. It is a work in progress and the trackers listed here can also apply to other aspects of the web we use today.
69 stars 7 forks source link

Expand domain lists using info from certificate transparency logs #10

Closed alexhaydock closed 4 years ago

alexhaydock commented 4 years ago

I've been looking through the lists here and have expanded them a bit using info I've scraped from certificate transparency logs. Some of these will be historic, as the logs go back pretty far, but all of these domains had valid TLS certs issued for them in the past.

Amusingly, this came about because I noticed this morning that Apple News had pulled in this fantastic piece of journalism from a staging domain. I was able to load it despite the list being active in Pi-Hole, so I thought I'd take a look at what else might be missing.

I haven't attempted to map out any IPs that might be attached to these domains, just the domains themselves.

Cheers for this work anyway! 👍

danielcuthbert commented 4 years ago

This is epic, thank you!!

alexhaydock commented 4 years ago

No problem!

As an aside, I realised the other day that we might be forgetting about Scotland. The Scottish Sun needs adding to the list. I meant to do a PR but didn’t get around to it.