AdguardTeam / cname-trackers

This repository contains a list of popular CNAME trackers
https://adguard.com/
MIT License
387 stars 37 forks source link

Info: historical graph of the number of domains in this list #53

Open StevenBlack opened 2 years ago

StevenBlack commented 2 years ago

Andrey @ameshkov this issue is for information only. I think you'll find this interesting.

I'm developing a variety of helper tools, still to early for prime-time, but this is a preliminary finding from analyzing my hosts repo history.

The data for your list is here has the granularity of my commits, whose frequency has varied over the years.

This bash file is what I used on my repo to get data. This is easily adaptable for your use; feel free. I use Mathematica for the plot, but many other things can produce graphs like this from CSV data.

KADhosts

Issue 2014 in my repo (scroll-scroll-scroll) contains recent graphs of all the sources for my amalgamated lists...

StevenBlack commented 2 years ago

Andrey @ameshkov small clarification: I paused refreshing data from AdguardTeam/cname-trackers a few days ago which is why this graph appears recently flat at 39,985 domains.

I paused refreshing AdguardTeam/cname-trackers because a recent list was over 60k domains, which raises my concern for MY overall list size. I'm sensitive to that, because I want my amalgamated lists to be usable on all devices, including tiny ones, and including Microsoft Windows, which starts choking long before *nix OSes do.

This graph shows that AdguardTeam/cname-trackers list size has started to vary significantly from release to release.

All that said, fuck these cname trackers, amirite? 🙄

ameshkov commented 2 years ago

Hi Steven,

It seems that most of these come from a single source: https://github.com/AdguardTeam/cname-trackers/blob/master/trackers/ingenious-technologies.txt

And this source is basically a bunch of subdomains of zooplus.*.

Not sure what to do with this information though:) In theory you can amend your script and ignore zooplus.* domains.

TPS commented 2 years ago

Whenever #51 is implemented, that might help.