hagezi / dns-blocklists

DNS-Blocklists: For a better internet - keep the internet clean!
GNU General Public License v3.0
5.91k stars 200 forks source link

Sources for each blocklist #2333

Closed MadSpindel closed 6 months ago

MadSpindel commented 6 months ago

Would it be possible to split up sources.md into one sources.md for each blocklist? For example, I would like to see which sources are used in TIF Medium.

hagezi commented 6 months ago

Not for the normal lists, see: https://github.com/hagezi/dns-blocklists/wiki/FAQ#sources

For TIF medium:

  Nr |   Count | Format  | Source | Status  | File      | URL/File
   1 |     256 | domains | local  | online  | changed   | deny_tif.txt
   2 |   10393 | hosts   | http   | online  | unchanged | https://phishing-filter.pages.dev/phishing-filter-hosts.txt
   3 |    7900 | domains | local  | online  | changed   | phishfort-hot-tif.txt
   4 |  170825 | domains | http   | online  | unchanged | https://phishing.army/download/phishing_army_blocklist.txt
   5 |  172117 | domains | http   | online  | unchanged | https://phishing.army/download/phishing_army_blocklist_extended.txt
   6 |    5002 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/durablenapkin/scamblocklist/master/hosts.txt
   7 |    2659 | adblock | local  | online  | changed   | fake.light.adblock
   8 |    3920 | adblock | http   | online  | unchanged | https://raw.githubusercontent.com/jarelllama/Scam-Blocklist/main/lists/adblock/scams.txt
   9 |   43276 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/elliotwutingfeng/GlobalAntiScamOrg-blocklist/main/global-anti-scam-org-scam-urls-pihole.txt
  10 |    3581 | domains | http   | online  | changed   | https://raw.githubusercontent.com/elliotwutingfeng/SpamdexingSites/main/blocklist.txt
  11 |    1041 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/marco-acorte/antispam-it/main/antispam-it.txt
  12 |    2272 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-list/master/spammers.txt
  13 |     409 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt
  14 |    2591 | hosts   | http   | online  | unchanged | https://hosts.tweedge.net/malicious.txt
  15 |   22735 | hosts   | http   | online  | changed   | https://threatfox.abuse.ch/downloads/hostfile
  16 |    3012 | hosts   | http   | online  | unchanged | https://urlhaus-filter.pages.dev/urlhaus-filter-hosts.txt
  17 |     245 | hosts   | http   | online  | changed   | https://urlhaus.abuse.ch/downloads/hostfile
  18 |   16842 | hosts   | http   | online  | unchanged | https://vn-badsite-filter.pages.dev/vn-badsite-filter-hosts.txt
  19 |   21457 | adblock | http   | online  | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareAdGuardHome.txt
  20 |    4304 | domains | local  | online  | changed   | malware.base.domains.txt
  21 |     473 | domains | local  | online  | changed   | tweetfeed-tif.txt
  22 |   21374 | domains | http   | online  | changed   | https://dl.red.flag.domains/red.flag.domains.txt
  23 |     206 | domains | http   | online  | changed   | https://lists.cyberhost.uk/malware.txt
  24 |    1667 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/braveinnovators/ukrainian-security-filter/main/lists/domains.txt
  25 |    6447 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/elliotwutingfeng/Inversion-DNSBL-Blocklists/main/Google_hostnames_light.txt
  26 |     500 | domains | http   | online  | unchanged | https://rescure.me/rescure_domain_blacklist.txt
  27 |   18043 | domains | http   | online  | unchanged | https://zonefiles.io/f/compromised/domains/live/
  28 |    2708 | adblock | http   | online  | changed   | https://raw.githubusercontent.com/uBlockOrigin/uAssets/master/filters/badware.txt
  29 |     868 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/AssoEchap/stalkerware-indicators/master/generated/hosts
  30 |    1438 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt
  31 |      29 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-10-07_donot/domains.txt
  32 |     336 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-12-16_cytrox/domains.txt
  33 |    2183 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2023-03-29_android_campaign/domains.txt
MadSpindel commented 6 months ago

Thanks! Could you also post the sources for TIF Full?

hagezi commented 6 months ago

TIF:

  Nr |   Count | Format  | Source | Status  | File      | URL/File
   1 |   18596 | domains | local  | online  | changed   | black.list.threat-intelligence
   2 |     256 | domains | local  | online  | unchanged | deny_tif.txt
   3 |   10393 | hosts   | http   | online  | unchanged | https://phishing-filter.pages.dev/phishing-filter-hosts.txt
   4 |    1071 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/MetaMask/eth-phishing-detect/master/src/hosts.txt
   5 |    7900 | domains | local  | online  | unchanged | phishfort-hot-tif.txt
   6 |  170825 | domains | http   | online  | unchanged | https://phishing.army/download/phishing_army_blocklist.txt
   7 |  172117 | domains | http   | online  | unchanged | https://phishing.army/download/phishing_army_blocklist_extended.txt
   8 |   53011 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/olbat/ut1-blacklists/master/blacklists/phishing/domains
   9 |    5002 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/durablenapkin/scamblocklist/master/hosts.txt
  10 |   15063 | adblock | local  | online  | changed   | fake.txt
  11 |    5790 | adblock | local  | online  | changed   | fake.plus.adblock
  12 |    3920 | adblock | http   | online  | unchanged | https://raw.githubusercontent.com/jarelllama/Scam-Blocklist/main/lists/adblock/scams.txt
  13 |  149882 | domains | local  | online  | changed   | scam-extension.txt
  14 |   12755 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Scam
  15 |   43276 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/elliotwutingfeng/GlobalAntiScamOrg-blocklist/main/global-anti-scam-org-scam-urls-pihole.txt
  16 |    3581 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/elliotwutingfeng/SpamdexingSites/main/blocklist.txt
  17 |    1041 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/marco-acorte/antispam-it/main/antispam-it.txt
  18 |    2272 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-list/master/spammers.txt
  19 |   48635 | domains | http   | online  | changed   | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
  20 |     409 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt
  21 |  184887 | hosts   | http   | online  | changed   | https://hole.cert.pl/domains/domains_hosts.txt
  22 |    2591 | hosts   | http   | online  | unchanged | https://hosts.tweedge.net/malicious.txt
  23 |    4155 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/bigdargon/hostsVN/master/extensions/threat/hosts
  24 |   22735 | hosts   | http   | online  | unchanged | https://threatfox.abuse.ch/downloads/hostfile
  25 |    3012 | hosts   | http   | online  | unchanged | https://urlhaus-filter.pages.dev/urlhaus-filter-hosts.txt
  26 |     241 | hosts   | http   | online  | changed   | https://urlhaus.abuse.ch/downloads/hostfile
  27 |   16842 | hosts   | http   | online  | unchanged | https://vn-badsite-filter.pages.dev/vn-badsite-filter-hosts.txt
  28 |   21457 | adblock | http   | online  | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareAdGuardHome.txt
  29 |    4304 | domains | local  | online  | unchanged | malware.base.domains.txt
  30 |   73992 | domains | local  | online  | changed   | malware.rodanmaharjan.domains.txt
  31 |   63373 | domains | http   | online  | unchanged | https://threatview.io/Downloads/DOMAIN-High-Confidence-Feed.txt
  32 |     473 | domains | local  | online  | unchanged | tweetfeed-tif.txt
  33 |  277165 | domains | http   | online  | changed   | https://www.usom.gov.tr/url-list.txt
  34 |    1029 | domains | http   | online  | unchanged | https://azorult-tracker.net/api/list/domain?format=plain
  35 |   21374 | domains | http   | online  | unchanged | https://dl.red.flag.domains/red.flag.domains.txt
  36 |    1131 | domains | http   | online  | changed   | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
  37 |     206 | domains | http   | online  | unchanged | https://lists.cyberhost.uk/malware.txt
  38 |  130867 | domains | http   | online  | changed   | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
  39 |   35350 | domains | http   | online  | changed   | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
  40 |    1667 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/braveinnovators/ukrainian-security-filter/main/lists/domains.txt
  41 |    6447 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/elliotwutingfeng/Inversion-DNSBL-Blocklists/main/Google_hostnames_light.txt
  42 |   13199 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
  43 |   53042 | domains | http   | online  | changed   | https://raw.githubusercontent.com/olbat/ut1-blacklists/master/blacklists/malware/domains
  44 |  360185 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/stamparm/aux/master/maltrail-malware-domains.txt
  45 |   18043 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/stamparm/blackbook/master/blackbook.txt
  46 |   28620 | domains | http   | online  | changed   | https://raw.githubusercontent.com/ttc-cert/TTC-CERT_blocklist_recommended/master/domain_blocklist_recommended.txt
  47 |     500 | domains | http   | online  | unchanged | https://rescure.me/rescure_domain_blacklist.txt
  48 |   18043 | domains | http   | online  | unchanged | https://zonefiles.io/f/compromised/domains/live/
  49 |    2708 | adblock | http   | online  | unchanged | https://raw.githubusercontent.com/uBlockOrigin/uAssets/master/filters/badware.txt
  50 |     868 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/AssoEchap/stalkerware-indicators/master/generated/hosts
  51 |    1438 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt
  52 |      29 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-10-07_donot/domains.txt
  53 |     336 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-12-16_cytrox/domains.txt
  54 |    2183 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2023-03-29_android_campaign/domains.txt
hagezi commented 6 months ago

@MadSpindel The TIF lists are now also displayed in the build statistics again, they should have appeared there, but I had a bug in the build system. I have now fixed it.

https://github.com/hagezi/dns-blocklists/blob/main/statistics.md#tifmedium https://github.com/hagezi/dns-blocklists/blob/main/statistics.md#tif

There is still a bug in the statistics (Included/Dead/Removed) which I will fix in the next release. However, the sources are displayed correctly.