AdguardTeam / HostlistsRegistry

Known hosts blocklists that are made available to the users of AdGuard products
https://adguard-dns.io/
GNU General Public License v3.0
210 stars 74 forks source link

USOM - Top misleading site block list #386

Closed Soickan closed 3 months ago

Soickan commented 11 months ago

Prerequisites

Problem description

Add list: USOM - Official Turk Cyber Block Center (www.usom.gov.tr)

Proposed solution

Hi,

Add please USOM - Official Turk Cyber Block Center (http://www.usom.gov.tr) block list. There is no ad blocking in the list. The list includes a list of fake and misleading sites. It is mostly updated hourly.

You can learn the details of blocked sites at https://www.usom.gov.tr/adres

This list address: https://www.usom.gov.tr/url-list.txt

Thanks

Additional information

No response

Alex-302 commented 11 months ago

@Soickan Moved to the correct repository.

Sergey-Lyapin commented 9 months ago

Hello @Soickan, thank you for suggestion. Here is blocklist requirements

How can I check this list against these criteria?

The blocklist should have a place for receiving user complaints and holding discussions, such as a repository on github.com, or a public website/forum.

The blocklist should be relatively popular, meaning:
- if there is a repository on GitHub, the number of stars should be at least 50.
- if there is no repository on GitHub, the number of reported issues and discussions should be at least 10 per month.
- the blocklist should be actively supported for at least 6 months.

The blocklist should be regularly updated with at least 10 updates per month.
Alex-302 commented 9 months ago

Hm. I don't see working domains below 20k line. The most domains are blocked/dead.

Soickan commented 9 months ago

Since they are mostly misleading (phishing) sites, when they are detected, the site owners close the site. Therefore, there will be old sites that do not work. This is, in a way, proof that the detection of sites is quick.

Alex-302 commented 8 months ago

It has more than 250k domains, and the most of that domains are dead/unregistered. Why don't they remove or move to another file domains, that are dead?

Soickan commented 8 months ago

It has more than 250k domains, and the most of that domains are dead/unregistered. Why don't they remove or move to another file domains, that are dead?

First of all, although it is officially detected and blocked, it continues to prevent phishing by remaining on the list.

Other ad blocking filters do not guarantee a 100% active domain. I see that retroactive cleaning is not done much in these filters.

hagezi commented 8 months ago

The active domains are included in my Threat Intelligence Feed list. The USOM also has a few false positive domains from time to time, these are also filtered out.

The TIF is available in AdGuard DNS.

hagezi commented 8 months ago

Stats from the last TIF build:

 Nr | Included | Dead | Removed |   Count | URL/File
136 |      25% |  75% |      0% |  250898 | https://www.usom.gov.tr/url-list.txt

75% dead domains, <1% false positives,

Alex-302 commented 8 months ago

@hagezi Which tool do you use to check dead domains? 3p or your own?

hagezi commented 8 months ago

@Alex-302 I check this myself with my own script against the Google DNS. My lists are checked once a month. I also check the deadlist once a month to see if dead domains are active again. I can make the list of dead domains available if required.

Sergey-Lyapin commented 3 months ago

The active domains on this list are included in Hagezi's Threat Intelligence Feed list, so we won't add this list separately.