serverless-dns / blocklists

An opinionated collection of blocklists for RethinkDNS.
https://rethinkdns.com/configure
Mozilla Public License 2.0
82 stars 24 forks source link

Use blockada optimized version #81

Closed SpencerIsGiddy closed 1 year ago

SpencerIsGiddy commented 1 year ago

Reduces # of entries by a lot. Potentially leaving room for other blocklists to be added to the service in the future. Although not important. Reduces entries by a little less then 90% i believe

Another thing is that I personally do not use the ublock filter list as I find it too aggressive and broke twitter last time I used the list so I do not use it. I wonder if the optimized version is less aggressive.

ignoramous commented 1 year ago

The Blokada version lists exist because I presume Blokada is pretty bad at dealing with large list, which isn't a problem for Rethink or serverless-dns. In fact, the more blocklists we add, the better our compression gets (to an extent).

I'd be wary of using a list that's optimised for a deficient app. Has the list maintainer mentioned just how the version is really optimized? If it is removing wildcards, then they should call it wildcard list like other maintainers do.

SpencerIsGiddy commented 1 year ago

To me, the only difference other than the amount of entries is that the Blokada optimized version includes the host and then the wildcard entry of the host. While the normal version is just hosts

ignoramous commented 1 year ago

That "optimization" is already enabled for all blocklists before building the final blocklists in serverless-dns code. I'd rather not use a list built specifically for one rather lousy dns app :)

SpencerIsGiddy commented 1 year ago

Ok👍

SpencerIsGiddy commented 1 year ago

So I’m reopening this pull request because I talked with the developer of the list and he says that both hosts.txt and hosts_blokada.txt sources are from the same sources. It’s just the format difference https://github.com/mtxadmin/ublock/issues/54

Does this change anything?

ignoramous commented 1 year ago

Thanks. Nothing changes from what I can tell. In fact, as mentioned above, Rethink is more efficient with larger lists.

SpencerIsGiddy commented 1 year ago

Thanks. Nothing changes from what I can tell. In fact, as mentioned above, Rethink is more efficient with larger lists.

Sounds good👍

mtxadmin commented 1 year ago

I think, main advantage of asterisk-driven form is flexibility. Ability to block any future subdomains (as for me as a blocklist maintainer it is wow! A killer feature!)

For instance, well-known doubleclick domains:

Traditional format:

doubleclick.net
1016557.fls.doubleclick.net
1268402.fls.doubleclick.net
1295336.fls.doubleclick.net
1326154.fls.doubleclick.net
1330903.fls.doubleclick.net
1359940.fls.doubleclick.net
1412173.fls.doubleclick.net
1435575.fls.doubleclick.net
1513878.fls.doubleclick.net
1742177.fls.doubleclick.net
2013561.fls.doubleclick.net
2196503.fls.doubleclick.net
2332696.fls.doubleclick.net
2463678.fls.doubleclick.net
2499034.fls.doubleclick.net
...
...
... and counting

And with asterisks:

doubleclick.net
*.doubleclick.net

The thing is, an ad network can make 100500 another random subdomains, and traditional form won't catch them. At the same time, asterisk form will block any new subdomains, without interaction from anyone.

ignoramous commented 1 year ago

Rethink treats all blocklists as if they were wildcards and removes duplicates (:

In fact this is what AdGuard also does, because like you say, it simply makes sense.

mtxadmin commented 1 year ago

It is really makes sense.

https://rethinkdns.com : "paid plans launching soon." "With our paid plans (coming soon), you'll also be able to define your own custom blocklists"

Blokada initially was more free :-(

But dns blocker + firewall is a unique combo. Please, let me know when paid plans will be available. At least, I add RethinkDNS to the docs. Thanks in advance.