EstherMoellman
commented
5 years ago Hi Dean @hl2guide ! I have the results of the first test:
INTRODUCTION: Approximately 30 users, from 8 different countries (all over the world), participated in this test.
Unfortunately the real-life test wasn't 100% possible, because for real-life test users needed common websites (social media etc), and they were blocked in your list. This also killed many days of the test, because some users (in order to start the test) were waiting for an updated list with these websites unblocked.
Another issue, in my opinion, was to make the test without steps, without differentiating first an "ads" test, second a "trackers" test etc. I blame myself for that, because this was my original intention from the very beginning, but I wasn't enough clear to you, and I couldn't express you my plan in the right way. I mention this issue in case you are interested in future tests, so in my opinion, it will be better to have separate lists (ads, trackers, social media, mining, whatever), and to test list by list. This also will be very useful for those users (like me) that like to choose lists (sometimes these users need just a tracker-blocking-list, sometimes just an ads-blocking-list etc, not all users want all lists at the same time). It will be a plus if users can choose the blocking lists they want. PS: Personally I don't think you need to build all the lists at the same time. In my very personal opinion, the tracker-blocking-list is the most important list. The second list will be ad-blocking-list. All the other lists will be a plus, but I don't consider them a priority.
The test was focused on ads and trackers (not malware, miners etc).
TEST RESULT - YOUR LIST: Considering the small size of your list, it is a powerful list. It succeeded to block lot of garbage. However:
- No video-ads-blocking for youtube, lot of ads in the form of videos (better known as sponsored), and also no blocked videos publicity at youtube
- Sometimes when an ad is blocked in a webpage, a kind of banner appears (occupying the blocked ad place) with the following text: “Hmm. We’re having trouble finding that site". In a webpage with lot of blocked ads, lot of these banners appear.
- Some international webpages are broken, for example www.bild.de
- Porn webpages are not blocked (and this is good), but porn videos are blocked (this is bad). As you know, most of the users like porn pages, and if they have problems with your list, they will abandon your list.
- Many ads are not blocked at porn websites. Porn pages are great to test blocking-lists... there you will see how really powerful is or isn't your blocking list.
- As you know, social media and similar were blocked at your list: www.reddit.com, www.facebook.com etc
- Movie webpages are not blocked, but most video-players are blocked: "Openload", "Fastplay", "Vevio", "Rapidvideo", "OK" etc... this is a huge problem!
ABOUT "TECHNITIUM SOFTWARE / DNSSERVER": The browser speed was good. The RAM' consumption was ±500MB. Very easy to install and use.
ABOUT "DNSCrypt": We achieved same browser speed with DNSCrypt, using just ±25MB... unbeatable! Yeah, I know you didn't have a good experience using DNSCrypt. But I must insist you, in my opinion this is the tool you are looking for. DNSCrypt is unbeatable. It requires from you, first to read the Wiki. It is a long Wiki (boooring LOL), but believe me, it is worth reading this Wiki. We did that, it took time, but it wasn't difficult to understand, and we consider our self average-users. In brief, DNSCrypt has almost everything DnsServer has, but DNSCrypt is much more efficient in terms of performance, and also has some functions DnsServer hasn't. Also, DNSCrypt is fully customizable. But I grant you, DNSCrypt hasn't the friendly UI DnsServer has. This is the only point where DnsServer wins. However, DNSCrypt has a kind of third-party UI named "SimpleDNSCrypt", which covers 80% of DnsServer offered options. The other 20% options can be achieved at DNSCrypt by doing a simple quick manual customization (a list of very simple commands explained at Wiki, that can be written in the "ini" file of DNSCrypt). Here in my bad English it sounds more complex than really is, when you read the Wiki, and you play with DNSCrypt for 2 or 3 days, it becomes a piece of cake, super easy to use. Average users are not going to read the Wiki, and they are not going to be interested in DNSCrypt. In this case, they can use "SimpleDNSCrypt", that works like a "plug and play", it takes 1 minute to install, select very few options, and that's all, ready to go.
More important, and you will love this: DNSCrypt has an extra software named "GENERATOR". There you can write all the blocking-list-urls you want. And when you execute "GENERATOR", the software first uploads all the lists you chose, then compiles deleting repeated domains, and finally it builds the unified-blocking-list for DNSCrypt. It is fantastic! Not to mention that also you can add your own white-list with unblocked domains, wildcards are totally compatible etc, and "GENERATOR" merges everything in one sole list. Amazing!
More details:
- DNSCrypt is portable.
- SimpleDNSCrypt allows the use of "logs" to see what is blocked in real-time. And domains can be blocked or whitelisted manually, everything in real-time.
- You can have a huge blocking-list, that DNSCrypt will upload everything to RAM, and it won't hurt performance. For example, I tested a gigantic list that took 1GB of RAM in DnsServer, while DNSCrypt only needed ±50MB. I never saw DNSCrypt using more than just 50MB, but DnsServer will kill your RAM.
YOUR REQUEST: You asked for:
-
a list of domains that need to be added to the allowed list The big problem was in the beginning, when international domains were blocked. But you unblocked them, and after that we haven't found lot of famous webpages blocked. However, considering that our real-life test was very incomplete, and social media and other remain blocked at your list, this is something that we need to recheck in future new tests.
-
a list of tracker domains that aren't already blocked
-
a list of potential domain lists (smaller than 1MB) that don't already appear on the repo Here I attach you a txt file with a list of domains (ads and trackers) that your list is not covering: (EDIT - this is the right list https://ufile.io/ru48fb2z)
It is more than 1MB. But you can decide what domains to delete or not. Some of the domains were added by us. Other were added from logs showing unblocked garbage. Other were added from updated blocking-lists (we only used updated lists).
I hope something of our collaboration will be useful to your project. Please, share with me your thoughts, and let me know what are going to be your future steps. And keep counting with our collaboration.
Thank you and big hug! : )
hl2guide
Discussion about testing Shard #2 list.