AdguardTeam / AdGuardHome

Network-wide ads & trackers blocking DNS server
https://adguard.com/adguard-home/overview.html
GNU General Public License v3.0
25.61k stars 1.84k forks source link

Question: Can AGH check for duplicate domains? #1402

Closed BobWs closed 4 years ago

BobWs commented 4 years ago

Hi, I was wondering if Adguardhome is checking and removing duplicate domains in the filter section (Filters and hosts blocklists)?

I've been using pihole for a while now and recently switched to adguardhome. Pihole has the built-in possibility to check the filters for duplicate domains and then remove them. This can also be seen in the logfile.

Does AGH also have this possibility? I haven't been able to find anything about it anywhere. I did notice that duplicate domains just occur.

Would you consider building this in?

ameshkov commented 4 years ago

When the filtering engine is being built from the blocklists, of course, duplicate domain names are ignored.

The source blocklists files are kept intact, though.