AdguardTeam / AdGuardHome

Network-wide ads & trackers blocking DNS server
https://adguard.com/adguard-home.html
GNU General Public License v3.0
24.83k stars 1.79k forks source link

Hide Redundancy #946

Open Erik262 opened 5 years ago

Erik262 commented 5 years ago

Prerequisites

Problem Description

I have a cam, which is sending every second, data to an website in my blocking list. This cause a huge redundancy statistics on the dashboard.

Proposed Solution

The possibility to hide some client or ignore counting them

Alternatives Considered

Additional Information

ameshkov commented 5 years ago

So the cam's DNS client ignores the blocked response's TTL?

Which rule blocks it? Could you please try blocking this domain with unspecified IP instead of NXDOMAIN? You can do it if you add smth like this to the custom rules: 0.0.0.0 example.org

Erik262 commented 5 years ago

No, I put this rule self in my block list and everything works. Maybe this pic can help to understand what I mean.

pic

While my IP Cam is sending data to a Chinese website (which I putted on my block list) the request count get higher and higher. So my statistics are not really usable. Thats why I'm asking for the feature to hide client or to ignore them counting in the statistics.

ghost commented 5 years ago

If has option to sort logs under client range as mentioned on https://github.com/AdguardTeam/AdGuardHome/issues/481#issuecomment-515673586 it helps to exclude 'IP Cam' client then @Erik262 able to view rest of query log, top clients statistics, top blocked or queried domains on dashboard.

Ultrabenosaurus commented 5 years ago

Being able to specify domains that are hidden from the Dashboard stats and Query Log, with a toggle switch in the top-right of both pages to include / exclude those domains at any time, would be amazing.

Avast's anti-virus / internet security software has a few domains they ping regularly for "connectivity checks" and for the email anti-spam function. They ping the email one every 5 seconds as long as your device is on regardless of whether you're doing anything email related or not. Luckily the email one can be added to the hosts file without issue, so it doesn't impact my AGH stats yet, but Avast has an anti-tamper thing built-in to ensure other software cannot bypass, alter, or disable Avast. This includes removing most Avast-related domains from the hosts file, so my only choice is to add them as custom filters to AGH.

Even without the email domain reaching AGH, just analytics.ff.avast.com alone accounts for a third to a half of all blocked requests in any given 24 hour period, significantly skewing my statistics and adding a lot of pointless entries to my query log and is constantly the number 1 for both the queried domains and blocked domains on my AGH Dashboard!

I've also just discovered ncc.avast.com and added it to AGH, so I'm expecting my stats to get even less meaningful this time tomorrow. If it's pinged half as often as analytics.ff.avast.com then between them they'll account for over half of all blocked domains every day.

ameshkov commented 5 years ago

Marked as a feature request. However, I have no clear vision on how to implement this.

ghost commented 5 years ago

@ameshkov > However, I have no clear vision on how to implement this.

in any given 24 hour period, significantly skewing my statistics and adding a lot of pointless entries to my query log and is constantly the number 1 for both the queried domains and blocked domains on my AGH Dashboard!

Add various sort methods. it is the best and easy solution for these type of feature requests then users able to input necessary domains, clients to exclude (or vise versa) and generate as desired however result must apply to query log and dashboard.

ameshkov commented 5 years ago

I mean if this is just about query log, this is one thing. But if this is about filtering on a different level, and getting rid of it in the dashboard, it is a whole different story.

ghost commented 5 years ago

Yes but i see continuously receive similar feature requests time to time then i prefer to suggest that way as most suitable solution.

szolin commented 4 years ago

I think we can add a new per-client configuration setting. If it's on, we just don't include this client's IP addresses in statistics data that AGH web server sends to UI. However, we should also provide a "red mark" somewhere in the clients table that would help admin not to forget about it.

ghost commented 4 years ago

https://github.com/AdguardTeam/AdGuardHome/issues/594#issuecomment-580248319

WildByDesign commented 4 years ago

I would also enjoy having the ability to exclude specific domains from the Statistics in the Dashboard.

For example, I have one domain name originating from my IPTV box that is accounting for something like 18% of overall DNS lookups on my entire network. So this naturally is skewing my Statistics and making them more difficult to understand.

bruvv commented 4 years ago

This is how pihole did it: https://github.com/pi-hole/FTL/pull/254/files they exclude the DNS query all together with dnsmasq Would be great if we can have this on adguard aswell. ( https://github.com/AdguardTeam/AdGuardHome/issues/1894 )

rfgamaral commented 3 years ago

I have the same problem and it«s even worse in my case since a specific internal domain accounts for more than 70% of all my DNS queries. It completely skews statistics and makes them hard to read.

For me, a simple "ignore this domain from all statistics" option would be more than enough :)

SmartBoy84 commented 1 year ago

Any update on this?