allinurl / goaccess

GoAccess is a real-time web log analyzer and interactive viewer that runs in a terminal in *nix systems or through your browser.
https://goaccess.io
MIT License
18.52k stars 1.11k forks source link

feature idea: capture ignored requests #2740

Open meonkeys opened 1 month ago

meonkeys commented 1 month ago

I found it confusing that many of my requests were not included in "Valid Requests", not because they were invalid, but because I had ignore-crawlers set to true.

One idea to help users (like me): capture ignored requests in a file, similar to how invalid-requests captures invalid requests and unknowns-log captures unknown OSes and browsers.

It would also be useful to know the reason a request is not included in the "Valid Requests" total, e.g.

So maybe there's a new ignored-requests option/file, but with REASON tab IGNORED_REQUEST ?

I'm not sure that's a great idea. What do you think?

Maybe a better idea for now is simply to document and/or clearly define the values "Total Requests", "Valid Requests", "Failed Requests", "Unique Visitors", and the rest. Maybe in https://goaccess.io/man or in tooltips for each of those boxes?

Happy to help out with either or both, but I feel like the first idea needs some improvement.

One other other idea is to add boxes to the top of the dashboard showing other excluded numbers similar to "Excl. IP Hits", e.g. "Excl. by Referrer", "Excl. Crawler", etc. such that the sum of valid, failed, and excluded requests adds up to the "Total Requests" value.