I found it confusing that many of my requests were not included in "Valid Requests", not because they were invalid, but because I had ignore-crawlers set to true.
One idea to help users (like me): capture ignored requests in a file, similar to how invalid-requests captures invalid requests and unknowns-log captures unknown OSes and browsers.
It would also be useful to know the reason a request is not included in the "Valid Requests" total, e.g.
request X skipped because client IP is included in an exclude-ip option (I do note the top of the dashboard has "Excl. IP Hits", so maybe that's already sorted)
request Y skipped because referrer is included in an ignore-referrer option
request Z skipped because it was a crawler and ignore-crawlers is true
So maybe there's a new ignored-requests option/file, but with REASON tab IGNORED_REQUEST ?
I'm not sure that's a great idea. What do you think?
Maybe a better idea for now is simply to document and/or clearly define the values "Total Requests", "Valid Requests", "Failed Requests", "Unique Visitors", and the rest. Maybe in https://goaccess.io/man or in tooltips for each of those boxes?
Happy to help out with either or both, but I feel like the first idea needs some improvement.
One other other idea is to add boxes to the top of the dashboard showing other excluded numbers similar to "Excl. IP Hits", e.g. "Excl. by Referrer", "Excl. Crawler", etc. such that the sum of valid, failed, and excluded requests adds up to the "Total Requests" value.
I found it confusing that many of my requests were not included in "Valid Requests", not because they were invalid, but because I had
ignore-crawlers
set totrue
.One idea to help users (like me): capture ignored requests in a file, similar to how
invalid-requests
captures invalid requests andunknowns-log
captures unknown OSes and browsers.It would also be useful to know the reason a request is not included in the "Valid Requests" total, e.g.
exclude-ip
option (I do note the top of the dashboard has "Excl. IP Hits", so maybe that's already sorted)ignore-referrer
optionignore-crawlers
istrue
So maybe there's a new
ignored-requests
option/file, but with REASON tab IGNORED_REQUEST ?I'm not sure that's a great idea. What do you think?
Maybe a better idea for now is simply to document and/or clearly define the values "Total Requests", "Valid Requests", "Failed Requests", "Unique Visitors", and the rest. Maybe in https://goaccess.io/man or in tooltips for each of those boxes?
Happy to help out with either or both, but I feel like the first idea needs some improvement.
One other other idea is to add boxes to the top of the dashboard showing other excluded numbers similar to "Excl. IP Hits", e.g. "Excl. by Referrer", "Excl. Crawler", etc. such that the sum of valid, failed, and excluded requests adds up to the "Total Requests" value.