search

darold / squidanalyzer

Squid Analyzer parses Squid proxy access log and reports general statistics about hits, bytes, users, networks, top URLs, and top second level domains. Statistic reports are oriented toward user and bandwidth control.
http://squidanalyzer.darold.net/
126 stars 36 forks source link

ERROR: bad format at line 1 into stat_denied_url.dat #81

Closed ghost closed 9 years ago

ghost commented 9 years ago

I got this error after rebuilding statistics.

10.2.12.166 hits=;first=;last=;url=

Squid access.log in that format:

1429893797.837     53 10.2.12.166 TCP_MISS/200 8310 GET http://habrahabr.ru/images/1429893503/navbar.sprite.v2.x1.png re
fnet DIRECT/178.248.233.33 image/png
1429893797.862    208 10.2.12.166 TCP_MISS/302 577 GET http://habrastorage.org/getpro/habr/avatars/85e/0bb/4a8/85e0bb4a8
6aad5b7b5b89ae834803792.jpg refnet DIRECT/82.192.95.170 application/octet-stream
1429893797.878     39 10.2.12.166 TCP_MISS/204 655 GET http://ad.adriver.ru/cgi-bin/rle.cgi? refnet DIRECT/81.222.128.22

How to reproduce:

  1. Fill log.
  2. Run squid-analyzer.
  3. Fill log again.
  4. Run squid-analyzer again.

How could i solve this problem? Thank you!

darold commented 9 years ago

Thanks for the report, please download latest code from github, last commit 0df6e96 might fix this issue.

Best regards,

ghost commented 9 years ago

Nice! Thank you! It works like after this fix.

cedua commented 8 years ago

Hi! Have the problem generating stat_user_url.dat file (bad format)....

My access.log is something like:

192.168.37.131 - - [16/Nov/2015:11:44:17 -0600] "GET http://www.geocities.com/sbllro2/IN12SDSDWVLML.txt HTTP/1.1" 407 2357 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:31 -0600] "HEAD http://download.windowsupdate.com/v9/windowsupdate/redir/muv4wuredir.cab? HTTP/1.1" 407 489 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:31 -0600] "HEAD http://download.windowsupdate.com/v9/windowsupdate/redir/muv4wuredir.cab? HTTP/1.1" 407 489 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:31 -0600] "GET http://download.windowsupdate.com/v9/windowsupdate/redir/muv4wuredir.cab? HTTP/1.1" 407 2499 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:31 -0600] "GET http://download.windowsupdate.com/v9/windowsupdate/redir/muv4wuredir.cab? HTTP/1.1" 407 2499 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:32 -0600] "HEAD http://download.microsoft.com/v9/windowsupdate/redir/muv4wuredir.cab? HTTP/1.1" 200 464 TCP_MISS:DIRECT 192.168.37.131 - - [16/Nov/2015:11:44:32 -0600] "HEAD http://ds.download.windowsupdate.com/v11/3/windowsupdate/selfupdate/WSUS3/x86/Win7SP1/wsus3setup.cab? HTTP/1.1" 407 489 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:32 -0600] "HEAD http://ds.download.windowsupdate.com/v11/3/windowsupdate/selfupdate/WSUS3/x86/Win7SP1/wsus3setup.cab? HTTP/1.1" 407 489 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:32 -0600] "GET http://ds.download.windowsupdate.com/v11/3/windowsupdate/selfupdate/WSUS3/x86/Win7SP1/wsus3setup.cab? HTTP/1.1" 407 2619 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:32 -0600] "GET http://ds.download.windowsupdate.com/v11/3/windowsupdate/selfupdate/WSUS3/x86/Win7SP1/wsus3setup.cab? HTTP/1.1" 407 2619 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:38 -0600] "GET http://ctldl.windowsupdate.com/msdownload/update/v3/static/trustedr/en/authrootstl.cab? HTTP/1.1" 407 2572 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:38 -0600] "CONNECT watson.microsoft.com:443 HTTP/1.1" 200 4995 TCP_MISS:DIRECT 192.168.37.131 - - [16/Nov/2015:11:45:38 -0600] "CONNECT www.update.microsoft.com:443 HTTP/1.1" 200 3747 TCP_MISS:DIRECT

And the squidanalyzer is reporting: ERROR: bad format at line 12 into /var/www/squidanalyzer/2015/11/16/stat_user_url.dat 192.168.37.131 hits=1;bytes=464;duration=-0;first=1447695872;last=1447695872;url=download.microsoft.com;cache_hit=0;cache_bytes=0

Please your comments,