search

darold / squidanalyzer

Squid Analyzer parses Squid proxy access log and reports general statistics about hits, bytes, users, networks, top URLs, and top second level domains. Statistic reports are oriented toward user and bandwidth control.
http://squidanalyzer.darold.net/
126 stars 36 forks source link

bad format at line xxx into /var/www/squidanalyzer/11/16/stat_user_url.dat #111

Closed cedua closed 8 years ago

cedua commented 8 years ago

Hi Darold! Have the problem generating stat_user_url.dat file (bad format)....

My access.log is something like:

192.168.37.131 - - [16/Nov/2015:11:44:17 -0600] "GET http://www.geocities.com/sbllro2/IN12SDSDWVLML.txt HTTP/1.1" 407 2357 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:31 -0600] "HEAD http://download.windowsupdate.com/v9/windowsupdate/redir/muv4wuredir.cab? HTTP/1.1" 407 489 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:31 -0600] "HEAD http://download.windowsupdate.com/v9/windowsupdate/redir/muv4wuredir.cab? HTTP/1.1" 407 489 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:31 -0600] "GET http://download.windowsupdate.com/v9/windowsupdate/redir/muv4wuredir.cab? HTTP/1.1" 407 2499 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:31 -0600] "GET http://download.windowsupdate.com/v9/windowsupdate/redir/muv4wuredir.cab? HTTP/1.1" 407 2499 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:32 -0600] "HEAD http://download.microsoft.com/v9/windowsupdate/redir/muv4wuredir.cab? HTTP/1.1" 200 464 TCP_MISS:DIRECT 192.168.37.131 - - [16/Nov/2015:11:44:32 -0600] "HEAD http://ds.download.windowsupdate.com/v11/3/windowsupdate/selfupdate/WSUS3/x86/Win7SP1/wsus3setup.cab? HTTP/1.1" 407 489 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:32 -0600] "HEAD http://ds.download.windowsupdate.com/v11/3/windowsupdate/selfupdate/WSUS3/x86/Win7SP1/wsus3setup.cab? HTTP/1.1" 407 489 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:32 -0600] "GET http://ds.download.windowsupdate.com/v11/3/windowsupdate/selfupdate/WSUS3/x86/Win7SP1/wsus3setup.cab? HTTP/1.1" 407 2619 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:32 -0600] "GET http://ds.download.windowsupdate.com/v11/3/windowsupdate/selfupdate/WSUS3/x86/Win7SP1/wsus3setup.cab? HTTP/1.1" 407 2619 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:38 -0600] "GET http://ctldl.windowsupdate.com/msdownload/update/v3/static/trustedr/en/authrootstl.cab? HTTP/1.1" 407 2572 TCP_DENIED:NONE 192.168.37.131 - - [16/Nov/2015:11:44:38 -0600] "CONNECT watson.microsoft.com:443 HTTP/1.1" 200 4995 TCP_MISS:DIRECT 192.168.37.131 - - [16/Nov/2015:11:45:38 -0600] "CONNECT www.update.microsoft.com:443 HTTP/1.1" 200 3747 TCP_MISS:DIRECT

And the squidanalyzer is reporting: ERROR: bad format at line 12 into /var/www/squidanalyzer/2015/11/16/stat_user_url.dat 192.168.37.131 hits=1;bytes=464;duration=-0;first=1447695872;last=1447695872;url=download.microsoft.com;cache_hit=0;cache_bytes=0

Please your comments,

PS Sorry, you might see this post in another issue post.

darold commented 8 years ago

Thanks for the report. Last commit 63ca649 might solves the issue, please download latest code and give it a try.

cedua commented 8 years ago

This is not presenting the issue anymore; but when the squid-analyzer ran the output was:

Illegal division by zero at /usr/share/perl5/vendor_perl/SquidAnalyzer.pm line 3274.

darold commented 8 years ago

Latest commit fix potential division by 0, but I do not find any problem or division in SquidAnalyzer.pm at line 3274. How do you updated the code? The best way is the following:

wget https://github.com/darold/squidanalyzer/archive/master.zip
unzip master.zip
cd squidanalyzer-master/
perl Makefile.PL
make
sudo make install
cedua commented 8 years ago

Done with your comments (master.zip) but it still with the division by 0 (but in another line):

Illegal division by zero at /usr/share/perl5/vendor_perl/SquidAnalyzer.pm line 3281

darold commented 8 years ago

Ok, last commit fix that. Thanks for your help to build a better tool.

cedua commented 8 years ago

We are moving forward... :)

Now the error is in another line:

Illegal division by zero at /usr/share/perl5/vendor_perl/SquidAnalyzer.pm line 5242

darold commented 8 years ago

Ok, fixed in commit d560231.

Waiting for next one :)

cedua commented 8 years ago

Darold, All is fine until now. The analyzer ran smoothly and generated the report.

I'll close the issue now

Thank you for your support, and the excellent tool!!!!