radiumfu / enterprise-log-search-and-archive

Automatically exported from code.google.com/p/enterprise-log-search-and-archive
0 stars 0 forks source link

Can't see any new queries #116

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago
What is the expected output? What do you see instead?
My elsa node instance has been collecting logs, but  no new events have been 
added to the event database. While the index id is increasing, no data are 
stored in the host_stats table. I'd love some help figuring out why new events 
are disappearing.

What version of the product are you using? On what operating system?
node: Ubuntu 12.04.2 LTS (GNU/Linux 3.2.0-23-generic x86_64)

Please provide any additional information below.
I have already try to make a debug. I have stopped syslog-ng and I checked that 
no Perl processes are running. Then I run :

---------------------------------------------------------------------------
$ cd /usr/local/elsa/node && echo "" | sudo perl elsa.pl -o
Validating directory...
Use of uninitialized value in string eq at /usr/local/elsa/node/Indexer.pm line 
850.
Use of uninitialized value in string eq at /usr/local/elsa/node/Indexer.pm line 
874.
Use of uninitialized value $db_size in concatenation (.) or string at 
/usr/local/elsa/node/Indexer.pm line 198.
Use of uninitialized value $db_size in addition (+) at 
/usr/local/elsa/node/Indexer.pm line 219.
Running once
Use of uninitialized value $line[3] in string eq at 
/usr/local/elsa/node/Reader.pm line 338, <STDIN> line 1.
---------------------------------------------------------------------------

I have also tried to make an update by running :
$ sudo sh /usr/local/elsa/contrib/install.sh node update

but no sense. The result is the same.

Original issue reported on code.google.com by alexandr...@gmail.com on 29 Mar 2013 at 6:56

GoogleCodeExporter commented 8 years ago
The new code that I put in last week requires both the web and the node code to 
be installed on all boxes.  (In the future, the node/web code will be merged 
together.)  Please run sudo sh /usr/local/elsa/contrib/install.sh web to get 
the web code loaded.  It will install the cron.pl script into your crontab to 
run each minute, which is now responsible for loading the buffer files.  There 
should be a big backlog of files in your /data/elsa/tmp/buffers, so those 
should get loaded when this starts (or when you run elsa.pl as you did).  
Please let me know if this fixes your problem.

Original comment by mchol...@gmail.com on 29 Mar 2013 at 2:39

GoogleCodeExporter commented 8 years ago
Thanks for your response.

No, that method didn't fixed the problem. My main problem is not the loading of 
buffer files, but when it loads the data, no data are stored in the host_stats 
table. The id in the index table is increasing but no further information are 
stored in the syslog database.

Original comment by alexandr...@gmail.com on 1 Apr 2013 at 5:18

GoogleCodeExporter commented 8 years ago
Your issue was listed as unable to execute queries, are you able to execute 
queries?  They don't use the host_stats table, that's only used for the stats 
page under the admin menu.  When you say "no further information is stored in 
the syslog database," do you mean specifically the host_stats table, or that 
logs themselves aren't being recorded and indexed?

Original comment by mchol...@gmail.com on 1 Apr 2013 at 3:33

GoogleCodeExporter commented 8 years ago
Sorry for the inconvenience that I may created. I will try to explain you 
again. When there are incoming data to some of my network interfaces (eg. my 
eth0 port) syslog-ng fetches those data to ELSA. Now, ELSA records the details 
of those data to syslog_data DB (mysql database) and the indexes of those data 
are stored in the index table of the syslog DB. Till here I think everything is 
OK. 
Now, I believe that there is data missing, especially in the host_stats table, 
as it is empty even though there added about 850,578 new records (as I can see 
in the index table and the syslog_data database). I think that in host_stats 
table I had to see some log counts. Am I right? or it is OK that this table is 
empty?

Original comment by alexandr...@gmail.com on 1 Apr 2013 at 4:06

GoogleCodeExporter commented 8 years ago
Ok, I think I fixed this.  Please try the latest code with sh install.sh node 
update and see if your host stats table is now populating.

Original comment by mchol...@gmail.com on 1 Apr 2013 at 4:12

GoogleCodeExporter commented 8 years ago
Yes! Thank you!

Original comment by alexandr...@gmail.com on 1 Apr 2013 at 4:26

GoogleCodeExporter commented 8 years ago
Great, closing via rev 754.

Original comment by mchol...@gmail.com on 1 Apr 2013 at 4:57