openedx-vlead / cc-pf-tests

Contains scripts for calculating performance of the college cloud server
0 stars 1 forks source link

How to get logfiles using logstash filters? #4

Open Karthik183 opened 7 years ago

Karthik183 commented 7 years ago

Tried to install logstash plugins to take logsfiles from syslogs. Unable to install the plugins in logstash as there is some installation problem of logstash.

Karthik183 commented 7 years ago

Successfully installed elk stack in a seperate container(ctid:15211). Working on plugins which gets logs directly from syslogs and import to elasticsearch in json format.

sivashankerN commented 7 years ago

I have created another container 14067 ( Ubuntu-16.04) on base4

  1. Export proxy
  2. Update OS

Installed following packages from root account

apt-get install default-jre - Installs openjdk-8-jdk apt-get install default-jdk - Installs openjdk-8-jdk

Downloaded ".deb" file of logstash from https://artifacts.elastic.co/downloads/logstash/logstash-5.4.1.deb

dpkg -i logstash-5.4.1.deb

successfully installed above three packages

For logstash plugings use the following commands

export proxy /usr/share/logstash/bin/logstash-plugin list

Above command lists available logstash plugins more details for plugings at https://www.elastic.co/guide/en/logstash/current/offline-plugins.html https://www.elastic.co/guide/en/logstash/current/working-with-plugins.html

Karthik183 commented 7 years ago

Able to push data in to kibana using logstash filter. But facing an error _grokparsefailure) in converting logfiles into json format while using grok plugin.