search

US-CBP / GTAS

Global Travel Assessment System | A passenger data screening and analysis system for enhancing global security
https://us-cbp.github.io/GTAS/
Other
115 stars 76 forks source link

Technical Guide for Installing Kibana/Logstash/ElasticSearch #1212

Open originalname51 opened 5 years ago

originalname51 commented 5 years ago

Technical documentation/deployment guide for Kibana/Logstash/ElasticSearch similar to the Neo4j deployment instructions.

tsegay commented 5 years ago

will this be in a separate readme file or part of the Technical Guide?

tsegay commented 5 years ago

ELK stack installation

Requirements

sudo yum install git, wget, maven -y

Configuration

Configuration files can be found at GTAS/gtas-parent/scripts/elastic/config/*.

Installation

  1. Linux

    • Clone GTAS from github (https://github.com/US-CBP/GTAS.git)

      git clone --single-branch --branch dev https://github.com/US-CBP/GTAS.git

    • Browse to GTAS/gtas-parent/scripts/elastic/install/linux/

      cd GTAS/gtas-parent/scripts/elastic/install/linux/

    • Manage all ELK stack

      install: installs elastic search, kibana and logstash as a serivce. The services will start automatically on boot.

       ./install_all.sh

      start: starts all ELK services.

       ./start_all.sh

      stop: stops all ELK services.

       ./stop_all.sh

      uninstall: stops the serivces and remove the packges from the system.

       ./uninstall_all.sh

    • Manage each ELK stack separately

      Each script below uses systemd service to (start/stop) and yum to (install/uninstall). The scripts are also used to bootstrap Centos7 VM.

      Elastic Search

      ./elasticsearch/(install/start/stop/uninstall).sh

      Kibana

      ./kibana/(install/start/stop/uninstall).sh

      Logstash

      install: installs logstash as a serivce. Copies all logstash config files, elastic search templates, sql scripts and java client jar for mariadb into logstash working directory. The service will start automatically on boot.

      ./logstash/(install/start/stop/uninstall).sh
originalname51 commented 5 years ago

Can we have an offline guide as well?

originalname51 commented 4 years ago

Testing for linux environments only

originalname51 commented 4 years ago

Several changes, including changes to docker will invalidate current state of this ticket; moving to backlog.