nikunjdoshi67 / LogsShipping

This Repository has been created to ship the logs from the Openstack Nodes to ElK
GNU General Public License v3.0
0 stars 0 forks source link

Filebeat Input Paths that needs to be specified for Log Configuration #5

Open nikunjdoshi67 opened 4 years ago

nikunjdoshi67 commented 4 years ago

From Openstack Nodes we have to collect the logs of Open stack Services spcifically?

In the Filebeat.yml file Input Section as of now the path section is just collecting the logs from all the services in the system

Paths that should be crawled and fetched. Glob based paths.

paths:

Refer Lines 26-30

Filebeat

I was also considering to mention the following logs in the path file

Compute nova-* /var/log/nova

Image Service glance-* /var/log/glance

Block Storage cinder-* /var/log/cinder

Identity service keystone-* /var/log/keystone

Networking neutron-* /var/log/neutron

Dashboard horizon /var/log/apache2 or /var/log/httpd

Orchestration service heat /var/log/heat

Telemetry service ceilometer /var/log/ceilometer

All nodes misc (swift, dnsmasq) /var/log/syslog

Compute nodes libvirt /var/log/libvirt/libvirtd.log

Compute nodes Console (boot upmessages) for VM instances: /var/lib/nova/instances/instance-/console.log

Block Storage nodes cinder-volume /var/log/cinder/cinder-volume.log

Reference Taken from : https://support.loomsystems.com/en/articles/930646-where-to-find-openstack-log-files

larsks commented 4 years ago

I think I mentioned this in email or slack earlier, but the log files we need to gather mostly match the expression /var/log/containers/*/*log. I think we will also want /var/log/messages and /var/log/openvswitch/*log.