search

typhon-project / typhondl

http://www.typhon-project.org
Eclipse Public License 2.0
1 stars 0 forks source link

Add centralised logging #73

Closed MarieSaphira closed 3 years ago

MarieSaphira commented 4 years ago

USER UPDATE Please recreate your DL model if you want to use centralised logging. If you don't want to use logging and don't want to recreate your model, you have to add the following line to your <DLmodelName>.tdl.properties file:

polystore.logging = false

Adds centralised logging to the Polystore using Elasticsearch, Kibana and Fluentd (EKF stack).

TODO: update wiki

Closes #65

5h4m4n commented 4 years ago

I think this looks great!

The only thing we might want to think about or maybe in a future release especially for the kubernetes deployment is where elasticsearch will be running.

In the current setup we are adding elasticsearch within the kubernetes deployment. Elastic is a pretty hungry application with respect to RAM and CPU resources so it might be a good idea to have the opportunity to add elastic in a different nodegroup under the monitoring namespace in kubernetes so that we can isolate its resource allocation.

Also if someone decides to completely separate elasticsearch to sit outside of the kubernetes world should we be able to customize the target host?