search

amitkumarj441 / gsoc17-cncf

:rocket: Google Summer of Code 2017 project tracker - Standardizing Kubernetes logs (CNCF)
Apache License 2.0
4 stars 2 forks source link

Create a filter for kubernetes.master logs. #11

Open mmmmmmpc opened 7 years ago

mmmmmmpc commented 7 years ago

Create a filter for kubernetes.master logs.

Initial test may be the ones with "GET /api" in it.

amitkumarj441 commented 7 years ago

@mperezco Please have a look at our fluentd filter.

amitkumarj441 commented 7 years ago

@mperezco Please suggest here if I'd able to get the logs under Kibana

kubernetes-filter.conf: | <filter kubernetes.**> type kubernetes_metadata merge_json_log true preserve_json_log true </filter> <filter kubernetes.**> @type record_transformer enable_ruby true <record> kubernetes_namespace_container_name ${record["kubernetes"]["namespace_name"]}.${record["kubernetes"]["container_name"]} </record> </filter> <match kubernetes.**> @type rewrite_tag_filter rewriterule1 kubernetes_namespace_container_name ^(.+)$ kube.$1 </match> <filter kube.**> @type record_transformer remove_keys kubernetes_namespace_container_name </filter> <filter kube.kube-system.**> type parser format kubernetes reserve_data true key_name log suppress_parse_error_log true </filter>