knative / serving

Kubernetes-based, scale-to-zero, request-driven compute
https://knative.dev/docs/serving/
Apache License 2.0
5.57k stars 1.16k forks source link

Collect logs for eventing components by fluent #9071

Closed xinydev closed 4 years ago

xinydev commented 4 years ago

/area monitoring

Ask your question here:

For now, we can not collect logs for eventing components by fluent, because the config of logs path for fluent look like:

/var/log/containers/*user-container-*.log,
/var/log/containers/*build-step-*.log,
/var/log/containers/controller-*controller-*.log,
/var/log/containers/webhook-*webhook-*.log,
/var/log/containers/*autoscaler-*autoscaler-*.log,
/var/log/containers/*queue-proxy-*.log,
/var/log/containers/activator-*activator-*.log

and the log files for eventing in /var/log/containers/* look like :

eventing-webhook-6f88588bcb-nctjn_knative-eventing_eventing-webhook-6ff5369cff9b5174f20dc881efde082a872104dfe3c488fe0b824b29ea78df09.log
imc-controller-f647846d4-7bf58_knative-eventing_controller-a04ca67d977780f298a9667df2d96b7e64ccc426b862da1e3cc48270077ed383.log
imc-dispatcher-8b74bf75d-dgccp_knative-eventing_dispatcher-037f4e9c6180447bd37b6604d7739f58ad8a10fcba2f763bcea09743e8513612.log
kafka-ch-controller-745d4c68d5-t848m_knative-eventing_controller-75646b2f16f6117c4c9925300385aeea9569330c2187a670133efcd452cdb452.log
kafka-webhook-7446bd8ffb-csmbp_knative-eventing_kafka-webhook-2556e92696fa721623326d2cdc8c882a16c02d0d5e630cc1f6982b597dcf842b.log
mt-broker-filter-6844445fcb-5qx56_knative-eventing_filter-3f06f315d700530b3e03e4ab81e95b584d41428f1d4ee4b7eb05ea5f454909b3.log
mt-broker-ingress-55789bb77b-6npcl_knative-eventing_ingress-abee089092d5d00f60aa0593d178b8967f21b789f1292b13506d9b2c16f2127e.log
pingsource-mt-adapter-5b96965577-82jg9_knative-eventing_dispatcher-37175248c9a06d9b30984405e4d795a99d708415228c0843f57cc28c10e32d01.log
mt-broker-controller-5cf9fcb59f-txb4k_knative-eventing_mt-broker-controller-20e4f72e860900178549caa70bab6b437d7903440a85cefba53673f6f5528413.log
natss-ch-controller-754996cd66-pnpgw_knative-eventing_controller-6871d14959fa054bdc24cafa15ec60bb24a12112b007f3d1e563d761df2a56bc.log
natss-ch-dispatcher-566b96ffc9-c5p7m_knative-eventing_dispatcher-85f4c1b7be369d0f216a2b3da99f400827f1aa220709cdf621f689e5856d815e.log

so we need do some changes:

/var/log/containers/controller-controller-.log -> /var/log/containers/controller-controller-.log, /var/log/containers/webhook-webhook-.log, -> /var/log/containers/webhook-webhook-.log,

and add paths for eventing dispatcher,filter,ingress,adapter:

/var/log/containers/dispatcher-dispatcher-.log
/var/log/containers/
filter-filter-.log
/var/log/containers/ingress-ingress-.log
/var/log/containers/
adapter-dispatcher-.log

Is that right? any guidance about this? I am not sure this is the right place to do these changes.

mattmoor commented 4 years ago

The monitoring plugin/bundle was deprecated in v0.14, and our intention is to remove it, so I don't think we really want to be making functional changes here.