search

apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.8k stars 4.22k forks source link

Improve log configuration when using multiple logging frameworks in Pipeline #18244

Open kennknowles opened 2 years ago

kennknowles commented 2 years ago

We need to improve / document how to configure the different logging frameworks to support the different Beam modules (SDK/Runners/IOs).

I have seen this reported already in slack, but it also bit me recently when trying to log things with a module whose dependencies only supported java based logging over slf4j (no log4j). I tried to provide the classical log4j.properties but I could not get it to log anything, nothing from the sdk, and logically nothing from the java logging framework.

Discussion on dev list

Imported from Jira BEAM-1757. Original Jira may contain additional context. Reported by: iemejia.

kennknowles commented 2 years ago

The following subtask(s) are associated with this issue: #18245, #18246