kdgregory / log4j-aws-appenders

Appenders for Log4J 1.2.x, Log4J 2.x, and Logback that write to AWS destinations.
Apache License 2.0
67 stars 18 forks source link

Kinesis Analytics #195

Closed marcoscale98 closed 8 months ago

marcoscale98 commented 8 months ago

Does this Appender also work when used in a AWS Kinesis Data Analytics App (Managed Apache Flink App)?

kdgregory commented 8 months ago

@marcoscale98

I don't think so, although I have no experience with Flink configuration. However, my experience with other AWS managed services, such as Glue, is that you have no ability to properly configure the logging system.

Looking at the Flink docs, it seems that the default logs are stored on disk, and there's no way to provide an alternative configuration. However, it also appears that AWS can send Flink logs to CloudWatch. I think that's your best option.

marcoscale98 commented 8 months ago

Thanks @kdgregory but the built-in Kinesis Analytics system that Cloudwatch uses does not allow me to fine-filter the logs using "log4j2.properties" (or so it seemed to me from some of my tests) Thank you anyway