search

DataCater / datacater

The developer-friendly ETL platform for transforming data in real-time. Based on Apache Kafka® and Kubernetes®.
https://datacater.io
Other
82 stars 4 forks source link

Clean up deployment logs #62

Closed flippingbits closed 1 year ago

flippingbits commented 1 year ago

At the moment the deployment logs contain a couple of warnings:

2022-11-19T12:35:47.436Zio.quarkus.smallrye.openapi.runtime.OpenApiRecorderDefault CORS properties will be used, please use 'quarkus.http.cors' properties instead
2022-11-19T12:35:47.682Zio.smallrye.reactive.messaging.kafkaSRMSG18216: No `group.id` set in the configuration, generate a random id: b8ffccb7-f485-4572-8778-09ca480c5102
2022-11-19T12:35:47.683Zio.smallrye.reactive.messaging.kafkaSRMSG18229: Configured topics for channel 'stream-in': [test]
2022-11-19T12:35:47.747Zio.quarkus.smallrye.reactivemessaging.kafka.KafkaCodecDependencyRemovalLoggerDependency to be removed: The Serde class `io.vertx.kafka.client.serialization.JsonObjectDeserializer` will no longer be included in the classpath of the Smallrye Reactive Messaging Kafka extension. Consider replacing it's usage with `io.quarkus.kafka.client.serialization.JsonObjectDeserializer` provided by the Kafka extension or including the Vert.x Kafka client dependency (io.vertx:vertx-kafka-client) yourself.
2022-11-19T12:35:47.755Zio.quarkus.smallrye.reactivemessaging.kafka.KafkaCodecDependencyRemovalLoggerDependency to be removed: The Serde class `io.vertx.kafka.client.serialization.JsonObjectDeserializer` will no longer be included in the classpath of the Smallrye Reactive Messaging Kafka extension. Consider replacing it's usage with `io.quarkus.kafka.client.serialization.JsonObjectDeserializer` provided by the Kafka extension or including the Vert.x Kafka client dependency (io.vertx:vertx-kafka-client) yourself.
2022-11-19T12:35:48.241Zorg.apache.kafka.common.security.authenticator.AbstractLoginSuccessfully logged in.
2022-11-19T12:35:48.432Zorg.apache.kafka.clients.consumer.ConsumerConfigThe configuration 'kafka-configuration' was supplied but isn't a known config.
2022-11-19T12:35:48.49Zio.quarkus.smallrye.reactivemessaging.kafka.KafkaCodecDependencyRemovalLoggerDependency to be removed: The Serde class `io.vertx.kafka.client.serialization.JsonObjectSerializer` will no longer be included in the classpath of the Smallrye Reactive Messaging Kafka extension. Consider replacing it's usage with `io.quarkus.kafka.client.serialization.JsonObjectSerializer` provided by the Kafka extension or including the Vert.x Kafka client dependency (io.vertx:vertx-kafka-client) yourself.
2022-11-19T12:35:48.491Zio.quarkus.smallrye.reactivemessaging.kafka.KafkaCodecDependencyRemovalLoggerDependency to be removed: The Serde class `io.vertx.kafka.client.serialization.JsonObjectSerializer` will no longer be included in the classpath of the Smallrye Reactive Messaging Kafka extension. Consider replacing it's usage with `io.quarkus.kafka.client.serialization.JsonObjectSerializer` provided by the Kafka extension or including the Vert.x Kafka client dependency (io.vertx:vertx-kafka-client) yourself.
2022-11-19T12:35:48.512Zorg.apache.kafka.clients.producer.ProducerConfigThe configuration 'kafka-configuration' was supplied but isn't a known config.
2022-11-19T12:35:48.518Zio.smallrye.reactive.messaging.kafkaSRMSG18258: Kafka producer kafka-producer-stream-out, connected to Kafka brokers 'pkc-75m1o.europe-west3.gcp.confluent.cloud:9092', is configured to write records to 'test_out_stream'
2022-11-19T12:35:48.655Zio.smallrye.reactive.messaging.kafkaSRMSG18257: Kafka consumer kafka-consumer-stream-in, connected to Kafka brokers 'pkc-75m1o.europe-west3.gcp.confluent.cloud:9092', belongs to the 'b8ffccb7-f485-4572-8778-09ca480c5102' consumer group and is configured to poll records from [test]
2022-11-19T12:35:48.919Zio.quarkuspipeline 1 on JVM (powered by Quarkus 2.12.0.Final) started in 2.515s. Listening on: http://0.0.0.0:8080
2022-11-19T12:35:48.921Zio.quarkusProfile prod activated.
2022-11-19T12:35:48.921Zio.quarkusInstalled features: [cdi, config-yaml, confluent-registry-avro, kafka-client, resteasy-reactive, resteasy-reactive-jackson, smallrye-context-propagation, smallrye-openapi, smallrye-reactive-messaging, smallrye-reactive-messaging-kafka, vertx]

Can we clean up the logs and get rid of warnings, such as the following?

2022-11-19T12:35:48.512Zorg.apache.kafka.clients.producer.ProducerConfigThe configuration 'kafka-configuration' was supplied but isn't a known config.

or

2022-11-19T12:35:48.491Zio.quarkus.smallrye.reactivemessaging.kafka.KafkaCodecDependencyRemovalLoggerDependency to be removed: The Serde class `io.vertx.kafka.client.serialization.JsonObjectSerializer` will no longer be included in the classpath of the Smallrye Reactive Messaging Kafka extension. Consider replacing it's usage with `io.quarkus.kafka.client.serialization.JsonObjectSerializer` provided by the Kafka extension or including the Vert.x Kafka client dependency (io.vertx:vertx-kafka-client) yourself.
HknLof commented 1 year ago

Let's reduce the noise created by org.apache.kafka.clients.* and introduce our own banner at startup.