kafka-ops / julie

A solution to help you build automation and gitops in your Apache Kafka deployments. The Kafka gitops!
MIT License
418 stars 113 forks source link

Verify schemas deletion process successfully #516

Closed purbon closed 2 years ago

purbon commented 2 years ago

related to #513

purbon commented 2 years ago

Operations logs:

/Users/pere/.sdkman/candidates/java/11.0.9.j9-adpt/bin/java -ea -Didea.test.cyclic.buffer.size=1048576 -javaagent:/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar=52728:/Applications/IntelliJ IDEA.app/Contents/bin -Dfile.encoding=UTF-8 -classpath /Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar:/Applications/IntelliJ IDEA.app/Contents/plugins/junit/lib/junit5-rt.jar:/Applications/IntelliJ IDEA.app/Contents/plugins/junit/lib/junit-rt.jar:/Users/pere/work/gitops/kafka-topology-builder/target/test-classes:/Users/pere/work/gitops/kafka-topology-builder/target/classes:/Users/pere/.m2/repository/org/projectlombok/lombok/1.18.22/lombok-1.18.22.jar:/Users/pere/.m2/repository/com/typesafe/config/1.4.0/config-1.4.0.jar:/Users/pere/.m2/repository/com/hubspot/jinjava/jinjava/2.5.4/jinjava-2.5.4.jar:/Users/pere/.m2/repository/org/slf4j/slf4j-api/1.7.25/slf4j-api-1.7.25.jar:/Users/pere/.m2/repository/com/google/guava/guava/30.1-android/guava-30.1-android.jar:/Users/pere/.m2/repository/org/javassist/javassist/3.24.1-GA/javassist-3.24.1-GA.jar:/Users/pere/.m2/repository/org/jsoup/jsoup/1.10.3/jsoup-1.10.3.jar:/Users/pere/.m2/repository/com/google/re2j/re2j/1.2/re2j-1.2.jar:/Users/pere/.m2/repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar:/Users/pere/.m2/repository/commons-net/commons-net/3.3/commons-net-3.3.jar:/Users/pere/.m2/repository/com/googlecode/java-ipv6/java-ipv6/0.17/java-ipv6-0.17.jar:/Users/pere/.m2/repository/com/google/code/findbugs/annotations/3.0.1/annotations-3.0.1.jar:/Users/pere/.m2/repository/ch/obermuhlner/big-math/2.0.0/big-math-2.0.0.jar:/Users/pere/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.12.6.redhat-00001/jackson-annotations-2.12.6.redhat-00001.jar:/Users/pere/.m2/repository/redis/clients/jedis/3.2.0/jedis-3.2.0.jar:/Users/pere/.m2/repository/org/apache/commons/commons-pool2/2.6.2/commons-pool2-2.6.2.jar:/Users/pere/.m2/repository/io/confluent/kafka-schema-registry-client/6.1.0/kafka-schema-registry-client-6.1.0.jar:/Users/pere/.m2/repository/jakarta/ws/rs/jakarta.ws.rs-api/2.1.6/jakarta.ws.rs-api-2.1.6.jar:/Users/pere/.m2/repository/io/swagger/swagger-annotations/1.6.2/swagger-annotations-1.6.2.jar:/Users/pere/.m2/repository/io/confluent/common-utils/6.1.0/common-utils-6.1.0.jar:/Users/pere/.m2/repository/io/confluent/kafka-avro-serializer/6.1.0/kafka-avro-serializer-6.1.0.jar:/Users/pere/.m2/repository/io/confluent/kafka-schema-serializer/6.1.0/kafka-schema-serializer-6.1.0.jar:/Users/pere/.m2/repository/org/apache/avro/avro/1.9.2/avro-1.9.2.jar:/Users/pere/.m2/repository/org/apache/commons/commons-compress/1.19/commons-compress-1.19.jar:/Users/pere/.m2/repository/io/confluent/kafka-json-schema-provider/6.1.0/kafka-json-schema-provider-6.1.0.jar:/Users/pere/.m2/repository/com/github/everit-org/json-schema/org.everit.json.schema/1.12.1/org.everit.json.schema-1.12.1.jar:/Users/pere/.m2/repository/org/json/json/20190722/json-20190722.jar:/Users/pere/.m2/repository/commons-validator/commons-validator/1.6/commons-validator-1.6.jar:/Users/pere/.m2/repository/commons-digester/commons-digester/1.8.1/commons-digester-1.8.1.jar:/Users/pere/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar:/Users/pere/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/Users/pere/.m2/repository/com/damnhandy/handy-uri-templates/2.1.8/handy-uri-templates-2.1.8.jar:/Users/pere/.m2/repository/com/fasterxml/jackson/datatype/jackson-datatype-guava/2.10.5/jackson-datatype-guava-2.10.5.jar:/Users/pere/.m2/repository/com/fasterxml/jackson/datatype/jackson-datatype-joda/2.10.5/jackson-datatype-joda-2.10.5.jar:/Users/pere/.m2/repository/joda-time/joda-time/2.9.9/joda-time-2.9.9.jar:/Users/pere/.m2/repository/com/fasterxml/jackson/module/jackson-module-parameter-names/2.10.5/jackson-module-parameter-names-2.10.5.jar:/Users/pere/.m2/repository/com/kjetland/mbknor-jackson-jsonschema_2.13/1.0.39/mbknor-jackson-jsonschema_2.13-1.0.39.jar:/Users/pere/.m2/repository/org/jetbrains/kotlin/kotlin-scripting-compiler-embeddable/1.3.50/kotlin-scripting-compiler-embeddable-1.3.50.jar:/Users/pere/.m2/repository/org/jetbrains/kotlin/kotlin-scripting-compiler-impl-embeddable/1.3.50/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar:/Users/pere/.m2/repository/org/jetbrains/kotlin/kotlin-scripting-common/1.3.50/kotlin-scripting-common-1.3.50.jar:/Users/pere/.m2/repository/org/jetbrains/kotlin/kotlin-reflect/1.3.50/kotlin-reflect-1.3.50.jar:/Users/pere/.m2/repository/org/jetbrains/kotlin/kotlin-scripting-jvm/1.3.50/kotlin-scripting-jvm-1.3.50.jar:/Users/pere/.m2/repository/org/jetbrains/kotlin/kotlin-script-runtime/1.3.50/kotlin-script-runtime-1.3.50.jar:/Users/pere/.m2/repository/org/jetbrains/kotlinx/kotlinx-coroutines-core/1.1.1/kotlinx-coroutines-core-1.1.1.jar:/Users/pere/.m2/repository/javax/validation/validation-api/2.0.1.Final/validation-api-2.0.1.Final.jar:/Users/pere/.m2/repository/io/github/classgraph/classgraph/4.8.21/classgraph-4.8.21.jar:/Users/pere/.m2/repository/org/jetbrains/kotlin/kotlin-stdlib/1.4.0/kotlin-stdlib-1.4.0.jar:/Users/pere/.m2/repository/org/jetbrains/kotlin/kotlin-stdlib-common/1.4.0/kotlin-stdlib-common-1.4.0.jar:/Users/pere/.m2/repository/org/jetbrains/annotations/13.0/annotations-13.0.jar:/Users/pere/.m2/repository/io/confluent/kafka-protobuf-provider/6.1.0/kafka-protobuf-provider-6.1.0.jar:/Users/pere/.m2/repository/com/squareup/wire/wire-schema/3.2.2/wire-schema-3.2.2.jar:/Users/pere/.m2/repository/org/jetbrains/kotlin/kotlin-stdlib-jdk8/1.3.71/kotlin-stdlib-jdk8-1.3.71.jar:/Users/pere/.m2/repository/org/jetbrains/kotlin/kotlin-stdlib-jdk7/1.3.71/kotlin-stdlib-jdk7-1.3.71.jar:/Users/pere/.m2/repository/com/squareup/wire/wire-runtime/3.2.2/wire-runtime-3.2.2.jar:/Users/pere/.m2/repository/com/squareup/okio/okio/2.5.0/okio-2.5.0.jar:/Users/pere/.m2/repository/com/google/protobuf/protobuf-java/3.15.6/protobuf-java-3.15.6.jar:/Users/pere/.m2/repository/com/google/protobuf/protobuf-java-util/3.15.6/protobuf-java-util-3.15.6.jar:/Users/pere/.m2/repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar:/Users/pere/.m2/repository/org/apache/zookeeper/zookeeper-jute/3.5.7/zookeeper-jute-3.5.7.jar:/Users/pere/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/Users/pere/.m2/repository/io/netty/netty-handler/4.1.45.Final/netty-handler-4.1.45.Final.jar:/Users/pere/.m2/repository/io/netty/netty-common/4.1.45.Final/netty-common-4.1.45.Final.jar:/Users/pere/.m2/repository/io/netty/netty-buffer/4.1.45.Final/netty-buffer-4.1.45.Final.jar:/Users/pere/.m2/repository/io/netty/netty-transport/4.1.45.Final/netty-transport-4.1.45.Final.jar:/Users/pere/.m2/repository/io/netty/netty-codec/4.1.45.Final/netty-codec-4.1.45.Final.jar:/Users/pere/.m2/repository/io/netty/netty-transport-native-epoll/4.1.45.Final/netty-transport-native-epoll-4.1.45.Final.jar:/Users/pere/.m2/repository/io/netty/netty-transport-native-unix-common/4.1.45.Final/netty-transport-native-unix-common-4.1.45.Final.jar:/Users/pere/.m2/repository/org/slf4j/slf4j-log4j12/1.7.25/slf4j-log4j12-1.7.25.jar:/Users/pere/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/Users/pere/.m2/repository/org/apache/kafka/kafka-clients/6.1.0-ce/kafka-clients-6.1.0-ce.jar:/Users/pere/.m2/repository/com/github/luben/zstd-jni/1.4.5-6/zstd-jni-1.4.5-6.jar:/Users/pere/.m2/repository/org/lz4/lz4-java/1.7.1/lz4-java-1.7.1.jar:/Users/pere/.m2/repository/org/xerial/snappy/snappy-java/1.1.7.7/snappy-java-1.1.7.7.jar:/Users/pere/.m2/repository/org/apache/kafka/kafka-streams/6.1.0-ce/kafka-streams-6.1.0-ce.jar:/Users/pere/.m2/repository/org/apache/kafka/connect-json/6.1.0-ce/connect-json-6.1.0-ce.jar:/Users/pere/.m2/repository/org/apache/kafka/connect-api/6.1.0-ce/connect-api-6.1.0-ce.jar:/Users/pere/.m2/repository/org/rocksdb/rocksdbjni/5.18.4/rocksdbjni-5.18.4.jar:/Users/pere/.m2/repository/io/confluent/kafka-client-plugins/6.1.0-ce/kafka-client-plugins-6.1.0-ce.jar:/Users/pere/.m2/repository/io/confluent/rest-authorizer/6.1.0-ce/rest-authorizer-6.1.0-ce.jar:/Users/pere/.m2/repository/io/confluent/authorizer/6.1.0-ce/authorizer-6.1.0-ce.jar:/Users/pere/.m2/repository/org/bitbucket/b_c/jose4j/0.7.2/jose4j-0.7.2.jar:/Users/pere/.m2/repository/org/bouncycastle/bc-fips/1.0.2/bc-fips-1.0.2.jar:/Users/pere/.m2/repository/org/bouncycastle/bcpkix-fips/1.0.3/bcpkix-fips-1.0.3.jar:/Users/pere/.m2/repository/org/bouncycastle/bctls-fips/1.0.10/bctls-fips-1.0.10.jar:/Users/pere/.m2/repository/io/confluent/ksql/ksqldb-api-client/6.1.0/ksqldb-api-client-6.1.0.jar:/Users/pere/.m2/repository/io/confluent/ksql/ksqldb-rest-model/6.1.0/ksqldb-rest-model-6.1.0.jar:/Users/pere/.m2/repository/io/confluent/ksql/ksqldb-common/6.1.0/ksqldb-common-6.1.0.jar:/Users/pere/.m2/repository/io/vertx/vertx-core/3.9.1/vertx-core-3.9.1.jar:/Users/pere/.m2/repository/io/netty/netty-handler-proxy/4.1.49.Final/netty-handler-proxy-4.1.49.Final.jar:/Users/pere/.m2/repository/io/netty/netty-codec-socks/4.1.49.Final/netty-codec-socks-4.1.49.Final.jar:/Users/pere/.m2/repository/io/netty/netty-codec-http/4.1.49.Final/netty-codec-http-4.1.49.Final.jar:/Users/pere/.m2/repository/io/netty/netty-codec-http2/4.1.49.Final/netty-codec-http2-4.1.49.Final.jar:/Users/pere/.m2/repository/io/netty/netty-resolver/4.1.49.Final/netty-resolver-4.1.49.Final.jar:/Users/pere/.m2/repository/io/netty/netty-resolver-dns/4.1.49.Final/netty-resolver-dns-4.1.49.Final.jar:/Users/pere/.m2/repository/io/netty/netty-codec-dns/4.1.49.Final/netty-codec-dns-4.1.49.Final.jar:/Users/pere/.m2/repository/io/vertx/vertx-codegen/3.9.1/vertx-codegen-3.9.1.jar:/Users/pere/.m2/repository/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar:/Users/pere/.m2/repository/io/confluent/confluent-log4j/1.2.17-cp2/confluent-log4j-1.2.17-cp2.jar:/Users/pere/.m2/repository/org/glassfish/jersey/core/jersey-common/2.22.2/jersey-common-2.22.2.jar:/Users/pere/.m2/repository/javax/ws/rs/javax.ws.rs-api/2.0.1/javax.ws.rs-api-2.0.1.jar:/Users/pere/.m2/repository/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.jar:/Users/pere/.m2/repository/org/glassfish/jersey/bundles/repackaged/jersey-guava/2.22.2/jersey-guava-2.22.2.jar:/Users/pere/.m2/repository/org/glassfish/hk2/hk2-api/2.4.0-b34/hk2-api-2.4.0-b34.jar:/Users/pere/.m2/repository/org/glassfish/hk2/hk2-utils/2.4.0-b34/hk2-utils-2.4.0-b34.jar:/Users/pere/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.4.0-b34/aopalliance-repackaged-2.4.0-b34.jar:/Users/pere/.m2/repository/org/glassfish/hk2/external/javax.inject/2.4.0-b34/javax.inject-2.4.0-b34.jar:/Users/pere/.m2/repository/org/glassfish/hk2/hk2-locator/2.4.0-b34/hk2-locator-2.4.0-b34.jar:/Users/pere/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.1/osgi-resource-locator-1.0.1.jar:/Users/pere/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.12.6.1-redhat-00004/jackson-databind-2.12.6.1-redhat-00004.jar:/Users/pere/.m2/repository/com/fasterxml/jackson/dataformat/jackson-dataformat-yaml/2.12.6.redhat-00001/jackson-dataformat-yaml-2.12.6.redhat-00001.jar:/Users/pere/.m2/repository/org/yaml/snakeyaml/1.27.0.redhat-00001/snakeyaml-1.27.0.redhat-00001.jar:/Users/pere/.m2/repository/com/fasterxml/jackson/datatype/jackson-datatype-jsr310/2.12.6.redhat-00001/jackson-datatype-jsr310-2.12.6.redhat-00001.jar:/Users/pere/.m2/repository/com/fasterxml/jackson/datatype/jackson-datatype-jdk8/2.12.6.redhat-00001/jackson-datatype-jdk8-2.12.6.redhat-00001.jar:/Users/pere/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.12.6.redhat-00001/jackson-core-2.12.6.redhat-00001.jar:/Users/pere/.m2/repository/org/apache/logging/log4j/log4j-api/2.17.1/log4j-api-2.17.1.jar:/Users/pere/.m2/repository/org/apache/logging/log4j/log4j-core/2.17.1/log4j-core-2.17.1.jar:/Users/pere/.m2/repository/commons-cli/commons-cli/1.4/commons-cli-1.4.jar:/Users/pere/.m2/repository/software/amazon/awssdk/s3/2.16.31/s3-2.16.31.jar:/Users/pere/.m2/repository/software/amazon/awssdk/aws-xml-protocol/2.16.31/aws-xml-protocol-2.16.31.jar:/Users/pere/.m2/repository/software/amazon/awssdk/aws-query-protocol/2.16.31/aws-query-protocol-2.16.31.jar:/Users/pere/.m2/repository/software/amazon/awssdk/protocol-core/2.16.31/protocol-core-2.16.31.jar:/Users/pere/.m2/repository/software/amazon/awssdk/arns/2.16.31/arns-2.16.31.jar:/Users/pere/.m2/repository/software/amazon/awssdk/profiles/2.16.31/profiles-2.16.31.jar:/Users/pere/.m2/repository/software/amazon/awssdk/sdk-core/2.16.31/sdk-core-2.16.31.jar:/Users/pere/.m2/repository/software/amazon/awssdk/auth/2.16.31/auth-2.16.31.jar:/Users/pere/.m2/repository/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar:/Users/pere/.m2/repository/software/amazon/awssdk/http-client-spi/2.16.31/http-client-spi-2.16.31.jar:/Users/pere/.m2/repository/software/amazon/awssdk/regions/2.16.31/regions-2.16.31.jar:/Users/pere/.m2/repository/software/amazon/awssdk/annotations/2.16.31/annotations-2.16.31.jar:/Users/pere/.m2/repository/software/amazon/awssdk/utils/2.16.31/utils-2.16.31.jar:/Users/pere/.m2/repository/software/amazon/awssdk/aws-core/2.16.31/aws-core-2.16.31.jar:/Users/pere/.m2/repository/software/amazon/awssdk/metrics-spi/2.16.31/metrics-spi-2.16.31.jar:/Users/pere/.m2/repository/software/amazon/awssdk/apache-client/2.16.31/apache-client-2.16.31.jar:/Users/pere/.m2/repository/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar:/Users/pere/.m2/repository/org/apache/httpcomponents/httpcore/4.4.11/httpcore-4.4.11.jar:/Users/pere/.m2/repository/software/amazon/awssdk/netty-nio-client/2.16.31/netty-nio-client-2.16.31.jar:/Users/pere/.m2/repository/io/netty/netty-transport-native-epoll/4.1.60.Final/netty-transport-native-epoll-4.1.60.Final-linux-x86_64.jar:/Users/pere/.m2/repository/com/typesafe/netty/netty-reactive-streams-http/2.0.4/netty-reactive-streams-http-2.0.4.jar:/Users/pere/.m2/repository/com/typesafe/netty/netty-reactive-streams/2.0.4/netty-reactive-streams-2.0.4.jar:/Users/pere/.m2/repository/com/google/cloud/google-cloud-storage/1.113.14/google-cloud-storage-1.113.14.jar:/Users/pere/.m2/repository/com/google/guava/failureaccess/1.0.1/failureaccess-1.0.1.jar:/Users/pere/.m2/repository/com/google/guava/listenablefuture/9999.0-empty-to-avoid-conflict-with-guava/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/Users/pere/.m2/repository/com/google/code/findbugs/jsr305/3.0.2/jsr305-3.0.2.jar:/Users/pere/.m2/repository/org/checkerframework/checker-compat-qual/2.5.5/checker-compat-qual-2.5.5.jar:/Users/pere/.m2/repository/com/google/errorprone/error_prone_annotations/2.5.1/error_prone_annotations-2.5.1.jar:/Users/pere/.m2/repository/com/google/j2objc/j2objc-annotations/1.3/j2objc-annotations-1.3.jar:/Users/pere/.m2/repository/com/google/http-client/google-http-client/1.39.1/google-http-client-1.39.1.jar:/Users/pere/.m2/repository/io/opencensus/opencensus-contrib-http-util/0.28.0/opencensus-contrib-http-util-0.28.0.jar:/Users/pere/.m2/repository/com/google/http-client/google-http-client-jackson2/1.39.1/google-http-client-jackson2-1.39.1.jar:/Users/pere/.m2/repository/com/google/api-client/google-api-client/1.31.3/google-api-client-1.31.3.jar:/Users/pere/.m2/repository/com/google/oauth-client/google-oauth-client/1.31.4/google-oauth-client-1.31.4.jar:/Users/pere/.m2/repository/com/google/http-client/google-http-client-gson/1.39.1/google-http-client-gson-1.39.1.jar:/Users/pere/.m2/repository/com/google/http-client/google-http-client-apache-v2/1.39.1/google-http-client-apache-v2-1.39.1.jar:/Users/pere/.m2/repository/com/google/apis/google-api-services-storage/v1-rev20210127-1.31.0/google-api-services-storage-v1-rev20210127-1.31.0.jar:/Users/pere/.m2/repository/com/google/code/gson/gson/2.8.6/gson-2.8.6.jar:/Users/pere/.m2/repository/com/google/cloud/google-cloud-core/1.94.4/google-cloud-core-1.94.4.jar:/Users/pere/.m2/repository/com/google/auto/value/auto-value-annotations/1.7.4/auto-value-annotations-1.7.4.jar:/Users/pere/.m2/repository/com/google/api/grpc/proto-google-common-protos/2.1.0/proto-google-common-protos-2.1.0.jar:/Users/pere/.m2/repository/com/google/cloud/google-cloud-core-http/1.94.4/google-cloud-core-http-1.94.4.jar:/Users/pere/.m2/repository/com/google/http-client/google-http-client-appengine/1.39.1/google-http-client-appengine-1.39.1.jar:/Users/pere/.m2/repository/com/google/api/gax-httpjson/0.79.0/gax-httpjson-0.79.0.jar:/Users/pere/.m2/repository/com/google/api/gax/1.62.0/gax-1.62.0.jar:/Users/pere/.m2/repository/com/google/auth/google-auth-library-credentials/0.25.2/google-auth-library-credentials-0.25.2.jar:/Users/pere/.m2/repository/com/google/auth/google-auth-library-oauth2-http/0.25.2/google-auth-library-oauth2-http-0.25.2.jar:/Users/pere/.m2/repository/com/google/api/api-common/1.10.1/api-common-1.10.1.jar:/Users/pere/.m2/repository/io/opencensus/opencensus-api/0.28.0/opencensus-api-0.28.0.jar:/Users/pere/.m2/repository/io/grpc/grpc-context/1.36.0/grpc-context-1.36.0.jar:/Users/pere/.m2/repository/com/google/api/grpc/proto-google-iam-v1/1.0.11/proto-google-iam-v1-1.0.11.jar:/Users/pere/.m2/repository/org/threeten/threetenbp/1.5.0/threetenbp-1.5.0.jar:/Users/pere/.m2/repository/org/hamcrest/hamcrest-core/2.2/hamcrest-core-2.2.jar:/Users/pere/.m2/repository/org/hamcrest/hamcrest/2.2/hamcrest-2.2.jar:/Users/pere/.m2/repository/org/hamcrest/hamcrest-library/2.2/hamcrest-library-2.2.jar:/Users/pere/.m2/repository/org/mockito/mockito-core/3.6.0/mockito-core-3.6.0.jar:/Users/pere/.m2/repository/net/bytebuddy/byte-buddy/1.10.15/byte-buddy-1.10.15.jar:/Users/pere/.m2/repository/net/bytebuddy/byte-buddy-agent/1.10.15/byte-buddy-agent-1.10.15.jar:/Users/pere/.m2/repository/org/objenesis/objenesis/3.1/objenesis-3.1.jar:/Users/pere/.m2/repository/junit/junit/4.13.1/junit-4.13.1.jar:/Users/pere/.m2/repository/org/testcontainers/testcontainers/1.15.3/testcontainers-1.15.3.jar:/Users/pere/.m2/repository/org/rnorth/duct-tape/duct-tape/1.0.8/duct-tape-1.0.8.jar:/Users/pere/.m2/repository/org/rnorth/visible-assertions/visible-assertions/2.1.2/visible-assertions-2.1.2.jar:/Users/pere/.m2/repository/net/java/dev/jna/jna/5.2.0/jna-5.2.0.jar:/Users/pere/.m2/repository/com/github/docker-java/docker-java-api/3.2.8/docker-java-api-3.2.8.jar:/Users/pere/.m2/repository/com/github/docker-java/docker-java-transport-zerodep/3.2.8/docker-java-transport-zerodep-3.2.8.jar:/Users/pere/.m2/repository/com/github/docker-java/docker-java-transport/3.2.8/docker-java-transport-3.2.8.jar:/Users/pere/.m2/repository/org/assertj/assertj-core/3.15.0/assertj-core-3.15.0.jar:/Users/pere/.m2/repository/org/awaitility/awaitility/4.0.3/awaitility-4.0.3.jar:/Users/pere/.m2/repository/io/findify/s3mock_2.13/0.2.6/s3mock_2.13-0.2.6.jar:/Users/pere/.m2/repository/org/scala-lang/scala-library/2.13.2/scala-library-2.13.2.jar:/Users/pere/.m2/repository/com/typesafe/akka/akka-stream_2.13/2.5.31/akka-stream_2.13-2.5.31.jar:/Users/pere/.m2/repository/com/typesafe/akka/akka-actor_2.13/2.5.31/akka-actor_2.13-2.5.31.jar:/Users/pere/.m2/repository/org/scala-lang/modules/scala-java8-compat_2.13/0.9.0/scala-java8-compat_2.13-0.9.0.jar:/Users/pere/.m2/repository/com/typesafe/akka/akka-protobuf_2.13/2.5.31/akka-protobuf_2.13-2.5.31.jar:/Users/pere/.m2/repository/com/typesafe/ssl-config-core_2.13/0.3.8/ssl-config-core_2.13-0.3.8.jar:/Users/pere/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.13/1.1.2/scala-parser-combinators_2.13-1.1.2.jar:/Users/pere/.m2/repository/com/typesafe/akka/akka-http_2.13/10.1.12/akka-http_2.13-10.1.12.jar:/Users/pere/.m2/repository/com/typesafe/akka/akka-http-core_2.13/10.1.12/akka-http-core_2.13-10.1.12.jar:/Users/pere/.m2/repository/com/typesafe/akka/akka-parsing_2.13/10.1.12/akka-parsing_2.13-10.1.12.jar:/Users/pere/.m2/repository/org/scala-lang/modules/scala-xml_2.13/1.3.0/scala-xml_2.13-1.3.0.jar:/Users/pere/.m2/repository/org/scala-lang/modules/scala-collection-compat_2.13/2.1.6/scala-collection-compat_2.13-2.1.6.jar:/Users/pere/.m2/repository/com/github/pathikrit/better-files_2.13/3.9.1/better-files_2.13-3.9.1.jar:/Users/pere/.m2/repository/com/typesafe/scala-logging/scala-logging_2.13/3.9.2/scala-logging_2.13-3.9.2.jar:/Users/pere/.m2/repository/org/scala-lang/scala-reflect/2.13.0/scala-reflect-2.13.0.jar:/Users/pere/.m2/repository/com/amazonaws/aws-java-sdk-s3/1.11.294/aws-java-sdk-s3-1.11.294.jar:/Users/pere/.m2/repository/com/amazonaws/aws-java-sdk-kms/1.11.294/aws-java-sdk-kms-1.11.294.jar:/Users/pere/.m2/repository/com/amazonaws/aws-java-sdk-core/1.11.294/aws-java-sdk-core-1.11.294.jar:/Users/pere/.m2/repository/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar:/Users/pere/.m2/repository/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.jar:/Users/pere/.m2/repository/com/amazonaws/jmespath-java/1.11.294/jmespath-java-1.11.294.jar:/Users/pere/.m2/repository/org/iq80/leveldb/leveldb/0.12/leveldb-0.12.jar:/Users/pere/.m2/repository/org/iq80/leveldb/leveldb-api/0.12/leveldb-api-0.12.jar:/Users/pere/.m2/repository/javax/xml/bind/jaxb-api/2.3.1/jaxb-api-2.3.1.jar:/Users/pere/.m2/repository/javax/activation/javax.activation-api/1.2.0/javax.activation-api-1.2.0.jar:/Users/pere/.m2/repository/com/github/tomakehurst/wiremock-jre8/2.33.1/wiremock-jre8-2.33.1.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-server/9.4.46.v20220331/jetty-server-9.4.46.v20220331.jar:/Users/pere/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-http/9.4.46.v20220331/jetty-http-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-io/9.4.46.v20220331/jetty-io-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-servlet/9.4.46.v20220331/jetty-servlet-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-security/9.4.46.v20220331/jetty-security-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-util-ajax/9.4.46.v20220331/jetty-util-ajax-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-servlets/9.4.46.v20220331/jetty-servlets-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-continuation/9.4.46.v20220331/jetty-continuation-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-util/9.4.46.v20220331/jetty-util-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-webapp/9.4.46.v20220331/jetty-webapp-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-xml/9.4.46.v20220331/jetty-xml-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-proxy/9.4.46.v20220331/jetty-proxy-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-client/9.4.46.v20220331/jetty-client-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/http2/http2-server/9.4.46.v20220331/http2-server-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/http2/http2-common/9.4.46.v20220331/http2-common-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/http2/http2-hpack/9.4.46.v20220331/http2-hpack-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-alpn-server/9.4.46.v20220331/jetty-alpn-server-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-alpn-java-server/9.4.46.v20220331/jetty-alpn-java-server-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-alpn-openjdk8-server/9.4.46.v20220331/jetty-alpn-openjdk8-server-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-alpn-java-client/9.4.46.v20220331/jetty-alpn-java-client-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-alpn-client/9.4.46.v20220331/jetty-alpn-client-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/eclipse/jetty/jetty-alpn-openjdk8-client/9.4.46.v20220331/jetty-alpn-openjdk8-client-9.4.46.v20220331.jar:/Users/pere/.m2/repository/org/apache/httpcomponents/client5/httpclient5/5.1.3/httpclient5-5.1.3.jar:/Users/pere/.m2/repository/org/apache/httpcomponents/core5/httpcore5/5.1.3/httpcore5-5.1.3.jar:/Users/pere/.m2/repository/org/apache/httpcomponents/core5/httpcore5-h2/5.1.3/httpcore5-h2-5.1.3.jar:/Users/pere/.m2/repository/commons-codec/commons-codec/1.15/commons-codec-1.15.jar:/Users/pere/.m2/repository/org/xmlunit/xmlunit-core/2.9.0/xmlunit-core-2.9.0.jar:/Users/pere/.m2/repository/jakarta/xml/bind/jakarta.xml.bind-api/2.3.3/jakarta.xml.bind-api-2.3.3.jar:/Users/pere/.m2/repository/jakarta/activation/jakarta.activation-api/1.2.2/jakarta.activation-api-1.2.2.jar:/Users/pere/.m2/repository/org/xmlunit/xmlunit-legacy/2.9.0/xmlunit-legacy-2.9.0.jar:/Users/pere/.m2/repository/org/xmlunit/xmlunit-placeholders/2.9.0/xmlunit-placeholders-2.9.0.jar:/Users/pere/.m2/repository/net/javacrumbs/json-unit/json-unit-core/2.33.0/json-unit-core-2.33.0.jar:/Users/pere/.m2/repository/com/jayway/jsonpath/json-path/2.7.0/json-path-2.7.0.jar:/Users/pere/.m2/repository/net/minidev/json-smart/2.4.7/json-smart-2.4.7.jar:/Users/pere/.m2/repository/net/minidev/accessors-smart/2.4.7/accessors-smart-2.4.7.jar:/Users/pere/.m2/repository/org/ow2/asm/asm/9.3/asm-9.3.jar:/Users/pere/.m2/repository/net/sf/jopt-simple/jopt-simple/5.0.4/jopt-simple-5.0.4.jar:/Users/pere/.m2/repository/com/github/jknack/handlebars/4.3.0/handlebars-4.3.0.jar:/Users/pere/.m2/repository/com/github/jknack/handlebars-helpers/4.3.0/handlebars-helpers-4.3.0.jar:/Users/pere/.m2/repository/commons-fileupload/commons-fileupload/1.4/commons-fileupload-1.4.jar:/Users/pere/.m2/repository/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar com.intellij.rt.junit.JUnitStarter -ideVersion5 -junit4 com.purbon.kafka.topology.integration.RBACPRoviderRbacIT,schemasRbacCreation
log4j:WARN No appenders could be found for logger (org.apache.zookeeper.ZooKeeper).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
[WARN ] 2022-08-01 13:29:04.896 [main] AccessControlManager - Remote state verification disabled, this is not a good practice, be awarein future versions, this check is going to become mandatory.
[WARN ] 2022-08-01 13:29:04.896 [main] AccessControlManager - Remote state verification disabled, this is not a good practice, be awarein future versions, this check is going to become mandatory.
{
  "Operation" : "com.purbon.kafka.topology.actions.access.CreateBindings",
  "Bindings" : [ {
    "resourceType" : "Subject",
    "resourceName" : "bar",
    "host" : "*",
    "operation" : "ResourceOwner",
    "principal" : "User:Schemas",
    "pattern" : "LITERAL",
    "scope" : {
      "clusters" : {
        "kafka-cluster" : "WOncQhSoRJadlekKn_47IQ",
        "schema-registry-cluster" : "schema-registry"
      },
      "resources" : [ {
        "name" : "bar",
        "patternType" : "LITERAL",
        "resourceType" : "Subject"
      } ]
    }
  }, {
    "resourceType" : "Subject",
    "resourceName" : "foo",
    "host" : "*",
    "operation" : "ResourceOwner",
    "principal" : "User:Schemas",
    "pattern" : "LITERAL",
    "scope" : {
      "clusters" : {
        "kafka-cluster" : "WOncQhSoRJadlekKn_47IQ",
        "schema-registry-cluster" : "schema-registry"
      },
      "resources" : [ {
        "name" : "foo",
        "patternType" : "LITERAL",
        "resourceType" : "Subject"
      } ]
    }
  } ]
}
[WARN ] 2022-08-01 13:29:05.767 [main] AccessControlManager - Remote state verification disabled, this is not a good practice, be awarein future versions, this check is going to become mandatory.
[WARN ] 2022-08-01 13:29:05.767 [main] AccessControlManager - Remote state verification disabled, this is not a good practice, be awarein future versions, this check is going to become mandatory.
{
  "Operation" : "com.purbon.kafka.topology.actions.access.CreateBindings",
  "Bindings" : [ {
    "resourceType" : "Subject",
    "resourceName" : "bar",
    "host" : "*",
    "operation" : "ResourceOwner",
    "principal" : "User:Schemas",
    "pattern" : "LITERAL",
    "scope" : {
      "clusters" : {
        "kafka-cluster" : "WOncQhSoRJadlekKn_47IQ",
        "schema-registry-cluster" : "schema-registry"
      },
      "resources" : [ {
        "name" : "bar",
        "patternType" : "LITERAL",
        "resourceType" : "Subject"
      } ]
    }
  }, {
    "resourceType" : "Subject",
    "resourceName" : "foo",
    "host" : "*",
    "operation" : "ResourceOwner",
    "principal" : "User:Schemas",
    "pattern" : "LITERAL",
    "scope" : {
      "clusters" : {
        "kafka-cluster" : "WOncQhSoRJadlekKn_47IQ",
        "schema-registry-cluster" : "schema-registry"
      },
      "resources" : [ {
        "name" : "foo",
        "patternType" : "LITERAL",
        "resourceType" : "Subject"
      } ]
    }
  } ]
}
{
  "Operation" : "com.purbon.kafka.topology.actions.access.ClearBindings",
  "Bindings" : [ {
    "resourceType" : "Subject",
    "resourceName" : "bar",
    "host" : "*",
    "operation" : "ResourceOwner",
    "principal" : "User:Schemas",
    "pattern" : "LITERAL",
    "scope" : {
      "clusters" : {
        "kafka-cluster" : "WOncQhSoRJadlekKn_47IQ",
        "schema-registry-cluster" : "schema-registry"
      },
      "resources" : [ {
        "name" : "bar",
        "patternType" : "LITERAL",
        "resourceType" : "Subject"
      } ]
    }
  }, {
    "resourceType" : "Subject",
    "resourceName" : "foo",
    "host" : "*",
    "operation" : "ResourceOwner",
    "principal" : "User:Schemas",
    "pattern" : "LITERAL",
    "scope" : {
      "clusters" : {
        "kafka-cluster" : "WOncQhSoRJadlekKn_47IQ",
        "schema-registry-cluster" : "schema-registry"
      },
      "resources" : [ {
        "name" : "foo",
        "patternType" : "LITERAL",
        "resourceType" : "Subject"
      } ]
    }
  } ]
}

Process finished with exit code 0
purbon commented 2 years ago

Direct check with the respective cluster:

~/work/gitops/kafka-topology-builder/docker/rbac-sasl on  fix/issue-513! ⌚ 13:34:57
$ confluent iam rbac role-binding list --kafka-cluster-id WOncQhSoRJadlekKn_47IQ --schema-registry-cluster-id schema-registry -
-principal User:Schemas
  Principal | Role | Resource Type | Name | Pattern Type
------------+------+---------------+------+---------------

~/work/gitops/kafka-topology-builder/docker/rbac-sasl on  fix/issue-513! ⌚ 13:35:22
$ confluent iam rbac role-binding list --kafka-cluster-id WOncQhSoRJadlekKn_47IQ --schema-registry-cluster-id schema-registry -
-role ResourceOwner
  Principal
-------------
sverrehu commented 2 years ago

LGTM

purbon commented 2 years ago

merging now. For now, keeping the issue open in case @ludovic-boutros or @damien-malescot are willing to contribute a PR for adding the schema filtering future.