search

Altinity / clickhouse-sink-connector

Replicate data from MySQL, Postgres and MongoDB to ClickHouse®
https://www.altinity.com
Apache License 2.0
235 stars 54 forks source link

Building from source fails - could not be resolved: com.altinity:clickhouse-kafka-sink-connector:jar #595

Closed slnw closed 6 months ago

slnw commented 6 months ago

Hi, I don't see ARM64 version in docker hub, maybe i'm missing it? - https://hub.docker.com/layers/altinity/clickhouse-sink-connector/2.0.2-lt/images/sha256-1c0db9877331a0aaceb2e0f2838db3a5156a3cfbfdb83a92235b6287b576c5d0?context=explore

I tried building from source but I get the following error - (tried in ./sink-connector-lightweight and ./ both failed similar)

mvn clean install
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for com.altinity:clickhouse-debezium-embedded:jar:0.0.4
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.commons:commons-lang3:jar -> duplicate declaration of version 3.12.0 @ line 367, column 21
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.junit.jupiter:junit-jupiter-engine:jar -> version ${version.junit} vs 5.8.1 @ line 417, column 21
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.kafka:connect-json:jar -> duplicate declaration of version 3.1.0 @ line 454, column 21
[WARNING] 'dependencies.dependency.scope' for org.junit:junit-bom:pom must be one of [provided, compile, runtime, test, system] but is 'import'. @ line 267, column 20
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO] ------------------------------------------------------------------------
[INFO] Detecting the operating system and CPU architecture
[INFO] ------------------------------------------------------------------------
[INFO] os.detected.name: osx
[INFO] os.detected.arch: aarch_64
[INFO] os.detected.version: 13.5
[INFO] os.detected.version.major: 13
[INFO] os.detected.version.minor: 5
[INFO] os.detected.classifier: osx-aarch_64
[INFO]
[INFO] -------------< com.altinity:clickhouse-debezium-embedded >--------------
[INFO] Building clickhouse-debezium-embedded 0.0.4
[INFO]   from pom.xml
[INFO] --------------------------------[ jar ]---------------------------------
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-api/2.5.0.Beta1/debezium-api-2.5.0.Beta1.pom
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-api/2.5.0.Beta1/debezium-api-2.5.0.Beta1.pom (2.2 kB at 8.7 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-parent/2.5.0.Beta1/debezium-parent-2.5.0.Beta1.pom
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-parent/2.5.0.Beta1/debezium-parent-2.5.0.Beta1.pom (17 kB at 827 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-build-parent/2.5.0.Beta1/debezium-build-parent-2.5.0.Beta1.pom
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-build-parent/2.5.0.Beta1/debezium-build-parent-2.5.0.Beta1.pom (20 kB at 208 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-bom/2.5.0.Beta1/debezium-bom-2.5.0.Beta1.pom
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-bom/2.5.0.Beta1/debezium-bom-2.5.0.Beta1.pom (31 kB at 327 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-core/2.5.0.Beta1/debezium-core-2.5.0.Beta1.pom
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-core/2.5.0.Beta1/debezium-core-2.5.0.Beta1.pom (5.3 kB at 59 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-embedded/2.5.0.Beta1/debezium-embedded-2.5.0.Beta1.pom
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-embedded/2.5.0.Beta1/debezium-embedded-2.5.0.Beta1.pom (3.8 kB at 41 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-api/3.6.0/connect-api-3.6.0.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-api/3.6.0/connect-api-3.6.0.pom (1.6 kB at 160 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-runtime/3.6.0/connect-runtime-3.6.0.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-runtime/3.6.0/connect-runtime-3.6.0.pom (4.8 kB at 402 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-json/3.6.0/connect-json-3.6.0.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-json/3.6.0/connect-json-3.6.0.pom (1.8 kB at 228 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-transforms/3.6.0/connect-transforms-3.6.0.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-transforms/3.6.0/connect-transforms-3.6.0.pom (1.4 kB at 204 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/bitbucket/b_c/jose4j/0.9.3/jose4j-0.9.3.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/bitbucket/b_c/jose4j/0.9.3/jose4j-0.9.3.pom (8.9 kB at 738 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-server/9.4.52.v20230823/jetty-server-9.4.52.v20230823.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-server/9.4.52.v20230823/jetty-server-9.4.52.v20230823.pom (3.4 kB at 427 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-project/9.4.52.v20230823/jetty-project-9.4.52.v20230823.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-project/9.4.52.v20230823/jetty-project-9.4.52.v20230823.pom (73 kB at 3.5 MB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/9.4.52.v20230823/jetty-http-9.4.52.v20230823.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/9.4.52.v20230823/jetty-http-9.4.52.v20230823.pom (4.0 kB at 448 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/9.4.52.v20230823/jetty-util-9.4.52.v20230823.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/9.4.52.v20230823/jetty-util-9.4.52.v20230823.pom (4.0 kB at 448 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/9.4.52.v20230823/jetty-io-9.4.52.v20230823.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/9.4.52.v20230823/jetty-io-9.4.52.v20230823.pom (1.2 kB at 155 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-servlet/9.4.52.v20230823/jetty-servlet-9.4.52.v20230823.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-servlet/9.4.52.v20230823/jetty-servlet-9.4.52.v20230823.pom (2.3 kB at 206 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-security/9.4.52.v20230823/jetty-security-9.4.52.v20230823.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-security/9.4.52.v20230823/jetty-security-9.4.52.v20230823.pom (2.1 kB at 150 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util-ajax/9.4.52.v20230823/jetty-util-ajax-9.4.52.v20230823.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util-ajax/9.4.52.v20230823/jetty-util-ajax-9.4.52.v20230823.pom (1.3 kB at 140 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-servlets/9.4.52.v20230823/jetty-servlets-9.4.52.v20230823.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-servlets/9.4.52.v20230823/jetty-servlets-9.4.52.v20230823.pom (2.6 kB at 219 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-continuation/9.4.52.v20230823/jetty-continuation-9.4.52.v20230823.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-continuation/9.4.52.v20230823/jetty-continuation-9.4.52.v20230823.pom (952 B at 119 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-client/9.4.52.v20230823/jetty-client-9.4.52.v20230823.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-client/9.4.52.v20230823/jetty-client-9.4.52.v20230823.pom (5.1 kB at 510 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-file/3.6.0/connect-file-3.6.0.pom
Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-file/3.6.0/connect-file-3.6.0.pom (1.4 kB at 16 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-ddl-parser/2.5.0.Beta1/debezium-ddl-parser-2.5.0.Beta1.pom
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-ddl-parser/2.5.0.Beta1/debezium-ddl-parser-2.5.0.Beta1.pom (6.2 kB at 64 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-connector-mysql/2.5.0.Beta1/debezium-connector-mysql-2.5.0.Beta1.pom
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-connector-mysql/2.5.0.Beta1/debezium-connector-mysql-2.5.0.Beta1.pom (69 kB at 6.3 MB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-storage-kafka/2.5.0.Beta1/debezium-storage-kafka-2.5.0.Beta1.pom
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-storage-kafka/2.5.0.Beta1/debezium-storage-kafka-2.5.0.Beta1.pom (1.3 kB at 15 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-storage/2.5.0.Beta1/debezium-storage-2.5.0.Beta1.pom
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-storage/2.5.0.Beta1/debezium-storage-2.5.0.Beta1.pom (1.2 kB at 14 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-storage-file/2.5.0.Beta1/debezium-storage-file-2.5.0.Beta1.pom
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-storage-file/2.5.0.Beta1/debezium-storage-file-2.5.0.Beta1.pom (1.3 kB at 15 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/com/zendesk/mysql-binlog-connector-java/0.29.0/mysql-binlog-connector-java-0.29.0.pom
Downloaded from central: https://repo.maven.apache.org/maven2/com/zendesk/mysql-binlog-connector-java/0.29.0/mysql-binlog-connector-java-0.29.0.pom (8.1 kB at 623 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/com/mysql/mysql-connector-j/8.0.33/mysql-connector-j-8.0.33.pom
Downloaded from central: https://repo.maven.apache.org/maven2/com/mysql/mysql-connector-j/8.0.33/mysql-connector-j-8.0.33.pom (3.2 kB at 353 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-connector-postgres/2.5.0.Beta1/debezium-connector-postgres-2.5.0.Beta1.pom
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-connector-postgres/2.5.0.Beta1/debezium-connector-postgres-2.5.0.Beta1.pom (22 kB at 2.8 MB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-connector-mongodb/2.5.0.Beta1/debezium-connector-mongodb-2.5.0.Beta1.pom
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-connector-mongodb/2.5.0.Beta1/debezium-connector-mongodb-2.5.0.Beta1.pom (16 kB at 188 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-storage-jdbc/2.5.0.Beta1/debezium-storage-jdbc-2.5.0.Beta1.pom
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-storage-jdbc/2.5.0.Beta1/debezium-storage-jdbc-2.5.0.Beta1.pom (7.4 kB at 79 kB/s)
[WARNING] The POM for com.altinity:clickhouse-kafka-sink-connector:jar:0.0.8 is missing, no dependency information available
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-api/2.5.0.Beta1/debezium-api-2.5.0.Beta1.jar
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-api/2.5.0.Beta1/debezium-api-2.5.0.Beta1.jar (28 kB at 303 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-core/2.5.0.Beta1/debezium-core-2.5.0.Beta1.jar
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-embedded/2.5.0.Beta1/debezium-embedded-2.5.0.Beta1.jar
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-runtime/3.6.0/connect-runtime-3.6.0.jar
Downloading from central: https://repo.maven.apache.org/maven2/org/bitbucket/b_c/jose4j/0.9.3/jose4j-0.9.3.jar
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-transforms/3.6.0/connect-transforms-3.6.0.jar
Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-transforms/3.6.0/connect-transforms-3.6.0.jar (109 kB at 2.2 MB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-servlets/9.4.52.v20230823/jetty-servlets-9.4.52.v20230823.jar
Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-servlets/9.4.52.v20230823/jetty-servlets-9.4.52.v20230823.jar (108 kB at 1.6 MB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-continuation/9.4.52.v20230823/jetty-continuation-9.4.52.v20230823.jar
Downloaded from central: https://repo.maven.apache.org/maven2/org/bitbucket/b_c/jose4j/0.9.3/jose4j-0.9.3.jar (298 kB at 4.3 MB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-client/9.4.52.v20230823/jetty-client-9.4.52.v20230823.jar
Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-continuation/9.4.52.v20230823/jetty-continuation-9.4.52.v20230823.jar (25 kB at 298 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-file/3.6.0/connect-file-3.6.0.jar
Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-runtime/3.6.0/connect-runtime-3.6.0.jar (726 kB at 7.7 MB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-ddl-parser/2.5.0.Beta1/debezium-ddl-parser-2.5.0.Beta1.jar
Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-client/9.4.52.v20230823/jetty-client-9.4.52.v20230823.jar (328 kB at 3.2 MB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-connector-mysql/2.5.0.Beta1/debezium-connector-mysql-2.5.0.Beta1.jar
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-embedded/2.5.0.Beta1/debezium-embedded-2.5.0.Beta1.jar (57 kB at 459 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-storage-kafka/2.5.0.Beta1/debezium-storage-kafka-2.5.0.Beta1.jar
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-core/2.5.0.Beta1/debezium-core-2.5.0.Beta1.jar (1.2 MB at 7.6 MB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-storage-file/2.5.0.Beta1/debezium-storage-file-2.5.0.Beta1.jar
Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/kafka/connect-file/3.6.0/connect-file-3.6.0.jar (18 kB at 106 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/com/zendesk/mysql-binlog-connector-java/0.29.0/mysql-binlog-connector-java-0.29.0.jar
Downloaded from central: https://repo.maven.apache.org/maven2/com/zendesk/mysql-binlog-connector-java/0.29.0/mysql-binlog-connector-java-0.29.0.jar (216 kB at 1.0 MB/s)
Downloading from central: https://repo.maven.apache.org/maven2/com/mysql/mysql-connector-j/8.0.33/mysql-connector-j-8.0.33.jar
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-connector-mysql/2.5.0.Beta1/debezium-connector-mysql-2.5.0.Beta1.jar (341 kB at 1.6 MB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-connector-postgres/2.5.0.Beta1/debezium-connector-postgres-2.5.0.Beta1.jar
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-storage-kafka/2.5.0.Beta1/debezium-storage-kafka-2.5.0.Beta1.jar (16 kB at 70 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-connector-mongodb/2.5.0.Beta1/debezium-connector-mongodb-2.5.0.Beta1.jar
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-storage-file/2.5.0.Beta1/debezium-storage-file-2.5.0.Beta1.jar (6.4 kB at 24 kB/s)
Downloading from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-storage-jdbc/2.5.0.Beta1/debezium-storage-jdbc-2.5.0.Beta1.jar
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-ddl-parser/2.5.0.Beta1/debezium-ddl-parser-2.5.0.Beta1.jar (3.1 MB at 9.2 MB/s)
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-connector-postgres/2.5.0.Beta1/debezium-connector-postgres-2.5.0.Beta1.jar (375 kB at 1.1 MB/s)
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-storage-jdbc/2.5.0.Beta1/debezium-storage-jdbc-2.5.0.Beta1.jar (23 kB at 61 kB/s)
Downloaded from central: https://repo.maven.apache.org/maven2/io/debezium/debezium-connector-mongodb/2.5.0.Beta1/debezium-connector-mongodb-2.5.0.Beta1.jar (254 kB at 653 kB/s)
Downloaded from central: https://repo.maven.apache.org/maven2/com/mysql/mysql-connector-j/8.0.33/mysql-connector-j-8.0.33.jar (2.5 MB at 5.0 MB/s)
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  2.806 s
[INFO] Finished at: 2024-05-15T15:46:53+01:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project clickhouse-debezium-embedded: Could not resolve dependencies for project com.altinity:clickhouse-debezium-embedded:jar:0.0.4: The following artifacts could not be resolved: com.altinity:clickhouse-kafka-sink-connector:jar:0.0.8 (absent): com.altinity:clickhouse-kafka-sink-connector:jar:0.0.8 was not found in https://repo.maven.apache.org/maven2 during a previous attempt. This failure was cached in the local repository and resolution is not reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

Thanks,

subkanthi commented 6 months ago

Hi @slnw , please check the instructions here https://github.com/Altinity/clickhouse-sink-connector/blob/develop/doc/development.md

The sink-connector library needs to built first before building sink-connector-lightweight

slnw commented 6 months ago

hey, yeah I tried it. still fails - 

cd clickhouse-sink-connector/
cd sink-connector
mvn install -DskipTests=true
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for com.altinity:clickhouse-kafka-sink-connector:jar:0.0.8
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.kafka:connect-json:jar -> duplicate declaration of version 3.1.0 @ line 423, column 21
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO] Inspecting build with total of 1 modules...
[INFO] Installing Nexus Staging features:
[INFO]   ... total of 1 executions of maven-deploy-plugin replaced with nexus-staging-maven-plugin
[INFO]
[INFO] ------------< com.altinity:clickhouse-kafka-sink-connector >------------
[INFO] Building ClickHouse Kafka Sink Connector 0.0.8
[INFO]   from pom.xml
[INFO] --------------------------------[ jar ]---------------------------------
[WARNING] The artifact org.slf4j:slf4j-log4j12:jar:2.0.11 has been relocated to org.slf4j:slf4j-reload4j:jar:2.0.11
[INFO]
[INFO] --- jacoco:0.8.2:prepare-agent (pre-unit-test) @ clickhouse-kafka-sink-connector ---
[INFO] argLine set to -javaagent:/Users/slainewilley/.m2/repository/org/jacoco/org.jacoco.agent/0.8.2/org.jacoco.agent-0.8.2-runtime.jar=destfile=/private/tmp/clickhouse-sink-connector/sink-connector/target/jacoco-ut.exec
[INFO]
[INFO] --- resources:3.3.1:resources (default-resources) @ clickhouse-kafka-sink-connector ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] Copying 1 resource from src/main/resources to target/classes
[INFO]
[INFO] --- compiler:3.11.0:compile (default-compile) @ clickhouse-kafka-sink-connector ---
[INFO] Changes detected - recompiling the module! :source
[WARNING] File encoding has not been set, using platform encoding UTF-8, i.e. build is platform dependent!
[INFO] Compiling 52 source files with javac [debug target 11] to target/classes
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  1.855 s
[INFO] Finished at: 2024-05-16T09:20:03+01:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.11.0:compile (default-compile) on project clickhouse-kafka-sink-connector: Fatal error compiling: java.lang.NoSuchFieldError: Class com.sun.tools.javac.tree.JCTree$JCImport does not have member field 'com.sun.tools.javac.tree.JCTree qualid' -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

with -X

[WARNING] File encoding has not been set, using platform encoding UTF-8, i.e. build is platform dependent!
[DEBUG] incrementalBuildHelper#beforeRebuildExecution
[INFO] Compiling 52 source files with javac [debug target 11] to target/classes
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  1.616 s
[INFO] Finished at: 2024-05-16T09:20:43+01:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.11.0:compile (default-compile) on project clickhouse-kafka-sink-connector: Fatal error compiling: java.lang.NoSuchFieldError: Class com.sun.tools.javac.tree.JCTree$JCImport does not have member field 'com.sun.tools.javac.tree.JCTree qualid' -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.11.0:compile (default-compile) on project clickhouse-kafka-sink-connector: Fatal error compiling
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:333)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:316)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:212)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:174)
    at org.apache.maven.lifecycle.internal.MojoExecutor.access$000 (MojoExecutor.java:75)
    at org.apache.maven.lifecycle.internal.MojoExecutor$1.run (MojoExecutor.java:162)
    at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute (DefaultMojosExecutionStrategy.java:39)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:159)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:105)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:73)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:53)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:118)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:906)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:283)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:206)
    at jdk.internal.reflect.DirectMethodHandleAccessor.invoke (DirectMethodHandleAccessor.java:103)
    at java.lang.reflect.Method.invoke (Method.java:580)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:283)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:226)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:407)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:348)
Caused by: org.apache.maven.plugin.MojoExecutionException: Fatal error compiling
    at org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute (AbstractCompilerMojo.java:1143)
    at org.apache.maven.plugin.compiler.CompilerMojo.execute (CompilerMojo.java:193)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:126)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:328)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:316)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:212)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:174)
    at org.apache.maven.lifecycle.internal.MojoExecutor.access$000 (MojoExecutor.java:75)
    at org.apache.maven.lifecycle.internal.MojoExecutor$1.run (MojoExecutor.java:162)
    at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute (DefaultMojosExecutionStrategy.java:39)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:159)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:105)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:73)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:53)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:118)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:906)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:283)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:206)
    at jdk.internal.reflect.DirectMethodHandleAccessor.invoke (DirectMethodHandleAccessor.java:103)
    at java.lang.reflect.Method.invoke (Method.java:580)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:283)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:226)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:407)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:348)
Caused by: org.codehaus.plexus.compiler.CompilerException: java.lang.NoSuchFieldError: Class com.sun.tools.javac.tree.JCTree$JCImport does not have member field 'com.sun.tools.javac.tree.JCTree qualid'
    at org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess (JavaxToolsCompiler.java:198)
    at org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile (JavacCompiler.java:183)
    at org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute (AbstractCompilerMojo.java:1140)
    at org.apache.maven.plugin.compiler.CompilerMojo.execute (CompilerMojo.java:193)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:126)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:328)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:316)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:212)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:174)
    at org.apache.maven.lifecycle.internal.MojoExecutor.access$000 (MojoExecutor.java:75)
    at org.apache.maven.lifecycle.internal.MojoExecutor$1.run (MojoExecutor.java:162)
    at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute (DefaultMojosExecutionStrategy.java:39)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:159)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:105)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:73)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:53)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:118)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:906)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:283)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:206)
    at jdk.internal.reflect.DirectMethodHandleAccessor.invoke (DirectMethodHandleAccessor.java:103)
    at java.lang.reflect.Method.invoke (Method.java:580)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:283)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:226)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:407)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:348)
Caused by: java.lang.RuntimeException: java.lang.NoSuchFieldError: Class com.sun.tools.javac.tree.JCTree$JCImport does not have member field 'com.sun.tools.javac.tree.JCTree qualid'
    at com.sun.tools.javac.api.JavacTaskImpl.invocationHelper (JavacTaskImpl.java:168)
    at com.sun.tools.javac.api.JavacTaskImpl.doCall (JavacTaskImpl.java:100)
    at com.sun.tools.javac.api.JavacTaskImpl.call (JavacTaskImpl.java:94)
    at org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess (JavaxToolsCompiler.java:136)
    at org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile (JavacCompiler.java:183)
    at org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute (AbstractCompilerMojo.java:1140)
    at org.apache.maven.plugin.compiler.CompilerMojo.execute (CompilerMojo.java:193)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:126)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:328)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:316)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:212)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:174)
    at org.apache.maven.lifecycle.internal.MojoExecutor.access$000 (MojoExecutor.java:75)
    at org.apache.maven.lifecycle.internal.MojoExecutor$1.run (MojoExecutor.java:162)
    at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute (DefaultMojosExecutionStrategy.java:39)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:159)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:105)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:73)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:53)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:118)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:906)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:283)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:206)
    at jdk.internal.reflect.DirectMethodHandleAccessor.invoke (DirectMethodHandleAccessor.java:103)
    at java.lang.reflect.Method.invoke (Method.java:580)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:283)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:226)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:407)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:348)
Caused by: java.lang.NoSuchFieldError: Class com.sun.tools.javac.tree.JCTree$JCImport does not have member field 'com.sun.tools.javac.tree.JCTree qualid'
    at lombok.javac.JavacImportList.getFullyQualifiedNameForSimpleNameNoAliasing (JavacImportList.java:53)
    at lombok.core.TypeResolver.typeRefToFullyQualifiedName (TypeResolver.java:60)
    at lombok.javac.HandlerLibrary.handleAnnotation (HandlerLibrary.java:247)
    at lombok.javac.JavacTransformer$AnnotationVisitor.visitAnnotationOnField (JavacTransformer.java:84)
    at lombok.javac.JavacNode.traverse (JavacNode.java:135)
    at lombok.javac.JavacAST.traverseChildren (JavacAST.java:222)
    at lombok.javac.JavacNode.traverse (JavacNode.java:100)
    at lombok.javac.JavacAST.traverseChildren (JavacAST.java:222)
    at lombok.javac.JavacNode.traverse (JavacNode.java:95)
    at lombok.javac.JavacAST.traverseChildren (JavacAST.java:222)
    at lombok.javac.JavacNode.traverse (JavacNode.java:90)
    at lombok.javac.JavacAST.traverse (JavacAST.java:218)
    at lombok.javac.JavacTransformer.transform (JavacTransformer.java:63)
    at lombok.javac.apt.LombokProcessor.process (LombokProcessor.java:328)
    at lombok.core.AnnotationProcessor$JavacDescriptor.process (AnnotationProcessor.java:187)
    at lombok.core.AnnotationProcessor.process (AnnotationProcessor.java:241)
    at lombok.launch.AnnotationProcessorHider$AnnotationProcessor.process (AnnotationProcessor.java:90)
    at com.sun.tools.javac.processing.JavacProcessingEnvironment.callProcessor (JavacProcessingEnvironment.java:1021)
    at com.sun.tools.javac.processing.JavacProcessingEnvironment.discoverAndRunProcs (JavacProcessingEnvironment.java:937)
    at com.sun.tools.javac.processing.JavacProcessingEnvironment$Round.run (JavacProcessingEnvironment.java:1265)
    at com.sun.tools.javac.processing.JavacProcessingEnvironment.doProcessing (JavacProcessingEnvironment.java:1380)
    at com.sun.tools.javac.main.JavaCompiler.processAnnotations (JavaCompiler.java:1272)
    at com.sun.tools.javac.main.JavaCompiler.compile (JavaCompiler.java:946)
    at com.sun.tools.javac.api.JavacTaskImpl.lambda$doCall$0 (JavacTaskImpl.java:104)
    at com.sun.tools.javac.api.JavacTaskImpl.invocationHelper (JavacTaskImpl.java:152)
    at com.sun.tools.javac.api.JavacTaskImpl.doCall (JavacTaskImpl.java:100)
    at com.sun.tools.javac.api.JavacTaskImpl.call (JavacTaskImpl.java:94)
    at org.codehaus.plexus.compiler.javac.JavaxToolsCompiler.compileInProcess (JavaxToolsCompiler.java:136)
    at org.codehaus.plexus.compiler.javac.JavacCompiler.performCompile (JavacCompiler.java:183)
    at org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute (AbstractCompilerMojo.java:1140)
    at org.apache.maven.plugin.compiler.CompilerMojo.execute (CompilerMojo.java:193)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:126)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:328)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:316)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:212)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:174)
    at org.apache.maven.lifecycle.internal.MojoExecutor.access$000 (MojoExecutor.java:75)
    at org.apache.maven.lifecycle.internal.MojoExecutor$1.run (MojoExecutor.java:162)
    at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute (DefaultMojosExecutionStrategy.java:39)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:159)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:105)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:73)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:53)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:118)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:906)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:283)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:206)
    at jdk.internal.reflect.DirectMethodHandleAccessor.invoke (DirectMethodHandleAccessor.java:103)
    at java.lang.reflect.Method.invoke (Method.java:580)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:283)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:226)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:407)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:348)
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[DEBUG] Shutting down adapter factory; available factories [file-lock, rwlock-local, semaphore-local, noop]; available name mappers [discriminating, file-gav, file-hgav, file-static, gav, static]
[DEBUG] Shutting down 'file-lock' factory
[DEBUG] Shutting down 'rwlock-local' factory
[DEBUG] Shutting down 'semaphore-local' factory
[DEBUG] Shutting down 'noop' factory
subkanthi commented 6 months ago

It looks like a JDK error, I personally use openJDK 17 on ubuntu


java --version
openjdk 17.0.10 2024-01-16
OpenJDK Runtime Environment (build 17.0.10+7-Ubuntu-122.04.1)
OpenJDK 64-Bit Server VM (build 17.0.10+7-Ubuntu-122.04.1, mixed mode, sharing)
slnw commented 6 months ago

Solved it, leaving here a solution if any one running on mac - brew install mvn installs by default JDK v21 even if you install JDK 17 on system, you need

brew install openjdk@17
export JAVA_HOME=/opt/homebrew/Cellar/openjdk@17/17.0.11/libexec/openjdk.jdk/Contents/Home/
mvn -v
# verify it's actual openjdk 17 used and continue with steps

@subkanthi - thank you for helping me with it.

subkanthi commented 6 months ago

Thanks @slnw , updated documentation with your instructions.