Closed hoaiff closed 4 months ago
@hoaiff upgraded iceberg version to 1.5.0 could you give it another try?
do you have the iceberg-hive-metastore artifact with the deployment? https://mvnrepository.com/artifact/org.apache.iceberg/iceberg-hive-metastore
Thanks @ismailsimsek for reply
upgraded iceberg version to 1.5.0 could you give it another try?
I built the latest pom file but face still the same problem. Besides, I checked the jar files in the lib folder, I found that the version of spark and jackson are not similar in pom file.
This morning, I edited only one version of Iceberg in the pom file and built it into docker image with versions: 1.4.2, and 1.4.3. I tried to run images locally, on my server and pc of my partner:
@hoaiff iceberg 1.4.* versions using jackson 2.14.2. somehow this project was pulling 2.15.3
merged a fix. now latest release is having same jackson version as iceberg (2.14.2).
@ismailsimsek, I built again your latest fixing, jackson 2.14.2 was pulled but the same error still This is full log file: full_log.log This is application.properties file application.txt
@ismailsimsek I face the same problem, the error randomly appears in different environments. I pulled the latest code but the error still exists.
@hoaiff @quydx aligned the iceberg runtime library and other libs. Any chance to test it again?
@ismailsimsek I tried your latest fixing but it doesn't work. I still receive the same error.
Hi @ismailsimsek, I built the image again and tested it. It seems to work well, but randomly env still error about log (maybe conflict version between SLF4J and Logback)
08:22:34.869 [pool-7-thread-1] INFO io.debezium.server.iceberg.offset.IcebergOffsetBackingStore - Stopped IcebergOffsetBackingStore table:test1.debezium_offset_storage_custom_table
Exception in thread "pool-7-thread-1" java.lang.NoSuchMethodError: 'boolean ch.qos.logback.core.util.OptionHelper.isNotEmtpy(java.lang.Object[])'
at ch.qos.logback.classic.spi.ThrowableProxy.<init>(ThrowableProxy.java:100)
at ch.qos.logback.classic.spi.ThrowableProxy.<init>(ThrowableProxy.java:63)
at ch.qos.logback.classic.spi.LoggingEvent.<init>(LoggingEvent.java:119)
at ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:419)
at ch.qos.logback.classic.Logger.filterAndLog_0_Or3Plus(Logger.java:383)
at ch.qos.logback.classic.Logger.error(Logger.java:538)
at io.debezium.server.ConnectorLifecycle.handle(ConnectorLifecycle.java:87)
at io.debezium.server.ConnectorLifecycle_ClientProxy.handle(Unknown Source)
at io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:500)
at io.debezium.embedded.ConvertingEngineBuilder$1.run(ConvertingEngineBuilder.java:248)
at io.debezium.server.DebeziumServer.lambda$start$1(DebeziumServer.java:170)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
08:22:34.911 [main] INFO io.debezium.server.DebeziumServer - Received request to stop the engine
08:22:34.911 [main] INFO io.debezium.embedded.EmbeddedEngine - Stopping the embedded engine
2024-03-04 08:22:34,955 INFO [io.quarkus] (main) debezium-server-iceberg-dist stopped in 0.085s
@hoaiff thank you for the feedback i will check
@ismailsimsek, I tried to run on my K8s env and appeared error about the log as I commented above Full log cdc-865fc5d76c-sdfqg_cdc.log
@hoaiff this should be fixed now #289
Great, @ismailsimsek, thank you so much. I tested it on different environments, and it works well
Thank you @hoaiff for testing and the feedback
Hi, I built a docker image cdc from dockerfile on the repo. I ran it on local without any error but when I ran in server, I received an error as title. In addition, I tried to image on k8s env, and I faced with similar problem This is a detail error: