search

vdesabou / kafka-docker-playground

🐳✨ Fully automated Apache Kafka® and Confluent Docker based examples // 👷‍♂️ Easily build examples or reproduction models
https://kafka-docker-playground.io
MIT License
662 stars 206 forks source link

🔥 connect/connect-aws-kinesis-source #5947

Open vdesabou opened 5 days ago

vdesabou commented 5 days ago

🆕💥 New issue !

🔥 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-04 18:37 📄 kinesis-source-assuming-iam-role-with-custom-awscredentialsprovider.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11184977891/job/31097215087

👍 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-04 18:40 📄 kinesis-source-proxy.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11184977891/job/31097215087

🔥 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-04 18:42 📄 kinesis-source-with-assuming-iam-role.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11184977891/job/31097215087

👍 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-04 18:45 📄 kinesis-source.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11184977891/job/31097215087

vdesabou commented 4 days ago

🤦‍♂️💥 Still failing !

🔥 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-05 18:33 📄 kinesis-source-assuming-iam-role-with-custom-awscredentialsprovider.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11195345860/job/31123013566

👍 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-04 18:40 📄 kinesis-source-proxy.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11184977891/job/31097215087

🔥 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-05 18:36 📄 kinesis-source-with-assuming-iam-role.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11195345860/job/31123013566

👍 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-04 18:45 📄 kinesis-source.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11184977891/job/31097215087

vdesabou commented 3 days ago

🤦‍♂️💥 Still failing !

🔥 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-06 18:33 📄 kinesis-source-assuming-iam-role-with-custom-awscredentialsprovider.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11204152530/job/31142311972

👍 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-04 18:40 📄 kinesis-source-proxy.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11184977891/job/31097215087

🔥 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-06 18:35 📄 kinesis-source-with-assuming-iam-role.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11204152530/job/31142311972

👍 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-04 18:45 📄 kinesis-source.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11184977891/job/31097215087

vdesabou commented 2 days ago 
[2024-10-06 18:35:37,353] WARN /connectors/kinesis-source/config (org.eclipse.jetty.server.HttpChannel:776)
javax.servlet.ServletException: org.glassfish.jersey.server.ContainerException: java.lang.NoSuchMethodError: 'void com.amazon***.auth.BasicSessionCredentials.<init>(java.lang.String, java.lang.String, java.lang.String, java.lang.String, java.lang.String)'
    at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:410)
    at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
    at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:358)
    at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:311)
    at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
    at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
    at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:554)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
    at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
    at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
    at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
    at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
    at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
    at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
    at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
    at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:234)
    at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:181)
    at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
    at org.eclipse.jetty.server.Server.handle(Server.java:516)
    at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
    at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
    at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
    at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
    at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
    at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
    at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
    at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137)
    at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
    at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
    at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.glassfish.jersey.server.ContainerException: java.lang.NoSuchMethodError: 'void com.amazon***.auth.BasicSessionCredentials.<init>(java.lang.String, java.lang.String, java.lang.String, java.lang.String, java.lang.String)'
    at org.glassfish.jersey.servlet.internal.ResponseWriter.rethrow(ResponseWriter.java:255)
    at org.glassfish.jersey.servlet.internal.ResponseWriter.failure(ResponseWriter.java:237)
    at org.glassfish.jersey.server.ServerRuntime$Responder.process(ServerRuntime.java:438)
    at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:263)
    at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
    at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
    at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
    at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
    at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
    at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
    at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:234)
    at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:684)
    at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
    ... 34 more
Caused by: java.lang.NoSuchMethodError: 'void com.amazon***.auth.BasicSessionCredentials.<init>(java.lang.String, java.lang.String, java.lang.String, java.lang.String, java.lang.String)'
    at com.amazon***.auth.SessionCredentialsHolder.<init>(SessionCredentialsHolder.java:40)
    at com.amazon***.auth.STSAssumeRoleSessionCredentialsProvider.newSession(STSAssumeRoleSessionCredentialsProvider.java:361)
    at com.amazon***.auth.STSAssumeRoleSessionCredentialsProvider.access$000(STSAssumeRoleSessionCredentialsProvider.java:44)
    at com.amazon***.auth.STSAssumeRoleSessionCredentialsProvider$1.call(STSAssumeRoleSessionCredentialsProvider.java:101)
    at com.amazon***.auth.STSAssumeRoleSessionCredentialsProvider$1.call(STSAssumeRoleSessionCredentialsProvider.java:98)
    at com.amazon***.auth.RefreshableTask.refreshValue(RefreshableTask.java:295)
    at com.amazon***.auth.RefreshableTask.blockingRefresh(RefreshableTask.java:251)
    at com.amazon***.auth.RefreshableTask.getValue(RefreshableTask.java:192)
    at com.amazon***.auth.STSAssumeRoleSessionCredentialsProvider.getCredentials(STSAssumeRoleSessionCredentialsProvider.java:329)
    at com.amazon***.auth.STSAssumeRoleSessionCredentialsProvider.getCredentials(STSAssumeRoleSessionCredentialsProvider.java:43)
    at com.amazon***.auth.profile.internal.securitytoken.STSProfileCredentialsServiceProvider.getCredentials(STSProfileCredentialsServiceProvider.java:71)
    at com.amazon***.auth.profile.internal.ProfileAssumeRoleCredentialsProvider.getCredentials(ProfileAssumeRoleCredentialsProvider.java:51)
    at com.amazon***.auth.profile.ProfilesConfigFile.getCredentials(ProfilesConfigFile.java:162)
    at com.amazon***.auth.profile.ProfileCredentialsProvider.getCredentials(ProfileCredentialsProvider.java:161)
    at com.amazon***.auth.AWSCredentialsProviderChain.getCredentials(AWSCredentialsProviderChain.java:118)
    at com.amazon***.http.AmazonHttpClient$RequestExecutor.getCredentialsFromContext(AmazonHttpClient.java:1269)
    at com.amazon***.http.AmazonHttpClient$RequestExecutor.runBeforeRequestHandlers(AmazonHttpClient.java:845)
    at com.amazon***.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:794)
    at com.amazon***.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:781)
    at com.amazon***.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:755)
    at com.amazon***.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:715)
    at com.amazon***.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:697)
    at com.amazon***.http.AmazonHttpClient.execute(AmazonHttpClient.java:561)
    at com.amazon***.http.AmazonHttpClient.execute(AmazonHttpClient.java:541)
    at com.amazon***.services.securitytoken.AWSSecurityTokenServiceClient.doInvoke(AWSSecurityTokenServiceClient.java:1731)
    at com.amazon***.services.securitytoken.AWSSecurityTokenServiceClient.invoke(AWSSecurityTokenServiceClient.java:1698)
    at com.amazon***.services.securitytoken.AWSSecurityTokenServiceClient.invoke(AWSSecurityTokenServiceClient.java:1687)
    at com.amazon***.services.securitytoken.AWSSecurityTokenServiceClient.executeGetCallerIdentity(AWSSecurityTokenServiceClient.java:1298)
    at com.amazon***.services.securitytoken.AWSSecurityTokenServiceClient.getCallerIdentity(AWSSecurityTokenServiceClient.java:1266)
    at io.confluent.connect.kinesis.Validations.validateCredentials(Validations.java:140)
    at io.confluent.connect.kinesis.Validations.validateAll(Validations.java:72)
    at io.confluent.connect.kinesis.KinesisSourceConnector.lambda$validate$0(KinesisSourceConnector.java:117)
    at io.confluent.connect.utils.validators.all.ConfigValidation.lambda$callValidators$0(ConfigValidation.java:222)
    at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:992)
    at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:762)
    at io.confluent.connect.utils.validators.all.ConfigValidation.callValidators(ConfigValidation.java:222)
    at io.confluent.connect.utils.validators.all.ConfigValidation.validate(ConfigValidation.java:182)
    at io.confluent.connect.kinesis.KinesisSourceConnector.validate(KinesisSourceConnector.java:118)
    at org.apache.kafka.connect.runtime.AbstractHerder.validateConnectorConfig(AbstractHerder.java:635)
    at org.apache.kafka.connect.runtime.AbstractHerder.lambda$validateConnectorConfig$7(AbstractHerder.java:491)
    at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
    ... 1 more
vdesabou commented 2 days ago

https://confluent.slack.com/archives/C6TLCLWKU/p1728306626748649

vdesabou commented 2 days ago

🤦‍♂️💥 Still failing !

🔥 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-07 18:40 📄 kinesis-source-assuming-iam-role-with-custom-awscredentialsprovider.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11221567489/job/31192584555

👍 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-04 18:40 📄 kinesis-source-proxy.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11184977891/job/31097215087

🔥 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-07 18:43 📄 kinesis-source-with-assuming-iam-role.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11221567489/job/31192584555

👍 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-04 18:45 📄 kinesis-source.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11184977891/job/31097215087

vdesabou commented 1 day ago

🤦‍♂️💥 Still failing !

🔥 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-08 18:53 📄 kinesis-source-assuming-iam-role-with-custom-awscredentialsprovider.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11241380201/job/31253183061

👍 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-04 18:40 📄 kinesis-source-proxy.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11184977891/job/31097215087

🔥 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-08 18:55 📄 kinesis-source-with-assuming-iam-role.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11241380201/job/31253183061

👍 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-04 18:45 📄 kinesis-source.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11184977891/job/31097215087

vdesabou commented 14 hours ago

🤦‍♂️💥 Still failing !

🔥 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-09 18:37 📄 kinesis-source-assuming-iam-role-with-custom-awscredentialsprovider.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11260792413/job/31313172795

👍 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-04 18:40 📄 kinesis-source-proxy.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11184977891/job/31097215087

🔥 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-09 18:40 📄 kinesis-source-with-assuming-iam-role.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11260792413/job/31313172795

👍 CP 7.7.1 🔢 Connector v1.3.26 (📅 release date 2024-10-04) 🕐 2024-10-04 18:45 📄 kinesis-source.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/11184977891/job/31097215087