Open SVD81Tech opened 7 years ago
ewencp
commented
7 years ago The maven setting you used should work fine. Maven caches when it fails to find an artifact, so it may continue to fail until that cache expires. You can for maven to check for the artifacts again by including -U in your maven command line.
SVD81Tech
commented
7 years ago i passed this hurdle but now i have the next one. my seet up is Mavne - 3.03 Java version: 1.8.0_73 OS- windows building - https://github.com/confluentinc/examples
and weirdly i am now getting below compilation error samlog.txt
some of my team members having the same issue. when i checked my local m2 repo i found out the Abstract.Config.class is present in the common-config-2.01.jar under .m2\repository\io\confluent\common-config\2.0.1 but i think it is looking for the class in .m2\repository\io\confluent\common-config\3.1.2\common-config-3.1.2.jar and unfortunately its not pulling this jar. i have no clue whats happening.
i tried cleaning the local repo, downloading the code samples using zip and git ssh and http methods. Also tried upgrading the maven to 3.3
but that didnt help. i asked 2 more team members and they were stuck with the prior issue.
ewencp
commented
7 years ago What branch of the examples repository do you have checked out and what version do you see in the POM file? Neither version is listed in the classpath used when compiling, but everything else is. Also, the log doesn't show it trying to download the jar, which would indicate it thinks the required jar is already available locally in your .m2 directory.
SVD81Tech
commented
7 years ago I tried building the 3.1x and3.1x-table-table-join branches and master. Also when i am building these applications i started with blank local m2 repo (took back up of my existing repo).
i know it wont matter but even i tried building first the samples under client package and then stream and then vice versa. one interesting thing i observed is when i clean up the local repo and try building the stream project maven doesnt even download the Common.config or common jars in the local repo. after the stream project build i only have kafka-avro-serializer, kafka-schema-registry, kafka-schema-registry-client these jars downloaded under the io.confluent.... in locla repo
When i build the client projects 1st or 2nd it would download the common.config but only the older version 2.0.1 and not the 3.1.2 jars and i am guessing thats the issue. what i am surprised to see is the class io.confluent.common.config.AbstractConfig is already present in the 2.0.1 then why is it complianing
Still the same issue :(
So here is my problem
I followed the steps on the links http://docs.confluent.io/3.1.2/quickstart.html and http://docs.confluent.io/3.1.2/app-development.html now to run the sample and do some hands on locally on the java platform i wanted to pull all the confluent jars (even though they are there in the downloaded confluent package ). my company has a nexus repo which doesnt have these jars hence i add the repo in my local maven settings.xml
<repositories> <repository> <id>confluent</id> <url>http://packages.confluent.io/maven/</url> </repository> </repositories>but it didnt help.i think i am looking for a online mirror which i can hook up in my m2 settings.xml so that after my company nexus repo maven will try and download the jars from remote repo.
I also tried installing the required jars one by one in my local repo using below command
mvn install:install-file -Dfile=C:\jars\kafka-avro-serializer-1.0.1.jar -DgroupId=io.confluent -DartifactId=kafka-avro-serializer -Dversion=3.1.2 -Dpackaging=jar
but i dont have patience and time to do this for all the jars
F1 F1 F1 :( :( .
either i am super silly or i am hoping the kafkens / confluent folks will make this little addition to the documentation. Looks like many people have faced similar issue. Thanks in advance the error i am getting while building the sample examples
C:\Kafka\poc\examples-3.1.x\kafka-streams>mvn -e clean install -Dmaven.test.skip Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0 [INFO] Error stacktraces are turned on. [INFO] Scanning for projects... [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building streams-examples 3.1.2 [INFO] ------------------------------------------------------------------------ [WARNING] The POM for io.confluent:kafka-schema-registry-client:jar:3.1.2 is missing, no dependency information available [WARNING] The POM for org.apache.kafka:kafka-clients:jar:0.10.1.1-cp1 is missing, no dependency information available [WARNING] The POM for org.apache.kafka:kafka-streams:jar:0.10.1.1-cp1 is missing, no dependency information available [WARNING] The POM for org.apache.kafka:kafka_2.11:jar:0.10.1.1-cp1 is missing, no dependency information available [WARNING] The POM for org.apache.kafka:kafka_2.11:jar:test:0.10.1.1-cp1 is missing, no dependency information available [WARNING] The POM for org.apache.kafka:kafka-clients:jar:test:0.10.1.1-cp1 is missing, no dependency information available [WARNING] The POM for io.confluent:kafka-schema-registry:jar:3.1.2 is missing, no dependency information available [WARNING] The POM for io.confluent:kafka-schema-registry:jar:tests:3.1.2 is missing, no dependency information available [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1.529s [INFO] Finished at: Wed Feb 01 10:57:23 EST 2017 [INFO] Final Memory: 8M/150M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal on project streams-examples: Could not resolve dependencies for project io.confluent:streams-examples:jar:3.1.2: The fo llowing artifacts could not be resolved: io.confluent:kafka-schema-registry-client:jar:3.1.2, org.apache.kafka:kafka-clients:jar:0.10.1.1-cp1, org.apa che.kafka:kafka-streams:jar:0.10.1.1-cp1, org.apache.kafka:kafka_2.11:jar:0.10.1.1-cp1, org.apache.kafka:kafka_2.11:jar:test:0.10.1.1-cp1, org.apache. kafka:kafka-clients:jar:test:0.10.1.1-cp1, io.confluent:kafka-schema-registry:jar:3.1.2, io.confluent:kafka-schema-registry:jar:tests:3.1.2: Failure t o find io.confluent:kafka-schema-registry-client:jar:3.1.2 in http://nexus.sys.cigna.com/nexus/content/groups/public was cached in the local repositor y, resolution will not be reattempted until the update interval of cigna-nexus has elapsed or updates are forced -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal on project streams-examples: Could not resolve dependencies for project io.confluent:streams-examples:jar:3.1.2: The following artifacts could not be resolved: io.confluent:kafka-schema-registry-client:jar:3.1.2, org.apac he.kafka:kafka-clients:jar:0.10.1.1-cp1, org.apache.kafka:kafka-streams:jar:0.10.1.1-cp1, org.apache.kafka:kafka_2.11:jar:0.10.1.1-cp1, org.apache.kaf ka:kafka_2.11:jar:test:0.10.1.1-cp1, org.apache.kafka:kafka-clients:jar:test:0.10.1.1-cp1, io.confluent:kafka-schema-registry:jar:3.1.2, io.confluent: kafka-schema-registry:jar:tests:3.1.2: Failure to find io.confluent:kafka-schema-registry-client:jar:3.1.2 in http://nexus.sys.cigna.com/nexus/content /groups/public was cached in the local repository, resolution will not be reattempted until the update interval of cigna-nexus has elapsed or updates are forced at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:196) at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies(LifecycleDependencyResolver.java:108) at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved(MojoExecutor.java:258) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:201) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196) at org.apache.maven.cli.MavenCli.main(MavenCli.java:141) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352) Caused by: org.apache.maven.project.DependencyResolutionException: Could not resolve dependencies for project io.confluent:streams-examples:jar:3.1.2: The following artifacts could not be resolved: io.confluent:kafka-schema-registry-client:jar:3.1.2, org.apache.kafka:kafka-clients:jar:0.10.1.1-cp1, org.apache.kafka:kafka-streams:jar:0.10.1.1-cp1, org.apache.kafka:kafka_2.11:jar:0.10.1.1-cp1, org.apache.kafka:kafka_2.11:jar:test:0.10.1.1-cp1, org. apache.kafka:kafka-clients:jar:test:0.10.1.1-cp1, io.confluent:kafka-schema-registry:jar:3.1.2, io.confluent:kafka-schema-registry:jar:tests:3.1.2: Fa ilure to find io.confluent:kafka-schema-registry-client:jar:3.1.2 in http://nexus.sys.cigna.com/nexus/content/groups/public was cached in the local re pository, resolution will not be reattempted until the update interval of cigna-nexus has elapsed or updates are forced at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:170) at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:171) ... 22 more Caused by: org.sonatype.aether.resolution.DependencyResolutionException: The following artifacts could not be resolved: io.confluent:kafka-schema-regi stry-client:jar:3.1.2, org.apache.kafka:kafka-clients:jar:0.10.1.1-cp1, org.apache.kafka:kafka-streams:jar:0.10.1.1-cp1, org.apache.kafka:kafka_2.11:j ar:0.10.1.1-cp1, org.apache.kafka:kafka_2.11:jar:test:0.10.1.1-cp1, org.apache.kafka:kafka-clients:jar:test:0.10.1.1-cp1, io.confluent:kafka-schema-re gistry:jar:3.1.2, io.confluent:kafka-schema-registry:jar:tests:3.1.2: Failure to find io.confluent:kafka-schema-registry-client:jar:3.1.2 in http://ne xus.sys.cigna.com/nexus/content/groups/public was cached in the local repository, resolution will not be reattempted until the update interval of cign a-nexus has elapsed or updates are forced at org.sonatype.aether.impl.internal.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:412) at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:164) ... 23 more Caused by: org.sonatype.aether.resolution.ArtifactResolutionException: The following artifacts could not be resolved: io.confluent:kafka-schema-regist ry-client:jar:3.1.2, org.apache.kafka:kafka-clients:jar:0.10.1.1-cp1, org.apache.kafka:kafka-streams:jar:0.10.1.1-cp1, org.apache.kafka:kafka_2.11:jar :0.10.1.1-cp1, org.apache.kafka:kafka_2.11:jar:test:0.10.1.1-cp1, org.apache.kafka:kafka-clients:jar:test:0.10.1.1-cp1, io.confluent:kafka-schema-regi stry:jar:3.1.2, io.confluent:kafka-schema-registry:jar:tests:3.1.2: Failure to find io.confluent:kafka-schema-registry-client:jar:3.1.2 in http://nexu s.sys.cigna.com/nexus/content/groups/public was cached in the local repository, resolution will not be reattempted until the update interval of cigna- nexus has elapsed or updates are forced at org.sonatype.aether.impl.internal.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:541) at org.sonatype.aether.impl.internal.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:220) at org.sonatype.aether.impl.internal.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:395) ... 24 more Caused by: org.sonatype.aether.transfer.ArtifactNotFoundException: Failure to find io.confluent:kafka-schema-registry-client:jar:3.1.2 in http://nexus .sys.cigna.com/nexus/content/groups/public was cached in the local repository, resolution will not be reattempted until the update interval of cigna-n exus has elapsed or updates are forced at org.sonatype.aether.impl.internal.DefaultUpdateCheckManager.checkArtifact(DefaultUpdateCheckManager.java:190) at org.sonatype.aether.impl.internal.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:430) ... 26 more [ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException