search

GoogleCloudPlatform / DataflowJavaSDK

Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.
http://cloud.google.com/dataflow
855 stars 325 forks source link

Dependency conflicts #611

Open elharo opened 6 years ago

elharo commented 6 years ago

Running mvn package on the starter archetype I see:

[INFO] Including org.hamcrest:hamcrest-core:jar:1.3 in the shaded jar.
[WARNING] proto-google-common-protos-0.1.9.jar, proto-google-longrunning-v1-0.1.11.jar, grpc-google-common-protos-0.1.0.jar define 28 overlapping classes: 
[WARNING]   - com.google.longrunning.ListOperationsRequestOrBuilder
[WARNING]   - com.google.longrunning.ListOperationsRequest$Builder
[WARNING]   - com.google.longrunning.OperationsProto$1
[WARNING]   - com.google.longrunning.OperationOrBuilder
[WARNING]   - com.google.longrunning.ListOperationsResponseOrBuilder
[WARNING]   - com.google.longrunning.DeleteOperationRequestOrBuilder
[WARNING]   - com.google.longrunning.DeleteOperationRequest$1
[WARNING]   - com.google.longrunning.CancelOperationRequest$1
[WARNING]   - com.google.longrunning.GetOperationRequest
[WARNING]   - com.google.longrunning.Operation$2
[WARNING]   - 18 more...
[WARNING] beam-sdks-java-core-2.1.0.jar, beam-sdks-java-extensions-google-cloud-platform-core-2.1.0.jar define 1 overlapping classes: 
[WARNING]   - org.apache.beam.sdk.util.package-info
[WARNING] proto-google-common-protos-0.1.9.jar, grpc-google-common-protos-0.1.0.jar define 352 overlapping classes: 
[WARNING]   - com.google.api.Logging
[WARNING]   - com.google.api.Usage$1
[WARNING]   - com.google.rpc.ResourceInfoOrBuilder
[WARNING]   - com.google.api.AuthProvider$1
[WARNING]   - com.google.api.ProjectProperties$Builder
[WARNING]   - com.google.api.DocumentationProto
[WARNING]   - com.google.type.TimeOfDayOrBuilder
[WARNING]   - com.google.api.MonitoringOrBuilder
[WARNING]   - com.google.api.Authentication$Builder
[WARNING]   - com.google.api.Monitoring
[WARNING]   - 342 more...
[WARNING] grpc-google-iam-v1-0.1.0.jar, proto-google-iam-v1-0.1.11.jar define 28 overlapping classes: 
[WARNING]   - com.google.iam.v1.Binding$1
[WARNING]   - com.google.iam.v1.Policy$Builder
[WARNING]   - com.google.iam.v1.PolicyProto
[WARNING]   - com.google.iam.v1.IamPolicyProto
[WARNING]   - com.google.iam.v1.Binding
[WARNING]   - com.google.iam.v1.TestIamPermissionsResponseOrBuilder
[WARNING]   - com.google.iam.v1.TestIamPermissionsResponse$Builder
[WARNING]   - com.google.iam.v1.PolicyProto$1
[WARNING]   - com.google.iam.v1.SetIamPolicyRequest$1
[WARNING]   - com.google.iam.v1.GetIamPolicyRequest$1
[WARNING]   - 18 more...
[WARNING] grpc-google-longrunning-v1-0.1.11.jar, grpc-google-common-protos-0.1.0.jar define 7 overlapping classes: 
[WARNING]   - com.google.longrunning.OperationsGrpc$OperationsStub
[WARNING]   - com.google.longrunning.OperationsGrpc$1
[WARNING]   - com.google.longrunning.OperationsGrpc$OperationsFutureStub
[WARNING]   - com.google.longrunning.OperationsGrpc$OperationsImplBase
[WARNING]   - com.google.longrunning.OperationsGrpc$OperationsBlockingStub
[WARNING]   - com.google.longrunning.OperationsGrpc
[WARNING]   - com.google.longrunning.OperationsGrpc$MethodHandlers
[WARNING] hamcrest-all-1.3.jar, hamcrest-core-1.3.jar define 45 overlapping classes: 
[WARNING]   - org.hamcrest.TypeSafeDiagnosingMatcher
[WARNING]   - org.hamcrest.Description
[WARNING]   - org.hamcrest.core.StringContains
[WARNING]   - org.hamcrest.MatcherAssert
[WARNING]   - org.hamcrest.Condition$Step
[WARNING]   - org.hamcrest.SelfDescribing
[WARNING]   - org.hamcrest.core.IsCollectionContaining
[WARNING]   - org.hamcrest.Condition$1
[WARNING]   - org.hamcrest.core.IsSame
[WARNING]   - org.hamcrest.BaseDescription
[WARNING]   - 35 more...
[WARNING] maven-shade-plugin has detected that some class files are
[WARNING] present in two or more JARs. When this happens, only one
[WARNING] single version of the class is copied to the uber jar.
[WARNING] Usually this is not harmful and you can skip these warnings,
[WARNING] otherwise try to manually exclude artifacts based on
[WARNING] mvn dependency:tree -Ddetail=true and the above output.
[WARNING] See http://maven.apache.org/plugins/maven-shade-plugin/
[INFO] Replacing /Users/elharo/workspaces/runtime-gcloud-eclipse/gf/target/gf-bundled-0.0.1-SNAPSHOT.jar with /Users/elharo/workspaces/runtime-gcloud-eclipse/gf/target/gf-0.0.1-SNAPSHOT-shaded.jar

We can probably cut some of the dependencies, perhaps upgrade others, and maybe push upstream to fix a few of these.