search

GoogleCloudPlatform / DataflowJavaSDK

Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.
http://cloud.google.com/dataflow
855 stars 324 forks source link

Update to Apache Beam, v2.1.0. #597

Closed wcn3 closed 7 years ago

wcn3 commented 7 years ago

Updated the compiler plugin version, and added explicit versioning for the JAR plugin.

okorz001 commented 7 years ago

Did you forget to update beam.version?

wcn3 commented 7 years ago

That appears to be the case. That was not listed as a step in the instructions I was following. There is also an obvious deficiency in that there are no source files associated in this change. I need to address both of these problems.

wcn3 commented 7 years ago

This PR has been updated and should contain all the necessary changes.

lukecwik commented 7 years ago

Travis failed in testing the archetype:

[INFO] [ERROR] /Users/travis/build/GoogleCloudPlatform/DataflowJavaSDK/maven-archetypes/examples/target/test-classes/projects/basic/project/basic/src/main/java/it/pkg/common/WriteOneFilePerWindow.java:[25,44] cannot find symbol
[INFO]   symbol:   class OutputFileHints
[INFO]   location: class org.apache.beam.sdk.io.FileBasedSink
[INFO] [ERROR] /Users/travis/build/GoogleCloudPlatform/DataflowJavaSDK/maven-archetypes/examples/target/test-classes/projects/basic/project/basic/src/main/java/it/pkg/common/WriteOneFilePerWindow.java:[97,40] cannot find symbol
[INFO]   symbol:   class OutputFileHints
[INFO]   location: class it.pkg.common.WriteOneFilePerWindow.PerWindowFiles
[INFO] [ERROR] /Users/travis/build/GoogleCloudPlatform/DataflowJavaSDK/maven-archetypes/examples/target/test-classes/projects/basic/project/basic/src/main/java/it/pkg/common/WriteOneFilePerWindow.java:[113,41] cannot find symbol
[INFO]   symbol:   class OutputFileHints
[INFO]   location: class it.pkg.common.WriteOneFilePerWindow.PerWindowFiles