BigQueryIO.Read needs a GCS temp location to store temp files.

GoogleCloudPlatform / DataflowJavaSDK

Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.

http://cloud.google.com/dataflow

855 stars 324 forks source link

BigQueryIO.Read needs a GCS temp location to store temp files. #542

Closed demousteven closed 7 years ago

demousteven commented 7 years ago

I keep on having this problem when executing BigQueryTornadoes : this is my config file : mvn compile exec:java \ -Dexec.mainClass=com.google.cloud.dataflow.examples.cookbook.BigQueryTornadoes \ -Dexec.args="--project=dev6celbux \ --output=dev6celbux:dev6celbux.Count_table\ --tempLocation=gs://project_autocomplete/BigQueryTornadoes/temp --stagingLocation=gs://project_autocomplete/BigQueryTornadoes/staging --runner=BlockingDataflowPipelineRunner"

davorbonaci commented 7 years ago

Can you please comment more on the specific problem you are seeing?

davorbonaci commented 7 years ago

Sounds like a duplicate of #541. Closing.