GoogleCloudPlatform / pontem

Open source tools for Google Cloud Storage and Databases.
Apache License 2.0
64 stars 15 forks source link

Dataflow Job failed while running Apache Beam Pipeline #251

Open Eugenemdk opened 5 months ago

Eugenemdk commented 5 months ago

Full error log: Startup of the worker pool in zone europe-west1-c failed to bring up any of the desired 1 workers. Please refer to https://cloud.google.com/dataflow/docs/guides/common-errors#worker-pool-failure for help troubleshooting. ZONE_RESOURCE_POOL_EXHAUSTED: Instance creation failed: The zone 'projects/project/zones/europe-west1-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.

Steps that were previously done to solve an issue:

  1. Changing worker_zone parameter
  2. running under another region
  3. removing worker_zone parameter from PipelineOptions object

Perhaps someone has already encountered such problem, would like to hear an examples of how you have overcome that issue.