Create google_dataproc_workflow_template without job

[cloudifyme]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment. If the issue is assigned to the "modular-magician" user, it is either in the process of being autogenerated, or is planned to be autogenerated soon. If the issue is assigned to a user, that user is claiming responsibility for the issue. If the issue is assigned to "hashibot", a community member has claimed the issue already.

Description

In GCP, the dataproc workflow templates can be created without attaching the jobs. Later the jobs can be attached and template can be instantiated. As the API of dataproc workflow template has been changed, need enhancement to the terraform module to allow dataproc workflow template creation without attaching the job.

Current behaviour:

Attaching a job is mandatory in Terraform while creating dataproc_workflow_template resource.

Error: Insufficient jobs blocks
on dataproc-workflow.tf line 2, in resource "google_dataproc_workflow_template" "template":
resource "google_dataproc_workflow_template" "template" {
At least 1 "jobs" blocks are required.

Previously a bug was raised to fix this issue but due to API changes, enhancement request has been raised to fix this problem. Bug Link: https://github.com/hashicorp/terraform-provider-google/issues/12783

New or Affected Resource(s)

• google_dataproc_workflow_template

Potential Terraform Configuration

resource "google_dataproc_workflow_template" "template" {
  name = "test-tfe-example1"
  location = "us-central1"
  project  = "test-project"
  placement {
    managed_cluster {
      cluster_name = "test-bucket"
      config {
          staging_bucket = "test-bucket-staging"
          temp_bucket    = "test-bucket-temp"
        gce_cluster_config {
          internal_ip_only       = true
          zone = "us-central1-a"
          tags = ["foo", "bar"]
        }
        endpoint_config {
      enable_http_port_access = "false"
    }
      }
    }
  } 
}

References

• https://registry.terraform.io/providers/hashicorp/google/latest/docs/resources/dataproc_workflow_template#jobs

• b/298503703

[rileykarson]

@melinath to triage

[rileykarson]

google_dataproc_workflow_template is an unusual resource, given it creates a template and then kicks it off. I'm not sure how useful this resource would end up being; there's probably some design thinking in implementing it.