hashicorp / terraform-provider-google

Terraform Provider for Google Cloud Platform
https://registry.terraform.io/providers/hashicorp/google/latest/docs
Mozilla Public License 2.0
2.33k stars 1.73k forks source link

Add support for creating Data Mapper Mapping Pipeline for data source BigQuery #19223

Open ashwinsshetty opened 2 months ago

ashwinsshetty commented 2 months ago

Community Note

Description

GCP Healthcare Data Engine(HDE) is a solution built using GCP Healthcare API to harmonize healthcare data into a patient-centric longitudinal patient record. This is achieved using Long Running Operation(LRO) pipelines for mapping/reconciliation for data sources like BigQuery, Spanner, FHIR etc.

Add Terraform support to create Data Mapper Long Running Operation(LRO) Mapping Pipeline for data source BigQuery.

New or Affected Resource(s)

google_healthcare_pipeline_job

Potential Terraform Configuration

resource "google_healthcare_pipeline_job" "default" {
  name  = "example-pipeline-job",
  disable_lineage = true,
  mapping_pipeline_job {
    mapping_config {
      data_mapper_config_source {
        gcs {
          uri_prefix = "gs://path-to-data-mapper-configurations"
        },
        mapping = "data-mapper-mapping-name"
      }
    },
    bigquery_source {
      bigquery_dataset = "projects/project-id/datasets/bigquery-dataset-id"
    },
    fhirStore_destination = "projects/project-id/locations/location/datasets/dataset_id/fhirStores/destination-fhir-store-id"
  }
}

References

https://cloud.google.com/healthcare-api/healthcare-data-engine/docs/reference/rest/v1/projects.locations.datasets.pipelineJobs

b/362278191

melinath commented 2 months ago

Note from triage: This is currently in alpha