Missing resource BigQuery DataTransfert projects.enrollDataSources

[jnahelou]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request.
• Please do not leave +1 or me too comments, they generate extra noise for issue followers and do not help prioritize the request.
• If you are interested in working on this issue or have submitted a pull request, please leave a comment.
• If an issue is assigned to a user, that user is claiming responsibility for the issue.
• Customers working with a Google Technical Account Manager or Customer Engineer can ask them to reach out internally to expedite investigation and resolution of this issue.

Description

When setting up a BigQuery data transfer job for carbon footprint data, there's an important prerequisite step that isn't mentioned in the official documentation, but can be discovered by examining the audit logs from Cloud Console operations.

Before creating the transfer job, you need to explicitly enable access to carbon footprint data by enrolling the following data source:

serviceName: "bigquerydatatransfer.googleapis.com"
methodName: "google.cloud.bigquery.datatransfer.v1.DataTransferService.EnrollDataSources"
dataSourceIds: [
    "61cede5a-0000-2440-ad42-883d24f8f7b8"
]

If this prerequisite enrollment step is not completed, you will encounter the following error:

Error: Error creating Config: googleapi: Error 400: BigQuery DataTransfer is not enabled for 61cede5a-0000-2440-ad42-883d24f8f7b8.

New or Affected Resource(s)

• google_bigquery_data_transfer_enroll_data_sources

Potential Terraform Configuration

resource "google_bigquery_data_transfer_enroll_data_sources" "carbon" {
  project = "x"
  data_source_ids = ["61cede5a-0000-2440-ad42-883d24f8f7b8"]
}

References

• Google Rest API

b/378508253

[SarahFrench]

Note from triage: We have analogous resources that set project-level settings (e.g. google_project_service ) so this fits into preexisting norms in the provider

[wj-chen]

This could be a new bigquerydatatransfer resource. The BQ Terraform team doesn't have capacity to take in new feature requests in Q4 at this time but we'll bring it into planning for Q1.