Support for compression/format in azurerm_data_factory_dataset_azure_blob

[SimonGasparKentico]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Terraform (and AzureRM Provider) Version

Terraform 0.12.29 AzureRM 2.26.0

Affected Resource(s)

• azurerm_data_factory_dataset_azure_blob

Description

Now there is no option to set compression or format for azurerm_data_factory_dataset_azure_blob.

Potential Terraform Configuration

I want to set compression and format blocks for blob's dataset. Something like this

resource "azurerm_data_factory_dataset_azure_blob" "example" {
  name                = "name"
  resource_group_name = "resource_group_name"
  data_factory_name   = "data_factory_name"
  linked_service_name = "linked_service_name"

  compression = {
    type  = "GZip"
    level = "Optimal"
  }

  format = {
    type        = "JsonFormat"
    filePattern = "setOfObjects"
 }

  path     = "path"
  filename = "filename"
}

References

Azure REST Api

[taljundi]

You could use azurerm_data_factory_dataset_delimited_text if you want

resource "azurerm_data_factory_dataset_delimited_text" "core" {
  name                = "example"
  data_factory_id     = azurerm_data_factory.core.id
  linked_service_name = azurerm_data_factory_linked_service_azure_blob_storage.core.name

  azure_blob_storage_location {
    container = azurerm_storage_container.population.name
    filename  = azurerm_storage_blob.source-file.name
  }

  compression_codec   = "gzip"
  compression_level   = "Optimal"
  column_delimiter    = "\\t"
  row_delimiter       = "NEW"
  encoding            = "UTF-8"
  quote_character     = "x"
  escape_character    = "f"
  first_row_as_header = true
  null_value          = "NULL"
}