awscc_dms_data_provider DMS doesn't support aurora_postgresql database │ engine

kstephensontm commented 4 months ago

Community Note

Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
If you are interested in working on this issue or have submitted a pull request, please leave a comment
The resources and data sources in this provider are generated from the CloudFormation schema, so they can only support the actions that the underlying schema supports. For this reason submitted bugs should be limited to defects in the generation and runtime code of the provider. Customizing behavior of the resource, or noting a gap in behavior are not valid bugs and should be submitted as enhancements to AWS via the CloudFormation Open Coverage Roadmap.

Terraform CLI and Terraform AWS Cloud Control Provider Version

Affected Resource(s)

awscc_dms_data_provider

Terraform Configuration Files

Please include all Terraform configurations required to reproduce the bug. Bug reports without a functional reproduction may be closed without investigation.

# Copy-paste your Terraform configurations here - for large Terraform configs,
# please use a service like Dropbox and share a link to the ZIP file. For
# security, you can also encrypt the files using our GPG public key: https://keybase.io/hashicorp

Debug Output

Panic Output

resource "awscc_dms_data_provider" "dms_data_provider_target" { data_provider_name = "sc-postgresql2" engine = "aurora_postgresql" settings = { postgre_sql_settings = { database_name = "pssql" port = 5432 server_name = "postgres-default-1.blah.us-west-2.rds.amazonaws.com" ssl_mode = "none" } } }

│ Error: AWS SDK Go Service Operation Incomplete │ │ with awscc_dms_data_provider.dms_data_provider_target, │ on dms-schema-conversion.tf line 39, in resource "awscc_dms_data_provider" "dms_data_provider_target": │ 39: resource "awscc_dms_data_provider" "dms_data_provider_target" { │ │ Waiting for Cloud Control API service CreateResource operation completion returned: waiter │ state transitioned to FAILED. StatusMessage: DMS doesn't support aurora_postgresql database │ engine. Choose another database engine and try again. (Service: DatabaseMigration, Status │ Code: 400, Request ID: a5033be9-0e1c-457a-bd9a-e751af7e224f). ErrorCode: InvalidRequest

Expected Behavior

Create an aurora postgres data provider.

Actual Behavior

Errors that the data provider postrgres aurora doesn't exist.

Steps to Reproduce

terraform apply

Important Factoids

no

References

https://registry.terraform.io/providers/hashicorp/awscc/latest/docs/resources/dms_data_provider

wellsiau-aws commented 4 months ago

@kstephensontm , thank you for reporting this issue.

according to the enumeration from here the right way to specify the engine is as aurora-postgresql.

I realize that Cloudformation documentation also has some inconsistency

Could you try this again using : aurora-postgresql

quixoticmonk commented 4 months ago

@wellsiau-aws I did try this today. The API expects us to use aurora_postgresql

 Error: Invalid Attribute Value Match
│
│   with awscc_dms_data_provider.dms_data_provider_source,
│   on main.tf line 3, in resource "awscc_dms_data_provider" "dms_data_provider_source":
│    3:   engine = "aurora-postgresql"
│
│ Attribute engine value must be one of: ["postgres" "mysql" "oracle" "sqlserver" "aurora"
│ "aurora_postgresql"], got: "aurora-postgresql"

kstephensontm commented 4 months ago

sorry still get an error when putting the correct value ...

resource "awscc_dms_data_provider" "dms_data_provider_target" { data_provider_name = "sc-postgresql2" engine = "aurora_postgresql" settings = { postgre_sql_settings = { database_name = "pssql" port = 5432 server_name = "postgres-default-1.blah.us-west-2.rds.amazonaws.com" ssl_mode = "none" } } }

│ Error: AWS SDK Go Service Operation Incomplete │ │ with awscc_dms_data_provider.dms_data_provider_target, │ on dms-schema-conversion.tf line 39, in resource "awscc_dms_data_provider" "dms_data_provider_target": │ 39: resource "awscc_dms_data_provider" "dms_data_provider_target" { │ │ Waiting for Cloud Control API service CreateResource operation completion returned: waiter │ state transitioned to FAILED. StatusMessage: DMS doesn't support aurora_postgresql database │ engine. Choose another database engine and try again. (Service: DatabaseMigration, Status │ Code: 400, Request ID: 43f51c09-d7ec-4cd7-a75e-6a433ea45de0). ErrorCode: InvalidRequest

kstephensontm commented 4 months ago

hi @quixoticmonk is this a bug that just needs to be fixed for aurora_postgresql?

kstephensontm commented 4 months ago

@quixoticmonk any update on this one?

quixoticmonk commented 3 months ago

@quixoticmonk any update on this one?

Apologies on the delay in responding. I was waiting for the next refresh this week if it did fix the engine listing. I have opened an internal issue against the service team in AWS.

@wellsiau-aws FYI

kstephensontm commented 3 months ago

just tried again with 0.77.0 and still the same error.

│ Error: AWS SDK Go Service Operation Incomplete │ │ with awscc_dms_data_provider.dms_data_provider_target, │ on dms-schema-conversion.tf line 39, in resource "awscc_dms_data_provider" "dms_data_provider_target": │ 39: resource "awscc_dms_data_provider" "dms_data_provider_target" { │ │ Waiting for Cloud Control API service CreateResource operation completion returned: waiter state transitioned to FAILED. │ StatusMessage: DMS doesn't support aurora_postgresql database engine. Choose another database engine and try again. │ (Service: DatabaseMigration, Status Code: 400, Request ID: fb40aa88-d959-44f6-9cfb-83caf0465f8a). ErrorCode: InvalidRequest ╵

wellsiau-aws commented 2 weeks ago

@kstephensontm , thank you for your patience, we just heard about the fix deployed by service team.

do you mind to test it again? since this is a upstream AWS handler issue, I believe you don't need to upgrade the provider.

hashicorp / terraform-provider-awscc