awslabs / aws-glue-libs

AWS Glue Libraries are additions and enhancements to Spark for ETL operations.
Other
635 stars 299 forks source link

Error Category: UNCLASSIFIED_ERROR; An error occurred while calling o111.pyWriteDynamicFrame. ERROR: relation "{table_name}" already exists #198

Open HernanCote opened 8 months ago

HernanCote commented 8 months ago

I am currently encountering an issue while attempting to execute an ETL job aimed at migrating data from a SQL Server database to a Postgres DB. The process consistently fails due to an error whose resolution eludes me. Should I anticipate the existence of the target table and expect to write information onto it, or is there another approach I should consider to address this recurring error?

The script is pretty simple, as it is just a select statement that select the appropriate columns from the source to insert them in the target.