Open Rizxcviii opened 9 months ago
AWS::Glue::Job
No response
There is now an ability to create visual ETL workflows through the SDK, by using the CodeGenConfigurationNodes option. My use case is working with other data engineers who prefer the visual implementation of Glue, rather than Spark directly.
CodeGenConfigurationNodes
https://docs.aws.amazon.com/glue/latest/dg/visual-job-api-chapter.html
https://docs.aws.amazon.com/glue/latest/dg/aws-glue-api-visual-job-api.html#aws-glue-api-visual-job-api-CodeGenConfigurationNode
I did link another ticket that tackled this issue. It was 'shipped', but the option never appears for this
Name of the resource
AWS::Glue::Job
Resource name
No response
Description
There is now an ability to create visual ETL workflows through the SDK, by using the
CodeGenConfigurationNodes
option. My use case is working with other data engineers who prefer the visual implementation of Glue, rather than Spark directly.Other Details
https://docs.aws.amazon.com/glue/latest/dg/visual-job-api-chapter.html
https://docs.aws.amazon.com/glue/latest/dg/aws-glue-api-visual-job-api.html#aws-glue-api-visual-job-api-CodeGenConfigurationNode