search

aws / aws-cdk

The AWS Cloud Development Kit is a framework for defining cloud infrastructure in code
https://aws.amazon.com/cdk
Apache License 2.0
11.52k stars 3.86k forks source link

aws-glue-alpha: add config for "Generate job insights" for Glue Job #22746

Open AlJohri opened 1 year ago

AlJohri commented 1 year ago

Describe the feature

AWS Glue Jobs have an option to "Generate Job Insights". You can see more about it here: https://docs.aws.amazon.com/glue/latest/dg/monitor-job-insights.html

Generate job insights AWS Glue will analyze your job runs and provide insights on how to optimize your jobs and the reasons for job failures.

Use Case

Glue Job already has configs for enableProfilingMetrics, sparkUI, and continuousLogging. We should have one more for the "Generate job insights" config.

Proposed Solution

No response

Other Information

No response

Acknowledgements

CDK version used

2.43.1

Environment details (OS name and version, etc.)

Amazon Linux 2

peterwoodworth commented 1 year ago

It doesn't look to me like this is supported by CloudFormation yet - take a look for yourself to double check!

If it turns out that it isn't supported by cfn yet, it would be best to submit a request in the CloudFormation Coverage Roadmap repository, if one doesn't already exist. We stay up to date with CloudFormation and will first need their support

For now, you may (or may not, I don't see this setting on UpdateJob) be able to bridge this feature gap with an AwsCustomResource to make any API call.