Both the Queue and Crawler should deploy and the Crawler should use the RecrawlPolicy to only crawl the relevant files.
Observed Behavior
Error message:
"eventTime": "2023-11-08T16:52:48Z",
"eventSource": "glue.amazonaws.com",
"eventName": "CreateCrawler",
"awsRegion": "eu-west-1",
"sourceIPAddress": "cloudformation.amazonaws.com",
"userAgent": "cloudformation.amazonaws.com",
"errorCode": "InvalidInputException",
"errorMessage": "SQS queue arn:aws:sqs:eu-west-1:<account>:<recource> does not exist or the role provided does not have access to it.",
"requestParameters": {
"role": "arn:aws:iam::<account>:role/<resource>",
"schedule": "cron(15 17 ? * FRI *)",
Test Cases
Deploying in a single template fails
Deploying the queue first and then the crawler works fine, but deploying them at the same time fails.
Adding a dependency to the crawler on the queue also doesn't work
Other Details
Spoken to AWS technical support (Case ID 14257963701) who said there was an internal ticket, but suggested raising a bug here too
Name of the resource
AWS::Glue::Crawler
Resource Name
No response
Issue Description
Created a Glue crawler and an SQS queue to push S3 event notifications with associated permissions in a single template.
Expected Behavior
Both the Queue and Crawler should deploy and the Crawler should use the RecrawlPolicy to only crawl the relevant files.
Observed Behavior
Error message:
Test Cases
Deploying in a single template fails Deploying the queue first and then the crawler works fine, but deploying them at the same time fails. Adding a dependency to the crawler on the queue also doesn't work
Other Details
Spoken to AWS technical support (Case ID 14257963701) who said there was an internal ticket, but suggested raising a bug here too