Both the Queue and Crawler should deploy and the Crawler should use the RecrawlPolicy to only crawl the relevant files.
Observed Behavior
Error message:
"eventTime": "2023-11-08T16:52:48Z",
"eventSource": "glue.amazonaws.com",
"eventName": "CreateCrawler",
"awsRegion": "eu-west-1",
"sourceIPAddress": "cloudformation.amazonaws.com",
"userAgent": "cloudformation.amazonaws.com",
"errorCode": "InvalidInputException",
"errorMessage": "SQS queue arn:aws:sqs:eu-west-1:<account>:<recource> does not exist or the role provided does not have access to it.",
"requestParameters": {
"role": "arn:aws:iam::<account>:role/<resource>",
"schedule": "cron(15 17 ? * FRI *)",
Test Cases
Deploying in a single template fails
Deploying the queue first and then the crawler works fine, but deploying them at the same time fails.
Adding a dependency to the crawler on the queue also doesn't work
Other Details
Spoken to AWS technical support (Case ID 14257963701) who said there was an internal ticket, but suggested raising a bug here too
It would be nice to know when we're actually getting an ETA for this, does Coming Soon mean that it's in the deployment pipeline, or some testing is being done?
Name of the resource
AWS::Glue::Crawler
Resource Name
No response
Issue Description
Created a Glue crawler and an SQS queue to push S3 event notifications with associated permissions in a single template.
Expected Behavior
Both the Queue and Crawler should deploy and the Crawler should use the RecrawlPolicy to only crawl the relevant files.
Observed Behavior
Error message:
Test Cases
Deploying in a single template fails Deploying the queue first and then the crawler works fine, but deploying them at the same time fails. Adding a dependency to the crawler on the queue also doesn't work
Other Details
Spoken to AWS technical support (Case ID 14257963701) who said there was an internal ticket, but suggested raising a bug here too