awslabs / aws-serverless-data-lake-framework

Enterprise-grade, production-hardened, serverless data lake on AWS
https://sdlf.workshop.aws/
MIT No Attribution
404 stars 137 forks source link

[Deploying the Foundations] sdlf-foundations-rS3Stack FAILS to create. #137

Closed Druizm128 closed 1 year ago

Druizm128 commented 1 year ago

Describe the bug Team, I have tried Deploying SDLF section. There is a problem with the CloudFormation stack sdlf-foundations-rS3Stack. It says Embedded stack arn:aws:cloudformation:us-east-1:****:stack/sdlf-foundations-rS3Stack-1HIU1XN1M2Z6C/558b2930-edcf-11ed-9eb9-0e8bcc37f821 was not successfully created: The following resource(s) failed to create: [rStageBucketLakeFormationS3Registration, rAnalyticsBucketLakeFormationS3Registration, rRawBucketLakeFormationS3Registration, rDataQualityBucketLakeFormationS3Registration]. The only thing I have done is to follow the instructions in Deploying the Foundations. I have not changed the parameters.

To Reproduce Steps to reproduce the behavior:

  1. I follow the instructions in Deploying the Foundations..

Expected behavior I should be able to deploy it successfully.

Screenshots If applicable, add screenshots to help explain your problem.

Screenshot 2023-05-08 at 13 02 05 Screenshot 2023-05-08 at 13 03 08 Screenshot 2023-05-08 at 13 03 54 Screenshot 2023-05-08 at 13 06 21

SDLF release (if known): Not sure, I deployed this on May 8th, 2023.

Additional context I tried deploying in different accounts, and got the same result. In summary this bug has left the first part of the workshop useless. Let me know if I can be of more help.

cnfait commented 1 year ago

Thanks for raising this issue. This is due to a missing service role for Lake Formation data access, required when registering buckets in Lake Formation. The temporary fix is to manually register any bucket using the AWS console, to trigger the role creation, then rerun the workshop.

I've opened a PR with a better fix: #138

Once it is merged in main, the issue should be gone.