josephmachado / beginner_de_project

Beginner data engineering project - batch edition
https://www.startdataengineering.com/post/data-engineering-project-for-beginners-batch-edition/
MIT License
464 stars 136 forks source link

S3 bucket creation and permissions issue #11

Closed josephmachado closed 1 year ago

josephmachado commented 2 years ago

from comments section on the blog

  1. the bucket creation command is giving an error An error occurred (IllegalLocationConstraintException) when calling the CreateBucket operation: The unspecified location constraint is incompatible for the region specific endpoint this request was sent to. You can fix this by editing the file setup_infra.sh at line 26: adding argument. I fix that using command like aws s3api create-bucket --bucket my-bucket-name --region us-west-2 --create-bucket-configuration LocationConstraint=us-west-2

  2. in linux get lot of permission issues so give permission to chmod -R 777 /opt chmod -R 777 ./logs chmod -R 777 ./data chmod -R 777 ./temp