search

aws-solutions / aws-data-lake-solution

A deployable reference implementation intended to address pain points around conceptualizing data lake architectures that automatically configures the core AWS services necessary to easily tag, search, share, and govern specific subsets of data across a business or with other external businesses.
https://aws.amazon.com/solutions/implementations/data-lake-solution/
Apache License 2.0
401 stars 160 forks source link

S3 prefix #23

Closed mirkods closed 4 years ago

mirkods commented 5 years ago

Hi there,

is there a way to change the s3 packages prefix? I'd like to avoid to save packages in the bucket root but for example add them in a packages/ prefix.

Any suggestions?

hvital commented 5 years ago

Hi @mirkods

Probably the fastest way to address this is upload the files to S3 using your own bucket structure and then import the files (you can refer just the bucket_name, folder path of filename) via manifest file. More info: http://docs.awssolutionsbuilder.com.s3-website-us-east-1.amazonaws.com/data-lake/user-guide/working-with-packages/#using-manifest-files

Does this answer your question?

Regards,

knihit commented 4 years ago

Hi @mirkods, please advise if the issue is resolved. If you have more questions please feel free to reach out. If not, can we close this issue.