[FEATURE]: Migrate DLP S3 buckets to us-east-1

[karkir0003]

Feature Name

Migrate DLP S3 Buckets to us-east-1

Your Name

Karthik Subramanian

Description

Problem Our DLP S3 Buckets are currently in us-west-2 region. Due to an initiative to migrate our AWS resources to us-east-1 to keep our resources closer to where we are, we need to do some work in migrating the S3 buckets to us-east-1.

Proposed Approach The following S3 buckets are currently used in DLP:

• Remove the dlp-executions-bucket stored in us-west-2. Rename to dlp-trainspace-bucket and store in us-east-1. This bucket stores the trainspace data by trainspace id. It's very important to make the "Buckets and Objects not public" condition hold. We wouldn't want to expose the trainspace data to a malicious actor
• Move the dlp-upload-bucket that was stored in us-west-2 to us-east-1. This bucket holds the uploaded datasets from the user. Please make sure that access settings and CORS settings are properly configured just like the one in us-west-2
• Clean up any code that uses the dlp-executions-bucket and ensure that we are writing trainspace data to dlp-trainspace-bucket
• We also might want to ensure that any code that writes uploaded file data to the dlp-upload-bucket still works as intended

[github-actions[bot]]

Hello @karkir0003! Thank you for submitting the Feature Request Form. We appreciate your contribution. :wave:

We will look into it and provide a response as soon as possible.

To work on this feature request, you can follow these branch setup instructions:

1. Checkout the main branch:

    git checkout nextjs

2. Pull the latest changes from the remote main branch:

    git pull origin nextjs

3. Create a new branch specific to this feature request using the issue number:

    git checkout -b feature-1131

   Feel free to make the necessary changes in this branch and submit a pull request when you're ready.

   Best regards, Deep Learning Playground (DLP) Team