NASA-PDS / s3-browser-cloudfront

Web view for files in S3 buckets
Other
1 stars 0 forks source link

Update buckets in S3 Browser Cloudfront to be production ready #31

Open jordanpadams opened 2 months ago

jordanpadams commented 2 months ago

💡 Description

The S3 browser should be pointed at 2 buckets:

odr/  ----> this will probably need to be hard-coded
   sbn/  -----> this will probably need to be hard-coded
       gbo.ast.catalina.survey/ ---> https://pds-css-archive.s3.us-west-2.amazonaws.com

sbn/ ---> sbn bucket behind whatever that cloudfront https://cloudfront.net/sbnbucket

# This will eventually point to all the node buckets behind cloudfront, e.g.
atm/ ---> https://cloudfront.net/atmbucket
img/ ---> https://cloudfront.net/imgbucket
geo/ ---> https://cloudfront.net/geobucket
naif/ ---> https://cloudfront.net/naifbucket
etc

⚔️ Parent Epic / Related Tickets

No response

jordanpadams commented 2 months ago

@eddiesarevalo I would like to make sure we are ready for this to work in production now, versus having to come back to it over and over. Let me know how this goes, and we can go from there.

tloubrieu-jpl commented 1 month ago

@jordanpadams will update that ticket.

eddiesarevalo commented 1 month ago

@jordanpadams If we add some code to the s3 browser that can differentiate between a directory and a bucket we can have a map of this in JSON and generate this.

So the directories would be like this:

/odr
  /sbn
    /gbo.ast.catalina.survey/ ---> https://pds-css-archive.s3.us-west-2.amazonaws.com
  /atm
  /img
  /geo
  /naif
jordanpadams commented 1 month ago

@eddiesarevalo copy. whatever you think is best.

As a note on the directories, the odr directory is for Open Data Registry data, right now, it will only contain sbn data. The rest of the node directories I would like at the top level. For right now, it would look like this:

odr/
|--sbn/
|----gbo.ast.catalina.survey/ ---> https://pds-css-archive.s3.us-west-2.amazonaws.com
sbn/  ---> https://cloudfront.net/sbn-archive-bucket

# eventually there will be more nodes at this top level of the directory structure
viviant100 commented 1 month ago

created DSIO-5829 - test bucket in progress

viviant100 commented 1 month ago

@eddiesarevalo the archive bucket is created in test env. Please let me know if that works for you. Thanks.

jordanpadams commented 2 weeks ago

Status: Issue trying to create static website host on s3-browser-app-dev bucket. @jordanpadams to ping SAs and MCP folks to get this enabled

eddiesarevalo commented 3 days ago

SAs set up some sort of hosting using oac. As far as I can tell it runs. https://dwfmsppt3a750.cloudfront.net/catalina-sky-survey/sbn/gbo.ast.catalina.survey/data_calibrated/703/2020/20Apr02/

This cloudfront points to our dev s3 bucket without using static website hosting.