NASA-PDS / planetary-data-cloud

PDS Cloud Migration documentation, issue, tracking and simple tools for assisting in the PDS hybrid cloud study and migration efforts.
Apache License 2.0
0 stars 0 forks source link

Design and Implement Initial Archive Browser Beta #61

Closed jordanpadams closed 5 months ago

jordanpadams commented 1 year ago

💡 Description

See sub-tasks for initial design and implementation tasks

jordanpadams commented 1 year ago

📆 January status: Ops concept and design in work. On schedule

jordanpadams commented 1 year ago

📆 February status: Deferred from plans after more discussions of architecture. Delivery Manager prioritized ahead of this component.

jordanpadams commented 7 months ago

📆 October Status: Task underway. Pursuing using stylesheets + cloudfront approach for abstracting S3 buckets. On schedule.

tloubrieu-jpl commented 7 months ago

@eddiesarevalo , I was able to set up a cloudfront distribution with origin the bucket pds-messenger-data-copy. The distribution provides:

  1. an http link to all objects in the s3 bucket, for example https://d1qy67vkpvel43.cloudfront.net/MESSDEM_1001/AAREADME.TXT
  2. a list of all the objects in the bucket but since all the objects of the bucket are on a single page, I think the number of objects is linited to 1000 (to be confirmed). see https://d1qy67vkpvel43.cloudfront.net/

To have a list of objects by directory, if needed by the Aria application, I see 2 options:

Note that S3 does not have the concept of directory, I believe, a directory has to be considered as prefix shared in the key of multiple objects. That might be why it is not natural to get the feature from the cloudfront-s3 connection.

We can also ask for help to the SAs on the general need. I will not work more on that this week.

eddiesarevalo commented 7 months ago

Thanks @tloubrieu-jpl !

The list of objects looks similar to what aria https://aria-share.jpl.nasa.gov/ has at https://d1z62tir4fw0q0.cloudfront.net

They then drill down the directories using some delimeter logic for example: https://d1z62tir4fw0q0.cloudfront.net/?delimiter=/&prefix=20140512-golden_guardian%2F

This is what Aria has compared to ours: Private Zenhub Image

Private Zenhub Image

I'm trying to see if I can run the code.

tloubrieu-jpl commented 7 months ago

Status:

jordanpadams commented 6 months ago

📆 November status: Work underway. On schedule

jordanpadams commented 5 months ago

Status: We tracked down the codebase, and @eddiesarevalo was able to fix some of the bugs in the code and tweak the interface/layouts. Deployed to demo site.

jordanpadams commented 5 months ago

Closing as completed for now. Will need to work out deployment at release time.