search

NASA-PDS / operations

Tickets for the PDSEN Operations Team
Other
5 stars 1 forks source link

Updates needed for pds.nasa.gov lift-and-shift #198

Closed jordanpadams closed 2 years ago

jordanpadams commented 2 years ago

Timeline for cutover.

rchenatjpl commented 2 years ago

@viviant100 @acyu-jpl @jordanpadams OK, today's release is out with help from @c-suh. Next scheduled release is 12/15

c-suh commented 2 years ago

@viviant100, I compared the data release files from the latest svn updates with the files in the new repo and pushed the difference. Do you have anything more for Action 2? If not, that is complete.

viviant100 commented 2 years ago

Consider action 2 done! Thanks @c-suh.

viviant100 commented 2 years ago

Thanks for wrapping up 12/6 data release @rchenatjpl. Starting next data release, we'll be using Github in lieu of svn for the updates. Feel free to reach out for any questions.

c-suh commented 2 years ago

@jordanpadams and @viviant100, the one-time sync for the /data directory (this is NOT static web content nor covered by the hourly sync in Action 1b) has been done thanks to Andrew, but I think there's active development happening (e.g. directory added this morning not caught by the sync: https://pds.nasa.gov/data/pds4/test-data/registry/lab.hydrocarbon_spectraV1/). So, I think a freeze on the /data directory would be in order with a final one-time sync right before the cutover. Would this be a new Action item right before the second Action 5 on 12/16 ?

jordanpadams commented 2 years ago

@c-suh since we are pushing the cutover for a few weeks, I would recommend we setup a sync for an hourly sync for the data, similar to the website, and then we can work on a freeze and shutdown of the sync once we are ready for the cutover.

c-suh commented 2 years ago

@jordanpadams and @viviant100, just verifying that Action 4 is for prod2 as well?

Note: Action 3 has been completed. Please give prem gamma a try and let me know if you find anything missing or broken.

viviant100 commented 2 years ago

@c-suh Action 4 applies to prod2 as well.

c-suh commented 2 years ago

@acyu-jpl has reviewed the deployment procedure and is ready to run it for prod1 and prod2 tomorrow.

acyu-jpl commented 2 years ago

@c-suh Action 4 has been applied to pds-prod1. pds-prod1 is loading correctly, with tophat & feedback widget showing as well.

acyu-jpl commented 2 years ago

Action 4 has been applied to (pds-prod2)[https://pds-prod2.jpl.nasa.gov). pds-prod2 is loading correctly, with tophat & feedback widget showing as well.

acyu-jpl commented 2 years ago

Quick test reveal that the Java app is not working correctly on pds-prod1 or pds-prod2 or pds-gamma the keyword search app https://pds-gamma.jpl.nasa.gov/datasearch/keyword-search/ and the dataset status app https://pds.nasa.gov/datasearch/ds-status/

c-suh commented 2 years ago

@acyu-jpl let's first replace htdocs on prod2 with the backup htdocs, then test on prod1. Additionally, is this the same for you - Data Search at https://pds.nasa.gov/datasearch/data-search/ works on gamma but not on prod1/2?

acyu-jpl commented 2 years ago

@c-suh I restored the pre-git htdocs on pds-prod2. However, Keyword Search and Data Set Status are still broken. The data search is working on all environment.

c-suh commented 2 years ago

@acyu-jpl OK; thank you. I will take a look now.

c-suh commented 2 years ago

Created a ticket with the SAs. Just discovered that pages from Data Set Status are also 404 across all prem machines, e.g. https://pds.nasa.gov/ds-view/pds/viewBundle.jsp?identifier=urn%3Anasa%3Apds%3Aapollo_seismic_event_catalog&version=1.0, with the same error as for the other two applications.

c-suh commented 2 years ago

@acyu-jpl Data Search was not working because I had mixed up part of the process. I've tested it on pds-prod1 and updated the documentation. Please apply this section to the git-htdocs directory on pds-prod2 and make that directory operational.

c-suh commented 2 years ago

@acyu-jpl after switching prod2 back to git, also do a git pull. Thank you

acyu-jpl commented 2 years ago

@c-suh pds-prod2 has switch back to the git working copy. ran git pull origin main, no conflict detected image

c-suh commented 2 years ago

Action 5: I've started updating documentation, but there are many procedures. @rchenatjpl and @acyu-jpl, please update those processes for which you are responsible and let me know if you come across any which I might have missed.

Action 7a: https://github.com/NASA-PDS/operations/issues/197#issuecomment-990537849

Action 7b: talked with @acyu-jpl and this seems straightforward enough that I've asked him to look into misc application problems while I work this agu page.

c-suh commented 2 years ago

@acyu-jpl , I see that prod2 is using git (thank you), but step 4 of the updated documentation has not been applied. Please do only that one step (not any of the other steps) then leave the changes (how those are to be handled are TBD and are fine to stay as untracked changes until then).

acyu-jpl commented 2 years ago

@c-suh I updated the password manually on pds-prod2 for the following 4 files based on the step 4 of the documentation datasearch/data-search/getInvestigation.php datasearch/data-search/getInvestigations.php datasearch/data-search/getTarget.php datasearch/data-search/getTargets.php

However, I do suggest that we ask SA to setup environment variables for the connection information so we can commit these 4 files to git, and not expose connection credential

jordanpadams commented 2 years ago

@acyu-jpl @c-suh maybe let's create a separate ticket to track that since it is isn't required right now?

but i 100% agree. this will avoid an unintentional commit that will expose the info

c-suh commented 2 years ago

Belatedly added Action 8 to test all applications/functionality of the AWS sites. Direct message me for the document tracking the tests.

List of tickets requested to this action item (some from initial testing before the holidays):

Update: tickets post-Jan 25

tloubrieu-jpl commented 2 years ago

A follow up ticket has been created for the documentation https://github.com/NASA-PDS/portal-tasks/issues/23, this current ticket is now closed