Added upgrade-dd command to Registry manager to upgrade data dictionary

tdddblog commented 2 years ago

🗒️ Summary

NOTE: This branch includes changes from branch versions (https://github.com/NASA-PDS/registry-mgr/pull/46)

⚙️ Test Data and/or Report

Run registry-manager upgrade-dd -r

Check that registry-dd index was dropped and recreated and that data dictionary was loaded. You should see output similar to this:

[INFO] Deleting index registry-dd                                                                                                                      
[INFO] Creating index: registry-dd
[INFO] Schema: C:\tmp\registry-manager-4.5.0-SNAPSHOT\elastic\data-dic.json
[INFO] Shards: 1
[INFO] Replicas: 0
[INFO] Loading ES data file: C:\tmp\registry-manager-4.5.0-SNAPSHOT\elastic\data-dic-data.jar:dd.json
[INFO] Loaded 500 document(s)
[INFO] Loaded 1000 document(s)
[INFO] Loaded 1500 document(s)
[INFO] Loaded 2000 document(s)
[INFO] Loaded 2500 document(s)
[INFO] Loaded 3000 document(s)
[INFO] Loaded 3122 document(s)

♻️ Related Issues

https://github.com/NASA-PDS/registry/issues/43

jordanpadams commented 2 years ago

@jimmie can you confirm you ran this script successfully so we can go ahead with a merge?

jimmie commented 2 years ago

@jordanpadams There's one issue I am investigating that I observed with SBN-PSI but I don't want to muck with it until the workshop is done.

jordanpadams commented 2 years ago

@jimmie 👍 ok. well that being said, will merge this, and we can create a new ticket to look at that issue later. there was a memory glitch, correct?

jimmie commented 2 years ago

SBN-PSI has about 1.5M documents loaded so the script was timing out.

NASA-PDS / registry-mgr