Scale how the data is downloaded in get_data.py

[umohnani8]

If there are more than 1 pod, the init-container of one pod should download the data while the init-containers of the other pods wait. Once the data is downloaded the processing container of all the pods can access the data.

Signed-off-by: umohnani8 umohnani@redhat.com

[umohnani8]

Addresses issue https://github.com/redhat-university-partnerships/radiology/issues/45 @danmcp @ravisantoshgudimetla PTAL I can remove the print statements if they are not needed. I just think that they would be helpful to be in the logs for the user if something goes wrong.

[umohnani8]

@ravisantoshgudimetla I updated the code, PTAL.

[ravisantoshgudimetla]

@umohnani8 Seems something broke in tests. Can you please check that otherwise this LGTM.

[ravisantoshgudimetla]

@danmcp PTAL

[umohnani8]

Should be ready now, @ravisantoshgudimetla @danmcp PTAL.

[umohnani8]

Storage is hard coded to 5Gi for now, I think that should be something the user should be able to control, but can add that functionality in later.

[umohnani8]

@danmcp @ravisantoshgudimetla should the pvc deletion happen here https://github.com/FNNDSC/pman/blob/master/pman/pman.py#L1360? If so, how do I go about testing that? How do I call the def_Shutdown() function?

[umohnani8]

@ravisantoshgudimetla yup, been testing it on the MOC.

[danmcp]

@umohnani8 This PR has a merge conflict

[umohnani8]

Updated the get_data logic. Tested the various failure and success cases. @ravisantoshgudimetla @danmcp PTAL.

[umohnani8]

@danmcp should be ready now.

[danmcp]

@umohnani8 Please squash the commits and I am good to merge

[umohnani8]

@danmcp squashed commits.