geodesymiami / rsmas_insar

RSMAS InSAR code
https://rsmas-insar.readthedocs.io/
GNU General Public License v3.0
61 stars 23 forks source link

Why are we setting hosts equal to number of tasks? #306

Closed AlexandrosAliKhan closed 4 years ago

AlexandrosAliKhan commented 4 years ago

https://github.com/geodesymiami/rsmas_insar/blob/f1048977ca0ff1bc7778d2d4aebba9c1365f2393/minsar/job_submission.py#L109

falkamelung commented 4 years ago

This is how it is supposed to be. It ensures that all jobs are run on the same node. Which is not relevant as we request only one core. But once we request 15 cores this should stay to make sure that all cores are on the same node.

Falk Amelung Professor Department of Marine Geosciences Rosenstiel School of Marine and Atmospheric Sciences University of Miami 4600 Rickenbacker Causeway Miami, FL 33149 USA Tel: 305 421 4949 E-mail: famelung@rsmas.miami.edumailto:famelung@rsmas.miami.edu Web:http://insar.rsmas.miami.edu InSAR data: http://insarmaps.miami.edu

On Feb 26, 2020, at 11:12 AM, Alexandros Ali Khan notifications@github.com<mailto:notifications@github.com> wrote:

https://github.com/geodesymiami/rsmas_insar/blob/f1048977ca0ff1bc7778d2d4aebba9c1365f2393/minsar/job_submission.py#L109https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgeodesymiami%2Frsmas_insar%2Fblob%2Ff1048977ca0ff1bc7778d2d4aebba9c1365f2393%2Fminsar%2Fjob_submission.py%23L109&data=02%7C01%7Cfamelung%40rsmas.miami.edu%7C46245418a11742f788de08d7bad6bcf1%7C2a144b72f23942d48c0e6f0f17c48e33%7C0%7C0%7C637183303766636295&sdata=pEVai946K0p5Mtr5Q%2Bcl7hs6Oo%2Fojpl%2FKEhSO0q%2Fcag%3D&reserved=0

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgeodesymiami%2Frsmas_insar%2Fissues%2F306%3Femail_source%3Dnotifications%26email_token%3DACVFHXGXHHX2JKRWIDHLBRLRE2IINA5CNFSM4K4JAXH2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4IQQLPYA&data=02%7C01%7Cfamelung%40rsmas.miami.edu%7C46245418a11742f788de08d7bad6bcf1%7C2a144b72f23942d48c0e6f0f17c48e33%7C0%7C0%7C637183303766646286&sdata=NjIE4tiUxL2DlKWDwN6BYNxkf6oefs%2FgNI7BlaCJLIY%3D&reserved=0, or unsubscribehttps://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FACVFHXFS7XV63QC4LAXG423RE2IINANCNFSM4K4JAXHQ&data=02%7C01%7Cfamelung%40rsmas.miami.edu%7C46245418a11742f788de08d7bad6bcf1%7C2a144b72f23942d48c0e6f0f17c48e33%7C0%7C0%7C637183303766646286&sdata=BAevIfr7qQvVDHcmoMCq7RSe75g5bPS49bHPKjKBlm4%3D&reserved=0.

AlexandrosAliKhan commented 4 years ago

I believe that span[hosts=1] does that. I think it means do it on one host. If we set hosts to a number greater than one, I am not sure how it will behave. From what I have read I think hosts is only used with one. The same can be achieved with span[ptiles=15] This means that give me 15 cores per node. So I think span[ptiles] is used when you are dealing with multiple hosts.

mirzaees commented 4 years ago

This was correct for stampede but not pegasus. fixed it closing the issue ...