radical-cybertools / radical.pilot

RADICAL-Pilot
http://radical-cybertools.github.io/radical-pilot/index.html
Other
54 stars 23 forks source link

RP uses hyperthreading during mpi execution #1462

Closed iparask closed 5 years ago

iparask commented 7 years ago

I am running a MPI application on Stampede2 using ibrun. Stampede2 has 68 cores and 4 threads per core. When I define a CU with more than 68 cores, RP thinks there are 272 cores per node and puts the CU to run in one node utilizing hyper threading.

We should introduce a way to avoid hyperthreading.

andre-merzky commented 7 years ago

This will be addressed in the GPU branch. At this point, RP relies on the batch system information which reports 68*4 process slots. In the GPU branch, we can define the number of cores and threads per node. I'll keep the ticket open until this is merged.

Iannis, do you have the option to switch to the GPU branches for this line of experiments? Also, I am fairly sure this is indeed the intended way to use the nodes on stampede-2, isn't it? What is the actual reason to avoid hyperthreading?

andre-merzky commented 6 years ago

After discussing this, we may want to consider adding a cud.hyperthreading=True flag to the CU description.

iparask commented 6 years ago

I think that the CU description proposal will take care of it. That being said I do not think there is any need to introduce a new flag.

vivek-bala commented 5 years ago

Closing as the CU description has been discussed and changed since then.