Azure / cyclecloud-slurm

Azure CycleCloud project to enable users to create, configure, and use Slurm HPC clusters.
MIT License
58 stars 43 forks source link

Enable Hyperthreading Support using threads #50

Closed davestacionis closed 3 years ago

davestacionis commented 3 years ago

The latest release switched from vcpu to pcpu, so hyperthreading is no longer captured in the configuration. Suggest using threads to allow 2 threads per core/cpu on VMs that support it.

anhoward commented 3 years ago

This is fixed in the latest 2.4.4 release of the project. This will be released as part of CycleCloud 8.1.1 but you can download and use the latest release with 8.1 as well.

themorey commented 3 years ago

@anhoward I'm still seeing the following in my cyclecloud.conf:

PartitionName=hpc Nodes=hpc-pg0-[1-10] Default=YES DefMemPerCPU=7680 MaxTime=INFINITE State=UP
Nodename=hpc-pg0-[1-10] Feature=cloud STATE=CLOUD CPUs=2 ThreadsPerCore=2 RealMemory=15360

PartitionName=htc Nodes=htc-[1-10] Default=NO DefMemPerCPU=3584 MaxTime=INFINITE State=UP
Nodename=htc-[1-10] Feature=cloud STATE=CLOUD CPUs=2 ThreadsPerCore=2 RealMemory=7168

The htc partition is F4s_v2 and the hpc partition is D4ds_v4. I would expect to see CPUs=4 ThreadsPerCore=1 for both.

I'm on CC v8.1.1-1451 and Slurm 2.4.4