search

ENCCS / hpda-python

ENCCS lesson material on High-Performance Data Analytics in Python
https://enccs.github.io/hpda-python
Creative Commons Attribution 4.0 International
4 stars 3 forks source link

something is wrong with salloc #54

Closed qianglise closed 2 years ago

qianglise commented 2 years ago

when i tried salloc -N 1 --ntasks-per-node=8 and once I launch dask, what I got is the following <Client: 'tcp://127.0.0.1:41107' processes=4 threads=8, memory=251.69 GiB> so --ntasks-per-node=8 allocated 8 threads, 4 cores, rather than 8 cores

or I misunderstood something here

wikfeldt commented 2 years ago

i just now noticed the same thing with ipyparallel! So there's a different SLURM flag we should use

wikfeldt commented 2 years ago

probably just need to add --ntasks-per-core=1

wikfeldt commented 2 years ago

fixed in setup instructions in 52fddd89a3efc9339799937dbf3d5fb0d743365c