can one node behaves like several nodes?

pgiri / dispy

Distributed and Parallel Computing Framework with / for Python

https://dispy.org

Other

260 stars 55 forks source link

can one node behaves like several nodes? #195

Open 7starsea opened 4 years ago

7starsea commented 4 years ago

I have 4 GPU installed on one machine, and I would like these 4 GPU behaves like 4 nodes, is that possible?

Thanks. Aimin

pgiri commented 4 years ago

dispynode binds to an IP address (without sharing) so one instance of dispynode can be used per IP address of node. If node has multiple network interfaces, then it is possible to run one instance per interface (with each instance in its own --dest_path_prefix and -i <IP> -n <cpus> etc.), making sure that total CPUs used by instances doesn't exceed available processors.

7starsea commented 4 years ago

Got it. Thanks for your quick suggestion.