search

lyulyul / shine-cluster

Simple High performance Infrastructure for Neural network Experiments
GNU General Public License v3.0
14 stars 8 forks source link

[Proposal] Is it possible for the same GPU to perform multiple tasks? #169

Open wi11Iam5-mpu opened 1 year ago

wi11Iam5-mpu commented 1 year ago

As the question describes, is it possible or necessary to allow multiple tasks to run on the same graphics card? For the purpose of making full use of arithmetic power and memory, some tasks need smaller overhead and could request a smaller unit of arithmetic resources.

wi11Iam5-mpu commented 1 year ago

I found this, running-multiple-slurm-jobs-on-the-same-gpu, that looks like the proposal is impossible.

Lu-233 commented 1 year ago

如果一个人需要执行多个程序，且每个都不消耗全部的算力，是可行的。

比如在一个任务中运行目标代码的多个副本。

gqqnbig commented 1 year ago

https://slurm.schedmd.com/gres.html#Sharding looks promising.

Yet I'm hesitated to investigate more in light of massive pending code.

wi11Iam5-mpu commented 1 year ago

https://slurm.schedmd.com/gres.html#Sharding looks promising.

Yet I'm hesitated to investigate more in light of massive pending code.

Great. This is not urgent work and can be left as a future feature.