search

NVIDIA / deepops

Tools for building GPU clusters
BSD 3-Clause "New" or "Revised" License
1.25k stars 326 forks source link

NVIDIA deepops is support GPU Time Slicing ? #1254

Closed jjsair0412 closed 1 year ago

jjsair0412 commented 1 year ago

Deepops is support MIG mode but I'd not found GPU Time Slicing .

NVIDIA deepops is support GPU Time Slicing ?

If deepops is not support time slicing , Do you have any support plans?

Thank you for your help !

supertetelman commented 1 year ago

You can find the documentation around MIG support in Kubernetes here: https://github.com/NVIDIA/deepops/blob/master/docs/k8s-cluster/nvidia-mig.md

If you are using Slurm, MIG is also supported, but you need to configure your MIG devices using the mig-parted tool that is installed and managed by this playbook: https://github.com/NVIDIA/deepops/blob/master/playbooks/nvidia-software/nvidia-mig.yml

jjsair0412 commented 1 year ago

hello , !

Thank you for your answer . !

Then deepops is not support nvidia GPU Time slicing ??

I found GPU Time slicing docs from nvidia offlical document. So i thought deepops also support Time-slicing founction.

jungyh0218 commented 1 year ago

@jjsair0412 DeepOps provides ansible modules to set up cluster and install SOTA programs. It's just an infrastructure automation tool. DeepOps does not provide any GPU sharing functionality by itself. If you are interested in GPU Time slicing, read this article please. Once you create your own k8s cluster with DeepOps, you can try GPU time slicing by configuring in the k8s cluster.

jjsair0412 commented 1 year ago

Thank you for your answer @jungyh0218 !