search

NVIDIA / gds-nvidia-fs

NVIDIA GPUDirect Storage Driver
Other
207 stars 31 forks source link

how can we deploy gds inside one VM just for quick study the framework? #11

Open gaowayne opened 1 year ago

gaowayne commented 1 year ago

could you please shed light if we can set up one VM to quickly understand GDS and play it inside VM?

sbates130272 commented 1 year ago

I am not affiliated with NVIDIA but I can comment a bit here.

I think it would be good if we had an automated method for installing GDS on bare metal or VM. Seems Ansible would be awesome for this.

Now if we did have GDS software installed in a VM we have to consider what hardware is real and what hardware is emulated. QEMU allows the user to emulate NVMe but there is no emulation of an NVIDIA GPU. So the GPU would have to be passed in.

Now you have to consider peer to peer DMAs and what that even means when the NVMe SSDs are emulated. I know quite a bit about this from my p2pdma work and I know you can make this all work but it only emulates p2p.

All in all I like this VM idea as a learning tool. But it won't work for an actual GDS deployment.

gaowayne commented 1 year ago

I am not affiliated with NVIDIA but I can comment a bit here.

I think it would be good if we had an automated method for installing GDS on bare metal or VM. Seems Ansible would be awesome for this.

Now if we did have GDS software installed in a VM we have to consider what hardware is real and what hardware is emulated. QEMU allows the user to emulate NVMe but there is no emulation of an NVIDIA GPU. So the GPU would have to be passed in.

Now you have to consider peer to peer DMAs and what that even means when the NVMe SSDs are emulated. I know quite a bit about this from my p2pdma work and I know you can make this all work but it only emulates p2p.

All in all I like this VM idea as a learning tool. But it won't work for an actual GDS deployment.

totally agree :)