search

NVIDIA / MagnumIO

Magnum IO community repo
Apache License 2.0
76 stars 16 forks source link

Which GPUs support GDS #5

Open zhileiz opened 3 years ago

zhileiz commented 3 years ago

Hello,

The README says that:

For example GDS requires the latest Tesla, Volta or Ampere GPUs, 
ext4 mounting options, and GDS enabled storage systems (an NVMe drive at minimum). 
More on GDS setup in the NVIDIA GPUDirect Storage Installation and Troubleshooting Guide

However, the hardware/cuds-capability requirement is not mentioned in GDS setup in the NVIDIA GPUDirect Storage Installation and Troubleshooting Guide or anywhere else on the web.

Moreover, I was able to follow developer-onizuka's repo to set up GPS using a Quadro P400 card. However, I noticed that gdsio utility's GPUD mode has worse throughput and latency performance than CPU_GPU mode.

Would you please specify which GPUs (or cuda capabilities) are actually supported by GDS? Thank you!

KiranModukuri commented 3 years ago

GDS is supported only on NVIDIA graphics processing units (GPU) Tesla® or Quadro® models that support compute mode, and a compute major capability greater than or equal to 6.

Note: This includes A100, V100 and T4 cards.

The performance of GDS depends on multiple factors.

1) The p2p performance between the NVMe device and the GPU. we have seen good performance on systems with GPU and NVMe devices connected under a PCIe switch.

2) GDS is tuned for IO request sizes >= 4KB.

3) offsets and IO aligned to 4KB size

johnnynunez commented 2 years ago

Why is it not compatible with the RTX Turing and RTX Ampere series? For university level it is clear that for students it is a long way to go to buy a quadro. If the rtx have this technology why is it not activated? In fact for gaming it is the same idea with these two series of graphics cards. RTX IO.