search

linux-rdma / perftest

Infiniband Verbs Performance Tests
Other
534 stars 274 forks source link

Question about ib_write_lat with CUDA #231

Open yzygitzh opened 7 months ago

yzygitzh commented 7 months ago

I've found that ib_write_lat doesn't support CUDA mode. Wonder whether there is any intrinsic issue that prevents supporting this? I think it should not be CUDA issue because NCCL library is using IB write with GPU. If there isn't a big obstacle, I can help draft a PR to fix this.

elevenxiang commented 6 months ago

I've found that ib_write_lat doesn't support CUDA mode. Wonder whether there is any intrinsic issue that prevents supporting this? I think it should not be CUDA issue because NCCL library is using IB write with GPU. If there isn't a big obstacle, I can help draft a PR to fix this.

Can you share your PR link ? I remove the error exit, and try to run on A100, it will be crash and gdb showed that not host memory, so it could be CUDA memory issue

Thanks

yzygitzh commented 6 months ago

Hi, sorry for misleading. I meant I don’t know the key issue to support write latency for CUDA either.