search

rapidsai / dask-cuda

Utilities for Dask and CUDA interactions
https://docs.rapids.ai/api/dask-cuda/stable/
Apache License 2.0
286 stars 91 forks source link

Investigate `dc` vs `rc` modes on InfiniBand #215

Open pentschev opened 4 years ago

pentschev commented 4 years ago

According to Connect-IB™: Architecture for Scalable High Performance Computing solution brief from Mellanox, using the rc mode (currently hardcoded in dask-cuda) may become an intractable memory problem as we scale systems. We need to investigate how rc and dc modes affect performance and memory consumption in dask-cuda.

cc @jakirkham @quasiben

jakirkham commented 4 years ago

Have we had a chance to explore this?

pentschev commented 3 years ago

No, I haven't explored this, perhaps it's something we could do this year.

github-actions[bot] commented 3 years ago

This issue has been marked stale due to no recent activity in the past 30d. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed. This issue will be marked rotten if there is no activity in the next 60d.

github-actions[bot] commented 3 years ago

This issue has been labeled inactive-90d due to no recent activity in the past 90 days. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed.