Bootstrap UCX processes outside of MPI

cylondata / cylon

Cylon is a fast, scalable, distributed memory, parallel runtime with a Pandas like DataFrame.

https://cylondata.org

Apache License 2.0

298 stars 48 forks source link

Open nirandaperera opened 2 years ago

nirandaperera commented 2 years ago

Parent issue: #575

[x] Figure out how to create a context out of locally spawned processes (determine what metadata is required to spawn processes)
[x] Get a UCC example running without MPI
[ ] Spawn UCX processes outside of MPI (use Dask/ ssh+bash to do this)

Possible options for a distributed key value store

kaiyingshan commented 2 years ago

Process of initializing UCX context:

[x] get rank and world size (currently by MPI) init UCP context (with cylon::ucx::initContext) init send/recv workers (with cylon::ucx::initWorker)
[x] allgather ucp recv worker address (currently by MPI), and create endpoint map
[ ] build with MPI if UCC is not present

Initializing UCC context: get rank and world size from UCX communicator assigned by constructor