NEW: Enable multi-node lamino using mpi4py.

[xiaodong-yu]

Purpose

Allow the bucket-based lamino to be executed in a multi-node enviroment.

Approach

Use mpi4py to split the object data and distribute them to multiple ranks. Use MPI.Allreduce and MPI.Allgather to sync and communicate during the lamino.

Pre-Merge Checklists

Submitter

• [ ] Write a helpfully descriptive pull request title.
• [ ] Organize changes into logically grouped commits with descriptive commit messages.
• [ ] Document all new functions.
• [ ] Write tests for new functions or explain why they are not needed.
• [ ] Build the documentation successfully
• [ ] Use yapf to format python code.

Reviewer

• [x] Actually read all of the code.
• [ ] Run the new code yourself.
• [ ] Write a summary of the changes as you understand them.
• [ ] Thank the submitter.

[pep8speaks]

Hello @xiaodong-yu! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

There are currently no PEP 8 issues detected in this Pull Request. Cheers! :beers:

Comment last updated at 2021-11-02 15:28:45 UTC