Fixes to scaling issues with Nalu-Wind

jsitaraman / tioga

Tioga is a library for overset grid assembly on parallel distributed systems

GNU Lesser General Public License v3.0

66 stars 36 forks source link

Closed sayerhs closed 5 years ago

sayerhs commented 5 years ago

This pull request adds a few modifications to fix scaling issues observed on 16k/32k MPI ranks on NERSC Cori system

Use MPI_AllReduce to exchange boxes instead of send/recv of a large number of boxes
Add option to determine unique nodes using global node ID instead of coincident coordinate search. Can be disabled using the CMake option -DTIOGA_HAS_NODEGID=OFF