idaholab / moose

Multiphysics Object Oriented Simulation Environment
https://www.mooseframework.org
GNU Lesser General Public License v2.1
1.78k stars 1.05k forks source link

Make MultiAppInterpolationTransfer/MultiAppUserObjectTransfer work with distributed meshes #20099

Open vincentlaboure opened 2 years ago

vincentlaboure commented 2 years ago

Reason

Many large multiphysics problems make use of LayeredAverage/MultiAppUserObjectTransfer and/or MultiAppInterpolationTransfer to transfer data between apps. If the mesh becomes too large, a replicated mesh is too memory intensive but, unfortunately, distributed meshes do not currently work with MultiAppUserObjectTransfer/MultiAppInterpolationTransfer.

Design

Make MultiAppUserObjectTransfer/MultiAppInterpolationTransfer work with distributed meshes.

Impact

Bigger problems can be considered.

lindsayad commented 2 years ago

@fdkong @roystgnr are we aware of this issue? If so, are there any important technical hurdles or just developer time?

fdkong commented 2 years ago

@friedmud intended to make MultiAppInterpolationTransfer work with only replicated meshes, IIRC.

fdkong commented 2 years ago

It is possible to make MultiAppInterpolationTransfer work with distributed meshes, but you might use other distributed transfers. I am not 100% convinced we should make MultiAppInterpolationTransfer work with distributed meshes

lindsayad commented 2 years ago

What should be used instead?

fdkong commented 2 years ago

MeshFunction and NearestNode should do that

vincentlaboure commented 2 years ago

Two comments:

  1. MultiAppUserObjectTransfer is definitely a higher priority
  2. Can you explain why you think MultiAppInterpolationTransfer shouldn't be supported ?
friedmud commented 2 years ago

As mentioned in #20616 I am waiting to do this until the general transfer framework ( #17417 ) is merged to make this happen.

rui-hu commented 1 year ago

We have similar needs to have MultiAppUserObjectTransfer working with distributed mesh, and find this issue. Is there any progress on this since the last update?

@aprilnovak @lingzou-anl

lindsayad commented 1 year ago

Have you tried MultiAppGeneralFieldUserObjectTransfer?

rui-hu commented 1 year ago

not yet. we will give it a try.