NVIDIA / modulus

Open-source deep-learning framework for building, training, and fine-tuning deep learning models using state-of-the-art Physics-ML methods

https://developer.nvidia.com/modulus

Apache License 2.0

947 stars 222 forks source link

add example which trains a distributed GraphCast model on shallow-water-equations data #400

Closed stadlmax closed 4 months ago

stadlmax commented 6 months ago

Modulus Pull Request

Description

add example which trains a GraphCast model on a shallow-water-equations dataset
setup example in such a way to showcase "tensor-parallel" training of a GNN model
improvements and bugfixes in used distributed communication primitives

Checklist

[x] I am familiar with the Contributing Guidelines.
[x] New or existing tests cover these changes.
[x] The documentation is up to date with these changes.
[x] The CHANGELOG.md is up to date with these changes.
[ ] An issue is linked to this pull request.

Dependencies

mnabian commented 4 months ago

Tagging @akshaysubr to review the changes to the distributed manager.

stadlmax commented 4 months ago

/blossom-ci

stadlmax commented 4 months ago

/blossom-ci

stadlmax commented 4 months ago

@mnabian I added a first version of the README. Could you have a look at that and some of the remarks Akshay brought up?

stadlmax commented 4 months ago

/blossom-ci

stadlmax commented 4 months ago

/blossom-ci