Closed hudeven closed 2 years ago
@hudeven has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.
@hudeven has updated the pull request. You must reimport the pull request before landing.
@hudeven has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.
@hudeven has updated the pull request. You must reimport the pull request before landing.
@hudeven has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.
@hudeven has updated the pull request. You must reimport the pull request before landing.
@hudeven has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.
@hudeven has updated the pull request. You must reimport the pull request before landing.
@hudeven has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.
@hudeven has updated the pull request. You must reimport the pull request before landing.
@hudeven has updated the pull request. You must reimport the pull request before landing.
@hudeven has updated the pull request. You must reimport the pull request before landing.
@edward-io yes, thanks for taking a look! As it's the initial check in from previous prototyping repos, there are a lot of things to improve! Any feedback is welcome!
@hudeven has updated the pull request. You must reimport the pull request before landing.
@hudeven has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.
@ananthsub thanks for the comments! All of them make sense. I plan to adopt those libs soon. Currently, the main goal of this pull request is to add the basic example and then have pipeline setup config/instructions on top of it.
1) We decide to put paved path examples in torchrecipes repo 2) This is an initial commit based on previous work https://github.com/aivanou/disttraining and https://github.com/dracifer/disttraining 3) It's a basic example without any external dependencies(mlflow logging, airflow, torchx, etc), which will be added soon
Testing:
single GPU
python main.py
multi GPUs
torchrun --nnodes 1 --nproc_per_node 4 \ --rdzv_backend c10d \ --rdzv_endpoint localhost:29500 \ main.py
torch single GPU
torchx run -s local_cwd dist.ddp -j 1x1 --script main.py
torchx multi GPUs
torchx run -s local_cwd dist.ddp -j 1x4 --script main.py