Add PP tracer + DP test

pytorch / torchtitan

A native PyTorch Library for large model training

BSD 3-Clause "New" or "Revised" License

1.28k stars 115 forks source link

Open kwen2501 opened 1 month ago

kwen2501 commented 1 month ago

Stack from ghstack (oldest at bottom):

Separate the addition of 2D test from original PR #362 for easier review and landing.

Also changed .items() to named_children() for more general submodule access. See similar changes in https://github.com/pytorch/torchtitan/pull/371.

kwen2501 commented 1 month ago