search

pytorch / torchtitan

A native PyTorch Library for large model training
BSD 3-Clause "New" or "Revised" License
2.68k stars 212 forks source link

some cleanups #697

Closed tianyu-l closed 3 days ago

tianyu-l commented 5 days ago

Stack from ghstack (oldest at bottom):

  1. rename wps to tps as it has caused some confusions (didn't use tokens/sec because it is too long)
  2. in README.md, move PP and CP to "available features"
  3. move memory estimation scripts to ./scripts folder