Closed xrsrke closed 9 months ago
Only partitioning optimizer states and making it work with 3D parallelism.