search

ai-computing / aicomp

Other
6 stars 0 forks source link

DP + PP support #8

Open ememos opened 3 months ago

ememos commented 3 months ago

2D parallelism is needed

ememos commented 3 months ago

Simultaneous support for PP and DP features implemented. The size of the DP group is adjusted using the dp_size argument of the Optimus_p class. The default value of dp_size is 1, in which case only PP is supported.