Closed ExtremeViscent closed 2 years ago
Thanks! Let me try to run this example and take some time to review.
Thank you for reviewing. The commit is edited as requested.
Hi @ExtremeViscent Could you cancel the review request for FrankLeeeee? This prevents other reviewers' action.
An MPI-backended Colossal-AI implementation of Vision-and-Language Transformer using 1D tensor parallel and data parallel.