Open ememos opened 3 months ago
In pipeline parallelism, when the first stage reads data and labels, there is a need to send the labels to the last stage.
move_labels2last_stage function added.
In pipeline parallelism, when the first stage reads data and labels, there is a need to send the labels to the last stage.