Open lifflander opened 6 months ago
What Needs to be Done?
Right now, proxy.allreduce is a reduce followed by a broadcast. We can make this more efficient by combining them into a singular allreduce algorithm.
proxy.allreduce
What Needs to be Done?
Right now,
proxy.allreduce
is a reduce followed by a broadcast. We can make this more efficient by combining them into a singular allreduce algorithm.