I just realized that the baselines MPI stuff is if you have multiple GPUs, not for multiple instances.
So we really don't want to log every instance as we do here, it should really only log if rank == 0 and other wise the log should be disabled, as we had before.
mwhittaker
commented
6 years ago
I just realized that the baselines MPI stuff is if you have multiple GPUs, not for multiple instances.
So we really don't want to log every instance as we do here, it should really only log if rank == 0 and other wise the log should be disabled, as we had before.
My mistake.