I was hoping you could provide some insight into how much pipeline communication and data parallel communication separately contributed to the communication costs. For example, as a percentage how much data transmission was needed for pipeline communication vs how much was needed for data parallel communication for a given device?
Hi, I really enjoyed your paper!
I was hoping you could provide some insight into how much pipeline communication and data parallel communication separately contributed to the communication costs. For example, as a percentage how much data transmission was needed for pipeline communication vs how much was needed for data parallel communication for a given device?