[XLA:MSA] Implement an auxiliary function to simulate the async memory request overhead.
The off-the-shelf runtime predictor does not include the overhead of asynchronous copies. We need to simulate the memory system to get the overhead of these copies. We implement an auxiliary function is this patch to simulate the bandwidth sharing model. This function can be further used to support end2end simulator that involves async copies.
[XLA:MSA] Implement an auxiliary function to simulate the async memory request overhead.
The off-the-shelf runtime predictor does not include the overhead of asynchronous copies. We need to simulate the memory system to get the overhead of these copies. We implement an auxiliary function is this patch to simulate the bandwidth sharing model. This function can be further used to support end2end simulator that involves async copies.