openxla / xla

A machine learning compiler for GPUs, CPUs, and ML accelerators
Apache License 2.0
2.64k stars 418 forks source link

[XLA:MSA] Implement an auxiliary function to simulate the bandwidth sharing between memory requests. #14885

Open copybara-service[bot] opened 3 months ago

copybara-service[bot] commented 3 months ago

[XLA:MSA] Implement an auxiliary function to simulate the bandwidth sharing between memory requests.

We implement an auxiliary function to simulate the process of draining memory request queues. There are two queues which track the read/write-default memory requests. When both queues are not empty, they need to share the bandwidth to process the front requests.