Add memory visualization tool for buffer assignment of HLO graph. The input for this script will be a file formatted as *-buffer-assignment.txt, such as module_0006.SyncTensorsGraph.26044.sm_8.0_gpu_after_optimizations-buffer-assignment.txt.
Usage:
python tools/plot_mem.py --input {file_name}
Example image:
The blue sections in the diagram represent the lifetime and buffer usage of tensors. Each tensor is depicted as a rectangle, where the length represents its lifespan, and the width represents its size. The starting position on the vertical axis indicates the offset within all Allocations.
The purple sections represent the cumulative GPU memory occupied by all tensors at each point in time.
The middle part of the red line represents the composition of buffers in the Allocation.
Add memory visualization tool for buffer assignment of HLO graph. The input for this script will be a file formatted as
*-buffer-assignment.txt
, such asmodule_0006.SyncTensorsGraph.26044.sm_8.0_gpu_after_optimizations-buffer-assignment.txt
.Usage:
Example image: