Comparison of the memory fields in the summary benchmarks is unintuitive.
Pandas sorts the fields in alphabetical order and because the memory tracking fields are not named with a common prefix in the current benchmarking code it ends up printing the report with memory values in columns far apart from each other in the table (see below image).
Proposed Solution
Renaming all memory values with a common mem_ prefix like the following
Description
Comparison of the memory fields in the summary benchmarks is unintuitive.
Pandas sorts the fields in alphabetical order and because the memory tracking fields are not named with a common prefix in the current benchmarking code it ends up printing the report with memory values in columns far apart from each other in the table (see below image).
Proposed Solution
Renaming all memory values with a common
mem_
prefix like the followingmem_nvidia_peak_reserved
mem_torch_peak_allocated
mem_torch_allocated
Update: Also remove the
index
column is introduced into the benchmark file.This way when the results are gathered and exported to csv, the columns are grouped together intuitively for comparison.