I would like to request a feature that tracks and displays memory usage during the execution of benchmarks within the Metriq benchmarking app. This feature would provide valuable insights into resource consumption, particularly in resource-constrained environments.
if we can Track the maximum memory usage (ru_maxrss) of the benchmarking process in real-time.
that can Provide the memory usage in MB as part of the benchmark's metadata.
and Include the option to visualize memory usage alongside other benchmark metrics.
Add memory usage as a parameter in existing plots, such as score vs. memory usage, to help users better understand the trade-offs.
This feature would be useful for comparing the efficiency of different backends, particularly in scenarios where memory constraints are critical.
It will also help in diagnosing memory-related bottlenecks and optimizing performance.
Ideally, the memory usage tracking should integrate seamlessly with existing features, such as plotting correlations between benchmark metrics and backend performances.
. Automating this process within Metriq would save time and provide a more comprehensive benchmarking experience
I would like to request a feature that tracks and displays memory usage during the execution of benchmarks within the Metriq benchmarking app. This feature would provide valuable insights into resource consumption, particularly in resource-constrained environments. if we can Track the maximum memory usage (ru_maxrss) of the benchmarking process in real-time. that can Provide the memory usage in MB as part of the benchmark's metadata. and Include the option to visualize memory usage alongside other benchmark metrics. Add memory usage as a parameter in existing plots, such as score vs. memory usage, to help users better understand the trade-offs. This feature would be useful for comparing the efficiency of different backends, particularly in scenarios where memory constraints are critical. It will also help in diagnosing memory-related bottlenecks and optimizing performance. Ideally, the memory usage tracking should integrate seamlessly with existing features, such as plotting correlations between benchmark metrics and backend performances. . Automating this process within Metriq would save time and provide a more comprehensive benchmarking experience