nodejs / benchmarking

Node.js Benchmarking Working Group
https://benchmarking.nodejs.org
161 stars 47 forks source link

Benchmarking Heap/Memory Used #295

Open mmarchini opened 5 years ago

mmarchini commented 5 years ago

Today our benchmarks are focused on execution time and ops/s. It would be interesting to have benchmarks for memory consumption as well, both on https://benchmarking.nodejs.org/ and on core benchmarks. Memory can be tricky to measure though: should we get the peak memory used by the process, the accumulated memory over the course of execution, or the memory at the end of the benchmark? I like the second metric, but I don't know how to get it. Has anyone tried/thought about this before?

mhdawson commented 5 years ago

There are memory consumption ones in the ACME air and Node-DCEIS. For example: https://benchmarking.nodejs.org/charts/acmeair_prefootprint.png and nchmarking.nodejs.org/charts/acmeair_postfootprint.png(although it does no look like there might be some problems with the latest results).

These two capture the memory before/after running ACME Air. and the scripts are here: https://github.com/nodejs/benchmarking/tree/master/experimental/benchmarks/acmeair