microsoft / mimalloc

mimalloc is a compact general purpose allocator with excellent performance.
MIT License
10.4k stars 840 forks source link

Periodic releases of benchmarking results? #290

Open Leedehai opened 4 years ago

Leedehai commented 4 years ago

Hi, wondering if this is a long-term commitment for the mimalloc team to release benchmarking results [1] periodically (say, once or twice a year)?

[1] That is, the charts and analysis in the current README.md, where mimalloc, tcmalloc, jemalloc, etc. are put to test under various benchmarking cases.

Further, is this a long-term project that will be maintained, or a one-off research project? (given its short history since release).

daanx commented 4 years ago

Hi @Leedehai, apologies for the late response; the plan is to update benchmarks maybe once a year, even with the automation it is quite some work to do this well, especially ensuring we use the latest working versions of all other allocators etc. Mimalloc itself is not quite a research project anymore and is used on critical services and workloads 24/7 on thousands of machines and will be maintained.

yvoinov commented 3 years ago

Hi @Leedehai, apologies for the late response; the plan is to update benchmarks maybe once a year, even with the automation it is quite some work to do this well, especially ensuring we use the latest working versions of all other allocators etc. Mimalloc itself is not quite a research project anymore and is used on critical services and workloads 24/7 on thousands of machines and will be maintained.

BTW, which tool you using for plot graph results for benchmark? Found nothing documentation about this part here. Hm?