nodejs / benchmarking

Node.js Benchmarking Working Group
https://benchmarking.nodejs.org
161 stars 47 forks source link

Investigate the time taken, and number of benchmarks in core #225

Open gareth-ellis opened 6 years ago

gareth-ellis commented 6 years ago

This is the starting place to begin running core benchmarks on a regular basis.

First steps: Put together a benchmark run that summarises time to run each suite as well as record number of results out of the run.

Then, at a future meeting: Look at results, decide on a subset to run on a regular basis that can fit into the time available and can be summarised appropriately.

gareth-ellis commented 6 years ago

@mhdawson i'm writing a script to go through and collect the runtime for each core benchmark - could you create me a temporary job in jenkins I can modify and use to run this?

mhdawson commented 6 years ago

Here you go https://ci.nodejs.org/job/benchmark-node-micro-benchmarks-gareth/

mhdawson commented 5 years ago

Closing as we have not made progress. @gabrielschulhof is going to write a proposal for an alternate approach.

gabrielschulhof commented 5 years ago

Spreadsheet tracking relative importance of benchmarks:

https://docs.google.com/spreadsheets/d/17ey-6r_sTVYpy6Zv0n55kqkVgqRf67aaf6Ub7eebGgo/edit#gid=0

gabrielschulhof commented 5 years ago

... and the survey: https://docs.google.com/forms/d/1BlVwIYZPBBmR46Ru3okvddLiPj5Zy03XPE2kyW55VzQ/edit

gabrielschulhof commented 4 years ago

Here's a spreadsheet with the processed responses where the benchmarks are sorted in order of popularity:

https://docs.google.com/spreadsheets/d/1_7VrAFO8K9KdQW8qEmnKnVBb514SMRqYiitoDu_cMiM/edit#gid=979605