search

greensoftwarelab / Energy-Languages

The complete set of tools for energy consumption analysis of programming languages, using Computer Language Benchmark Game
MIT License
688 stars 111 forks source link

Is Javascript being benchmarked with an outdated version of NodeJS? #20

Closed asparagii closed 3 years ago

asparagii commented 3 years ago

Javascript and Typescript benchmarks are using Node.js v7.9.0, which was released on 2017-04-11 and uses v8 version 5.5.372.43. Is there a specific reason to use such an old Node release? I think that using an outdated version of v8 might invalidate the benchmark results.

I think we should use the oldest maintainance LTS (Dubnium, v10.22.1, running v8 version 6.8.275.32), or maybe the active LTS (Erbium, v12.19.0, running v8 version 7.8.279.23)

States commented 3 years ago

The compiler versions used in this benchmark were based on a study executed in 2017 (https://sites.google.com/view/energy-efficiency-languages), which in turn used the compiler versions which were officially used in the Computer Language Benchmarks Game (https://benchmarksgame-team.pages.debian.net/benchmarksgame/index.html) at that time.

Since, many compilers/interpreters have updated. Anyone is free to use our benchmarks and update accordingly. The settings currently present, are those of which were published however.

asparagii commented 3 years ago

I understand the reasoning, thank you