search

chakra-core / ChakraCore

ChakraCore is an open source Javascript engine with a C API.
MIT License
9.13k stars 1.2k forks source link

Benchmarks #6431

Open ppenzin opened 4 years ago

ppenzin commented 4 years ago

Contents of test/benchmarks

ARES-6
jetstream
Kraken
Octane
Octane_Closure
SunSpider

Should we add or update anything? One thing I can think from the top of my head, is that Jetstream has a new version (which also includes Wasm).

@chicoxyzzy and @zenparsing what do you think about this from set standards point of veiw?

@RTSMikeM, since you brought up an interesting use for the engine, do you have any input into how you would see evaluating its performance?

rhuanjl commented 4 years ago

One point currently impacting all of these - Date.now within chakracore has a 5ms jitter on it intended to mitigate against timing attacks - as this is used for measuring these benchmarks it can produce a lot of noice.

Just as there's a request for a monotonic now for test262 purposes we probably want an equivalently reliable function for benchmarking.

Also a different note: there's a perl script for running the benchmarks (perhaps something to change to python for consistency) but it won't run ARES-6, currently you have to manage that seperately - something to consider changing.