mathiasbynens / jsperf.com

jsPerf.com source code
http://jsperf.com/
Other
473 stars 56 forks source link

Run test cases in random order #159

Closed dleppik closed 10 years ago

dleppik commented 10 years ago

Just-In-Time compilers can have extremely different performance characteristics, depending on other code that has already been compiled and optimized. In some cases, one test may inadvertently optimize or pessimize another test. For this reason, the tests should be run in random order.

jdalton commented 10 years ago

We won't be introducing random run order. We do allow you to manually choose the order by clicking on the test title. We generate a new test per sample with random characters to the var names. Your concern can possibly be handled by putting code in your setup.

Do you have a real world test case to point to?

collinanderson commented 10 years ago

it would help me with my test: http://jsperf.com/jquery-load-time