littleinc / android-orm-benchmark

This repo is no longer maintained, please go to:
https://github.com/daj/android-orm-benchmark
Apache License 2.0
24 stars 21 forks source link

Stop process between each test #1

Open chrisjenx opened 10 years ago

chrisjenx commented 10 years ago

Java/Dalvik optimise code as they are run, if GreenDAO ORMLite call similar methods the test running last will actually be automatically optimised.

You ideally need to cold start every test to get anything near to a 'reliable' benchmark (if such thing exists).

daj commented 10 years ago

Thanks for the suggestion. I'm pretty sure we did at least some of the performance tests with a cold start for each test (i.e. we only ran one of the executers per launch).

I don't know much about VM optimizations, but as each test involves lots of looping, and each set of tests is run 5 times I'd hope all tests would benefit from any optimizations.