search

krausest / js-framework-benchmark

A comparison of the performance of a few popular javascript frameworks
https://krausest.github.io/js-framework-benchmark/
Apache License 2.0
6.69k stars 830 forks source link

unfair benchmarks vs real life tests #22

Closed boussou closed 7 years ago

boussou commented 8 years ago

I spent a couple of hours going over the last additions of the benchmarks.

I noticed one thing that may be important: Some frameworks have an extra overhead the first time you interact with the DOM. You can observe that when you open the console and click several time the "Create 1,000 rows" button.

Some frameworks get a 5x factor on the next calls (the 1rst call is very slow). Among them:

Some have always the same performance:

I am still wondering whether it is unfair, or not? I think the current way of doing this test (inserting a lot of rows on a blank page) is close to a real life test. Do you?

boussou commented 7 years ago

Just for the record. I find that issue interesting as it is about another facet of the comparison: memory footprint. (althought quite "extreme" case )

https://github.com/vuejs/vue/issues/4384

for a data set like 4 mb big, vue eats 85 mb. vuex eats 89mb of memory usage.

krausest commented 7 years ago

Closing this due to #104 (of course that doesn't turn this benchmark from a simple table benchmark to something more real life )