can we reproduce results of Ousterhout et al for Spark?

ivotron / quiho-popper

Popper repository for the quiho paper

BSD 3-Clause "New" or "Revised" License

0 stars 0 forks source link

can we reproduce results of Ousterhout et al for Spark? #3

Open ivotron opened 7 years ago

ivotron commented 7 years ago

Can we do performance sensitivity analysis on Spark and arrive to the same results presented in [1]? In this case, we need to take into account network, IO, memory and CPU performance.

1: http://people.eecs.berkeley.edu/~keo/publications/nsdi15-final147.pdf

ivotron commented 6 years ago

Roadmap:

[ ] read nsdi '15 paper
[ ] add ability to request specific clusters on cloudlab (#12)
[ ] create datapackage for the experiment (#13)
[ ] run on all the 10 different hardware setups
[ ] analyze results

More will be added based on the outcome of the analysis