qubole / sparklens

Qubole Sparklens tool for performance tuning Apache Spark
http://sparklens.qubole.com
Apache License 2.0
567 stars 138 forks source link

Decouple reporting from spark-app #10

Closed beriaanirudh closed 6 years ago

beriaanirudh commented 6 years ago

Copying from the related issue:

""" Right now, the simulations are run in the spark-app. This may add penalty to the app runtime.

By de-coupling simulation we can also get the additional advantage of running simulations independently on any previously-run-app. This is also a goal of de-coupling. """