Open hildrum opened 8 years ago
This is cool to see. Congrats.
What is the status of this?
The three checked-off items are done. Pull request 1104 adds support for hadoop jobs and uses PKB-created hadoop clusters. It also reworks the hadoop_terasort_benchmark to use the framework.
The next step is to add a PKB-installed spark, and the support for setting cluster properties.
It'd be super-nice to add support for HDInsights (currently just AWS and GCP are supported), but I don't know if I'm going to have time.
Hi,
Is there any progress on 'PKB-installed spark' item?
Regards, Mateusz