dafreels
commented
4 years ago - Manage different runtimes
- GCP DataProc
- Qubole AWS
- Databricks
- Provide a pluggable architecture so new runtimes can be added
- Allow starting an Application against an environment
- Track the execution information for the job
- Copy a historical job
- Provide additional command line parameters
- Manage Providers
- Manage Tracked Jobs