search

rajasekarv / vega

A new arguably faster implementation of Apache Spark from scratch in Rust
Apache License 2.0
2.23k stars 205 forks source link

Use kubernetes for scheduling #19

Open whazor opened 4 years ago

whazor commented 4 years ago

Directly using kubernetes scheduling both nicely integrates into cloud providers but also saves you code to maintain.

rajasekarv commented 4 years ago

We need to have good support for multiple schedulers like Yarn, Kubernetes too. Presently only basic standalone mode is finished. I am adding this as a feature/enhancement.