rajasekarv / vega

A new arguably faster implementation of Apache Spark from scratch in Rust
Apache License 2.0
2.23k stars 205 forks source link

No graceful shutdown on panic inside executors. #25

Closed iduartgomez closed 4 years ago

iduartgomez commented 4 years ago

Right now when there is a panic inside an executor the process is left open (at least in local mode) indefinitely and doe snot shutdown, the only way to terminate it is by sending SIGKILL to the master.

OS: Linux Architecture: x86_64 Replication: Just write "assert!(false)" inside a map function to be executed (MapRDD).

iduartgomez commented 4 years ago

Fixed in #75