[PYTHON] Add support for easily packaging dependencies

apache-spark-on-k8s / spark

Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/

https://spark.apache.org/

Apache License 2.0

612 stars 118 forks source link

[PYTHON] Add support for easily packaging dependencies #574

Open holdenk opened 6 years ago

holdenk commented 6 years ago

One of the big frustrations user have with PySpark on YARN is dependency management.