search

apache-spark-on-k8s / spark

Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/
https://spark.apache.org/
Apache License 2.0
612 stars 118 forks source link

Do not add the MountSmallLocalFilesStep when there's no submitter local files #557

Closed liyinan926 closed 6 years ago

liyinan926 commented 6 years ago

What changes were proposed in this pull request?

Fixes #556. When there's no submitter local file, the MountSmallLocalFilesStep should not be added and no submitted-files secret should be created.

How was this patch tested?

Unit tests.

@mccheah @foxish

foxish commented 6 years ago

@mccheah PTAL

liyinan926 commented 6 years ago

@mccheah Can you take a look?

liyinan926 commented 6 years ago

Thanks @mccheah! Will merge on green build if no objection.