apache-spark-on-k8s / spark

Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/
https://spark.apache.org/
Apache License 2.0
612 stars 118 forks source link

Failing submission if submitter-local files are provided, but no reso… #362

Closed sahilprasad closed 7 years ago

sahilprasad commented 7 years ago

…urce staging URI is given (#339)

Validating the behavior as per the issue.

foxish commented 7 years ago

/cc @mccheah @ash211

foxish commented 7 years ago

This will likely not be applicable following the major redesign in https://github.com/apache-spark-on-k8s/spark/pull/365

mccheah commented 7 years ago

@foxish It's still applicable but it needs to be written into the new design. We can punt on this PR for now and re-write it with the new design - shouldn't be too difficult.

mccheah commented 7 years ago

Or we can merge as-is and rewrite it into the new design PR.

erikerlandson commented 7 years ago

@foxish @mccheah did this get folded into the submission refactoring?

mccheah commented 7 years ago

Ah, I don't think so - can this be rebased and re-worked accordingly?

sahilprasad commented 7 years ago

@mccheah sure thing. Since it's such a small fix, I'll close this PR for now, and open another once I've refactored.