apache-spark-on-k8s / spark

Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/
https://spark.apache.org/
Apache License 2.0
612 stars 118 forks source link

Refactor for Hadoop conf related code #596

Closed hex108 closed 6 years ago

hex108 commented 6 years ago

What changes were proposed in this pull request?

When doing some refactor for #585 , I find that it will help a lot to do some refactor for Hadoop conf related code. It might be better to split a separate and small PR for it.

(Please fill in changes proposed in this fix)

How was this patch tested?

Unit tests.

hex108 commented 6 years ago

@liyinan926 PTAL. Thanks!

hex108 commented 6 years ago

Integration Test error is environment related.

liyinan926 commented 6 years ago

rerun integration tests please

liyinan926 commented 6 years ago

LGTM. Will merge once integration tests pass.

ifilonenko commented 6 years ago

Thank you for your work on this!

hex108 commented 6 years ago

Thanks!