Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/
This will act as a running list of issues that need to be resolved for a stable Secure HDFS solution.
@kimoonkim @liyinan926 add more which you feel are appropriate
[ ] Resolution of Yarn configs in K8S world
[ ] Unit test that simulates file system for keytab resolution in Secure HDFS
[ ] Having KerberosBootstrap be passed into the keytab resolution step
[ ] Integration test for HDFS File Mounting
A PR will be released for this shortly as part of #514
[ ] Integration test for Secure HDFS interaction
A PR will be released for this shortly as part of #514
[ ] Secure HDFS Renewal Service
If all are checked, we may begin merging with upstream
This will act as a running list of issues that need to be resolved for a stable Secure HDFS solution. @kimoonkim @liyinan926 add more which you feel are appropriate
If all are checked, we may begin merging with upstream