Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/
As reported in #620 invalid secret names are being generated by Spark on K8S. This commit adds atoLowerCase to the generated name to pass the validation regex. The specific problem is that the current name generation creates a segment containing K8S requires that each segment start with an alphabetic character.
How was this patch tested?
Tested against a secure HDFS cluster to verify successful mounting of the Hadoop Kerberos secret volume
rvesse
commented
6 years ago
As reported in #620 invalid secret names are being generated by Spark on K8S. This commit adds a
toLowerCaseto the generated name to pass the validation regex. The specific problem is that the current name generation creates a segment containing K8S requires that each segment start with an alphabetic character.How was this patch tested?
Tested against a secure HDFS cluster to verify successful mounting of the Hadoop Kerberos secret volume