search

apache-spark-on-k8s / kubernetes-HDFS

Repository holding configuration files for running an HDFS cluster in Kubernetes
Apache License 2.0
398 stars 185 forks source link

datanode's privileged mode #21

Open jpiper opened 7 years ago

jpiper commented 7 years ago

Just wondering if there's a specific reason the datanodes are being run in privileged mode? It would be a lot cleaner to not need this.

Likewise is hostPID really needed?

kimoonkim commented 7 years ago

Thanks for filing this issue.

I don't recall any particular reasons to use the privileged mode. Maybe it wasn't necessary. Ditto for hostPID.

I suggest we just try out without using them. I'm definitely curious how it would behave. I'll report back when I get the result.

jpiper commented 7 years ago

No worries. I'm probably going to try deploying this in an RBAC environment soon, and these things stood out to me. I'll also give it a whirl without the hostPID and privileged modes as well and let you know how this goes.

emcfarlane commented 6 years ago

@jpiper any updates on this?

jpiper commented 6 years ago

@afking @kimoonkim looking into this this week :)

jpiper commented 6 years ago

@afking @kimoonkim everything (including data locality) still works for me without the datanodes running privileged mode and hostPID