search

dask / hdfs3

A wrapper for libhdfs3 to interact with HDFS from Python
http://hdfs3.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
136 stars 40 forks source link

how does this lib access the hdfs without any username pwd? #139

Open venkat-vs-id opened 6 years ago

venkat-vs-id commented 6 years ago

can you please explain how we can add username, pwd when connecting to hdfs and what config currently allows this lib to access all hdfs without usrname?

btw my dfs.permissions.enabled config is set to true

martindurant commented 6 years ago

I'm sorry, would you mind clarifying your question?

pwd is password or working directory?

HDFS does not implement a username/password model for authentication. Security may be off, in which case your system username or the value of the user= keyword when instantiation will be used; if secured, authentication may be via kerberos (ticket cache or kinit) or via token - in both cases, the user is defined by the mechanism chosen.

There is no way to grant access to the whole of HDFS using this library. Typically user "root" has global access, but this is something configured within HDFS and no concern of hdfs3.