search

Isilon / isilon_hadoop_tools

Tools for Using Hadoop with OneFS
https://pypi.org/project/isilon-hadoop-tools/
MIT License
14 stars 21 forks source link

hadoop root equal to access root issue with directory path #96

Open brittup opened 3 years ago

brittup commented 3 years ago

isi hdfs settings view --zone=az6 Service: Yes Default Block Size: 128M Default Checksum Type: none Authentication Mode: simple_only Root Directory: /ifs/az6 WebHDFS Enabled: Yes Ambari Server: Ambari Namenode: ODP Version: Data Transfer Cipher: none Ambari Metrics Collector:

[INFO] Had this been for real, this is what would have happened... [WARNING] The HDFS root is the same as the zone root. [INFO] mkdir '/ifs/az6' [INFO] chmod '755' '/ifs/az6' [INFO] chown 'hdfs:hadoop' '/ifs/az6' [INFO] mkdir '/ifs/az6hbase' < -- missing '/' between the root and directory [INFO] chmod '755' '/ifs/az6hbase' [INFO] chown 'hbase:hbase' '/ifs/az6hbase' [INFO] mkdir '/ifs/az6ranger'

isi hdfs settings view --zone=az6 Service: Yes Default Block Size: 128M Default Checksum Type: none Authentication Mode: simple_only Root Directory: /ifs/az6/hadoop_root WebHDFS Enabled: Yes Ambari Server: Ambari Namenode: ODP Version: Data Transfer Cipher: none Ambari Metrics Collector:

not an issue when hadoop root is not the access zone root

[INFO] Had this been for real, this is what would have happened... [INFO] mkdir '/ifs/az6/hadoop_root/' [INFO] chmod '755' '/ifs/az6/hadoop_root/' [INFO] chown 'hdfs:hadoop' '/ifs/az6/hadoop_root/' [INFO] mkdir '/ifs/az6/hadoop_root/hbase' [INFO] chmod '755' '/ifs/az6/hadoop_root/hbase' [INFO] chown 'hbase:hbase' '/ifs/az6/hadoop_root/hbase' [INFO] mkdir '/ifs/az6/hadoop_root/ranger'

tucked commented 3 years ago

I suspect this is cosmetic...

zone_root = hdfs_root = "/ifs/az6"

https://github.com/Isilon/isilon_hadoop_tools/blob/61d0b21d13b843861657eb6baa81363d3bdc3223/src/isilon_hadoop_tools/directories.py#L60

https://github.com/Isilon/isilon_hadoop_tools/blob/61d0b21d13b843861657eb6baa81363d3bdc3223/src/isilon_hadoop_tools/directories.py#L64

https://github.com/Isilon/isilon_hadoop_tools/blob/61d0b21d13b843861657eb6baa81363d3bdc3223/src/isilon_hadoop_tools/directories.py#L65

[INFO] mkdir '/ifs/az6hbase'

  • 🐛 There's no join!

https://github.com/Isilon/isilon_hadoop_tools/blob/61d0b21d13b843861657eb6baa81363d3bdc3223/src/isilon_hadoop_tools/directories.py#L67 https://github.com/Isilon/isilon_hadoop_tools/blob/61d0b21d13b843861657eb6baa81363d3bdc3223/src/isilon_hadoop_tools/onefs.py#L1097-L1099 https://github.com/Isilon/isilon_hadoop_tools/blob/61d0b21d13b843861657eb6baa81363d3bdc3223/src/isilon_hadoop_tools/onefs.py#L660-L664