search

datadudes / athena

Interact with your Hadoop cluster from the convenience of your local command line.
14 stars 1 forks source link

Use Snakebite for HDFS commands #19

Open DonDebonair opened 9 years ago

DonDebonair commented 9 years ago

This is so much better than doing it over SSH.

DonDebonair commented 9 years ago

Apparently Snakebite doesn't support commands that require communication with the datanode(s) yet. It seems that there is no ETA for supporting this. A better option seems to be, to use pywebhdfs for working with HDFS. pywebhdfs isn't feature-complete either, but has support for writing to HDFS, so copyFromLocal-like functionality should be no problem. Another advantage is that webhdfs is a simpler protocol than the protobuf communication that happens in Snakebite, therefor it should be much easier to contribute to pywebhdfs for any missing features (chown/chmod come to mind).