search

bio-guoda / guoda-services

Services provided by GUODA, currently a container for tickets and wikis.
MIT License
2 stars 0 forks source link

Install NFS gateway on HDFS cluster to facilitate data workflows #48

Closed mjcollin closed 6 years ago

mjcollin commented 6 years ago

New data work flows (backups, archiving old data, syncs to other sites) would be easier with an NFS gateway on the HDFS storage cluster.

Will need to re-start HDFS name node service to do so which will interrupt HDFS access, schedule a time.

mjcollin commented 6 years ago

Fri 4/6 or 4/7 midnight to noon.

Anne says she pauses her checklist scripts every day from midnight to noon.

mjcollin commented 6 years ago

General documentation: https://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-hdfs/HdfsNfsGateway.html

mjcollin commented 6 years ago

Commands to package:

root@mesos01:~# $HADOOP_PREFIX/sbin/hadoop-daemon.sh --script $HADOOP_PREFIX/bin/hdfs start portmap
hdfs@mesos01:~$ HADOOP_ROOT_LOGGER=WARN,DRFA $HADOOP_PREFIX/sbin/hadoop-daemon.sh --script $HADOOP_PREFIX/bin/hdfs start nfs3
mjcollin commented 6 years ago

Done, in Salt, and mounted on moose.