Isilon / isilon_hadoop_tools

Tools for Using Hadoop with OneFS
https://pypi.org/project/isilon-hadoop-tools/
MIT License
14 stars 21 forks source link

sqoop2 in sqoop or sqoop in sqoop2 #21

Closed dmtucker closed 7 years ago

dmtucker commented 7 years ago

In the CDH path, we add sqoop2 to the sqoop group on OneFS:

    #Deal with special cases on Isilon 
    isi auth groups modify sqoop$CLUSTER_NAME --add-user sqoop2$CLUSTER_NAME --zone $ZONE
        [ $? -ne 0 ] && addError "Could not add user sqoop2$CLUSTER_NAME to sqoop$CLUSTER_NAME group in zone $ZONE"

However, we add sqoop to the sqoop2 group in the group file:

        #Set some varliables to take these special case group assignments to the group file
        sqp=`grep sqoop2$CLUSTER_NAME $grpfile`
        hve=`grep hive$CLUSTER_NAME $grpfile`

    #manipulate the group file for special cases
        sed -i .bak /$sqp/d $grpfile
        echo "$sqp,sqoop" | cat >> $grpfile
        [ $? -ne 0 ] && addError "Could not add user sqoop2$CLUSTER_NAME to sqoop$CLUSTER_NAME group in $grpfile"
# use this file to add to the group file of your clients
hdfs:x:1000:
mapred:x:1001:
yarn:x:1002:
HTTP:x:1003:
cloudera-scm:x:1004:
accumulo:x:1005:
flume:x:1006:
hbase:x:1007:
httpfs:x:1009:
hue:x:1010:
apache:x:1011:
impala:x:1012:
kafka:x:1013:
kms:x:1014:
keytrustee:x:1015:
kudu:x:1016:
llama:x:1017:
oozie:x:1018:
solr:x:1019:
spark:x:1020:
sentry:x:1021:
sqoop:x:1022:
zookeeper:x:1024:
anonymous:x:1025:
cmjobuser:x:1026:
hadoop:x:1027:,hdfs,mapred,yarn,HTTP
supergroup:x:1028:,hdfs,mapred,yarn,HTTP
sqoop2:x:1023:,sqoop
hive:x:1008:,impala

Given the error messages, I think we want the former.

bonibruno commented 7 years ago

Fixed.