skanduri1987 / SEBC

0 stars 0 forks source link

Storage labs #4

Open skanduri1987 opened 6 years ago

skanduri1987 commented 6 years ago

Copying data from One cluster to Other Cluster

Teragen and Tersort Some Test:

Commands:

Teragen:

[hdfs@instance-1 ~]$ time yarn jar /opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce/hadoop-examples.jar teragen -Dmapred.map.tasks=4 -Ddfs.block.size=33554432 1000000 /user/skand uri1987/teragentest

Terasort Execution

[hdfs@instance-1 ~]$ time yarn jar /opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce/hadoop-examples.jar terasort /user/skanduri1987/teragentest /user/skanduri1987/terasortoutput

skanduri1987 commented 6 years ago

NN HA Configuration: Screen shot is updated in the directory