search

prashanthsidd / BD2017

1 stars 0 forks source link

1-mapreduce-hadoop Output path on HDFS #2

Open prashanthsidd opened 7 years ago

prashanthsidd commented 7 years ago

In the first assignment there is no mention of output path on HDFS file system while running WordCount.jar. Should I generate a output folder depending on the input folder/file supplied as command line argument?

HorizonNet commented 7 years ago

You can create the output path in HDFS on-the-fly in the MapReduce program, but you can also create it before running the job. The best idea is to pass the output path as an argument to the MapReduce program.