Closed lucidfrontier45 closed 7 years ago
I added gzip and bzip2 file support for mapper input.
The current dumbo seems only support this kind of mapreduce in local mode. cat input | mapper | sort | reducer > output
cat input | mapper | sort | reducer > output
What I added works like this. zcat input | mapper | sort | reducer > output bzcat input | mapper | sort | reducer > output
zcat input | mapper | sort | reducer > output
bzcat input | mapper | sort | reducer > output
I added gzip and bzip2 file support for mapper input.
The current dumbo seems only support this kind of mapreduce in local mode.
cat input | mapper | sort | reducer > outputWhat I added works like this.
zcat input | mapper | sort | reducer > outputbzcat input | mapper | sort | reducer > output