i have a problem to pass an additional command line argument ((--target) to an MRJob on a hadoop (v2.7.3.2.6.5.0) cluster. The argument is introduced via self.add_passthru_arg in def configure_args(self) in a python script called micIteration.py
The argument is correctly processed on my local computer but when I try to run the same job on a hadoop cluster it says
Usage: micIteration.py [options] [input files]
micIteration.py: error: no such option: --target
Hi,
i have a problem to pass an additional command line argument ((--target) to an MRJob on a hadoop (v2.7.3.2.6.5.0) cluster. The argument is introduced via self.add_passthru_arg in def configure_args(self) in a python script called micIteration.py
The argument is correctly processed on my local computer but when I try to run the same job on a hadoop cluster it says Usage: micIteration.py [options] [input files] micIteration.py: error: no such option: --target
Complete call python micIteration.py -r hadoop --hadoop-streaming-jar /usr/hdp/2.6.5.0-292/hadoop-mapreduce/hadoop-streaming.jar --target=100 input_file.txt
Any advice?
Cheers, Ralf