When executing the script, the error below is generated:
Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads (): subprocess failed with code 1
My environment is a cluster with 5 servers, 1 with the applications and the other forming a High Availability Hadoop cluster (2 NameNodes and 2 DataNodes).
I'm running the command where the source is in HDFS:
Hello,
When executing the script, the error below is generated: Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads (): subprocess failed with code 1 My environment is a cluster with 5 servers, 1 with the applications and the other forming a High Availability Hadoop cluster (2 NameNodes and 2 DataNodes).
I'm running the command where the source is in HDFS:
"python mr_word_freq_count.py hdfs:///mapred/u.data -r hadoop"
The script is executed from the application server.
But I've done everything and nothing works.
Locally runs normally.
I attach the Yarn log.
Thank you
Hadoop 3.2.0 Python 3.7.3
yarn_error.txt