Intel-bigdata / HiBench

HiBench is a big data benchmark suite.
Other
1.45k stars 761 forks source link

for single node hadoop configuration #735

Open vishnusvk27 opened 11 months ago

vishnusvk27 commented 11 months ago

root@vishnu:/usr/local/HiBench# bin/workloads/micro/wordcount/prepare/prepare.sh patching args= Parsing conf: /usr/local/HiBench/conf/hadoop.conf Parsing conf: /usr/local/HiBench/conf/hibench.conf Parsing conf: /usr/local/HiBench/conf/workloads/micro/wordcount.conf probe sleep jar: /home/hdoop/hadoop-3.3.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.3.1-tests.jar start HadoopPrepareWordcount bench hdfs rm -r: /home/hdoop/hadoop-3.3.1/bin/hadoop --config /home/hdoop/hadoop-3.3.1/etc/hadoop fs -rm -r -skipTrash hdfs://localhost:8020/HiBench/Wordcount/Input rm: Call From vishnu/10.2.0.5 to localhost:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apach... Submit MapReduce Job: /home/hdoop/hadoop-3.3.1/bin/hadoop --config /home/hdoop/hadoop-3.3.1/etc/hadoop jar /home/hdoop/hadoop-3.3.1/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.1.jar randomtextwriter -D mapreduce.randomtextwriter.totalbytes=32000 -D mapreduce.randomtextwriter.bytespermap=8000 -D mapreduce.job.maps=4 -D mapreduce.job.reduces=4 hdfs://localhost:8020/HiBench/Wordcount/Input ... 47 more ERROR: Hadoop job /home/hdoop/hadoop-3.3.1/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.1.jar randomtextwriter failed to run successfully. Hint: You can goto /usr/local/HiBench/report/wordcount/prepare/conf/../bench.log to check for detailed log. Opening log tail for you:

    at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:777)
    at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
    at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:586)
    at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:701)
    at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:822)
    at org.apache.hadoop.ipc.Client$Connection.access$3800(Client.java:414)
    at org.apache.hadoop.ipc.Client.getConnection(Client.java:1647)
    at org.apache.hadoop.ipc.Client.call(Client.java:1463)
    ... 47 more