search

Trex-Group / trex-bigdata

11 stars 6 forks source link

[docker]关于docker安装配置的几点问题 #5

Open 75502881 opened 7 years ago

75502881 commented 7 years ago

老师您好，我在自己电脑上按照Hadoop_docker.pdf的手顺安装docker的时候， 在执行以下命令时候出错，请问是什么原因呢？

oushuhuadeiMac:Hadoop_Ubuntu_Bin oushuhua$ ./start-hbase-container.sh latest 3 start master container... start slave1 container... start slave2 container... root@master:~# cd ~ root@master:~# serf members master.trex.com 172.17.0.5:7946 alive
slave1.trex.com 172.17.0.6:7946 alive
slave2.trex.com 172.17.0.7:7946 alive root@master:~# ./configure-members.sh ./configure-members.sh: line 8: /usr/local/hbase/conf/regionservers: No such file or directory sed: can't read /usr/local/hbase/conf/hbase-site.xml: No such file or directory Warning: Permanently added 'slave1.trex.com,172.17.0.6' (ECDSA) to the list of known hosts. slaves 100% 48 0.1KB/s 00:00
Warning: Permanently added 'slave1.trex.com,172.17.0.6' (ECDSA) to the list of known hosts. scp: /usr/local/hbase/conf/regionservers: No such file or directory Warning: Permanently added 'slave1.trex.com,172.17.0.6' (ECDSA) to the list of known hosts. /usr/local/hbase/conf/hbase-site.xml: No such file or directory Warning: Permanently added 'master.trex.com,172.17.0.5' (ECDSA) to the list of known hosts. slaves 100% 48 0.1KB/s 00:00
Warning: Permanently added 'master.trex.com,172.17.0.5' (ECDSA) to the list of known hosts. scp: /usr/local/hbase/conf/regionservers: No such file or directory Warning: Permanently added 'master.trex.com,172.17.0.5' (ECDSA) to the list of known hosts. /usr/local/hbase/conf/hbase-site.xml: No such file or directory Warning: Permanently added 'slave2.trex.com,172.17.0.7' (ECDSA) to the list of known hosts. slaves 100% 48 0.1KB/s 00:00
Warning: Permanently added 'slave2.trex.com,172.17.0.7' (ECDSA) to the list of known hosts. scp: /usr/local/hbase/conf/regionservers: No such file or directory Warning: Permanently added 'slave2.trex.com,172.17.0.7' (ECDSA) to the list of known hosts. /usr/local/hbase/conf/hbase-site.xml: No such file or directory root@master:~# root@master:~# root@master:~# ls configure-members.sh run-wordcount.sh start-hbase.sh stop-hbase.sh docker-entrypoint.sh serf_log start-ssh-serf.sh zookeeper hdfs start-hadoop.sh stop-hadoop.sh root@master:~# more configure-members.sh

xenron commented 7 years ago

首先，“Warning”并不是错误信息，只是警告信息。 可以自己尝试读一下该信息的内容，大概意思是追加了一个主机到未知主机列表。

开源项目的学习过程中遇到的英文会稍多些，log日志中基本也是英文。 要继续努力啊:smile:，加油

既然已经做到了docker，可以再尝试读一下dockerfile

75502881 commented 7 years ago

老师晚上好，我执行以下命令发生连接不了的错误，是端口指定的不对吗？ hadoop jar $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar wordcount /input /output

root@master:~# hadoop jar $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar wordcount /input /output 17/03/07 13:21:16 INFO client.RMProxy: Connecting to ResourceManager at master.trex.com/172.17.0.5:8040 17/03/07 13:21:17 INFO ipc.Client: Retrying connect to server: master.trex.com/172.17.0.5:8040. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) ^Croot@master:~# root@master:~# root@master:~# netstat -tnulp | grep java tcp 0 0 0.0.0.0:50075 0.0.0.0: LISTEN 413/java
tcp 0 0 0.0.0.0:50020 0.0.0.0: LISTEN 413/java
tcp 0 0 172.17.0.5:9000 0.0.0.0: LISTEN 283/java
tcp 0 0 0.0.0.0:50090 0.0.0.0: LISTEN 576/java
tcp 0 0 127.0.0.1:40237 0.0.0.0: LISTEN 413/java
tcp 0 0 0.0.0.0:50070 0.0.0.0: LISTEN 283/java
tcp 0 0 0.0.0.0:50010 0.0.0.0: LISTEN 413/java
tcp6 0 0 172.17.0.5:8060 ::: LISTEN 833/java
tcp6 0 0 :::8042 ::: LISTEN 833/java
tcp6 0 0 172.17.0.5:8050 ::: LISTEN 833/java
tcp6 0 0 :::13562 :::* LISTEN 833/java
root@master:~# ~

2017-03-07 22 22 52

xenron commented 7 years ago

上面的错误是在docker环境发生的？ yarn是否启动了？

狭义的hadoop，实际上是由hdfs和mapreduce两部分组成的。 单独访问hdfs的话，可以不用启动yarn 但如果执行mapreduce程序的话，yarn就是必不可少的了。