cloudmesh-book / book-latex-2018

Handbook of Cloud and Big Data: Theory and Practice
https://tinyurl.com/vonLaszewski-handbook
4 stars 27 forks source link

Make the example of pagerank for hadoop docker work #117

Closed minchen57 closed 6 years ago

minchen57 commented 6 years ago

The previous example of pagerank for hadoop docker does not work anymore for two reasons:

  1. the script compileAndExecHadoopPageRank.sh is based on compiled binaries and Jar file, which are removed recently, so I add the command to compile from source
  2. "hadoop dfs " has been a deprecated command, we should use either "hadoop fs" or "hdfs dfs", therefore I replace them accordingly

I also added a md file section/container/docker-pagerank-example-instruction.md, this contains the information of how to run this example, which is missing from the section. This information could be added to docker-hadoop.tex, I need to talk to the TA or instructor tomorrow to get more information on this.