search

MIDS-scaling-up / coursework

61 stars 84 forks source link

Additional instructions / typo #17

Open EvanKepner opened 9 years ago

EvanKepner commented 9 years ago

Hi all -

I was able to get this running successfully. A few points that may help other people out:

  1. I didn't have a masters file in the /usr/local/hadoop/etc/hadoop folder. Creating the file and adding the master line worked just fine.
  2. mapred-site.xml needs to be copied from mapred-site.xml.template before making any edits
  3. There's a broken line on the config text for yarn-site.xml, if you copy paste and don't join the line you'll get an error starting the namenode services: 
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</
name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>

Should be: 

<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
NosajGithub commented 9 years ago

Thanks Evan! These were helpful points.

sarahneff commented 9 years ago

Yes thank you for this as well.

taylorma commented 9 years ago

Thanks a bunch Evan. The #3 one caught me just now.