nsavageJVM
commented
9 years ago Also the maven pom file doesn't seem to download all the libraries required
the hadoop dependencies will be dependent on the platform
" Failed to set permissions of path:" from the error you dont seem to rwx permissions at the path location
the course is there to illustrate high level principles mainly and you will definite need to fine tune things for different java run-times, hadoop versions, cluster environments and architectures
try running as administrator
for vagrantfile and provision.sh i will look at this when i get some free time
Hi there, I'm taking your BIg Data Course on Udemy and I'm stuck at Lecture 31 - the code used isn't exactly what was put on Lecture 27 (the first in that section) and when I run it on windows it gives the error below. Also the maven pom file doesn't seem to download all the libraries required. You have hadoop source code in your project directory but you haven't mentioned what you're doing with it yet. I've enjoyed the course so far and I'd like to get other people in work to take it too. Also it'd be really handy if you could put all the vagrantfile and provision.sh files you have up into github - when you copy & paste them from the lecture pdfs it really screws up the character encoding and I've wasted a lot of time getting them running. Thanks for your help, Donal
Exception in thread "main" java.io.IOException: Failed to set permissions of path: \tmp\hadoop-madded1\mapred\staging\madded1260026733.staging to 0700 at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:691) at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:664) at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:514) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:349) at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:193) at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:126) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:942) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:936) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:910) at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1353) at org.eduonix.PartitionGenerator.main(PartitionGenerator.java:116)