Storm components for interacting with HDFS file systems
Apache License 2.0
61
stars
59
forks
source link
HDFS run job:org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid local directory for ttprivate/taskTracker/root/jobcache/job_201410161548_0035/jobToken #20
master:/home/hadoop-1.1.2 # hadoop jar /home/mahout/mahout-distribution-0.8/mahout-examples-0.8-job.jar org.apache.mahout.clustering.syntheticcontrol.kmeans.Job
Warning: $HADOOP_HOME is deprecated.
14/12/10 18:50:23 INFO kmeans.Job: Running with default arguments
14/12/10 18:50:23 INFO kmeans.Job: Preparing Input
14/12/10 18:50:24 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
14/12/10 18:50:24 INFO input.FileInputFormat: Total input paths to process : 1
14/12/10 18:50:24 INFO util.NativeCodeLoader: Loaded the native-hadoop library
14/12/10 18:50:24 WARN snappy.LoadSnappy: Snappy native library not loaded
14/12/10 18:50:25 INFO mapred.JobClient: Running job: job_201410161548_0035
14/12/10 18:50:26 INFO mapred.JobClient: map 0% reduce 0%
14/12/10 18:50:26 INFO mapred.JobClient: Task Id : attempt_201410161548_0035_m_000002_0, Status : FAILED
Error initializing attempt_201410161548_0035_m_000002_0:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid local directory for ttprivate/taskTracker/root/jobcache/job_201410161548_0035/jobToken
at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:381)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:146)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:127)
at org.apache.hadoop.mapred.TaskTracker.localizeJobTokenFile(TaskTracker.java:4492)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1285)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker$5.run(TaskTracker.java:2603)
at java.lang.Thread.run(Thread.java:722)
master:/home/hadoop-1.1.2 # hadoop jar /home/mahout/mahout-distribution-0.8/mahout-examples-0.8-job.jar org.apache.mahout.clustering.syntheticcontrol.kmeans.Job Warning: $HADOOP_HOME is deprecated.
14/12/10 18:50:23 INFO kmeans.Job: Running with default arguments 14/12/10 18:50:23 INFO kmeans.Job: Preparing Input 14/12/10 18:50:24 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 14/12/10 18:50:24 INFO input.FileInputFormat: Total input paths to process : 1 14/12/10 18:50:24 INFO util.NativeCodeLoader: Loaded the native-hadoop library 14/12/10 18:50:24 WARN snappy.LoadSnappy: Snappy native library not loaded 14/12/10 18:50:25 INFO mapred.JobClient: Running job: job_201410161548_0035 14/12/10 18:50:26 INFO mapred.JobClient: map 0% reduce 0% 14/12/10 18:50:26 INFO mapred.JobClient: Task Id : attempt_201410161548_0035_m_000002_0, Status : FAILED Error initializing attempt_201410161548_0035_m_000002_0: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid local directory for ttprivate/taskTracker/root/jobcache/job_201410161548_0035/jobToken at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:381) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:146) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:127) at org.apache.hadoop.mapred.TaskTracker.localizeJobTokenFile(TaskTracker.java:4492) at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1285) at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226) at org.apache.hadoop.mapred.TaskTracker$5.run(TaskTracker.java:2603) at java.lang.Thread.run(Thread.java:722)
14/12/10 18:50:26 WARN mapred.JobClient: Error reading task outputhttp://slave2:50060/tasklog?plaintext=true&attemptid=attempt_201410161548_0035_m_000002_0&filter=stdout 14/12/10 18:50:26 WARN mapred.JobClient: Error reading task outputhttp://slave2:50060/tasklog?plaintext=true&attemptid=attempt_201410161548_0035_m_000002_0&filter=stderr