LinkedInAttic / white-elephant

Hadoop log aggregator and dashboard
Other
191 stars 63 forks source link

where does it look for logs #22

Open mmmzzz opened 9 years ago

mmmzzz commented 9 years ago

Hello,

I am quite new to hadoop, when I installed white-elephant, I am stuck at statsupload.pl. What type of logs does it look for? I am getting these messages, hope someone can help me by looking at below messages: [root@tblsbamb01adv-hdp scripts]# ./statsupload.pl --config cfg.pm Checking the last 5 days in HDFS for existing data /etc/hadoop/bin/hadoop dfs -lsr hdfs://tblsbnn01adv-hdp.tdc.vzwcorp.com:50070/user/white-elephant/cisco_sandbox_hadoop/daily/default/2015/0102 /etc/hadoop/bin/hadoop dfs -lsr hdfs://tblsbnn01adv-hdp.tdc.vzwcorp.com:50070/user/white-elephant/cisco_sandbox_hadoop/daily/default/2015/0101 /etc/hadoop/bin/hadoop dfs -lsr hdfs://tblsbnn01adv-hdp.tdc.vzwcorp.com:50070/user/white-elephant/cisco_sandbox_hadoop/daily/default/2014/1231 /etc/hadoop/bin/hadoop dfs -lsr hdfs://tblsbnn01adv-hdp.tdc.vzwcorp.com:50070/user/white-elephant/cisco_sandbox_hadoop/daily/default/2014/1230 /etc/hadoop/bin/hadoop dfs -lsr hdfs://tblsbnn01adv-hdp.tdc.vzwcorp.com:50070/user/white-elephant/cisco_sandbox_hadoop/daily/default/2014/1229 /etc/hadoop/bin/hadoop dfs -lsr hdfs://tblsbnn01adv-hdp.tdc.vzwcorp.com:50070/user/white-elephant/cisco_sandbox_hadoop/daily/default/2014/1228 Found 0 existing files in HDFS

Searching /var/log/hadoop/history for logs

Uploaded 0 files, found 0 existing, skipped 0, and 0 failed