search

linkedin / dr-elephant

Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark
Apache License 2.0
1.35k stars 859 forks source link

Error couldn't invoke class com.Linkedin.dr.elephant.tez.fetchers.TezFetcher #404

Open pithanimohan opened 6 years ago

pithanimohan commented 6 years ago

Hello,

I'm trying to install and run dr elephant. I have successfully compiled and got the zip file. However, when I run the start.sh the message shows Dr.elephant started but does nothing.

I have attached the error screenshot of dr.log.

My Dr Elephant web UI doesn't open. nothing shows up.

Please help me..

Thanks Mohan.P error2

daming000 commented 6 years ago

Comment Related lines

pithanimohan commented 6 years ago

Hi, @daming000 @akshayrai @nntnag17

May I know what information you need?

I'm new to Bigdata Ecosystem. I was given this new assignment where I would have to evaluate Dr Elephant and come up with a report. I'm trying to run this on VM which has hadoop. However, I'm stuck with this error.

It would also help if you can provide the hadoop conf mandatory attributes which are required to run dr.E

I have attached all the log files I have with me.

dr.log application.log dr_elephant.log

I would highly appreciate any help which will help me resolve this issue.

Thanks and regards Mohan.P

Windyhe commented 6 years ago

The same bugs occur for me. Commenting related lines in FetcherConf.xml helps resolving that. However, can Dr. E fetch TEZ metrics after commenting the only TEZ fetcher?

Finally I found it is Tez configuration which leads failure for me. Adding timeline-server service relevant parameters fixed the bug . Refer to tez-ui for detailed configuration. Hope that helps.

chrevanthreddy commented 6 years ago

I looked at the logs. Looks like this URL is not accessible to Dr. Elephant. Can you verify access to time line server on your cluster please. http:///ws/v1/timeline/

nutscrack commented 5 years ago

Hi @akshayrai @nntnag17

I would greatly appreciate your assistance with starting dr-elephant properly.

I had the same TezFetcher related error specified in dr.log file above, so I commented out the TEZ fetcher in /app-conf/FetcherConf.xml file and now Dr. Elephant starts. However, when I open dr-elephant in WEB browser, I see that no analysis has been done: 27698422-b8dec836-5d14-11e7-8998-2c9795788599

In addition, dr_elephant.log file is not created in /logs/elephant/ directory. Please advise how to make dr-elephant present analysis. Thanks.