unable to get stats for execution engines Tez,spark.

linkedin / dr-elephant

Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark

Apache License 2.0

1.35k stars 859 forks source link

unable to get stats for execution engines Tez,spark. #691

Open ashokhellboy opened 4 years ago

ashokhellboy commented 4 years ago

@akshayrai @shankar37 Please help me on this.

I have configured new webUI for Dr.elephant, but could able to see the stats if the job ran with hive.execution.engine=mr only. If I try the same query with TEZ it doesn't show up, same goes with spark-shell also.

Any parameters needs to be added in Fetcherconf.xml for tez and spark ?

ashokhellboy commented 4 years ago

Any suggestions of adding params would be more helpful

ashokhellboy commented 4 years ago

@akshayrai @ljank Can you please help me on this ?

ashokhellboy commented 4 years ago

Can anyone please suggest me for hadoop jobs , for tez execution engine ?

ShubhamGupta29 commented 4 years ago

@ashokhellboy do you see any error in thedr_elephant.log file?