Adding more conditions to add Azkaban logs to TonY ExceptionFingerprinting results

linkedin / dr-elephant

Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark

Apache License 2.0

1.35k stars 859 forks source link

Adding more conditions to add Azkaban logs to TonY ExceptionFingerprinting results #681

Closed ShubhamGupta29 closed 4 years ago

ShubhamGupta29 commented 4 years ago

DESCRIPTION Improved the logic in TonY exceptionFingerprinting of adding Azkaban logs to the results. After these changes, Azkaban logs will get added in No logs found or no relevant stack traces found in both ApplicationMaster's STDERR and STDOUT logs.

HOW ARE THE CHANGES TESTED Modified the unit test case to verify if the logic is behaving as expected. Testing on EI machine.

pralabhkumar commented 4 years ago

LGTM

ShubhamGupta29 commented 4 years ago

Thanks for the review and for merging the change @pralabhkumar.