Open dbseraf1 opened 2 years ago
Great suggestion.
Quick notes for myself or whoever may pick this up:
Add config for the retry here:
Consume the config and handle the retry here:
And document it in README.md here:
@dbseraf1 You can save the output to a file or hdfs so you don't lose the results of the run if it fails to send the email.
If you can't wait for this issue to be resolved, you could also use the Pipe output option to specify a program to run which can read the jsonReport
from stdin and send an email.
Currently, if sending email fails because the email server is temporarily offline or overloaded, the only choice of action is to rerun the whole validation. This can be very expensive, and may require manual intervention if the program is running as part of an automatic workflow.
It would be better if the program detected the error in sending email and did its own wait-and-retry loop. This would be pretty cheap and much better than failing.