AbsaOSS / spark-commons

Apache License 2.0
7 stars 0 forks source link

Implement error handling by putting the info into a log file #87

Open benedeki opened 1 year ago

benedeki commented 1 year ago

Background

One of the provided ErrorHandling implementations. The ErrorMessage entries should go out to a log file.

Feature

Write errors into a log file, they won't appear in the result DataFrame.

Opened question:

Do we want to "pollute" the spark-commons library with a chosen standard logging implementation?