AbsaOSS / spark-commons

Apache License 2.0
7 stars 0 forks source link

ErrorHandling documentation and fields renames #101

Closed benedeki closed 1 year ago

benedeki commented 1 year ago

Background

The ErrorHandling is missing description (at least of the main classes and their methods. Also some methods and parameters have misleading names.

Feature

Add ScalaDoc_ and rename the misleading. functions.

Proposed Solution

Solution Ideas:

### Tasks
- [x] errCol / errCols => errSrcCol or srcColWithError or something like that
- [x] putErrorToColumn => createErrorAsColumn
- [x] aggregateErrorColumns => applyErrorColumnsToDataFrame
- [x] Merge `ErrorHandlingCommon` into `ErrorHandling`