AbsaOSS / spark-commons

Apache License 2.0
7 stars 0 forks source link

Move `ErrorMessage` type from spark-data-standardization into spark-commons #78

Closed benedeki closed 1 year ago

benedeki commented 1 year ago

Background

ErrorMessage complex (data) type has wider usage than just in the Standardization.

Feature

Move the type ErrorMessage from spark-data-standardization into spark-commons. Include ErrorMessage.errorColSchema method and errorColumnName constant.

To discuss

TheMappingtype is marked as for discussion. For starters let's keep it as it is. maybe just move it as a subtype ofobject ErrorMessage`, if it will work.