AbsaOSS / hyperdrive

Extensible streaming ingestion pipeline on top of Apache Spark
Apache License 2.0
44 stars 13 forks source link

Remove SparkUtils #139

Closed kevinwallimann closed 4 years ago

kevinwallimann commented 4 years ago

SparkUtils is never used and should be removed. It contains code for making a schema nullable by creating a new dataframe. However, this approach doesn't work for streaming (throws exception)

This issue solves the last point in #106