AbsaOSS / hyperdrive

Extensible streaming ingestion pipeline on top of Apache Spark
Apache License 2.0
44 stars 13 forks source link

Remove explicit app name setting #267

Closed kevinwallimann closed 2 years ago

kevinwallimann commented 2 years ago

Remove ingestor.spark.app.name setting.

This property is redundant to the spark.app.name config and should therefore be removed. Moreover, since the property is mandatory, it's impossible to set the app name using the spark.app.name property, which unnecessarily reduces flexibility.