Remove usage of hadoop.env file from Spark

TrivadisPF / platys-modern-data-platform

Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....

Apache License 2.0

72 stars 15 forks source link

Remove usage of hadoop.env file from Spark #922

Open gschmutz opened 1 month ago

gschmutz commented 1 month ago

The hadoop.env is from the days of Hadoop with Spark and should be removed and replaced by environment variables inside docker-compose.yml. This improves consistency and understandability.