salesforce / TransmogrifAI

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
https://transmogrif.ai
BSD 3-Clause "New" or "Revised" License
2.24k stars 392 forks source link

Get Hadoop config from Spark session #542

Closed nicodv closed 3 years ago

nicodv commented 3 years ago

Related issues N/A

Describe the proposed solution We were getting a fresh Hadoop configuration, instead of getting it from the SparkSession. Hence, it will miss out on any configurations that were set.

Describe alternatives you've considered N/A

Additional context N/A