search

salesforce / TransmogrifAI

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
https://transmogrif.ai
BSD 3-Clause "New" or "Revised" License
2.24k stars 393 forks source link

Apache Spark 2.4.X compatible version #443

Closed asoriano-stratio closed 4 years ago

asoriano-stratio commented 4 years ago

Hi! I have seen that some work has been done in order to update Spark version to 2.4.X. (but seems that it is freezed).

I would like to know if this update is still in the Roadmap and if there exists an estimation about when it can be completed.

Thanks!

tovbinm commented 4 years ago

We can make a special version release for Spark 2.4.

@leahmcguire when is the next time you were planning to make a release?

nicodv commented 4 years ago

@asoriano-stratio , we're actually working on this behind the scenes, and are quite close to having a new release with Spark 2.4.4. Stay tuned.

andresdoncel-stratio commented 4 years ago

Any updates on this issue? I'd like to know why was it closed.

nicodv commented 4 years ago

@andresdoncel-stratio , see comments in this PR for the latest info: https://github.com/salesforce/TransmogrifAI/pull/402

nicodv commented 4 years ago

For those interested: the Spark 2.4.4 upgrade has been merged to the master branch.

In the meantime, Spark 2.4.5 was released... We will be upgrading to that soon, and subsequently release a new TransmogrifAI 0.7.0 version based on that.