[CORE] Split common / version dependent code.

openucx / sparkucx

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

https://www.sparkucx.org/

BSD 3-Clause "New" or "Revised" License

45 stars 31 forks source link

Closed petro-rudenko closed 4 years ago

petro-rudenko commented 4 years ago

Initial spark-3.0 support:

Split version dependent code to spark-2.4 and spark-3.0 folders.
Fully works for spark-2.4
For spark-3.0 starts ucx node and using TCP mapper and reducers for now (will update in susequent PRs)
Added matrix testing for spark-2.4 and spark-3.0

sonarcloud[bot] commented 4 years ago

Kudos, SonarCloud Quality Gate passed!