feat: Support Spark-3.1 version.

openucx / sparkucx

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

https://www.sparkucx.org/

BSD 3-Clause "New" or "Revised" License

44 stars 31 forks source link

feat: Support Spark-3.1 version. #36

Closed trietopsoft closed 2 years ago

trietopsoft commented 2 years ago

Adding Spark 3.1 function calls for reader/writer, specifically: startMapIndex: Int and endMapIndex: Int. Pull request follows existing support for 3.0, etc.

petro-rudenko commented 2 years ago

Please make a PR to https://github.com/NVIDIA/sparkucx - new repository for SparkUCX development. Here is an archive of the project