Is UCX also supported in spark 3.1.2 with java 11

openucx / sparkucx

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

https://www.sparkucx.org/

BSD 3-Clause "New" or "Revised" License

45 stars 31 forks source link

Is UCX also supported in spark 3.1.2 with java 11 #37

Open KunwarAkanksha opened 2 years ago

KunwarAkanksha commented 2 years ago

We are working on spark 3.1.2 with java version 11 , we don't wan tto degrade our cluster can somebody tell me if it will also work on java 11 with spark 3.1.2

mtsol commented 2 years ago

I tried with spark 3.1 and it didn't work, when I try with spark 3.0, it worked.

Can you tell me if I am doing anything wrong.