Benchmark on performance

openucx / sparkucx

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

https://www.sparkucx.org/

BSD 3-Clause "New" or "Revised" License

44 stars 31 forks source link

Open TheForgotten69 opened 4 years ago

TheForgotten69 commented 4 years ago

Do you have any input on the difference between this shuffle manager and the default one performance wise ? Thanks