Mellanox SparkRDMA issues

Mellanox / SparkRDMA

This is archive of SparkRDMA project. The new repository with RDMA shuffle acceleration for Apache Spark is here: https://github.com/Nvidia/sparkucx

Apache License 2.0

241 stars 70 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Errors when using 2 or more nodes

#37 SmirAlex opened 4 years ago
1
ClassNotFoundException: org.apache.spark.shuffle.rdma.RdmaShuffleManager

#36 UntaggedRui opened 5 years ago
4
ERROR RdmaNode: libdisni not found! It must be installed within the java.library.path on each Executor and Driver instance

#35 RummySugar opened 5 years ago
3
Steam is corrupted when shuffle read with RDMA Shuffle Manager

#34 tobegit3hub opened 5 years ago
8
Fail to write HDFS with custom codec when using SparkRDMA

#33 tobegit3hub closed 5 years ago
7
Use default numCompletionVectors if disni returns negative.

#32 petro-rudenko opened 5 years ago
0
Error in accept call on a passive RdmaChannel

#31 rmunoz527 opened 5 years ago
23
Need memory overhead to run Spark RDMA shuffler

#30 tobegit3hub closed 5 years ago
4
Add libdisni.so in wiki to test performance of SparkRDMA

#29 tobegit3hub closed 5 years ago
1
Fail to re-produce the speed-up of TeraSort with SparkRDMA

#28 tobegit3hub closed 5 years ago
2
java.lang.NoClassDefFoundError: Could not initialize class com.ibm.disni .rdma.verbs.impl.NativeDispatcher

#27 Akshay-Venkatesh closed 5 years ago
4
libdisni resolve hostname with another IP instead of the IP from RdmaNode

#26 tobegit3hub closed 5 years ago
3
Fail to setup RoCE IP for Spark in Yarn-cluster mode

#25 tobegit3hub closed 5 years ago
9
spark on yarn Compatibility between different versions？

#24 chenzhaohangbj opened 5 years ago
13
spark rdma IBV_WC_WR_FLUSH_ERR

#23 xluckly opened 5 years ago
4
Seeing ERROR RdmaNode: Failed in RdmaNode constructor in Standalone cluster mode

#22 Akshay-Venkatesh closed 5 years ago
2
Getting lower RDMA perf that TCP/IP perf

#21 gilbertc777 opened 5 years ago
16
SPARK RDMA , HIBENCH not able to run.

#20 caiqingsong closed 5 years ago
17
Fix mmap error on systems with page size different from 4k

#19 petro-rudenko closed 5 years ago
0
Catch NullPointerException to not print in error log

#18 petro-rudenko closed 5 years ago
1
SparkRDMA issue:ERROR scheduler.TaskSetManager: Task 45 in stage 1.0 failed 4 times; aborting job

#17 XianlaiShen closed 5 years ago
10
SparkRDMA issue:ERROR scheduler.TaskSetManager: Task 45 in stage 1.0 failed 4 times; aborting job

#16 XianlaiShen closed 5 years ago
0
Release 3.1

#15 petro-rudenko closed 5 years ago
0
Fix readme2

#14 petro-rudenko closed 6 years ago
0
Fix README merge conflict

#13 petro-rudenko closed 6 years ago
0
Release 3.0

#12 petro-rudenko closed 6 years ago
0
spark rdma error

#11 li7hui opened 6 years ago
15
[error] terasort on spark rdma

#10 li7hui closed 6 years ago
3
Release 2.0

#9 petro-rudenko closed 6 years ago
0
SparkRDMA 2.0 release

#8 petro-rudenko closed 6 years ago
0
Spark RDMA release v2.0

#7 petro-rudenko closed 6 years ago
0
[SparkRDMA] spark-terasort job hangs at last stage when using spark-rdma plugin

#6 li7hui closed 6 years ago
3
[SparkRDMA] set up SPARK_LOCAL_IP for RoCE network

#5 li7hui closed 6 years ago
7
Integrate README fix

#4 yuvaldeg closed 7 years ago
0
Merge from internal dev branch

#3 yuvaldeg closed 7 years ago
0
TeraSort performance chart for README

#2 yuvaldeg closed 7 years ago
8
Update README.md

#1 yuvaldeg closed 7 years ago
0