issues
search
Mellanox
/
SparkRDMA
This is archive of SparkRDMA project. The new repository with RDMA shuffle acceleration for Apache Spark is here: https://github.com/Nvidia/sparkucx
Apache License 2.0
240
stars
70
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Errors when using 2 or more nodes
#37
SmirAlex
opened
3 years ago
1
ClassNotFoundException: org.apache.spark.shuffle.rdma.RdmaShuffleManager
#36
UntaggedRui
opened
4 years ago
4
ERROR RdmaNode: libdisni not found! It must be installed within the java.library.path on each Executor and Driver instance
#35
RummySugar
opened
4 years ago
3
Steam is corrupted when shuffle read with RDMA Shuffle Manager
#34
tobegit3hub
opened
5 years ago
8
Fail to write HDFS with custom codec when using SparkRDMA
#33
tobegit3hub
closed
5 years ago
7
Use default numCompletionVectors if disni returns negative.
#32
petro-rudenko
opened
5 years ago
0
Error in accept call on a passive RdmaChannel
#31
rmunoz527
opened
5 years ago
23
Need memory overhead to run Spark RDMA shuffler
#30
tobegit3hub
closed
5 years ago
4
Add libdisni.so in wiki to test performance of SparkRDMA
#29
tobegit3hub
closed
5 years ago
1
Fail to re-produce the speed-up of TeraSort with SparkRDMA
#28
tobegit3hub
closed
5 years ago
2
java.lang.NoClassDefFoundError: Could not initialize class com.ibm.disni .rdma.verbs.impl.NativeDispatcher
#27
Akshay-Venkatesh
closed
5 years ago
4
libdisni resolve hostname with another IP instead of the IP from RdmaNode
#26
tobegit3hub
closed
5 years ago
3
Fail to setup RoCE IP for Spark in Yarn-cluster mode
#25
tobegit3hub
closed
5 years ago
9
spark on yarn Compatibility between different versions？
#24
chenzhaohangbj
opened
5 years ago
13
spark rdma IBV_WC_WR_FLUSH_ERR
#23
xluckly
opened
5 years ago
4
Seeing ERROR RdmaNode: Failed in RdmaNode constructor in Standalone cluster mode
#22
Akshay-Venkatesh
closed
5 years ago
2
Getting lower RDMA perf that TCP/IP perf
#21
gilbertc777
opened
5 years ago
16
SPARK RDMA , HIBENCH not able to run.
#20
caiqingsong
closed
5 years ago
17
Fix mmap error on systems with page size different from 4k
#19
petro-rudenko
closed
5 years ago
0
Catch NullPointerException to not print in error log
#18
petro-rudenko
closed
5 years ago
1
SparkRDMA issue:ERROR scheduler.TaskSetManager: Task 45 in stage 1.0 failed 4 times; aborting job
#17
XianlaiShen
closed
5 years ago
10
SparkRDMA issue:ERROR scheduler.TaskSetManager: Task 45 in stage 1.0 failed 4 times; aborting job
#16
XianlaiShen
closed
5 years ago
0
Release 3.1
#15
petro-rudenko
closed
5 years ago
0
Fix readme2
#14
petro-rudenko
closed
5 years ago
0
Fix README merge conflict
#13
petro-rudenko
closed
5 years ago
0
Release 3.0
#12
petro-rudenko
closed
5 years ago
0
spark rdma error
#11
li7hui
opened
5 years ago
15
[error] terasort on spark rdma
#10
li7hui
closed
5 years ago
3
Release 2.0
#9
petro-rudenko
closed
6 years ago
0
SparkRDMA 2.0 release
#8
petro-rudenko
closed
6 years ago
0
Spark RDMA release v2.0
#7
petro-rudenko
closed
6 years ago
0
[SparkRDMA] spark-terasort job hangs at last stage when using spark-rdma plugin
#6
li7hui
closed
6 years ago
3
[SparkRDMA] set up SPARK_LOCAL_IP for RoCE network
#5
li7hui
closed
6 years ago
7
Integrate README fix
#4
yuvaldeg
closed
6 years ago
0
Merge from internal dev branch
#3
yuvaldeg
closed
6 years ago
0
TeraSort performance chart for README
#2
yuvaldeg
closed
7 years ago
8
Update README.md
#1
yuvaldeg
closed
7 years ago
0