issues
search
NVIDIA
/
sparkucx
A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer
https://www.sparkucx.org/
BSD 3-Clause "New" or "Revised" License
22
stars
14
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Project status?
#36
neverlink
opened
5 months ago
1
Wait driver endpoint start up in shuffle manger initialization
#35
jeynmann
opened
10 months ago
0
Support reply in slices for large block.
#34
jeynmann
opened
10 months ago
0
Support spill to disk
#33
jeynmann
opened
10 months ago
0
Fix invalid capacity when `getByteBufferView` of 2G block
#32
jeynmann
opened
10 months ago
1
Support external shuffle service
#31
jeynmann
opened
1 year ago
1
add synchronization for transport initialization
#30
jeynmann
closed
1 year ago
2
do not save worker address in executor address map
#29
jeynmann
closed
1 year ago
0
[DNM] Select worker round robin
#28
jeynmann
opened
1 year ago
0
Client/Server use wakeup feature and their own thread
#27
jeynmann
opened
1 year ago
0
Load UCX libs explicitly
#26
brianplus
closed
1 year ago
1
Fix invalid parameter issue when force to close endpoint
#25
brianplus
opened
1 year ago
3
[DNM] Typo fixes + debug logs + remove ep flush.
#24
petro-rudenko
opened
1 year ago
0
Count backward eps in numEps hint.
#23
petro-rudenko
closed
2 years ago
0
Update to UCX-1.13 + some cleaning.
#22
petro-rudenko
closed
2 years ago
0
Multiple server threads.
#21
petro-rudenko
closed
2 years ago
0
Random order read in SparkUcx perf benchmark.
#20
petro-rudenko
closed
2 years ago
0
Support multiple files to perf benchmark
#19
huaxiangfan
closed
2 years ago
0
Print error when target file doesn't exist.
#18
petro-rudenko
opened
2 years ago
0
Flush connection ep to make sure backwards ep established.
#17
petro-rudenko
closed
2 years ago
0
Batch reply protocol
#16
petro-rudenko
closed
2 years ago
0
Fix amdata close in IO helper thread.
#15
petro-rudenko
closed
2 years ago
0
Memory handle hint.
#14
petro-rudenko
closed
2 years ago
0
Remove spark-2.1 from actions.
#13
petro-rudenko
closed
2 years ago
0
Few minor fixes.
#12
petro-rudenko
closed
2 years ago
0
Fix jar name for release action.
#11
petro-rudenko
closed
2 years ago
0
AZP: Change pool executors
#10
avildema
closed
2 years ago
0
Fix dockerfile image for signoff check
#9
petro-rudenko
closed
2 years ago
0
SparkUCX new protocol.
#8
petro-rudenko
closed
2 years ago
0
AZP: Fix AZP tests.
#7
petro-rudenko
closed
2 years ago
0
[DNM] Test CI.
#6
petro-rudenko
closed
2 years ago
0
Signoff check action.
#5
petro-rudenko
closed
2 years ago
0
AZP: Add big test
#4
avildema
closed
2 years ago
0
feat: Support Spark-3.1 version.
#3
trietopsoft
opened
3 years ago
2
Flush on endpoint.
#2
petro-rudenko
closed
3 years ago
0
[MINOR] Update project info. Rename to ucx-spark.
#1
petro-rudenko
closed
3 years ago
1